Contributors: O. Bobryshev (Deutscher Wetterdienst)

Issued by: Deutscher Wetterdienst (DWD) / Oleksandr Bobryshev

Date: 14/11/2023

Ref: C3S2_D312a_Lot1.1.2.6-v3.0_202311_PQAD_ECVEarthRadiationBudget_v1.2

Official reference number service contract: 2021/C3S2_312a_Lot1_DWD/SC1

Table of Contents

History of Modification

Version

Date

Description of modification

Chapters / Sections

V1.0

14/11/2023

First version

All

V1.1

27/10/2023

Document revised following feedback from independent review

All

V1.2

14/11/2023

Document revised following feedback from independent review

Chapter 4.3

List of datasets covered by this document

Deliverable ID

Product title

Product type (CDR, ICDR)

Version number

Delivery date

D2.6.3

ECV Surface Radiation Budget brokered from EUMETSAT’s CM SAF CLARA-A3 TCDR

CDR

V3.0

30/06/2023

D2.6.4-P1/2/3

ECV Surface Radiation Budget brokered from EUMETSAT’s CM SAF CLARA-A3 ICDR

ICDR

V3.0

30/06/2023 - onward

Related documents

Reference ID

Document

D1

Validation Report, CM SAF Cloud, Albedo, Radiation data record, AVHRR-based, Edition 3 (CLARA-A3) Top-of-Atmosphere Radiation

Code: SAF/CM/RMIB/VAL/GAC/TOA, Issue 1.1

https://www.cmsaf.eu/SharedDocs/Literatur/document/2023/saf_cm_rmib_val_gac_toa_1_1_pdf.pdf?__blob=publicationFile

Last accessed on 12/10/2023

D2

CDOP-4, Product Requirements Document

Code: SAF/CM/DWD/PRD, Issue 4.2

https://www.cmsaf.eu/SharedDocs/Literatur/document/2023/saf_cm_dwd_prd_4_2_pdf.pdf?__blob=publicationFile&v=2

Last accessed on 11/10/2023

D3

Algorithm Theoretical Basis Document, CM SAF Cloud, Albedo, Radiation data record, AVHRR-based, Edition 3 (CLARA-A3) Top-of-Atmosphere Radiation

Code: SAF/CM/RMIB/ATBD/GAC/TOA, Issue 1.5

https://www.cmsaf.eu/SharedDocs/Literatur/document/2023/saf_cm_rmib_atbd_gac_toa_1_5_pdf.pdf?__blob=publicationFile

Last accessed on 12/10/2023

D4

Climate Algorithm Theoretical Basis Document (C-ATBD), ISCCP-FH Radiative Flux Profile Product

Issue 1.1

https://data.giss.nasa.gov/isccp/flux-fh/docs/C-ATBD_ISCCP-FH.pdf

Last accessed on 12/10/2023

Acronyms

Acronym

Definition

4DVAR

4-dimensional variational assimilation

ATBD

Algorithm Theoretical Basis Document

AVHRR

Advanced Very High Resolution Radiometer

C3S

Copernicus Climate Change Service

C3S2

Copernicus Climate Change Service – Phase 2

CCI

Climate Change Initiative

CDOP-4

Continuous Development and Operations Phase – 4

CDR

Climate Data Record

CDS

Climate Data Store

CERES

Clouds and the Earth’s Radiant Energy System

CLARA-A3

CM SAF cLoud, Albedo and surface Radiation dataset from AVHRR data - Edition 3

Cloud_cci

Cloud Climate Change Initiative

CM SAF

Satellite Application Facility on Climate Monitoring

DWD

Deutscher Wetterdienst

EBAF

Energy Balanced and Filled

ECMWF

European Centre for Medium-Range Weather Forecast

ECV

Essential Climate Variable

ERA5

ECMWF Reanalysis v5

ERB

Earth Radiation Budget

ESA

European Space Agency

EUMETSAT

European Organisation for the Exploitation of Meteorological Satellites

GAC

Global Area Coverage

GCM

The general circulation model

GCOS

Global Climate Observing System

GISS

The Goddard Institute for Space Studies

GOES

Geostationary Operational Environmental Satellites

HIRS

High Resolution Infrared Radiation Scanner

ICDR

Interim Climate Data Record

IFS

Integrated Forecasting System

ISCCP

International Satellite Cloud Climatology Project

LW

LongWave

Meteosat

Meteorological satellite

Metop

Meteorological Operational Satellite

MODIS

Moderate Resolution Imaging Spectroradiometer

NASA

National Aeronautics and Space Administration

NCEI

National Centers for Environmental Information

NESDIS

National Environmental Satellite, Data, and Information Service

NOAA

National Oceanic and Atmospheric Administration

OLR

Outgoing Longwave Radiation

PQAD

Product Quality Assurance Document

RadH

The radiation code recently developed based on RadE (Radiation code of NASA GISS GCM ModelE)

RadH-PRD

Production code using RadH and mainly ISCCP H-series data product

RMIB

Royal Meteorological Institute of Belgium

RSF

Reflected Solar Flux

SW

ShortWave

SYN

Synoptic TOA and surface fluxes and clouds (CERES product)

TCDR

Thematic Climate Data Record

TIROS-N

Television and Infra-Red Observation Satellite - N

TOA

Top Of the Atmosphere

List of figures


List of tables

Table 1-1: General characteristics of the brokered CLARA-A3 TOA radiation products

Table 4-1: Summary of the achieved accuracy of the brokered CLARA-A3 TOA radiation products

General definitions

Variables

Abbreviation

Definition

Reflected Solar Flux

RSF

The Top-of-Atmosphere (TOA) Reflected Solar Flux (RSF) quantifies the total amount of solar radiation which is reflected back to space by the Earth and its atmosphere. The RSF is also sometime called shortwave flux. This quantity is expressed as flux (density) in W/m².

Outgoing Longwave Radiation

OLR

The Top-of-Atmosphere TOA Outgoing Longwave Radiation (OLR) is the total amount of energy (thermally) emitted by the Earth and escaping to space. OLR is often called longwave or thermal flux. This quantity is expressed as flux (density) in W/m²

Processing level

Definition

Level-1

The full-resolution geolocated radiometric measurements (for each view and each channel).

Level-2

Derived geophysical variables at full input data resolution and location as L1 source data.

Level-3

Geophysical variables mapped on uniform spacetime grid, derived from one or multiple satellites/radiometers, possibly averaged over a specific time period to give for example monthly and daily means.

Term

Definition

Brokered product

The C3S Climate Data Store (CDS) provides both datasets produced within the C3S and so-called brokered products. The latter are existing products (data) produced under an independent programme or project which are made available through the CDS.

TCDR

A Thematic Climate Data Record is a consistently processed time series of a geophysical variable. The time series should be of sufficient length and quality.

ICDR

An Interim Climate Data Record (ICDR) denotes an extension of TCDR, processed with a processing system as consistent as possible to the generation of TCDR.

User requirements

Depending on the different user needs, different product requirements may be applied and they are used to evaluate validation results. This document uses three categories: threshold, target and optimal accuracies. They are defined keeping in mind different target users: operational climate monitoring, global and regional climate modelling and global and regional climate studies, respectively.

ISCCP FH MPF

ISCCP Flux product from H-series, PFR is defined as Top-of-Atmosphere Radiation + Surface Budget Radiation, MPF is defined as monthly mean PRF

The product contains 91 parameters of TOA and Surface Radiation Fluxes in NetCDF-4 format with monthly means and global coverage (spatial resolution of 110 km)

Taken from: https://isccp.giss.nasa.gov/products/products.html

ISCCP H-Series

International Satellite Cloud Climatology Project product series “H”. Successor of series “D”.

BUGSrad

The broad-band radiative transfer software used to generate the radiative flux values.

Statistical metrics

Definition

Optimal requirement

This is a level where a product is considered to perform much

better than expected given the current knowledge.

Target requirement

This is the main quality goal for a product. It should reach

this level based on the current knowledge on what is reasonable to achieve.

Threshold requirement

A product should at least fulfil this level to be considered

useful at all. Sometimes the term ‘Breakthrough” is used instead.

Scope of the document

This Product Quality Assurance Document (PQAD) provides a description of the product validation methodology for the Top-Of-Atmosphere (TOA) radiation products of the Climate Data Record (CDR) CM SAF Cloud, Albedo, Radiation data record, AVHRR-based, Edition 3 (CLARA-A3), which is a brokered service from EUMETSAT's CM SAF, and its extension with an Interim Climate Data Record (ICDR) derived from the Advanced Very High Resolution Radiometer (AVHRR).

This document mostly refers to the original Satellite Application Facilities on Climate Monitoring (CM SAF) Validation Report [D1] that encompasses an extensive evaluation of the Top-Of-Atmosphere (TOA) radiation Thematic Climate Data Record (TCDR) version 3 product. The ICDR extension of the EUMETSAT CM SAF CLARA-A3 dataset is derived using the same algorithm and processing chain. Additionally, this document refers to the CM SAF Validation Report [D1] with a specific section for the ICDR evaluation.

This document is not part of the official CM SAF documentation but produced solely in the scope of data brokering to the Climate Data Store (CDS).

Executive summary

The TCDR on the Essential Climate Variable (ECV) Earth Radiation Budget is a brokered product of the CLARA-A3 dataset produced by EUMETSAT's CM SAF. The extending ICDR is also a brokered product of EUMETSAT's CLARA-A3 ICDR, also produced by EUMETSAT's CM SAF. Accordingly, this document largely refers to the corresponding EUMETSAT CM SAF original documentation [D1,D3].

The brokering service of the CLARA-A3 data products includes 42 years (1979-2020) of level-3 data (monthly and daily means) on a regular global latitude-longitude grid (with 0.25° x 0.25° resolution), merged from various polar orbiting satellites. It includes two products: the TOA Reflected Solar Flux and the TOA Outgoing Longwave Radiation (OLR). This CDR is brokered from EUMETSAT’s CM SAF. Therefore, this document only refers to the validation results from the original EUMETSAT CM SAF Validation Report [D1]. A brief summary of the validation products (CLARA-A3 in section 1 and reference datasets in section 2) can be found in the following sections.

Section 3 contains a description of the validation methodology, while section 4 gives a brief summary of the validation results.

1. Validated products

The validated dataset is the CLARA-A3 dataset produced by EUMETSAT's CM SAF and brokered to the Climate Data Store (CDS).

The data products brokered from CM SAF CLARA-A3 are:

  • the Reflected Solar Flux (RSF),

  • the Outgoing Longwave Radiation (OLR).

The CM SAF CLARA TOA radiation data record is derived from successive AVHRR sensors onboard dedicated polar orbiting platforms, including TIROS-N, NOAA, and Metop satellites. AVHRR observations are used to derive spatio-temporal averaged data sets. The final product is available as monthly and daily averages on a regular latitude-longitude grid with a spatial resolution of 0.25° × 0.25° degrees. The TCDR comprises 42 years of data ranging from January 1979 to December 2020. Main characteristics of the CDR are summarized in Table 1-1. The detailed description of the algorithm used to generate the TOA radiation CDR is given in the CM SAF Algorithm Theoretical Basis Document [D3].

Table 1-1: General characteristics of the brokered CLARA-A3 TOA radiation products

Characteristics

Description

TOA radiation products

Outgoing Longwave Radiation (OLR), Reflected Solar Flux (RSF)

Operational satellite input

AVHRR GAC data from NOAA and Metop satellites

Other operational input

ECMWF ERA5

Spatial coverage

Global

Spatial resolution

0.25° x 0.25°

Temporal resolution

Daily mean, monthly mean

Record length

1979-2020 (with ICDR extensions after 2020)

2. Description of validating datasets

The validation for the TCDR is based on a set of satellite-based reference data records. They are CERES EBAF Ed. 4.1, CERES SYN1deg, HIRS OLR Daily v01r02, HIRS OLR Monthly v02r07, ERA5 (reanalysis), ISCCP FH MPF 1 and Cloud_cci v3.0. These are described in detail in the CM SAF Validation Report [D1], Section 4 and are summarized in the following.

2.1 CERES SYN1deg and CERES EBAF Ed 4.1

A brief description of the dataset can be found in [D1], Section 3.1 and 3.2.

Two CDR’s CERES SYN1deg and CERES EBAF Ed4.1 provide level 3 TOA Reflected Solar Flux (RSF) and Outgoing Longwave Radiation (OLR) in all sky and clear sky conditions. Both datasets comprise 22 years (March 2000 – March 2022) of satellite-based measurements derived from the Clouds and the Earth’s Radiant Energy System (CERES) instruments onboard the polar orbiting Terra and Aqua NASA EOS satellites. The CERES instruments are broadband radiometers developed as part of the NASA's Earth Observing System (EOS) program.

The CERES SYN1deg CDR provides estimates of the daily and monthly RSF and OLR fluxes on a 1°x1° nested grid. The CDR uses CERES-observed measurements, enhanced by geostationary observations 2 .

The CERES EBAF Ed 4.1 CDR provides estimates of the monthly RSF and OLR fluxes at 1° x 1° regular latitude-longitude grid. This CDR uses improved algorithm of ingesting the geostationary observations. A one-time adjustment to RSF and OLR fluxes within their ranges of uncertainty is made to remove the inconsistency between average global net TOA flux and heat storage in the Earth-atmosphere system.

2.2 HIRS OLR Daily v01r02 and Monthly v02r07

A brief description of the dataset can be found in [D1], Sections 4.3 and 4.4.

The HIRS OLR product is based on the data acquired by the High Resolution Infrared Radiation Sounder (HIRS) instruments measuring radiances in the infrared (IR). The instruments used for this CDR come from four successive versions of the instrument: HIRS/2, HIRS/2I, HIRS/3 and HIRS/4. They are installed onboard the NOAA and MetOp satellites. At the time of writing, the dataset comprises more than 43 years (January 1979 onward).

The version v01r02 of the HIRS OLR CDR provides daily mean Outgoing Longwave Radiation (OLR) in all sky conditions. The OLR estimates from geostationary observations (Geostationary Operational Environmental Satellites (GOES) series of satellites and Meteosat series of satellites) are used to allow accurate temporal integration of the daily mean OLR. This CDR is a level 3 product (daily means) on a regular global latitude-longitude grid with 1° x 1° resolution.

The version v02r07 of the HIRS OLR CDR provides monthly daily mean Outgoing Longwave Radiation (OLR) in all sky conditions. In contrast to HIRS daily CDR, this CDR doesn’t use information from the geostationary satellites. The spatial resolution of the monthly mean HIRS OLR CDR is 2.5° x 2.5°.

2.3 ERA5

A brief description of the dataset can be found in [D1], Section 4.5.

ERA5 is the fifth generation ECMWF reanalysis for the global climate and weather for the past 8 decades. The model is the Integrated Forecasting System (IFS) cycle 41r2 with a 4-D variational analysis (4DVAR) assimilation system. The temporal resolution is 1 hour, and output data are interpolated on a regular latitude-longitude grid of 0.25°x0.25°. The ERA5’s radiation scheme is described in (Hogan, et al. 2018)

2.4 ISCCP-FH

A brief description can be found in [D1], Section 4.6.1.

The International Satellite Cloud Climatology Project (ISCCP-FH) is a third generation, high resolution version of the ISCCP radiative flux products. It includes all upwelling and downwelling, shortwave and longwave radiative fluxes at the top of the atmosphere (TOA), at three levels in the atmosphere, and at the surface using aradiative transfer model RadH-PRD [D4]. The H series 3 CDR covers the period from July 1983 through June 2017 on a regular latitude-longitude grid with 1°x1° resolution.

2.5 Cloud_cci

A brief description can be found in [D1], section 8.5.

European Space Agency’s (ESA's) Cloud Climate Change Initiative (Cloud_cci) provides the Cloud_cci AVHRR-PM version 3.0 dataset based on the afternoon orbit NOAA-satellites. TOA fluxes are calculated using a radiative transfer model (BUGSrad 4 ). The Level-3 monthly mean data are provided on a regular latitude-longitude grid of 0.5°x0.5° for the period of 1982-2018.

2.6 Reference datasets for the ICDR

The CLARA-A3 TOA radiation products TCDR used as a reference dataset is described in Section 1 and in [D1], Section 3.

3. Description of product validation methodology

The validation methodology is described in detail in [D1], Section 5 and summarized in the following.

Target requirements for the use of TOA radiation products are formulated in the CM SAF Product Requirement Document [D2]. They include ‘accuracy’ and stability requirements. The CLARA-A3 TOA radiation products cannot be considered independent of CERES products [D3]. The accuracy requirement thus is not “absolute radiometric error”, but an overall bias with respect to a reference data record. The stability is also defined as consistent temporally consistent bias to the reference dataset, over a period of 10 years (decade).

The TOA radiation products are provided at 0.25° x 0.25° spatial resolution, most of the validation is performed at a coarser spatial resolution of 1°x1° of CERES SYN1deg nested grid. Bias for a single grid box with indices (i,j) is calculated as:


\( B_{i,j}=F_{CLARA,i,j} - F_{REF,i,j} \ \ (Eq. 1) \)


, with  \( F_{CLARA} \) and  \( F_{REF} \) as Fluxes for respective datasets in W/m².

The global mean bias is calculated over all biases for a single grid box as follows:


\( MB = \frac{1}{m*n} \sum_{i=1}^m \sum_{j=1}^n w_j(B_{i,j}) = \frac{1}{m*n} \sum_{i=1}^m \sum_{j=1}^n w_j(F_{CLARA,i,j} - F_{REF,i,j}) \ \ (Eq. 2) \)

Where m and n are the number of grid boxes and  \( w_j \) is a meridionally varying weighting factor to correct the equal angle grid boxes to equal area grid boxes (to prevent an overrepresentation of the polar areas).

The global mean absolute bias (MAB), bias corrected is calculated as follows:


\( MAB = \frac{1}{m*n} \sum_{i=1}^m \sum_{j=1}^n w_j|B_{i,j} - MB| = \frac{1}{m*n} \sum_{i=1}^m \sum_{j=1}^n w_j |F_{CLARA,i,j} - F_{REF,i,j} - MB| \ \ (Eq. 3) \)


The MAB is used in the Validation Report [D1] to report the accuracy.

Spatially explicit validation, such as MAB, is sensitive for the spatial gaps. For the purposes of the validation, the spatial gaps in daily OLR and RSF are filled using daily mean ERA5 as ‘surrogate data record’.

CLARA-A3 TOA products ICDR is solely assessed based on how closely it resembles the CLARA-A3 TCDR despite the difference in the input data. TCDR and ICDR parts have the overlapping period of six months from 07/2020 to 12/2020.

4. Summary of validation results

Validation results of TCDR and ICDR are described in detail in [D1], Sections 6-7 and summarized briefly in the following.

The RSF and OLR data products are validated for accuracy and stability against satellite-based reference data records. The achieved accuracy is summarized in Table 4-1 below. Both products OLR and RSF fulfil the threshold requirements, as defined in the CM SAF Product Requirement Document [D2], on both time scales: monthly and daily.

Table 4-1: Summary of the achieved accuracy of the brokered CLARA-A3 TOA radiation products, [D1] Section 1 for RSF and OLR for TCDR and ICDR

Product Name

Temporal resolution

Product accuracy [W/m2]

Threshold/ Target / Optimal accuracies

Reference Data Record

RSF

Monthly

3.2

8 / 4 / 2

CERES

Daily

9

16 / 8 / 4

CERES

OLR

Monthly

1.8

8 / 4 / 2

HIRS

Daily

4.8

16 / 8 / 4

HIRS

4.1 Validation results for Reflected Solar Flux (RSF)

Validation results are described in detail in CM SAF Validation Report [D1], Section 6. The CLARA-A3 product on RSF meets optimal accuracy criterions, as specified in the [D2].

4.2 Validation results for Outgoing Longwave Radiation (OLR)

Validation results are described in detail in CM SAF Validation Report [D1], Section 7. The CLARA-A3 product on OLR meets optimal accuracy criterions, as specified in the [D2].

4.3 Validation results for ICDR products

Validation results are described in detail in CM SAF Validation Report [D1], Section 4.7.

Results of the comparison between the TCDR and ICDR products, show only very small differences, enough to demonstrate that the ICDR products meet all the requirements as the TCDR.

References

Hogan, R. J., & Bozzo, A. (2018). A flexible and efficient radiation scheme for the ECMWF model. Journal of Advances in Modeling Earth Systems, 10, 1990– 2008. doi: 10.1029/2018MS001364

This document has been produced in the context of the Copernicus Climate Change Service (C3S).

The activities leading to these results have been contracted by the European Centre for Medium-Range Weather Forecasts, operator of C3S on behalf of the European Union (Delegation Agreement signed on 11/11/2014 and Contribution Agreement signed on 22/07/2021). All information in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose.

 The users thereof use the information at their sole risk and liability. For the avoidance of all doubt , the European Commission and the European Centre for Medium - Range Weather Forecasts have no liability in respect of this document, which is merely representing the author's view.

Related articles