Contributors: R. Wilson (PML), J. Clark (PML)

Table of Contents

1. Known issues in model outputs

2. Erroneous time point in April 2047 daily data for RCP 8.5 simulation

In the RCP8.5 daily temperature and salinity fields, there is an erroneous time point in the April data for 2047. Values across the domain are recorded as zeros when this should not be the case. When working with the data, care should be taken (e.g. using masking) to avoid the data point negatively impacting workflows.

3. Model validation

Surface chlorophyll and sea surface temperature output by the NEMO-ERSEM model (Butenschön et al. 2016) for the Northeast Atlantic have been compared to satellite values, using monthly values for years 2000-2015. Satellite chlorophyll data come from the ESA Climate Change Initiative Ocean Colour project (http://www.esa-oceancolour-cci.org/, v4.0). Sea surface temperature is from the OSTIA dataset (Donlon et al. 2012), downloaded from Copernicus Marine Environment Monitoring Service (http://marine.copernicus.eu/; SST_GLO_SST_L4_NRT_OBSERVATIONS_010_001 and SST_GLO_SST_L4_REP_OBSERVATIONS_010_011). Two model runs have been compared to the satellite values: the climate run as delivered to the Copernicus Climate Change Service - Monitoring and Forecasting Centre C3S-MFC, which was driven by a downscaled general circulation model (GCM), and a separate run driven by reanalysis data (referred to below as the validation run). Although the GCM-driven run cannot be expected to closely track the observations at time scales of days or months, the two should be comparable at longer time scales (e.g. the 15-year mean shown here).

Figure 1: (a) Seasonal mean surface chlorophyll-a for 2000 to 2015 for satellite ocean colour and model outputs; (b) model-satellite differences.

The model broadly reproduces the temporal and spatial patterns of chlorophyll concentration across the region – a northward-spreading spring bloom, highest levels in the northwestern European shelf in the April-June season (Figures 1, 2 and Table 1). However, model estimates tend to be higher than satellite, especially in regions of high chlorophyll. The two model runs give similar outputs, with the GCM-driven run tending to give greater overproduction compared to satellite. Model outputs are lower than satellite in the northern winter, however satellite data tends to be sparse for this period and region because of high cloud coverage, so has higher than usual uncertainty.

Furthermore, the satellite chlorophyll product used over-predicts in turbid shelf waters in winter, and we therefore should not assume that ERSEM under-predicts winter chlorophyll. Outputs from the GCM-driven model generally have a higher bias and root-mean-square-difference (RMSD) than the reanalysis- driven model. Additionally, the correlation to satellite data is weaker, which is expected since the climate model cannot reproduce the month-by-month conditions as closely as the reanalysis. The model-satellite correlation is weakest in shallow coastal areas (Figure 2), however satellite chlorophyll estimates are less reliable in these areas than for open seas. This apparent poor performance of the model in shallow regions is potentially partly because of the failure of the chlorophyll algorithm used by the satellite product to fully distinguish between chlorophyll and suspended particulate matter.

Figure 2: Spearman correlation between monthly mean and satellite values of surface chlorophyll, 2000-2015. The model runs are (a) validation (reanalysis-driven) (b) GCM-driven. Areas where the correlation is not statistically significant are marked in grey.

Table 1: Model-satellite comparison for surface chlorophyll-a, using monthly data for 2000 to 2015, for the whole model domain and sub-regions. Bias = model mean – satellite mean (mg m-3); RMSD = root mean square difference between model and satellite (mg m-3); Spearman-r = Spearman rank correlation coefficient.


Reanalysis-driven model

GCM-driven model

region

Bias

RMSD

Spearman-r

Bias

RMSD

Spearman-r

Full domain

0.172

1.402

0.640

0.110

1.304

0.599

Continental Shelf

-0.291

1.992

0.479

-0.187

1.992

0.428

English Channel

-0.549

1.774

0.493

-0.567

1.859

0.505

Irish Sea

-0.984

2.366

0.193

-0.853

2.399

0.089

North Sea

-0.545

2.374

0.465

-0.457

2.321

0.409

North Western Approaches

0.097

1.701

0.654

0.253

1.670

0.586

Northern North Sea

0.069

1.495

0.616

0.106

1.385

0.523

Norwegian Trench0.0831.7600.4190.1341.6970.384
Offshelf0.3671.0590.7580.2350.8640.680

South Western Approaches

-0.094

1.157

0.558

0.074

1.473

0.496

Southern North Sea

-1.183

3.029

0.195

-1.065

3.023

0.102

There is also a good spatial and temporal match between modelled and satellite-derived sea surface temperature (Figures 3, 4 and Table 2). The reanalysis-driven run of the model tends to overestimate sea surface temperature in shelf waters, especially in the spring and summer. The GCM-driven run has higher bias, and over-estimates winter temperatures in much of the region.
This is in line with the biases in the GCM model driving the model. Model-satellite correlation is high in all regions, though rather lower for the GCM-driven run: as noted above, a climate model is not expected to accurately reproduce conditions month-by-month, even in a hindcast.

Figure 3 (a) Seasonal mean sea surface temperature for 2000 to 2015 for satellite and model outputs; (b) model-satellite difference.

Figure 4 Spearman correlation between monthly mean and satellite values of sea surface temperature, 2000-2015. The model runs are (a) validation (reanalysis-driven) (b) GCM-driven.

Table 2 Model-satellite comparison for surface temperature, using monthly data for 2000 to 2015, for the whole model domain and sub-regions. Bias = model mean – satellite mean (°C); RMSD = root mean square difference between model and satellite (°C); Spearman-r = Spearman rank correlation coefficient.


Reanalysis-driven model

GCM-driven model

Region

Bias

RMSD

Spearman-r

Bias

RMSD

Spearman-r

Full domain

-0.050

0.576

0.992

1.112

1.453

0.962

Continental Shelf

0.074

0.404

0.996

0.742

0.996

0.984

English Channel

0.088

0.409

0.995

0.747

0.970

0.989

Irish Sea

-0.040

0.444

0.993

0.919

1.088

0.989

North Sea

0.048

0.414

0.996

0.758

1.011

0.987

North Western Approaches

0.097

0.502

0.990

1.010

1.198

0.975

Northern North
Sea

0.106

0.351

0.994

1.045

1.169

0.986

Norwegian Trench

0.064

0.474

0.987

0.833

1.143

0.977

Offshelf

-0.102

0.635

0.991

1.267

1.606

0.955

South Western Approaches

0.174

0.370

0.994

0.656

0.819

0.990

Southern North Sea

-0.020

0.476

0.996

0.426

0.789

0.990

4. References

Butenschön, M., Clark, J., Aldridge, J. N., Icarus Allen, J., Artioli, Y., et al. (2016). ERSEM 15.06: A generic model for marine biogeochemistry and the ecosystem dynamics of the lower trophic levels. Geoscientific Model Development, 9(4), 1293–1339.

Dee, D. P., Uppala, S. M., Simmons, A. J., Berrisford, P., Poli, P., Kobayashi, S., … Vitart, F. (2011). The ERA-Interim reanalysis: Configuration and performance of the data assimilation system.
Quarterly Journal of the Royal Meteorological Society, 137(656), 553–597. https://doi.org/10.1002/qj.828
Donlon, C. J., Martin, M., Stark, J., Roberts-Jones, J., Fiedler, E., & Wimmer, W. (2012). The Operational Sea Surface Temperature and Sea Ice Analysis (OSTIA) system. Remote Sensing of Environment, 116, 140–158.

Locarnini, R.A., Mishonov, A.V., Antonov, J.I., Boyer, T.P., Garcia, H.E., Baranova, O.K., Zweng, M.M., Paver, C.R., Reagan, J.R., Johnson, D.R. and Hamilton, M., (2013). World ocean atlas 2013
MacLachlan, C., Arribas, A., Peterson, K. A., Maidens, A., Fereday, D., Scaife, A. A., … Madec, G. (2015). Global Seasonal forecast system version 5 (GloSea5): a high-resolution seasonal forecast system. Quarterly Journal of the Royal Meteorological Society, 141(689), 1072–1084. https://doi.org/10.1002/qj.2396

This document has been produced in the context of the Copernicus Climate Change Service (C3S).

The activities leading to these results have been contracted by the European Centre for Medium-Range Weather Forecasts, operator of C3S on behalf of the European Union (Delegation Agreement signed on 11/11/2014 and Contribution Agreement signed on 22/07/2021). All information in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose.

The users thereof use the information at their sole risk and liability. For the avoidance of all doubt , the European Commission and the European Centre for Medium - Range Weather Forecasts have no liability in respect of this document, which is merely representing the author's view.

Related articles