Hi

due to impossibility to connect from intranet to copernicus website I have to download many data from the website and I began with time to get data for each chunk of around 10minutes... Now I may have up to 10 hours to wait. Do you have some limits I have to respect?

Thanks in advance

Bruno

8 Comments

  1. Kevin Marsh

    Hi Bruno,

    if there are a lot of requests on the CDS, it can take longer for your request to be processed:

    https://cds.climate.copernicus.eu/live/queue

    you should also make sure your requests are structured efficiently. To retrieve data efficiently using the CDS API please have a look at the efficiency tips section on CDS documentation.

    Thanks,

    Kevin

  2. User Alexandre dot BANQUET at oecd dot org

    Hi,

    I am currently facing the same issue with the ERA5 hourly data on single levels from 1979 to present, even if by following the guidelines and dividing the requests in small chunks of data. 

    Thanks in advance for your help,

    Alexandre

  3. Kevin Marsh

    Hi Alexandre

    Can you share the request you are submitting?

    (Note that request may be processed faster if they are submitted at 'quiet' times e.g. evenings/weekends)

    Thanks,

    Kevin

  4. User Alexandre dot BANQUET at oecd dot org

    Hi Kevin,

    Thanks for your reply. It went indeed much faster last night than yesterday. Here is the request I am submitting: 

    c.retrieve(
            'reanalysis-era5-single-levels',
            {
                'product_type': 'reanalysis',
                'format': 'grib',
                'variable': '10m_u_component_of_wind',
                'year': year_str,
                'month': month_str,
                'time': [
                    '00:00', '01:00', '02:00',
                    '03:00', '04:00', '05:00',
                    '06:00', '07:00', '08:00',
                    '09:00', '10:00', '11:00',
                    '12:00', '13:00', '14:00',
                    '15:00', '16:00', '17:00',
                    '18:00', '19:00', '20:00',
                    '21:00', '22:00', '23:00',
                ],
                'day': day_str,
            },
            path_to_file)

    Thanks,

    Alexandre

  5. Matthew Rosencrans

    Same issue here, trying to pull C3S data to NCEP as input to the seasonal outlooks.

    This is a relatively small request, and it's been in queue for 20 minutes.   This was NOT a problem before the datacenter switch.

    c = cdsapi.Client()

c.retrieve(
    'seasonal-monthly-single-levels',
    {
        'originating_centre': 'ukmo',
        'system': '600',
        'variable': 'sea_surface_temperature',
        'product_type': 'monthly_mean',
        'year': '2016',
        'month': '06',
        'leadtime_month': [
            '1', '2',
        ],
        'format': 'grib',
    },
    'download.grib')

  6. Kevin Marsh

    Hi Matthew,

    I think there was an issue with the CDS connection to the archive which resulted in longer than expected processing times for some requests,

    Thanks,

    Kevin

  7. bruno patin

    it seems you solved this isssue. time got back to ~10mns (however sometimes it is slightly lonnger) and download bandwidth became largely correct. Thus case closed for me at least.

    Thanks

    Bruno

  8. bruno patin

    unhappily, I was wrong. My requests are now taking from 1 hour to 3 hours to complete.


Feedback: C3S User Satisfaction Survey - CAMS User Satisfaction Survey

Web: C3S Help and Support - CAMS Help and Support