Skip to content
This repository has been archived by the owner on Aug 29, 2023. It is now read-only.

Temporal coverage wrong for some ODP data sources #272

Closed
mzuehlke opened this issue Jun 29, 2017 · 2 comments
Closed

Temporal coverage wrong for some ODP data sources #272

mzuehlke opened this issue Jun 29, 2017 · 2 comments
Assignees
@mzuehlke
Labels
bug ds
Milestone
IPM6

Comments

@mzuehlke
Copy link
Collaborator

mzuehlke commented Jun 29, 2017 •
edited by forman
Loading

Expected behavior

The temporal coverage associated with a data source from the ODP should match the available data just within that individual data source.

Actual behavior

When merging the results from ODP CSW and ESGF, all data sources receive the temporal coverage from the CSW record that contains the data source. The problem is, that some CSW records contain multiple data sources in their uricode entry:

'title': 'ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global ocean colour data products gridded on a geographic projection (All Products), Version 2.0',
'uricode': [
    'a897196a8e2b4c30ab8d22dbfe8f98c7',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2013-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2012-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2011-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2010-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2009-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2008-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2007-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2004-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2003-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2002-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2001-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2000-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1999-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1998-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1997-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2006-r1.v20170406',
    'esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2005-r1.v20170406',
    'esacci.OC.mon.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120',
    'esacci.OC.8-days.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120',
    'esacci.OC.climatology.L3S.OC_PRODUCTS.multi-sensor.multi-platform.merged.2-0.1deg.v20170406',
    'esacci.OC.climatology.L3S.OC_PRODUCTS.multi-sensor.multi-platform.merged.2-0.0-5deg.v20170406',
    'esacci.OC.climatology.L3S.OC_PRODUCTS.multi-sensor.multi-platform.merged.2-0.0-25deg.v20170406',
    'esacci.OC.climatology.L3S.OC_PRODUCTS.multi-sensor.multi-platform.merged.2-0.4km.v20170406',
    'esacci.OC.5-days.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.r1.v20170405'
  ],
'temporal_coverage_start': '1997-09-04T00:00:00',
'temporal_coverage_end': '2013-12-31T23:59:59'

All entries in the uricode list produce a separate data source and therefore have the same temporal coverage.

Steps to reproduce the problem

marcoz ~ $ cate ds list -c -n esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1998-r1
One data source found
   0: esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1998-r1 [1997-09-04, 2013-12-31T23:59:59]
marcoz ~ $

Specifications

0.8.0rc7.dev1
@mzuehlke mzuehlke added this to the IPM6 milestone Jun 29, 2017
@forman forman changed the title Temporal coverage is wrong for splitted datasets Temporal coverage wrong for some ODP data sources Jun 30, 2017
@mzuehlke
Copy link
Collaborator Author

mzuehlke commented Jul 7, 2017

A solution maybe to combine the data sources that are split into yearly data sources into a single one. Then the temporal coverage should be correct.

This would also reduce the number of data sources shown to the user.

@forman forman assigned mzuehlke and unassigned kbernat Jul 19, 2017
@mzuehlke
Copy link
Collaborator Author 

ESA Aerosol Climate Change Initiative (Aerosol CCI): Level 2 aerosol products from MERIS (ALAMO algorithm), Version 2.2
    r1         esacci.AEROSOL.satellite-orbit-frequency.L2P.AOD.MERIS.Envisat.MERIS_ENVISAT.2-2.r1.v20170406            
ESA Aerosol Climate Change Initiative (Aerosol CCI): Level 3 aerosol products  from the Multi-Sensor UVAI algorithm (MS UVAI), Version 1.5.7
    r1         esacci.AEROSOL.climatology.L3.AAI.multi-sensor.multi-platform.ms_uvai.1-5-7.r1.v20170406                 
    r1         esacci.AEROSOL.day.L3.AAI.multi-sensor.multi-platform.ms_uvai.1-5-7.r1.v20170406                         
    r1         esacci.AEROSOL.mon.L3.AAI.multi-sensor.multi-platform.ms_uvai.1-5-7.r1.v20170406                         
ESA Aerosol Climate Change Initiative (Aerosol CCI): Level 3 aerosol products from AATSR (ORAC algorithm), Version 3.02
    r1         esacci.AEROSOL.day.L3C.AER_PRODUCTS.AATSR.Envisat.ORAC.03-02.r1.v20170402                                
    r1         esacci.AEROSOL.mon.L3C.AER_PRODUCTS.AATSR.Envisat.ORAC.03-02.r1.v20170402                                
ESA Aerosol Climate Change Initiative (Aerosol CCI): Level 3 aerosol products from AATSR (SU algorithm), Version 4.21
    r1         esacci.AEROSOL.day.L3C.AER_PRODUCTS.AATSR.Envisat.SU.4-21.r1.v20170405                                   
    r1         esacci.AEROSOL.mon.L3C.AER_PRODUCTS.AATSR.Envisat.SU.4-21.r1.v20170405                                   
ESA Aerosol Climate Change Initiative (Aerosol CCI): Level 3 aerosol products from ATSR2 (ORAC algorithm), Version 3.02
    r1         esacci.AEROSOL.day.L3C.AER_PRODUCTS.ATSR-2.ERS-2.ORAC.03-02.r1.v20170402                                 
    r1         esacci.AEROSOL.mon.L3C.AER_PRODUCTS.ATSR-2.ERS-2.ORAC.03-02.r1.v20170402                                 
ESA Aerosol Climate Change Initiative (Aerosol CCI): Level 3 aerosol products from ATSR2 (SU algorithm), Version 4.21
    r1         esacci.AEROSOL.day.L3C.AER_PRODUCTS.ATSR-2.ERS-2.SU.4-21.r1.v20170405                                    
    r1         esacci.AEROSOL.mon.L3C.AER_PRODUCTS.ATSR-2.ERS-2.SU.4-21.r1.v20170405                                    
ESA Aerosol Climate Change Initiative (Aerosol CCI): Level 3 aerosol products from GOMOS (AERGOM algorithm), Version 2.19
    r1         esacci.AEROSOL.5-days.L3C.AEX.GOMOS.Envisat.aergom.2-19.r1.v20170406                                     
ESA Aerosol Climate Change Initiative (Aerosol CCI): Level 3 aerosol products from MERIS (ALAMO algorithm), Version 2.2
    r1         esacci.AEROSOL.day.L3C.AOD.MERIS.Envisat.MERIS_ENVISAT.2-2.r1.v20170406                                  
    r1         esacci.AEROSOL.mon.L3C.AOD.MERIS.Envisat.MERIS_ENVISAT.2-2.r1.v20170406                                  
ESA Cloud Climate Change Initiative (Cloud_cci): ATSR2-AASTR monthly gridded cloud properties,  version 2.0
    r1         esacci.CLOUD.mon.L3C.CLD_PRODUCTS.multi-sensor.multi-platform.ATSR2-AATSR.2-0.r1.v20170407               
ESA Cloud Climate Change Initiative (Cloud_cci): AVHRR-AM monthly gridded cloud properties, version 2.0
    r1         esacci.CLOUD.mon.L3C.CLD_PRODUCTS.AVHRR.multi-platform.AVHRR-AM.2-0.r1.v20170410                         
ESA Cloud Climate Change Initiative (Cloud_cci): AVHRR-PM monthly gridded cloud properties, version 2.0
    r1         esacci.CLOUD.mon.L3C.CLD_PRODUCTS.AVHRR.multi-platform.AVHRR-PM.2-0.r1.v20170410                         
ESA Cloud Climate Change Initiative (Cloud_cci): MERIS+AATSR monthly gridded cloud properties,  Version 2.0
    r1         esacci.CLOUD.mon.L3C.CLD_PRODUCTS.multi-sensor.Envisat.MERIS-AATSR.2-0.r1.v20170410                      
ESA Cloud Climate Change Initiative (Cloud_cci): MODIS-AQUA monthly gridded cloud properties, version 2.0
    r1         esacci.CLOUD.mon.L3C.CLD_PRODUCTS.MODIS.Aqua.MODIS_AQUA.2-0.r1.v20170330                                 
ESA Cloud Climate Change Initiative (Cloud_cci): MODIS-TERRA monthly gridded cloud properties, version 2.0
    r1         esacci.CLOUD.mon.L3C.CLD_PRODUCTS.MODIS.Terra.MODIS_TERRA.2-0.r1.v20170330                               
ESA Fire Climate Change Initiative (Fire_cci): Burned Area Grid Product Version 4.1
    r1         esacci.FIRE.day.L4.BA.multi-sensor.multi-platform.MERIS.v4-1.r1.v20160819                                
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): GOSAT CH4 Full Physics Level 2 Data Product (CH4_GOS_SRFP), version 2.3.7, generated with the SRFP (RemoTeC) algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CH4.TANSO-FTS.GOSAT.GOSAT.v2-3-7.r1.v20160909                    
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): GOSAT CH4 Full Physics Level 2 Data Product, version 1.0 (CH4_GOS_OCFP) generated with the OCFP (UoL-FP) algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CH4.TANSO-FTS.GOSAT.GOSAT.v1.r1.v20160909                        
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): GOSAT CH4 Proxy Level 2 Data Product (CH4_GOS_SRPR), version 2.3.7, generated with the SRPR (RemoTeC) algorithm
    r2         esacci.GHG.satellite-orbit-frequency.L2.CH4.TANSO-FTS.GOSAT.GOSAT.v2-3-7.r2.v20160909                    
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): GOSAT CH4 Proxy Level 2 Data Product, (CH4_GOS_OCPR), version 6.0, generated with the OCPR (UoL-PR) algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CH4.TANSO-FTS.GOSAT.GOSAT.v6.r1.v20160909                        
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): GOSAT CO2 Level 2 Data Product (CO2_GOS_OCFP) version 6.0, generated with the OCFP (UoL-FP) algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CO2.TANSO-FTS.GOSAT.GOSAT.v6.r1.v20160909                        
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): GOSAT CO2 Level 2 Data Product (CO2_GOS_SRFP) version 2.3.7, generated with the SRFP (RemoTeC) algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CO2.TANSO-FTS.GOSAT.GOSAT.v2-3-7.r1.v20160909                    
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): Merged CH4 Level 2 Data Product (CH4_EMMA), version 1.0, generated with the EMMA algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CH4.multi-sensor.multi-platform.VARIOUS.ch4_v1-0.r1.v20170120    
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): Merged CO2 Level 2 Data Product (CO2_EMMA), version 2.1, generated with the EMMA algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CO2.multi-sensor.multi-platform.VARIOUS.v2-1a.r1.v20170120       
    r1         esacci.GHG.satellite-orbit-frequency.L2.CO2.multi-sensor.multi-platform.VARIOUS.v2-1b.r1.v20170120       
    r1         esacci.GHG.satellite-orbit-frequency.L2.CO2.multi-sensor.multi-platform.VARIOUS.v2-1c.r1.v20170120       
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): SCIAMACHY CH4 Level 2 Data Product (CH4_SCI_IMAP), version 7.1, generated with the IMAP-DOAS algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CH4.SCIAMACHY.Envisat.SCIAMACHY.v7-1.r1.v20160909                
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): SCIAMACHY CH4 Level 2 Data Product (CH4_SCI_WFMD), version 3.9, generated with the WFMD algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CH4.SCIAMACHY.Envisat.SCIAMACHY.v3-9.r1.v20160909                
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): SCIAMACHY CO2 Level 2 Data Product (CO2_SCI_BESD), version 02.01.01, generated with the BESD algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CO2.SCIAMACHY.Envisat.SCIAMACHY.v02-01-01.r1.v20170120           
ESA Greenhouse Gases Climate Change Initiative (GHG CCI): SCIAMACHY CO2 Level 2 Data Product (CO2_SCI_WFMD), version 3.9, generated with the WFMD algorithm
    r1         esacci.GHG.satellite-orbit-frequency.L2.CO2.SCIAMACHY.Envisat.SCIAMACHY.v3-9.r1.v20160909                
ESA Land Cover Climate Change Initiative (Land_Cover_cci):  Global Land Cover Maps, Version 1.6.1
    r1         esacci.LC.5-yrs.L4.LCCS.multi-sensor.multi-platform.Map.1-6-1.r1.v20170120                               
ESA Land Cover Climate Change Initiative (Land_Cover_cci):  Water Bodies Map, v4.0
    r1         esacci.LC.13-yrs.L4.WB.asar.Envisat.Map.4-0.r1.v20170120                                                 
ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global attenuation coefficient for downwelling irradiance (Kd490) gridded on a geographic projection, Version 2.0
    r1         esacci.OC.5-days.L3S.K_490.multi-sensor.multi-platform.MERGED.2-0.r1.v20170405                           
    r1         esacci.OC.8-days.L3S.K_490.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                           
    r1         esacci.OC.day.L3S.K_490.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                              
    r1         esacci.OC.mon.L3S.K_490.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                              
ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global attenuation coefficient for downwelling irradiance (Kd490) gridded on a sinusoidal projection, Version 2.0
    r2         esacci.OC.5-days.L3S.K_490.multi-sensor.multi-platform.MERGED.2-0.r2.v20170405                           
    r2         esacci.OC.8-days.L3S.K_490.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                           
    r2         esacci.OC.day.L3S.K_490.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                              
    r2         esacci.OC.mon.L3S.K_490.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                              
ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global chlorophyll-a data products gridded on a geographic projection, Version 2.0
    r1         esacci.OC.5-days.L3S.CHLOR_A.multi-sensor.multi-platform.MERGED.2-0.r1.v20170405                         
    r1         esacci.OC.8-days.L3S.CHLOR_A.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                         
    r1         esacci.OC.day.L3S.CHLOR_A.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                            
    r1         esacci.OC.mon.L3S.CHLOR_A.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                            
ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global chlorophyll-a data products gridded on a sinusoidal projection, Version 2.0
    r2         esacci.OC.5-days.L3S.CHLOR_A.multi-sensor.multi-platform.MERGED.2-0.r2.v20170405                         
    r2         esacci.OC.8-days.L3S.CHLOR_A.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                         
    r2         esacci.OC.day.L3S.CHLOR_A.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                            
    r2         esacci.OC.mon.L3S.CHLOR_A.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                            
ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global dataset of inherent optical properties (IOP) gridded on a geographic projection, Version 2.0
    r1         esacci.OC.5-days.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.r1.v20170405                             
    r1         esacci.OC.8-days.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                             
    1997-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.1997-r1.v20170406                           
    1998-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.1998-r1.v20170406                           
    1999-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.1999-r1.v20170406                           
    2000-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2000-r1.v20170406                           
    2001-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2001-r1.v20170406                           
    2002-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2002-r1.v20170406                           
    2003-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2003-r1.v20170406                           
    2004-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2004-r1.v20170406                           
    2005-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2005-r1.v20170406                           
    2006-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2006-r1.v20170406                           
    2007-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2007-r1.v20170406                           
    2008-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2008-r1.v20170406                           
    2009-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2009-r1.v20170406                           
    2010-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2010-r1.v20170406                           
    2011-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2011-r1.v20170406                           
    2012-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2012-r1.v20170406                           
    2013-r1    esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.2013-r1.v20170406                           
    r1         esacci.OC.mon.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                                
ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global dataset of inherent optical properties (IOP) gridded on a sinusoidal projection, Version 2.0
    r2         esacci.OC.5-days.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.r2.v20170405                             
    r2         esacci.OC.8-days.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                             
    r2         esacci.OC.day.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                                
    r2         esacci.OC.mon.L3S.IOP.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                                
ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global ocean colour data products gridded on a geographic projection (All Products), Version 2.0
    r1         esacci.OC.5-days.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.r1.v20170405                     
    r1         esacci.OC.8-days.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                     
    0-25deg    esacci.OC.climatology.L3S.OC_PRODUCTS.multi-sensor.multi-platform.merged.2-0.0-25deg.v20170406           
    0-5deg     esacci.OC.climatology.L3S.OC_PRODUCTS.multi-sensor.multi-platform.merged.2-0.0-5deg.v20170406            
    1deg       esacci.OC.climatology.L3S.OC_PRODUCTS.multi-sensor.multi-platform.merged.2-0.1deg.v20170406              
    4km        esacci.OC.climatology.L3S.OC_PRODUCTS.multi-sensor.multi-platform.merged.2-0.4km.v20170406               
    1997-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1997-r1.v20170406                   
    1998-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1998-r1.v20170406                   
    1999-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1999-r1.v20170406                   
    2000-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2000-r1.v20170406                   
    2001-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2001-r1.v20170406                   
    2002-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2002-r1.v20170406                   
    2003-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2003-r1.v20170406                   
    2004-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2004-r1.v20170406                   
    2005-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2005-r1.v20170406                   
    2006-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2006-r1.v20170406                   
    2007-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2007-r1.v20170406                   
    2008-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2008-r1.v20170406                   
    2009-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2009-r1.v20170406                   
    2010-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2010-r1.v20170406                   
    2011-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2011-r1.v20170406                   
    2012-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2012-r1.v20170406                   
    2013-r1    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2013-r1.v20170406                   
    r1         esacci.OC.mon.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                        
ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global ocean colour data products gridded on a sinusoidal projection (All Products), Version 2.0.
    r2         esacci.OC.5-days.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.r2.v20170405                     
    r2         esacci.OC.8-days.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                     
    1997-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1997-r2.v20170406                   
    1998-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1998-r2.v20170406                   
    1999-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.1999-r2.v20170406                   
    2000-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2000-r2.v20170406                   
    2001-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2001-r2.v20170406                   
    2002-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2002-r2.v20170406                   
    2003-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2003-r2.v20170406                   
    2004-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2004-r2.v20170406                   
    2005-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2005-r2.v20170406                   
    2006-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2006-r2.v20170406                   
    2007-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2007-r2.v20170406                   
    2008-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2008-r2.v20170406                   
    2009-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2009-r2.v20170406                   
    2010-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2010-r2.v20170406                   
    2011-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2011-r2.v20170406                   
    2012-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2012-r2.v20170406                   
    2013-r2    esacci.OC.day.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.2013-r2.v20170406                   
    r2         esacci.OC.mon.L3S.OC_PRODUCTS.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                        
ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global remote sensing reflectance gridded on a geographic projection, Version 2.0
    r1         esacci.OC.5-days.L3S.RRS.multi-sensor.multi-platform.MERGED.2-0.r1.v20170405                             
    r1         esacci.OC.8-days.L3S.RRS.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                             
    r1         esacci.OC.day.L3S.RRS.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                                
    r1         esacci.OC.mon.L3S.RRS.multi-sensor.multi-platform.MERGED.2-0.r1.v20170120                                
ESA Ocean Colour Climate Change Initiative (Ocean_Colour_cci): Global remote sensing reflectance gridded on a sinusoidal projection, Version 2.0
    r2         esacci.OC.5-days.L3S.RRS.multi-sensor.multi-platform.MERGED.2-0.r2.v20170405                             
    r2         esacci.OC.8-days.L3S.RRS.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                             
    r2         esacci.OC.day.L3S.RRS.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                                
    r2         esacci.OC.mon.L3S.RRS.multi-sensor.multi-platform.MERGED.2-0.r2.v20170120                                
ESA Ozone Climate Change Initiative (Ozone CCI): Level 3 Nadir Ozone Profile Merged Data Product, version 2
    r1         esacci.OZONE.mon.L3.NP.multi-sensor.multi-platform.MERGED.fv0002.r1.v20160704                            
ESA Ozone Climate Change Initiative (Ozone CCI): Level 3 Total Ozone Merged Data Product, version 01
    r1         esacci.OZONE.day.L3S.TC.multi-sensor.multi-platform.MERGED.fv0100.r1.v20170404                           
ESA Sea Ice Climate Change Initiative (Sea_Ice_cci):  Sea Ice Concentration Climate Data Record from the AMSR-E and AMSR-2 instruments at 25km grid spacing, version 2.0
    NH         esacci.SEAICE.day.L4.SICONC.multi-sensor.multi-platform.AMSR_25kmEASE2.2-0.NH.v20170404                  
    SH         esacci.SEAICE.day.L4.SICONC.multi-sensor.multi-platform.AMSR_25kmEASE2.2-0.SH.v20170404                  
ESA Sea Ice Climate Change Initiative (Sea_Ice_cci):  Sea Ice Concentration Climate Data Record from the AMSR-E and AMSR-2 instruments at 50 km grid spacing, version 2.0
    NH         esacci.SEAICE.day.L4.SICONC.multi-sensor.multi-platform.AMSR_50kmEASE2.2-0.NH.v20170404                  
    SH         esacci.SEAICE.day.L4.SICONC.multi-sensor.multi-platform.AMSR_50kmEASE2.2-0.SH.v20170404                  
ESA Sea Level Climate Change Initiative (Sea_Level_cci): Oceanic Indicators of Mean Sea Level Changes,  Version 2.0
    r1         esacci.SEALEVEL.mon.IND.MSL.multi-sensor.multi-platform.MERGED.2-0.r1.v20170126                          
    r1         esacci.SEALEVEL.mon.IND.MSLAMPH.multi-sensor.multi-platform.MERGED.2-0.r1.v20170126                      
    r1         esacci.SEALEVEL.mon.IND.MSLTR.multi-sensor.multi-platform.MERGED.2-0.r1.v20170126                        
ESA Sea Surface Temperature Climate Change Initiative (ESA SST CCI): Along-Track Scanning Radiometer (ATSR) level 3 uncollated data (L3U) long-term product version 1.1
    2002       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2002.v20170405                  
    2003       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2003.v20170405                  
    2004       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2004.v20170405                  
    2005       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2005.v20170405                  
    2006       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2006.v20170405                  
    2007       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2007.v20170405                  
    2008       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2008.v20170405                  
    2009       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2009.v20170405                  
    2010       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2010.v20170405                  
    2011       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2011.v20170405                  
    2012       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.AATSR.Envisat.AATSR.1-1.2012.v20170405                  
    1995       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR-2.ERS-2.ATSR2.1-1.1995.v20170405                   
    1996       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR-2.ERS-2.ATSR2.1-1.1996.v20170405                   
    1997       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR-2.ERS-2.ATSR2.1-1.1997.v20170405                   
    1998       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR-2.ERS-2.ATSR2.1-1.1998.v20170405                   
    1999       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR-2.ERS-2.ATSR2.1-1.1999.v20170405                   
    2000       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR-2.ERS-2.ATSR2.1-1.2000.v20170405                   
    2001       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR-2.ERS-2.ATSR2.1-1.2001.v20170405                   
    2002       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR-2.ERS-2.ATSR2.1-1.2002.v20170405                   
    2003       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR-2.ERS-2.ATSR2.1-1.2003.v20170405                   
    1991       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR.ERS-1.ATSR1.1-1.1991.v20170405                     
    1992       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR.ERS-1.ATSR1.1-1.1992.v20170405                     
    1993       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR.ERS-1.ATSR1.1-1.1993.v20170405                     
    1994       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR.ERS-1.ATSR1.1-1.1994.v20170405                     
    1995       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR.ERS-1.ATSR1.1-1.1995.v20170405                     
    1996       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR.ERS-1.ATSR1.1-1.1996.v20170405                     
    1997       esacci.SST.satellite-orbit-frequency.L3U.SSTskin.ATSR.ERS-1.ATSR1.1-1.1997.v20170405                     
ESA Sea Surface Temperature Climate Change Initiative (ESA SST CCI): Analysis long term product version 1.1
    r1         esacci.SST.day.L4.SSTdepth.multi-sensor.multi-platform.OSTIA.1-1.r1.v20160909                            
ESA Soil Moisture Climate Change Initiative (Soil_Moisture_cci): 'Active' Product, Version 03.2
    r1         esacci.SOILMOISTURE.day.L3S.SSMS.multi-sensor.multi-platform.ACTIVE.03-2.r1.v20170611                    
ESA Soil Moisture Climate Change Initiative (Soil_Moisture_cci): 'Combined' Product, Version 03.2
    r1         esacci.SOILMOISTURE.day.L3S.SSMV.multi-sensor.multi-platform.COMBINED.03-2.r1.v20170611                  
ESA Soil Moisture Climate Change Initiative (Soil_Moisture_cci): 'Passive' Product, Version 03.2
    r1         esacci.SOILMOISTURE.day.L3S.SSMV.multi-sensor.multi-platform.PASSIVE.03-2.r1.v20170611

In the text above the lines starting with "ESA.." are the records from the CSW and the indented lines below are the referenced dataset from the ESGF. The first value is the realization.

We get only time coverage information for each CSW record.

We can now either ignore the time coverage information from the CSW when the realization starts with a year (4 digits) and calculate the time coverage from the ESGF supplied file names.
Or split the time coverage by year for these datasets.

All this we only can do if the time coverage is correct for all datasets that are referenced from a single CSW record with the exception of datasets splits by year.

I think we should clarify this with the ODP team before doing anything.
What do you think @kbernat @forman

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@mzuehlke mzuehlke

Labels
bug ds
Projects
None yet
Milestone
IPM6
Development

No branches or pull requests
2 participants
@mzuehlke @kbernat