Re: [thredds] Limit on diminsion when using Godiva?

  • To: Jon Blower <j.blower@xxxxxxxxxxx>, "thredds@xxxxxxxxxxxxxxxx" <thredds@xxxxxxxxxxxxxxxx>
  • Subject: Re: [thredds] Limit on diminsion when using Godiva?
  • From: Phil Scadden <P.Scadden@xxxxxxxxxx>
  • Date: Sun, 9 Aug 2020 21:57:19 +0000
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=gns.cri.nz; dmarc=pass action=none header.from=gns.cri.nz; dkim=pass header.d=gns.cri.nz; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=P3FFtCWS8Q/QaFGOHrEE1l1UKWtFZcKRK6pC/5BWfEI=; b=H45QGSHHQAA97nhFD1JKcxsL4x7Sk+sSykMZaixDJCN9PFK+CxbvddynWIlbuTmPThuRi1JJxoRxxBtCCONNhn6SpPat9+TbVMZUWcdqI9QtfQc3bpLdHwDKSXWbIgv0JA4QZGdTtvGhU4PD49oC/8cgQDN+jtsk0nwQ52Kh2CzRUKDq5zDAYG7c6oAkqXVDRPmCPhRHumZNUdSOKVnC2BlAzT9s/mjlgJXVotWwN19c8RNUreHPIiP0Vuh8G6h5TySM7YetvrNjH+t+P/3rA8m5QSt/NVB4let3mDfLtByvKW94r38fIH81UePYPSgzt0R/r5lldsOqUefRRjqigw==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=BteDczwz0FOOyphpWkhHXR1PRFdjoIUI3K2OiCQ/YDrUNZHZZlQT8g8iQDCUFV7PhiFdfp9r6feAoK+Z16+V9cJakmKesyWyn/6atDcm165+yDccSDaflam6kTAjSFF6G+R4VP8eym4nrNCPdPP3zpFiRL/vE86QCP1UuYJEW3cBbvZcc8wNs4hOQP4MgSPOjY+Y1jz9Oo25zVICj6KUM17Vk08hDWvWJLDyCatndRr0N2aAoHgmcGO2qlr6CvFGhbyiIH76ZAFVCAbWcfeofDsP6A1QamLzO8fHyAa6pQnPPmtADh2lWrBGes9NZTnq6ebuGv9ZHhhGKfu1lWFxqQ==
  • Authentication-results: the-iea.org; dkim=none (message not signed) header.d=none; the-iea.org; dmarc=none action=none header.from=gns.cri.nz;
Ok. We will fix the time dimension. We do have working netCDF that include a 
non-spatio-temporal dimension (layer) but it is ordered after the spatial 
dimensions and time is in the right format. This is a stochastic model and 
realn is just the realization. It is surprizing to me if CF world doesn’t 
handle it.

-----Original Message-----
From: thredds <thredds-bounces@xxxxxxxxxxxxxxxx> On Behalf Of Jon Blower
Sent: Friday, 7 August 2020 20:38
To: thredds@xxxxxxxxxxxxxxxx
Subject: Re: [thredds] Limit on diminsion when using Godiva?

Hi Phil,

The WMS part of THREDDS expects all the dimensions of a variable to be spatial 
or temporal. Your datasets have a "realisation" dimension, which is not 
recognised and therefore unfortunately the WMS can't handle the variable.

Also, your first dataset has a time dimension that is not described in a 
CF-compliant way (the units should be something like "days since X"), so that 
dimension would probably not be recognised as a valid temporal axis.

Hope this helps,
Jon





    ----------------------------------------------------------------------

    Message: 1
    Date: Thu, 6 Aug 2020 22:28:58 +0000
    From: Phil Scadden <P.Scadden@xxxxxxxxxx>
    To: "thredds@xxxxxxxxxxxxxxxx" <thredds@xxxxxxxxxxxxxxxx>
    Subject: Re: [thredds] Limit on diminsion when using Godiva?
    Message-ID:
    
<SYBP282MB012334C09421B6C315B68B2CC8480@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx>

    Content-Type: text/plain; charset="windows-1257"

    Whoops, the second netcdf file isnt working either.

    From: thredds <thredds-bounces@xxxxxxxxxxxxxxxx> On Behalf Of Phil Scadden
    Sent: Friday, 7 August 2020 10:05
    To: thredds@xxxxxxxxxxxxxxxx
    Subject: [thredds] Limit on diminsion when using Godiva?

    We have a 5D netCDF which works fine in Panoply, but when we try to use it 
in thredds, we don?t get a list of variable. Digging deeper, I see that call to 
/thredds/wms/gwAll/hpm_outputs.nc?item=menu&menu=&request=GetMetadata returns:

    {"label":"GNS Thredds","children":[{"label":"hpm model 
outputs","children":[]}]}  I don?t see any errors reports in the 
threddsServlet.log.

    A very similar file in the same datascan but with one less dimension is 
working ok.

    The header  for the failing file is:
    netcdf hpm_outputs {
    dimensions:
                    lay = 8 ;
                    x = 501 ;
                    y = 302 ;
                    realn = 91 ;
                    datetime = 76 ;
    variables:
                    char transverse_mercator ;
                                    transverse_mercator:grid_mapping_name = 
"transverse_mercator" ;
                                    
transverse_mercator:longitude_of_central_meridian = 173. ;
                                    transverse_mercator:false_easting = 
1600000. ;
                                    transverse_mercator:false_northing = 
10000000. ;
                                    
transverse_mercator:latitude_of_projection_origin = 0. ;
                                    
transverse_mercator:scale_factor_at_central_meridian = 0.9996 ;
                                    transverse_mercator:long_name = "CRS 
definition" ;
                                    
transverse_mercator:longitude_of_prime_meridian = 0. ;
                                    transverse_mercator:semi_major_axis = 
6378137. ;
                                    transverse_mercator:semi_minor_axis = 
6356752.31414036 ;
                                    
transverse_mercator:reference_ellipsoid_name = "GRS 1980" ;
                                    transverse_mercator:prime_meridian_name = 
"Greenwich" ;
                                    transverse_mercator:geographic_crs_name = 
"NZGD2000" ;
                                    transverse_mercator:horizontal_datum_name = 
"New Zealand Geodetic Datum 2000" ;
                                    transverse_mercator:projected_crs_name = 
"NZGD2000 / New Zealand Transverse Mercator 2000" ;
                                    transverse_mercator:inverse_flattening = 
298.257222101 ;
                                    transverse_mercator:spatial_ref = 
"PROJCRS[\"NZGD2000 / New Zealand Transverse Mercator 
2000\",BASEGEOGCRS[\"NZGD2000\",DATUM[\"New Zealand Geodetic Datum 
2000\",ELLIPSOID[\"GRS 
1980\",6378137,298.257222101,LENGTHUNIT[\"metre\",1]]],PRIMEM[\"Greenwich\",0,ANGLEUNIT[\"degree\",0.0174532925199433]],
 ID[\"EPSG\",4167]],CONVERSION[\"New Zealand Transverse Mercator 
2000\",METHOD[\"Transverse Mercator\", ID[\"EPSG\",9807]],PARAMETER[\"Latitude 
of natural origin\",0,ANGLEUNIT[\"degree\",0.0174532925199433], 
ID[\"EPSG\",8801]],PARAMETER[\"Longitude of natural 
origin\",173,ANGLEUNIT[\"degree\",0.0174532925199433], 
ID[\"EPSG\",8802]],PARAMETER[\"Scale factor at natural 
origin\",0.9996,SCALEUNIT[\"unity\",1],ID[\"EPSG\",8805]],PARAMETER[\"False 
easting\",1600000,LENGTHUNIT[\"metre\",1],ID[\"EPSG\",8806]],PARAMETER[\"False 
northing\",10000000,LENGTHUNIT[\"metre\",1],ID[\"EPSG\",8807]]], 
CS[Cartesian,2], AXIS[\"northing (N)\",north,ORDER[1],LENGTHUNIT[\"met
     re\",1]], AXIS[\"easting 
(E)\",east,ORDER[2],LENGTHUNIT[\"metre\",1]],USAGE[SCOPE[\"unknown\"],AREA[\"New
 Zealand - onshore\"],BBOX[-47.33,166.37,-34.1,178.63]],ID[\"EPSG\",2193]]" ;
                    int lay(lay) ;
                                    lay:standard_name = "(no standard name)" ;
                                    lay:long_name = "Model layer" ;
                    double x(x) ;
                                    x:standard_name = "projection_x_coordinate" 
;
                                    x:long_name = "x coordinate of projection" ;
                                    x:units = "m" ;
                    double y(y) ;
                                    y:standard_name = "projection_y_coordinate" 
;
                                    y:long_name = "y coordinate of projection" ;
                                    y:units = "m" ;
                    string realn(realn) ;
                                    realn:long_name = "Realisation" ;
                                    realn:standard_name = "realization" ;
                    int64 datetime(datetime) ;
                                    datetime:standard_name = "(no standard 
name)" ;
                                    datetime:long_name = "Datetime" ;
                                    datetime:units = "YYYYMMDD" ;
                    float head(realn, datetime, lay, y, x) ;
                                    head:_FillValue = -1.e+30f ;
                                    head:grid_mapping = "transverse_mercator" ;
                                    head:long_name = "Simulated GW Head" ;
                                    head:standard_name = "(no standard name)" ;
                                    head:units = "m" ;
                    float s_flow(realn, datetime, y, x) ;
                                    s_flow:_FillValue = -1.e+30f ;
                                    s_flow:grid_mapping = "transverse_mercator" 
;
                                    s_flow:long_name = "Simulated Stream Flow" ;
                                    s_flow:standard_name = "(no standard name)" 
;
                                    s_flow:units = "m3/d" ;
                    float s_flux(realn, datetime, y, x) ;
                                    s_flux:_FillValue = -1.e+30f ;
                                    s_flux:grid_mapping = "transverse_mercator" 
;
                                    s_flux:long_name = "Simulated Stream Flux 
to GW" ;
                                    s_flux:standard_name = "(no standard name)" 
;
                                    s_flux:units = "m3/d" ;

    // global attributes:
                                    :title = "hpm model outputs" ;
                                    :description = "ensemble simulated outputs" 
;
                                    :file_creation_time = "2020-08-03 
15:03:00.336462" ;
                                    :Conventions = "CF-1.7" ;
                                    :institution = "GNS Science" ;
                                    :source = "PEST++/pyEMU" ;
    }

    And for the good file is:
    netcdf hpm_inputs {
    dimensions:
                    lay = 8 ;
                    x = 501 ;
                    y = 302 ;
                    realn = 100 ;
    variables:
                    char transverse_mercator ;
                                    transverse_mercator:grid_mapping_name = 
"transverse_mercator" ;
                                    
transverse_mercator:longitude_of_central_meridian = 173. ;
                                    transverse_mercator:false_easting = 
1600000. ;
                                    transverse_mercator:false_northing = 
10000000. ;
                                    
transverse_mercator:latitude_of_projection_origin = 0. ;
                                    
transverse_mercator:scale_factor_at_central_meridian = 0.9996 ;
                                    transverse_mercator:long_name = "CRS 
definition" ;
                                    
transverse_mercator:longitude_of_prime_meridian = 0. ;
                                    transverse_mercator:semi_major_axis = 
6378137. ;
                                    transverse_mercator:semi_minor_axis = 
6356752.31414036 ;
                                    
transverse_mercator:reference_ellipsoid_name = "GRS 1980" ;
                                    transverse_mercator:prime_meridian_name = 
"Greenwich" ;
                                    transverse_mercator:geographic_crs_name = 
"NZGD2000" ;
                                    transverse_mercator:horizontal_datum_name = 
"New Zealand Geodetic Datum 2000" ;
                                    transverse_mercator:projected_crs_name = 
"NZGD2000 / New Zealand Transverse Mercator 2000" ;
                                    transverse_mercator:inverse_flattening = 
298.257222101 ;
                                    transverse_mercator:spatial_ref = 
"PROJCRS[\"NZGD2000 / New Zealand Transverse Mercator 
2000\",BASEGEOGCRS[\"NZGD2000\",DATUM[\"New Zealand Geodetic Datum 
2000\",ELLIPSOID[\"GRS 
1980\",6378137,298.257222101,LENGTHUNIT[\"metre\",1]]],PRIMEM[\"Greenwich\",0,ANGLEUNIT[\"degree\",0.0174532925199433]],
 ID[\"EPSG\",4167]],CONVERSION[\"New Zealand Transverse Mercator 
2000\",METHOD[\"Transverse Mercator\", ID[\"EPSG\",9807]],PARAMETER[\"Latitude 
of natural origin\",0,ANGLEUNIT[\"degree\",0.0174532925199433], 
ID[\"EPSG\",8801]],PARAMETER[\"Longitude of natural 
origin\",173,ANGLEUNIT[\"degree\",0.0174532925199433], 
ID[\"EPSG\",8802]],PARAMETER[\"Scale factor at natural 
origin\",0.9996,SCALEUNIT[\"unity\",1],ID[\"EPSG\",8805]],PARAMETER[\"False 
easting\",1600000,LENGTHUNIT[\"metre\",1],ID[\"EPSG\",8806]],PARAMETER[\"False 
northing\",10000000,LENGTHUNIT[\"metre\",1],ID[\"EPSG\",8807]]], 
CS[Cartesian,2], AXIS[\"northing (N)\",north,ORDER[1],LENGTHUNIT[\"met
     re\",1]], AXIS[\"easting 
(E)\",east,ORDER[2],LENGTHUNIT[\"metre\",1]],USAGE[SCOPE[\"unknown\"],AREA[\"New
 Zealand - onshore\"],BBOX[-47.33,166.37,-34.1,178.63]],ID[\"EPSG\",2193]]" ;
                    int lay(lay) ;
                                    lay:standard_name = "(no standard name)" ;
                                    lay:long_name = "Model layer" ;
                    double x(x) ;
                                    x:standard_name = "projection_x_coordinate" 
;
                                    x:long_name = "x coordinate of projection" ;
                                    x:units = "m" ;
                    double y(y) ;
                                    y:standard_name = "projection_y_coordinate" 
;
                                    y:long_name = "y coordinate of projection" ;
                                    y:units = "m" ;
                    string realn(realn) ;
                                    realn:long_name = "Realisation" ;
                                    realn:standard_name = "realization" ;
                    float K(realn, lay, y, x) ;
                                    K:_FillValue = -1.e+30f ;
                                    K:grid_mapping = "transverse_mercator" ;
                                    K:long_name = "Hydraulic conductivity" ;
                                    K:standard_name = "(no standard name)" ;
                                    K:units = "m day-1" ;

    // global attributes:
                                    :title = "hpm model pars" ;
                                    :description = "ensemble parameters for 
MODFLOW" ;
                                    :file_creation_time = "2020-08-03 
13:14:55.609150" ;
                                    :Conventions = "CF-1.7" ;
                                    :institution = "GNS Science" ;
                                    :source = "PEST++/pyEMU" ;
    }

    
https://data-dev.gns.cri.nz/thredds/wms/gwAll/hpm_outputs1.nc?item=menu&menu=&request=GetMetadata

    ________________________________________________
    Ng? mihi, N? Phil Scadden
    Te Aroturuki Matep? Aronuku me te P?taiao Raraunga
    GNS Science Ltd 764 Cumberland St, Private Bag 1930,
    Dunedin, New Zealand Ph +64 3 4799663, 027 3463185

    ?Wh?ia te iti kahurangi ki te t?ohu koe me he maunga teitei?

    Notice: This email and any attachments are confidential and may not be 
used, published or redistributed without the prior written consent of the 
Institute of Geological and Nuclear Sciences Limited (GNS Science). If received 
in error please destroy and immediately notify GNS Science. Do not copy or 
disclose the contents.
    Notice: This email and any attachments are confidential and may not be 
used, published or redistributed without the prior written consent of the 
Institute of Geological and Nuclear Sciences Limited (GNS Science). If received 
in error please destroy and immediately notify GNS Science. Do not copy or 
disclose the contents.
    -------------- next part --------------
    An HTML attachment was scrubbed...
    URL: 
<https://mailman.unidata.ucar.edu/mailing_lists/archives/thredds/attachments/20200806/bf7d7874/attachment.html>

    End of thredds Digest, Vol 129, Issue 2
    ***************************************

_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are recorded in 
the Unidata inquiry tracking system and made publicly available through the 
web.  Users who post to any of the lists we maintain are reminded to remove any 
personal information that they do not want to be made public.


thredds mailing list
thredds@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
https://www.unidata.ucar.edu/mailing_lists/
Notice: This email and any attachments are confidential and may not be used, 
published or redistributed without the prior written consent of the Institute 
of Geological and Nuclear Sciences Limited (GNS Science). If received in error 
please destroy and immediately notify GNS Science. Do not copy or disclose the 
contents.
  • 2020 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: