Greetings Tony,
The capability to do cross grid boundary requests is solved in TDS 5. We
are planning on using TDS 5 in our workshop this fall, with the hope of
releasing a beta post workshop.
As far as I know, github issue 330 has not been ported to TDS 4.6. We are
having a THREDDS meeting on Wednesday, and I will bring it up to see where
things stand.
Cheers,
Sean
On Tue, Jul 19, 2016 at 6:59 AM, Jolibois Tony <tjolibois@xxxxxx> wrote:
> Dear Thredds community,
>
> I was wondering when 2 issues will be solved, and if it is or will be
> solved in which version of TDS.
>
>
>
> Many users here in Europe are impacted (CMEMS community), as well as Hycom
> users apparently.
>
> - The capacity of NCSS to manage subset across the grid boundary
>
> - A bug on netCDF 4 output writing :
> https://github.com/Unidata/thredds/issues/330
>
> Is the TDS 5.0 the good one ? If yes, is this version considered as a
> stable version ?
>
> Thanks,
>
> Tony
>
>
>
> *-*
>
> *Tony Jolibois*
>
> *Product Dissemination Services *
>
> Space Oceanography
>
> +33 5 61 39 37 97
>
>
>
> [image: logo_cls_small]
>
> http://www.cls.fr/
>
>
> ------------------------------
>
> *Ce message et toutes les pièces jointes (ci-après le "message") sont
> établis à l'intention exclusive de ses destinataires et sont confidentiels.
> Si vous recevez ce message par erreur ou s'il ne vous est pas destiné,
> merci de le détruire ainsi que toute copie de votre système et d'en avertir
> immédiatement l'expéditeur. Toute lecture non autorisée, toute utilisation
> de ce message qui n'est pas conforme à sa destination, toute diffusion ou
> toute publication, totale ou partielle, est interdite. L'Internet ne
> permettant pas d'assurer l'intégrité de ce message électronique susceptible
> d'altération, l’expéditeur (et ses filiales) décline(nt) toute
> responsabilité au titre de ce message dans l'hypothèse où il aurait été
> modifié ou falsifié.*
>
> *This message and any attachments (the "message") is intended solely for
> the intended recipient(s) and is confidential. If you receive this message
> in error, or are not the intended recipient(s), please delete it and any
> copies from your systems and immediately notify the sender. Any
> unauthorized view, use that does not comply with its purpose, dissemination
> or disclosure, either whole or partial, is prohibited. Since the internet
> cannot guarantee the integrity of this message which may not be reliable,
> the sender (and its subsidiaries) shall not be liable for the message if
> modified or falsified. *
>
>
> ---------- Forwarded message ----------
> From: Christian Ward-Garrison <cwardgar@xxxxxxxx>
> To: "Don.Murray@xxxxxxxx" <Don.Murray@xxxxxxxx>
> Cc: "thredds@xxxxxxxxxxxxxxxx" <thredds@xxxxxxxxxxxxxxxx>
> Date: Mon, 14 Sep 2015 21:48:13 +0000
> Subject: Re: [thredds] NCSS Queries Not Spaning/Crossing Dateline
> Indeed, we have this (mostly) working on our 5.0 development branch. We're
> not really sure about when we'll release 5.0, but it should be by the end
> of the year at the latest.
>
> On Mon, Sep 14, 2015 at 3:38 PM, Don Murray (NOAA Affiliate) <
> don.murray@xxxxxxxx> wrote:
>
>> Hi Michael-
>>
>> In the current versions of TDS/netCDF-Java, you cannot subset across the
>> grid boundary. Since your model runs -180 to 180, that's what you are
>> running into. For model output that runs 0-360, the problem is at the
>> prime meridian.
>>
>> I think this is to be fixed in the next iteration (5.0?), but I'm sure
>> Unidata can verify that.
>>
>> Don
>>
>> On 9/14/15 3:25 PM, Michael McDonald wrote:
>>
>>> Is there some trick I am not understanding for making NCSS queries
>>> that span the 180-degree east dateline? We've had users on the
>>> HYCOM.org forum asking about this, and I cannot get a netcdf object
>>> which does not stop at 180-degrees east.
>>>
>>>
>>> http://www.unidata.ucar.edu/software/thredds/current/tds/reference/NetcdfSubsetServiceReference.html#Subsetting
>>>
>>> We are using the latest 4.6.3
>>> http://ncss.hycom.org/thredds/catalog.html
>>>
>>> 1. Start with our HYCOM reanalysis product,
>>> http://ncss.hycom.org/thredds/ncss/grid/GLBa0.08/reanalysis/dataset.html
>>>
>>> 2. See if you can successfully get data that spans the dateline,
>>> i.e., West 170 to East 200
>>>
>>> If successful, please let me know how to accomplish this.
>>>
>>>
>> --
>> Don Murray
>> NOAA/ESRL/PSD and CU-CIRES
>> 303-497-3596
>> http://www.esrl.noaa.gov/psd/people/don.murray/
>>
>>
>> _______________________________________________
>> thredds mailing list
>> thredds@xxxxxxxxxxxxxxxx
>> For list information or to unsubscribe, visit:
>> http://www.unidata.ucar.edu/mailing_lists/
>>
>
>
>
> Cliquez ici
> <https://www.mailcontrol.com/sr/0rp!JUjVdg7GX2PQPOmvUo1yZ91kITL4y92GS5Ba1a1R!khHnxdqh5TV!DiD!7MCQGpUKsswpNw5N50IUBelLw==>
> si ce message est indésirable (pourriel).
>
>
> ---------- Forwarded message ----------
> From: Jolibois Tony <tjolibois@xxxxxx>
> To: Ryan May <rmay@xxxxxxxx>
> Cc: "joan.sala@xxxxxxxxxxxxxxxxxxxxxxxx" <
> joan.sala@xxxxxxxxxxxxxxxxxxxxxxxx>, THREDDS community <
> thredds@xxxxxxxxxxxxxxxx>
> Date: Mon, 14 Dec 2015 10:25:36 +0000
> Subject: Re: [thredds] TDS NCSS: issue with netCDF4 files as input and
> netCDF4 requested as output
>
> Dear Ryan,
>
> Ok, new issue. Do you have a planning for the correction ? More
> generally, do you have a roadmap for Thredds Data Server developments ? The
> next versions, what will be corrected etc ?
>
> Thanks.
>
> Best regards,
>
> Tony
>
>
>
> *De :* Ryan May [mailto:rmay@xxxxxxxx]
> *Envoyé :* samedi 12 décembre 2015 00:30
> *À :* Jolibois Tony
> *Cc :* THREDDS community; joan.sala@xxxxxxxxxxxxxxxxxxxxxxxx
> *Objet :* Re: [thredds] TDS NCSS: issue with netCDF4 files as input and
> netCDF4 requested as output
>
>
>
> Thanks for the files, I'm able to reproduce the problem locally.
> Unfortunately, it doesn't appear to be related to the issue #301 as I
> thought.
>
>
>
> I've opened a new issue: https://github.com/Unidata/thredds/issues/330
>
>
>
> You can follow any progress there as I continue to dig.
>
>
>
> Thanks,
>
>
>
> Ryan
>
>
>
> On Fri, Dec 11, 2015 at 1:45 AM, <tjolibois@xxxxxx> wrote:
>
> Hi Christian,
> Please find some FTP link in the end of this email, to download some
> netCDF4 files we've used here for the tests. I've also added part of
> catalina.out, the java_opts used, and the Thredds configuration (simple
> joinExisting aggregation).
> Note that it's only when you request netCDF4 as output that we have an
> error.
> Best regards,
> Tony
>
>
>
> Hi Tony,
>
> Can you provide an example of the NetCDF-4 input file so that we can
> recreate the problem locally?
>
> Thanks,
> Christian
>
> On Thu, Dec 10, 2015 at 8:29 AM, Jolibois Tony wrote:
> Hi Thredds team,
>
> We’re currently testing TDS netCDF Subset Service, its performance,
> robustness.. These tests include different netCDF format, to study the
> impact on performance and robustness with different compression levels.
> To study this impact, we run 4 scenarios for input/output data files for
> TDS NCSS.
> Input netCDF3 => output netCDF3
> Input netCDF4 => output netCDF3
> Input netCDF3 => output netCDF4
> Input netCDF4 => output netCDF4
> We’re facing an error only with the 4th scenario, netCDF4 => netCDF4 (NCSS
> REST parameter &accept=netcdf4).
>
> java.io.IOException: -101: NetCDF: HDF error
> at ucar.nc2.jni.netcdf.Nc4Iosp.writeData(Nc4Iosp.java:2821)
> ~[netcdf4-4.6.3.jar:4.6.3]
> at ucar.nc2.jni.netcdf.Nc4Iosp.writeData(Nc4Iosp.java:2729)
> ~[netcdf4-4.6.3.jar:4.6.3]
> at ucar.nc2.NetcdfFileWriter.write(NetcdfFileWriter.java:953)
> ~[cdm-4.6.3.jar:4.6.3]
> at ucar.nc2.NetcdfFileWriter.write(NetcdfFileWriter.java:937)
> ~[cdm-4.6.3.jar:4.6.3]
> at ucar.nc2.FileWriter2.copyAll(FileWriter2.java:427)
> ~[cdm-4.6.3.jar:4.6.3]
> at ucar.nc2.FileWriter2.copyVarData(FileWriter2.java:380)
> ~[cdm-4.6.3.jar:4.6.3]
> at ucar.nc2.dt.grid.CFGridWriter2.writeOrTestSize(CFGridWriter2.java:244)
> ~[cdm-4.6.3.jar:4.6.3]
> at ucar.nc2.dt.grid.CFGridWriter2.writeFile(CFGridWriter2.java:112)
> ~[cdm-4.6.3.jar:4.6.3]
> at
> thredds.server.ncss.controller.GridResponder.writeGridFile(GridResponder.java:250)
> ~[classes/:4.6.3]
> at
> thredds.server.ncss.controller.GridResponder.writeLatLonSubset(GridResponder.java:166)
> ~[classes/:4.6.3]
> at
> thredds.server.ncss.controller.GridResponder.getResponseFile(GridResponder.java:97)
> ~[classes/:4.6.3]
> at
> thredds.server.ncss.controller.NcssController.handleRequestGrid(NcssController.java:175)
> ~[classes/:4.6.3]
> at
> thredds.server.ncss.controller.NcssController.handleRequest(NcssController.java:140)
> ~[classes/:4.6.3]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_65]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_65]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_65]
> at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_65]
>
> The error comes from netcdf4 java library used inside TDS version 4.6.3
> (latest stable version).
> The error appears only if we have a geographical subset (works with no
> subset or temporal aggregation).
> Different NetCDF-4 input files have been tested:
> • original Netcdf3 files converted with the command nccopy –k4 –d3
> input.nc output.nc4
> • original Netcdf4 generated with python library
> For information on software versions:
> misgw-qt-new:/home/misgw# ls -ltr
> total 246300
> -rw-r--r-- 1 root root 9130958 oct 7 21:09 apache-tomcat-8.0.28.tar.gz
> -rw-rw-r-- 1 misgw misgw 181260798 nov 9 10:48 jdk-8u65-linux-x64.gz
> -rw-r--r-- 1 root root 61808104 nov 9 11:03 thredds_4.6.3.war
>
> Thanks for the support.
> Tony Jolibois
>
> -
> Tony Jolibois
> Product Dissemination Services
> Space Oceanography
> +33 5 61 39 37 97
> Files attached to this message
>
> *Filename*
>
> *Size*
>
> netCDF4.zip
>
> 13 MB
>
> catalina.out
>
> 6 KB
>
> java_opts.sh
>
> 1012.0 B
>
> m_LR_OBS_nc4.xml
>
> 2 KB
>
> m_Surcouf_C4.xml
>
> 2 KB
>
> Please click on the following link to download the attachments:
> http://ftp-mail.cls.fr/message/XY07Uo3bGqdx38DKHGNgyD
>
> The attachments are available until: *Friday, 18 December.*
>
> Message ID: XY07Uo3
>
> *CLS — Secure Filetransfer Appliance
> <http://www.allardsoft.com/filetransfer>: http://ftp-mail.cls.fr/
> <http://ftp-mail.cls.fr/> *
>
>
> _______________________________________________
> thredds mailing list
> thredds@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe, visit:
> http://www.unidata.ucar.edu/mailing_lists/
>
>
>
>
>
> --
>
> Ryan May
>
> Software Engineer
>
> UCAR/Unidata
>
> Boulder, CO
>
>
>
> Cliquez ici <https://www.mailcontrol.com/sr/MZbqvYs5QwJvpeaetUwhCQ==> si
> ce message est indésirable (pourriel).
>
> _______________________________________________
> NOTE: All exchanges posted to Unidata maintained email lists are
> recorded in the Unidata inquiry tracking system and made publicly
> available through the web. Users who post to any of the lists we
> maintain are reminded to remove any personal information that they
> do not want to be made public.
>
>
> thredds mailing list
> thredds@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe, visit:
> http://www.unidata.ucar.edu/mailing_lists/
>
