Hi,
Just reporting out on a test I did on the original data file:
Instead of creating a timeSeries with dimension of 1, I left the
timeSeries out entirely. So the variables lat, lon, and depth are scalars,
and the variables for time and for the physical observables are a function
of the time dimension, but not of an additional timeSeries dimension.
The end result was that this broke NCSS (no NCSS page loaded).
I suppose that means NCSS is expecting a timeSeries dimension?
Cordially,
Aaron
On Tue, Mar 1, 2016 at 3:17 PM, Aaron Sweeney - NOAA Affiliate <
aaron.sweeney@xxxxxxxx> wrote:
> A browser. Chrome or Firefox for the most part.
>
> On Tue, Mar 1, 2016 at 2:53 PM, John Caron <jcaron1129@xxxxxxxxx> wrote:
>
>> The HTTP layer does it transparently, so typically you dont see it unless
>> you are working at the HTTP layer.
>> Will have to check that we have it turned on in the TDS.
>>
>> What client do you use? A browser, or?
>>
>> On Tue, Mar 1, 2016 at 2:28 PM, Aaron Sweeney - NOAA Affiliate <
>> aaron.sweeney@xxxxxxxx> wrote:
>>
>>> Hi, John,
>>>
>>> Is compression of CSV an option? I had no idea. How could I
>>> enable that?
>>>
>>> Thanks,
>>> Aaron
>>>
>>> On Tue, Mar 1, 2016 at 2:27 PM, John Caron <jcaron1129@xxxxxxxxx> wrote:
>>>
>>>> With compression, I wonder if the bandwidth is so bad? Would be helpful
>>>> to measure.
>>>>
>>>> On Tue, Mar 1, 2016 at 2:16 PM, Ryan May <rmay@xxxxxxxx> wrote:
>>>>
>>>>> Aaron,
>>>>>
>>>>> The answer to your question is: no, the TDS can't do this...currently.
>>>>> We do have plans to focus some improvements on our support for
>>>>> observational point data, so we'll be sure to keep this use case in mind.
>>>>>
>>>>> Sorry I can't give you a better answer for today, though.
>>>>>
>>>>> Ryan
>>>>>
>>>>> On Tue, Mar 1, 2016 at 1:58 PM, Aaron Sweeney - NOAA Affiliate <
>>>>> aaron.sweeney@xxxxxxxx> wrote:
>>>>>
>>>>>> Hi, Rich,
>>>>>>
>>>>>> Thanks very much for the information on what additional formats
>>>>>> ERDDAP supports. Yes, many users just want CSV. Unfortunately, ERDDAP
>>>>>> is
>>>>>> not a viable option for me at this time.
>>>>>>
>>>>>> So I suppose it's still an open question if TDS can support
>>>>>> this use-case through NCSS.
>>>>>>
>>>>>> Thanks,
>>>>>> Aaron
>>>>>>
>>>>>> On Tue, Mar 1, 2016 at 12:38 PM, Signell, Richard <rsignell@xxxxxxxx>
>>>>>> wrote:
>>>>>>
>>>>>>> Aaron,
>>>>>>>
>>>>>>> If you guys have essentially tabular data in CF-1.6 compliant netcdf
>>>>>>> files (which it looks like you do), and want to deliver CSV, JSON and
>>>>>>> other formats for users, you might consider setting up an ERDDAP
>>>>>>> server in addition to THREDDS. Folks love that you can download
>>>>>>> CSV,
>>>>>>> JSON, .mat files, etc using RESTFUL syntax, just like the NCSS.
>>>>>>>
>>>>>>> ERDDAP has the ability to read directly from CF-1.6 NetCDF files:
>>>>>>>
>>>>>>> http://coastwatch.pfeg.noaa.gov/erddap/download/setupDatasetsXml.html#EDDTableFromNcCFFiles
>>>>>>> and installation/setup/maintenance of ERDDAP has become a lot easier
>>>>>>> now that it's been dockerized:
>>>>>>> https://hub.docker.com/r/axiom/docker-erddap/
>>>>>>>
>>>>>>> Here's a site installed with ERDDAP container that hosts CF-1.6
>>>>>>> netCDF files:
>>>>>>>
>>>>>>> http://hydromet-thredds.princeton.edu:8000/erddap/info/index.html?page=1&itemsPerPage=1000
>>>>>>>
>>>>>>> Here's a example request of data from just two variables for the
>>>>>>> last 7 days:
>>>>>>>
>>>>>>> 1. as htmlTable:
>>>>>>>
>>>>>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.htmlTable?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>>>>>
>>>>>>> 2. as CSV
>>>>>>>
>>>>>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.csv?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>>>>>
>>>>>>> 3. as JSON
>>>>>>>
>>>>>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.json?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>>>>>
>>>>>>> I say this as a happy THREDDS Data Server user -- no reason not to
>>>>>>> have both TDS and ERDDAP, but ERDDAP is especially nice for tabular
>>>>>>> data.
>>>>>>>
>>>>>>> -Rich
>>>>>>>
>>>>>>> On Mon, Feb 29, 2016 at 6:40 PM, Aaron Sweeney - NOAA Affiliate
>>>>>>> <aaron.sweeney@xxxxxxxx> wrote:
>>>>>>> > Hi,
>>>>>>> >
>>>>>>> > I am providing netCDF data via TDS and using NCSS (subset
>>>>>>> service) to
>>>>>>> > provide the option of downloading data as CSV.
>>>>>>> >
>>>>>>> > Is it possible to deselect latitude, longitude, and station
>>>>>>> number in a
>>>>>>> > time-series netCDF file that contains only one station with one
>>>>>>> latitude and
>>>>>>> > longitude? The resultant CSV files contain extra columns for
>>>>>>> station
>>>>>>> > number, latitude, and longitude. Because these values never
>>>>>>> change, this
>>>>>>> > seems like a waste of bandwidth. In my netCDF files, I have
>>>>>>> specified the
>>>>>>> > dimension of the timeSeries to 1, rather than leave it out
>>>>>>> entirely.
>>>>>>> >
>>>>>>> > Here's a live example where I'm selecting four physical
>>>>>>> variables via
>>>>>>> > NCSS, but I also get back station number, latitude, and longitude:
>>>>>>> >
>>>>>>> >
>>>>>>> http://www.ngdc.noaa.gov/thredds/ncss/dart_bpr/processed/54401/54401_20090912to20130828_qc.nc?var=seafloor_pressure_abs_quality_controlled&var=seafloor_pressure_abs_modelled&var=seafloor_pressure_residual&var=temperature&temporal=all&accept=csv
>>>>>>> >
>>>>>>> > Thanks,
>>>>>>> > Aaron
>>>>>>> >
>>>>>>> > --
>>>>>>> > Aaron D. Sweeney
>>>>>>> > Water Level Data Manager
>>>>>>> >
>>>>>>> > Cooperative Institute for Research in Environmental Sciences
>>>>>>> (CIRES)
>>>>>>> > University of Colorado at Boulder
>>>>>>> > and
>>>>>>> > NOAA National Centers for Environmental Information
>>>>>>> > formerly NOAA's National Geophysical Data Center
>>>>>>> > 325 Broadway, E/NE42
>>>>>>> > Boulder, CO 80305-3328
>>>>>>> >
>>>>>>> > Phone: 303-497-4797, Fax: 303-497-6513
>>>>>>> >
>>>>>>> > DISCLAIMER: The contents of this message are mine personally and
>>>>>>> do not
>>>>>>> > necessarily reflect any position of NOAA.
>>>>>>> >
>>>>>>> > _______________________________________________
>>>>>>> > thredds mailing list
>>>>>>> > thredds@xxxxxxxxxxxxxxxx
>>>>>>> > For list information or to unsubscribe, visit:
>>>>>>> > http://www.unidata.ucar.edu/mailing_lists/
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Dr. Richard P. Signell (508) 457-2229
>>>>>>> USGS, 384 Woods Hole Rd.
>>>>>>> Woods Hole, MA 02543-1598
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Aaron D. Sweeney
>>>>>> Water Level Data Manager
>>>>>>
>>>>>> Cooperative Institute for Research in Environmental Sciences (CIRES)
>>>>>> University of Colorado at Boulder
>>>>>> and
>>>>>> NOAA National Centers for Environmental Information
>>>>>> *formerly NOAA's National Geophysical Data Center*
>>>>>> 325 Broadway, E/NE42
>>>>>> Boulder, CO 80305-3328
>>>>>>
>>>>>> Phone: 303-497-4797, Fax: 303-497-6513
>>>>>>
>>>>>> DISCLAIMER: The contents of this message are mine personally and do
>>>>>> not necessarily reflect any position of NOAA.
>>>>>>
>>>>>> _______________________________________________
>>>>>> thredds mailing list
>>>>>> thredds@xxxxxxxxxxxxxxxx
>>>>>> For list information or to unsubscribe, visit:
>>>>>> http://www.unidata.ucar.edu/mailing_lists/
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Ryan May, Ph.D.
>>>>> Software Engineer
>>>>> UCAR/Unidata
>>>>> Boulder, CO
>>>>>
>>>>> _______________________________________________
>>>>> thredds mailing list
>>>>> thredds@xxxxxxxxxxxxxxxx
>>>>> For list information or to unsubscribe, visit:
>>>>> http://www.unidata.ucar.edu/mailing_lists/
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Aaron D. Sweeney
>>> Water Level Data Manager
>>>
>>> Cooperative Institute for Research in Environmental Sciences (CIRES)
>>> University of Colorado at Boulder
>>> and
>>> NOAA National Centers for Environmental Information
>>> *formerly NOAA's National Geophysical Data Center*
>>> 325 Broadway, E/NE42
>>> Boulder, CO 80305-3328
>>>
>>> Phone: 303-497-4797, Fax: 303-497-6513
>>>
>>> DISCLAIMER: The contents of this message are mine personally and do not
>>> necessarily reflect any position of NOAA.
>>>
>>
>>
>
>
> --
> Aaron D. Sweeney
> Water Level Data Manager
>
> Cooperative Institute for Research in Environmental Sciences (CIRES)
> University of Colorado at Boulder
> and
> NOAA National Centers for Environmental Information
> *formerly NOAA's National Geophysical Data Center*
> 325 Broadway, E/NE42
> Boulder, CO 80305-3328
>
> Phone: 303-497-4797, Fax: 303-497-6513
>
> DISCLAIMER: The contents of this message are mine personally and do not
> necessarily reflect any position of NOAA.
>
--
Aaron D. Sweeney
Water Level Data Manager
Cooperative Institute for Research in Environmental Sciences (CIRES)
University of Colorado at Boulder
and
NOAA National Centers for Environmental Information
*formerly NOAA's National Geophysical Data Center*
325 Broadway, E/NE42
Boulder, CO 80305-3328
Phone: 303-497-4797, Fax: 303-497-6513
DISCLAIMER: The contents of this message are mine personally and do not
necessarily reflect any position of NOAA.
