Hi, John,
Is compression of CSV an option? I had no idea. How could I enable
that?
Thanks,
Aaron
On Tue, Mar 1, 2016 at 2:27 PM, John Caron <jcaron1129@xxxxxxxxx> wrote:
> With compression, I wonder if the bandwidth is so bad? Would be helpful to
> measure.
>
> On Tue, Mar 1, 2016 at 2:16 PM, Ryan May <rmay@xxxxxxxx> wrote:
>
>> Aaron,
>>
>> The answer to your question is: no, the TDS can't do this...currently. We
>> do have plans to focus some improvements on our support for observational
>> point data, so we'll be sure to keep this use case in mind.
>>
>> Sorry I can't give you a better answer for today, though.
>>
>> Ryan
>>
>> On Tue, Mar 1, 2016 at 1:58 PM, Aaron Sweeney - NOAA Affiliate <
>> aaron.sweeney@xxxxxxxx> wrote:
>>
>>> Hi, Rich,
>>>
>>> Thanks very much for the information on what additional formats
>>> ERDDAP supports. Yes, many users just want CSV. Unfortunately, ERDDAP is
>>> not a viable option for me at this time.
>>>
>>> So I suppose it's still an open question if TDS can support this
>>> use-case through NCSS.
>>>
>>> Thanks,
>>> Aaron
>>>
>>> On Tue, Mar 1, 2016 at 12:38 PM, Signell, Richard <rsignell@xxxxxxxx>
>>> wrote:
>>>
>>>> Aaron,
>>>>
>>>> If you guys have essentially tabular data in CF-1.6 compliant netcdf
>>>> files (which it looks like you do), and want to deliver CSV, JSON and
>>>> other formats for users, you might consider setting up an ERDDAP
>>>> server in addition to THREDDS. Folks love that you can download CSV,
>>>> JSON, .mat files, etc using RESTFUL syntax, just like the NCSS.
>>>>
>>>> ERDDAP has the ability to read directly from CF-1.6 NetCDF files:
>>>>
>>>> http://coastwatch.pfeg.noaa.gov/erddap/download/setupDatasetsXml.html#EDDTableFromNcCFFiles
>>>> and installation/setup/maintenance of ERDDAP has become a lot easier
>>>> now that it's been dockerized:
>>>> https://hub.docker.com/r/axiom/docker-erddap/
>>>>
>>>> Here's a site installed with ERDDAP container that hosts CF-1.6 netCDF
>>>> files:
>>>>
>>>> http://hydromet-thredds.princeton.edu:8000/erddap/info/index.html?page=1&itemsPerPage=1000
>>>>
>>>> Here's a example request of data from just two variables for the last
>>>> 7 days:
>>>>
>>>> 1. as htmlTable:
>>>>
>>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.htmlTable?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>>
>>>> 2. as CSV
>>>>
>>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.csv?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>>
>>>> 3. as JSON
>>>>
>>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.json?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>>
>>>> I say this as a happy THREDDS Data Server user -- no reason not to
>>>> have both TDS and ERDDAP, but ERDDAP is especially nice for tabular
>>>> data.
>>>>
>>>> -Rich
>>>>
>>>> On Mon, Feb 29, 2016 at 6:40 PM, Aaron Sweeney - NOAA Affiliate
>>>> <aaron.sweeney@xxxxxxxx> wrote:
>>>> > Hi,
>>>> >
>>>> > I am providing netCDF data via TDS and using NCSS (subset
>>>> service) to
>>>> > provide the option of downloading data as CSV.
>>>> >
>>>> > Is it possible to deselect latitude, longitude, and station
>>>> number in a
>>>> > time-series netCDF file that contains only one station with one
>>>> latitude and
>>>> > longitude? The resultant CSV files contain extra columns for station
>>>> > number, latitude, and longitude. Because these values never change,
>>>> this
>>>> > seems like a waste of bandwidth. In my netCDF files, I have
>>>> specified the
>>>> > dimension of the timeSeries to 1, rather than leave it out entirely.
>>>> >
>>>> > Here's a live example where I'm selecting four physical
>>>> variables via
>>>> > NCSS, but I also get back station number, latitude, and longitude:
>>>> >
>>>> >
>>>> http://www.ngdc.noaa.gov/thredds/ncss/dart_bpr/processed/54401/54401_20090912to20130828_qc.nc?var=seafloor_pressure_abs_quality_controlled&var=seafloor_pressure_abs_modelled&var=seafloor_pressure_residual&var=temperature&temporal=all&accept=csv
>>>> >
>>>> > Thanks,
>>>> > Aaron
>>>> >
>>>> > --
>>>> > Aaron D. Sweeney
>>>> > Water Level Data Manager
>>>> >
>>>> > Cooperative Institute for Research in Environmental Sciences (CIRES)
>>>> > University of Colorado at Boulder
>>>> > and
>>>> > NOAA National Centers for Environmental Information
>>>> > formerly NOAA's National Geophysical Data Center
>>>> > 325 Broadway, E/NE42
>>>> > Boulder, CO 80305-3328
>>>> >
>>>> > Phone: 303-497-4797, Fax: 303-497-6513
>>>> >
>>>> > DISCLAIMER: The contents of this message are mine personally and do
>>>> not
>>>> > necessarily reflect any position of NOAA.
>>>> >
>>>> > _______________________________________________
>>>> > thredds mailing list
>>>> > thredds@xxxxxxxxxxxxxxxx
>>>> > For list information or to unsubscribe, visit:
>>>> > http://www.unidata.ucar.edu/mailing_lists/
>>>>
>>>>
>>>>
>>>> --
>>>> Dr. Richard P. Signell (508) 457-2229
>>>> USGS, 384 Woods Hole Rd.
>>>> Woods Hole, MA 02543-1598
>>>>
>>>
>>>
>>>
>>> --
>>> Aaron D. Sweeney
>>> Water Level Data Manager
>>>
>>> Cooperative Institute for Research in Environmental Sciences (CIRES)
>>> University of Colorado at Boulder
>>> and
>>> NOAA National Centers for Environmental Information
>>> *formerly NOAA's National Geophysical Data Center*
>>> 325 Broadway, E/NE42
>>> Boulder, CO 80305-3328
>>>
>>> Phone: 303-497-4797, Fax: 303-497-6513
>>>
>>> DISCLAIMER: The contents of this message are mine personally and do not
>>> necessarily reflect any position of NOAA.
>>>
>>> _______________________________________________
>>> thredds mailing list
>>> thredds@xxxxxxxxxxxxxxxx
>>> For list information or to unsubscribe, visit:
>>> http://www.unidata.ucar.edu/mailing_lists/
>>>
>>
>>
>>
>> --
>> Ryan May, Ph.D.
>> Software Engineer
>> UCAR/Unidata
>> Boulder, CO
>>
>> _______________________________________________
>> thredds mailing list
>> thredds@xxxxxxxxxxxxxxxx
>> For list information or to unsubscribe, visit:
>> http://www.unidata.ucar.edu/mailing_lists/
>>
>
>
--
Aaron D. Sweeney
Water Level Data Manager
Cooperative Institute for Research in Environmental Sciences (CIRES)
University of Colorado at Boulder
and
NOAA National Centers for Environmental Information
*formerly NOAA's National Geophysical Data Center*
325 Broadway, E/NE42
Boulder, CO 80305-3328
Phone: 303-497-4797, Fax: 303-497-6513
DISCLAIMER: The contents of this message are mine personally and do not
necessarily reflect any position of NOAA.
