Re: [thredds] NCSS: deselect latitude, longitude, and station number in single-station time-series?

  • To: John Caron <jcaron1129@xxxxxxxxx>
  • Subject: Re: [thredds] NCSS: deselect latitude, longitude, and station number in single-station time-series?
  • From: Aaron Sweeney - NOAA Affiliate <aaron.sweeney@xxxxxxxx>
  • Date: Tue, 1 Mar 2016 15:17:25 -0700
A browser.  Chrome or Firefox for the most part.

On Tue, Mar 1, 2016 at 2:53 PM, John Caron <jcaron1129@xxxxxxxxx> wrote:

> The HTTP layer does it transparently, so typically you dont see it unless
> you are working at the HTTP layer.
> Will have to check that we have it turned on in the TDS.
>
> What client do you use? A browser, or?
>
> On Tue, Mar 1, 2016 at 2:28 PM, Aaron Sweeney - NOAA Affiliate <
> aaron.sweeney@xxxxxxxx> wrote:
>
>> Hi, John,
>>
>>      Is compression of CSV an option?  I had no idea.  How could I enable
>> that?
>>
>> Thanks,
>> Aaron
>>
>> On Tue, Mar 1, 2016 at 2:27 PM, John Caron <jcaron1129@xxxxxxxxx> wrote:
>>
>>> With compression, I wonder if the bandwidth is so bad? Would be helpful
>>> to measure.
>>>
>>> On Tue, Mar 1, 2016 at 2:16 PM, Ryan May <rmay@xxxxxxxx> wrote:
>>>
>>>> Aaron,
>>>>
>>>> The answer to your question is: no, the TDS can't do this...currently.
>>>> We do have plans to focus some improvements on our support for
>>>> observational point data, so we'll be sure to keep this use case in mind.
>>>>
>>>> Sorry I can't give you a better answer for today, though.
>>>>
>>>> Ryan
>>>>
>>>> On Tue, Mar 1, 2016 at 1:58 PM, Aaron Sweeney - NOAA Affiliate <
>>>> aaron.sweeney@xxxxxxxx> wrote:
>>>>
>>>>> Hi, Rich,
>>>>>
>>>>>       Thanks very much for the information on what additional formats
>>>>> ERDDAP supports.  Yes, many users just want CSV.  Unfortunately, ERDDAP is
>>>>> not a viable option for me at this time.
>>>>>
>>>>>       So I suppose it's still an open question if TDS can support this
>>>>> use-case through NCSS.
>>>>>
>>>>> Thanks,
>>>>> Aaron
>>>>>
>>>>> On Tue, Mar 1, 2016 at 12:38 PM, Signell, Richard <rsignell@xxxxxxxx>
>>>>> wrote:
>>>>>
>>>>>> Aaron,
>>>>>>
>>>>>> If you guys have essentially tabular data in CF-1.6 compliant netcdf
>>>>>> files (which it looks like you do), and want to deliver CSV, JSON and
>>>>>> other formats for users, you might consider setting up an ERDDAP
>>>>>> server in addition to THREDDS.   Folks love that you can download CSV,
>>>>>> JSON, .mat files, etc using RESTFUL syntax, just like the NCSS.
>>>>>>
>>>>>> ERDDAP has the ability to read directly from CF-1.6 NetCDF files:
>>>>>>
>>>>>> http://coastwatch.pfeg.noaa.gov/erddap/download/setupDatasetsXml.html#EDDTableFromNcCFFiles
>>>>>> and installation/setup/maintenance of ERDDAP has become a lot easier
>>>>>> now that it's been dockerized:
>>>>>> https://hub.docker.com/r/axiom/docker-erddap/
>>>>>>
>>>>>> Here's a site installed with ERDDAP container that hosts CF-1.6
>>>>>> netCDF files:
>>>>>>
>>>>>> http://hydromet-thredds.princeton.edu:8000/erddap/info/index.html?page=1&itemsPerPage=1000
>>>>>>
>>>>>> Here's a example request of  data from just two variables for the
>>>>>> last 7 days:
>>>>>>
>>>>>> 1. as htmlTable:
>>>>>>
>>>>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.htmlTable?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>>>>
>>>>>> 2. as CSV
>>>>>>
>>>>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.csv?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>>>>
>>>>>> 3. as JSON
>>>>>>
>>>>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.json?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>>>>
>>>>>> I say this as a happy THREDDS Data Server user -- no reason not to
>>>>>> have both TDS and ERDDAP, but ERDDAP is especially nice for tabular
>>>>>> data.
>>>>>>
>>>>>> -Rich
>>>>>>
>>>>>> On Mon, Feb 29, 2016 at 6:40 PM, Aaron Sweeney - NOAA Affiliate
>>>>>> <aaron.sweeney@xxxxxxxx> wrote:
>>>>>> > Hi,
>>>>>> >
>>>>>> >      I am providing netCDF data via TDS and using NCSS (subset
>>>>>> service) to
>>>>>> > provide the option of downloading data as CSV.
>>>>>> >
>>>>>> >      Is it possible to deselect latitude, longitude, and station
>>>>>> number in a
>>>>>> > time-series netCDF file that contains only one station with one
>>>>>> latitude and
>>>>>> > longitude?  The resultant CSV files contain extra columns for
>>>>>> station
>>>>>> > number, latitude, and longitude.  Because these values never
>>>>>> change, this
>>>>>> > seems like a waste of bandwidth.  In my netCDF files, I have
>>>>>> specified the
>>>>>> > dimension of the timeSeries to 1, rather than leave it out entirely.
>>>>>> >
>>>>>> >       Here's a live example where I'm selecting four physical
>>>>>> variables via
>>>>>> > NCSS, but I also get back station number, latitude, and longitude:
>>>>>> >
>>>>>> >
>>>>>> http://www.ngdc.noaa.gov/thredds/ncss/dart_bpr/processed/54401/54401_20090912to20130828_qc.nc?var=seafloor_pressure_abs_quality_controlled&var=seafloor_pressure_abs_modelled&var=seafloor_pressure_residual&var=temperature&temporal=all&accept=csv
>>>>>> >
>>>>>> > Thanks,
>>>>>> > Aaron
>>>>>> >
>>>>>> > --
>>>>>> > Aaron D. Sweeney
>>>>>> > Water Level Data Manager
>>>>>> >
>>>>>> > Cooperative Institute for Research in Environmental Sciences (CIRES)
>>>>>> > University of Colorado at Boulder
>>>>>> > and
>>>>>> > NOAA National Centers for Environmental Information
>>>>>> > formerly NOAA's National Geophysical Data Center
>>>>>> > 325 Broadway, E/NE42
>>>>>> > Boulder, CO 80305-3328
>>>>>> >
>>>>>> > Phone: 303-497-4797, Fax: 303-497-6513
>>>>>> >
>>>>>> > DISCLAIMER: The contents of this message are mine personally and do
>>>>>> not
>>>>>> > necessarily reflect any position of NOAA.
>>>>>> >
>>>>>> > _______________________________________________
>>>>>> > thredds mailing list
>>>>>> > thredds@xxxxxxxxxxxxxxxx
>>>>>> > For list information or to unsubscribe,  visit:
>>>>>> > http://www.unidata.ucar.edu/mailing_lists/
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Dr. Richard P. Signell   (508) 457-2229
>>>>>> USGS, 384 Woods Hole Rd.
>>>>>> Woods Hole, MA 02543-1598
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Aaron D. Sweeney
>>>>> Water Level Data Manager
>>>>>
>>>>> Cooperative Institute for Research in Environmental Sciences (CIRES)
>>>>> University of Colorado at Boulder
>>>>> and
>>>>> NOAA National Centers for Environmental Information
>>>>> *formerly NOAA's National Geophysical Data Center*
>>>>> 325 Broadway, E/NE42
>>>>> Boulder, CO 80305-3328
>>>>>
>>>>> Phone: 303-497-4797, Fax: 303-497-6513
>>>>>
>>>>> DISCLAIMER: The contents of this message are mine personally and do
>>>>> not necessarily reflect any position of NOAA.
>>>>>
>>>>> _______________________________________________
>>>>> thredds mailing list
>>>>> thredds@xxxxxxxxxxxxxxxx
>>>>> For list information or to unsubscribe,  visit:
>>>>> http://www.unidata.ucar.edu/mailing_lists/
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Ryan May, Ph.D.
>>>> Software Engineer
>>>> UCAR/Unidata
>>>> Boulder, CO
>>>>
>>>> _______________________________________________
>>>> thredds mailing list
>>>> thredds@xxxxxxxxxxxxxxxx
>>>> For list information or to unsubscribe,  visit:
>>>> http://www.unidata.ucar.edu/mailing_lists/
>>>>
>>>
>>>
>>
>>
>> --
>> Aaron D. Sweeney
>> Water Level Data Manager
>>
>> Cooperative Institute for Research in Environmental Sciences (CIRES)
>> University of Colorado at Boulder
>> and
>> NOAA National Centers for Environmental Information
>> *formerly NOAA's National Geophysical Data Center*
>> 325 Broadway, E/NE42
>> Boulder, CO 80305-3328
>>
>> Phone: 303-497-4797, Fax: 303-497-6513
>>
>> DISCLAIMER: The contents of this message are mine personally and do not
>> necessarily reflect any position of NOAA.
>>
>
>


-- 
Aaron D. Sweeney
Water Level Data Manager

Cooperative Institute for Research in Environmental Sciences (CIRES)
University of Colorado at Boulder
and
NOAA National Centers for Environmental Information
*formerly NOAA's National Geophysical Data Center*
325 Broadway, E/NE42
Boulder, CO 80305-3328

Phone: 303-497-4797, Fax: 303-497-6513

DISCLAIMER: The contents of this message are mine personally and do not
necessarily reflect any position of NOAA.
  • 2016 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: