Re: [thredds] nco as a web service

Could the the OGC's Web Processing Service spec
(http://en.wikipedia.org/wiki/Web_Processing_Service) serve that
function?

--john


On Mon, Jun 18, 2012 at 3:56 PM, Roy Mendelssohn
<roy.mendelssohn@xxxxxxxx> wrote:
> But for a useful service, the form and syntax of the URL should be 
> independent of the mechanism that does the server side calculations  (which 
> rules out SWAMP).  So for example, both Grads an F-TDS use the same format in 
> the URL to say that "this is an expression", but the expressions themselves 
> are platform specific.  That is not the way to get overarching services.
>
> Instead, we need agreement on how in the URL request we signal a server-side 
> function, the syntax of that function (independent of the engine underneath) 
> and a few simple functions to start  (say simple data transformations, 
> differencing and averaging on a dimension(s)).  Then the server back-end can 
> parse the request and use Ferret or Grads or NCO or Python or whatever is 
> desired, and like with any good service, the back end could change  without 
> having any affect on the URL or the user.
>
> I know Matthew Arrott at least used to like the approach in Chapter 12 of 
> "Python Scripting for Computation Science".  But a lot of that is the engine 
> underneath.  I am more interested in the form of the URL.  Get some agreement 
> on that, and some real implementation could proceed.
>
> -Roy
>
>
>
>
>
> On Jun 18, 2012, at 2:37 PM, Russ Rew wrote:
>
>> Jeff,
>>
>>> However, we have to keep in mind performance ramifications. It still takes
>>> a long time to move gigabytes of data across a network. This brings up the
>>> importance of moving the computation to the data, instead of moving the
>>> data to the computation. For some data sets and many use cases remote
>>> access to data works very well so things like brokering are tractable.
>>> However, for *big* data sets (e.g., climate model output) we need to come
>>> up with richer mechanisms (like the NCO on local data) to bring computation
>>> to the data.
>>
>> See Daniel Wang's SWAMP (the Script Workflow Analysis for
>> MultiProcessing), built on top of NCO:
>>
>>  https://code.google.com/p/swamp/
>>
>> --Russ
>>
>> _______________________________________________
>> thredds mailing list
>> thredds@xxxxxxxxxxxxxxxx
>> For list information or to unsubscribe,  visit: 
>> http://www.unidata.ucar.edu/mailing_lists/
>
> **********************
> "The contents of this message do not reflect any position of the U.S. 
> Government or NOAA."
> **********************
> Roy Mendelssohn
> Supervisory Operations Research Analyst
> NOAA/NMFS
> Environmental Research Division
> Southwest Fisheries Science Center
> 1352 Lighthouse Avenue
> Pacific Grove, CA 93950-2097
>
> e-mail: Roy.Mendelssohn@xxxxxxxx (Note new e-mail address)
> voice: (831)-648-9029
> fax: (831)-648-8440
> www: http://www.pfeg.noaa.gov/
>
> "Old age and treachery will overcome youth and skill."
> "From those who have been given much, much will be expected"
> "the arc of the moral universe is long, but it bends toward justice" -MLK Jr.
>
> _______________________________________________
> thredds mailing list
> thredds@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit: 
> http://www.unidata.ucar.edu/mailing_lists/