Re: [thredds] OPeNDAP Clients and Cookies

Hi all:

Yes, the info Nathan provides is correct AFAIU. 

Tomcat is commercial-grade software, used on high volume sites, managing 1000s 
of simultaneous connections. So there are already solutions for the common 
problem of authorization/authentication. And if you need more than whats out of 
the box, you can buy high performance servers for a small fraction of the cost 
of developing them.

Anyway, Tomcat JDBCRealm seems a likely candidate for your authentication; it 
would talk to your mySQL database, which you are managing from another web 
service etc.

Also, the TDS has a pluggable authorization mechanism, read these for 
background:

  
http://www.unidata.ucar.edu/projects/THREDDS/tech/tds4.3/reference/RestrictedAccess.html

  
http://www.unidata.ucar.edu/projects/THREDDS/tech/tds4.3/reference/PluggableRestrictedAccess.html

The CISL ESG group (Eric Neinhouse et al) delevoped a custom TDS authorizer, 
you might want to talk to them. We developed the pluggable scheme in conjustion 
with them. The requirement was to authenticate with SSL, but not to be forced 
to send data under SSL. Not something you would do with your banking app, but 
good for scientific data you just want to restrict access to.

John

BTW, I always confuse authorization and authentication. google "authorization 
vs authentication" to get the background, eg

  http://people.duke.edu/~rob/kerberos/authvauth.html


On 4/2/2013 1:18 PM, Nathan Potter wrote:
> 
> 
> Kevin,
> 
> I made a number of comments below. I think I got the facts right and II am 
> hoping that James jumps in if he sees a mistake.
> 
> 
> Nathan
> 
> 
> On Apr 2, 2013, at 9:38 AM, Kevin Manross wrote:
> 
>>
>> Thank you all for the feedback!
>>
>> Since I've already handled authentication for browser based logins, I'm 
>> concerned with other (command line or plugin) opendap client login.
>>
>> Jeff mentioned using Basic Authentication for clients like RAMADDA and IDV.  
>> If I understand correctly, this requires maintaining the user list in the 
>> tomcat-users.xml file.  If this is correct, I don't think is not a viable 
>> option to maintain our 9000+ users which we currently maintain in a mysql 
>> database.  (I would be very happy to learn that I don't have a proper 
>> understanding of the tomcat basic authentication process, so please correct 
>> me if needed.)
> 
> Tomcat can use a number of existing external authentication services (for 
> example LDAP) for identifying users: 
> http://tomcat.apache.org/tomcat-6.0-doc/realm-howto.html
> 
> I imagine that it would be possible to utilize the JDBCRealm to conduct your 
> user authentication.
> 
> As far as authorization goes you might need to do something more - if you 
> already have something like the notion of "groups" in your user-base you 
> might already be thinking of translating those into different (tiered) levels 
> of access and that might be done along with the authentication step by 
> creating tomcat "roles" that parallel the "groups".
> 
>> I could envision writing a filter that parses the BA-style url syntax to 
>> obtain the user/pass and then access our mysql users database to verify.  
>> However, when testing our gribcollection best time series with the IDV 
>> (without restriction), the volume of requests to obtain the subdomain of 
>> data was relatively large.  My concern is how much overhead there would be 
>> to verify each request via mysql when sent in rapid succession like that.
> 
> I don't think that would be required, once you have your credentials (session 
> cookies) then the client should be able to return the cookie to Tomcat with 
> subsequent requests - up to the point the cookie expires or is invalidated by 
> the server. If the command line clients can't cope with that then you might 
> have to look at using certificates issued to the users - I believe that once 
> a certificate is correctly installed and identified to (most of?) the DAP2 
> client software implementations that they already know how to feed it to a 
> server and make the authentication step.
> 
> 
>> If I understand John correctly, clients technically can send a cookie over 
>> the HTTP protocol, but there is no guarantee that a client has this 
>> capability.  It would be great if there was something akin to wget's 
>> --load-cookies option for opendap clients.  All of this is for the current 
>> (3.7, I believe) version of opendap.
> 
> To be clear - while the DAP2 protocol is tied to HTTP the DAP2 Protocol 
> pretty much does not address the issues of authentication and authorization. 
> These are assumed to be handled elsewhere
> 
>>
>> So it sounds to me that my best course of action may be to pursue the filter 
>> option(?) - unless anyone can correct my understanding     above or offer 
>> another way to think about this.
> 
> If you're doing something custom then I would say a filter is the way to go.  
> I think that this is an area where we anticipate receiving some funding and 
> that we have been engaged in active but low bandwidth discussion of this 
> topic over the last several months. We should keep communicating about this 
> it may be that we may find places to work together for a general solution.
> 
> 
> N
> 
> 
>>
>> -kevin.
>>
>>
>> On 4/1/13 5:34 PM, John Caron wrote:
>>> Hi kevin:
>>>
>>> Cookies are part of standard HTTP, and are passed (both ways) in the HTTP 
>>> header.  Opendap is built on top of HTTP, and so any opendap client has a 
>>> mechanism for passing cookies. Whether they do so or not depends on the 
>>> client. I dont think they are required to (?).
>>>
>>> Cookies are used to maintain session state on the server. This can mean 
>>> that the server only has to authenticate once for a session. That is mostly 
>>> just a performance issue, but in the worst case, the client could pop up a 
>>> user login window for each request, of which there are often many for any 
>>> given dataset access. But the client could also cache the authentication 
>>> header and send it each time. So cookies arent totally necessary, whats 
>>> really important is that the client does something reasonable.
>>>
>>> There is also a subtle (and usually rare) problem on datasets that can 
>>> change while being accessed, when you dont manage state, blogged about here:
>>>
>>> http://www.unidata.ucar.edu/blogs/developer/en/entry/indexed_data_access_and_coordinate
>>>
>>> My own opinion is that state is necessary, though perhaps evil. Web servers 
>>> like apache and tomcat do all the heavy lifting, so i       think its not a 
>>> huge burden on server writers. If I was king of opendap i would specify 
>>> that clients must return cookies.
>>>
>>> I think if you follow standard HTTP practices, and an opendap client 
>>> misbehaves, its up to the client to improve or risk becoming obsolete. 
>>> There are plenty of robust HTTP libraries in all languages, so there is 
>>> really no good excuse for clients not to do something reasonable.
>>>
>>> John
>>>
>>> On 4/1/2013 11:04 AM, Kevin Manross wrote:
>>>>
>>>> Greetings,
>>>>
>>>> To server our data, we set a cookie once the user successfully logs in
>>>> to our website.  We check for that cookie upon return to the website.  I
>>>> have successfully written a filter for our experimental TDS and it seems
>>>> to handle web browser interactions by checking for cookies and
>>>> redirecting to our login if need be.  My next step is how to handle
>>>> opendap requests.
>>>>
>>>> I have been reading up on the various ways to authenticate opendap
>>>> requests (primarily via THREDDS), many of which refer to the server
>>>> setting a session cookie upon successful login. My question is, how is
>>>> the session cookie checked upon subsequent requests by opendap clients
>>>> like IDL, Matlab, IDV, pydap, etc.?
>>>>
>>>> We have a mechanism to allow users to obtain and store cookie
>>>> information for use in non-browser-sessions like scripts.  These scripts
>>>> usually involve wget which has a way to load cookies.  Do opendap
>>>> clients have any such way to send a cookie?
>>>>
>>>> This is a major hurdle for our service and any feedback is greatly
>>>> appreciated!
>>>>
>>>> Thanks!
>>>>
>>>> -kevin.
>>>>
>>>> -- 
>>>> Kevin Manross
>>>> NCAR/CISL/Data Support Section
>>>> Phone: (303)-497-1218
>>>> Email:manross@xxxxxxxx <mailto:manross@xxxxxxxx>
>>>> Web:http://rda.ucar.edu
>>>>
>>>>
>>>> _______________________________________________
>>>> thredds mailing list
>>>> thredds@xxxxxxxxxxxxxxxx
>>>> For list information or to unsubscribe,  visit: 
>>>> http://www.unidata.ucar.edu/mailing_lists/
>>>>
>>>
>>> _______________________________________________
>>> thredds mailing list
>>> thredds@xxxxxxxxxxxxxxxx
>>> For list information or to unsubscribe,  visit: 
>>> http://www.unidata.ucar.edu/mailing_lists/
>>
>> -- 
>> Kevin Manross
>> NCAR/CISL/Data Support Section
>> Phone: (303)-497-1218
>> Email:manross@xxxxxxxx
>> Web:http://rda.ucar.edu
>> _______________________________________________
>> thredds mailing list
>> thredds@xxxxxxxxxxxxxxxx
>> For list information or to unsubscribe,  visit: 
>> http://www.unidata.ucar.edu/mailing_lists/
> 
> = = =
> Nathan Potter                        ndp at opendap.org
> OPeNDAP, Inc.                        +1.541.231.3317
> 
> 
> 
> 
> _______________________________________________
> thredds mailing list
> thredds@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit: 
> http://www.unidata.ucar.edu/mailing_lists/
> 



  • 2013 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: