Talking about the first of Gray's criteria for scalable Scientific Data Management Systems:
1. Data independence: the physical data organization can change without breaking existing applications
[Read More]Whats wrong with Fortran unformatted writes?
23 May 2011
Talking about the first of Gray's criteria for scalable Scientific Data Management Systems:
1. Data independence: the physical data organization can change without breaking existing applications
[Read More]What can we learn from Relational Databases?
16 May 2011
How do we scale up to petabyte datasets? Lessons from the adult in the room, relational databases.
[Read More]Indexed data access and coordinate contract violations
10 May 2011
Indexed data access exposes the physical schema of datasets and makes violations of the relationship between coordinate and indices commonplace for datasets that change, such as aggregations of rolling archives. Making data requests in coordinate space will be added to the next generation of data access protocols, partly in order to solve this problem.
[Read More]Do blogs about Coordinates need to be monotonous?
04 May 2011
You may be shocked that netCDF coordinates can't always be monotonic. Other embarrassing facts are also revealed.
[Read More]