Quick search Find article
Quick search
Find article

IO strategies and data services for petascale data sets from a global cloud resolving model

K L Schuchardt, B J Palmer, J A Daily, T O Elsethagen and A S Koontz

Show affiliations


Global cloud resolving models at resolutions of 4km or less create significant challenges for simulation output, data storage, data management, and post-simulation analysis and visualization. To support efficient model output as well as data analysis, new methods for IO and data organization must be evaluated. The model we are supporting, the Global Cloud Resolving Model being developed at Colorado State University, uses a geodesic grid. The non-monotonic nature of the grid's coordinate variables requires enhancements to existing data processing tools and community standards for describing and manipulating grids. The resolution, size and extent of the data suggest the need for parallel analysis tools and allow for the possibility of new techniques in data mining, filtering and comparison to observations. We describe the challenges posed by various aspects of data generation, management, and analysis, our work exploring IO strategies for the model, and a preliminary architecture, web portal, and tool enhancements which, when complete, will enable broad community access to the data sets in familiar ways to the community.


PACS

93.85.Bc Computational methods and data processing, data acquisition and storage

92.60.Nv Cloud physics; stratus and cumulus clouds

07.05.Kf Data analysis: algorithms and implementation; data management

Subjects

Instrumentation and measurement

Environmental and Earth science

Dates

Issue 1 (2007)



View by subject




Export






Please login to access our web services, or create an account if you don't yet have one.

You must have cookies enabled in your web browser to be able to login.

Username
Password

Forgotten your password? Get a new one here.