The open archive for STFC research publications

ePubs will be offline on Wednesday 25/11 for essential maintenance. The service will be at risk between 09:00 and 12:00. We apologise for any inconvenience.

Full Record Details

Persistent URL http://purl.org/net/epubs/work/30369
Record Status Checked
Record Id 30369
Title High Performance Computing needs High Performance Data Management High Performance
Abstract Parallel environmental models are currently some of the most demanding codes we have. They push the machines available to their limit and are still in need of more resources. However the bottleneck in running these codes is not so much the code performance as the data handling strategies employed. To address the identified environmental research challenges, researchers need access to a wide range of observational data and model output, covering the human, physio-chemical and biological components of the Earth system. This data should be recognised as a highly valuable resource, but data from existing data centres are frequently under-used because of the difficulties of accessing the data and of assessing whether they contain anything of interest or relevance. Furthermore data exploration is still in its early stages. The seriousness of the problem is increasing rapidly, as new computer and observation technologies encourage the production of more data in shorter time spans. For an efficient working environment, mechanisms have to be put in place to support scientific work more effectively. The High Performance Computing Initiative Centre at CLRC, Daresbury Laboratory (UK) has set up a project to investigate this important issue (DAMP - Data Management in Climate Research Project). Although this project is specifically targeting problems in Climate Research many of its finding are easily applicable to other scientific disciplines. Besides analysing existing solutions, the project will also look for new, more flexible and portable approaches.
Organisation CCLRC , ESC , ESC-DMG
Keywords Data Management , Data Mining , Visualisation
Related record(s):
Language English (EN)
Type Details URI(s) Local file(s) Year
Miscellaneous Computing 1999 - Grand Challenges in Computer Simulation p.331-336 Adrian Tentner (Eds), The Society for Computer Simulation International (SCS), San Diego, California, USA, (April 1999). http://www.dl.ac.…blications/hpc99.htm hpc99.htm 1999
Showing record 1 of 1
Science and Technology Facilities Council Switchboard: 01793 442000