Evaluate a methodology to test Earth system models quickly on large scale computing systems.
In this paper, the utility of ensembles-based testing framework is demonstrated; it was shown that running many short simulations is more efficient than running a single long simulation. It was also demonstrated that aggressive optimizations can lead to simulations with a statistically distinct model state. Also, averaged behavior of many single year runs of the atmosphere are statistically different than one long run, demonstrating atmosphere low-frequency variability.
Ensembles-based testing provides faster verification to model developers when developing at scale. With this testing, developers can now more effectively use multicore computing systems when performing development model simulations.
A strict throughput requirement has placed a cap on the degree to which we can depend on the execution of single, long, fine spatial grid simulations to explore global atmospheric climate behavior. Whereas, running an ensemble of short simulations is computationally more efficient. We test the null hypothesis that the climate statistics of a full-complexity atmospheric model derived from an ensemble of independent short simulation is equivalent to that from an equilibrated long simulation. The climate of short simulation ensembles is statistically distinguishable from that of a long simulation in terms of the distribution of global annual means, largely due to the presence of low-frequency atmospheric intrinsic variability in the long simulation. We also find that model climate statistics of the simulation ensemble are sensitive to the choice of compiler optimizations. While some answer-changing optimization choices do not affect the climate state in terms of mean, variability and extremes, aggressive optimizations can result in significantly different climate states.
Contacts (BER PM)
Earth System Modeling Program
Oak Ridge National Laboratory
The U.S. Department of Energy Office of Science, Biological and Environmental Research supported this research as part of the Accelerated Climate Modeling for Energy (ACME) project of the Earth System Modeling (ESM) program.
Mahajan S., A. L. Gaddis, K. J. Evans, and M. R. Norman. “Exploring an ensemble-based approach to atmospheric climate modeling and testing at scale.” Procedia Computer Science, 108C, 735-744, (2017). [DOI:10.1016/j.procs.2017.05.259]
BER Highlight: Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale
SC-23.1 Climate and Environmental Sciences Division, BER
BER supports basic research and scientific user facilities to advance DOE missions in energy and environment. More about BER
Aug 24, 2019
New Approach for Studying How Microbes Influence Their Environment
A diverse group of scientists suggests a common framework and targeting of known microbial processes [more...]
Aug 08, 2019
Nutrient-Hungry Peatland Microbes Reduce Carbon Loss Under Warmer Conditions
Enzyme production in peatlands reduces carbon lost to respiration under future high temperatures. [more...]
Aug 05, 2019
Amazon Forest Response to CO2 Fertilization Dependent on Plant Phosphorus Acquisition
AmazonFACE Model Intercomparison. The Science Plant growth is dependent on the availabi [more...]
Jul 29, 2019
A Slippery Slope: Soil Carbon Destabilization
Carbon gain or loss depends on the balance between competing biological, chemical, and physical reac [more...]
Jul 15, 2019
Field Evaluation of Gas Analyzers for Measuring Ecosystem Fluxes
How gas analyzer type and correction method impact measured fluxes. The Science A side- [more...]
List all highlights (possible long download time)