A new collaborative organization for sea ice model development, the CICE Consortium, has devised quality control procedures to maintain the integrity of its numerical codes’ physical representations, enabling broad participation from the scientific community in the Consortium’s open software development environment.
Using output from five coupled and uncoupled configurations of the Los Alamos Sea Ice Model, CICE, the authors formulated quality control methods that exploit common statistical properties of sea ice thickness, which are used to efficiently test for significant changes in model results when the code is altered. Modifications to the code are assessed using criteria that account for the high level of autocorrelation in sea ice time series, along with a skill metric that searches for hemispheric changes in model answers across an array of different CICE configurations.
Quality control of community sea ice codes has, until now, been somewhat subjective. These statistical tests grade new additions and changes to CICE into four categories, ranging from bit-for-bit amendments to significant, answer-changing upgrades. In addition to providing a classification procedure for modifications to existing code, these metrics also provide objective guidance for assessing new physical representations and code functionality.
Understanding whether or not changes in CICE code may also alter the climate of the model can be nontrivial. A large team of scientists, led by DOE’s Los Alamos National Laboratory, known as “the CICE Consortium” has developed an efficient and automated acceptance testing method for controlling the quality of new contributions to CICE, thereby guarding against inadvertent bugs or numerical inaccuracies. The method exploits statistical properties of sea ice thickness evolution common across a range of sea ice models and is demonstrated in both stand-alone and coupled model settings. The CICE software and data are publicly available through an open-source repository and data portal to facilitate community involvement and improvement.
Contacts (BER PM)
Earth and Environmental System Modeling
Earth and Environmental System Modeling
Andrew F. Roberts and Elizabeth C. Hunke
Los Alamos National Laboratory
This research was based on work supported by the U.S. Department of Energy Office of Science, Biological and Environmental Research as part of the Earth and Environmental System Modeling program. The Office of Naval Research (ONR, award N0001417WX00563), National ESPC Committee Support Project, National Science Foundation, and the Canadian Operational Network of coupled Environmental Prediction Systems (CONCEPTS) programs provided additional support for the work.
Roberts, A. F., E. C. Hunke, R. Allard, D. A. Bailey, A. P. Craig, J-F. Lemieux, M. D. Turner. “Quality Control for Community Based Sea Ice Model Development.” Philos. Trans. Royal Soc. A A376:2017.0344 (2018). [DOI:10.1098/rsta.2017.0344]
SC-23.1 Climate and Environmental Sciences Division, BER
BER supports basic research and scientific user facilities to advance DOE missions in energy and environment. More about BER
May 10, 2019
Quantifying Decision Uncertainty in Water Management via a Coupled Agent-Based Model
Considering risk perception can improve the representation of human decision-making processes in age [more...]
May 09, 2019
Projecting Global Urban Area Growth Through 2100 Based on Historical Time Series Data and Future Scenarios
Study provides country-specific urban area growth models and the first dataset on country-level urba [more...]
May 05, 2019
Calibrating Building Energy Demand Models to Refine Long-Term Energy Planning
A new, flexible calibration approach improved model accuracy in capturing year-to-year changes in bu [more...]
May 03, 2019
Calibration and Uncertainty Analysis of Demeter for Better Downscaling of Global Land Use and Land Cover Projections
Researchers improved the Demeter model’s performance by calibrating key parameters and establi [more...]
Apr 22, 2019
Representation of U.S. Warm Temperature Extremes in Global Climate Model Ensembles
Representation of warm temperature events varies considerably among global climate models, which has [more...]
List all highlights (possible long download time)