U.S. Department of Energy Office of Biological and Environmental Research

BER Research Highlights

ARM Develops New Software Tools to Streamline Data Analysis
Published: July 09, 2014
Posted: August 20, 2014

The Atmospheric Radiation Measurement (ARM) Climate Research Facility operates meteorological instruments at fixed and mobile locations to provide the climate research community with data needed to improve the understanding and representation of cloud, aerosol, and radiative processes and their interactions in climate models.  Addressing these complex scientific questions requires implementation of increasingly more advanced analysis routines that examine and integrate larger and more diverse datasets. ARM recently developed the ARM Data Integrator (ADI) software framework to streamline development of scientific algorithms to analyze ARM data. ADI automates the process of retrieving and formatting data for analysis; provides a modular, flexible framework that simplifies software development; and supports integration of multiple diverse datasets. ADI includes a library of software modules to support scientific analysis workflow and a source code generator that produces software templates in languages commonly used by the climate research community to jump start development. While developed for processing ARM data, ADI can be applied to any time-series data in network common data format (netCDF).  ADI is now being used by the ARM infrastructure for all development of new value-added products and is freely available to the broader research community. This paper presents the ADI framework and illustrates how ADI's capabilities can decrease the time and cost of implementing scientific algorithms, allowing scientists to focus their efforts on their research rather than preparing and packaging data.

Reference: Gaustad, K., T. Shippert, B. Ermold, S. Beus, J. Daily, A. Borsholm, and K. Fox. 2014. “A Scientific Data Processing Framework for Time Series NetCDF Data,” Environmental Modelling and Software 60, 241–49. (Reference link)

Contact: Sally McFarlane, SC-23.1, (301) 903-0943
Topic Areas:

  • Facility: DOE ARM User Facility

Division: SC-23.1 Climate and Environmental Sciences Division, BER


BER supports basic research and scientific user facilities to advance DOE missions in energy and environment. More about BER

Recent Highlights

May 10, 2019
Quantifying Decision Uncertainty in Water Management via a Coupled Agent-Based Model
Considering risk perception can improve the representation of human decision-making processes in age [more...]

May 09, 2019
Projecting Global Urban Area Growth Through 2100 Based on Historical Time Series Data and Future Scenarios
Study provides country-specific urban area growth models and the first dataset on country-level urba [more...]

May 05, 2019
Calibrating Building Energy Demand Models to Refine Long-Term Energy Planning
A new, flexible calibration approach improved model accuracy in capturing year-to-year changes in bu [more...]

May 03, 2019
Calibration and Uncertainty Analysis of Demeter for Better Downscaling of Global Land Use and Land Cover Projections
Researchers improved the Demeter model’s performance by calibrating key parameters and establi [more...]

Apr 22, 2019
Representation of U.S. Warm Temperature Extremes in Global Climate Model Ensembles
Representation of warm temperature events varies considerably among global climate models, which has [more...]

List all highlights (possible long download time)