Capabilities Overview

The capabilities currently contributing to CMEC are briefly highlighted below. For a full list of all the metrics available in each package, see the Model Evaluation Packages table.


CMEC driver

CMEC driver is a command-line program that manages execution of CMEC-compliant evaluation modules. It has been designed to provide a user with a simple and consistent interface regardless of the evaluation module (or set of modules) employed, and is responsible for organization of the output data produced by these evaluations.


Quick links: Repository, Installation

The PCMDI Metrics Package (PMP)

PMP provides a diverse suite of relatively robust high level summary statistics across space and time scales, gauging the differences between models and observations. PMP summaries encapsulate the simulated atmosphere, ocean, ice and land - with current examples highlighting atmospheric characteristics. PMP is useful for producing quick, high-level summaries of new simulations and putting them into the context of all previous generations of AMIP and CMIP.


Metrics include: El Niño-Southern Oscillation (ENSO), Mean Climate, Madden-Julian Oscillation (MJO) metrics, Extra-tropical modes of variability, Monsoon metrics (Sperber and Wang), Precipitation variability, Sub-daily precipitation
Quick links: Repository, Installation, and Results

The International Land Model Benchmarking (ILAMB) Package

ILAMB provides a variety of in-depth diagnostics of more than 24 terrestrial biogeochemical and hydrological model variables on annual and inter-annual time scales. It compares these variables with over 60 site-based, regional, and global observational data sets, and scores model performance based on a combination bias, RMSE, and seasonal cycle metrics. Relationships between many biogeochemical variables and physical driver variables are calculated from model results and compared with observational estimates. ILAMB is useful for detailed exploration of land biogeochemical and hydrological model responses and provides an interactive interface designed to enable the user to more rapidly understand the underlying drivers of those responses.


Metrics include: Ecosystem and Carbon Cycle, Hydrology Cycle, Radiation and Energy Cycle, Forcings, Relationships
Quick linksRepository, Installation, and Tutorials

The International Ocean Model Benchmarking (IOMB) Package

IOMB provides a variety of in-depth diagnostics of marine biogeochmical model variables on annual and inter-annual time scales. It compares a growing number of variables with site-based, transect, regional, and global observational data sets, and scores model performance based on a combination of bias, RMSE, and seasonal cycle metrics. IOMB is useful for detailed exploration of ocean biogeochemical model responses and provides an interactive interface designed to enable the user to more rapidly understand the underlying drivers of those responses.

IOMB uses the same code base as ILAMB (described above). The links below refer to ILAMB instead of IOMB.


Metrics include: Chemical Oceanography, Physical Oceanography, SeaAirFluxes
Quick linksRepository, Installation, and Tutorials

Community contributed packages

Analysing Scales of Precipitation (ASoP)
The ASoP package offers two workflows: one that characterizes the spectrum of precipitation intensity (ASoP Spectral), and another that measures spatial and temporal coherence of precipitation (ASoP Coherence). It can operate on a variety of temporal and spatial scales for both climate models and observations. Link to reference.

Cyclone Metrics Package (CyMeP)
CyMeP offers a suite of metrics for analyzing tropical cyclone trajectories on global or regional scales. This package includes a "scorecard" presentation for easy metrics comparisons along with maps of spatial quantities like storm genesis and track bias. Link to reference.

Drought Metrics
The Drought Metrics package includes a complete suite of metrics for characterizing regional drought. It also narrows down a subset of the most important metrics that characterize drought in that area. Link to reference.

The Toolkit for Extremes Climate Analysis (TECA)
TECA specializes in extreme event detection for phenomena such as tropical cyclones, extra-tropical cyclones, and atmospheric rivers. Link to reference.