Objective Evaluation of Earth System Models: PCMDI Metrics Package (PMP) version 3

• DOI: 10.5194/egusphere-2023-2720
• Publication Date: 2023-11-24T09:16:14Z
• Authors: Jiwoo Lee; Peter J. Gleckler; Min-Seop Ahn; Ana Ordonez; Paul A. Ullrich; Kenneth R. Sperber; Karl E. Taylor; Yann Y. Planton; Eric Guilyardi; Paul Durack; Celine Bonfils; Mark D. Zelinka; Li-Wei Chao; Bo Dong; Charles Doutriaux; Chengzhu Zhang; Tom Vo; Jason Boutte; Michael F. Wehner; Angeline G. Pende...; Daehyun Kim; Zeyu Xue; Andrew T. Wittenberg; John Krasting
• Keywords: Earth system science; Benchmarking; Python

Abstract. Systematic, routine, and comprehensive evaluation of Earth System Models (ESMs) facilitates benchmarking improvement across model generations identifying the strengths weaknesses different configurations. By gauging consistency between models observations, this endeavor is becoming increasingly necessary to objectively synthesize thousands simulations contributed Coupled Model Intercomparison Project (CMIP) date. The PCMDI Metrics Package (PMP) an open-source Python software package that provides "quick-look" objective comparisons ESMs with one another observations. include metrics large- global-scale climatologies, tropical inter-annual intra-seasonal variability modes such as El Niño-Southern Oscillation (ENSO) Madden-Julian (MJO), extratropical variability, regional monsoons, cloud radiative feedbacks, high-frequency characteristics simulated precipitation, including extremes. PMP results are produced in context all CMIP6 earlier CMIP phases. An important priority document statistics for Historical AMIP submitted recent phases CMIP, providing version-controlled information data sets packages being used. Among other purposes, also enables modeling groups assess performance changes during ESM development cycle error distribution multi-model ensemble. In paper, we present overview its history date, capabilities, updates, future direction.