Climates Using Interactive Suites of Intercomparisons Nested for Exoplanet Studies (CUISINES)

Scope

In the upcoming era of the James Webb Space Telescope, it becomes timely to focus community effort on benchmarking, comparing, and validating the performance of exoplanet models, both with respect to other models and to observations (when available).

This is the objective of the Climates Using Interactive Suites of Intercomparisons Nested for Exoplanet Studies (CUISINES) NExSS Science Working Group. The first intercomparison that happened within CUISINES is the TRAPPIST-1 Habitable Atmosphere Intercomparison (THAI) which can be found in this focus issue: https://iopscience.iop.org/journal/2632-3338/page/The_TRAPPIST_Habitable_Atmosphere_Intercomparison_THAI

With CUISINES we are expanding THAI beyond only general circulation models (GCMs) and rocky planets, to perform model intercomparison project (MIP) on any exoplanet model, from 3D GCMs with or without interactive chemistry, Energy Balance Models (EBMs), 1D climate models, analytical models, and radiative transfer models from rocky to gas giant planets.

This project identifies and—where appropriate—smooths out differences between model predictions within the same model category (i.e., GCM vs. GCM) or between categories (e.g. GCM vs. 1D climate models). It also aims to evaluate the model performances with comparisons to data (when available), as well as their computational efficiency. CUISINES data, multimodel outputs and scripts will all be made publicly available in a standardized format to guarantee easy reproducibility of the results. This collection of publications represents the protocol papers for each of the MIP, as well as the result papers.

Open access
The Sparse Atmospheric Model Sampling Analysis (SAMOSA) Intercomparison: Motivations and Protocol Version 1.0: A CUISINES Model Intercomparison Project

Jacob Haqq-Misra et al 2022 Planet. Sci. J. 3 260

Planets in synchronous rotation around low-mass stars are the most salient targets for current ground- and space-based missions to observe and characterize. Such model calculations can help to prioritize targets for observation with current and future missions; however, intrinsic differences in the complexity and physical parameterizations of various models can lead to different predictions of a planet's climate state. Understanding model differences is necessary if such models are to guide target selection and aid in the analysis of observations. This paper presents a protocol to intercompare models of a hypothetical planet with a 15-day synchronous rotation period around a 3000 K blackbody star across a parameter space of surface pressure and incident instellation. We conduct a sparse sample of 16 cases from a previously published exploration of this parameter space with the ExoPlaSim model. By selecting particular cases across this broad parameter space, the SAMOSA intercomparison will identify areas where simpler models are sufficient, as well as areas where more complex GCMs are required. Our preliminary comparison using ExoCAM shows general consistency between the climate state predicted by ExoCAM and ExoPlaSim except in regions of the parameter space most likely to be in a steam atmosphere or incipient runaway greenhouse state. We use this preliminary analysis to define several options for participation in the intercomparison by models of all levels of complexity. The participation of other GCMs is crucial to understand how the atmospheric states across this parameter space differ with model capabilities.

Open access
CAMEMBERT: A Mini-Neptunes General Circulation Model Intercomparison, Protocol Version 1.0.A CUISINES Model Intercomparison Project

Duncan A. Christie et al 2022 Planet. Sci. J. 3 261

With an increased focus on the observing and modeling of mini-Neptunes, there comes a need to better understand the tools we use to model their atmospheres. In this Paper, we present the protocol for the Comparing Atmospheric Models of Extrasolar Mini-Neptunes Building and Envisioning Retrievals and Transits, CAMEMBERT, project, an intercomparison of general circulation models (GCMs) used by the exoplanetary science community to simulate the atmospheres of mini-Neptunes. We focus on two targets well studied both observationally and theoretically with planned JWST cycle 1 observations: the warm GJ 1214b and the cooler K2-18b. For each target, we consider a temperature-forced case, a clear sky dual-gray radiative transfer case, and a clear sky multiband radiative transfer case, covering a range of complexities and configurations where we know differences exist between GCMs in the literature. This Paper presents all the details necessary to participate in the intercomparison, with the intention of presenting the results in future papers. Currently, there are eight GCMs participating (ExoCAM, Exo-FMS, FMS PCM, Generic PCM, MITgcm, RM-GCM, THOR, and the Unified Model), and membership in the project remains open. Those interested in participating are invited to contact the authors.

Open access
Functionality of Ice Line Latitudinal EBM Tenacity (FILLET). Protocol Version 1.0. A CUISINES Intercomparison Project

Russell Deitrick et al 2023 Planet. Sci. J. 4 39

Energy balance models (EBMs) are 1D or 2D climate models that can provide insights into planetary atmospheres, particularly with regard to habitability. Because EBMs are far less computationally intensive than 3D general circulation models (GCMs), they can be run over large uncertain parameter spaces and can be used to explore long-period phenomena, like carbon and Milankovitch cycles. Because horizontal dimensions are incorporated in EBMs, they can explore processes that are beyond the reach of 1D radiative-convective models (RCMs). EBMs are, however, dependent on parameterizations and tunings to account for physical processes that are neglected. Thus, EBMs rely on observations and results from GCMs and RCMs. Different EBMs have included a wide range of parameterizations (for albedo, radiation, and heat diffusion) and additional physics, such as carbon cycling and ice sheets. This CUISINES exoplanet model intercomparison project (exoMIP) will compare various EBMs across a set of numerical experiments. The set of experiments will include Earth-like planets at different obliquities, parameter sweeps across obliquity, and variations in instellation and CO2 abundance, to produce hysteresis diagrams. We expect a range of different results due to the choices made in the various codes, highlighting which results are robust across models and which are dependent on parameterizations or other modeling choices. Additionally, the project will allow developers to identify model defects and determine which parameterizations are most useful or relevant to the problem of interest. Ultimately, this exoMIP will allow us to improve the consistency between EBMs and accelerate the process of discovering habitable exoplanets.

Open access
Modeling Atmospheric Lines by the Exoplanet Community (MALBEC) Version 1.0: A CUISINES Radiative Transfer Intercomparison Project

Geronimo L. Villanueva et al 2024 Planet. Sci. J. 5 64

Radiative transfer (RT) models are critical in the interpretation of exoplanetary spectra, in simulating exoplanet climates, and when designing the specifications of future flagship observatories. However, most models differ in methodologies and input data, which can lead to significantly different spectra. In this paper, we present the experimental protocol of the Modeling Atmospheric Lines By the Exoplanet Community (MALBEC) project. MALBEC is an exoplanet model intercomparison project that belongs to the Climates Using Interactive Suites of Intercomparisons Nested for Exoplanet Studies framework, which aims to provide the exoplanet community with a large and diverse set of comparison and validation of models. The proposed protocol tests include a large set of initial participating RT models, a broad range of atmospheres (from hot Jupiters to temperate terrestrials), and several observation geometries, which would allow us to quantify and compare the differences between different RT models used by the exoplanetary community. Two types of tests are proposed: transit spectroscopy and direct imaging modeling, with results from the proposed tests to be published in dedicated follow-up papers. To encourage the community to join this comparison effort and as an example, we present simulation results for one specific transit case (GJ-1214 b), in which we find notable differences in how the various codes handle the discretization of the atmospheres (e.g., sub-layering), the treatment of molecular opacities (e.g., correlated-k, line-by-line) and the default spectroscopic repositories generally used by each model (e.g., HITRAN, HITEMP, ExoMol).