Building CESM 2.1.0 Tetralith

This page describes the building the CESM 2.1.0 on NSC's Tetralith system. Tetralith is NSC's largest HPC cluster. It replaced NSC's previous HPC cluster Triolith in 2018. Tetralith is funded by SNIC and uses for research by Swedish research groups. Access to Tetralith is granted by SNIC.

CESM1 unix group on triolith

If you are going to run one of the CESM models on Tetralith, you should join the 'cesm_input-data' storage project (SNIC 2020/14-98). This is not absolutely necessary but being a member allows access to shared storage space (/proj/cesm_input-data) where pre-downloaded initial data and ancillary files are stored. To join the 'cesm_input-data' project, log into SUPR (https://supr.snic.se/) and click the 'View and Manage Projects' button, the request membership to the SNIC 2020/14-98 project.

Getting the source code

CESM is a free, open source model. The source code, build and run scripts can be downloaded as described in the CESM 2.1.0 quick guide.

It is recommended that the source files be downloaded into the /home file system. This ensures that your code, and configuration files are backed up.

Starting with CESM2, releases are available through a public GitHub repository, http://github.com/ESCOMP/cesm. The latest version of the release code can be downloaded by executing, e.g.:

git clone -b release-cesm2.1.0 https://github.com/ESCOMP/cesm.git cesm2.1.0

cd cesm2.1.0

./manage_externals/checkout_externals

Copying the Tetralith configuration files

Files containing Tetralith specific machine environment variables have been created and are stored in the folder /proj/cesm_input-data/tetralith_config_cesm2.1.0. These files should be copied to the appropriate location in your local distribution. Based on the steps above:

cd <cesm-base>/cesm2.1.0/cime/config/cesm/machines/

cp /proj/cesm_input-data/tetralith_config_cesm2.1.0/* .

Creating a new case and building the model

1. Load modules:

module purge

module load buildenv-intel/2018.u1-bare netCDF-HDF5/4.6.2-nsc1-parallel-private_hdf5-intel20018a-eb

2. Create a new case, for example, to create a new 'f09_g17' resolution case using the 'BW1850' compset:

cd <cesm-base>/cesm2.1.0/cime/scripts/

./create_newcase --case ../cases/BW1850 --walltime 24:00:00 --compset BW1850 --res f09_g17 --machine tetralith --project snic2019-1-2 --output-root /proj/bolinc/users/struthers/cesm2.1.0-out

3. Configure and build your model:

cd <cesm-base>/cesm2.1.0/cime/cases/BW1850

./case.setup

./case.build

4. Edit the env_run.xml and the $CASE.run files for the particular simulation you wish to make, then submit your job:

./case.submit