Difference between revisions of "CESM & NorESM users on Triolith: changing to the new centre storage (/proj/) system"

From SNIC Documentation
Jump to: navigation, search
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
The new centre storage system at NSC became operational in October 2014 ([https://www.nsc.liu.se/storage/snic-centrestorage/ NSC Centre Storage]). Because the storage environment was changed from a 'user' based systen (/nobackup/global/${USER}) to a 'project' based system (/proj/project_name), this requires a change in the way the CESM and NorESM models are configured on Triolith.
 
The new centre storage system at NSC became operational in October 2014 ([https://www.nsc.liu.se/storage/snic-centrestorage/ NSC Centre Storage]). Because the storage environment was changed from a 'user' based systen (/nobackup/global/${USER}) to a 'project' based system (/proj/project_name), this requires a change in the way the CESM and NorESM models are configured on Triolith.
  
'''CESM (& CCSM4)'''
 
  
''Existing Cases''
 
  
1. Change the EXEROOT variable in the 'env_build.xml' file from:
+
'''CESM 1.1 and later versions'''
 +
 
 +
''1. Existing Cases''
 +
 
 +
i. Change the EXEROOT variable in the 'env_build.xml' file from:
 +
 
 +
:<code>value="/nobackup/global/$CCSMUSER/$CASE/bld"</code>
 +
 
 +
to e.g.
 +
 
 +
:<code>value="/proj/<project-name>/users/$CCSMUSER/$CASE/bld"</code>
 +
 
 +
where <code><project-name></code> is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.
 +
 
 +
ii. Change the DOUT_S_ROOT variable in the 'env_run.xml' file from:
 +
 
 +
:<code>value="/nobackup/global/$CCSMUSER/archive/$CASE"</code>
 +
 
 +
to e.g.
 +
 
 +
:<code>value="/proj/<project-name>/users/$CCSMUSER/cesm1.1.1/archive/$CASE"</code>
 +
 
 +
iii. Change the RUNDIR variable in the 'env_run.xml' file from:
 +
 
 +
:<code>value="/nobackup/global/$CCSMUSER/$CASE/run"</code>
 +
 
 +
to e.g.
 +
 
 +
:<code>value="/proj/<project-name>/users/$CCSMUSER/cesm1.1.1/$CASE/run"</code>
 +
 
 +
iii. Clean case and reconfigure:
 +
 
 +
:<code>./cesm_setup</code>
 +
 
 +
iv. Clean then rebuild the model:
 +
 
 +
:<code><mycase>.clean_build</code>
 +
:<code><mycase>.build</code>
 +
 
 +
 
 +
''2. New Cases, Existing Code''
 +
 
 +
i. Copy new config. files, e.g. for vn 1.1.1.
 +
 
 +
:<code>cd <CESM-base-dir>/scripts</code>
 +
:<code>cp /proj/cesm_input-data/triolith_config_cesm1.1.1/create_newcase .</code>
 +
 
 +
:<code>cd <CESM-base-dir>/scripts/ccsm_utils/Case.template</code>
 +
:<code>cp /proj/cesm_input-data/triolith_config_cesm1.1.1/config_definition.xml .</code>
 +
 
 +
:<code>cd <CESM-base-dir>/scripts/ccsm_utils/Machines</code>
 +
:<code>cp /proj/cesm_input-data/triolith_config_cesm1.1.1/config_machines.xml .</code>
 +
 
 +
ii. Create new case. '''Note''': when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g.
 +
 
 +
:<code><CESM-base-dir>/scripts/create_newcase -case mycase1 -res f19_g16 -compset B1850CN -mach triolith -ccsm_out /proj/bolinc/users/$USER/cesm1.1.1</code>
 +
 
 +
 
 +
''3. Completely new download''
 +
 
 +
See: [[Building CESM models on the NSC triolith system]]
 +
 
 +
 
 +
 
 +
 
 +
 
 +
'''CESM 1.0.x'''
 +
 
 +
''1. Existing Cases''
 +
 
 +
i. Change the EXEROOT variable in the 'env_build.xml' file from:
  
 
:<code>value="/nobackup/global/$CCSMUSER/$CASE"</code>
 
:<code>value="/nobackup/global/$CCSMUSER/$CASE"</code>
Line 15: Line 83:
 
where <code><project-name></code> is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.
 
where <code><project-name></code> is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.
  
2. Change the RUNDIR variable in the 'env_run.xml' file from:
+
ii. Change the DOUT_S_ROOT variable in the 'env_run.xml' file from:
 +
 
 +
:<code>value="/nobackup/global/$CCSMUSER/archive/$CASE"</code>
 +
 
 +
to e.g.
 +
 
 +
:<code>value="/proj/<project-name>/users/$CCSMUSER/cesm1.0.3/archive/$CASE"</code>
 +
 
 +
iii. Clean case and reconfigure:
 +
 
 +
:<code>./configure -cleanall</code>
 +
:<code>./configure -case</code>
 +
 
 +
iv. Clean then rebuild the model:
 +
 
 +
:<code><mycase>.clean_build</code>
 +
:<code><mycase>.build</code>
 +
 
 +
 
 +
''2. New Cases, Existing Code''
 +
 
 +
i. Copy new config. files.
 +
 
 +
:<code>cd <CESM-base-dir>/scripts</code>
 +
:<code>cp /proj/cesm_input-data/triolith_config_cesm1.0.3/create_newcase .</code>
 +
 
 +
:<code>cd <CESM-base-dir>/scripts/ccsm_utils/Case.template</code>
 +
:<code>cp /proj/cesm_input-data/triolith_config_cesm1.0.3/config_definition.xml .</code>
 +
 
 +
:<code>cd <CESM-base-dir>/scripts/ccsm_utils/Machines</code>
 +
:<code>cp /proj/cesm_input-data/triolith_config_cesm1.0.3/config_machines.xml .</code>
 +
 
 +
ii. Create new case. '''Note''': when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g.
 +
 
 +
:<code><CESM-base-dir>/scripts/create_newcase -case mycase1 -res f19_g16 -compset B1850CN -mach triolith -ccsm_out /proj/bolinc/users/$USER/cesm1.0.3</code>
 +
 
 +
 
 +
''3. Completely new download''
 +
 
 +
See: [[Building CESM models on the NSC triolith system]]
 +
 
  
  
Line 71: Line 179:
  
 
:<code><NorESM-base-dir>/scripts/create_newcase -case ../cases/triolithTest -mach triolith -res f19_g16 -compset N2000AERL -pecount S -ccsm_out /proj/bolinc/users/${USER}/NorESM</code>
 
:<code><NorESM-base-dir>/scripts/create_newcase -case ../cases/triolithTest -mach triolith -res f19_g16 -compset N2000AERL -pecount S -ccsm_out /proj/bolinc/users/${USER}/NorESM</code>
 +
 +
 +
''3. Completely new model''
 +
 +
See: [[Building NorESM (CMIP5) on the NSC triolith system]]
  
  
 
{{set category list|field|Climate research}}
 
{{set category list|field|Climate research}}

Latest revision as of 15:21, 25 November 2014

The new centre storage system at NSC became operational in October 2014 (NSC Centre Storage). Because the storage environment was changed from a 'user' based systen (/nobackup/global/${USER}) to a 'project' based system (/proj/project_name), this requires a change in the way the CESM and NorESM models are configured on Triolith.


CESM 1.1 and later versions

1. Existing Cases

i. Change the EXEROOT variable in the 'env_build.xml' file from:

value="/nobackup/global/$CCSMUSER/$CASE/bld"

to e.g.

value="/proj/<project-name>/users/$CCSMUSER/$CASE/bld"

where <project-name> is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.

ii. Change the DOUT_S_ROOT variable in the 'env_run.xml' file from:

value="/nobackup/global/$CCSMUSER/archive/$CASE"

to e.g.

value="/proj/<project-name>/users/$CCSMUSER/cesm1.1.1/archive/$CASE"

iii. Change the RUNDIR variable in the 'env_run.xml' file from:

value="/nobackup/global/$CCSMUSER/$CASE/run"

to e.g.

value="/proj/<project-name>/users/$CCSMUSER/cesm1.1.1/$CASE/run"

iii. Clean case and reconfigure:

./cesm_setup

iv. Clean then rebuild the model:

<mycase>.clean_build
<mycase>.build


2. New Cases, Existing Code

i. Copy new config. files, e.g. for vn 1.1.1.

cd <CESM-base-dir>/scripts
cp /proj/cesm_input-data/triolith_config_cesm1.1.1/create_newcase .
cd <CESM-base-dir>/scripts/ccsm_utils/Case.template
cp /proj/cesm_input-data/triolith_config_cesm1.1.1/config_definition.xml .
cd <CESM-base-dir>/scripts/ccsm_utils/Machines
cp /proj/cesm_input-data/triolith_config_cesm1.1.1/config_machines.xml .

ii. Create new case. Note: when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g.

<CESM-base-dir>/scripts/create_newcase -case mycase1 -res f19_g16 -compset B1850CN -mach triolith -ccsm_out /proj/bolinc/users/$USER/cesm1.1.1


3. Completely new download

See: Building CESM models on the NSC triolith system



CESM 1.0.x

1. Existing Cases

i. Change the EXEROOT variable in the 'env_build.xml' file from:

value="/nobackup/global/$CCSMUSER/$CASE"

to e.g.

value="/proj/<project-name>/users/$CCSMUSER/$CASE"

where <project-name> is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.

ii. Change the DOUT_S_ROOT variable in the 'env_run.xml' file from:

value="/nobackup/global/$CCSMUSER/archive/$CASE"

to e.g.

value="/proj/<project-name>/users/$CCSMUSER/cesm1.0.3/archive/$CASE"

iii. Clean case and reconfigure:

./configure -cleanall
./configure -case

iv. Clean then rebuild the model:

<mycase>.clean_build
<mycase>.build


2. New Cases, Existing Code

i. Copy new config. files.

cd <CESM-base-dir>/scripts
cp /proj/cesm_input-data/triolith_config_cesm1.0.3/create_newcase .
cd <CESM-base-dir>/scripts/ccsm_utils/Case.template
cp /proj/cesm_input-data/triolith_config_cesm1.0.3/config_definition.xml .
cd <CESM-base-dir>/scripts/ccsm_utils/Machines
cp /proj/cesm_input-data/triolith_config_cesm1.0.3/config_machines.xml .

ii. Create new case. Note: when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g.

<CESM-base-dir>/scripts/create_newcase -case mycase1 -res f19_g16 -compset B1850CN -mach triolith -ccsm_out /proj/bolinc/users/$USER/cesm1.0.3


3. Completely new download

See: Building CESM models on the NSC triolith system



NorESM (& CCSM4)

1. Existing Cases

i. Change the EXEROOT variable in the 'env_build.xml' file from:

value="/nobackup/global/$CCSMUSER/$CASE"

to e.g.

value="/proj/<project-name>/users/$CCSMUSER/NorESM/$CASE"

where <project-name> is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.

ii. Change the DOUT_S_ROOT variable in the 'env_run.xml' file from:

value="/nobackup/global/$CCSMUSER/archive/$CASE"

to e.g.

value="/proj/<project-name>/users/$CCSMUSER/NorESM/archive/$CASE"

where <project-name> is an appropriate project directory name (that you have permission to write to), e.g. 'bolinc'.

iii. Clean case and reconfigure:

./configure -cleanall
./configure -case

iv. Clean then rebuild the model:

<mycase>.clean_build
<mycase>.build


2. New Cases, Existing Code

i. Copy new config. files.

cd <NorESM-base-dir>/scripts
cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/create_newcase .
cd <NorESM-base-dir>/scripts/ccsm_utils/Case.template
cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/config_definition.xml .
cd <NorESM-base-dir>/scripts/ccsm_utils/Machines
cp /proj/cesm_input-data/NorESM/triolith_config_NorESM/config_machines.xml .

ii. Create new case. Note: when using the 'create_newcase' script, you have to add an additional variable 'ccsm_out'. This defines the folder where the model is compiled and where output is written, and must correspond to an appropriate Triolith project storage area (e.g. /proj/bolinc/users/x_abcde/NorESM). e.g.

<NorESM-base-dir>/scripts/create_newcase -case ../cases/triolithTest -mach triolith -res f19_g16 -compset N2000AERL -pecount S -ccsm_out /proj/bolinc/users/${USER}/NorESM


3. Completely new model

See: Building NorESM (CMIP5) on the NSC triolith system