-
Oriol Tintó authoredOriol Tintó authored
AutoIcon
Available examples:
- real-from-ideal: Start with a test simulation (ltestcase=.TRUE.) to produce a first-guess file and an analysis file to start a second simulation.
- real-from-dwd-ana: Start with a first-guess and analysis from DWD (relying on the local archive to do that.)
NOTE: The current implementation of real-from-dwd-ana relies on the local archives at LMU. The templates to provide the initial conditions have to be modified to run from a different local system.
With autosubmit installed, we can run these ICON workflows with autosubmit we need to do the following:
1. Create an experiment:
```bash
autosubmit expid -min -repo https://gitlab.physik.uni-muenchen.de/w2w/autoicon.git -d "Launching an ICON experiment with autosubmit."
```
This will create a new experiment folder and will give us the corresponding experiment id.
2. Modify the minimal.yml configuration file
If we go to the **conf** folder corresponding to our experiment, we will find a **minimal.yml** file there:
CONFIG:
AUTOSUBMIT_VERSION: "4.0.76"
TOTALJOBS: 20
MAXWAITINGJOBS: 20
DEFAULT:
EXPID: "a00p"
HPCARCH: "local"
#hint: use %PROJDIR% to point to the project folder (where the project is cloned)
CUSTOM_CONFIG: "%PROJDIR%/"
PROJECT:
PROJECT_TYPE: "git"
PROJECT_DESTINATION: "git_project"
GIT:
PROJECT_ORIGIN: "https://gitlab.physik.uni-muenchen.de/w2w/autoicon.git"
PROJECT_BRANCH: ""
PROJECT_COMMIT: ""
PROJECT_SUBMODULES: ""
FETCH_SINGLE_BRANCH: True
We will modify this file as follows:
- Point to the proper branch ("master" should be stable)
- We will add a new variable to select which example we do want to run:
ICON_CASE: "real-from-ideal"
- We will modify CUSTOM_CONFIG to point to the desired configurations.
- We will modify HPCARCH to point to our desired platform.
# Select case between real-from-ideal, real-from-dwd-ana
ICON_CASE: "real-from-ideal"
CONFIG:
AUTOSUBMIT_VERSION: "4.0.76"
TOTALJOBS: 20
MAXWAITINGJOBS: 20
DEFAULT:
EXPID: "a00p" # Will depend on the actual experiment id.
HPCARCH: "LRZ"
#hint: use %PROJDIR% to point to the project folder (where the project is cloned)
CUSTOM_CONFIG:
PRE:
- "%PROJDIR%/conf/common"
- "%PROJDIR%/conf/%ICON_CASE%"
PROJECT:
PROJECT_TYPE: "git"
PROJECT_DESTINATION: "git_project"
GIT:
PROJECT_ORIGIN: "https://gitlab.physik.uni-muenchen.de/w2w/autoicon.git"
PROJECT_BRANCH: "master"
PROJECT_COMMIT: ""
PROJECT_SUBMODULES: ""
FETCH_SINGLE_BRANCH: True
3. Additional configuration
We will create an additional yaml file with some more configuration.
NOTE: It is important to add these things in a different file because minimal.yml is the first file to be read, and all the other configuration files overwrite its contents. If we try to replace a variable that also appears in the default configuration files (i.e. local_destination_folder) it won't have an effect.
The name of the file doesn't matter as long as it is a .yml file, for example my_configuration.yaml.
To this file we will add the following:
- We will add a path in the local machine at which the output data will be transferred.
data_management:
# Where do we put the output files afterwards?
local_destination_folder: /Path/to/output/folder