Skip to content
Snippets Groups Projects
README.md 6.42 KiB

AutoIcon

Available examples:

  • real-from-ideal: Start with a test simulation (ltestcase=.TRUE.) to produce a first-guess file and an analysis file to start a second simulation.
  • real-from-dwd-ana: Start with a first-guess and analysis from DWD (relying on the local archive to do that.)

NOTE: The current implementation of real-from-dwd-ana relies on the local archives at LMU. The templates to provide the initial conditions have to be modified to run from a different local system.

With autosubmit installed, we can run these ICON workflows with autosubmit we need to do the following:

1. Create an experiment:

```bash
autosubmit expid -min -repo  https://gitlab.physik.uni-muenchen.de/w2w/autoicon.git -d "Launching an ICON experiment with autosubmit."
```

This will create a new experiment folder and will give us the corresponding experiment id.

2. Modify the minimal.yml configuration file

If we go to the **conf** folder corresponding to our experiment, we will find a **minimal.yml** file there:
CONFIG:
  AUTOSUBMIT_VERSION: "4.0.76"
  TOTALJOBS: 20
  MAXWAITINGJOBS: 20
DEFAULT:
  EXPID: "a00p"
  HPCARCH: "local"
  #hint: use %PROJDIR% to point to the project folder (where the project is cloned)
  CUSTOM_CONFIG: "%PROJDIR%/"
PROJECT:
  PROJECT_TYPE: "git"
  PROJECT_DESTINATION: "git_project"
GIT:
  PROJECT_ORIGIN: "https://gitlab.physik.uni-muenchen.de/w2w/autoicon.git"
  PROJECT_BRANCH: ""
  PROJECT_COMMIT: ""
  PROJECT_SUBMODULES: ""
  FETCH_SINGLE_BRANCH: True

We will modify this file as follows:

  • Point to the proper branch ("master" should be stable)
  • We will add a new variable to select which example we do want to run: ICON_CASE: "real-from-ideal"
  • We will modify CUSTOM_CONFIG to point to the desired configurations.
  • We will modify HPCARCH to point to our desired platform.
# Select case between real-from-ideal, real-from-dwd-ana
ICON_CASE: "real-from-ideal"

CONFIG:
  AUTOSUBMIT_VERSION: "4.0.76"
  TOTALJOBS: 20
  MAXWAITINGJOBS: 20
DEFAULT:
  EXPID: "a00p"   # Will depend on the actual experiment id.
  HPCARCH: "LRZ"
  #hint: use %PROJDIR% to point to the project folder (where the project is cloned)
  CUSTOM_CONFIG:
    PRE:
      - "%PROJDIR%/conf/common"
      - "%PROJDIR%/conf/%ICON_CASE%"

PROJECT:
  PROJECT_TYPE: "git"
  PROJECT_DESTINATION: "git_project"
GIT:
  PROJECT_ORIGIN: "https://gitlab.physik.uni-muenchen.de/w2w/autoicon.git"
  PROJECT_BRANCH: "master"
  PROJECT_COMMIT: ""
  PROJECT_SUBMODULES: ""
  FETCH_SINGLE_BRANCH: True

3. Additional configuration

We will create an additional yaml file with some more configuration.

NOTE: It is important to add these things in a different file because minimal.yml is the first file to be read, and all the other configuration files overwrite its contents. If we try to replace a variable that also appears in the default configuration files (i.e. local_destination_folder) it won't have an effect.

The name of the file doesn't matter as long as it is a .yml file, for example my_configuration.yaml.

To this file we will add the following:

  • We will add a path in the local machine at which the output data will be transferred.
data_management:
  # Where do we put the output files afterwards?
  local_destination_folder: /Path/to/output/folder