diff --git a/development-docs/schemas/config_schema.html b/development-docs/schemas/config_schema.html index 563f3d5..26dc4a6 100644 --- a/development-docs/schemas/config_schema.html +++ b/development-docs/schemas/config_schema.html @@ -15,9 +15,9 @@ WfExS-backend config -

WfExS-backend config

+ - Type: object
+

WfExS-backend config

Type: object

WfExS-backend configuration file (EOSC-Life Demonstrator 7 JSON Schemas)

No Additional Properties @@ -47,7 +47,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - cacheDirType: string
+ cacheDir

Caching directory

Type: string

Directory where all the cache-able content will be hold.
This directory can be removed, as its contents should be available outside.
When it is not set, a temporary directory is created for the session, being destroyed when the program finishes.

@@ -83,8 +83,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - crypt4ghType: object
-

WfExS-backend needs an encryption key for several tasks, like encrypting and decrypting random keys of encrypted working directories. When this block does not exist, WfExS-backend.py creates the installation's keys, and updates the configuration file

+ crypt4gh

Installation Crypt4GH key setup

Type: object
+

WfExS-backend needs an encryption key for several tasks, like encrypting and decrypting random keys of encrypted working directories. When this block does not exist, WfExS-backend.py creates the installation's keys, and updates the configuration file

No Additional Properties @@ -120,7 +120,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - keyType: string
+ key

Secret key installation file

Type: string

The path to the Crypt4GH secret key file used by this installation. If the path is relative, the directory where the configuration file resides is used for the resolution

@@ -161,7 +161,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - passphraseType: string
+ passphrase

Passphrase used to work with the secret key

Type: string

Passphrase which has to be used to work with the secret key

@@ -202,7 +202,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - pubType: string
+ pub

Public key installation file

Type: string

The path to the Crypt4GH public key file used by this installation. If the path is relative, the directory where the configuration file resides is used for the resolution

@@ -240,7 +240,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - toolsType: object
+ tools

External tools configuration block

Type: object

External tools configuration block

No Additional Properties @@ -277,8 +277,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - containerTypeType: enum (of string) Default: "singularity"
-

Type of container technology to be used when any workflow is launched using this installation. Supported types are:
+ containerType

Default container technology type in this installation

Type: enum (of string) Default: "singularity"
+

Type of container technology to be used by default when any workflow is launched using this installation. Supported types are:
- Singularity (default).
- Docker.
- Podman
@@ -326,7 +326,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - engineModeType: enum (of string) Default: "local"
+ engineMode

Workflow engine invocation mode

Type: enum (of string) Default: "local"

Most of workflow engines are usually available both as installable executables and as containers, but when they are used inside a container usually do not support running containerised jobs, unless a very careful setup is done. Currently, WfExS-backend only partially supports Nextflow in its docker-in-docker mode.

Must be one of:

@@ -370,7 +370,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - encrypted_fs

Type: object
+ encrypted_fs

Working directory FUSE encrypted FS configuration block

Type: object
No Additional Properties @@ -413,7 +413,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - typeType: enum (of string) Default: "encfs"
+ type

Type of encrypted FS

Type: enum (of string) Default: "gocryptfs"

When an encrypted working directory is needed, the type of encrypted FS to be used is set up through this key. Currently, both encfs (default) and gocryptfs (recommended) are supported

Must be one of:

@@ -464,7 +464,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - command

Type: string
+ command

Path to encryption mount program

Type: string

When this key is set, it overrides the default command to be used when an encrypted directory has to be created or mounted

@@ -512,8 +512,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - fusermount_commandType: string Default: "fusermount"
-

Path to unmounting command to be used, being 'fusermount' by default

+ fusermount_command

Path to unmount command

Type: string Default: "fusermount"
+

Path to unmounting command to be used, being 'fusermount' by default

@@ -560,7 +560,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - idleType: integer Default: 5
+ idle

Idle minutes before autoumount

Type: integer Default: 5

Number of minutes before an idle, mounted encrypted directory will automatically unmount

@@ -577,6 +577,192 @@

+
+
+
+

+ +

+
+ +
+
+ +

Custom command paths

Type: array of object
+

Different modules depend on locatable programs, like git, docker, java or similar. These declarations are used to provide WfExS either custom paths or custom names. These declarations take precedence over gitCommand, javaCommand and similar ones

+
+ + + + + +

Must contain a minimum of 1 items

All items must be unique

No Additional Items

Each item of this array must be:

+
+
+ + + Type: object
+ + + + + + + +
+
+
+

+ +

+
+ +
+
+ +

The command key

Type: string
+

Internal symbolic name used to represent this command

+
+ + + + + + +
+
+
+
+
+
+
+

+ +

+
+ +
+
+ +

The command path

Type: string
+

Either the absolute path or PATH findable program name

+
+ + + +

Must be at least 1 characters long

+ + +
+
+
+
+
+
+
+
+
+
@@ -605,7 +791,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - gitCommand

Type: string Default: "git"
+ gitCommand

Git client path

Type: string Default: "git"

Git is used to materialize workflows being hosted at git repositories, like GitHub. This key sets up custom paths to git command

@@ -646,7 +832,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - javaCommand

Type: string Default: "java"
+ javaCommand

Java path

Type: string Default: "java"

Java is needed to run Nextflow and future workflow engines. This key sets up custom paths to java installations

@@ -687,8 +873,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - singularityCommandType: string Default: "singularity"
-

Singularity is used when containerType is 'singularity'. This key sets up custom paths to singularity command

+ singularityCommand

Singularity client path

Type: string Default: "singularity"
+

Singularity is used when containerType is 'singularity'. This key sets up custom paths to singularity command

@@ -728,8 +914,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - dockerCommandType: string Default: "docker"
-

Docker is used when containerType is 'docker'. This key sets up custom paths to docker command

+ dockerCommand

Docker client path

Type: string Default: "docker"
+

Docker is used when containerType is 'docker'. This key sets up custom paths to docker command

@@ -769,8 +955,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - podmanCommandType: string Default: "podman"
-

Podman is used when containerType is 'podman'. This key sets up custom paths to podman command

+ podmanCommand

Podman client path

Type: string Default: "podman"
+

Podman is used when containerType is 'podman'. This key sets up custom paths to podman command

@@ -810,8 +996,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - dotCommandType: string Default: "dot"
-

'dot' is used when the workflow engine generated diagram is in DOT format, to translate it to either PNG or SVG when the diagram is going to be embedded in an RO-Crate

+ dotCommand

'dot' client path

Type: string Default: "dot"
+

'dot' is used when the workflow engine generated diagram is in DOT format, to translate it to either PNG or SVG when the diagram is going to be embedded in an RO-Crate

@@ -851,8 +1037,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - staticBashCommandType: string Default: "bash.static"
-

There is a bug in some bash versions which make them unsuitable to run the trace machinery from Nextflow, as the trace machinery enters in a live lock. As the images containing these faulty bash versions cannot be changed, a 'monkey patch' solution where an external, static bash version is injected on workflow execution is used. The injected static bash is found through this key, which is searched on PATH variable when it is not a full path.

+ staticBashCommand

Static bash command (used in singularity based Nextflow engine executions)

Type: string Default: "bash.static"
+

There is a bug in some bash versions which make them unsuitable to run the trace machinery from Nextflow, as the trace machinery enters in a live lock. As the images containing these faulty bash versions cannot be changed, a 'monkey patch' solution where an external, static bash version is injected on workflow execution is used. The injected static bash is found through this key, which is searched on PATH variable when it is not a full path.

@@ -892,8 +1078,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - staticPsCommandType: string Default: "ps.static"
-

Nextflow uses a bash wrapper to gather process execution statistics. One of the binaries used by the wrapper is ps. Some containers (for instance, r-base:latest) do not contain such binary. As the images which do not contain ps cannot be changed, a 'monkey patch' solution where an external, static ps version is injected on workflow execution is used. The injected static ps is found through this key, which is searched on PATH variable when it is not a full path.

+ staticPsCommand

Static ps command (used in Nextflow engine executions to assure metrics gathering works even in containers without /bin/ps command)

Type: string Default: "ps.static"
+

Nextflow uses a bash wrapper to gather process execution statistics. One of the binaries used by the wrapper is ps. Some containers (for instance, r-base:latest) do not contain such binary. As the images which do not contain ps cannot be changed, a 'monkey patch' solution where an external, static ps version is injected on workflow execution is used. The injected static ps is found through this key, which is searched on PATH variable when it is not a full path.

@@ -976,8 +1162,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - dockerImageType: string Default: "nextflow/nextflow"
-

(unfinished) When engineMode is docker, the name of the image to be fetched and used. The used tag will depend on the workflow's metadata, being by default the version

+ dockerImage

Image for docker-in-docker mode

Type: string Default: "nextflow/nextflow"
+

(unfinished) When engineMode is docker, the name of the image to be fetched and used. The used tag will depend on the workflow's metadata, being by default the version

@@ -1024,8 +1210,8 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - versionType: string Default: "19.04.1"
-

Version of Nextflow engine to be used when workflow's metadata does not provide hints about minimal version needed.

+ version

Nextflow's version

Type: string Default: "19.04.1"
+

Version of Nextflow engine to be used when workflow's metadata does not provide hints about minimal version needed.

@@ -1072,7 +1258,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - maxRetriesType: integer Default: 5
+ maxRetries

Retries in docker mode

Type: integer Default: 5

Retries when engineMode is docker.
Retries system was introduced when using docker-in-docker pattern because an insidious
bug happens sometimes. See https://forums.docker.com/t/any-known-problems-with-symlinks-on-bind-mounts/32138

@@ -1122,7 +1308,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - maxProcesses
+ maxProcesses

Max number of CPUs


Number of CPUs to be used by Nextflow. When this key has an explicit value of null, it depends on Nextflow criteria, which tries creating as many processes as available CPUs, spawning jobs in parallel. Not declaring it, or declaring and explicit value, imposes a limitation in the number of concurrent processes

@@ -1317,7 +1503,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - version

Type: string Default: "3.1.20210628163208"
+ version

cwltool's version

Type: string Default: "3.1.20210628163208"

Version of cwltool engine to be used. WfExS is not currently guessing the minimal needed version, so it is either the value set up in this key or the default one

@@ -1367,7 +1553,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - Path to a commandType: string
+ Path to a command

Path to a command

Type: string

This is a wildcard declaration to allow setting up custom paths to commands needed by several parts of the code

@@ -1405,7 +1591,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - workDirType: string
+ workDir

Working directory

Type: string

Directory where all the working directories are going to be created.
When it is not set, a temporary directory is created, which will be removed when the program finishes (which avoids inspecting the working directory after the program has finished).

@@ -1440,7 +1626,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - fetchers-setupType: object
+ fetchers-setup

Fetchers parameters setup

Type: object

Some fetchers could need customizations at the configuration level, like limiting throughput or setting up some proxy

@@ -1482,7 +1668,7 @@

d="M4 8a.5.5 0 0 1 .5-.5h5.793L8.146 5.354a.5.5 0 1 1 .708-.708l3 3a.5.5 0 0 1 0 .708l-3 3a.5.5 0 0 1-.708-.708L10.293 8.5H4.5A.5.5 0 0 1 4 8z" /> - Scheme fetcher setupType: object
+ Scheme fetcher setup

Scheme fetcher setup

Type: object

Some scheme fetchers could need customizations which depend on local WfExS installation environment. This is the place where to pass that

@@ -1501,6 +1687,6 @@

\ No newline at end of file diff --git a/development-docs/schemas/config_schema.md b/development-docs/schemas/config_schema.md index 21fc09f..7aebfce 100644 --- a/development-docs/schemas/config_schema.md +++ b/development-docs/schemas/config_schema.md @@ -13,24 +13,28 @@ - [3.3.2. Property `WfExS-backend config > tools > encrypted_fs > command`](#tools_encrypted_fs_command) - [3.3.3. Property `WfExS-backend config > tools > encrypted_fs > fusermount_command`](#tools_encrypted_fs_fusermount_command) - [3.3.4. Property `WfExS-backend config > tools > encrypted_fs > idle`](#tools_encrypted_fs_idle) - - [3.4. Property `WfExS-backend config > tools > gitCommand`](#tools_gitCommand) - - [3.5. Property `WfExS-backend config > tools > javaCommand`](#tools_javaCommand) - - [3.6. Property `WfExS-backend config > tools > singularityCommand`](#tools_singularityCommand) - - [3.7. Property `WfExS-backend config > tools > dockerCommand`](#tools_dockerCommand) - - [3.8. Property `WfExS-backend config > tools > podmanCommand`](#tools_podmanCommand) - - [3.9. Property `WfExS-backend config > tools > dotCommand`](#tools_dotCommand) - - [3.10. Property `WfExS-backend config > tools > staticBashCommand`](#tools_staticBashCommand) - - [3.11. Property `WfExS-backend config > tools > staticPsCommand`](#tools_staticPsCommand) - - [3.12. Property `WfExS-backend config > tools > nextflow`](#tools_nextflow) - - [3.12.1. Property `WfExS-backend config > tools > nextflow > dockerImage`](#tools_nextflow_dockerImage) - - [3.12.2. Property `WfExS-backend config > tools > nextflow > version`](#tools_nextflow_version) - - [3.12.3. Property `WfExS-backend config > tools > nextflow > maxRetries`](#tools_nextflow_maxRetries) - - [3.12.4. Property `WfExS-backend config > tools > nextflow > maxProcesses`](#tools_nextflow_maxProcesses) - - [3.12.4.1. Property `WfExS-backend config > tools > nextflow > maxProcesses > oneOf > item 0`](#tools_nextflow_maxProcesses_oneOf_i0) - - [3.12.4.2. Property `WfExS-backend config > tools > nextflow > maxProcesses > oneOf > item 1`](#tools_nextflow_maxProcesses_oneOf_i1) - - [3.13. Property `WfExS-backend config > tools > cwl`](#tools_cwl) - - [3.13.1. Property `WfExS-backend config > tools > cwl > version`](#tools_cwl_version) - - [3.14. Pattern Property `WfExS-backend config > tools > Path to a command`](#tools_pattern1) + - [3.4. Property `WfExS-backend config > tools > commands`](#tools_commands) + - [3.4.1. WfExS-backend config > tools > commands > commands items](#autogenerated_heading_2) + - [3.4.1.1. Property `WfExS-backend config > tools > commands > commands items > key`](#tools_commands_items_key) + - [3.4.1.2. Property `WfExS-backend config > tools > commands > commands items > path`](#tools_commands_items_path) + - [3.5. Property `WfExS-backend config > tools > gitCommand`](#tools_gitCommand) + - [3.6. Property `WfExS-backend config > tools > javaCommand`](#tools_javaCommand) + - [3.7. Property `WfExS-backend config > tools > singularityCommand`](#tools_singularityCommand) + - [3.8. Property `WfExS-backend config > tools > dockerCommand`](#tools_dockerCommand) + - [3.9. Property `WfExS-backend config > tools > podmanCommand`](#tools_podmanCommand) + - [3.10. Property `WfExS-backend config > tools > dotCommand`](#tools_dotCommand) + - [3.11. Property `WfExS-backend config > tools > staticBashCommand`](#tools_staticBashCommand) + - [3.12. Property `WfExS-backend config > tools > staticPsCommand`](#tools_staticPsCommand) + - [3.13. Property `WfExS-backend config > tools > nextflow`](#tools_nextflow) + - [3.13.1. Property `WfExS-backend config > tools > nextflow > dockerImage`](#tools_nextflow_dockerImage) + - [3.13.2. Property `WfExS-backend config > tools > nextflow > version`](#tools_nextflow_version) + - [3.13.3. Property `WfExS-backend config > tools > nextflow > maxRetries`](#tools_nextflow_maxRetries) + - [3.13.4. Property `WfExS-backend config > tools > nextflow > maxProcesses`](#tools_nextflow_maxProcesses) + - [3.13.4.1. Property `WfExS-backend config > tools > nextflow > maxProcesses > oneOf > item 0`](#tools_nextflow_maxProcesses_oneOf_i0) + - [3.13.4.2. Property `WfExS-backend config > tools > nextflow > maxProcesses > oneOf > item 1`](#tools_nextflow_maxProcesses_oneOf_i1) + - [3.14. Property `WfExS-backend config > tools > cwl`](#tools_cwl) + - [3.14.1. Property `WfExS-backend config > tools > cwl > version`](#tools_cwl_version) + - [3.15. Pattern Property `WfExS-backend config > tools > Path to a command`](#tools_pattern1) - [4. Property `WfExS-backend config > workDir`](#workDir) - [5. Property `WfExS-backend config > fetchers-setup`](#fetchers-setup) - [5.1. Pattern Property `WfExS-backend config > fetchers-setup > Scheme fetcher setup`](#fetchers-setup_pattern1) @@ -147,9 +151,10 @@ When it is not set, a temporary directory is created for the session, being dest | Property | Pattern | Type | Deprecated | Definition | Title/Description | | -------------------------------------------------- | ------- | ---------------- | ---------- | ---------- | ----------------------------------------------------------------------------------------------------------------------------------- | -| - [containerType](#tools_containerType ) | No | enum (of string) | No | - | Container technology type in this installation | +| - [containerType](#tools_containerType ) | No | enum (of string) | No | - | Default container technology type in this installation | | - [engineMode](#tools_engineMode ) | No | enum (of string) | No | - | Workflow engine invocation mode | | - [encrypted_fs](#tools_encrypted_fs ) | No | object | No | - | Working directory FUSE encrypted FS configuration block | +| - [commands](#tools_commands ) | No | array of object | No | - | Custom command paths | | - [gitCommand](#tools_gitCommand ) | No | string | No | - | Git client path | | - [javaCommand](#tools_javaCommand ) | No | string | No | - | Java path | | - [singularityCommand](#tools_singularityCommand ) | No | string | No | - | Singularity client path | @@ -164,7 +169,7 @@ When it is not set, a temporary directory is created for the session, being dest ### 3.1. Property `WfExS-backend config > tools > containerType` -**Title:** Container technology type in this installation +**Title:** Default container technology type in this installation | | | | ------------ | ------------------ | @@ -172,7 +177,7 @@ When it is not set, a temporary directory is created for the session, being dest | **Required** | No | | **Default** | `"singularity"` | -**Description:** Type of container technology to be used when any workflow is launched using this installation. Supported types are: +**Description:** Type of container technology to be used by default when any workflow is launched using this installation. Supported types are: - Singularity (default). - Docker. - Podman @@ -226,7 +231,7 @@ Must be one of: | ------------ | ------------------ | | **Type** | `enum (of string)` | | **Required** | No | -| **Default** | `"encfs"` | +| **Default** | `"gocryptfs"` | **Description:** When an encrypted working directory is needed, the type of encrypted FS to be used is set up through this key. Currently, both encfs (default) and gocryptfs (recommended) are supported @@ -269,7 +274,69 @@ Must be one of: **Description:** Number of minutes before an idle, mounted encrypted directory will automatically unmount -### 3.4. Property `WfExS-backend config > tools > gitCommand` +### 3.4. Property `WfExS-backend config > tools > commands` + +**Title:** Custom command paths + +| | | +| ------------ | ----------------- | +| **Type** | `array of object` | +| **Required** | No | + +**Description:** Different modules depend on locatable programs, like git, docker, java or similar. These declarations are used to provide WfExS either custom paths or custom names. These declarations take precedence over `gitCommand`, `javaCommand` and similar ones + +| | Array restrictions | +| -------------------- | ------------------ | +| **Min items** | 1 | +| **Max items** | N/A | +| **Items unicity** | True | +| **Additional items** | False | +| **Tuple validation** | See below | + +| Each item of this array must be | Description | +| --------------------------------------- | ----------- | +| [commands items](#tools_commands_items) | - | + +#### 3.4.1. WfExS-backend config > tools > commands > commands items + +| | | +| ------------------------- | ------------------------------------------------------------------------- | +| **Type** | `object` | +| **Required** | No | +| **Additional properties** | [[Any type: allowed]](# "Additional Properties of any type are allowed.") | + +| Property | Pattern | Type | Deprecated | Definition | Title/Description | +| ------------------------------------- | ------- | ------ | ---------- | ---------- | ----------------- | +| + [key](#tools_commands_items_key ) | No | string | No | - | The command key | +| + [path](#tools_commands_items_path ) | No | string | No | - | The command path | + +##### 3.4.1.1. Property `WfExS-backend config > tools > commands > commands items > key` + +**Title:** The command key + +| | | +| ------------ | -------- | +| **Type** | `string` | +| **Required** | Yes | + +**Description:** Internal symbolic name used to represent this command + +##### 3.4.1.2. Property `WfExS-backend config > tools > commands > commands items > path` + +**Title:** The command path + +| | | +| ------------ | -------- | +| **Type** | `string` | +| **Required** | Yes | + +**Description:** Either the absolute path or PATH findable program name + +| Restrictions | | +| -------------- | - | +| **Min length** | 1 | + +### 3.5. Property `WfExS-backend config > tools > gitCommand` **Title:** Git client path @@ -281,7 +348,7 @@ Must be one of: **Description:** Git is used to materialize workflows being hosted at git repositories, like GitHub. This key sets up custom paths to git command -### 3.5. Property `WfExS-backend config > tools > javaCommand` +### 3.6. Property `WfExS-backend config > tools > javaCommand` **Title:** Java path @@ -293,7 +360,7 @@ Must be one of: **Description:** Java is needed to run Nextflow and future workflow engines. This key sets up custom paths to java installations -### 3.6. Property `WfExS-backend config > tools > singularityCommand` +### 3.7. Property `WfExS-backend config > tools > singularityCommand` **Title:** Singularity client path @@ -305,7 +372,7 @@ Must be one of: **Description:** Singularity is used when containerType is 'singularity'. This key sets up custom paths to singularity command -### 3.7. Property `WfExS-backend config > tools > dockerCommand` +### 3.8. Property `WfExS-backend config > tools > dockerCommand` **Title:** Docker client path @@ -317,7 +384,7 @@ Must be one of: **Description:** Docker is used when containerType is 'docker'. This key sets up custom paths to docker command -### 3.8. Property `WfExS-backend config > tools > podmanCommand` +### 3.9. Property `WfExS-backend config > tools > podmanCommand` **Title:** Podman client path @@ -329,7 +396,7 @@ Must be one of: **Description:** Podman is used when containerType is 'podman'. This key sets up custom paths to podman command -### 3.9. Property `WfExS-backend config > tools > dotCommand` +### 3.10. Property `WfExS-backend config > tools > dotCommand` **Title:** 'dot' client path @@ -341,7 +408,7 @@ Must be one of: **Description:** 'dot' is used when the workflow engine generated diagram is in DOT format, to translate it to either PNG or SVG when the diagram is going to be embedded in an RO-Crate -### 3.10. Property `WfExS-backend config > tools > staticBashCommand` +### 3.11. Property `WfExS-backend config > tools > staticBashCommand` **Title:** Static bash command (used in singularity based Nextflow engine executions) @@ -353,7 +420,7 @@ Must be one of: **Description:** There is a bug in some bash versions which make them unsuitable to run the trace machinery from Nextflow, as the trace machinery enters in a live lock. As the images containing these faulty bash versions cannot be changed, a 'monkey patch' solution where an external, static bash version is injected on workflow execution is used. The injected static bash is found through this key, which is searched on PATH variable when it is not a full path. -### 3.11. Property `WfExS-backend config > tools > staticPsCommand` +### 3.12. Property `WfExS-backend config > tools > staticPsCommand` **Title:** Static ps command (used in Nextflow engine executions to assure metrics gathering works even in containers without /bin/ps command) @@ -365,7 +432,7 @@ Must be one of: **Description:** Nextflow uses a bash wrapper to gather process execution statistics. One of the binaries used by the wrapper is `ps`. Some containers (for instance, r-base:latest) do not contain such binary. As the images which do not contain `ps` cannot be changed, a 'monkey patch' solution where an external, static ps version is injected on workflow execution is used. The injected static ps is found through this key, which is searched on PATH variable when it is not a full path. -### 3.12. Property `WfExS-backend config > tools > nextflow` +### 3.13. Property `WfExS-backend config > tools > nextflow` | | | | ------------------------- | ------------------------------------------------------------------------- | @@ -380,7 +447,7 @@ Must be one of: | - [maxRetries](#tools_nextflow_maxRetries ) | No | integer | No | - | Retries in docker mode | | - [maxProcesses](#tools_nextflow_maxProcesses ) | No | Combination | No | - | Max number of CPUs | -#### 3.12.1. Property `WfExS-backend config > tools > nextflow > dockerImage` +#### 3.13.1. Property `WfExS-backend config > tools > nextflow > dockerImage` **Title:** Image for docker-in-docker mode @@ -392,7 +459,7 @@ Must be one of: **Description:** (unfinished) When `engineMode` is `docker`, the name of the image to be fetched and used. The used tag will depend on the workflow's metadata, being by default the `version` -#### 3.12.2. Property `WfExS-backend config > tools > nextflow > version` +#### 3.13.2. Property `WfExS-backend config > tools > nextflow > version` **Title:** Nextflow's version @@ -404,7 +471,7 @@ Must be one of: **Description:** Version of Nextflow engine to be used when workflow's metadata does not provide hints about minimal version needed. -#### 3.12.3. Property `WfExS-backend config > tools > nextflow > maxRetries` +#### 3.13.3. Property `WfExS-backend config > tools > nextflow > maxRetries` **Title:** Retries in docker mode @@ -422,7 +489,7 @@ bug happens sometimes. See https://forums.docker.com/t/any-known-problems-with-s | ------------ | ------ | | **Minimum** | ≥ 0 | -#### 3.12.4. Property `WfExS-backend config > tools > nextflow > maxProcesses` +#### 3.13.4. Property `WfExS-backend config > tools > nextflow > maxProcesses` **Title:** Max number of CPUs @@ -439,7 +506,7 @@ bug happens sometimes. See https://forums.docker.com/t/any-known-problems-with-s | [item 0](#tools_nextflow_maxProcesses_oneOf_i0) | | [item 1](#tools_nextflow_maxProcesses_oneOf_i1) | -##### 3.12.4.1. Property `WfExS-backend config > tools > nextflow > maxProcesses > oneOf > item 0` +##### 3.13.4.1. Property `WfExS-backend config > tools > nextflow > maxProcesses > oneOf > item 0` | | | | ------------ | --------- | @@ -451,14 +518,14 @@ bug happens sometimes. See https://forums.docker.com/t/any-known-problems-with-s | ------------ | ------ | | **Minimum** | ≥ 1 | -##### 3.12.4.2. Property `WfExS-backend config > tools > nextflow > maxProcesses > oneOf > item 1` +##### 3.13.4.2. Property `WfExS-backend config > tools > nextflow > maxProcesses > oneOf > item 1` | | | | ------------ | ------ | | **Type** | `null` | | **Required** | No | -### 3.13. Property `WfExS-backend config > tools > cwl` +### 3.14. Property `WfExS-backend config > tools > cwl` | | | | ------------------------- | ------------------------------------------------------------------------- | @@ -470,7 +537,7 @@ bug happens sometimes. See https://forums.docker.com/t/any-known-problems-with-s | -------------------------------- | ------- | ------ | ---------- | ---------- | ----------------- | | - [version](#tools_cwl_version ) | No | string | No | - | cwltool's version | -#### 3.13.1. Property `WfExS-backend config > tools > cwl > version` +#### 3.14.1. Property `WfExS-backend config > tools > cwl > version` **Title:** cwltool's version @@ -486,7 +553,7 @@ bug happens sometimes. See https://forums.docker.com/t/any-known-problems-with-s | -------------- | - | | **Min length** | 1 | -### 3.14. Pattern Property `WfExS-backend config > tools > Path to a command` +### 3.15. Pattern Property `WfExS-backend config > tools > Path to a command` > All properties whose name matches the regular expression ```^.+Command$``` ([Test](https://regex101.com/?regex=%5E.%2BCommand%24)) must respect the following conditions @@ -552,4 +619,4 @@ must respect the following conditions **Description:** Some scheme fetchers could need customizations which depend on local WfExS installation environment. This is the place where to pass that ---------------------------------------------------------------------------------------------------------------------------- -Generated using [json-schema-for-humans](https://github.com/coveooss/json-schema-for-humans) on 2023-09-19 at 01:51:40 +0000 +Generated using [json-schema-for-humans](https://github.com/coveooss/json-schema-for-humans) on 2024-07-28 at 02:42:58 +0000