Skip to content

There is no default memory specification for steps/jobs #84

Description

@TBradley27

Is your feature related to a problem?

There is no default memory specification for jobs. This means that some job scheduling software such as SLURM will harshly penalise some of the steps in this workflow because the job does not request a specific amount of memory. This is understandable, because SLURM does not want to write a 'blank cheque' to a job with no memory specification.

This means that trivial jobs that do not require many resources can be stuck in a SLURM queue for many hours/days. Even if the job is trivially small it is better to specify a minimum memory rather than leave this attribute blank.

Describe the solution you'd like

Add something like the following to the config file:

process {
    memory = '2 GB'
}

Describe alternatives you've considered

No other alternatives have been considered

Additional context

No response

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions