dewret
DEclarative Workflow REndering Tool
Pron: durr-it, like "durable"
Introduction
Dewret allows certain workflows written in a dynamic style to be rendered to a static representation.
Advantages of doing so include:
- git-versionable workflows: while code can be versioned, the changes of a dynamic workflow do not necessarily clearly correspond to changes in the executed workflow. This maintains a precise trackable history.
- plan and play: the workflow can be rapidly iterated, analysed and optimized before it is sent for real execution on expensive or restricted HPC hardware.
- optimization: creating the workflow explicitly opens up possibilities for static analysis and refactoring before real execution.
- debugging: a number of classes of workflow planning bugs will not appear until late in a simulation run that might take days or weeks. This catches them before startup.
- continuous integration and testing: complex dynamic workflows can be rapidly sense-checked in CI without needing all the hardware and internal algorithms present to run them.
Documentation
For further information, see the documentation.