maestro, an R pipeline orchestration package, has reached stable release with versions 1.0.0 and 1.1.0. Key improvements include 2x-4x faster schedule build times, portable/cacheable schedule objects via RDS, a new get_run_sequence() function for planning pipeline execution, more intuitive weekday and month-date anchor times for weekly/monthly pipelines, and overhauled DAG fan-in observability with per-invocation run IDs in get_status(). Two functions (suggest_orch_frequency and show_network) are deprecated. The author notes running ~50 production pipelines via maestro in Docker serverless for under $1/month.
Table of contents
Faster schedule build and run timesSchedules are more portableNew function get_run_sequence get_run_sequenceMore intuitive anchor times for weekly/monthly pipelinesBetter observability of DAG pipelines that fan-in - overhauling get_status () get_status() .Deprecated functionsWrap upFootnotesSort: