gusty allows you to control your Airflow DAGs, Task Groups, and Tasks with greater ease. gusty manages collections of tasks, represented as any number of YAML, Python, SQL, Jupyter Notebook, or R Markdown files. A directory of task files is instantly rendered into a DAG by passing a file path to gusty's create_dag function. gusty also manages dependencies (within one DAG) and external dependencies (dependencies on tasks in other DAGs) for each task file you define. All you have to do is provide a list of dependencies or external_dependencies inside of a task file, and gusty will automatically set each task's dependencies and create external task sensors for any external dependencies listed. gusty works with both Airflow 1.x and Airflow 2.x, and has even more features, all of which aim to make the creation, management, and iteration of DAGs more fluid, so that you can intuitively design your DAG and build your tasks.

Features

  • Object-oriented orchestration
  • Decorative orchestration
  • File-oriented orchestration
  • gusty is a file-oriented framework for Airflow
  • gusty exists to make file-oriented orchestration fun and easy using Airflow
  • You can use any Airflow operator with gusty; gusty is simply a different way to write Airflow DAGs

Project Samples

Project Activity

See All Activity >

Categories

Data Pipeline

License

MIT License

Follow gusty

gusty Web Site

You Might Also Like
MongoDB Atlas runs apps anywhere Icon
MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of gusty!

Additional Project Details

Programming Language

Python

Related Categories

Python Data Pipeline Tool

Registered

2023-06-12