Astronomer

Why choose Apache Airflow over other tools? For Amogh Desai, Senior Software Engineer at Astronomer, it came down to two things: opportunity and community. Airflow’s evolving nature offered room for meaningful contributions, while its vibrant and welcoming community made it easier to get started. A guest speech by Yarik at a meetup further sparked his interest, showing how strong mentorship and guidance can pave the way for impactful open-source work. These factors not only drew Amogh to Airflow but also helped him make a lasting impact on the project. For the full episode, click the link in the comments below. #AI #Automation #Airflow #MachineLearning

❓: What does a top 5 global bank have in common with an investment firm with $1.5 trillion in managed assets? 🙋 : They’ve modernized their data stacks to support AI initiatives and power advanced analytics with real-time insights, while improving performance and reliability. Download this guide to learn the top 5 initiatives financial institutions are prioritizing with data orchestration and Apache Airflow. https://bit.ly/488XNw5

Had the pleasure of meeting Benjamin Rogojan (The Seattle Data Guy) today, and he's every bit as genuine and insightful in person as he is online 💚. We grabbed coffee after his talk at the Airflow Summit and swapped war stories about our shared history with Hadoop and SQL Server 😅. It's fascinating how different companies are stuck in different eras of data infrastructure, some still fighting with problems we thought we'd solved years ago, while others are pushing the boundaries of what's possible. What struck me most: Ben has built an incredible presence in the data community, yet he remains incredibly grounded and generous with his time and knowledge. I've learned so much from his content over the years, and it was great to finally connect face-to-face. This whole experience reminded me why I love this community. From being part of Data Engineer Things, with contributing as an editor for the DET newsletter, to my work as a DevRel member at Astronomer, every step has reinforced one thing: The best part of data engineering isn't the technology; it's the people willing to share what they've learned so others don't have to struggle alone. Grateful to be part of such a collaborative community 🙏.

Processing billions of geospatial data points is no small task. In “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI,” Alex Iannicelli at Overture Maps Foundation and Daniel Smith at Wherobots share how Airflow orchestrates massive pipelines, ensuring scale, speed and efficiency in geospatial workflows. Click the link in the comments for the episode. #AI #Automation #Airflow #MachineLearning

🍎 "With Astro IDE, I completed five or six hours of work in under an hour – exactly the kind of time savings data teams need. The code it generated was high-quality and production-ready from the start. Compared to generic AI tools, Astro IDE was miles ahead, with a deeper understanding of Airflow and the ability to ask the right questions. Even with our most complex DAGs, it was able to explain, transform, and adapt them with ease.” - Tim Handley, Chief Product and Technology Officer, Welbee Read the new case study to learn how Welbee's Edu Intelligence leverages Astro to cut data analysis time by 90%, enabling educators to focus on student and staff outcomes: https://bit.ly/4mSLyHv

👩💻 Using dbt and Apache Airflow? Take the next step with Cosmos, the open-source package that brings your dbt projects into Airflow for better visibility, faster performance, and simpler orchestration. In this free eBook, you’ll learn how to: ✅ Set up Airflow + Cosmos for local development ✅ Deploy to Astro in minutes ✅ Improve parsing and execution performance Download today: https://bit.ly/4h29c2R

☀️ Day 2 of Airflow Summit is off to a fast start with keynotes from Tala Karadsheh of GitHub and Brooke Jamieson from Amazon Web Services (AWS)! Day 1 was jam-packed with innovative presentations – what session are you most looking forward to today? https://airflowsummit.org/ #AirflowSummit

Watching OpenAI at the Airflow Summit in a standing-room-only presentation. Airflow has become “mission critical” for them. They are running 7000+ DAGs and growing!

🤔 Wondering if the new Astro IDE already recognizes the latest Airflow 3.1 features? What about comparing Astro IDE's grasp of Airflow, versus other popular LLMs and coding agents like ChatGPT with gpt-5, Cursor with gpt-5, and Cursor with claude-4.5-sonnet? Tamara Janina Fingerlin dives into which of these solutions can help you write the best human-in-the-loop Apache Airflow DAG in her new blog post: https://bit.ly/3KLMf89