Astronomer

Building a self-serve data platform turns Airflow from a scheduler into an integration ecosystem. In “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI”, Paul Vickers and Andras Gombosi share how 11,000 DAGs, YAML-driven frameworks and LLM-powered pipelines keep analytics, AI products and sales aligned at Intercom. Click the link in the comments for the episode. #AI #Automation #Airflow

🤖 Sure, you can ship another chatbot, but what about an application your competitor can’t vibe code within a day? That takes data orchestration. Learn how to upgrade from AI experimentation to shipping scalable, production-grade data products with Apache Airflow. Download this eBook to deep dive into: → Event-driven inference execution → Multi-agent workflows → Latest Airflow 3 GenAI features Link below.

🛡️ Joshua D., Chief Information Security Officer at Astronomer, appeared on ADAMnetworks® The Defender's Log podcast to dissect a critical reality: cybersecurity is a human-made domain, and we have an obligation to control it. Joshua outlines the transition from the "easy" path of offensive hacking to the complex, high-stakes world of strategic defense. The conversation moves beyond standard hygiene into the mechanics of survival in a Universal Threat Ecosystem (UTE): Watch the full episode at the link below.

Tomorrow! Join Marc Lamberti to learn about implementing CI/CD for your Apache Airflow pipelines: ✅ The basics of using CI/CD with Airflow ✅ How to leverage Astro’s built-in GitHub integration and other CI/CD features ✅ Strategies for choosing and implementing the best deployment options Register at the link below.

Data teams at organizations like WeWork, Glassdoor, and Foursquare are already on Apache Airflow 3. What are you waiting for? Join Kenten Danas and Tamara Janina Fingerlin to learn what’s new and get tips on planning your upgrade: - Dag versioning, human-in-the-loop, and more - Native support for MLOps + GenAI workflows - Best practices for upgrading your Dags (without breaking them) 🎁 Attend live for a chance to win a physical copy of the Manning Practical Guide to Airflow 3, authored by none other than Tamara herself! Register at the link below.

Pete DeJoy, CEO and Co-Founder at Astronomer, will be joining Barry McCardel on stage at our December 9th NYC event to explore Astronomer's journey, including the company's open-source roots and sudden global brand recognition. Link to request a spot to attend in the comments below.

🎰 In Vegas this week for Amazon Web Services (AWS) re:Invent? Join Kenten Danas and Volker Janz at the AWS Open Source Lounge in Ha Salon at the Venetian on Wednesday at 4:30 PM for Play Astro. This is a gamified learning event using Astronomer solutions to solve technical problems in a risk-free setting. You'll experience the new Astro IDE, as well as Apache Airflow 3 features such as event-driven scheduling, Dag versioning, and human-in-the-loop. Register at the link below.

In this episode, Sharadh Krishnamurthy at Stripe explains how Stripe customizes Airflow, how to scale orchestration and what it takes to maintain reliability across thousands of workflows. Check the comments for a link to the episode. #AI #Automation #Airflow #MachineLearning