Workflow orchestration has always been a pain for data scientists, but this is exacerbated in these AI hype days by agentic workflows executing arbitrary (not pre-defined) workflows with a variety of failure modes. Adam from Prefect joins us to talk through their open source Python library for orchestration and visibility into python-based pipelines. Along the way, he introduces us to things like Marvin, their AI engineering framework, and ControlFlow, their agent workflow system.
Featuring
Sponsors
WorkOS – A platform that gives developers a set of building blocks for quickly adding enterprise-ready features to their application. Add Single Sign-On (Okta, Azure, Google, Microsoft OAuth), sync users from any SCIM directory, HRIS integration, audit trails (SIEM), free magic link sign-in. WorkOS is designed for developers and offers a single, elegant interface that abstracts dozens of enterprise integrations. Learn more and get started at WorkOS.com
Shopify – Sign up for a $1/month trial period at shopify.com/practicalai
Notion – Notion is a place where any team can write, plan, organize, and rediscover the joy of play. It’s a workspace designed not just for making progress, but getting inspired. Notion is for everyone — whether you’re a Fortune 500 company or freelance designer, starting a new startup or a student juggling classes and clubs.
Notes & Links
Chapters
| Chapter Number | Chapter Start Time | Chapter Title | Chapter Duration |
| 1 | 00:00 | Welcome to Practical AI | 00:34 |
| 2 | 00:35 | Sponsor: WorkOS | 03:21 |
| 3 | 04:09 | Workflow orchestration | 05:24 |
| 4 | 09:32 | Common pain points | 05:05 |
| 5 | 14:37 | What makes ML orchestration different | 06:06 |
| 6 | 20:57 | Sponsor: Shopify | 01:32 |
| 7 | 22:46 | Intro to Prefect | 07:07 |
| 8 | 29:52 | Conversion experience | 07:21 |
| 9 | 37:25 | Sponsor: Notion | 02:03 |
| 10 | 39:43 | Adam's friend Marvin | 04:49 |
| 11 | 44:32 | Agentic approach | 07:18 |
| 12 | 51:50 | What's next? | 05:11 |
| 13 | 57:01 | Thanks for joining us | 00:36 |
| 14 | 57:38 | Outro | 00:46 |