Data Engineering Podcast artwork

Podcast

Data Engineering Podcast

Tobias Macey

Technology · 521 episodes
Subscribe+ Add a credit

This show goes behind the scenes for the tools, techniques, and difficulties associated with the discipline of data engineering. Databases, workflows, automation, and data manipulation are just some of the topics that you will find here.

Is this your show? Claim this page

PodCred

The people behind this show

People get invited back because someone remembered they were great.

PodCred is the verified record of who made this show. A credit here means people who were there confirmed the work.

Hosts

11 people
  • Tobias MaceyHost, 520 episodesFeed-stated
  • Matthew RocklinHost, Dask with Matthew Rocklin - Episode 2Feed-stated
  • Nikita ShamgunovHost, 2 episodesFeed-stated
  • Hannes MühleisenHost, Move Your Database To The Data And Speed Up Your Analytics With DuckDBFeed-stated
  • Praveen GujarHost, The Role of Product Managers in Data-Centric OrganizationsFeed-stated
  • Michel TricotHost, Scaling Airbyte: Challenges and Milestones on the Road to 1.0Feed-stated
  • Burak KarakanHost, An Opinionated Look At End-to-end Code Only Analytical Workflows With BruinFeed-stated
  • Marc BrookerHost, From RAG to Relational: How Agentic Patterns Are Reshaping Data ArchitectureFeed-stated
  • Brijesh TripathiHost, From GPUs-as-a-Service to Workloads-as-a-Service: Flex AI’s Path to High-Utilization AI InfraFeed-stated
  • Jevin MaltaisHost, Holding Kafka Right: Product-Friendly Streaming with TypeStreamFeed-stated
  • Prukalpa SankarHost, Building the Context Flywheel for AI Data AgentsFeed-stated
Showing 5 of 11

Guests

63 guests
  • Victor Kesslerguest, Advanced Lakehouse Management With The LakeKeeper Iceberg REST CatalogFeed-stated
  • Xinyu Zhengguest, Unfreezing The Data Lake: The Future-Proof File FormatFeed-stated
  • Daniel WhitenackGuest, Pachyderm with Daniel Whitenack - Episode 1Feed-stated
  • Sean T. AllenGuest, Wallaroo with Sean T. Allen - Episode 12Feed-stated
  • Gleb MezhanskiyGuest, 3 episodesFeed-stated
  • Kevin LiuGuest, Being Data Driven At Stripe With Trino And IcebergFeed-stated
  • Dipti BorkarGuest, Stitching Together Enterprise Analytics With Microsoft FabricFeed-stated
  • Petr JandaGuest, Improve Data Quality Through Engineering Rigor And Business Engagement With SynqFeed-stated
  • Lior GavishGuest, How Generative AI Is Impacting Data Engineering TeamsFeed-stated
  • Tom BaeyensGuest, Achieving Data Reliability: The Role of Data Contracts in Modern Data ManagementFeed-stated
  • Chris BerghGuest, The Evolution of DataOps: Insights from DataKitchen's CEOFeed-stated
  • Junping DuGuest, Enhancing Data Accessibility and Governance with GravitinoFeed-stated
  • Lukas SchulteGuest, Build Your Data Transformations Faster And Safer With SDFFeed-stated
  • Marcin RudolfGuest, The Role of Python in Shaping the Future of Data Platforms with DLTFeed-stated
  • Adrian BrudaruGuest, The Role of Python in Shaping the Future of Data Platforms with DLTFeed-stated
  • Weston PaceGuest, Bring Vector Search And Storage To The Data Lake With LanceFeed-stated
  • Gleb MezhanskiyGuest, 2 episodesFeed-stated
  • Mihai BudiuGuest, Feldera: Bridging Batch and Streaming with Incremental ComputationFeed-stated
  • Lalith SureshGuest, Feldera: Bridging Batch and Streaming with Incremental ComputationFeed-stated
  • Leonid RyzhykGuest, Feldera: Bridging Batch and Streaming with Incremental ComputationFeed-stated
  • Ken PickeringGuest, Streaming Data Into The Lakehouse With Iceberg And Trino At GoingFeed-stated
  • Anna GellerGuest, Bridging Code and UI in Data Orchestration with KestraFeed-stated
  • Sam KleinmanGuest, The Art of Database Selection and EvolutionFeed-stated
  • Maxime BeaucheminGuest, 2 episodesFeed-stated
  • Hugo LuGuest, How Orchestration Impacts Data Platform ArchitectureFeed-stated
  • Lior BarakGuest, Building a Data Vision Board: A Guide to Strategic PlanningFeed-stated
  • Daniel BrucknerGuest, Breaking Down Data Silos: AI and ML in Master Data ManagementFeed-stated
  • Andrew LuoGuest, CSVs Will Never Die And OneSchema Is Counting On ItFeed-stated
  • Bartosz MikulskiGuest, Evolving Responsibilities in AI Data ManagementFeed-stated
  • Rajan GoyalGuest, Accelerated Computing in Modern Data Centers With DatapelagoFeed-stated
  • Pete DeJoyGuest, Astronomer's Role in the Airflow Ecosystem: A Deep Dive with Pete DeJoyFeed-stated
  • Roman GershmanGuest, Overcoming Redis Limitations: The Dragonfly DB ApproachFeed-stated
  • Jeremy EdbergGuest, Simplifying Data Pipelines with Durable ExecutionFeed-stated
  • Viktor KesslerGuest, Advanced Lakehouse Management With The LakeKeeper Iceberg REST CatalogFeed-stated
  • Derek CollisonGuest, Exploring NATS: A Multi-Paradigm Connectivity Layer for Distributed ApplicationsFeed-stated
  • Tulika BhattGuest, Balancing Off-the-Shelf and Custom Solutions in Data EngineeringFeed-stated
  • Shinji KimGuest, From Data Discovery to AI: The Evolution of Semantic LayersFeed-stated
  • Chakravarthy KotaruGuest, Scaling Data Operations With Platform EngineeringFeed-stated
  • Mai-Lan Tomsen BukovecGuest, Amazon S3: The Backbone of Modern Data SystemsFeed-stated
  • Alex AlbuGuest, AI and the Lakehouse: How Starburst is Pioneering New WorkflowsFeed-stated
  • Nick SchrockGuest, 2 episodesFeed-stated
  • Arun JosephGuest, Enabling Agents In The Enterprise With A Platform ApproachFeed-stated
  • Effie BaramGuest, Foundational Data Engineering At Two SigmaFeed-stated
  • Kacper ŁukawskiGuest, Streamlining Data Pipelines with MCP Servers and Vector EnginesFeed-stated
  • Dan SotolongoGuest, Warehouse Native Incremental Data Processing With Dynamic Tables And Delayed View SemanticsFeed-stated
  • Akshay AgrawalGuest, Revolutionizing Python Notebooks with MarimoFeed-stated
  • Andy WarfieldGuest, From Bits to Tables: The Evolution of S3 StorageFeed-stated
  • Drew GilsonGuest, Bridging Data and Decision-Making: AI's Role in Modern AnalyticsFeed-stated
  • Lucas ThelosenGuest, Bridging Data and Decision-Making: AI's Role in Modern AnalyticsFeed-stated
  • Prashanth RaoGuest, High Performance And Low Overhead Graphs With KuzuDBFeed-stated
  • Paul GrothGuest, From Academia to Industry: Bridging Data Engineering ChallengesFeed-stated
  • Serge GershkovichGuest, Aligning Business and Data: The Essential Role of Data ModelingFeed-stated
  • Mark RaasveldtGuest, Duck Lake: Simplifying the Lakehouse EcosystemFeed-stated
  • Hannes MühleisenGuest, Duck Lake: Simplifying the Lakehouse EcosystemFeed-stated
  • Kate ShawGuest, The True Costs of Legacy Systems: Technical Debt, Risk, and Exit StrategiesFeed-stated
  • Matt TopperGuest, Beyond the Perimeter: Practical Patterns for Fine‑Grained Data AccessFeed-stated
  • Ido BronsteinGuest, Bridging the AI–Data Gap: Collect, Curate, ServeFeed-stated
  • Omri LifshitzGuest, Bridging the AI–Data Gap: Collect, Curate, ServeFeed-stated
  • Ariel PohorylesGuest, The AI Data Paradox: High Trust in Models, Low Trust in DataFeed-stated
  • Preeti SomalGuest, State, Scale, and Signals: Rethinking Orchestration with Durable ExecutionFeed-stated
  • Michael ToyGuest, Malloy: Hierarchical Data, Semantic Models, and the Future of AnalyticsFeed-stated
  • Suresh SrinivasGuest, From Context to Semantics: How Metadata Powers Agentic AIFeed-stated
  • Sriharsha ChintalapaniGuest, From Context to Semantics: How Metadata Powers Agentic AIFeed-stated
Showing 5 of 63

Who is on this show?

Think of the guest you still think about. The producer who makes the host sound smart. The editor who saves every episode. If a name is missing here, that person is invisible everywhere.

Add a credit

Episodes

521 episodes
  1. Entity Resolution at Scale: Graphs, LLMs, and Real-World Data Messiness

    59 minAudio

    Summary In this episode, I spoke with Steven Renwick, CEO and co-founder of Tilores, about the realities of entity-oriented data processing and the practical role of LLMs in entity resolution. We covered the confusing...

    Credit the people on this episode

  2. How Amazon Uses Telemetry and AI to Automate Physical Logistics

    50 minAudio

    Summary In this episode, I spoke with Keerti Kulkarni about the data and AI systems behind physical logistics automation at Amazon. She explained how her team supports dock-door operations across more than 100 North...

    Credit the people on this episode

  3. Why Metadata Still Matters: From Data Catalogs to AI-Ready Semantic Hubs

    1 hr 25 minAudio

    Summary In this episode, I spoke with Christian Bremeau and Simon Dynin about their decades-long work in metadata management and how that experience shaped the evolution of Meta Integration Technology and its...

    Credit the people on this episode

  4. Reducing Data Debt with Agile Ledger Architecture

    50 minAudio

    Summary In this episode Christopher Doidge talks about his Agile Ledger Architecture (ALA) approach to data warehousing and how it aims to reduce data debt while shortening the path from raw data to trustworthy business...

    Credit the people on this episode

  5. What Context Really Means in Data Engineering and AI

    53 minAudio

    Summary In this episode Soham Mazumdar, co-founder and CEO of Wisdom.ai, talks about what “context” really means in data engineering and AI systems. He explores why context has become such an overloaded term, spanning...

    Credit the people on this episode

Show moreShowing 5 of 521

Posts

No posts yet. Posts Data Engineering Podcast shares on PodSubs, and what it publishes on Substack, YouTube and its own site, will show here.

Be the first to rate this show

Subscribe

Be on the front line of the show

Everything Data Engineering Podcast sends its own people, first. Resources, announcements, behind the scenes, events, and giveaways, straight from the host. No account needed.

  • The resources the host shares with subscribers
  • Announcements before anyone else hears
  • Behind the scenes from the team
  • Events, invitations, and giveaways
  • Only what the host sends, nothing else
How often

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.