Back to Workshops
Workshop Free

Build a Production-Ready YouTube AI Agent with Temporal

December 16, 2025 Alexey Grigorev
ai-agents data-engineering temporal elasticsearch production-systems

We build a deep research agent over the DataTalks.Club podcast archive. The workshop starts by downloading and indexing YouTube transcripts, then turns that ingestion code into a durable Temporal workflow. After the data is searchable, we build a Pydantic AI research agent, add a summarization sub-agent for long transcripts, and wrap the agent run in Temporal too.

Links

The main resources for this workshop:

The system you will build

The final system looks like this:

flowchart LR YT["YouTube transcripts"] CACHE["Cached transcript files GitHub fallback"] FLOW["flow/ Temporal ingestion"] ES["Elasticsearch podcasts index"] AGENT["agent/ Pydantic AI research agent"] SUM["Summarization sub-agent"] TW["Temporal workflow agent run"] OPENAI["OpenAI"] YT -->|fetch_subtitles| FLOW CACHE -->|fetch_transcript_cached| FLOW FLOW -->|index_video| ES AGENT -->|search_videos| ES AGENT -->|summarize| SUM AGENT -->|model call| OPENAI SUM -->|model call| OPENAI TW -->|durable execution| AGENT

The ingestion side has the parts that usually fail in production: network calls, YouTube blocking cloud IPs, proxies, Elasticsearch writes, and long loops over many videos. Temporal gives that side retries, observability, and durable execution. The agent side uses the indexed data to answer questions from the podcast archive and then uses Temporal again so long agent runs can survive failures.

Materials

Related Course: AI Engineering Buildcamp

article

Tutorial pages

  1. Overview and setup
  2. Part 1: Fetch one transcript
  3. Part 2: Run Elasticsearch
  4. Part 3: Discover podcast videos
  5. Part 4: Temporal motivation
  6. Part 5: Define the workflow
  7. Part 6: Create the agent project
  8. Part 7: Summarize long transcripts
  9. Part 8: Wrap the agent in Temporal
  10. Q&A: questions from the workshop
  11. What to improve next
  12. Appendix: file inventory

Watch the recording

Full workshop video with timestamps and downloadable materials.

View code on GitHub

Related content

Article

Inside ChatGPT’s /home/oai/ Folder: Not a Data Leak, but OpenAI’s Hidden Skills System

I unpacked the mysterious /home/oai/ directory that ChatGPT can zip on command and found not leaked OpenAI infrastructure, but a sandbox of document, slide, and spreadsheet “skill…

February 10, 2026

Workshop

Skills.md from Scratch: Build a Skill-Driven Coding Agent

We start from the coding agent from the prerequisite workshop and turn it into a general-purpose coding agent with two reusable behavior layers: skills and slash commands. Skills …

January 16, 2026

Workshop

Building Safe AI Agents with Guardrails

We start with a DataTalks.Club Data Engineering Zoomcamp FAQ assistant, then add checks that keep the agent on topic, block unsafe responses, and show how to cancel wasted work wh…

January 6, 2026