--- schema: 1 type: video title: >- Claude Managed Agents Q&A: Evals, CI/CD and Multi-Tenancy (Part 4 of 4) — Anthropic description: >- How to version agent configs, isolate customers, add GPUs and keep a long-running agent responsive. NEXT UP: AI ENGINEER CODE SUMMIT Join us in SF for the second annual AIE CODE Summit, Nov 10–12, our last flagship summit of 2026. Applications live now: https://aie.codes The workshop closes with audience Q&A for Priyanka Phatak and Gabe Cemaj: syncing agent configs in CI/CD with the ant CLI, what happens when you message an agent waiting on a custom tool, how Anthropic runs evals, sharing resources across a workspace, code-review agents, tenant isolation, GPUs via self-hosted sandboxes, modeling a multiplayer Slack agent, and a coordinator pattern that keeps the main agent free while a subagent handles custom tools. This is part 4 of 4 of the Claude Managed Agents workshop from Anthropic. In this video: • Keeping agent definitions in YAML and syncing them in CI/CD • Isolating tenants by workspace, org or session metadata • Self-hosted sandboxes for GPUs and extra memory • A coordinator pattern for custom tools SPEAKERS Priyanka Phatak, Member of Technical Staff, Anthropic (leads the Claude Managed Agents engineering team) Gabe Cemaj, Member of Technical Staff, Anthropic GitHub: https://github.com/gcemaj LINKS Claude Managed Agents docs: https://platform.claude.com/docs/en/managed-agents/overview Scaling Managed Agents: Decoupling the brain from the hands: https://www.anthropic.com/engineering/managed-agents CHAPTERS 0:00 Q&A: CI/CD for agent configs 1:10 Q&A: messages during custom tool waits 2:06 Q&A: other workshop repos 2:45 Q&A: Anthropic's eval practices 4:42 Q&A: sharing resources across an org 6:29 Q&A: reviewing agent-written code 8:48 Q&A: tenant isolation 9:54 Q&A: one agent, many customers 12:10 Q&A: custom compute and GPUs 13:20 Q&A: a multiplayer Slack agent 14:34 Q&A: very long-running sessions 16:30 Q&A: coordinator pattern for custom tools 18:30 Closing Recorded at the AI Engineer World's Fair 2026 in San Francisco. Subscribe for more talks from the engineers building with AI. AI Engineer: https://ai.engineer YouTube: https://www.youtube.com/@aiDotEngineer X: https://x.com/aiDotEngineer LinkedIn: https://www.linkedin.com/company/aidotengineer/ #Claude #AIAgents #AIEngineer canonical: 'https://liquidgold.cc/watch/QSeaZ6qHyXs' markdown: 'https://liquidgold.cc/watch/QSeaZ6qHyXs.md' llms: 'https://liquidgold.cc/watch/QSeaZ6qHyXs/llms.txt' parent: 'https://liquidgold.cc/channel/aidotengineer.md' channel: aidotengineer updated: '2026-10-23T22:24:25.056Z' language: null children: [] videoId: QSeaZ6qHyXs durationSeconds: 1138 publishedAt: '2026-10-12T06:07:45.000Z' searchChunks: - ordinal: 0 text: null startSeconds: 23 endSeconds: 79 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=23' heldReason: rights - ordinal: 1 text: null startSeconds: 79 endSeconds: 89 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=79' heldReason: rights - ordinal: 2 text: null startSeconds: 181 endSeconds: 282 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=181' heldReason: rights - ordinal: 3 text: null startSeconds: 181 endSeconds: 282 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=181' heldReason: rights - ordinal: 4 text: null startSeconds: 292 endSeconds: 393 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=292' heldReason: rights - ordinal: 5 text: null startSeconds: 404 endSeconds: 538 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=404' heldReason: rights - ordinal: 6 text: null startSeconds: 404 endSeconds: 538 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=404' heldReason: rights - ordinal: 7 text: null startSeconds: 549 endSeconds: 594 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=549' heldReason: rights - ordinal: 8 text: null startSeconds: 605 endSeconds: 734 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=605' heldReason: rights - ordinal: 9 text: null startSeconds: 605 endSeconds: 734 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=605' heldReason: rights - ordinal: 10 text: null startSeconds: 744 endSeconds: 801 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=744' heldReason: rights - ordinal: 11 text: null startSeconds: 801 endSeconds: 813 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=801' heldReason: rights - ordinal: 12 text: null startSeconds: 893 endSeconds: 990 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=893' heldReason: rights - ordinal: 13 text: null startSeconds: 893 endSeconds: 990 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=893' heldReason: rights - ordinal: 14 text: null startSeconds: 1000 endSeconds: 1120 watch: 'https://liquidgold.cc/watch/QSeaZ6qHyXs?t=1000' heldReason: rights --- # Claude Managed Agents Q\&A: Evals, CI/CD and Multi-Tenancy (Part 4 of 4) — Anthropic How to version agent configs, isolate customers, add GPUs and keep a long-running agent responsive. NEXT UP: AI ENGINEER CODE SUMMIT Join us in SF for the second annual AIE CODE Summit, Nov 10–12, our last flagship summit of 2026. Applications live now: https://aie.codes The workshop closes with audience Q\&A for Priyanka Phatak and Gabe Cemaj: syncing agent configs in CI/CD with the ant CLI, what happens when you message an agent waiting on a custom tool, how Anthropic runs evals, sharing resources across a workspace, code-review agents, tenant isolation, GPUs via self-hosted sandboxes, modeling a multiplayer Slack agent, and a coordinator pattern that keeps the main agent free while a subagent handles custom tools. This is part 4 of 4 of the Claude Managed Agents workshop from Anthropic. In this video: • Keeping agent definitions in YAML and syncing them in CI/CD • Isolating tenants by workspace, org or session metadata • Self-hosted sandboxes for GPUs and extra memory • A coordinator pattern for custom tools SPEAKERS Priyanka Phatak, Member of Technical Staff, Anthropic (leads the Claude Managed Agents engineering team) Gabe Cemaj, Member of Technical Staff, Anthropic GitHub: https://github.com/gcemaj LINKS Claude Managed Agents docs: https://platform.claude.com/docs/en/managed-agents/overview Scaling Managed Agents: Decoupling the brain from the hands: https://www.anthropic.com/engineering/managed-agents CHAPTERS 0:00 Q\&A: CI/CD for agent configs 1:10 Q\&A: messages during custom tool waits 2:06 Q\&A: other workshop repos 2:45 Q\&A: Anthropic's eval practices 4:42 Q\&A: sharing resources across an org 6:29 Q\&A: reviewing agent-written code 8:48 Q\&A: tenant isolation 9:54 Q\&A: one agent, many customers 12:10 Q\&A: custom compute and GPUs 13:20 Q\&A: a multiplayer Slack agent 14:34 Q\&A: very long-running sessions 16:30 Q\&A: coordinator pattern for custom tools 18:30 Closing Recorded at the AI Engineer World's Fair 2026 in San Francisco. Subscribe for more talks from the engineers building with AI. AI Engineer: https://ai.engineer YouTube: https://www.youtube.com/@aiDotEngineer X: https://x.com/aiDotEngineer LinkedIn: https://www.linkedin.com/company/aidotengineer/ #Claude #AIAgents #AIEngineer Canonical: https://liquidgold.cc/watch/QSeaZ6qHyXs · Channel: [AI Engineer](https://liquidgold.cc/channel/aidotengineer.md) > Search chunk text is held until public-source provenance is verified. ## Document chunks --- #### Chunk 0: Document excerpt (0:13 to 1:19) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 1: Document excerpt (1:19 to 2:07) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 2: Document excerpt (2:07 to 2:50) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 3: Document excerpt (2:50 to 4:42) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 4: Document excerpt (4:42 to 6:33) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 5: Document excerpt (6:33 to 8:58) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 6: Document excerpt (8:58 to 9:54) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 7: Document excerpt (9:54 to 12:14) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 8: Document excerpt (12:14 to 13:21) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 9: Document excerpt (13:21 to 14:40) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 10: Document excerpt (14:40 to 16:30) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 11: Document excerpt (16:30 to 18:58) > Held: transcript rights do not permit this chunk's text.