--- schema: 1 type: video title: 'Fighting AI with AI — Lawrence Jones, Incident' description: >- Incident's AI SRE runs hundreds of prompts per investigation across logs, metrics, traces, and code. When it produces a wrong root cause analysis, there is no tractable way for a human to read through the full trace and find where the reasoning went sideways. Lawrence Jones, founding engineer at Incident.io, describes the moment the team realized they needed AI to debug their AI. The talk covers three patterns they built. A small CLI lets coding agents read and edit eval YAML files that had grown too large for agents to work with directly, enabling a red-green runbook where the agent writes a failing eval, fixes the prompt, and checks nothing else broke. Their bigger unlock was serializing every UI debugging view as a downloadable file system: drop it into a Claude Code session, describe the bad behavior, and the agent traces through the prompt hierarchy to tell you exactly which prompt to change. For fleet-scale analysis, 25 agents run in parallel each analyzing one investigation, then a second stage clusters the results to surface systemic failure patterns across customer accounts. Speaker info: - https://x.com/lawrjones - https://www.linkedin.com/in/lawrence2jones/ --- Watch along with the corrected transcript, summary, timestamps and resources on this talk's official AIE page: https://ai.engineer/talks/L2r6vLlLgs8-lawrence-jones-fighting-ai-with-ai Join our upcoming AI Engineer conferences (see https://ai.engineer landing page): - AIEi Shanghai, November 5–6 — the first for meeting top Chinese labs and engineers - AIE CODE in SF, November 10–12 — the top AI Coding conference returns - AIEi Sydney, December 7–8 — the first AIEi run alongside NeurIPS 2026 in Sydney --- canonical: >- https://liquidgold.cc/channel/aidotengineer/explore/video/fighting-ai-with-ai-lawrence-jones-incident-8ccc61924c57 markdown: >- https://liquidgold.cc/channel/aidotengineer/video/fighting-ai-with-ai-lawrence-jones-incident-8ccc61924c57.md llms: null parent: 'https://liquidgold.cc/channel/aidotengineer.md' channel: aidotengineer updated: '2026-10-24T14:10:56.596Z' language: null children: [] videoId: L2r6vLlLgs8 durationSeconds: 1049 publishedAt: '2026-05-17T16:30:07.000Z' searchChunks: - ordinal: 0 text: null startSeconds: 15 endSeconds: 25 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=15' heldReason: rights - ordinal: 1 text: null startSeconds: 25 endSeconds: 123 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=25' heldReason: rights - ordinal: 2 text: null startSeconds: 123 endSeconds: 134 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=123' heldReason: rights - ordinal: 3 text: null startSeconds: 134 endSeconds: 255 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=134' heldReason: rights - ordinal: 4 text: null startSeconds: 265 endSeconds: 353 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=265' heldReason: rights - ordinal: 5 text: null startSeconds: 363 endSeconds: 472 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=363' heldReason: rights - ordinal: 6 text: null startSeconds: 363 endSeconds: 472 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=363' heldReason: rights - ordinal: 7 text: null startSeconds: 483 endSeconds: 572 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=483' heldReason: rights - ordinal: 8 text: null startSeconds: 572 endSeconds: 582 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=572' heldReason: rights - ordinal: 9 text: null startSeconds: 582 endSeconds: 691 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=582' heldReason: rights - ordinal: 10 text: null startSeconds: 691 endSeconds: 703 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=691' heldReason: rights - ordinal: 11 text: null startSeconds: 703 endSeconds: 791 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=703' heldReason: rights - ordinal: 12 text: null startSeconds: 802 endSeconds: 908 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=802' heldReason: rights - ordinal: 13 text: null startSeconds: 802 endSeconds: 908 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=802' heldReason: rights - ordinal: 14 text: null startSeconds: 918 endSeconds: 1049 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=918' heldReason: rights - ordinal: 15 text: null startSeconds: 918 endSeconds: 1049 watch: 'https://liquidgold.cc/watch/L2r6vLlLgs8?t=918' heldReason: rights --- # Fighting AI with AI — Lawrence Jones, Incident Incident's AI SRE runs hundreds of prompts per investigation across logs, metrics, traces, and code. When it produces a wrong root cause analysis, there is no tractable way for a human to read through the full trace and find where the reasoning went sideways. Lawrence Jones, founding engineer at Incident.io, describes the moment the team realized they needed AI to debug their AI. The talk covers three patterns they built. A small CLI lets coding agents read and edit eval YAML files that had grown too large for agents to work with directly, enabling a red-green runbook where the agent writes a failing eval, fixes the prompt, and checks nothing else broke. Their bigger unlock was serializing every UI debugging view as a downloadable file system: drop it into a Claude Code session, describe the bad behavior, and the agent traces through the prompt hierarchy to tell you exactly which prompt to change. For fleet-scale analysis, 25 agents run in parallel each analyzing one investigation, then a second stage clusters the results to surface systemic failure patterns across customer accounts. Speaker info: - https://x.com/lawrjones - https://www.linkedin.com/in/lawrence2jones/ --- Watch along with the corrected transcript, summary, timestamps and resources on this talk's official AIE page: https://ai.engineer/talks/L2r6vLlLgs8-lawrence-jones-fighting-ai-with-ai Join our upcoming AI Engineer conferences (see https://ai.engineer landing page): - AIEi Shanghai, November 5–6 — the first for meeting top Chinese labs and engineers - AIE CODE in SF, November 10–12 — the top AI Coding conference returns - AIEi Sydney, December 7–8 — the first AIEi run alongside NeurIPS 2026 in Sydney --- Canonical: https://liquidgold.cc/channel/aidotengineer/explore/video/fighting-ai-with-ai-lawrence-jones-incident-8ccc61924c57 · Channel: [AI Engineer](https://liquidgold.cc/channel/aidotengineer.md) > Search chunk text is held until public-source provenance is verified. ## Document chunks > Missing: no stored document chunks are available.