--- schema: 1 type: video title: 'Why 99% Accurate Browser Agents Still Fail — Derek Meegan, Browserbase' description: >- A browser agent that's 99% accurate per step succeeds only about 36% of the time over 100 steps. Here's how to beat that math. Derek Meegan, software engineer at Browserbase, explains what separates a browser-agent demo from thousands of unattended production runs. He covers how agents see the web (text, screenshots and code), why cost builds up with every step while value only comes at the end, and why you should measure success per transaction, not per run. Then he walks through a real architecture for automating a health insurance portal: deterministic tools, OCR verification, pulled-out authentication and skills that keep the agent on the critical path. In this talk: • The three ways agents interact with the browser • Why compounding step risk kills long trajectories, and how retries change the picture • Performance first, then cost and maintainability as engineering problems • A production architecture that takes everything deterministic out of the model's hands SPEAKER Derek Meegan, Software Engineer, Browserbase LinkedIn: https://www.linkedin.com/in/derekmeegan/ X: https://x.com/derekmeegan Website: https://www.derekmeegan.com/ LINKS Browserbase: https://www.browserbase.com Stagehand: https://www.browserbase.com/stagehand Stagehand (GitHub): https://github.com/browserbase/stagehand CHAPTERS 0:00 Intro 0:12 Demo vs production 0:47 Agenda 1:27 How agents interact with the web 2:32 Text, screenshots or code 3:17 Types of browser trajectories 4:32 No partial credit 5:22 The 99% → 36% problem 6:12 Profit = revenue − cost 7:37 Performance, cost, maintainability 8:12 What success looks like 8:42 Per-run vs per-transaction success 9:32 Breaking down cost 10:11 Maintenance over time 10:46 Risks: the web fights back 12:06 Architecture: automating an insurance portal 13:01 A deterministic download tool 13:31 Verifying with OCR 13:56 Pulling out authentication 14:36 Skills as standard operating procedures 15:26 The final system 16:21 Welcome to production Recorded at the AI Engineer World's Fair 2026 in San Francisco. Subscribe for more talks from the engineers building with AI. AI Engineer: https://ai.engineer YouTube: https://www.youtube.com/@aiDotEngineer X: https://x.com/aiDotEngineer LinkedIn: https://www.linkedin.com/company/aidotengineer/ #BrowserAgents #AIAgents #AIEngineer canonical: 'https://liquidgold.cc/watch/5xi_S1f9sDU' markdown: 'https://liquidgold.cc/watch/5xi_S1f9sDU.md' llms: 'https://liquidgold.cc/watch/5xi_S1f9sDU/llms.txt' parent: 'https://liquidgold.cc/channel/aidotengineer.md' channel: aidotengineer updated: '2026-10-23T22:20:13.635Z' language: null children: [] videoId: 5xi_S1f9sDU durationSeconds: 1009 publishedAt: '2026-10-02T21:30:15.000Z' searchChunks: - ordinal: 0 text: null startSeconds: 12 endSeconds: 23 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=12' heldReason: rights - ordinal: 1 text: null startSeconds: 23 endSeconds: 48 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=23' heldReason: rights - ordinal: 2 text: null startSeconds: 48 endSeconds: 58 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=48' heldReason: rights - ordinal: 3 text: null startSeconds: 58 endSeconds: 92 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=58' heldReason: rights - ordinal: 4 text: null startSeconds: 92 endSeconds: 104 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=92' heldReason: rights - ordinal: 5 text: null startSeconds: 104 endSeconds: 159 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=104' heldReason: rights - ordinal: 6 text: null startSeconds: 159 endSeconds: 171 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=159' heldReason: rights - ordinal: 7 text: null startSeconds: 171 endSeconds: 205 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=171' heldReason: rights - ordinal: 8 text: null startSeconds: 205 endSeconds: 216 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=205' heldReason: rights - ordinal: 9 text: null startSeconds: 216 endSeconds: 274 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=216' heldReason: rights - ordinal: 10 text: null startSeconds: 274 endSeconds: 287 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=274' heldReason: rights - ordinal: 11 text: null startSeconds: 287 endSeconds: 334 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=287' heldReason: rights - ordinal: 12 text: null startSeconds: 334 endSeconds: 348 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=334' heldReason: rights - ordinal: 13 text: null startSeconds: 348 endSeconds: 384 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=348' heldReason: rights - ordinal: 14 text: null startSeconds: 384 endSeconds: 394 watch: 'https://liquidgold.cc/watch/5xi_S1f9sDU?t=384' heldReason: rights --- # Why 99% Accurate Browser Agents Still Fail — Derek Meegan, Browserbase A browser agent that's 99% accurate per step succeeds only about 36% of the time over 100 steps. Here's how to beat that math. Derek Meegan, software engineer at Browserbase, explains what separates a browser-agent demo from thousands of unattended production runs. He covers how agents see the web (text, screenshots and code), why cost builds up with every step while value only comes at the end, and why you should measure success per transaction, not per run. Then he walks through a real architecture for automating a health insurance portal: deterministic tools, OCR verification, pulled-out authentication and skills that keep the agent on the critical path. In this talk: • The three ways agents interact with the browser • Why compounding step risk kills long trajectories, and how retries change the picture • Performance first, then cost and maintainability as engineering problems • A production architecture that takes everything deterministic out of the model's hands SPEAKER Derek Meegan, Software Engineer, Browserbase LinkedIn: https://www.linkedin.com/in/derekmeegan/ X: https://x.com/derekmeegan Website: https://www.derekmeegan.com/ LINKS Browserbase: https://www.browserbase.com Stagehand: https://www.browserbase.com/stagehand Stagehand (GitHub): https://github.com/browserbase/stagehand CHAPTERS 0:00 Intro 0:12 Demo vs production 0:47 Agenda 1:27 How agents interact with the web 2:32 Text, screenshots or code 3:17 Types of browser trajectories 4:32 No partial credit 5:22 The 99% → 36% problem 6:12 Profit = revenue − cost 7:37 Performance, cost, maintainability 8:12 What success looks like 8:42 Per-run vs per-transaction success 9:32 Breaking down cost 10:11 Maintenance over time 10:46 Risks: the web fights back 12:06 Architecture: automating an insurance portal 13:01 A deterministic download tool 13:31 Verifying with OCR 13:56 Pulling out authentication 14:36 Skills as standard operating procedures 15:26 The final system 16:21 Welcome to production Recorded at the AI Engineer World's Fair 2026 in San Francisco. Subscribe for more talks from the engineers building with AI. AI Engineer: https://ai.engineer YouTube: https://www.youtube.com/@aiDotEngineer X: https://x.com/aiDotEngineer LinkedIn: https://www.linkedin.com/company/aidotengineer/ #BrowserAgents #AIAgents #AIEngineer Canonical: https://liquidgold.cc/watch/5xi_S1f9sDU · Channel: [AI Engineer](https://liquidgold.cc/channel/aidotengineer.md) > Search chunk text is held until public-source provenance is verified. ## Document chunks --- #### Chunk 0: Document excerpt (0:00 to 0:12) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 1: Document excerpt (0:12 to 1:32) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 2: Document excerpt (1:32 to 3:25) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 3: Document excerpt (3:25 to 4:34) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 4: Document excerpt (4:34 to 6:24) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 5: Document excerpt (6:24 to 8:18) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 6: Document excerpt (8:18 to 9:39) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 7: Document excerpt (9:39 to 10:46) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 8: Document excerpt (10:46 to 12:06) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 9: Document excerpt (12:06 to 14:00) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 10: Document excerpt (14:00 to 15:30) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 11: Document excerpt (15:30 to 16:49) > Held: transcript rights do not permit this chunk's text.