Talk by Corey Gallon on automating web browsers with AI agents so they interact with websites like human users. Core premise: a browser driven via the Chrome DevTools Protocol (CDP) sends clicks and keystrokes through the same path as real user input, though Chrome marks events trusted or untrusted. Covers a sense–act–verify loop and a three-rung escalation ladder: synthetic JavaScript clicks, real CDP input events, and human-like mouse paths with jitter and overshoot. Discusses why a CLI may beat an MCP server on speed, and a hybrid approach where deterministic code drives challenges (e.g., reCAPTCHA v2, Cloudflare Turnstile, image captchas) while the agent handles visual tile recognition. Demonstrations run on the speaker's own infrastructure and accounts. # Channel Presentation Observations: "The Dark Arts of Web Automation" (Corey Gallon, Rexmore) ## Explicit Self-Description Evidence - **Tool authorship claim**: The speaker states he wrote the featured tool: *"a tool that I wrote called Chrome Agent"* and later *"It's installable in the Python ecosystem. That's the tool that I wrote that I do all of this with and I use it all day every day."* - **Non-commercial framing**: *"I'm not here shilling a product"* — presented alongside *"or frankly build your own."* - **Speaker affiliation**: The title identifies the speaker as **Corey Gallon, Rexmore**; the talk appears to be a **conference presentation** (references to "this talk," "15 minutes," a "huddle space" for post-talk discussion). - **Personal workflow claim**: Agents should *"book the things, to send the emails, to fill in the forms so that I don't have to"* — framing automation around the speaker's own daily web tasks. ## Claimed Scope of Content - **Topic scope**: Teaching AI agents to operate web browsers indistinguishably from humans, including bypassing anti-bot systems (Cloudflare Turnstile, image CAPTCHAs, drag-puzzle CAPTCHAs, reCAPTCHA v2). - **Methodological framework offered**: Three pillars — a **CLI over MCP**, the **Chrome DevTools Protocol**, and a **"loop on a ladder"** (sense → act → verify, escalating through three "rungs" of human-likeness). - **Demonstration scope**: Live demos claimed to be *"real agent browser use in the wild"* — with the caveat *"upon the advice of council, everything that you're seeing is running only on infrastructure that I own and accounts that I operate."* - **Reliability claim**: *"It's a repeatable, reliable solution now for solving this and other forms of captures."* ## Observable Presentation Patterns - **Provocative/edgy framing**: Title ("Dark Arts"), self-deprecating humor (*"meatbag"*), and the OpenAI ban anecdote used as a hook: *"OpenAI threatened to ban my account just for the work that I was doing in preparing for the talk."* - **Technically detailed, evidence-citing style**: Cites third-party studies — *"a recent study by the guys at Arise AI"* (CLI vs. MCP ~83% success; 71 round trips/8 minutes vs. 7 turns/under 1 minute) and *"Anthropic themselves reported that the CLI can be as much as 75 times cheaper."* - **Audience addressed**: Developers/practitioners building AI agents — assumes familiarity with MCP, CDP, DOM, shadow roots, cross-origin iframes, and Python ecosystems. - **Takeaway-oriented structure**: Explicitly names the big takeaway: *"The methodology that enabled this. The CAPTCHAs themselves were just tricky little tests that demonstrate the methodology."* - **Audience engagement prompts**: *"Please, however, do follow me on X. I'd love to chat to you and learn how it is that you're automating the web with AI."* ## Claims vs. Demonstrated Distinction - **Creator claims**: reliability/repeatability of CAPTCHA solutions; authorship and daily use of Chrome Agent; legal compliance of demos. - **Demonstrated in material**: detailed technical methodology, comparative statistics (attributed to external sources), and a structured escalation framework — though demo outcomes are described, not independently verifiable from the transcript alone. # Delivery Observations: Corey Gallon — "The Dark Arts of Web Automation" ## Tone & Register - **Playful, irreverent, confrontational humor** established immediately and sustained throughout: > "That sounds ominous, right? Sounds like something I'm going to teach you that you're going to need a lawyer for." > "the final boss of the internet... Recapture V2" > "this cheeky bastard" - **Self-deprecating asides** defuse tension at technical moments: > "I'm not here shilling a product." ## Recurring Vocabulary & Coinages - **"Meat bag"** — his signature term for humans, repeated at least four times: > "A CDP browser is just like a meatag with a mouse" (apparent transcript rendering of "meat bag") > "you climb the meatag ladder" > "moves like Jagger... just like a meat bag with a mouse" > "how it is that you move like a meat bag" - **Gaming/combat framing** used consistently: "picks a fight," "winning that fight," "the page fighting back," "level one cleared," "final boss," "defeats this whole mess." - **"Rung"** as the unit of escalation: "you climb one rung at a time," "rung one... rung two... rung three" — a stable structural scaffold across the whole talk. ## Teaching Habits & Structure - **Pre-announced roadmap**: "that comes down to three things," then each item introduced as "the second thing," "the third and final thing." - **Plant-and-callback structure**: > "So hold on to speed because that actually comes back at the end." > "we'll come back to the lawyer in a minute... I mentioned that the lawyer would be back." - **Restatement for emphasis**: "No joke. Well, at least as far as Google and Cloudflare and the rest can tell. No joke." - **Concrete numbers to anchor claims**: "83% of the time," "71 round trips and 8 minutes... only seven turns and in under one minute," "75 times cheaper," "57 domains." - **Metaphorical mental models**: "digital senses" ("you see the page... you hear the page"), the solver/operator division framed as "eyes and a brain." ## Interactive / Conversational Patterns - **Direct audience address and rhetorical questions**: > "who's ready to see the agents get busy with the browser?" > "Who wants to see a go?" > "You remember this guy?" - **Anticipating objections**: "Before you in the back knuckle up on this one, there are some specific reasons..." - **Running joke about masked vendor names**: "your favorite online mega store and we'll just call them Demon" → "they're a crafty bunch over there at Amazon" (the reveal slips in despite the pun). - **Self-corrections mid-sentence**, suggesting improvised delivery: > "Oh, sorry, left side. It's inverted." > "the lowest ladder that the lowest rung, sorry, that actually works." ## Isolated Moments (Not Stable Patterns) - **Physical audience engagement**: "I'll pop out there into the uh huddle space" — appears once; no broader pattern observable. - **Calls to action** ("follow me on X") appear only in the closing; insufficient repetition to treat as a habitual pattern. ## Uncertainty Notes - Transcript artifacts ("meatag" for "meat bag," "MT capture," "Recapture," "turn style," "by Lemon," "moves like Jagger") appear to be transcription errors; quoted as-is above. The underlying spoken terms cannot be confirmed from this text alone. - Non-verbal cues are only visible via bracketed notations ("[snorts]" appears three times near ladder/CDP discussion; one "[clears throat and cough]") — too sparse to characterize a delivery pattern. # Position Record: “The Dark Arts of Web Automation” — Corey Gallon (Rexmore) ## Central Premise > “A CDP browser is just like a meatbag with a mouse… at least as far as Google and Cloudflare and the rest can tell.” Gallon's stated thesis: an agent driving a browser via the **Chrome DevTools Protocol (CDP)** produces clicks and keystrokes that travel the same internal path in Chrome as a human's, making them indistinguishable to anti-bot systems. ## Framing and Motivation - Wants agents to "use the web exactly the way that I do" — booking, emailing, form-filling — without human involvement. - Frames the talk as being about "winning that fight" when pages resist automation. - Claims **OpenAI threatened to ban his account** for "cyber abuse" during talk preparation, and later says the ban was rescinded "after a quiet word," restoring his Codex access. ## Claimed Architecture: Three Components ### 1. CLI over MCP - Cites "a recent study by the guys at Arise AI": CLI and MCP achieve ~**83% task success** equally — "capability is a wash." - CLI wins on: - **Reuse**: a CLI sequence runs programmatically without a model in the loop; MCP "hits the model on every single turn." - **Speed**: same study — MCP took 71 round trips / 8 minutes vs. CLI's 7 turns / under 1 minute. - **Cost**: "Anthropic themselves reported" CLI can be up to **75× cheaper** in token cost. ### 2. Chrome DevTools Protocol via his tool, "Chrome Agent" - Same protocol as the F12 DevTools panel. - CDP has **57 domains**, hundreds of methods/events; he buckets them into eight categories. - Only a small subset needed, framed as "digital senses": - **See**: DOM, accessibility tree, screenshots. - **Hear**: network traffic, console, logs. - **Operate**: clicks, keystrokes, navigation. ### 3. "Loop on a Ladder" - Loop: **sense → act → verify**, repeated "until the page gives in." Verify through a *different* channel than the action (e.g., check network/screen after a click, don't "ask the click"). - **"Meatbag ladder"** — climb only as high as the page forces: - **Rung 1**: synthetic JavaScript clicks / page-internal APIs — free, instant, right default. - **Rung 2**: CDP input domain — "trusted" input the page cannot distinguish from a human's. - **Rung 3**: human-like behavior — real mouse paths with dwell and jitter, vision. - Workflow: explore by hand, then **write the solution down** as code and/or agent skill for permanent reuse. ## Demonstrated Cases (claimed, on his own infrastructure/accounts) - **Outlook batch emails**: rung one; synthetic clicks; programmatic loop; agent only personalizes content. Rationale: Office 365 API needs app registration + admin approval employees often can't get; the web UI becomes a "permissionless API." - **"Demazon" (Amazon)**: page drops untrusted JS clicks silently (Chrome's trusted/untrusted event stamping); rung-two CDP input domain click works. - **Cloudflare Turnstile**: checkbox hidden under closed shadow root + cross-origin iframe + second shadow root; solution — locate iframe coordinates, do math, fire trusted click at screen position. - **"MT capture"** (image CAPTCHA): screenshot + agent vision to read characters, typed back with trusted keystrokes into the cross-origin iframe. - **"Lemon"** (drag-puzzle CAPTCHA): samples mouse-movement trails; agent uses human-like drag — easing in, slight curve, deliberate overshoot then correction. - **reCAPTCHA v2 ("final boss")**: two-part system — deterministic **solver** (no model: trusted checkbox click, iframe piercing, screenshots, auto-rearm) plus **operator** agent used only for vision ("eyes and a brain") once per round. Claims repeatable, reliable success. - Key argument: **speed is decisive** — challenges expire on a clock; a model round-tripping on every interaction loses; deterministic code plus one AI look per round is "the only thing I found that defeats this whole mess." ## Stated Takeaway - The CAPTCHAs were "just tricky little tests"; the durable contribution is the **methodology**: CLI + CDP + loop on the ladder, explore once, record the solution. - Attributes success to "careful disciplined engineering" enabling what off-the-shelf agents couldn't do. - Notes Chrome Agent is his own tool ("I'm not here shilling a product"), installable in Python; invites people to build their own. ## Qualifications & Caveats Preserved - All demos run "only on infrastructure that I own and accounts that I operate" — per advice of counsel. - Capability parity between CLI and MCP is conceded before arguing CLI advantages. - The on-screen mouse cursor is "added programmatically" for visualization, not his actual mouse. - He only claims the solver/operator pattern as "the only thing that **I** found" defeats reCAPTCHA — personal experience, not a general claim. - External claims (Arise AI study, Anthropic cost figure, OpenAI ban) are reported by the speaker without independent verification in the transcript. # Speaker Attribution Record ## Video **Title:** *The Dark Arts of Web Automation: Teaching Agents to Use Websites Like Humans — Corey Gallon, Rexmore* ## Speakers ### Primary (and sole) speaker - **Role:** Creator / Presenter / Demonstrator - **Identity:** Corey Gallon (per title), affiliated with **Rexmore** - **Evidence:** First-person talk format throughout; states *"a tool that I wrote called Chrome Agent"* and *"I'm not here shilling a product."* Presents all demonstrations, methodology, and claims personally. ### No other speakers - No guests, narrators, panelists, or audience voices appear in the transcript. ## Referenced Sources & Third-Party Claims | Claim | Attributed to | |---|---| | CLI vs. MCP achieve ~**83% task success**; MCP took 71 round trips / 8 min vs. CLI 7 turns / under 1 min | *"a recent study by the guys at Arise AI"* (as characterized by speaker) | | CLI can be up to **75× cheaper in token cost** | *"Anthropic themselves reported"* (as characterized by speaker) | | OpenAI threatened to ban the speaker's account; later rescinded | Speaker's first-hand account; no documentation shown beyond speaker's description | ## Products & Services Referenced - **Chrome Agent** — speaker's own tool ("installable in the Python ecosystem"); **promotional mention flagged**, though speaker disclaims: *"I'm not here shilling a product."* - **Chrome DevTools Protocol (CDP)** — cited as the browser automation mechanism. - Third-party sites/services discussed as demonstration targets (speaker states all demos run on **infrastructure he owns** and accounts he operates, per legal counsel's advice): Outlook web client, "Demazon" (pseudonym for Amazon), Cloudflare Turnstile, MT captcha, byLemon puzzle captcha, reCAPTCHA v2. ## Promotional Segments - **Closing segment:** speaker invites audience to follow him on X and to use/install Chrome Agent — flagged as **self-promotion**. ## Availability Limits - **No curated metadata supplied** (no comment availability, upload date, channel details, or citation links). - Transcription errors present (e.g., "meatag" likely "meat-bag," "MT capture" likely an audio captcha, "by Lemon" likely a vendor name) — recorded as-is from transcript; identity unverified. - Cited studies (Arise AI, Anthropic) are **not directly linked**; claims rest solely on the speaker's characterization. All right. The dark arts of web automation. That sounds ominous, right? Sounds like something I'm going to teach you that you're going to need a lawyer for. Uh, well, actually, we'll come back to the lawyer in a minute, but a little bit of background. As I was preparing for this talk, OpenAI threatened to ban my account just for the work that I was doing in preparing for the talk. So I checked my inbox a few days ago and got this and that's a real shocker, right? So what does one do to earn the banhammer for cyber abuse with a web browser? this. I was doing this. So, what you see here is every one of these is being solved by an AI agent with no human in the loop. And in 15 minutes or so, you'll understand exactly how this is possible. I want my agents to be able to use the web exactly the way that I do. I want them to book the things, to send the emails, to fill in the forms so that I don't have to. But the moment that something isn't a person starts clicking into a page, web pages often fight back. So this talk is about winning that fight. And it starts with one slightly unconventional idea. And here it is. This is the premise of the whole talk on one slide. A CDP browser is just like a meatag with a mouse. No joke. Well, at least as far as Google and Cloudflare and the rest can tell. No joke. If you have a browser, an agent drive a browser using the Chrome DevTools protocol, \[snorts\] your agents clicks and keystrokes travel the exact same path inside Chrome that yours do. And that's the big idea. The rest of the talk is about how to pull it off. And that comes down to three things to you need a a CLI, not an MCP, the Chrome DevTools protocol, which is where a tool that I wrote called Chrome Agent comes into play, and then a loop run on a ladder. So, let's start with the one that picks a fight. The first thing is to give your agent a CLI and not an MCP server. And by CLI, I mean shell-based tools. Before you in the back knuckle up on this one, there are some specific reasons as to why this is necessary. First of all, it's worth noting that capability is a wash. So, in a recent study by the guys at Arise AI, both a CLI and an MCP given the same task achieve those tasks successfully roughly 83% of the time. However, a CLI beats MCP in reuse, in speed, and in cost. So, let's take reuse first. A CLI sequence can be programmed. You write it once and you run it a thousand times without a model in the loop, whereas MCP hits the model on every single turn. The CLI is faster for a similar reason, because there's not a model in the middle of every step. So in that same study that I mentioned before, MCP took 71 round trips and 8 minutes for the same task that took a CLI only seven turns and in under one minute. So hold on to speed because that actually comes back at the end. Lastly, token cost. Anthropic themselves reported that the CLI can be as much as 75 times cheaper in terms of token cost. So what is it that we're actually running on the command line? We drive the browser in the Chrome DevTools protocol. And that's the second thing that your agent needs to appear human. You already know this protocol even if you don't know its name. That panel that pops up when you hit F12 that drives the browser using exactly this protocol. Your agents can speak it too. They can use the Chrome agent tool. And Chrome Agent also makes it really easy for your agents to write code to replay CDP interactions. \[snorts\] The surface area of CDP is enormous and it changes really frequently. So as of now it's 57 domains and within those there are hundreds and hundreds of methods and events. So I've kind of bucketed all of the domains into eight buckets to make it a little easier to keep it in your head. But no worries, you don't actually need all 57 domains. In order to interact with a browser in the way that a human does, you need a small subset of these. And the best way to think about that small subset is in terms of the digital senses that they give your agent. So you see the page, you may read its structure from the DOM, you may read its semantics from the accessibility tree, or just take a screenshot if you need the pixels. you hear the page. So that may be network traffic to and from uh or the console or logs and then you operate the page with clicks and with keystrokes and with navigation. The third and final thing that you need for your agent to appear human is what I like to call a loop on a ladder. So here's the loop. sense, act, verify, and you repeat that until the page gives in. So in sensing, we perceive the page through one or more channels. The DOM, the accessibility tree, a screenshot as I just mentioned, and then you act, you do one thing. You click something, you type something, you take a you uh select something, and then you verify. And now this is sensing again, but it's sensing through a different channel than the interaction. So, for example, if you've clicked something, don't ask the click if it was successful. Check the network or check the screen. So, you sense where you are. You make one move, you confirm that it landed, and then you iterate again. And when the loop won't close, so you sense, act, verify, and the page still won't do what it is you're trying to do. That's the page fighting back. And so, that's telling you to climb the ladder, the meatag ladder. That is this is a ladder of techniques that are increasingly more human as you climb it. It has three rungs and you climb only as high as the page forces you. Or said differently, you you climb to the lowest ladder that the lowest rung, sorry, that actually works. So \[snorts\] on rung one, you don't act human at all. If you can just use the API that's exposed within the page then and issue a synthetic JavaScript click, then do that. It's easy. It's free. It's instant. And it's the right default. You climb to rung two when faking it stops working. So when you need to use a real click, for example, using the CDP input domain. Now this is agent input that the page cannot tell apart from your own. You climb to rung three when you need human input and human behavior. So this is a real mouse path maybe with a little dwell and some jitter uh or vision to actually see and interpret things. So you start cheap, you climb run one rung rung at a time only when the page makes you climb the ladder loop on each rung and then write down the path that worked. And that's how you arrive at fully automated AI agent-driven browsing. First you explore You run the loop by hand. You climb rungs until you the thing actually works. And then you automate. You write the solution down so you never have to figure it out again. And you write it down as code or as an agent skill or very often as both. So let me show you how this all comes together. But first of all with a word from my attorney. So, I mentioned that the lawyer would be back and everything you're about to see is in fact real agent browser use in the wild. It's taken from real experience. However, upon the advice of council, everything that you're seeing is running only on infrastructure that I own and accounts that I operate right now. So, who's ready to see the agents get busy with the browser? All right. So, here's a simple one, everyday use case we'll start with. Let's send a batch of personalized emails, each one different from your Outlook web client. And we've got some lovely pseudo code on the right side. Oh, sorry, left side. It's inverted. Left side of the uh the slide that makes it really simple for you to see how it all kind of works in code. Outlook's compose box has nothing for us to defeat. So, this is rung one of the meatag ladder. You don't act human at all. A synthetic click opens the compose window. We fill this in programmatically and another synthetic click sends it and then you let that rip. Right? So the reason this is going so smoothly is it's executing a program. So you capture the sequence once and then loop it whether it's 20 emails or 200 and from from just that one command. So you solve it once and reuse it forever. The agent is riffing on content to personalize here as we go, but it's running a program to drive all of the interactions. Now, you may ask, why would we drive the web UI at all? Like, why not just use the API? And in corporate environments, the API for an Office 365 tenant requires an app registration and it also requires admin approval, which as an employee, you can't often get. And so in this pattern or sorry whereas the the web login you have is all you need to be able to do exactly what you see on the screen here now. And so in this pattern the web UI itself kind of becomes a universal API right like a permissionless API which is really neat. So that's rung one but what happens when the page starts fighting back? So, let's say that you're browsing on your favorite online mega store and we'll just call them Demon. So, they're a crafty bunch over there at Amazon and they have no love for your bots at all. Now, if you take that same JavaScript click that just worked in Outlook and you point it at say the add to cart button, you get nothing. Literally nothing. There's there's no failure. There's no error. just nothing happens and the page is ignoring it. And the reason for that is the page is checking was this click from a human source. Chrome stamps every single event with just that answer whether it's trusted or untrusted. So the JavaScript click that we fired previously is stamped untrusted. And in this case, the page just quietly drops that input. But that's no worries. we'll just climb the meatag ladder. So, we move to rung two and we click using Chrome's input domain and that uses the exact same input path that your actual mouse uses. And now it's stamped trusted and the page can't tell the difference between your mouse and our agent and bam, the items drop straight into the cart. So, we've got quite the inside view of demazon.com here. So if you look at this lower panel, you can imagine that this is what the pages logs look like. Every one of the untrusted clicks fails, but the trusted ones go through. No worries. Now, as a heads up going forward, when you see this mouse cursor moving here, that is added programmatically just so that you can visually see the mouse inputs that the agent is giving to the browser using Chrome agent and CDP. It's not actually moving my mouse here. All right, rung two is where the real meatag inputs begin. But that's not enough to replace you in the browser. So we climb to the top of the meatag ladder, rung three. And this is the narrow frontier where pages are actively hunting for bots. There are a variety of techniques that we're going to deploy here though. So let's talk through a few of them. I'm sure this guy looks familiar, right? This is Cloudflare turn style. It looks deceptively simple, but it is the hardest target that we've hit yet. And it's because that little checkbox can't be easily reached through typical web automation programming because these cheeky guys have hidden this thing through isolated boundaries. First, it's encapsulated beneath a closed shadow route. And then the whole widget itself lives in a cross origin iframe which in it then also has another shadow route. So to every cheap trick that that checkbox is uncclickable. There's no element to grab. So what do we do? Well, we just stop trying to grab it, right? We ask the browser where it is that the iframe sits on the screen. We do a little bit of math to figure out where the checkbox is. Then we fire a trusted click right at that position on the glass and then Chrome does the rest for us, right? A real click lands right in the checkbox and we're off and running. There's no human in the loop. This is all agent. So that's level one cleared. And the trick here was really just kind of figuring out how to interact with it. But all the next levels now make you prove that you can actually see. So, this is MT capture. You remember this guy? And these guys are then like it. They're they're still around. Um, your agent's actually got to read this guy. And so, what the agent does is simulate what you would do. It takes a screenshot of the challenge, looks at it, and then uses its own vision capability to pick the characters out of the noise. Then it types the answer back using real trusted keystrokes routed into the widgets cross origin iframe one character at a time and these are the same keyboard inputs that you would send and then the server agrees the text is verified and the token is issued. Now, there's one more level before the final boss, and this one is one or lost based on how it is that you move like a meat bag. So, this is by Lemon. Uh, it's a little jigsaw puzzle where you spot where the piece belongs and then you drag it in to fill the gap. And there's an entire class of captures just like this. Now, this one's Trixie in different ways. There's no shadow route. There's no cross origin iframe. The piece is sitting right there in the page. The hard part here is the drag itself. So when you drop the puzzle piece, these types of captures sample the mouse movement into a trail of points the whole way. And so that includes jitter and changing speeds and all of that. So it's not just solving the puzzle, but it's solving it with moves like Jagger. So the agent drags the exact same way that a hand would drag, right? If you kind of watch him move, it eases in gently. There's like a slight curve. It actually deliberately overshoots the puzzle piece and then eases it right back in \[snorts\] just like a meat bag with a mouse. And it's using vision to identify the gap and then humanlike motion to cross it. So that's turn style, that's MT capture, and that's lemon. Three gates built to keep agents out. And we've just beat each one of them, which leaves only one boss standing. And here he is, the final boss of the internet. Recapture V2. It's that little checkbox and then the blurry grid with like fuzzy pictures of crosswalks or traffic lights in it. We've all squinted at these ones, but we've got the whole kit now on how to beat this guy, too. The digital sensors, the loop to deploy them in, the meatag ladder, everything that you need to take down this cheeky bastard. So let's go. This is the whole machine and it comes in two halves. On one side we have the solver. This is pure code. No agent, no model. It does everything programmatically. It does the trusted click in the checkbox. It pierces into the challenge iframe and then every round it screenshots the grid and if for some reason a round expires, it just rearms itself and goes again. All of that that bit there is deterministic. It's fast and it's free. \[clears throat and cough\] But there's one step in the loop that the code can't do. And that's look at that grid of fuzzy tiles and figure out what it is that's in it. Is this a bus for example? That's vision and thinking. And that needs eyes and a brain. And so that's the only thing that we give the agent as a job. We call that bit the operator. The solver taps the agent on the shoulder and the agent takes one look at the grid, picks the tiles with whatever the thing is that we're looking for in them, hands that answer back to the solver, and then just hangs out waiting until the next lab. And this is really the entire talk running as one system. Code does the deterministic driving and the agent does the only bits that require eyes and a brain. All right. Who wants to see a go? There it is. So, while this is playing, by the way, kind of have a look. Like, some of these are really hard. The the agent was able to spot bicycles in some of these tiles that I didn't see. But ultimately, it's solved. It's verified by the server. And it's fast. And fast is the whole game here because this big bad boss is on a clock. Every round expires and one challenge can be multiple rounds back to back. An agent that roundtrips a model on every click and on every look burns that clock and loses. The challenge expires well before it ever finishes. The only thing that I found that defeats this whole mess is exactly what you're looking at here. deterministic code running at machine speed with one quick AI look per round. So remember when I told you to hold on to speed, this is exactly why. And this is also why this had to be a CLI running the CDP and not a model sitting in the middle of every single interaction. By the way, in case you're wondering, this wasn't a fluke. It's a repeatable, reliable solution now for solving this and and other forms of captures. But here's what I want you to really walk out of here with. The big takeaway is the methodology that enabled this. The captures themselves were just trixy little tests that demonstrate the methodology. This came down to careful disciplined engineering and the engineering enabled the agent to do something that it could not do at all off the shelf. And the method is simple. Give your agent a CLI so that you can program it. drive the whole browser through CDP using its digital sensors. Run it as a loop on the meatag ladder and climb only as high as the page forces you to and then explore until you solve it and write the solution down. That's what makes this durable and useful. You figure it out once and you do it forever. Which brings us all the way back to the good folks at OpenAI. After a quiet word, they kindly rescended the thread. So, I've still got access to codeex, which is nice. So, you too can use Chrome Agent. It's installable in the Python ecosystem. That's the tool that I wrote that I do all of this with and I use it all day every day or frankly build your own, right? Like I'm not here shilling a product. Uh we live in the age of unbounded personalized software. Please, however, do follow me on X. I'd love to chat to you and learn how it is that you're automating the web with AI. And if you'd like to chat more about it, I'll pop out there into the uh huddle space and we can have a chat now. But happy hacking.