Skip to content

Version-Controlled Search: The Web as It Was — Ryan Ahern,…

Ryan Ahern of Exa introduces Exa Snapshot, a capability for searching the web as it appeared on a past date. Topics include why search quality matters when agents perform most searches, how snapshot results compare to live results, and how teams use point-in-time search to build and test predictive signals while avoiding overfitting. # Video Identity Observations ## Source Overview - **Video:** *"Version-Controlled Search: The Web as It Was — Ryan Ahern, Exa"* - **Format:** Conference talk by a named Exa employee, identified as: *"So I'm Ryan, I'm a forward deployed engineer here at Exa."* ## Intended Audience The material addresses **technical builders of AI agents and financial ML practitioners**, demonstrated by: - **AI engineering conference context:** *"because this is AI engineer, like here are a few like kind of archetypes that we work across the financial space"* — indicating an AI-engineer audience being pitched financial use cases. - **Developer/agent-builder framing:** *"Okay, I'm building agents or I'm interested in agents and I definitely need a generative web search"* — the speaker voices the assumed audience's position. - **Quantitative finance practitioners:** *"I work with a lot of hedge funds, asset managers, sovereign wealth funds, VCs"* and detailed discussion of **backtesting, overfitting, holdout sets, risk models, and valuation** (e.g., the OpenAI revenue-run-rate example). - **Assumed baseline familiarity:** audience polling — *"who here has heard of Exa before or used it? Okay, I've got a good show of hands"* — suggests a pre-aware, industry-insider crowd. ## Claimed Scope **Creator claims about Exa (product/positioning):** - **Full-stack agentic web search:** *"we have our own crawling infrastructure, our own database, our own embedding model, our own retrieval architecture."* - **Three stated pillars:** *"quality"* (via a new benchmark), *"cost"* (dynamic highlights yielding *"95% fewer tokens"*), and *"latency"* (own infrastructure; plus *ExaAgent Ultra* for deep research). - **Version-controlled search as the core product claim:** *ExaSnapshot* — *"400 billion plus snapshots of the web... you can search them by date"* — with two access modes: URL-at-a-date and *"version search"* ("what would happen if I had executed that search but at a prior point"). - **Primary claimed use case:** historical web-state backtesting of financial/agent models — *"you can now go back... before the market and before some financial analyst published the think piece... what information existed on the internet."* **Customer segments claimed:** AI product companies (Cursor, Gamma cited as examples), financial services (hedge funds, insurers, VCs), and prediction-focused startups. ## Demonstrated (Non-Claim) Presentation Patterns - **Workshop/lab-style delivery:** hand-raising polls, live example slides, and reference to a prior workshop (*"around about 100 people in the room"*) show an applied, practitioner-oriented presentation style. - **Educational structure:** the talk deliberately sequences *"motivate what is Exa"* before the versioning feature, indicating a persuasive, top-of-funnel presentation pattern. - **Caveat evidence:** the speaker flags overfitting risk in a workshop example — *"the last bit that's interesting is like, 'Hey, is the company named Dominion?' Now this is a little bit of overfitting"* — demonstrating technical honesty as part of the channel's presentation. ## Summary This video presents Exa as a **developer-facing agentic search provider** addressing **AI engineers and financial modelers**, with a claimed differentiator of **date-versioned web search enabling leakage-free backtesting** of web-dependent models. # Delivery Observation — "Version-Controlled Search: The Web as It Was" (Ryan Ahern, Exa) ## Overall Communication Style The delivery is **conversational and informal**, built around a two-part structure the speaker states up front: > "I'm going to give you an overview of two things... the first one, I just want to motivate what is Exa... the second thing I'm going to talk about, which is how to backtest financial models using that." He explicitly frames this as necessary because of time pressure: "We only have a very short amount of time." ## Recurring Linguistic Patterns ### "So, like..." as a discourse marker The most frequent pattern is the filler pair **"so" + "like"**, opening most sentences: - "So, like a couple of the logos of like the bigger companies..." - "So, uh when you're working with um like many many agentic systems." - "So, that's like the sort of basic space." - "So, the first one is like I'm operating like a very traditional model." ### Second-person scenario framing He consistently puts the audience inside hypotheticals using **"you're like" / "you're going to be"**: - "If you're a hedge funder, you're going to be trading on information." - "Or even if you're in VC, you're like, 'I need the hottest startup.'" - "You're like, 'Hey, it'd be great if I had just this like SEC data from like Apple in like 2018.'" ### Quoted inner monologue A teaching habit of **voicing hypothetical user/agent thoughts in quotation marks**: - "Hey, I don't even really use desktop search anymore. I kind of ask an agent to do this." - "Okay, before everyone figured it out... what information existed on the internet?" - "Hey, I want to make sure that I can control that feature so I know that future information is not just going to leak directly into my model." ## Teaching Habits ### Room-checking with escalation He opens with a **three-question live poll**, moving from specific to universal with light humor: > "Who here has ever used like Google back in the day... Hopefully like everyone in the room, most people had pretty good market share, you might have heard of it." ### Numbered triads He repeatedly organizes content into **sets of three**: - "There's three like core tenants" — "quality, cost, latency." - "There's like three kind of archetypes here" — traditional model, agentic feature, full agentic prediction. - Two access modes: "One is like, 'I know the URL I want...'" and "The second one, which is even more exciting..." ### Explicit signposting and recaps - "Um and then the the kind of to wrap up the last part on like why Exa..." - "So, that's just like sort of like the status quo plus one." - "Um, then I'm just going to kind of like recap." ### Concrete numeric anchors He grounds claims with **specific figures**: "400 billion plus snapshots of the web," "95% fewer tokens than you would at full page text," "around about 100 people in the room." ### Worked example as centerpiece The **OpenAI run-rate example** ($70B → $50B revised reporting) is used to demonstrate the "so what": > "But the so what for version search is like, 'Let's say you're in the interest of creating a product... what information existed on the internet, right?'" He also uses the overfitting example ("is the company named Dominion?") with self-aware framing: "Now this is a little bit of overfitting for people that know like backtesting." ## Stylistic Markers - **Hedged enthusiasm**: "that's really really interesting," "which is even more exciting," "very very hard to do," "very very low latency." - **Marketing hooks**: "We have a blog about this, it's very interesting," "highly recommend you check those things out." - **Frequent verbal tics**: heavy use of "um," "uh," and doubled words ("the the," "that that," "to to"), consistent throughout. ## Stable Patterns vs. Isolated Moments - **Stable**: "like" as hedge, second-person scenarios, quoted hypotheticals, triadic structure, signposting, numeric anchors — all recur across the full talk. - **Appears once (uncertain as pattern)**: the humor ("you might have heard of it" re: Google) and the self-deprecating overfitting remark appear only once each; whether this reflects a broader humorous register is not determinable from this single talk. - The **transition device** ("this is just a segway to be like...") appears twice, suggesting it is a deliberate bridging habit rather than a one-off. # Observation Record: "Version-Controlled Search: The Web as It Was" — Ryan Ahern, Exa ## Speaker Identification - **Ryan Ahern** — self-identified as a "forward deployed engineer here at Exa." Delivered the full talk; no other speakers are distinguishable in the transcript. --- ## Part 1: Motivation — Agentic Web Search and Exa ### Claim: Search behavior is shifting from humans to agents Ahern polled the audience, suggesting a market trend: - Many attendees reportedly no longer use Google directly, instead using **ChatGPT, Claude**, or (as he phrased it) "Instinct or Muse if you're like at the cutting edge." - His stated reasoning for agents as search brokers: - Agents can **retry multiple times** without tiring and "tend to be quite agreeable and work very, very hard." - Agents **search differently from humans**: humans use a few keywords and give up quickly; agents are "very verbose," describe targets in detail, and "execute many searches in order to understand the space more fully." ### Claim: Exa's role in agentic systems - Exa provides search infrastructure used by agentic products (he cited **Cursor** for documentation search and **Gamma** for retrieving e.g. Apple SEC data), operating "our own crawling infrastructure, our own database, our own embedding model, our own retrieval architecture." - Financial services customers (hedge funds, asset managers, sovereign wealth funds, VCs) use Exa because they "need the latest information": - **Hedge funds**: trading on information, seeking alpha. - **Insurers**: counterparty diligence for risk models. - **VCs**: finding startups before they are visible in structured datasets. ### Claim: Exa's three stated differentiators 1. **Quality** — fewer tool calls mean better cost-effectiveness and more likely task success. Exa "recently released like a new benchmark" intended to assess search tools separately from inference models, since the two "can be confounded." 2. **Cost** — evaluated at the total-agent-task level, not per tool call. He cited **dynamic highlights**: extracting the right snippets across all search results rather than returning full pages, claimed to deliver "higher quality results at **95% fewer tokens** than you would at full page text." (Presented as a product claim; a blog is referenced but not verifiable from the transcript.) 3. **Latency** — very low latency search due to owned infrastructure; at the other extreme, **ExaAgent Ultra** ("released... maybe a few weeks ago"), which he described as "state-of-the-art on... very very long-running search" benchmarks. *(Benchmark superiority is his claim, not independently substantiated in the talk.)* --- ## Part 2: ExaSnapshot and Version-Controlled Search ### Product description - **ExaSnapshot**: "400 billion plus snapshots of the web," searchable by date. - Mechanism as described: Exa continuously crawls and checks URLs for freshness; as a byproduct it captures a version of each URL at check time, creating a version history. - Two access modes stated: 1. **Snapshot retrieval**: request a known URL as it was **at or before** a given date. 2. **Version search**: execute a query as if at a prior date, returning "only results that would have been served at that point or before." ### Worked example: OpenAI revenue reporting - As of ~October 1, Ahern said, some discussion put OpenAI's annualized run rate "around like the 70 billion" (reporting he attributed to **Axios**). - Later publications, he said, reported figures "closer to 50 billion" for accounting reasons: gross revenue included amounts coming from cloud providers that should be treated as a **vendor pass-through**, making **net** annualized revenue the better figure. - **His "so what"**: an agent designed to detect such discrepancies can be tested against the historical web — *before* "the market and before some financial analyst published the think piece" — asking whether an SEC filing footnote or less-reputable-but-accurate reporting existed. The agent's approach can then be adjusted and validated on sample sets with a holdout. > "That's something that's kind of new in this in the in the web search space and that you can backtest that." ### Acquisition-prediction illustration - Live search for a company's acquisition status will surface the announcement (lookahead/leakage). Snapshot search at 1 day, 7 days, 1 month before announcement enables testing whether a system could have predicted the outcome. --- ## Part 3: Three Backtesting Archetypes (as presented) 1. **Traditional model + unstructured data enrichment** ("status quo plus one"): gathering software prices, sentiment, or terms-and-conditions from the versioned web into structured signal arrays for existing ML or even decision-tree models. He noted such data "is not continually available" in versioned form from the sites themselves. 2. **Adding agentic features to existing models**: e.g., an **adverse media scan** or **equity research** tool called at prediction time; these features can be backtested via snapshot ("what would I have said at the point where they were going to enter my portfolio?"). His framing: customers "don't now just have to believe that search will be better. You can actually go back and back test that against your existing processes." 3. **Fully agentic prediction** (his characterization of "the future"): an agent manages the whole simulation, tool-calling the web among other sources. Version search allows controlling information leakage so a "future information" leak cannot let a single search return the acquisition announcement and "predict it with like 100% accuracy." --- ## Part 4: Workshop Example and Overfitting - He reported a workshop (~100 attendees, the prior day) using the acquisition-prediction example. High-scoring features included: - Within the past year, an investor or significant shareholder publicly called for/supported a sale of the company. - The share price was at least 60% below its 5-year high. - **"Is the company named Dominion?"** — which Ahern himself flagged: "this is a little bit of **overfitting** for people that know backtesting." - His argument: snapshot search enables detecting such overfitting via evals and generalization checks, whereas live-only testing "might... [mean] waiting for months" to learn whether features are predictive. - He emphasized that **semantic search** allows arbitrarily complex feature descriptions (his colorful example: adverse media about VPs at funds that appeared on the AI Engineer podcast), which can then be backtested for actual predictive value. --- ## Recap (as stated by speaker) 1. Use Exa for "quality cost-effective... web search across every latency." 2. Use **Exa Snapshot** to backtest financial/risk/prediction models with web-search features and verify they add value. --- ## Qualifications and Tensions Preserved - All performance claims (95% token reduction, ExaAgent Ultra state-of-the-art, benchmark quality) are the speaker's product claims, presented with references to blogs/benchmarks not shown in the transcript. - The speaker explicitly acknowledged the overfitting risk in his own example (the "Dominion" feature), rather than presenting workshop results as unambiguously strong. - The OpenAI revenue figures (~$70B gross vs. ~$50B net annualized run rate) are relayed as reported-by-others information; the speaker did not assert them as verified fact. - The claim that market search behavior has shifted to agents is supported in-talk only by audience hand-raising, not by external data. # Speaker & Provenance Record ## Video Metadata - **Title:** Version-Controlled Search: The Web as It Was — Ryan Ahern, Exa - **Video ID:** `01a15ca6-66d3-79f6-b1a1-991c8c6a8dad` ## Identified Speakers ### Ryan Ahern - **Role:** Presenter; self-identified as a **forward deployed engineer at Exa** - **Speaking context:** Conference talk (references "AI engineer" — likely the AI Engineer conference), giving an introduction to Exa's version-controlled search feature - **Scope:** Single continuous speaker throughout the entire transcript; no guests, narrators, or other speakers appear. ## Provenance Facts — Referenced Sources & Claims ### Third-party claims made by the speaker (unverified within the video) - **OpenAI revenue reporting (early October):** Claimed discussions of a ~$70B annualized run rate; original reporting attributed to **Axios**. Later publications reportedly put it closer to $50B due to gross-vs-net revenue accounting (cloud provider revenue as vendor pass-through). - **Company customers:** Speaker name-drops **Cursor** and **Gamma** as agentic systems using Exa; mentions "a couple of the logos" of bigger companies (logos not itemized in transcript). - **Workshop reference:** An extended workshop on Snapshot held "yesterday" with ~100 attendees, covering a company-acquisition prediction example. ### Company products referenced - **Exa** — agentic web search; own crawling infrastructure, database, embedding model, retrieval architecture - **ExaSnapshot** — "400 billion plus snapshots of the web," searchable by date; supports URL-snapshot lookup and version search - **ExaAgent Ultra** — released "a few weeks ago" per speaker; claimed "state-of-the-art" on long-running search benchmarks (benchmark names not specified) - **Dynamic highlights** — claimed 95% fewer tokens vs. full page text; speaker references an associated Exa blog (not cited by title/URL) ## Promotional Content — FLAGGED > The entire talk functions as a **product promotion** for Exa and its new ExaSnapshot feature. - Explicit promotional elements include: - Direct encouragement to try Exa ("encourage you if you've not tried Exa... to have a go") - References to Exa **blogs** and a new **benchmark** as marketing materials ("highly recommend you check those things out") - Product claims of quality/cost/latency advantages presented without independent verification ## Availability Limits - No mention of paywalls, comment availability, or access restrictions for the video itself. - Benchmark results, blogs, and workshop materials are referenced but **not linked or titled** in the transcript. ## Self-Check Summary - ✅ Single speaker role (Ryan Ahern, forward deployed engineer, Exa) is explicit in transcript - ✅ Axios attribution and product claims recorded as speaker claims, not verified facts - ✅ Promotional framing flagged - ✅ No quality judgments entered \>\> Welcome everyone. Looking forward to giving you all a introduction into one of our newest features in Exa, which is version controlled search. So I'm Ryan, I'm a forward deployed engineer here at Exa. And today I'm going to give you an overview of two things. We only have a very short amount of time. So the first one, I just want to motivate what is Exa, what is agentic web search? Just because you kind of need to believe in the dream of that to understand why you'd want to use it to do the second thing I'm going to talk about, which is how to backtest financial models using that. So first, just to understand where I'm at in the room, who here has heard of Exa before or used it? Okay, I've got a good show of hands. Who here has ever used like Google back in the day to like do some sort of work or personal use, just like typed into Google to do some sort of search? Hopefully like everyone in the room, most people had pretty good market share, you might have heard of it. Last one would be, how many of you now no longer really use Google? You use ChatGPT or Claude or maybe even Instinct or Muse if you're like at the cutting edge to actually do your searches. Yeah, most people, right? So we're going to connect all of these things together. This last point where a lot of people now are like, "Hey, I don't even really use desktop search anymore. I kind of ask an agent to do this." is something that we see more broadly in the market, right? And the idea is that like agents tend to do a pretty good job at understanding how to search because they're allowed to try multiple, multiple times. They kind of don't get tired. They tend to be quite agreeable and work very, very hard. So when you say like this is the thing that I want, it's going to go out and it's going to do many, many different searches in order to satisfy like your objective. And the other thing here is that like they tend to search different to humans. So as a human, you might put in like a few keywords for the thing and then hope that you get the best results like in the first couple, and otherwise like maybe you try like a different query and then you'll kind of give up. Whereas agents will be very verbose. Um they they tend to describe what they want to search in great detail and will execute many searches in order to understand the space more fully before they respond. Um and that means that they do way more searches um on on a per task basis. So, generally the idea is that like, "Hey, nowadays most humans, you're going to be using agents to kind of broker your search tasks." Um and that's where Exa kind of plugs in. So, uh when you're working with um like many many agentic systems. So, whenever Cursor wants to go and search latest documentation to help its coding agent complete its trajectory, whenever you're like talking to Gamma and you're like, "Hey, it'd be great if I had just this like SEC data from like Apple in like 2018 to complete my slide, like that would make it brilliant." It's going to use Exa to go out, search the full web, so we have our own crawling infrastructure, our own database, our own embedding model, our own retrieval architecture to get exactly what it needs to answer its query. Um this is like a couple of the logos of like the bigger companies, but because this is AI engineer, like here are a few like kind of archetypes that we work across the financial space. I work with a lot of hedge funds, asset managers, sovereign wealth funds, VCs across like a bunch of different tasks because they also need like the latest information. So, if you're a hedge funder, you're going to be trading on information. You're looking in the market for alpha, right? And for information that allows you to understand how you could position your your organization better. If you're a um uh an insurer, you're probably understanding like what counterparties you're working with or who you're insuring to make sure that ultimately you're making the determination. So, you want to make sure you're making it on the best information and that your risk models are the most accurate. Or even if you're in VC, you're like, "I need the hottest startup. I need to know the in next instant before they blow up." And they're not necessarily going to be in like some structured data set. Like I need to go and find them wherever they exist in the web. Um that's what they come to Exa to kind of support them for. Um and then the the kind of to wrap up the last part on like why Exa and the reason why I think now you'd be like, "Okay, I'm I'm building agents or I'm interested in agents and I definitely need a generative web search. Why Exa?" Um and it's because like we're a lab um in the sense that we're very very interested in the search market um and in the ways in which agents search and we're hyper focused on that problem. There's three like core tenants and then we'll talk about how that goes into versioning to segue into the next part of the talk. But first and quite obviously is like quality, right? So, you want to make sure that when the agent does that um the tool call and the retrieval, it gets what it needs cuz the fewer tool calls that it needs to make, the more cost-effective on your inference and also just like the more likely it is to succeed on its overall trajectory. You're not going to bring in something that like misaligns it. Um uh we're really really interested in the quality space. We uh recently released like a new benchmark um which we think more accurately assesses the um the the performance of like the search tools separately to the inference because these two things can be confounded, right? Like what agent or what model is calling the search and what search is connected to what model. So, that you can kind of have a look at that to see our latest thinking there. Secondly, on cost. So, it's not just the line item of the tool call, right? Like how much does one search cost because agents can broker many different searches. Um so, the idea is both like, "Hey, what's the value to this to complete your trajectory?" But also like what's the impact of this on the total cost of that agent completing its task cuz that's actually the thing that you care about, right? You're generally less opinionated about one tool call. It's like, "How much did this overall agent take?" Uh and that's why like we're we we worked on things like say dynamic highlights, which means that for every single result, we're not we're not just returning full pages. Uh we're not even just taking one page, which is our previous highlight features, and figuring out what are the exact right snippets on that page that we need to send back to the context window to complete the trajectory. We now do that across all of the search results, which means that you can actually get higher quality results at 95% fewer tokens than you would at full page text. We have a blog about this, it's very interesting, but basically it means you'll save a lot of money downstream on all of the input tokens you'll be spending on inference for the agent to complete its trajectory. Last one on latency, so because we own our own infrastructure, we can do very very low latency search. Um I'm just going to touch on the other side of the spectrum, which is like very long-running deep research. So we have ExaAgent Ultra, which we released um like not too long ago, maybe a few weeks ago, which is like state-of-the-art on um a lot of benchmarks around like very very long-running um search. And that's because we can do a lot of things under the hood. We have obviously we own the search harness, but we can also be opinionated about that how that interacts with the agent to harness do these like very very long-running research task. So highly recommend you check those things out. Um this is just a segway to be like, "Okay, Exa really cares about this space. I think that their search is going to be good." To motivate the next part, which is really interesting is the topic of this talk, which is versioning. So just recently we released ExaSnapshot. Uh it's 400 billion plus snapshots of the web, um and you can search them by date. Um and that's really really interesting in the um in the financial services industry. We'll get into that, but first I'm just going to talk a little bit about like what this basically means. So uh we're we're a search company, so we're constantly uh searching across the web for the latest information that we can add to our index. Um and every single time we do it, we check it for we're checking for freshness. Because ultimately you want to have the latest live up-to-date information at the point at which you're searching. But because we're doing all of those checks, it means that we can capture a version of those URLs at the point where we checked it and have like a version history. Um and you can access that in two ways. One is like, "I know the URL I want to find as it was at or before a given date." And so you can give us a URL and you say, "This is the date that I want it. I want it at that date or before and serve it to me as you would have if I had requested it at that point." The second one, which is even more exciting, is this concept of version search. So, where a search API, and the idea is like, "Hey, what would happen if I had executed that search but at a prior point, right?" So, I only get results that would have been served at that point or before. Um that has very like interesting implications. I'm just going to do one like very small example here. So, OpenAI recently I say as of like October 1st. So, on the left-hand side here, you'll see a snapshot search as it was in October 1st. And on the right-hand side was a live search as of like a couple of days ago when I made this slide. Um but uh at that time in early October, like there was some discussions that like OpenAI had a like annualized like run rate around like the 70 billion, right? Um and that was leading to certain ways in which the market was projecting how and where they would be valued. And then more recently, there was some and that reporting was originally by Axios. And then more recently, there were some publications that were reporting like, "Actually, it's closer to 50 billion for fun accounting reasons, right?" Like it turns out that they were counting gross revenue when actually like some of their revenue was coming from cloud providers. And technically, the way that you should account for that would be that there would be a vendor pass-through. So, net annualized revenue is better. That's how what some what some other players were reporting, etc., etc., right? But basically, it meant that the the the net annualized run rate was like kind of down forecast from 70 billion down to 50 billion, right? Now, this is just like a financial thing that some of you may or may not find interesting. But the so what for version search is like, "Let's say you're in the interest of creating a product or a solution or an agent that is made to that that will that its job is to to find these things, right?" You can now go back and be like, "Okay, before everyone figured it out, right? Before the market and before some financial analyst published the think piece that was like slamming down on this particular thing and everyone knew about it, what information existed on the internet, right? Like was there an SEC filing that would have revealed this thing in an accounting footnote? Like was there some other reporting from some other vendor that maybe is like you would consider is like less reputable, but actually was able to find that kind of thing and and maybe you should consider them differently." Um you can you can potentially like trace these things before like the rest of the market found it. But most importantly, like not only can you test out that you can backtest that, right? You could then adjust the ways in which you're setting up your model, you can adjust the ways that you're setting up your agent to be able to be like, "Could it have found this discrepancy?" Uh and more importantly, could it have found that discrepancy in a way that is generalizable, right? Let's like create a set of like like 50 sample sets, see if it can perform against that, check it against the holdout and be like, "Okay, I think that my model is now going to be pretty good at finding this kind of feature." And that's something that's kind of new in this in the in the web search space and that you can backtest that. Um this is like a like a little diagram just to kind of motivate the idea, but at any like live search that you do with like any existing search product, the idea is it's live, so it has all of the information. So, in this particular little example, um we're we're trying to predict whether company got acquired or not. Um in this case, if you do a live search, you're going to find like that the deal was announced, right? Because that happened, it got released everywhere. You could um be like, "Hey, I'm trying to train a model that's able to predict whether this company got acquired or not." So, I'm going to go like 1 day before the announcement, 7 days before the announcement, a month before the announcement and see whether I could or could not predict it, right? Uh and you can build a set of those companies um and basically train your model um or whatever system it is that it's trying to do this prediction, and see like was it able to reliably like predict this particular feature. Um So, I'm going to spend a little bit of time here just talking about how different systems are currently being back-tested with Snapshot. So, there's like three kind of archetypes here. The first one is I'm operating like a very traditional model. Maybe it's ML, maybe it's even more simple than that, like a decision tree or something. Uh and all I want to do is just gather unstructured data from the version web into some sort of structured set of information. So, it could be something like software prices, it could be some sentiment analysis, it could be like the terms and conditions of a particular site. Whatever it is that like powers your model, not all information is continually available. Like if you're trying to understand software prices, like, you know, the the page of that software price is not necessarily stored in a versioned um a way for that website in a way that you could reliably access. Or potentially like you have some like, sentiment analysis that you want to do, but like that's going to be mired in like what point was that sentiment released in time, right? And you want to be able to get like a reliable set of those signals. And then you can just transform it into some array of signals that goes into your model and you can predict it. That's like the sort of basic space. And some people are just like enriching data that they wouldn't have had access to for their existing models. So, that's just like sort of like the status quo plus one. The interesting space is in like the next two areas. So, the first one is this idea of like adding an agentic feature. And the And And here is like, okay, well, I have this existing model. It performs pretty well, but I have an idea that like if I add one or two like agentic features to this model, it would be able to perform better. So, let's say something like an adverse media scan. Necessarily like adverse media is going out into the web, searching across it for all of the information that exists, potentially doing it in an agentic way, right? Where you're doing multiple searches, you're exhausting multiple different trajectories, and then you're going to take all of that and then condense it into some sort of structure. Um Uh another example here would be to say like equity research in much the same way. Like, "Hey, I want to go out. I want to look at the full universe of companies and I want to find like potentially all of their like like estimated uh like rack revenue or head count or all of the features that matter." Um and the idea is that you'd be using something like adverse search at the point at which you're doing a prediction life to go out and gather all of that information to then send into your um traditional model. And you can now use like adverse snapshot to back test those particular features. So, you can go back and be like, "Hey, if I was to do this like adverse media scan like 1 month before." Or maybe I've already like onboarded a bunch of people into my portfolio like 4 months ago, what would I have said at the point where they were going to enter my portfolio? And would how is that tracked against today? Um and that kind of motivates like especially with a lot of financial services customers like you don't now just have to believe that like search will be better. You can actually go back and back test that against your existing processes and say, "Hey, it's better." Um so, that's like the maybe the next evolution like one step plus plus. Um on the far right-hand side here um is kind of like maybe the future. So, there's some like startups that are working in this prediction space. And the idea here is that the full sort of like simulation or prediction is being managed by an agent. So, in the middle is like an ML model that's maybe doing a prediction or some algorithm or decision tree. On the right-hand side like it is like an agent that's just going off and doing a bunch of things. It could be searching internal knowledge, it could be accessing data feeds, it could be doing whatever it is. But one of the things that it may do that that is to tool call uh and access the web. And the idea is like now you don't have to try and create some internal corpus that tries to represent what it would be like to access the full web. You can just be like, "Hey, I want to make sure that I can control that feature so I know that future information is not just going to leak directly into my model." Like I'm trying to predict company acquisitions through some very very insane like agentic process that's accessing everything. You can now be like, "All right, let's just make sure that's not just going to have one web search that finds that it was acquired, comes back and predicts it with like 100% accuracy. Um so that's kind of the the sort of right-hand side there. Um I'm just going to give like a little example of like the middle um just to round off um this this this kind of discussion. Um so uh yesterday we ran like um a kind of extended workshop on snapshot uh and we had a bunch of around about 100 people in the room that were kind of uh running through this the same example we had before about trying to predict company acquisitions. Um one thing that was kind of interesting is that um the this was like some like one of the example features from the workshop from one of the people um that uh that that got a relatively high score. But a thing that was interesting here is like um the just to just to motivate so the first one was this idea that like, "Hey, within the past year did an investor or a significant shareholder publicly call for a supported sale of the company as a whole?" And the second one, which is the interesting one, is like, "Hey, did this company's share price um was at least 60% lower than high share price during the past 5 years?" Which the idea is like it's kind of dipped down. Um the last bit that's interesting is like, "Hey, is the company named Dominion?" Now this is a little bit of overfitting for people that know like backtesting. Um like and the idea here is like this could be something that like an agent could do, right? If it's trained on like a live set, um it can potentially just overfit to the training data that you have. But the idea with snapshot is like not only can you go back and test for these things, um you can go back and like set up your your your e-vals and your identic harness in such a way that you can detect these things, but you can also try and check that it generalizes. And this is something that would be very, very hard to do if you are gated by like testing live, like in production. And you can only change the ways in which these features are described over time and check against real time, right? you might be waiting for months to try and see how and why your identic setup um, actually is predictive or is overfitting in different ways. Um, that is like you can describe these like quite complex features like um, these ones are like maybe you could imagine trying to recreate in um, uh, in like some sort of like uh, like non-semantic search, but you can go as crazy as you want within the within existing like uh, like extra semantic search world. So, you can say things like, "Hey, I want to see if there was any adverse media against like reputable VPs that are operating like um, uh, that are operating within VC funds that have like been on the AI Engineer podcast and they've said something bad about it, right? Like you can go as as hard as you want on these features that you think are going to be predictive cuz that's what core extra search allows, but then you can back test it, right? and see if it's performative or not. Um, then I'm just going to kind of like recap. So, the first thing that we talked about here is like um, using Exa because it's quality cost-effective identic web search across every latency. Um, we have lots of blogs around this, so encourage you if you've not tried Exa um, to have a go at this um, because the first thing you want to know is like, "Hey, do I actually think that this is going to add some benefit to my model?" The second thing as we talked about is like, "Hey, using Exa snapshot to be able to like back test these financial models or whichever model of risk risk model prediction model with these web search features in order to see like, hey, does adding it uh, add value to to you and your identic processes?" Thank you so much.