Building GTM AI Agents: Lessons from Deploying to 6,000…
Talk by Sait Izmit of Snowflake on lessons learned from building and deploying a go-to-market AI agent that has served roughly 6,000 users and answered over a million questions (about 40,000 per week) since launching. Key points: evaluating agents with real questions from the sales process (150 written before build, first run scored 50%) and prioritizing quality over coverage (50 questions at 95% accuracy over 100 at 70%); the agent's data landscape (about 60% added post-launch, spanning 15 semantic views, 85 tables, 3,000 columns, with MCP connections and around 20 skills); a phased rollout (pilot, 10% beta with a 70% retention bar, then general availability); the finding that these projects fail at activation and change management rather than technology; the diminishing novelty of "talk to your data"; and guidance to plan for rearchitecting rather than searching for the perfect architecture.
# Channel Identity Observations — Video: "Building GTM AI Agents: Lessons from Deploying to 6,000 Users — Sait Izmit, Snowflake"
## Speaker Role & Explicit Self-Description
- **Speaker identity within an organization**: Sait Izmit states, *"I'm responsible for our internal AI tools for our sales team"* — positioning himself as an internal AI tooling leader at Snowflake, not an independent creator.
- **Customer-zero framing**: *"We are the customer zero for a lot of Snowflake products"* and *"this is built on Snowflake co-work."* The talk presents internal deployment as validation of the company's own platform.
- **Regular customer engagement**: *"I meet a lot of customers every week... Fortune 500 companies"* — claims a practitioner-plus-advisor position sharing lessons with enterprises.
## Intended Audience
- **Technical/engineering conference audience**: The speaker notes, *"I'm told that I need to have some code in my presentation. I don't, but I will try to show you at least some architectural diagrams just to make it more interesting for the engineering audience."*
- Also explicitly addresses **builders of AI products in enterprises**: *"A lot of engineers doesn't think about this... make sure that you have a plan for that, especially in larger organizations where we are dealing with like 6,000 go-to-market users."*
## Claimed Scope of Content
- **Deployment lessons, not product demos**: Topics explicitly covered:
- **Quality over coverage**: *"We don't want to try to answer 100 questions and get them 70% right. We want to answer 50 questions, but get them 95% right."*
- **Phased launch**: Pilot → 10% beta (600 people) → GA, with retention metrics (*"more than 70% retention rate"*).
- **Change management / activation**: *"I will spend 60–70% of my time in sales meetings, giving demos."*
- **Continuous iteration** ("collapsing of the wow factor") and **log-driven feedback loops**.
## Observable Presentation Patterns (Demonstrated, Not Claimed)
- **Vendor-adjacent content**: The talk repeatedly ties lessons back to Snowflake products (Cortex Analyst, Cortex Search, Snowflake Co-work — *"we renamed that [Snowflake Intelligence] to Snowflake Co-work a couple of weeks ago at our summit"*).
- **Metrics-heavy credibility style**: Uses concrete figures throughout — *"answered more than 1 million questions," "40,000 questions a week," "15 semantic views, 85 tables, 3,000 columns," "6,000 people."*
- **Cross-promotion to other channel content**: *"We constantly publish like blog posts... how we do agent instructions, how we do our structured data with semantic views... feel free to check those"* — demonstrates an ecosystem of supplementary written content.
- **Practitioner-war-story narrative style**: Anecdotes such as writing 150 test questions in a spreadsheet and managing agent instructions *"out of a Google Doc"* at launch.
## Claims vs. Demonstration — Distinction Summary
| Type | Evidence |
|---|---|
| **Creator/channel claim** | "Customer zero" status; team maxim "quality is P minus one"; blog posts sharing learnings |
| **Demonstrated pattern** | Evangelistic framing of internal success as replicable for customers; strong quantitative emphasis; Snowflake platform integration throughout, including in Q&A |
## Notes for Channel-Level Synthesis
- Identity is **corporate practitioner / conference speaker**, not an independent educator; content serves dual purposes of lesson-sharing and platform showcasing.
- No private motivations were stated; all observations above trace to quoted transcript passages.
# Delivery Observations: Sait Izmit, Snowflake
## Tone & Register
- **Conversational, informal delivery** throughout, with heavy use of filler words: "like," "you know," "basically," "um," "and so on."
> "So, I think I'm one of the last speakers that is standing between you and the long weekend."
- **Self-deprecating humor and audience awareness** in the opener, acknowledging talk fatigue near a long weekend.
- **Direct, emphatic address** — frequent rhetorical questions answered immediately:
> "What do they struggle with? ... What does AI offer for them?"
## Recurring Verbal Habits
- **"Right?" as a constant check-in/tag** — appears dozens of times: "everyone's data is siloed," "quality is P minus one. Right?" "It frees up your time, right?"
- **"And so on" as a list terminator** — used repeatedly when enumerating features or examples.
- **"Like" as a discourse marker** throughout, e.g., "we launched our internal go-to-market assistant uh in September last year."
- **Intensifier repetition** for emphasis: "very, very seriously," "many, many, many AI projects failed," "really, really recommend."
## Teaching & Framing Patterns
- **Numbered/metric-driven storytelling**: concrete figures anchor nearly every point — "1 million questions," "40,000 questions a week," "15 semantic views, 85 tables, 3,000 columns," "70% retention rate," "6,000 people."
- **Memorable coined phrases** used as teachable concepts, introduced with attribution framing:
> "We have a saying in our team, we say quality is P minus one."
> "This is what I call the collapsing of the wow factor."
- **Anecdote-with-dialogue**: he narrates conversations with invented direct quotes:
> "I was like, 'It doesn't matter. These are the questions your sellers are going to ask.'"
> "They start coming back to you with frustrations. Say, 'I cannot do this in the product anymore.'"
- **Staged/journey framing**: concepts presented as sequential phases (pilot → 10% launch → GA; talk-to-data → automation → orchestration → hyper-personalization).
- **Contrast pairs** to drive lessons home:
> "We don't want to try to answer 100 questions and get them 70% right. We want to answer 50 questions, but get them 95% right."
## Audience Adaptation
- **Acknowledges engineering audience explicitly**, twice:
> "I'm told that I need to have some code in my presentation. I don't, but I will try to show you at least some architectural diagrams."
> "I know that this is a technical conference, but this is also where a lot of these products fail."
- **Preempts engineering bias**: "A lot of engineers doesn't think about this, right?"
## Structure & Closing Habits
- **Explicit summary slide behavior**: a final recap of named lessons ("quality over coverage," "change management," "collapsing wow factor," "build fast," "feedback loops"), with reinforcement language: "I'm very, very like religious about this."
- **Blunt warning formulations** for retention: "you are going to shoot yourself in the foot," "you should be paranoid."
## Stability vs. Isolated Moments
- **Stable patterns**: "Right?" tagging, filler density, metric-laden evidence, quoted dialogue, contrast framing — all recur across the entire talk and Q&A.
- **Isolated**: the humor about code/architecture diagrams and the "long weekend" opener occur only at the start; the "shaming the managers" remark ([492]) is a one-off vivid example, not a repeated framing device.
## Uncertainty Note
- Timestamps and audio delivery (pace, pauses, laughter) are not observable in this transcript; tone judgments are based on text markers only. Q&A responses show the same conversational style ("basically," "and so on"), suggesting the patterns are stable, though the sample is one talk.
# Position Record: Building GTM AI Agents — Sait Izmit, Snowflake
## Speaker
- **Sait Izmit**, responsible for internal AI tools for Snowflake's sales team (speaker self-identification in transcript).
## Why Build GTM AI (Stated Reasoning)
- Nearly half of Snowflake's ~10,000-person workforce is sales, responsible for revenue.
- Sales reps struggle with **siloed data**: some reps use **15 different tools**, stitching data into spreadsheets; reps with **1,000 assigned accounts** cannot stay on top of news, consumption, support tickets, earnings.
- AI offers, per Izmit: **data democratization** (fewer dashboards, less analyst dependency), **automation**, **tool consolidation**, **productivity savings** → better win rates, shorter deal cycles, incremental revenue.
## Deployment Context (Claims)
- Internal GTM assistant launched **September last year**; **1M+ questions answered**, ~**40,000 questions/week**; built on **Snowflake Co-work** (formerly Snowflake Intelligence); Snowflake is **customer zero**.
## Core Lessons
### 1. Quality over Coverage
- **"User trust is earned extremely hard and is lost overnight"** — non-deterministic chatbots face arbitrary free-form questions; bad first five answers are very hard to recover from.
- Team saying: **"quality is P minus one."**
- Izmit wrote **150 test questions** from the sales process before trying the agent; initial test hit **50% accuracy**.
- Strategy: answer **50 questions at 95%** rather than 100 at 70%; **60% of data was added post-launch**.
- Current scale: 15 semantic views, 85 tables, 3,000 columns, 5–6 MCP connections, ~20 skills.
### 2. Phased Launch
- **Pilot** → prove accuracy with AI-native early adopters.
- **Beta at 10% (600 people)** → validate MVP; track request concentrations and retention (exited beta at **>70% weekly retention**).
- **GA** → then change management becomes the problem.
### 3. Change Management
- Two weeks post-launch, management frustration; Izmit's response: **only 20% of the organization tried the product** — if they don't try it, "that's not the product's fault."
- Izmit spends **60–70% of time** in sales meetings, demos, adoption dashboards, leader sponsorship — claims this effort roughly doubled results ("we would probably be doing half of where we are today").
### 4. The "Collapsing Wow Factor"
- Initial delight becomes baseline habit within months; users then compare against other AI products and can **switch overnight**.
- Maturity journey he describes: **talk-to-your-data → workflow automation (MCP, inbox/Slack monitoring) → team tool-building → hyper-personalization**.
- Position: *"every time people are happy, you should be paranoid."*
### 5. Build Fast with Today's Stack
- Criticism: large enterprises try to "purchase the perfect architecture," test frameworks, but **don't build, launch, and learn**.
- Initial launch was a **nine-page agent instruction doc, a couple of Cortex Analyst tools, semantic views, Cortex Search**, with instruction versions managed in **a Google Doc** — launched to 6,000 people.
- Architecture evolved post-launch: CI/CD, eval infrastructure, skill library, progressive disclosure, memory, task scheduling, Slack interface.
- Claim: comparing original PRD to current architecture, **80% matches**; 30–40% of ongoing work is re-architecting. Warning: waiting longer means losing to competitors moving 3–4 months ahead.
### 6. Invest in Logs / Feedback Loops
- Uses LLMs to classify **1.2M questions at scale** ("without breaking the bank").
- Benefits claimed: real-time feature-gap visibility; sales-enablement "goldmine" (generate battle cards from Confluence/Jira/Slack/PRDs in minutes); internal team matchmaking; compounding "hockey stick" effect.
## Q&A: Snowflake Intelligence / Co-work
- Izmit clarified: Snowflake Intelligence was **renamed to Snowflake Co-work**; it's a **no-code agent platform** with Cortex Analyst/Search/etc. out of the box; agents inherit **role-based access controls**; deployable "without writing a single line of code"; includes security guardrails and data curation.
## Qualifications & Tensions Preserved
- Izmit admits failures are common: "I see many, many, many AI projects failed" — attributed primarily to activation/change management, **not technology** (conditional on quality being done).
- He acknowledges upfront his talk lacks code ("I'm told that I need to have some code in my presentation. I don't").
- The 80% architecture match claim coexists with the claim of constant re-architecting (30–40% of work) — stated as complementary, not contradictory, per the speaker.
# Speaker Attribution Record
## Video Metadata
- **Title:** Building GTM AI Agents: Lessons from Deploying to 6,000 Users — Sait Izmit, Snowflake
- **Video ID:** `01a15ca7-c21b-7b56-8b3d-b3fab85c01fb`
- **No curated metadata was supplied**; all attribution below is derived from the transcript only.
## Speakers and Roles
### 1. Sait Izmit — **Creator / Featured Speaker**
- Identified via video title attribution and self-introduction ("I'm responsible for our internal AI tools for our sales team").
- Delivers the entire main presentation on Snowflake's internal go-to-market AI assistant, its launch, adoption, and lessons learned.
### 2. Unnamed Audience Member — **Audience Questioner**
- Asks the single Q&A question about whether "Snowflake Intelligence" is the underlying platform or the tool itself.
### 3. Unnamed Moderator — **Moderator / Host**
- Announces "We have time for one question" at the end; no substantive contribution.
## Provenance Facts
### Speaker's Self-Described Credentials
- Leads internal AI tools for Snowflake's sales team; launched internal go-to-market assistant in September (year stated as "last year").
- Reports the assistant has answered **1 million+ questions**, ~**40,000 questions/week** (elsewhere stated as 1.2 million cumulative).
- States Snowflake is "**customer zero**" for many Snowflake products.
### Referenced Sources and Systems
- **Snowflake Co-work** — platform the agent is built on (noted as renamed from "Snowflake Intelligence" at a recent summit).
- **Cortex Analyst, Cortex Search, Cortex Sense** — cited as out-of-the-box components.
- **MCP connections** (5–6), ~20 skills, 15 semantic views, 85 tables, 3,000 columns — agent scale claims.
- **Confluence, Jira, Slack, Gmail** — cited integration targets.
- **Blog posts** — speaker references published Snowflake blog posts on agent instructions, semantic views, RAG-based knowledge assistants, and change management; no specific URLs given.
- **Google Doc** — initial agent-instruction version management.
### Third-Party Claims
- Speaker reports recurring discussions with **Fortune 500 customers** who struggle to build similar agents — these are the speaker's characterizations of customer conversations, not independently sourced.
- Claims about Snowflake's workforce composition (~10,000 people, ~half in sales) are speaker assertions.
### Promotional Segments
- **Flagged:** The Q&A answer functions partly as a **product pitch for Snowflake Co-work** (no-code agent platform, out-of-the-box UI, security guardrails, "customer zero" positioning, and invitation for customers to build on Snowflake).
- **Flagged:** Closing reference to Snowflake blog posts promoting the team's published learnings.
### Comment Availability
- **Not indicated** — no comment availability information present in the source material.
\>\> Hi everyone. So, I think I'm one of the last speakers that is standing between you and the long weekend. So, I hope I can get your energy levels up. Um so, I'm responsible for our internal
AI tools for our sales team. And the reason I'm here today is indeed like we launched our internal go-to-market assistant uh in September last year. It answered more than 1 million questions so far. We have roughly answered 40,000 questions a week. Um and we are the customer zero for a lot of Snowflake products. So, this is built on Snowflake co-work. Um and I meet a lot of customers every week. Okay? So, I meet a lot of enterprises, Fortune 500 companies, and then they're all trying to build similar things, and they all struggle, right? So, and then I end up like having this discussion with them all the time. Like they ask like how did you guys do it? And then we share our best practices. So, I will try to share some of those things with you. Uh I'm told that I need to have some code in my presentation. I don't, but I will try to show you at least some architectural diagrams just to make it more interesting for the engineering audience. Uh but let's jump into it. Um I think before we start like I think I already I was watching the other presentations like I think everyone tries to give their interpretation of like you know, why are we even building things for go-to-market. Okay? So, this is how I explain it to family and friends. So, let's take Snowflake. Okay? So, we are a company of like, you know, close to 10,000 people. So, if you look at that or our organization, almost half of our basically workforce is sales, right? And
what are they responsible for? They're responsible for revenue generation. What do they struggle with? And I into I talked to a lot of customers. It's very common. You know, everyone's data is
siloed. We work with a lot of first-party data, a lot of third-party data. It's all locked down in these like SaaS tools and things like that. And literally we have for example like reps who are using 15 different tools, not because they love the UI of those tools, because every tool has a different data point, and then they end up stitching all of that together in spreadsheets and running it there, right? And the data is endless. Like we have reps who have 1,000 accounts assigned to them, 1,000 customers. They have to stay on top of their recent news, what's happening with their consumption, did they get in support tickets recently, what was their latest earning results, everything. There's no It's not a single human on this planet that can stay on top of that much data. And then they need to do that 30 times, 40 times a day, right? So, what does AI offer for them? It offers that data democratization. No more like 1,000 dashboards, right? No more access to analysts. Like you know, um it offers automation possibilities for them, right? It frees up their inbox. It offers tool consolidation. No longer 15 different tools that I need to work for. And that brings productivity savings. It frees up your time, right? You can use that time on other things. It helps you become a better seller. You're more effective with your customers. And that translates to business results. You can cover more of your book, you know, you can have better win rates, uh you can have shorter deal cycles, and ultimately what everyone cares about, you can get incremental revenue. Okay, so that's the reason why I'm I'm working for, you know, making the go-to-market organizations more effective. But, there's a catch. These are non-deterministic systems, right? And I run into this problem every time with users. I see many, many, many AI projects failed,
and then it fails on this principle. User trust is earned extremely hard and is lost overnight, right? So, at the end what you're doing is
you're putting a free-form chatbot there, right? And people will come in and they will ask any question they can think of. If they like what they see in the first five questions, they come back. If they don't like what they see, it's 10 times more effort for you to win them back, if you can ever win them back. Right? So, we have a saying in our team, we say quality is P minus one. Right? And that's basically we take that very, very seriously. So, one of the things that we really cared about is when I first joined the team, you know, the team had all these like data sources connected from our top dashboards. We they had a knowledge assistant built into it and so on. We had three lines of agent instructions. And then before I even tried the agent,
I opened a spreadsheet, I took the sales process, I wrote down 150 questions. And then the sales our engineering team was like, "What are you doing? We don't have that data in the agent." I was like, "It doesn't matter. These
are the questions your sellers are going to ask." Right? And then we run our test, 50% accuracy, you know, like everyone's depressed and so on. So, we said, "Okay, let's make sure that we don't go for coverage, but we go for quality." Right? We don't want to try to answer 100 questions and get them 70% right. We want to answer 50 questions, but get them 95% right. Right? Because with that you get a first impression, good first impression, you build a trust with them. And then rather than being in that boat of, "Oh, this thing doesn't work." people are like, "Oh, this thing is awesome. Can I get more of that?" Right? So, we started small and 60% of the data we actually added after the launch, after the 6-7 months post launch. Today, if you look into our agent, I mean, it's
not a small agent. We have 15 semantic views, 85 tables, 3,000 columns of data. We have like five to six different MCP connections on it. You know, close to 20 skills connected to that and so on and
so on. Right? So, it's a huge system that we are managing in here. And then you cannot just launch these things to everyone, right? So, we said that, "Look, we need to do this in a controlled way because we want to make sure that we earn that first five questions. We don't want to burn our bridges in that first five questions." Right? So, that's why with every product we do, we do a face launch. The first one is a pilot. The goal of
the pilot is to prove the accuracy, prove the quality, right? You get your top, you know, AI native folks in the organization who are eager to work with
you, give you feedback, improve the product, make sure that you got the rough edges through that, right? And then after a couple of weeks, you come to a point where it looks like, okay, those rough edges are more smoother now. Okay? Then you go into your better launch. We do 10% better, right? With 600 people. There you are looking at do I truly have an basically a minimum viable product? Is the MVP really there, right? And what will happen is that you will start getting tons of requests. Can you connect this data? Can you connect that data and everything? And then you are looking at like where are the actually the concentrations happening? Because that means that if you don't get those things in, you don't truly have an MVP, right? Then it's not going to work for their daily workflows. And then at this stage, you're also trying to prove are they coming back? Right? So, the things that we really track there is basically like, okay, how many questions they're asking and everything, but what is the retention rate? So, we exited for example that at like more than 70% retention rate that the weekly active users were coming back. Okay, now we're in a good place, right? We have confidence on the accuracy, we have on the confidence of the basically the coverage of the product we have, and people are coming back. Okay, now let's go to GA, and then you launch through the GA. And then you have your next problem. So, I know that this is a technical conference, but this is also where a lot of these products fail.
It's basically how do you drive change management? So, you launch your product, you are 2 weeks into the launch, and then you are here. And all your management is like disappointed or
frustrated. Why aren't people using this? Why are numbers are real low? Right? And I show them this graph. I say that only 20% of your basically organization actually tried the product. I cannot do anything. This is not the product's fault if people are not even taking 5 minutes to try try the product. Right? If they try it and if they don't come back, okay, that's my problem. Right? But if they don't try it, then we have another problem. So, the first and I've been, you know, I've seen this with many many sales organization in my past life as well and so on. Usually this is a couple of month process. And then you significantly invest in basically change management, in activation. I will spend 60 70% of my time in sales meetings, giving demos, building dashboards, which teams adopted, you know, shaming the like the managers whose team is actually doing good, getting sponsorship from sales leaders to basically like make sure that they you know, they push their people to try these things and so on. And then ultimately that gets your blue line up and then your questions are start coming up and then your focus can shift into, okay, how do I drive more depth? Right? And I want to really really emphasize this because if you hadn't done this, we would probably be doing, you know, half of where we are today. So, this is a very very important part. And then as engineers, if you spend all your effort, you want to have a good product, make sure that the activation and the change management is like lined up, like post launch of the product as well. Now, you run into another issue. Okay, you are let's say that four to six months down the road. Right? What happens is you successfully launched the product. You are first like rockstars in the company. Right? People literally show you on the
corridor like, "Hey, your product is awesome. We can talk to our data now. We don't need to wait on the queue to like, you know, get access to like analysts to answer our questions in every 2 weeks and so on. Right?" And after a couple of
months, they start coming back to you with frustrations. Say, "I cannot do this in the product anymore. Right? I I would like to I mean, I saw this other AI product that does this and so on." This is what I call the collapsing of the wow factor. Okay? So, initially you are cool, but then and that becomes a habit, right? You basically change their habit and it becomes standard for them. Now, you need to raise the bar again. So, the journey that we usually see with the sales teams is like you start with talk to your data. How do we get you out of those like, you know, hundreds of dashboards situation, dependency to the analyst, and then first we'll basically
like democratize the data for you so that you can basically talk to your data. Then the next wave comes with all the MCP connections, right? All the integrations that you are building. Now it becomes like automate my
workflows. We literally have now sellers who are going to use our agent basically to monitor their inbox, they monitor their Slack channels, you know, keep track of all the customer questions coming about like product questions, uh use the agent to draft responses that save that in Gmail, review them afterwards like send those things out, right? Or they automate their like outreach workflows and so on. Okay, that's great. Now I became an orchestrator, right? I'm basically automating my workflow workflows. Then the next thing you see start happening is teams, they get these like, you know, tool democratization, this empowerment coming to them, right? Because historically a lot of these go-to-market teams, they have been always in the backlog of someone, backlog of of an IT team or like trying to get a SaaS budget to learn and get a vendor on board to actually like enable something. And now all of a sudden they're able to build team skills. They're able to build like, you know, the custom dashboards that are basically like fully, you know, optimized for what their team needs. Are able to like deploy applications, automations, alerts, and things like that, right? And then the comes the phase of hyper-personalization, right? Everyone is able to now like get everything personalized for them, not only for themselves, but also for their customers with living context of customers, contacts, and things like that. I think the main message I want to give here is if you just do the first stage, and if you just wait there, you will get disrupted in a month or two, right? Because now you already raised their expectations, that already became a baseline, and then they will find another product that does better than you, and right now the switch is very easy. They're going to just switch over night. Okay? So, you need to keep iterating. You need to keep that wow factor, and I cannot just rely on the fact that, you know, what I built so far is going to stay cool forever. And the next thing is, how do you deal with basically the changing technology? So, I talked to a lot of customers.
And then, you know, it sometimes you run into these customers, big enterprises, very big brands. And then they are still trying to purchase that perfect architecture. They're trying to like test different frameworks. They're trying to see how
the, you know, the technology is maturing and everything and so on. But, the thing that they don't do is they don't build, and then they don't launch, and they don't learn. Right? All these blue boxes that you see here, those are all the things we added after the launch. Right? When we literally first launched the agent, it was a nine-page long agent instructions. It was couple of Cortex analyst tools, semantic views. It was a Cortex search service for our unstructured data. And we were managing the agent instructions versions out of a Google Doc. That's how we launched it. To 6,000 people. Right? Now we realized, okay, it's not going to work out. Let's figure out CICD. It's not going to work out. Let's figure out our basically eval infrastructure with all the like the unit test, routing test, and everything. Right? Then we start basically like coming to a point where, for example, we were creating all these like business processes and workflows. We couldn't fit them into the agent instructions anymore. And then the skills came, and we were like, "Oh, perfect. Let's build a skill library." You know, then the MCPs came. Perfect. But now, like we have to put bunch of other instructions to basically orchestrate that, we hit the limits on the agent instructions. What do we do? Okay, let's do the progressive disclosures. Right? And then user memory comes, task scheduling comes. We want to go beyond the chat screen and then, you know, chat interface and start doing the Slack interface and things like that. If I look at the PRD and the architectural diagram we wrote in the beginning of the project, if I compare to this architecture we have now, 80% of it It match. Okay? So, like if you look at our sprints, like maybe 60-70% of the work we are doing is adding new features, improving quality, and all kind of things. But 30-40% of the work is that we are constantly re-architecting with the new technology. So, this is a time where like you need to get your hands dirty, you need to run with the new technology, and then you shouldn't be like, you know, too much tied to your architecture. You should be okay to like pivot very easily, so that you can basically double on down on these like new capabilities and things like that. And then the longer you wait, the more, you know, you lose towards your competition, because if your competition is doing these kind of things like 3-4 months ahead of you, right? That means that they're also getting more customers. Um last thing is I would really, really recommend investing in your logs. Okay? Because they create the basically the feedback loop. So, first of all, technically it's very fun. Okay? So, you basically use LLMs to like classify your logs and things like that. As I said, like we have 1.2
million questions, we get 40,000 questions every week. It's technically very fun, you know, how you do that at scale without breaking the bank and so on. You know, our data scientists love working on those things, and then they really experiment with new things.
But as a result of that, what we get is we get a very extremely detailed breakdown of topics and, you know, things that we are having. I'm just to showing you the top category categorization level there, but then basically we are able to track like, you know, what kind of questions they are asking. We are able to break down each of those categories to subcategories, you know, they are able to get like detailed example questions, this and that, and so on. All good, but how do we use that? Then we start creating the basically the feedback loops. Right? I know, I mean, I still interview, of course, users, but now I see in real time what my feature gaps are. I'm clearly seeing what people are asking and we are not able to answer or where we have a like a quality issue, where they are swearing at the agent or like at repeating their question, so that we see where to improve. For sales enablement is a goldmine. Let's say that we launch a new product. Usually, you know, they would need to interview maybe 100 sellers a week to be able to understand like how basically the you know, the topics are changing where there's gaps in terms of like knowledge documents, battle cards. I see that in real time in a minute or two by just asking an element question. And then we can then, you know, connect to Confluence, we can connect to Jira, we can connect to Slack channels, we can ingest the PRDs, and in couple of minutes we can actually like, you know, generate battle cards, sales enablement document and then feed it back into the agent. Right? I mean, you cannot do that kind of a like a feedback loop with humans, right? So then you we can basically automate these kind of things. Um within the sales organization, there will be different teams that are good trying to connect each other. They are trying to maybe target similar accounts from different angles. They don't know about each other. We do. We are now able to ping them. And then we are able to basically do matchmaking. Right? I'm just giving you couple of examples, but this is also one of those areas where like you start building your AI platform, you start building your architecture. The first features are difficult to get out. The next ones are easy. And then once you start tapping into your logs, this this like hockey stick exponential thing actually starts happening and it's magical.
So, if you were to take a couple of things from this talk, like quality over coverage. I'm very, very like religious about this. If you go for the coverage,
you are going to shoot yourself in the foot. Okay? Change management. A lot of engineers doesn't think about this, right? A lot of these AI initiatives, they don't fail because there's an issue with the technology, there's an issue with that as assuming you did the first one, right? Right? So, they fail actually in activation. So, make sure that you have a plan for that, especially in larger organizations where we are dealing with like 6,000 go-to-market users, right? Um again, don't forget this concept of collapsing law factor. You cannot stay where you are. You cannot just say that, "Hey, I did an innovation. I'm going to surf that for a year." You know, every time people are happy, you should be paranoid. You should be like, "Okay, what am I going to show them in a month or two now?" How do I basically keep that excitement going on? Right? Build fast with today's stack. Like, don't try to invest in these like high, you know, super like plat, you know, architectures and have these like 6 9 months of long projects and things like that. How do you turn around these things in weeks, days, and so on? And just be comfortable with the fact that you are constantly going to be re-architecting. That's fine. Right? Just don't over-invest in the current architecture. Just make sure that you keep your like flexibility out there. Um and then the feedback loops. I think that's what kind of like gives you really that like, you know, the incremental part of like that hockey stick exponential part of the thing. Um we constantly publish like blog posts, I mean, where we kind of like try to have our, you know, learnings shared with uh our customers and so on. Like, we have blog posts on like how we do agent instructions, how we do our structured data with semantic views, you know, how we basically build our rack-based like knowledge assistants, the non-technical side of the story, like how do you derive change management, and so on. So, feel free to check those. Um and yeah, I think that's the end of my talk. Okay. \>\> We have time for one question. Okay, there you go.
\>\> Thanks for the talk. Um I don't know if you already said this, but I saw in the the titles of the articles Snowflake Intelligence. Is that an underlying context or layer that the tool or system
you built was on top of, or was that the tool itself or something else? \>\> Yeah, Snowflake Intelligence, we renamed that to Snowflake Co-work a couple of weeks ago in our summit. That's basically our no-code agent platform that we basically build have available for our business users. I mean, the advantage of that is that all of these tools are on like, you know, you know, Cortex analyst or Cortex search or Cortex sense, a lot of those things are basically comes out of the box. We made a strategic choice for our internal thing where we said that, "Look, it is important that we bring all our data together." And we do that in Snowflake. We bring all the first-party, the third-party data, all the Salesforce data, everything, the call transcripts, and so on, all together. And then these agents then can basically basically inherit a lot of the role-based access controls and so on. And I literally can deploy these agents without writing a single line of code, right? And then, you know, you don't need to worry about the UI, the chat UI comes out of the box, and so on. And then we have been the customer zero of that like internally to build this ourselves. And then, you know, our customers are able to go and then build similar things basically on Snowflake over platform as well. And it comes with the guardrails and things where you don't really need to worry about them going very, you know, crazy on, you know, what data sources to do things, and so on. So we are able to do a lot of curation. We are able to do a lot of security guardrails in there as well. Thank you.
