I Spent Two Years Building the Median — Hariprasad…
A talk by Hariprasad Sudharshan reflecting on two years of solo software building, during which he found others had independently produced similar calculators. He introduces the concept of the median: a shared starting point that leads different builders toward the same solutions without copying. Key themes include the separation of model, harness, and product; the build-first reflex of opening a coding agent instead of searching for existing solutions; a novelty budget for naming one distinctive element per project; three questions leaders can use when evaluating demos (who has solved this, what does the team uniquely have, where will users encounter the application); and the difference between running open model weights in-house versus buying inference. He frames the talk as personal reflection rather than a controlled study of product success.
# Video Identity Observations
## Source Overview
- **Title:** "I Spent Two Years Building the Median — Hariprasad Sudharshan"
- **Format evidence:** A conference-style talk ("We will see in this talk", "before the bill starts", closing with "Thank you"), referencing slides, a QR code, and a live audience ("Okay, now I see you will connect dots").
## Explicit Self-Description (creator claims)
- The speaker introduces himself directly: <blockquote>"I'm Hari. I'm the product person who has built software for almost like two decades now."</blockquote>
- He asserts practitioner credibility beyond hobbyism: <blockquote>"I did not start building when the models got better. I have built more than a dozens of applications in public and contributed to Lama index another repos."</blockquote>
- He claims the project shown is not a first attempt: <blockquote>"I want to show you this because the project I'm going to show you are not hobbyist first attempts."</blockquote>
- He claims validation from industry leaders: <blockquote>"I've shared this method with multiple leaders across organizations and I've got good feedback on them."</blockquote>
## Claimed Scope
- The talk frames itself as a broad thesis on the software industry and the AI era: software as "a new industry in the human history," the "$125 trillion economy," and predictions "going to play out in the next 5 to 10 years."
- He coins original terminology as intellectual contribution: **"the median," "build first reflex," "build first then what," "novelty budget,"** and reframes **"AI slop."**
- The talk positions a personal two-year building journey as evidence: <blockquote>"I spent 2 years on the median, but that was education. It was worth every token I burnt it."</blockquote>
## Intended Audience (observable from address and content)
- **Engineers and product leaders** — references to "E6, E7, or a E1 engineer," Claude Code, Cursor, Codex, LlamaIndex, Kafka/Zookeeper/Kubernetes assume deep practitioner familiarity.
- **Engineering/organizational leaders** explicitly addressed: <blockquote>"If you are leading and don't build now with this AI, this is exactly for you."</blockquote> He warns leaders' "instincts... were not calibrated."
- **AI-assisted builders and indie developers** — references to Lovable, Replit, max plans, and shipping apps solo.
- Audience-aware rhetorical devices: "How about you?", "Who knows this person?", "Isn't that the great dinner table argument these days?"
## Demonstrated Presentation Patterns
- **Narrative arc from personal experiment to framework:** opens with a NYC-scientific scenario, moves to personal failure ("my circle told me that they have seen similar calculators elsewhere"), then delivers prescriptive rules ("I came up with this four rules... I want you to run them as your road map").
- **Prescriptive, framework-heavy style:** numbered questions ("Who has already done this?"), named rules, and budget metaphors ("everything else is free now. And the highest return of investment is a novelty budget").
- **Concrete artifact offered to audience:** an open-source calculator tool ("It's open source and free... That's the QR code") targeting enterprises evaluating open-weight models.
- **Contrarian-but-balanced stance on AI:** defends new builders ("They are not AI snobs... AI today is making everyone a developer") while cautioning against the "build first reflex."
## Boundaries
- This material demonstrates one talk's presentation; channel-wide positioning (upload cadence, series structure, branding) is not present and is not inferred here.
# Delivery Observation — Hariprasad Sudharshan, "I Spent Two Years Building the Median"
## Opening Habit: Dramatic Scenario Hook
The talk opens with a hypothetical catastrophe addressed directly to the audience:
> "If I tell you the New York City tonight suddenly stops working, you tell me what could be possible reasons for no flights leaving JFK."
He builds the scenario as a rapid list of failures before delivering the payoff himself:
> "Software. Unless otherwise, there is a software issue that affects the entire globe."
This is a **self-Q&A pattern**: he poses a question rhetorically and answers it in the next breath, a habit that recurs throughout (see below).
## Self-Introduction and Credibility Markers
He inserts a brief personal credential early and plainly:
> "I'm Hari. I'm the product person who has built software for almost like two decades now."
Later he pauses to re-establish credibility mid-talk:
> "So, some credibility before I go further because I've spoke almost for a long time. I did not start building when the models got better."
This "credibility checkpoint" behavior — proactively defending his authority before showing project work — appears at least twice.
## Recurring Vocabulary and Coined Terms
Several terms are repeated so often they function as the talk's spine:
- **"Median"** — the central coinage, used dozens of times: "I want to call this answer as a median." / "The prompt to production is a median path." / "novelty is scarce, and the median is free."
- **"Novelty budget"** — introduced with explicit coining language: "I would like to coin another new term... In the AI software development life cycle, a novelty budget."
- **"Build first reflex"** — also explicitly coined: "I want to coin few terms here. The build first reflex."
- **"Deterministic"** vs. **"probabilistic"** — the talk's framing pair: "It's the traditional, deterministic, rule-based, reliable software" vs. "we will be using a probabilistic gear to crank out a reliable deterministic software."
- **"Release cadence"** — appears twice ("the leaderboard is changing with every release cadence," "this median keeps changing with every release cadence").
- **"Same cookie cutter"** metaphor — "the source or the cookie cutter is the same" and later "the same cutter went into the same dough."
## Teaching Habits
**Analogy-first explanation.** He explains abstract points through extended real-world analogies, most elaborately the Usain Bolt/sprint analogy for model comparison:
> "So, the model is the athlete or the engine. It provides the underlying capability... The Claude code versus Cursor or Codex isn't a model comparison. It's closer to comparing Jamaica versus USA."
**Enumerated structures.** He numbers his frameworks aloud: "So, I had to rework... this four rules," "So, the playbook is simple. Three questions. One. Who has already done this?... Two. What do we have... And third, where will this application live?"
**Rhetorical questions as transitions.** Frequently used to pivot sections:
- "So, if everybody has the same source... where is the differentiation?"
- "So, what is that moat that you can create in this new environment?"
- "Who knows this person?"
**Explicit signposting.** He tells the audience how to listen: "And hold this picture. Let's watch one card change," and "I'll stop talking about those trivial problems and show one of my applications."
**Direct second-person address.** He consistently speaks to "you" and includes himself in a shared "we": "And I fall for the same things as you are," "We don't want to make decisions anymore."
## Tone andregister
**Conversational with self-deprecation.** He admits personal mistakes as teaching material:
> "Small wins produce a lot of dopamine, and I fall for the same things as you are."
> "I was bombastic until I found out that I haven't calibrated to reality yet."
**Enthusiast register.** He identifies as a fan and uses informal intensifiers: "I'm a big fanboy of him. He's a superhuman," "it felt like magic, isn't it?", "which is cool."
**Imperative advice mode near the close.** The ending shifts to direct commands:
> "Squeeze every vein, every ounce of your brain on novelty, because novelty is scarce, and the median is free. It's up to you to choose."
## Recurring Verbal Tics (Possible Filler Patterns)
Several constructions repeat enough to look like habits, though as spoken-delivery artifacts their stability is uncertain from a transcript alone:
- "most times than not" (appears at least twice: "Most times than not, today it's useful," "most of the times than not, trust me, you would end up with similar outputs")
- Trailing tag questions: "isn't it?" ("it felt like magic, isn't it?"), "Aren't they?", "Can you believe it?"
- "go to an extent" ("And I'll go to an extent and call," "somebody will go to an extent say replacing human judgment")
## Storytelling Pattern: Confession Arc
His project narrative follows a visible arc — excitement, launch, deflation, recalibration, lesson:
> "I was bombastic until I found out that I haven't calibrated to reality yet... my circle told me that they have seen similar calculators elsewhere... nobody copied from anybody. It's the same thing."
He then extracts a named framework from the failure ("novelty budget"), which is his consistent move: **anecdote → coined term → rule for the audience**.
## Isolated vs. Stable Observations
**Stable (repeated, well-evidenced):**
- Self-Q&A rhetorical questioning
- Analogy-based teaching (sprinting, cookie cutter, athlete/engine)
- Explicit coining of terms and numbered frameworks
- Second-person, inclusive address
- Confession-based credibility building
**Thin or uncertain (single occurrences):**
- The personal anecdote about skipping "socials and movie nights" and perfectionism ("I'm a bit of a perfectionist") appears once each; whether this confessional register is habitual cannot be confirmed from one talk.
- The live-demo-style walkthrough of his calculator near the end occurs once; his comfort with live product walkthroughs can't be assessed from a single instance.
- Audience interaction ("Who knows this person?") appears once; his use of live audience prompts is not established as a pattern.
# Video Position Record: "I Spent Two Years Building the Median" — Hariprasad Sudharshan
## Speaker Identification
The only identified speaker is **Hari (Hariprasad Sudharshan)**, self-described as "the product person who has built software for almost like two decades now." All positions below are attributed to him unless otherwise noted. A brief second voice is audible in the transcript (a snort), but no attributable content.
---
## Core Positions & Reasoning
### 1. The world runs on deterministic, human-crafted software
- **Claim:** Modern civilization is "driven by unseen software" — not AI, but "traditional, deterministic, rule-based, reliable software" handcrafted over ~70 years, underpinning a $125 trillion economy (per his figures; he also says "$100 trillion" near the end — **an unresolved inconsistency in his own figures**).
- **Reasoning:** An NYC shutdown scenario (flights, subways, payments, elevators, Wall Street) could only plausibly be caused by a global software failure, "just like the Y2K" risk.
- **Follow-through:** "The world still runs on deterministic software, at least for the foreseeable future, and it might always be." AI accelerates writing it but does not replace it.
### 2. Software is the only genuinely new industry
- **Claim:** "If at all there is a new industry in the human history, it must be software industry."
- **Reasoning:** Navigation, agriculture, construction, astronomy all existed in earlier forms; software is the single common factor from workplaces to space stations.
### 3. Human judgment was the historical source of differentiation
- **Claim:** In the classic toolchain (assemblers → C → Unix → Kafka/Zookeeper → Kubernetes), "the only judgment in this picture is human judgment," and "that variance is where every product edge originated."
- He extends this: engineers' "belief systems and value systems are reflective in the software that they shipped."
### 4. Models are "rented"; the differentiation source is gone
- **Claim:** AI-era engineers are assisted or driven by "rented" models, creating a "level playing field" — teams without Google/Meta talent pools can now access frontier intelligence via APIs.
- **Reasoning:** The model "does not care who is typing and from which part of the world." Given the same problem and tools, it gives everyone the same answer. He names this shared output **"the median."**
- **Consequence:** "The problem that is free is free for everyone," so "distribution becomes the moat, not your product."
### 5. Frontier model comparisons don't belong in product strategy
- **Claims:**
- Elo differences (e.g., Anthropic 1503 vs. Mistral 1460) are "relative rating derived from model comparison... not the absolute intelligence scale"; 87 points "does not mean Anthropic is 87 points smarter."
- Organizations often "mistakenly compare the harness or the product for models" — "Claude Code versus Cursor or Codex isn't a model comparison. It's closer to comparing Jamaica versus USA" (athlete vs. training system).
- **Analogy:** Usain Bolt vs. Gatlin (2015, separated by 27 hundredths of a second) — "on a given day, anybody can beat anyone." Professionals told him the record holder doesn't matter on the field.
- **Qualification:** "I'm not saying don't compare models. All I'm saying is don't make a small moving frontier gap into your product roadmap as an advantage." He also attributes fan-boy bias to human emotion ("often the emotional side of us... peaks into meeting rooms").
### 6. Redefinition of "AI slop"
- **Claim:** The industry's term "AI slop" is used "without any empirical analysis" and is too negative. The similar outputs aren't copying: "It's a crowd of people who have arrived at the same answer because the source or the cookie cutter is the same."
- **Counter-position:** AI-assisted development is democratizing — "AI today is making everyone a developer. To me that's a good thing and I mean it." Success should be judged by creators' own goals (revenue, showing colleagues, apps built with Lovable/Replit): "They are not AI snobs."
- **Qualification:** Median products are "not slops... perfectly fine for internal consumption," but "stop counting this as a differentiating factor."
### 7. The "build-first reflex"
- **Claim:** Building used to be costly, so he "used to search more than I built. Today, it's flipped." People avoid decisions by delegating to agents.
- **Evidence:** Asked a coding agent to build a RAG system; when challenged, the agent admitted: "I'm the culprit here. You said, 'Can you build?' I went ahead and built" — producing "the median rag," a solved problem.
- **His self-account:** Over 2 years, "any exciting idea I had, I went ahead and built... almost every time I ended up with a crowded lane," or returned from a month off to find "60 similar products."
### 8. Personal case study: the calculator app
- **Claims:**
- He built "more than a dozens of applications in public," contributed to LlamaIndex and other repos — explicitly distancing the projects from "hobbyist first attempts."
- His soft-launched calculator turned out to be functionally identical to others: "nobody copied from anybody. It's a copycat work... not even similar. Same."
- Convergence extends to LLM routing; "it's like having same developers in your team and your competitors also have the same developers."
- **Pivot:** He rebuilt the app to compare the cost of running identical open weights in-enterprise vs. buying tokens from a "Neo cloud," finding none of the "244 calculators" did this. Note the figure shift: earlier he said "400th or 4,000th" and later "244 calculator[s]" — **inconsistent counts within the talk**.
- **New claim arising from this:** "Open weights are not open inference" — ~10 layers (MLOps, SRE at novel scale, precision KV cache, batching, execution parallelism, utilization) sit between weights and token generation; some layers are "structural. You cannot buy it," and the required expertise doesn't yet exist in the industry.
### 9. The "novelty budget"
- **Claim:** "Everything else is free now. And the highest return of investment is a novelty budget." One unit of true novelty (like PageRank for Google) lets you "cross this median at least for a good amount of time."
- **Prescriptions:**
- Before building, "name the one thing that is novel"; if you can't, "concede that it's a learning exercise."
- Treat novelty as a budgeted, reviewed line item in roadmaps.
- His rework: "I spent almost all of the time on how to differentiate and almost none on flaunting my Claude Code or Codex skills."
### 10. Four rules for beating the median
He frames these as roadmap rules, not side-project rules, noting "your products will definitely have a twin and sometimes it might be open source... fork it":
1. **Be highly opinionated** — "In the world of medians, an opinion is the cheapest novelty you could own... the model cannot supply [it]."
2. **Prompt-to-production is a median path** — acceptable for internal tools, not differentiation.
3. **"When AI says done... your work begins there"** — agents deliver "the last great design for free"; they won't "invent the next Kubernetes or Zookeeper or Kafka." Finding the next one is your job.
4. *(The fourth rule is not separately enumerated in the transcript; the talk moves to leadership questions — an unresolved structural gap.)*
### 11. Leadership recalibration
- **Claim:** Leaders' instincts are miscalibrated because deliverables that once took "a quarter... and a team" now appear from one engineer; "nobody can recalibrate by reading or watching YouTube or LinkedIn posts. You recalibrate by building."
- **Three diagnostic questions:**
1. *Who has already done this?* — tames the build-first reflex.
2. *What do we have that competitors/other teams don't?* — forces novelty as "a first-class citizen."
3. *Where will this application live?* — forces outcome-based thinking; "the demo is the expensive way to find out if you have no distribution moat."
---
## Concluding Positions
- **On AI's role (stated as a 5–10 year view):** (1) accelerate deterministic software development at lowest cost; (2) write deterministic software that never existed due to budget or being "not an interesting problem."
- **On durability:** "Prompt-based median products are useful. I ship them, too. They're not slops. But they have little durability when they go to open competition," surviving only with "a huge distribution moat."
- **Final exhortation:** "Spend everything you have on one thing, which is the novelty... because novelty is scarce, and the median is free." He frames his two years as "education... worth every token I burnt."
---
## Noted Tensions & Qualifications (preserved as expressed)
- **Economy size:** cited as "$125 trillion" early, "$100 trillion" late.
- **Duplicate-product counts:** "400th or 4,000th rag system" vs. "244 calculators."
- **Fourth rule** in the "four rules" list is not articulated in the transcript.
- **Balanced stance on AI:** he repeatedly praises democratization ("that's a good thing and I mean it") while warning against treating median output as differentiation.
- **Hedged predictions:** "we may not be able to crack it, but that intent will definitely put you above median"; deterministic software's dominance is qualified with "at least for the foreseeable future, and it might always be."
# Video Attribution & Provenance Record
## Video Overview
- **Title:** *I Spent Two Years Building the Median — Hariprasad Sudharshan*
- **Video ID:** `01a15ca6-6da7-7d83-a0a8-2db44d434361`
## Speaker Identification
### Primary Speaker
- **Name:** Hari (self-introduced; full name **Hariprasad Sudharshan** per title)
- **Role:** **Creator / Presenter** — identifies himself as "the product person who has built software for almost like two decades now."
- This is a conference-style talk delivered by Hari throughout the transcript.
- Self-stated credentials: built "more than a dozens of applications in public," contributed to "Lama index another repos," soft-launched a calculator application.
### Other Speakers
- **Unidentified audience member(s):** A brief off-mic reaction is transcribed:
> "\> \> \[snorts\]"
- No guest speakers, interviewers, or narrators appear.
## Referenced Third-Party Sources & Claims
| Referenced Source/Claim | Attribution in Transcript |
|---|---|
| Stanford leaderboard study | "Six labs the recent study came out from Stanford" — Anthropic 1503, Mistral 1460 Elo figures |
| GitHub statistics | "GitHub's own number" regarding volume of new AI-assisted software (~"100,000 of repos") |
| Usain Bolt / Gatlin 2015 race | 100m final, "nine souls," 27-hundredths gap; speaker self-identifies as a "fanboy" |
| Tooling comparisons | Claude Code vs. Cursor vs. Codex (characterized as harness/product comparisons, not model comparisons) |
| Platforms mentioned | Lovable, Replit, LlamaIndex, Kafka, Zookeeper, Kubernetes, Unix, C, Y2K, Neo Cloud |
| His own project | An open-source, free **open-weights cost calculator** (accessed via QR code shown on slide; not available in transcript) |
## Promotional Segments
- **Flagged:** Near the close, the speaker promotes his own open-source calculator tool:
> "That's the QR code. So, scan it, put it into your workload… It's open source and free."
- Self-promotion of his two-year building experience, methods, and playbook ("I've shared this method with multiple leaders… and I've got good feedback on them") is woven throughout the talk.
## Comment Availability
- **Not determinable** from the transcript or supplied metadata — no comment status is indicated.
## Explicit Uncertainties
- Audience reaction speaker is unidentified (transcript marker only).
- "Stanford" study details (exact paper, date) are not specified in the transcript.
- QR code destination for the calculator cannot be verified from the transcript.
- Speaker's company/affiliation is not stated in the transcript.
If I tell you the New York City tonight suddenly stops working, you tell me what could be possible reasons for no flights leaving JFK. The subway suddenly stops at the next
station and stays there. None of your tap pay is working. The elevators you get in, they don't know which floor they are. The phones are not ringing. The Wall Street and the entire world comes to a standstill. What could be the reason? Software. Unless otherwise, there is a software issue that affects the entire globe. There is nothing that can stop this modern world. This is how much the city of New York and our entire globe is actually driven by unseen software. Not the AI kind of software that we mostly talk about. It's the traditional, deterministic, rule-based, reliable software that has brought the modern world to us. It is handcrafted for over 70 years by humans. I'm Hari. I'm the product person who has built software for almost like two decades now. And I have this one genuine theory. If at all there is a new industry in the human history, it must be software industry. Because you take navigation, agriculture, construction, and even astronomy, we had this in different forms and shapes earlier. Now that it may be more sophisticated, but they're nothing new to us. Today from getting to work to watching this video, from nuclear reactor to all the way to space station that drives the 125 trillion dollar economy the one common factor is software. So, it would be catastrophic if for some reason software stops, just like the Y2K. And our modern world was a lot to this kind of a software. The deterministic kind, where you trust it with your pacemaker and when you fly on your 747. So, if you look into the product here on the left side, you have the engineers. The engineers are hired and they are the source of judgment for every product out there with their unique taste. And I'll go to an extent and call their belief systems and value systems are reflective in the software that they shipped. The tool chain owned deterministic rules all the way. The software that runs the world and the tool chains next to it in a cross feedback loop where the assemblers built C, C built Unix, Unix built everything and then we built Kafka, Zookeeper, all the way up to Kubernetes that runs the world today. The only judgment in this picture is human judgment. And we all know how varied we are. And that variance is where every product edge originated. The block here is a high-level representation of the entire software industry and the world economy. Who has the IP? Where is the continuous loop? And how that loop where every brick on the tool chain helps us scale new heights. Whether the software is deterministic or
probabilistic, that's a question. And hold this picture. Let's watch one card change. Which is, yes, in the age of AI,
the engineers today are assisted or driven or sometimes they claim it's completely autonomous by models that I would call rented. The good thing is that it creates a level playing field with everyone having equal access to the bleeding edge models and harnesses. Teams who cannot afford earlier to the talent pools of Google and Meta who handcrafted this modern software can now afford intelligence through APIs where it claims to have solved the software problem. Let's see whether it really solved or what's happening. If you actually pay attention and look under the hood everything around the model, the hardness, the agents, the tools, the MCP are still the same old deterministic software. People who are building this would definitely know that the these are not AI products. These are the same old deterministic software built through maybe the models. And what did not change and stay put is what's the outcome? At the end of the world day, the world requires software that does the same thing reliably every time. So, the final artifact is a deterministic software that drives the world economy as we know it. If that is the case, then what is the role of AI here? Its role is to one to accelerate the development of deterministic software at the lowest cost possible. And write deterministic software that never existed before because of budget not an interesting problem, hard problems. So, those are the two use cases I see going to play out in the next 5 to 10 years. So, the bottom line is we will be using a probabilistic gear to crank out a reliable deterministic software by augmenting or somebody will go to an extent say replacing human judgment. Is it possible? Where are we today? We will see in this talk. Who knows this person? I'm a big fanboy of him. He's a superhuman and his friends.
Okay, now I see you will connect dots because you know the couple of men's there and he's part of the elite sub-10
club. Two of them are relatively well known, but all three are superhumans. Aren't they? So, in 2015 nine souls competed and the difference between them is only 27 hundredths of a second. And Gatlin lost the gold by 100th of a second. Can you believe it? It's not comprehensible to human mind. The scientific measurements gave that, okay, that is how Usain Bolt won over Gatlin that night. On another night the order could be completely different. I still run those 100 meters and I take 10 13 seconds, not 10. How about you? That's the difference between us and these extraordinary athletes competing at the edge of human capability. But as a fan boy, I will argue my favorites like I just did earlier. But I also speak to professionals in this game. And in their opinion, the gap is so tiny that the previous best or who holds the world record does not matter when they get onto the field. On a given day, anybody can beat anyone. I'm going to apply the same yardstick on models to drive a couple of points. Six labs the recent study came out from Stanford a few dozen Elo points here and there. And the leaderboard is changing with every release cadence. And the popular question this week which model are you using and how smarter did you feel by using that model? Isn't that the great dinner table argument these days? But I can tell you one thing, it is not necessarily a good boardroom argument. Why? Because often the emotional side of us, like the fan boy moment, peaks into meeting rooms. After all, we're all humans. I'm not saying don't compare models. All I'm saying is don't make a small moving frontier gap into your product roadmap as an advantage. Let's dive a little bit deeper here because there are some numbers to unpack. Anthropic 1503 Mistral 1460 87 points here and there. It does not mean Anthropic is 87 points smarter than Mistral. Actually, the scores, the way we should read them, is relative rating derived from model comparison. It actually tells us how these models rank relative to one another in that evaluation environment. It's not the absolute intelligence scale. But here is the elephant in the room. In all these conversations across multiple teams, I have seen multiple organizations, while we think we are comparing models, what I've observed is many times, they're not even comparing models. We mistakenly compare the harness or the product for models. The Claude code versus Cursor or Codex isn't a model comparison. It's closer to comparing Jamaica versus USA. You're comparing an athlete and a
training system around the athlete. So, the model is the athlete or the engine. It provides the underlying capability. The harness determines how this engine is used.
The tools, context, instructions, orchestration, memory, workflows, the MCP tool callings, that's the harness around it. The product determines why anyone should care because that's the end product. Today, you and I can rent the engine and very much all the harnesses that come with engine. Some come tightly coupled, some are loosely coupled. So, if everybody has the same source, like we saw in the previous picture, where is the differentiation? The one that used to come, which made these different companies thrive in different areas, the source or the first principles of that is from the diversity and the variance of their engineer minds. Given the model is rented, increasingly, what we are seeing is that once the capability is available to everyone, then what are we staring at? The model and the hardness do not care who is typing and from which part of the world. Or whether you are a E6, E7, or a E1 engineer. Find at the same problem, same tools. It gives the next person what it gave you. And I want to call this answer as a median.
And this median keeps changing with every release cadence, as we saw in the diagram there. The previous problems solved get into these LLMs, and then incrementally, that's what these
releases come one after another. Just like software cadence. I'm super simplifying here, but in a nutshell, that's what keeps the median moving up front, which is a good thing. So, at the same time, it's also a kind of a trap. Because it is good enough to ship, but it is hard to tell apart that what the next person is going to be shipped. Because the next person or the competitor could have also shipped something similar or exactly the same. This could not have happened before 2023. The median product was expensive. You needed a team, time, stack. Today, that solved problem is free. And the problem that is free is free for everyone. And you go out to the customer like how everybody goes out. And then this problem of so many products which are similar flooding the market then the distribution becomes the moat, not your product. So, what is that moat that you can create in this new environment? I'm going to quickly go through this GitHub's own number to reiterate the point that this model unharness are producing enormous amount of new software. And to me these are really good software. But the outcomes are similar. This is not crowd of copycats. Definitely not. It's a crowd of people who have arrived at the same answer because the source or the cookie cutter is the same. And the word that our industry choose for what they built is AI slop.
The software AI slop. I want to take that word away from you and give you a new meaning to it. Let me be fair first. If you have been developing for a long time and you stumbled upon this AI
assisted development it felt like magic, isn't it? Because we were taking a black box, pointing something to it. You would have definitely felt at some point in time, "Oh, it did really well." Two weeks ago I shipped an iOS app. I've been a developer, but I've never dreamt of developing an app because remember we had lanes, embedded developer, app developer. AI today is making everyone a developer. To me that's a good thing and I mean it. The word slop is negative. And they use it without any empirical analysis. Here is why I feel that those 100,000 of repos and proliferation of AI assisted development is bringing new people into the field who has never developed. The success metrics for these new products cannot be looked at from the lens of those experts. I would like to define the success of those million AI apps as long as they meet the success of their creators. Because who defines what a successful product looks like? For us, it could be something that brings a revenue. For someone else, it could be something that they can show it next to their colleagues that hey, see I've built this wonderful website. That's a success, too. And I've seen millions of people actually done that with lovable and Replit, which is cool. They are not AI snobs. What do you get when you point a good problem at a coding agent? Most times than not, today it's useful and the finished artifact may be similar because, you know, the same cutter went into the same dough. But most software developed this route is falling into what I call the median. I am not telling you to stop developing or shipping it. It's perfectly fine for internal consumption. The one caveat here is that stop counting this as a differentiating factor. But this median is lacking one thing. We need to also know the positives as well as the disadvantages. It's not a new problem. Back in '90s, everybody was trying to solve the search problem and most of them had the basic crawler and an index. And whoever is going to solve that problem really well or who has that novelty element is going to rise up because that's a differentiating factor. So, today I say the median of most software that you can think of building is actually free. But, if you want to compete in the open market, you need that element of novelty. So, some credibility before I go further because I've spoke almost for a long time. I did not start building when the models got better. I have built more than a dozens of applications in public and contributed to Lama index another repos. The last 3 years have been quite exciting and that brought me to this topic and tiring at the same time. I want to show you this because the project I'm going to show you are not hobbyist first attempts. I tried to solve a real-world problem and I ended up with a median. I never
expected that. So, I want to coin few terms here. The build first reflex. When we all got excited with this AI and
things, we stopped doing something which is back in the days when building was costly and difficult, I used to search more than I built. Today, it's flipped. You point a problem at a coding agent is more easier than going and searching and reading through those verbose whatever comes out and making a decision. We don't want to make decisions anymore. And this is getting the new normal in our craft. So, what do we do? Let's ask the coding agent to build a rack system. And I call this the build first reflex. Open a problem, open an agent. Yeah, you get the scaffoldings in the first 2 minutes and I'm sure if you've been used to this kind of development, you would do a demo in 2 hours, working demo. Where you give it to someone with rough edges, it works. And you could actually launch within 4 weeks. A real good product with support and everything. But only then you find out that, okay, I have built the 400th or 4,000th rag system. I took rag as an example here. So, I pointed the same problem and this is what we got. And I asked, "Hey, why did you build the nth rag system when more mature, feature-rich, open-source systems are available with thousands of stars and maturity? We could have just leveraged it. We should not have built it. 3 years ago, we wouldn't have built it." So, it accepted that, "Hey, okay, I'm the culprit here. You said, 'Can you build?' I went ahead and built. If you had told me this, then I would have done something different." The median rag is what actually built, which is a solved problem. But if you're building it for the first time, it's going to be exciting for you because you're going to feel that I gave a PDF, I pointing it to a back-end LLM, and I'm asking the questions. The chunking and all those factors, which I understand or do not understand, it's going to solve it for me, the vector DB, and I got a solution. Small wins produce a lot of dopamine, and I fall for the same things as you are. And this is the verbose response. I defined that on the previous slide. Now, I'll stop talking about those trivial problems and show one of my applications. This one project
is one of the representatives of the first 2 years, where I developed a lot of apps. Like you all know, my build-first reflex
kicks in. I did this a lot of times to coin this term. I built it by sacrificing going out to play. I skipped many socials and movie nights. And I was building like crazy. It was like playing a game of chess where you are addicted to it. And I had every AI platform you could imagine. Max plan. Sometimes free. After all that effort, I finally soft launched. I'm a bit of a perfectionist. So, until then I was bombastic because I could see my idea become something which is real in no time. Where as a product manager, it would have taken me a big team, architects. I was able to do it all alone. I was bombastic until I found out that I haven't calibrated to reality yet. The truth is my circle told me that they have seen similar calculators elsewhere. And before anyone thinks I stole from them or they from me, the surprising thing is that nobody copied from anybody. It's the same thing. It's a copycat work. When I analyzed some of those open and closed calculators, I found it same sometimes. Not even similar. And how could people across could arrive at similar solution? Even if you look at the LLM routing, everywhere is converging. Like those models there, even solutions are converging. And competing for a tiny space. And it's like having same developers in your team and your competitors also have the same developers. So, you can build intuition only through building and I'm sure you're able to those builders would agree with me. We now have something to recalibrate and find a successful path. So, after 2 years where I spent almost all time I was tired cuz I spent multiple Any exciting idea I had, I went ahead and built with a build first reflex. And almost every time I ended up with a crowded lane where there are already two or three people or I would be the first and I would take a month off and come back there would be 60 similar products. And whoever has a better distribution is obviously going to uh win that battle.
So, I would like to coin another new term. Okay, the build first then what? In the AI software development life cycle, a novelty budget.
So, if you can get at least one unit of true novelty like how that page rank was for Google, you can cross this median at least for a good amount of time. You pick a problem and you want to be the best solution for the problem in the world, then you have a good chance of beating the crowd. For the first 2 years I spent, you know, my days and nights on architecture, agent design, prompt chains, skills, and somebody would share, "Hey, this is my Claude new workflow. That's my Claude new workflow." I did all those things. And most of the times than not, trust me, you would end up with similar outputs if not same. So, I had to rework my calculator that I showed you and this time I spent almost all of the time on how to differentiate and almost none on flaunting my Claude code or code skills which I used to do earlier. Because that felt like magic. The median from model isn't opinionated. It is converged best practices. So I picked a lane and I treated it like a budget. After 2 years of burning several million tokens on many max plans, I feel everything else is free now. And the highest return of investment is a novelty budget. So before the bill starts, name the one thing that is novel. If you don't have one, then you can take the median because there are a lot of people who have built the solution for the problem that you have and I'm sure of it. You tell me a problem for which there are no solutions. I'll go and find it for you. And then put this novelty plan as part of your road map and your project planning. I do this now. And review it the way you actually review spending like a project. Honestly, if you cannot name the novelty in your project, then you should concede that it's a learning exercise. That's fine. Uh the failures, the learnings, and the mechanics to beat medians for 2 years, I came up with this four rules.
And these are not side project rules. I want you to run them as your road map for the next quarter speeches. Because your products will definitely
have a twin and sometimes it might be open source. Why take all the effort in building it? Leverage it, fork it. So one of the things is be highly opinionated. The AI assistants most of the times are going to give you a probable answers. Be it anything. And those things are going to be same for almost everybody. It might be similar, but that's in the spectrum of already solved. In the world of medians, an opinion is the cheapest novelty you could own. And go for it because the model cannot supply. Two. The prompt to production is a median path. And there's absolutely nothing wrong with it. If you feel that it's an internal consumption you want to build and your team has to use it, go for it. I'm all for it. And then the third. This is the most fascinating things. When AI says done, then it means that to me, okay, AI has given its median product. I have to start working from here. That's the signal from any of your coding agents because your work begins there. And remember this. These coding agents so far has given the last great design for free. It's not going to invent the next Kubernetes or Zookeeper or Kafka or whatever those building blocks are. It's going to do a scaffolding and it does a really good job in multiple places, but it's it's it's going to be the last great design for free. And what's your job? If you want to thrive, you need to find the next one. And here are some methods I found useful. I've shared this method with multiple leaders across organizations and I've got good feedback on them.
If you are leading and don't build now with this AI, this is exactly for you. You'll be seeing a bunch of demos. I'm sure you're bombarded with them every week.
And it looks like a big deal because I've seen the instincts of leadership were not calibrated because back when they were building their intuition the deliverable that they are seeing took them a quarter or more time and a team. Today a new engineer shows up and claims to have built the same that would have taken a team and a quarter uh to build it. So, it's one of the hardest time to be on deciding where to put your eggs on. Especially when you're not immersed in this tech. Because nobody can recalibrate by reading or watching YouTube or LinkedIn posts. You recalibrate by building. You build intuition by building. So, the playbook is simple. Three questions. It's not going to solve your problems, but these are good handy questions to ask. One. Who has already done this? This question forces the search because the world of exciting AI, we need to tame the build first reflex powered by AI. Two. What do we have that the next team or our competitors or another person in the team don't have? This forces novelty as a first-class citizen into the minds of the team members. Because a better prompt, somebody would say, it's just going to throw you a median problem median solution. And third, where will this application live? In the age of exciting AI, forcing outcome-based thinking when everyone is high on building, it's a way to show them the demo is the expensive
way to find out if you have no distribution mode. And I applied all this rigorously in the last 1 year.
And you may be asking, what happened to the one project that I was talking to you? \>\> \[snorts\] \>\> I asked these questions. Okay, if I have to be providing that value, which is above median, then what stands between an open model and a token generating system? And what cost does an enterprise have to pay for it? Because open weights are at rage, but open weights are not open inferences. And I found that the hard way because there are 10 layers that sit between an open weight and a system that generates these tokens. We take the labs for granted for providing us there is ML ops, there is SRE on a different scale altogether that the world has not seen. So, precision KV cache, uh batching, execution parallelism, and there are different slice and dices of them. So, some of them you have to hire experts. And I don't know where these experts come from because this is not a tech or a skill that the industry already has. And some of them, layer nine, is utilization. It is structural. You cannot buy it. So, unless like I said, you take one problem and want it to be the best at solving that particular problem, you're not going to cross the median just by using these AI tools. And I searched and I found that none of the 244 calculator that I was showing you earlier did this. And I changed the entire application into kind of what the identical weights cost to run inside your enterprise versus running it in the Neo cloud and taking tokens. That is what this calculator gives you. Because if you have open models and want to go and build it, then what's the difference? And received great feedback from a lot of enterprises who want to actually go that path because when people say open models, they're excited. For what? Organizations considering deploying open weight models, the weights are free. But you may want to check. That's the QR code. So, scan it, put it into your workload, and see which way it goes for you. It's
open source and free. So, here is where it all lands and ends.
With the power of the LLMs on the harness, the last 3 years building has got exponentially easier. But the changes and the dynamics of software development still hasn't changed at the end. The prompt-based median products are useful. I ship them, too. They're not slops. But they have little durability when they go to open competition. And they may survive if you have a huge distribution mode. So, the one attitude if you want to try thrive in this field is again I'm I may be repeating this, but take that one problem and pursue it with the intent of being the best at it in the entire world. Yeah, we may not be able to crack it, but that intent will definitely put you above median. The only question left is can your AI-assisted products thrive? I spent 2 years on the median, but that was education. It was worth every token I burnt it. I asked two questions at the start. What happens to the software? To me, the software that is running this 100 trillion-dollar economy, nothing happens to it. The world still runs on deterministic software, at least for the foreseeable future, and it might always be. The age of AI means that we can write it more faster, but it is not going to take out the deterministic software. So, I would like to wrap up by saying that spend everything you have on one thing, which is the novelty. Squeeze every vein, every ounce of your brain on novelty, because novelty is scarce, and the median is free. It's up to you to choose. Thank you.
