--- schema: 1 type: video title: 'Under 5 minutes to a deployed LLM endpoint — Audry Hsu, RunPod' description: >- Two failed crypto mining rigs in a basement in 2022. The founders posted on Reddit offering the GPUs for free in exchange for feedback. That is the origin of RunPod, now at $120 million in annual recurring revenue with 500,000 developers on the platform. The demo runs in under five minutes: pick a model from the Hub, configure a context window, deploy a serverless endpoint on H100s. First request queues for 41 seconds on cold start while the container initializes and the model downloads. Every request after that executes in about 1.5 seconds. You pay only while a worker is handling a request. Speaker info: - https://www.linkedin.com/in/audry-hsu/ --- Watch along with the corrected transcript, summary, timestamps and resources on this talk's official AIE page: https://ai.engineer/talks/ILdE7FaAjVA-under-5-minutes-to-a-deployed-llm-endpoint-audry-hsu-runpod Join our upcoming AI Engineer conferences (see https://ai.engineer landing page): - AIEi Shanghai, November 5–6 — the first for meeting top Chinese labs and engineers - AIE CODE in SF, November 10–12 — the top AI Coding conference returns - AIEi Sydney, December 7–8 — the first AIEi run alongside NeurIPS 2026 in Sydney --- canonical: >- https://liquidgold.cc/channel/aidotengineer/explore/video/under-5-minutes-to-a-deployed-llm-endpoint-audry-hs-fd517b6916e5 markdown: >- https://liquidgold.cc/channel/aidotengineer/video/under-5-minutes-to-a-deployed-llm-endpoint-audry-hs-fd517b6916e5.md llms: null parent: 'https://liquidgold.cc/channel/aidotengineer.md' channel: aidotengineer updated: '2026-10-24T09:46:38.245Z' language: null children: [] videoId: ILdE7FaAjVA durationSeconds: 806 publishedAt: '2026-06-07T16:00:32.000Z' searchChunks: - ordinal: 0 text: null startSeconds: 24 endSeconds: 106 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=24' heldReason: rights - ordinal: 1 text: null startSeconds: 24 endSeconds: 106 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=24' heldReason: rights - ordinal: 2 text: null startSeconds: 24 endSeconds: 106 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=24' heldReason: rights - ordinal: 3 text: null startSeconds: 116 endSeconds: 217 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=116' heldReason: rights - ordinal: 4 text: null startSeconds: 116 endSeconds: 217 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=116' heldReason: rights - ordinal: 5 text: null startSeconds: 217 endSeconds: 230 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=217' heldReason: rights - ordinal: 6 text: null startSeconds: 230 endSeconds: 312 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=230' heldReason: rights - ordinal: 7 text: null startSeconds: 230 endSeconds: 312 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=230' heldReason: rights - ordinal: 8 text: null startSeconds: 230 endSeconds: 312 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=230' heldReason: rights - ordinal: 9 text: null startSeconds: 323 endSeconds: 405 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=323' heldReason: rights - ordinal: 10 text: null startSeconds: 323 endSeconds: 405 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=323' heldReason: rights - ordinal: 11 text: null startSeconds: 416 endSeconds: 517 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=416' heldReason: rights - ordinal: 12 text: null startSeconds: 527 endSeconds: 652 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=527' heldReason: rights - ordinal: 13 text: null startSeconds: 527 endSeconds: 652 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=527' heldReason: rights - ordinal: 14 text: null startSeconds: 527 endSeconds: 652 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=527' heldReason: rights - ordinal: 15 text: null startSeconds: 665 endSeconds: 806 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=665' heldReason: rights - ordinal: 16 text: null startSeconds: 665 endSeconds: 806 watch: 'https://liquidgold.cc/watch/ILdE7FaAjVA?t=665' heldReason: rights --- # Under 5 minutes to a deployed LLM endpoint — Audry Hsu, RunPod Two failed crypto mining rigs in a basement in 2022. The founders posted on Reddit offering the GPUs for free in exchange for feedback. That is the origin of RunPod, now at $120 million in annual recurring revenue with 500,000 developers on the platform. The demo runs in under five minutes: pick a model from the Hub, configure a context window, deploy a serverless endpoint on H100s. First request queues for 41 seconds on cold start while the container initializes and the model downloads. Every request after that executes in about 1.5 seconds. You pay only while a worker is handling a request. Speaker info: - https://www.linkedin.com/in/audry-hsu/ --- Watch along with the corrected transcript, summary, timestamps and resources on this talk's official AIE page: https://ai.engineer/talks/ILdE7FaAjVA-under-5-minutes-to-a-deployed-llm-endpoint-audry-hsu-runpod Join our upcoming AI Engineer conferences (see https://ai.engineer landing page): - AIEi Shanghai, November 5–6 — the first for meeting top Chinese labs and engineers - AIE CODE in SF, November 10–12 — the top AI Coding conference returns - AIEi Sydney, December 7–8 — the first AIEi run alongside NeurIPS 2026 in Sydney --- Canonical: https://liquidgold.cc/channel/aidotengineer/explore/video/under-5-minutes-to-a-deployed-llm-endpoint-audry-hs-fd517b6916e5 · Channel: [AI Engineer](https://liquidgold.cc/channel/aidotengineer.md) > Search chunk text is held until public-source provenance is verified. ## Document chunks --- #### Chunk 0: Document excerpt (0:14 to 1:46) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 1: Document excerpt (1:46 to 3:37) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 2: Document excerpt (3:37 to 5:12) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 3: Document excerpt (5:12 to 6:45) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 4: Document excerpt (6:45 to 8:37) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 5: Document excerpt (8:37 to 10:52) > Held: transcript rights do not permit this chunk's text. --- #### Chunk 6: Document excerpt (10:52 to 13:26) > Held: transcript rights do not permit this chunk's text.