Skip to content

embedding

What an embedding is in this material In the channel's captured conversation with Linus Lee, an embedding is a list of numbers that summarizes what a piece of text or image means. Two metaphors make it concrete: - Coordinates: an embedding is like assigning text a latitude and longitude, so similar meanings sit close together on the map. [^3e5745ab-279e-5154-9c22-9015dba70a32@713] - A color picker: “crimson” is the word; the RGB value is the embedding. You can't do math on the word, but with numbers you can algorithmically make the color lighter or more blue. [^3e5745ab-279e-5154-9c22-9015dba70a32@713] Why embeddings matter Lee frames embeddings as a way to make AI tools more precise: when you work with dials and numbers instead of requests to an entity, the experience feels like a tool you control — and you retain more agency. [^3e5745ab-279e-5154-9c22-9015dba70a32@1013] Because a model like CLIP places text and images in the same embedding space, you can pick a point between two concepts — say, a butterfly and the French flag — and decode it back into an image mixing both. [^3e5745ab-279e-5154-9c22-9015dba70a32@1013] Embeddings in practice Lee built a half-finished prototype called Varna to explore this: it samples points along the line between two images in embedding space and decodes each one, like a slider between concepts — from his selfie to a clip-art face, or from “happy young man” to “very angry young man.” [^3e5745ab-279e-5154-9c22-9015dba70a32@1013] - An embedding is a numeric summary of meaning — coordinates for text or images in meaning-space. [^3e5745ab-279e-5154-9c22-9015dba70a32@713] - Numbers make meaning computable: you can algorithmically interpolate between concepts, the way you can shift an RGB color. [^3e5745ab-279e-5154-9c22-9015dba70a32@713] - In shared embedding spaces like CLIP's, you can decode points between concepts back into images; Varna turns that into a concept slider. [^3e5745ab-279e-5154-9c22-9015dba70a32@1013]

glossary term

Ready

Loading…

2 min read