Education

Vector Databases Full Course for Beginners – Embeddings, Similarity Search & ChromaDB

by freeCodeCamp.org

Share:

📚 Temas principales

  • Qué es una base de datos vectorialAlmacena y organiza embeddings de alta dimensión para buscar información por significado. El curso explica su funcionamiento y cómo complementa, en lugar de reemplazar, las bases de datos tradicionales. 3:42
  • Vectores y métricas de similitudLos vectores son arreglos unidimensionales de números cuyas dimensiones representan características. Se comparan con métricas como la similitud del coseno, que mide la dirección, y la distancia euclidiana, que mide la distancia entre vectores. 22:34
  • Tokens y embeddingsLa tokenización convierte los datos en representaciones numéricas; los modelos de embeddings transforman esas representaciones en vectores que capturan significado y contexto. 45:16
  • Generación y visualización de embeddingsSe generan embeddings con el modelo de Google Gemini y se comparan con similitud del coseno. PCA reduce sus dimensiones para visualizarlos en un espacio tridimensional. 1:11:52
  • Arquitectura e índicesSe presentan las capas de API, indexación, almacenamiento y procesamiento de consultas, junto con IVF y HNSW como técnicas para acelerar la búsqueda. 1:22:07
  • Proyecto con ChromaDBEl proyecto genera embeddings, los guarda junto con los textos y sus identificadores, y luego recupera resultados mediante consultas semánticas. 1:29:26

✨ Conclusiones clave

  • Búsqueda por significadoLas bases de datos tradicionales suelen buscar coincidencias de palabras; las vectoriales permiten encontrar contenido relacionado aunque no incluya los términos exactos de la consulta. 12:37
  • Flujo de ingestión y recuperaciónEn la ingestión, los datos se convierten en embeddings y se almacenan con referencias y metadatos. En la recuperación, la consulta se convierte con el mismo modelo y configuración, y la base de datos devuelve los resultados más cercanos. 5:49
  • Búsqueda rápida mediante índicesEn vez de comparar la consulta con cada vector, las bases vectoriales usan índices y algoritmos aproximados de vecinos más cercanos para reducir el tiempo de búsqueda. 7:53
  • Elección de la métricaLa similitud del coseno prioriza la dirección y se usa ampliamente con embeddings; la distancia euclidiana mide la separación directa entre vectores. La métrica adecuada depende del problema. 33:37
  • Usos prácticosLos embeddings y la búsqueda vectorial pueden sustentar recomendaciones, búsqueda en lenguaje natural, sistemas RAG y detección de anomalías o fraude. 19:27

🧠 Lecciones aprendidas

  • Dimensiones y significadoCada dimensión de un vector representa una característica; en embeddings de alta dimensión, elementos con significados similares tienden a quedar próximos en el espacio vectorial. 26:13
  • Tokens no son palabrasLos tokenizadores pueden dividir el texto en caracteres, palabras o subpalabras; los modelos modernos suelen usar subpalabras para representar texto de forma más eficiente. 48:39
  • El contexto importaLos embeddings de palabras individuales no distinguen por sí solos los distintos sentidos de una palabra; los embeddings de texto pueden representar oraciones, párrafos o documentos. 1:04:29
  • Consistencia entre modelosPara comparar una consulta con los datos almacenados, hay que generar ambos embeddings con el mismo modelo y la misma dimensionalidad. 1:36:03

🏁 Conclusión y próximos pasos

  • Probar la búsqueda semánticaEn la demostración, consultar términos como “programming” o “electronics” recupera textos relacionados aunque no contengan esas palabras exactas. 1:37:39
  • Practicar el flujo completoEl curso termina mostrando cómo generar embeddings con Gemini, almacenarlos en ChromaDB y consultar la colección para recuperar resultados por significado. 1:38:10

Transcript excerpt

0:00 This beginner course teaches vector databases from scratch. Starting with vectors, cosine similarity and ukitian distance, then moving on to tokenization and embedding models. You'll generate embeddings in a live demo with Google's Gemini embedding model and see how a vector database works inside, including its storage indexing and the IVF and HNSW index types. The course ends with a

0:31 project where you store embeddings in Chroma DB and run semantic searches that find matches by meaning instead of by keyword. See if you want to learn vector databases in one shot then this video is for you. In this video I will literally hold your hand and teach you everything from scratch. No prior knowledge is required. I have 15 years working as a software engineer and 4 years working as a lead AI engineer. And let me tell you vector database is something you must know in 2026. Whether you are a software

1:03 engineer, an AI engineer or a machine learning engineer. Today technologies like AI agents, recommendation engines, rag application, enterprise knowledge bases are all powered by one core concept, vector databases. So by the end of this video, you will not only understand vector databases conceptually, but you will also gain hands-on experience working with vector databases. So here is what we will come. So in chapter one, we will understand the fundamentals. What exactly is a vector database? Why were vector

🔒 The full, searchable transcript is available with Pro.

🔒 Unlock Premium Features

This is a premium feature. Upgrade to unlock unlimited Q&A, transcripts, mindmaps, and translations.

Questions & Answers

Common questions about this video

What is a vector database?

A vector database is designed to store, index, and search high-dimensional vector embeddings generated by embedding models, enabling semantic search. 4:13

How does a vector database handle data during ingestion and retrieval?

During ingestion, raw data is converted into vector embeddings, which are stored with references to the original content and optional metadata. The database indexes the vectors to speed up search. During retrieval, the query is embedded using the same model, similar vectors are found, and the results are ranked and returned. 5:49

How do vector databases differ from traditional databases?

Traditional databases are optimized for structured data and keyword-based searches, while vector databases store high-dimensional vectors and use similarity search to retrieve content based on meaning. They are often used alongside traditional databases rather than replacing them. 12:37

What is the difference between cosine similarity and Euclidean distance?

Cosine similarity compares the direction of two vectors and does not depend on their magnitude. Euclidean distance measures the straight-line distance between vectors, so their positions and magnitudes matter. 33:37

What do embedding models do, and why do they matter for semantic search?

Embedding models convert tokenized data into vectors whose coordinates capture semantic meaning. Content with similar meanings tends to have embeddings close together in vector space, which makes meaning-based search possible. 58:45

What are IVF and HNSW used for in a vector database?

IVF, or inverted file index, and HNSW, or hierarchical navigable small worlds, are indexing techniques used to organize vectors for fast similarity search without scanning every vector one by one. 25:37

Why must a query use the same embedding model and dimensions as the stored vectors?

The query embedding must be comparable to the stored embeddings in the same vector space, so it needs to use the same embedding model and dimensions. 36:03

How does the ChromaDB demo show the difference between semantic and keyword search?

Searching for “programming” returns documents about writing a Python function and creating a Java class, even though neither contains the word “programming.” The match is based on meaning rather than an exact keyword. 37:39

🔒 Unlock Premium Features

Access to Chat is a premium feature. Upgrade now to unlock unlimited studying tools.

🔒 Unlock Premium Features

Access to Mindmap is a premium feature. Upgrade now to unlock unlimited studying tools.

🔒 Unlock Premium Features

Access to Translation is a premium feature. Upgrade now to unlock unlimited studying tools.

Get unlimited summaries, Q&A, transcripts and more with Pro

Upgrade to Pro

Suggestions

🔒 Unlock Premium Features

Access to AI Suggestions is a premium feature. Upgrade now to unlock unlimited studying tools.