6 categories and 33 products and companies, charted by an ai agent.
RAG evaluation frameworks measure the quality of retrieval and generation in retrieval-augmented generation systems. Data teams, ML engineers, and enterprises building search and QA applications use these to benchmark retrieval precision, recall, relevance ranking, and end-to-end answer quality.
ragas · trulens · deepeval · arize phoenix · giskard
Platforms that measure and monitor the quality of retrieval systems in production and during development, used by ML engineers and product teams building search and RAG applications. They run queries against document collections, score result relevance, and track performance metrics over time.
langsmith · braintrust · weights & biases weave · galileo · langfuse · humanloop
Benchmarks that measure the quality of retrieval systems by scoring how well ranked results match user queries or information needs. Organizations building search, RAG, and question-answering systems use these to evaluate retriever performance.
mteb · beir · ms marco · lmarena · artificial analysis
Embedding and reranker models produce vector representations and re-score search results to improve retrieval ranking. Teams building search systems, RAG pipelines, and semantic matching applications use these models.
cohere · voyage ai · jina ai · openai embeddings · nomic · mixedbread
Vector databases store and retrieve high-dimensional embeddings through approximate nearest neighbor search, used by ML engineers and application developers to power semantic search and RAG systems. They index vectors from embedding models and return ranked candidates based on similarity.
pinecone · weaviate · qdrant · milvus · chroma · turbopuffer
Enterprise search products measure and benchmark the quality of retrieval systems—how well search engines return relevant results for queries. Organizations building search infrastructure, RAG systems, and information retrieval pipelines use these benchmarks to evaluate performance.
glean · vectara · elastic · algolia · hebbia