RAG & Vector Databases

Vector Databases

Power your agents with Retrieval-Augmented Generation. 8 vector databases, universal configuration, MCP integration. Same RAG works across all 8 frameworks.

Works with:
DSPy logoDSPy
OpenAI SDK logoOpenAI SDK
CrewAI logoCrewAI
Google ADK logoGoogle ADK
Microsoft logoMicrosoft
DeepAgents logoDeepAgents
Pydantic AI logoPydantic AI
6
Vector Databases
7
Framework Support
MCP Integration
GEPA Optimization
Retrieval-Augmented Generation

What is RAG?

RAG enhances AI agents by providing access to external knowledge sources. Instead of relying solely on pre-trained knowledge, agents retrieve relevant information from your documents to provide accurate, up-to-date responses.

Semantic Search

Find relevant information based on meaning, not just keywords.

Knowledge Grounding

Ground AI responses in your actual documents and data.

Context Retrieval

Automatically retrieve relevant context for each query.

MCP Integration

Model Context Protocol for advanced tool and data access.

6 Vector Databases

Supported Vector Databases

From lightweight embedded databases to enterprise-scale distributed systems. Choose the right database for your use case.

ChromaDB logo

ChromaDB

Local development, prototyping, small datasets

Lightweight, embedded vector database. Perfect for development and prototyping.

Zero config
Embedded mode
Auto embeddings
Persistent storage
Configuration:
retriever_type: chroma
vector_store:
  collection_name: my_knowledge
  persist_directory: ./data/chromadb
View Documentation
LanceDB logo

LanceDB

Production applications, high-performance needs

High-performance vector database built on Apache Arrow. Enterprise-grade with ACID compliance.

Apache Arrow
ACID compliant
Version control
Cloud native
Configuration:
retriever_type: lancedb
vector_store:
  table_name: knowledge_table
  database_path: ./data/lancedb
View Documentation
Weaviate logo

Weaviate

Enterprise deployments, rich ecosystem needs

Cloud-native vector database with rich ecosystem and GraphQL API.

GraphQL API
Multi-tenancy
Hybrid search
Cloud offerings
Configuration:
retriever_type: weaviate
vector_store:
  url: http://localhost:8080
  class_name: SuperOptiXKnowledge
View Documentation
Qdrant logo

Qdrant

High-throughput applications, complex filtering

Blazingly fast vector database with advanced filtering and payload support.

Ultra-fast
Rich filtering
Payload support
Rust-powered
Configuration:
retriever_type: qdrant
vector_store:
  url: http://localhost:6333
  collection_name: superoptix_knowledge
View Documentation
Milvus logo

Milvus

Massive scale, distributed systems, enterprise

Cloud-native, distributed vector database for massive-scale deployments.

Billion-scale
Distributed
GPU support
Multiple indexes
Configuration:
retriever_type: milvus
vector_store:
  host: localhost
  port: 19530
  collection_name: superoptix_knowledge
View Documentation
SurrealDB logo

SurrealDB

Hybrid retrieval, metadata filtering, unified app + vector storage

Unified operational + vector database with embedded and Docker modes, including hybrid retrieval workflows.

Embedded in-memory
Persistent surrealkv://
Docker/WebSocket mode
Hybrid retrieval
Configuration:
retriever_type: surrealdb
vector_store:
  url: surrealkv://./.superoptix/surreal.db
  namespace: test
  database: test
  vector_field: embedding

Database Comparison

DatabaseScaleSetupBest ForPerformance
ChromaDBSmall-Medium
Zero config
DevelopmentGood
LanceDBMedium-Large
Zero config
ProductionExcellent
WeaviateLarge
Docker
EnterpriseExcellent
QdrantLarge
Docker
High-throughputBlazing
MilvusMassive
Docker Compose
DistributedEnterprise
SurrealDBSmall-Large
Embedded/Docker
Hybrid + metadata-aware RAGFlexible
Universal Configuration

RAG Setup

Same RAG configuration works across all 8 frameworks. Just add the rag section to your playbook.

# Basic RAG configuration (works with any framework)
spec:
  target_framework: openai  # or dspy, crewai, google-adk, etc.
  rag:
    enabled: true
    retriever_type: chroma  # or lancedb, weaviate, qdrant, milvus, surrealdb
    config:
      top_k: 5
      chunk_size: 512
      chunk_overlap: 50
    vector_store:
      embedding_model: sentence-transformers/all-MiniLM-L6-v2
      collection_name: knowledge_base

Universal Workflow

$ super agent compile <agent>RAG automatically configured
$ super agent evaluate <agent>Test with knowledge retrieval
$ super agent optimize <agent> --auto mediumGEPA optimizes RAG-enhanced agents
$ super agent run <agent>Use with RAG-enhanced responses
Model Context Protocol

MCP Integration

Combine RAG with MCP for advanced tool and data access. Connect to filesystems, databases, APIs, and Git repositories.

Filesystem

Access local files and directories

Git Repository

Search code and commit history

Database

Query SQL and NoSQL databases

API Endpoints

Connect to REST and GraphQL APIs

Best Practices

Document Quality

  • Use high-quality, relevant documents
  • Include comprehensive metadata
  • Regular updates and maintenance

Chunking Strategy

  • Choose appropriate chunk sizes (512-1024)
  • Use overlap to maintain context
  • Consider semantic boundaries

Embedding Models

  • Use domain-appropriate models
  • Consider multilingual needs
  • Balance quality vs performance

Database Selection

  • ChromaDB for development
  • LanceDB/Qdrant for production
  • Milvus for massive scale

Performance Tuning

  • Monitor retrieval latency
  • Optimize chunk sizes
  • Implement caching strategies

GEPA Optimization

  • Enable RAG optimization
  • Use auto: medium for start
  • Monitor relevance metrics

Power Your Agents with RAG

From lightweight ChromaDB to enterprise Milvus. Choose the right vector database and start building knowledge-grounded agents today.