Tool Hut
Best AI developer infrastructure
These 28 AI developer infrastructure tools handle the plumbing — vector search, orchestration, evals, and observability — behind production AI apps. Compare how each fits your stack and what it costs as traffic grows.
Open Tool Hut — it's free →-
LangChain
Framework for building LLM-powered apps — chains, agents, RAG, memory, tool use.
Best for LLM app development, RAG pipelines, agents, Python and JavaScript developers
-
LlamaIndex
Data framework for LLMs — index, query, and retrieve from any data source.
Best for RAG pipelines, data indexing for LLMs, multi-source knowledge bases, production retrieval
-
Weights & Biases
MLOps platform — experiment tracking, model evaluation, fine-tuning monitoring.
Best for Experiment tracking, fine-tuning monitoring, model evaluation, MLOps teams
-
Hugging Face Spaces
Free hosting for ML demos and Gradio/Streamlit apps — try any model instantly.
Best for Demos, Hosting, Gradio, AI Application Infrastructure
-
Firecrawl
Web scraping API for AI — turns any URL into clean markdown for LLM ingestion and RAG pipelines.
Best for Scraping, RAG Pipelines, API Access, AI Application Infrastructure
-
Pinecone
Managed vector database — store and query billions of embeddings for semantic search and RAG at scale.
Best for RAG pipelines, semantic search, production embedding storage, LLM knowledge bases
-
Weaviate
Open-source vector database with hybrid search for AI apps.
Best for Vector Search, Open-Source Deployments, Hybrid Search, AI Application Infrastructure
-
Chroma
Lightweight open-source embedding database for prototyping RAG.
Best for Vector Search, Open-Source Deployments, Embeddings, AI Application Infrastructure
-
Qdrant
High-performance open-source vector database written in Rust.
Best for Vector Search, Open-Source Deployments, Rust, AI Application Infrastructure
-
pgvector
Postgres extension that adds vector similarity search to your DB.
Best for Vector Search, Postgres, Open-Source Deployments, AI Application Infrastructure
-
LangSmith
LangChain's platform for tracing, testing, and monitoring LLM apps.
Best for Observability, Tracing, Eval, AI Application Infrastructure
-
Langfuse
Open-source LLM observability, tracing, and prompt management.
Best for Observability, Open-Source Deployments, Tracing, AI Application Infrastructure
-
Helicone
Open-source observability and cost tracking proxy for LLM calls.
Best for Observability, Cost, Open-Source Deployments, AI Application Infrastructure
-
Braintrust
Eval and prompt-iteration platform for shipping reliable AI features.
Best for Eval, Prompts, Testing, AI Application Infrastructure
-
Arize Phoenix
Open-source tracing and evaluation for LLM and RAG pipelines.
Best for Observability, Open-Source Deployments, Eval, AI Application Infrastructure
-
Ragas
Open-source framework for evaluating RAG pipeline quality.
Best for Eval, RAG Pipelines, Open-Source Deployments, AI Application Infrastructure
-
Haystack
deepset's open-source framework for RAG and search pipelines.
Best for Framework, RAG Pipelines, Open-Source Deployments, AI Application Infrastructure
-
DSPy
Stanford framework for programming — not prompting — language models.
Best for Framework, Prompts, Optimization, AI Application Infrastructure
-
Instructor
Get structured, validated JSON out of LLMs using Pydantic.
Best for Structured Output, Json, Python, AI Application Infrastructure
-
Pydantic AI
Type-safe agent framework from the Pydantic team.
Best for Framework, Agents, Python, AI Application Infrastructure
-
Semantic Kernel
Microsoft's SDK for orchestrating models, memory, and plugins.
Best for Microsoft, Framework, Orchestration, AI Application Infrastructure
-
Apify
Web scraping and automation platform that feeds clean data to AI.
Best for Scraping, Automation, Data, AI Application Infrastructure
-
Bright Data
Large-scale web data collection and proxy infrastructure for AI.
Best for Scraping, Data, Proxy, AI Application Infrastructure
-
Tavily
Search API built for LLM agents — clean, citation-ready results.
Best for Search API, RAG Pipelines, Agents, AI Application Infrastructure
-
LlamaParse
LlamaIndex's parser that turns messy PDFs into clean data for RAG.
Best for Parsing, Pdf, RAG Pipelines, AI Application Infrastructure
-
Jina AI
Embeddings, rerankers, and a reader API for building search and RAG.
Best for Embeddings, Reranker, Search, AI Application Infrastructure
-
Streamlit
Turn Python scripts into shareable data and AI web apps fast.
Best for Python, Apps, Prototyping, AI Application Infrastructure
-
Chainlit
Open-source framework for building chat UIs over your LLM app.
Best for Chat Ui, Open-Source Deployments, Python, AI Application Infrastructure