Skip to content

HoloDeck - AI Agent Experimentation Platform

HoloDeck Logo

HoloDeck is an open-source experimentation platform for building, testing, and deploying AI agents through YAML configuration. Define intelligent agents entirely through configuration—no code required.

Key Features

  • No-Code Agent Definition: Define agents, tools, and evaluations in simple YAML files
  • Multi-Provider Support: Ollama (local inference), OpenAI, Azure OpenAI, Anthropic
  • Flexible Tool Integration: Vector stores, custom functions, MCP servers, and AI-powered tools
  • Built-in Testing & Evaluation: Run evaluations with multiple metrics, customize models per metric
  • Multimodal Test Support: Images, PDFs, Word docs, Excel sheets, and mixed media in test cases
  • Agent Server: Deploy agents as REST APIs or AG-UI endpoints for integration with web apps
  • OpenTelemetry Observability: Built-in tracing, metrics, and logs with OTLP export

Get Started

uv tool install holodeck-ai@latest --prerelease allow --python 3.10

Installation Guide | Quickstart Tutorial

Documentation

Examples

Browse complete examples including basic agents, tool integrations, evaluations, and configuration patterns.

Project Status

Version: 0.3.0

  • Core configuration schema (Pydantic models)
  • YAML parsing and validation
  • Environment variable support
  • CLI interface (holodeck command with init, test, chat, serve)
  • Agent execution engine (LLM provider integration, tool execution, memory)
  • Interactive chat with spinner, token tracking, and adaptive status display
  • Evaluation framework (AI-powered and NLP metrics with threshold validation)
  • Agent Local Server with REST API and AG-UI endpoints
  • OpenTelemetry instrumentation with OTLP export
  • Multi-agent orchestration (planned for v0.4)

Community & Support

  • GitHub Issues: Report bugs or suggest features
  • Discussions: Ask questions and share ideas
  • Contributing: Read contributing guide to get involved

License

MIT License - See LICENSE file for details