Lunary is an open-source LLM chatbot and agent platform, focused on observability, prompt management, testing, and other features, aiming to help enterprise teams build, deploy, and scale AI applications with more confidence.
[Main Capabilities]
- Observability and analytics: View LLM performance and how users interact in real time, track model usage and costs, analyze high-frequency topics and user satisfaction, and support custom dashboards.
- Debugging and tracing: Record all prompts and results, view how agents run in production, provide tracing and error stack information, instant search and filtering, and data annotation (for fine-tuning).
- Prompt management: Create prompt templates, collaborate with non-technical team members to iterate on prompts, and keep source code clean.
- Testing and evaluation: Score LLM responses and track user feedback; allow teams to judge LLM responses; experiment with prompts and LLM models without coding.
- Integration and data capture: 1-line code integration, with a lightweight SDK that seamlessly connects to the codebase; support capturing LLM data across the entire tech stack, compatible with any LLM and any framework, and can connect to preferred data destinations.
- Multimodal and multilingual: Full support for text, audio, and images; can identify the language users use; supports grouping conversations by topic to quickly discover trends.
- Notifications and search: Receive notifications when agent performance does not meet expectations; search and filter anything in milliseconds.
[How to Use] Integrate with 1 line of code and connect to an existing codebase using the lightweight SDK. Cloud workspaces require paid activation; self-hosted deployment is also available, supporting Kubernetes or Docker deployment in your own VPC or private cloud.
[Applicable Scenarios]
- Internal knowledge base: Help teams access company knowledge and automate workflows, monitor usage, and improve based on real feedback.
- Customer support: Build customer-facing chatbots that understand documents and provide accurate replies, track satisfaction, and continuously improve.
- Autonomous agents: Deploy autonomous agents that perform complex tasks, monitor performance in real time, and detect errors as early as possible.
- Suitable for everyone from next-generation startups to mature enterprises.
[Limitations and Compliance] Lunary has passed SOC 2 Type II and ISO 27001 certifications and is designed for self-hosting, which can protect sensitive data and avoid GDPR compliance hassles; it supports RBAC and SSO to ensure controllable data access permissions. Cloud workspaces start at $20 per user per month, and workspace activation requires payment.
