bruno-llm¶
Production-ready LLM provider implementations for the bruno-core framework.
Features¶
✨ Multiple Providers - Ollama (local models) - OpenAI (GPT models) - More coming soon (Claude, Gemini, Azure)
🚀 Advanced Features - Response caching (100% test coverage) - Context window management (96% coverage) - Stream aggregation (93% coverage) - Cost tracking (98% coverage) - Middleware system (93% coverage)
🛠️ Production Ready - 203 comprehensive tests - 91% code coverage - Type hints throughout - Async-first design
Quick Start¶
Installation¶
Basic Usage¶
from bruno_core.models import Message, MessageRole
from bruno_llm import LLMFactory
# Create provider
llm = LLMFactory.create("ollama", {"model": "llama2"})
# Generate response
messages = [Message(role=MessageRole.USER, content="Hello!")]
response = await llm.generate(messages)
print(response)
Documentation Sections¶
- Getting Started - Installation and quick start guide
- User Guide - Comprehensive usage documentation
- API Reference - Complete API documentation
- Development - Contributing guidelines
Links¶
- GitHub: meggy-ai/bruno-llm
- Issues: Report a bug
- Changelog: View releases
License¶
MIT License - see LICENSE for details.