Observability

Monitoring, logging, and performance tracking for LLM Proxy.

What’s in this section

• Instrumentation - Event middleware, async event bus, and dispatcher integrations
• Distributed Rate Limiting - Redis-backed rate limiting across instances
• HTTP Response Caching - Cache configuration and performance
• Coverage Reports - Live test coverage report
• Coverage Setup - Setting up coverage reporting

Event Flow

Request → Proxy → Event Bus → Dispatcher → Backends
                     ↓
              [Lunary, Helicone, File]

For detailed event flow documentation, see the Instrumentation Guide.

---

Table of contents

• Instrumentation
• Distributed Rate Limiting
• HTTP Response Caching
• Coverage Setup