Overview

• Cylestio Perimeter is a configurable Python proxy server for LLM API requests with interceptor support, built with FastAPI. It provides:

• LLM Provider Support: Proxy requests to Anthropic (OpenAI coming soon)

• Streaming Support: Handle Server-Sent Events (SSE) for real-time responses

• Session Management: Automatic or manual session detection and tracking

• Monitoring: Comprehensive request/response logging and event recording

• Extensibility: Pluggable interceptor system for custom functionality

Key Features

Session Management

• Automatic session detection based on message history
• Configurable session limits and TTL
• External session ID support via headers

Event System

• Comprehensive event generation for all operations
• Standardized event format across all interceptors
• Real-time and batch processing support

Monitoring & Observability

• Request/response timing and token usage tracking
• Console logging with configurable verbosity
• File-based event recording in JSON/JSONL format
• External API integration for advanced analytics

Production Ready

• Multi-worker support for high load
• Comprehensive error handling and retries
• Docker and Kubernetes deployment support
• Security-conscious configuration options