Skip to content
Cylestio Docs

Installation

  • Cylestio Perimeter is a configurable Python proxy server for LLM API requests with interceptor support, built with FastAPI. It provides:

  • LLM Provider Support: Proxy requests to Anthropic (OpenAI coming soon)

  • Streaming Support: Handle Server-Sent Events (SSE) for real-time responses

  • Session Management: Automatic or manual session detection and tracking

  • Monitoring: Comprehensive request/response logging and event recording

  • Extensibility: Pluggable interceptor system for custom functionality

Prerequisites

Section titled “Prerequisites”
  • Python 3.8 or higher
  • pip package manager

Installation

Section titled “Installation”

  1. Install:

    Terminal window
    pip install cylestio-perimeter

  2. Create a config.yaml file:

    server:
      port: 3000
      host: "0.0.0.0"
    

    llm:
      base_url: "https://api.anthropic.com"
      type: "anthropic"

  3. Run Cylestio Perimeter gateway

    Terminal window
    cylestio-perimeter run --config config.yaml

Verification

Section titled “Verification”

Once the Cylestio Perimeter gateway is running, you should see:

INFO:     Started server process [12345]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:3000 (Press CTRL+C to quit)

Cylestio Perimeter gateway will now proxy requests to your configured LLM provider.

Next Steps

Section titled “Next Steps”