Skip to main content

A DSL-driven LLM gateway

Open Next Router (ONR) routes requests, applies opt-in compatibility transforms, and normalizes streaming behavior across providers, without hiding logic in code.
Runtime behavior must be described explicitly by DSL directives loaded from config/onr.conf, which typically includes files under config/providers/*.conf (see config/onr.conf). The runtime proxy stays an execution engine, not a guessing layer.

Architecture at a Glance

Jump in

30-second Quickstart

make build
onr run -c onr.yaml
curl -sS http://127.0.0.1:3300/v1/models -H "Authorization: Bearer change-me"

What you get

  • Atomic DSL: declare routing/auth/transforms/SSE parsing in config, not code.
  • Safe defaults: first match wins; no-match returns HTTP 400 (no silent fallback).
  • Streaming-aware: normalize SSE framing and provider chunk semantics.
  • Ops-friendly: one-line access logs, optional traffic dumps, optional usage/cost extraction.

Where to Start