SGLang

SGLang can serve open-source models via an OpenAI-compatible HTTP API. OpenClaw can connect to SGLang using the

OpenClaw can also auto-discover available models from SGLang when you opt in with

OpenClaw treats

Getting started

text
Copy
* `http://127.0.0.1:30000/v1`

text
Copy
```bash}
export SGLANG_API_KEY="sglang-local"
```

text
Copy
Or configure the model manually:

```json5}
{
  agents: {
    defaults: {
      model: { primary: "sglang/your-model-id" },
    },
  },
}
```

Model discovery (implicit provider)

When

• text

  Copy

  GET http://127.0.0.1:30000/v1/models

and convert the returned IDs into model entries.

Explicit configuration (manual models)

Use explicit config when:

• SGLang runs on a different host/port.
• You want to pin
  text

  Copy

  contextWindow
  /
  text

  Copy

  maxTokens
  values.
• Your server requires a real API key (or you want to control headers).

json5
Copy
{
  models: {
    providers: {
      sglang: {
        baseUrl: "http://127.0.0.1:30000/v1",
        apiKey: "${SGLANG_API_KEY}",
        api: "openai-completions",
        models: [
          {
            id: "your-model-id",
            name: "Local SGLang Model",
            reasoning: false,
            input: ["text"],
            cost: { input: 0, output: 0, cacheRead: 0, cacheWrite: 0 },
            contextWindow: 128000,
            maxTokens: 8192,
          },
        ],
      },
    },
  },
}

Advanced configuration

Related