inflight_tracker
Tracks live request counts and reserved tokens per model.
Versions marked “overview” do not contain this page. Selecting one opens that version’s documentation overview.
On this page
Tracks live request counts and reserved tokens per model.
Configuration
| Field | Type | Required | Description |
|---|
default_model | string | no | Model name attributed when the request body reveals none. Keeps counts from silently vanishing for clients that omit model. |