==> call the api
Responses (OpenAI)
POST /v1/llm/responses
OpenAI's Responses API, as vLLM serves it. Usage comes as input_tokens/output_tokens. Body up to 32 MiB. A personal access token only, for an account the model is open to (modelApi in /v1/me); a few calls in flight per account at most (429 beyond). The answer streams back as the model writes it.
Needs a personal access token: Authorization: Bearer <token>.
Body
application/json
- input
anyrequired
Answer
200 Success.
Refusals
Each answers { "error": "...", "code"?: "..." } with its status.
| status | when |
|---|---|
400 | The request is not valid. |
401 | No valid token. |
403 | This model is not open to the account, or the call did not come with a token. |
413 | The body is too large for this model. |
429 | Too many calls in flight for this account. |
503 | The model is not running. |
Example
curl -X POST 'https://api.clusterstuck.sh/v1/llm/responses' \
-H 'Authorization: Bearer <your token>' \
-H 'Content-Type: application/json' \
-d '{"input":{}}'