Documentation

One endpoint. You send messages, you get a reply. Every number on this page is enforced by the running server.

Quickstart

A streamed reply, in one command:

curl -N https://www.ai.latdlabs.in/api/v1/chat \
  -H "content-type: application/json" \
  -d '{
    "messages": [
      { "role": "user", "content": "What is a haiku? One example, please." }
    ],
    "stream": true
  }'

What comes back, abbreviated:

data: {"object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"A hai"}}]}

data: {"object":"chat.completion.chunk","choices":[{"index":0,"delta":{},"finish_reason":"stop"}]}

data: [DONE]

Messages

messages is the only required field. Each entry has a role and content.

Request fields

Unknown fields are ignored, not rejected, so a request built for another provider still answers.

Images

An image is a part inside a user message — not a separate upload, and not a property of the conversation.

{
  "role": "user",
  "content": [
    { "type": "text", "text": "What is in this picture?" },
    { "type": "image_url",
      "image_url": { "url": "data:image/jpeg;base64,/9j/4AAQSkZJRgABAQ…" } }
  ]
}

url also takes a plain link (https://example.com/chart.png). The server fetches it before sending, so the address must be reachable without a login.

Streaming

With "stream": true the response is text/event-stream: one line per event beginning data:, then a blank line, ending in data: [DONE].

const r = await fetch('/api/v1/chat', {
  method: 'POST',
  headers: { 'content-type': 'application/json' },
  body: JSON.stringify({
    messages: [{ role: 'user', content: 'Tell me a short joke.' }],
  }),
});

const reader = r.body.getReader();
const dec = new TextDecoder();
let buf = '', out = '';

while (true) {
  const { value, done } = await reader.read();
  if (done) break;
  buf += dec.decode(value, { stream: true });

  let i;
  while ((i = buf.indexOf('\n')) >= 0) {
    const line = buf.slice(0, i).trim();
    buf = buf.slice(i + 1);
    if (!line.startsWith('data:')) continue;
    const payload = line.slice(5).trim();
    if (payload === '[DONE]') break;
    const piece = JSON.parse(payload).choices?.[0]?.delta?.content;
    if (piece) { out += piece; console.log(out); }
  }
}

Plain JSON

Set "stream": false for scripts and cron jobs.

{
  "object": "chat.completion",
  "model": "glitchyapi",
  "choices": [{
    "index": 0,
    "message": { "role": "assistant", "content": "Tokyo." },
    "finish_reason": "stop"
  }],
  "usage": { "prompt_tokens": 8, "completion_tokens": 2, "total_tokens": 10 }
}

Errors

One JSON object, a status that means something, never a stack trace.

{
  "error": {
    "message": "`messages` must be a non-empty array.",
    "type": "invalid_request_error",
    "code": "missing_messages"
  }
}

Limits

Published from the file that enforces them, so the two cannot drift.

Under heavy free use a request may wait a few seconds before it starts. It still streams; it just starts late. That wait is not counted against the per-minute limit.

Service

Two endpoints that describe the service rather than answering a question.

{
  "ok": true,
  "service": "glitchyapi",
  "api": "/api/v1/chat",
  "streaming": true,
  "json": true,
  "images": true,
  "limits": "/docs#limits",
  "docs": "/docs"
}

{ "object": "list", "data": [
  { "id": "glitchyapi", "object": "model", "selectable": false }
] }

Questions

Try it in the chat