Open-source models · HALO Docs

The open-source gateway routes listed canonical model IDs to validated custom inference providers while preserving an OpenAI-compatible chat response.

#Make a request

curl https://api.agihalo.com/open-source/v1/chat/completions \
  -H "Authorization: Bearer $HALO_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "qwen/qwen3.6-35b-a3b",
    "messages": [{"role": "user", "content": "Reply with OK"}],
    "max_tokens": 16,
    "stream": false
  }'

#Runtime contract

Text-only messages and visible assistant output.
n and best_of, when present, must be 1.
Tools, function declarations, tool-role messages, audio, images, and multimodal content are rejected before provider dispatch.
Runtime normalizes to stream: false and caps output at 32,768 tokens.

#Model families

The production catalog groups listed models across Qwen, Llama, DeepSeek, Kimi, Mistral, Gemma, GLM, MiniMax, Nemotron, MiMo, GPT-OSS, and AllenAI families. Use the dashboard's Models page for the current project-visible IDs.

#Supplying inference

If you operate an OpenAI-compatible HTTPS endpoint, read the Keeper contract before registration. Model discovery, baseline checks, bounded health probes, deterministic metering, and payout rules apply.