Skip to content
InferenceHub

Changelog

What shipped, when — new models, pricing changes, and features across the gateway, the hosted chat, and the desktop app.

RSSMarkdown

  • models
  • pricing
  • api

Auto routing: name a price, not a model

Two new model ids — ih-auto and ih-auto-smart — route each request to a fast open-weight model at a flat sheet: $1.00 per 1M input tokens and $5.00 per 1M output, whatever the router picks. Smart Auto can additionally escalate a genuinely hard turn to Claude Sonnet 5, billed exactly as if you had named sonnet-5 yourself — picking -smart is the consent to that. Both ids work on the OpenAI Chat wire and the Anthropic Messages wire, so they drop into Cursor, Claude Code, and Kilo Code like any other model id.

Named models on InferenceHub pass through at 0% markup; Auto is the one deliberate exception — the spread between the flat sheet and the routed model's native price is the routing fee, and we say so. It is also not a black box: routing is a deterministic rule table (no LLM classifier reading your prompts), and every turn discloses what served it — in the response's model field, the x-ih-auto header, and the portal's usage view. Conversations stick to their routed model, so agent loops don't flap mid-task.

The Auto ids also unlock context compaction for long agent sessions: conversations that outgrow the pool are automatically trimmed to keep serving where the alternative was a context-window error, and an opt-in x-ih-compact header trims to a working set on demand — billing follows the compacted request, so opting in directly cuts what long sessions cost. On subscription plans, Auto turns (escalations included) draw standard windows and never touch the premium budget, which makes ih-auto-smart the all-day coding id on Plus and Max.

Auto routing docs

  • models

Kimi K3: Moonshot's flagship open-weight model, at cost

Kimi K3 — Moonshot AI's newest flagship open-weight reasoning model — is live across the platform at exact upstream parity: $3.00 per 1M input tokens, $15.00 per 1M output, $0.60 per 1M cached input. As with every named model on InferenceHub, that's a 0% markup on what the upstream charges us.

It works everywhere the other open-weight models do: the OpenAI Chat Completions endpoint for Cursor, Kilo Code, Cline and friends (use the moonshotai-kimi-k3 id in Cursor — it hijacks the bare name), and inside Claude Code with tool calls and thinking, where it also appears in the /model picker as claude-code-kimi-k3 with gateway discovery on. It's also in the hosted chat's model picker, with its reasoning shown as it thinks.

Prompt caching is on automatically — repeated context bills at the cached rate ($0.60 per 1M) with no setup. Unlike some of the earlier open-weight deployments, K3 also handles forced tool choice (tool_choice: "required" and named functions) correctly, so structured-output agent frameworks work out of the box.

Model ids & pricingClaude Code setup

  • chat

Chat platform upgrade: refreshed interface and per-message reasoning control

The hosted chat moved to a much newer build of its underlying platform, bringing a refreshed interface throughout — cleaner layout, a reworked model selector with vendor marks and exact model ids on every row, and a smoother settings area.

Reasoning control is now built into the model selector: pick how hard a reasoning-capable model should think (off to high) per conversation, right where you pick the model. This replaces the previous separate Instant/Thinking toggle in the composer.

Everything you already use — your conversations, projects, web search, deep research, image generation, per-model billing — carries over unchanged.

  • models
  • api

Model synthesis: a panel of models, one merged answer

Three new model ids — ih-synthesis-budget, ih-synthesis, and ih-synthesis-max — fan your prompt out to a panel of models that answer independently in parallel, then a synthesizer model merges the attributed candidates into one streamed reply. For explicit control, the model_synthesis tool on /v1/chat/completions lets you name your own panel (up to four models) and synthesizer.

Pricing is the same honest deal as everything else here: no bundle price, no markup — every participant bills as its own line item at that model's normal per-token rates, and the portal's usage view shows the per-participant breakdown for each synthesis turn. Pay-as-you-go only for now; synthesis requests must stream.

Every response tells you who participated via the x-ih-synthesis header, and panel failures are disclosed in-stream rather than hidden.

Model synthesis docs

  • chat
  • desktop

Font zoom in the chat

You can now make the chat bigger or smaller: Settings → Appearance → Font Size steps the whole interface between 85% and 140%, and the choice sticks on that device across visits.

In the desktop app, Cmd/Ctrl + = and Cmd/Ctrl + - zoom in and out and Cmd/Ctrl + 0 resets — the zoom shortcuts a browser window has and the app was missing. In a browser, your browser's own zoom keeps working exactly as before.

  • chat
  • models

Claude Opus 5 in the hosted chat

Claude Opus 5 is now selectable in the hosted chat and the desktop app — pick it from the model selector under Anthropic. Like the other premium models in chat, turns bill your own account: plan budgets cover them if you subscribe, pay-as-you-go otherwise, and trial accounts stay on the Free models.

Extended thinking stays off by default in chat; use the per-message Thinking toggle when you want it.

  • api

The model list shows each model once

GET /v1/models on the Anthropic-compatible endpoint now lists exactly one id per model — the canonical claude-* id — instead of every alias. Claude Code's /model picker (with gateway model discovery on) stops showing each Claude model twice, and the open-weight entries keep appearing under their claude-code-* picker ids.

Every alias still works in requests and per-id lookups: opus-5 and claude-opus-5 both resolve to Claude Opus 5. Only the listing is deduplicated.

Model ids & aliases

  • api
  • models

Fixed: newest Claude models in Cursor

Anthropic recently deprecated explicit sampling parameters (temperature, top_p) on its newest models — Opus 4.8, Opus 5, Sonnet 5, Fable 5 — and rejects requests that set them. Cursor sends a temperature on every request, so these models had started erroring on the OpenAI-compatible endpoint.

The gateway now drops those parameters for Claude models on that endpoint instead of forwarding them, and requests succeed again. The native Anthropic endpoint is unaffected and stays byte-faithful: what you send is what Anthropic sees.

Cursor guide

  • chat
  • pricing

Free models in chat — $0, for every account

The hosted chat now has a set of Free models: GPT-5.6 Luna, Claude Haiku 4.5, GLM-5, Kimi K2.5, Qwen3.5, and DeepSeek 3.2. Chatting with a Free model costs $0 on every account — it draws nothing from your balance, and for subscribers it never touches plan windows. A fair-use pacing window applies, sized so normal chatting never meets it and roomier on paid accounts.

New accounts start on the Free models: the first top-up or plan unlocks the full chat catalog, and until then picking another model in chat shows a clear notice instead of spending anything. This is a chat-surface rule only — over the API, your key reaches every model on the platform exactly as before.

Billing & plans — Free chat models

  • models
  • pricing

Claude Opus 5 is live

Claude Opus 5 — Anthropic's newest Opus-class model — is available across the platform as opus-5 (canonical id claude-opus-5): on the Anthropic API endpoint and in Claude Code, with tool calls, streaming, and prompt caching. Same key, no config change beyond the model id.

Prices match Anthropic's list exactly, per our standing parity pricing: $5 per million input tokens, $25 per million output, $0.50 cached input — the same sheet as Opus 4.8. The bare opus alias continues to point at Opus 4.8, so existing setups change nothing until you opt in.

One behavior note: Opus 5 ships with extended thinking enabled by default. The gateway forwards your requests unmodified, so that default is yours to keep or override per request.

Models & pricingClaude Code setup

  • api
  • models

Claude Code × open-weight: reasoning stalls now explain themselves

Open-weight reasoning models in Claude Code (GLM-5.2, Kimi K2.6, and friends on the translation lane) can occasionally spend a turn's entire output budget inside internal reasoning and never start an answer — the upstream serves these models' reasoning always-on and currently honors no reasoning-effort controls. Until today that failure surfaced as a silently empty reply.

Such turns now end with a clearly marked [InferenceHub] note explaining what happened and suggesting a retry with a narrower ask or a model switch, so a stalled turn is never silent again. Ordinary turns are untouched, and the note is stripped from the conversation before anything is replayed upstream.

Troubleshooting

  • models

DeepSeek V4 Pro now works in Claude Code

DeepSeek V4 Pro joins the open-weight models you can run inside Claude Code — same endpoint, same key, tool calls and thinking included. Launch with claude --model deepseek-v4-pro, set it as your default in settings.json, or pick it from the /model picker (listed as claude-code-deepseek-v4-pro), where it appears automatically with gateway model discovery enabled.

Same model and prices as everywhere else on the platform. One caveat carried over from the upstream serving stack: requests that force a tool call (tool_choice required or a named tool) return an honest error instead of a silently empty reply; normal automatic tool use is unaffected.

Claude Code setup

  • chat

Long file names no longer cut off in chat

Attached file names that don't fit their card — in the composer and in a project's Files list — now end with an ellipsis instead of being clipped mid-name. Hover a file to see its full name.

  • chat

Copied answers no longer carry citation artifacts

Copying a chat answer that cites your uploaded files or web sources now produces clean text. Previously the inline citation chips leaked into the clipboard, so pasted answers showed stray labels like "File" between sentences — or raw [[1]](…) fragments when pasting as plain text.

Citations themselves are unchanged in the app: they still render inline and open the source when clicked. Both the copy button and manual text selection are covered, in the browser and in the desktop app.

  • chat

Chat speaks one accent color

Selected controls in chat — the Deep Research toggle, tool chips, checkboxes, and links inside answers — now use the InferenceHub green in both light and dark themes, replacing the leftover blue accent.

  • desktop

A cleaner desktop window on macOS

The macOS desktop app lost its grey title bar: chat now runs edge-to-edge, with the sidebar toggle tucked up beside the traffic lights. Hovering the toggle peeks at your chat history without stealing focus from the composer; clicking pins the sidebar open, and it always folds as a compact panel instead of a mobile-style overlay.

The strip along the top behaves like a real title bar — drag it to move the window, double-click it to zoom.

Download

  • chat

Chat greeting fits small windows

The empty-state greeting now scales down with the window instead of clipping behind the message box — short or narrow windows shed the tagline first, then shrink the greeting.

  • pricing

Three plan sizes, one pooled premium budget

Subscriptions now come in three sizes: All Access at $10/mo, Plus at $25/mo, and Max at $50/mo. Every tier gets every model.

Premium Claude and GPT models — Opus, GPT-5.6 Sol — now draw from a single burstable monthly premium budget ($50, $200, or $500 by tier), pooled across vendors so you spend it on whichever frontier model you're actually using. Every other model draws standard 5-hour and weekly windows that scale with the tier.

Reach any limit and you keep working at pay-as-you-go rates. No hard stop.

Pricing

  • pricing
  • api

Claude prompt-cache discounts on the OpenAI wire

Claude requests made through the OpenAI Chat Completions endpoint — the wire Cursor and most OpenAI-compatible clients speak — now earn Anthropic's prompt-cache discounts, same as on the native Anthropic wire. Long agent sessions replay their context at cached-read rates instead of full price.

Nothing to configure: caching is applied automatically where it saves you money.

Cursor guide

  • docs

Docs, rebuilt

The documentation grew from one long page into a full section: step-by-step guides for Claude Code, Codex, Cursor, Kilo Code, ZCode, and Hermes, plus API references for text, images, and embeddings, with a persistent sidebar throughout.

For agents and LLMs, the whole guide ships as one markdown file at /docs.md, and /llms.txt maps the site.

Documentation

  • chat

Prompt caching in the hosted chat

The hosted chat now uses provider prompt caching for conversation history, so long chats re-read their context at cached rates. Faster follow-up turns, lower spend, nothing to configure.

  • desktop

The desktop app is open source

InferenceHub Desktop is now developed in the open — a lightweight native client for the hosted chat on macOS and Windows, with frontier and open-weight models, web search, and Deep Research outside the browser.

Installers live on the download page, and the source is on GitHub.

Download

  • platform

One key.

InferenceHub is generally available. One API key for real Claude, GPT, and open-weight models, served byte-faithful on their native APIs — Anthropic Messages, OpenAI Chat Completions, Responses, Images, Embeddings — at native rates with 0% per-token markup.

Start with $1 in free credit, top up by card or crypto, and point Claude Code, Codex, Cursor, or your own stack at it.

Quickstart

  • pricing

The daily reward

Make at least one successful API request in a day and you can claim a small credit in the portal's Rewards tab. The amount ramps with a consecutive-day streak, with bonus credit at 7 and 30 days.

Billing & plans

  • chat
  • desktop

Voice input in chat

Talk instead of type. The hosted chat takes voice input using your browser's built-in speech recognition, and the desktop app transcribes on-device with whisper.cpp.

  • pricing

All Access: every model, $10/mo

The first subscription plan: All Access at $10/mo covers every model on the gateway with generous standard usage windows, on top of plain pay-as-you-go. No model gating by tier — the ladder scales limits, not access.

Pricing