Skip to content

Document Cheaper Inference via the openai setting - #1193

Open
aiapienthusiast wants to merge 1 commit into
Pythagora-io:mainfrom
aiapienthusiast:cheaperinference-provider
Open

aiapienthusiast wants to merge 1 commit into
Pythagora-io:mainfrom
aiapienthusiast:cheaperinference-provider

Conversation

@aiapienthusiast

Copy link
Copy Markdown

This PR documents Cheaper Inference as an endpoint for the openai provider setting.
It uses the same pattern as OpenRouter (#69): no new provider, only the openai setting.

Cheaper Inference is an OpenAI-compatible LLM gateway.
One API key gives access to models from several labs.

Usage in config.json:

"openai": {
  "base_url": "https://api.cheaperinference.com/v1",
  "api_key": "your-api-key"
}

Then set the agent model, for example "model": "gpt-5.4-mini".

Details

Files:

  • README.md: Cheaper Inference in the note next to Azure and OpenRouter.
  • example-config.json: Cheaper Inference in the header comment, with its base URL.

No code changes.

Tests: pytest tests/config passes (17 passed).
test_get_git_version fails on main too. It does not touch these files.
ConfigLoader.from_json still parses example-config.json.

Live check: gpt-5.4-mini returned a reply through OpenAIClient._make_request (streaming, with stream_options).
The config came from example-config.json with the base URL above.

@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants