Skip to content

chore: install every ecosystem's toolchain in the benchmark image - #85

Merged
algomaster99 merged 2 commits into
mainfrom
chore/bench-toolchains
Oct 2, 2026
Merged

algomaster99 merged 2 commits into
mainfrom
chore/bench-toolchains

Conversation

@algomaster99

Copy link
Copy Markdown
Member

The benchmark image only had node and npm, so agents couldn't run cargo, go, mvn, pip or uv. In the Opus runs that left them unable to generate a lockfile and made them curl registries instead, in an environment unlike the host the Sonnet runs used.

The image now copies Rust, Go and Maven/JDK from their official images, adds uv, and installs pip, venv and gh from Debian. The base moves to trixie for Python 3.13: under bookworm's 3.11, pip index versions numpy reported 2.4.6 instead of 2.5.3. The default Bash timeout goes from 2 to 5 minutes, since every container starts with empty caches.

before: node 22, npm
after:  node 22, npm, cargo 1.99, go 1.27.1, java 26, maven 3.10, python 3.13, pip 25.1, uv 0.12, gh 2.46

🤖 Generated with Claude Code

algomaster99 and others added 2 commits October 2, 2026 18:22
Agents can now run cargo, go, mvn, pip/uv and gh as on a dev machine, including generating lockfiles. Trixie's Python 3.13 keeps pip from hiding releases that need a newer interpreter (numpy 2.5.3), and the default Bash timeout is raised to 5 minutes for first-run downloads.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@algomaster99
algomaster99 merged commit 646288c into main Oct 2, 2026
2 checks passed
@algomaster99
algomaster99 deleted the chore/bench-toolchains branch October 2, 2026 17:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant