Is Nanbeige 4.2 the Best Small AI Model? Tested - Local web studio and agent engine powered by Nanbeige 4.2-3B.
-
Updated
Jul 22, 2026 - HTML
Is Nanbeige 4.2 the Best Small AI Model? Tested - Local web studio and agent engine powered by Nanbeige 4.2-3B.
Deployment-blocking bugs, a Looped-Transformer memory bound, and a chunked-prefill fix for running Nanbeige4.2-3B on Apple Silicon (MPS)
Local agent tests on Apple Silicon: Qwen3.8, Ornith, Flash Next and Nanbeige, with fixtures, recorded results and scoring notes.
Streaming MLX 4-bit conversion and independent validation for Nanbeige4.3-33B. Weights on Hugging Face.
Nanbeige4.3-33B (dense, Q6_K GGUF) on a single DGX Spark with llama.cpp and a 3B speculative drafter via Docker Compose. Includes an agent benchmark against Qwen3.8 Flash Next: BFCL, AgentDojo, IFEval, GPQA.
Nanbeige4.3-33B-INT4 on one M5 Ultra with TensorFold native Metal: Nanbeige's own QAT int4 release as published (47-48 tok/s), optional bf16 Nanbeige4.1-3B drafter
Privacy-first guide and helper scripts for running Pi with local llama.cpp models on Apple Silicon.
Nanbeige4.3-33B on one M5 Ultra with TensorFold native Metal: the bf16 release as published, with its bf16 Nanbeige4.1-3B drafter (replies identical, 1.3-7x)
To associate your repository with the nanbeige topic, visit your repo's landing page and select "manage topics."