Really cool to see a 3B model running fully client-side via WebGPU. The claim about beating Qwen3-32B on Arena-Hard at 10x smaller is interesting - do you know if those benchmarks hold up for more practical tasks like summarization or instruction following? Also curious about inference speed - what kind of tokens/sec are you seeing on a typical laptop GPU?
This is a 3B parameter model from Nanbeige with surprisingly strong benchmarks. It beats Qwen3-32B on Arena-Hard and LiveCodeBench despite being 10x smaller. (Also be warned it thinks a lot).
I wrapped it in a simple browser demo using Transformers.js + WebGPU. It downloads the q4 ONNX weights (~1.7GB) and runs fully client-side. no server required. Falls back to WASM if WebGPU isn't available.
Really cool to see a 3B model running fully client-side via WebGPU. The claim about beating Qwen3-32B on Arena-Hard at 10x smaller is interesting - do you know if those benchmarks hold up for more practical tasks like summarization or instruction following? Also curious about inference speed - what kind of tokens/sec are you seeing on a typical laptop GPU?
This is a 3B parameter model from Nanbeige with surprisingly strong benchmarks. It beats Qwen3-32B on Arena-Hard and LiveCodeBench despite being 10x smaller. (Also be warned it thinks a lot).
I wrapped it in a simple browser demo using Transformers.js + WebGPU. It downloads the q4 ONNX weights (~1.7GB) and runs fully client-side. no server required. Falls back to WASM if WebGPU isn't available.