Gradium releases Phonon for on-device speech: from about 65 MB, 28 ms p95 time to first audio on CPU streaming, and an Apache 2.0 English model
A small text-to-speech model that needs no server and no network, small enough for browsers and phones.
// Key points
- The models are about 65 MB and 75 MB, cover English, French, German, Spanish and Portuguese, ship 100+ voices, and support voice cloning and voice design
- Phonon 31m (English) is Apache 2.0; Phonon 40m, covering all five languages, is under a non-commercial license
- On the Open TTS Leaderboard it ranks first for intelligibility in German and Spanish and top three in every language; CPU streaming p95 time to first audio is 28 ms (31m) and 38 ms (40m), against 165 ms for Pocket TTS
- Its runtime supports 10+ backends including CPU, CUDA, Vulkan, Metal, WebGPU and NPUs; it is in Transformers from v5.21, and an ExecuTorch build runs in the browser on WebGPU
Builder's takeAI Interview's spoken follow-ups use cloud TTS today, and both latency and per-character billing hurt. For English I would try the Apache 2.0 31m model in the browser first; if first audio really stays in the tens of milliseconds it is worth switching. The multilingual model is non-commercial, so check licensing before shipping it.
// Background · from #Open models
Full timeline →- Nov 8 Kimi K3.1 Pro (Highspeed) arrives on Amazon Bedrock: open-weight, natively multimodal, a 1-million-token context, and explicit prompt caching
- Nov 8 NVIDIA open-sources the Reshard collective, making RL post-training weight refit 2.7x to 5.7x faster than gather-and-broadcast
- Nov 7 Foundry Local runs Qwen3.8-27B at 4-bit in about 18 GB, on 24 GB consumer GPUs with up to 64K context, as a GitHub Copilot model provider