Open source #Open models Nov 8, 2026 · Originally published Nov 5

Gradium releases Phonon for on-device speech: from about 65 MB, 28 ms p95 time to first audio on CPU streaming, and an Apache 2.0 English model

A small text-to-speech model that needs no server and no network, small enough for browsers and phones.

Image: Hugging Face Blog
Primary source Hugging Face Blog · huggingface.co Read the original ↗

// Key points

  • The models are about 65 MB and 75 MB, cover English, French, German, Spanish and Portuguese, ship 100+ voices, and support voice cloning and voice design
  • Phonon 31m (English) is Apache 2.0; Phonon 40m, covering all five languages, is under a non-commercial license
  • On the Open TTS Leaderboard it ranks first for intelligibility in German and Spanish and top three in every language; CPU streaming p95 time to first audio is 28 ms (31m) and 38 ms (40m), against 165 ms for Pocket TTS
  • Its runtime supports 10+ backends including CPU, CUDA, Vulkan, Metal, WebGPU and NPUs; it is in Transformers from v5.21, and an ExecuTorch build runs in the browser on WebGPU

Builder's takeAI Interview's spoken follow-ups use cloud TTS today, and both latency and per-character billing hurt. For English I would try the Apache 2.0 31m model in the browser first; if first audio really stays in the tens of milliseconds it is worth switching. The multilingual model is non-commercial, so check licensing before shipping it.

// Background · from #Open models

Full timeline →
  1. Nov 8 Kimi K3.1 Pro (Highspeed) arrives on Amazon Bedrock: open-weight, natively multimodal, a 1-million-token context, and explicit prompt caching
  2. Nov 8 NVIDIA open-sources the Reshard collective, making RL post-training weight refit 2.7x to 5.7x faster than gather-and-broadcast
  3. Nov 7 Foundry Local runs Qwen3.8-27B at 4-bit in about 18 GB, on 24 GB consumer GPUs with up to 64K context, as a GitHub Copilot model provider

Every Monday, the week in AI in one email

Every Monday morning: the 6 AI stories that mattered most in the past seven days, with my take, in your inbox.

Your email is only used to send the weekly and is never shared. Every email has a one-click unsubscribe link. See the latest issue →