18 KiB
Language recommendations: zh, yue, ja, ko, the Qwen set, and Auto
Research, 2026-10-22. Builds on model-watch.md (not repeated). Scope: every
language in LANGUAGES that Parakeet v3 does not cover, plus Auto-detect.
Read-only against src/transcription_models.rs; nothing here is implemented.
Bottom line
Today Evidence says
├── zh|yue|ja|ko → Qwen3-ASR 0.6B ├── zh: a tie (all within CI). Keep Qwen 0.6B.
│ Fastest SenseVoice, hints Whisper ├── yue: Qwen (7.9 / 6.1 CER) wins by 4x over Whisper turbo
│ │ (34.6) and SenseVoice (37.4). SenseVoice must stop being "Fastest" here.
│ ├── ja: Whisper turbo (4.82) and Fun-ASR-MLT (2.10) beat Qwen 0.6B (8.61)
│ └── ko: Whisper turbo (5.24) beats Qwen 0.6B (5.82); Qwen 1.7B best (4.60)
├── other Qwen languages → Qwen 0.6B ├── Qwen 0.6B loses to Whisper turbo on ar, tr, ms, fil, fa, mk, id
│ └── it wins only on hi, th (and ties zh, vi)
└── Auto → Whisper + Qwen both "Recommended"└── Auto → Whisper turbo Recommended; drop SenseVoice as Fastest
+ SenseVoice Fastest
Every model proposed below already runs in the pinned transcribe-cpp 0.2.4
(src/arch/ has qwen3_asr, funasr_nano, sensevoice, whisper, cohere).
No crate bump is needed for any proposal except possibly the Arabic Cohere
GGUF (same cohere arch; confirm it loads on 0.2.4).
Method and trust
One source does almost all the work: the per-model docs in transcribe.cpp
(docs/models/*.md, handy-computer, MIT), which score the same Q8_0 GGUFs
Hex would ship on FLEURS test with one harness. That is third-party to
the model vendors and apples-to-apples across models. Its limits:
- FLEURS is read Wikipedia sentences, one run, about 900 utterances per language. The bootstrap 95% CI on zh is roughly ±0.9 CER points, so differences under about 1.5 points are noise. It says nothing about dictation, noise, accents, or code-switching.
- Normalization is the harness's, not each language's best. Cantonese and Chinese script (Traditional vs Simplified) can inflate CER: SenseVoice 37.4 and Whisper turbo 34.6 on yue are probably partly script mismatch, not only recognition. Unverified here; test before telling users "SenseVoice cannot do Cantonese".
- Fun-ASR-MLT ja 2.10 CER is an outlier next to every other model (4.8 to 8.6). Possible training-data overlap with FLEURS; I did not check. Treat as promising, medium confidence.
- Vendor-only: the Qwen3-ASR technical report (arXiv 2601.21337) and model card (MLS, Common Voice, MLC-SLM, Fleurs, WenetSpeech, internal sets). Used below only as a cross-check and marked "vendor".
- AISHELL, CSJ, KsponSpeech, and Common Voice per-language numbers for the
GGUFs: none found from an independent party. The HF Open ASR leaderboard
results dataset (
hf-audio/open-asr-leaderboard-results, checked 2026-10-22) publishes onlyenglish_short_latest.csv; there is no public multilingual per-language results file to cite.
Candidate models (what can actually ship)
All Q8_0, Metal speed on M4 Max (transcribe.cpp, asr-publication-v2, jfk 11 s
/ dots 35 s, x realtime). Only Whisper supports Hex's recognition hints today.
model size speed (jfk/dots) license langs hints in transcribe.cpp notes
Qwen3-ASR 0.6B (shipped) 850 MB 75x / 64x Apache-2.0 30 (52) vocabulary + prompt echoes vocabulary into output often
Qwen3-ASR 1.7B 2.19 GB 45x / 37x Apache-2.0 30 (52) vocabulary + prompt Q4_K_M 1.32 GB (+0.2 EN WER); Q5_K_M 1.52 GB
Whisper large-v3-turbo 886 MB 36x / 51x MIT 100 vocabulary, prompt, prefix shipped; hint path works
Whisper large-v3 1.67 GB slower Apache-2.0 100 same better on yue/th than turbo; 2x size
SenseVoice Small (shipped) 253 MB 245x / 289x FunASR license 5 none zh/yue/en/ja/ko only
Fun-ASR-Nano-2512 891 MB 83x / 73x FunASR license zh,en,ja vocabulary (hotwords) Mandarin/Japanese specialist
Fun-ASR-MLT-Nano-2512 891 MB 75x / 65x FunASR license 31 vocabulary (hotwords) ITN on by default; LS-clean EN 1.72
Cohere Transcribe (shipped)2.41 GB 76x / 75x Apache-2.0 14 none already in catalog, not offered for non-English
Cohere Transcribe Arabic 2.41 GB ~Cohere Apache-2.0 ar, en none FLEURS ar 11.06; upstream repo is gated
Nemotron 3.5 ASR Streaming 751 MB 144x / 138x OpenMDW-1.1 32 auto-LID tag; streaming multilingual accuracy is weak (below)
FunASR Model License v1.1 allows use, copy, modify, share with attribution and the model name retained; it has a non-disparagement termination clause. It is redistributable, but a legal glance is warranted before shipping two more FunASR-licensed weights. SenseVoice already carries it.
Not available through transcribe.cpp (checked docs/models/ and src/arch/
at v0.4.1): Dolphin, FireRedASR, Paraformer/FunASR standalone, kotoba-whisper,
Belle-whisper, Voxtral for these languages (Voxtral Mini 3B lists only en, fr,
de, es, it, pt, nl, hi). Granite Speech 4.1 2B covers ja among these (6.30 CER,
2.56 GB) and is not better than Whisper turbo. breeze-asr-25 (Taiwan Mandarin
Whisper fine-tune) is in the Whisper family list but is outside Hex's
language set. Whisper fine-tunes such as kotoba-whisper could in principle be
converted through the Whisper path, but nothing is published as GGUF there, so
they are out under the "published GGUF" constraint.
crate/version note: Hex pins transcribe-cpp 0.2.4 (2026-09-25); 0.3.0
(2026-10-03), 0.3.1, 0.4.0 and 0.4.1 (2026-10-22) exist. 0.4.x adds ecapa_tdnn
(language ID, VoxLingua107) and silero_vad arches. No new ASR arch landed
after 0.2.4 for these languages.
Evidence: FLEURS test, Q8_0, transcribe.cpp harness
CER for zh, yue, ja, ko, th; WER elsewhere. Lower is better. Bold is the best among models that fit under about 1 GB (the default download class).
lang Qwen0.6 Qwen1.7 Whisper-turbo Whisper-v3 SenseVoice FunASR-Nano FunASR-MLT Cohere Nemotron3.5
zh 7.57 7.14 8.50 7.98 10.12 8.59 7.33 11.18 18.87
yue 7.91 6.13 34.62 22.06 37.44 n/a 8.39 n/a n/a
ja 8.61 5.29 4.82 4.81 7.63 8.50 2.10 5.13 13.52
ko 5.82 4.60 5.24 4.89 8.27 n/a 5.41 6.57 8.89
ar 24.51 14.91 15.48 14.92 n/a n/a 25.88 13.60 15.93 // Cohere-Arabic 11.06
hi 12.68 7.84 18.85 17.06 n/a n/a 23.07 n/a 8.61
vi 9.32 6.15 9.48 8.74 n/a n/a 8.22 7.39 13.96
tr 16.74 9.46 6.97 6.51 n/a n/a n/a n/a 15.40
th 8.81 6.89 13.15 8.78 n/a n/a 7.28 n/a n/a
id 8.49 5.37 7.20 6.08 n/a n/a 7.32 n/a n/a
ms 17.18 10.42 8.64 7.59 n/a n/a 9.11 n/a n/a
fa 50.30 28.29 30.56 30.11 n/a n/a n/a n/a n/a
fil 35.43 24.29 12.08 11.82 n/a n/a 14.29 n/a n/a
mk 35.09 18.22 17.85 15.09 n/a n/a n/a n/a n/a
Aggregate over the 30 FLEURS languages Qwen and Whisper share (same harness):
mean WER/CER Qwen 0.6B 21.4, Qwen 1.7B 12.5, Whisper turbo 10.6, Whisper v3
9.2; medians 13.3, 7.6, 8.6, 7.8. Qwen 0.6B is the outlier-prone one, and
Whisper turbo is the better all-rounder under 1 GB. Qwen's own report agrees
(vendor): on its 30-language Fleurs set Whisper-large-v3 scores 8.16 vs
Qwen3-ASR 1.7B 12.60 and 0.6B 21.80 ("performance degrades on the full
30-language setting"); Qwen leads only on the 12- and 20-language subsets of
major languages. Hex's QWEN_LANGUAGES is the full 30-language set, so the
hard tail (fa, mk, fil, el, hu, cs, da, fi, ro, sv) is exactly where 0.6B is
worst. Note that those tail languages other than fa, fil, mk are Parakeet v3
languages in Hex and never reach the Qwen branch.
Per-language table: current → proposed
Roles: Rec = Recommended, Fast = Fastest, Acc = Most accurate, Hint = Recognition hints. "Rec" speed class assumes the model above. Confidence is about the ranking, not the absolute WER.
lang current proposed evidence (FLEURS) conf
zh Rec Qwen0.6; Fast SenseVoice; Rec Qwen0.6 (keep); Fast SenseVoice (keep); Qwen0.6 7.57, MLT 7.33, Qwen1.7 7.14, turbo 8.50, low
Hint Whisper turbo Acc Qwen3-ASR 1.7B (+Fun-ASR-Nano as a Mandarin SenseVoice 10.12: all inside ±1 CI except SenseVoice.
option, hotwords); Hint Whisper turbo Vendor-only AISHELL/WenetSpeech claims; no indep. run.
yue Rec Qwen0.6; Fast SenseVoice; Rec Qwen0.6; Fast: none (drop SenseVoice); Qwen0.6 7.91, Qwen1.7 6.13, MLT 8.39 vs turbo 34.62, high on
Hint Whisper turbo Acc Qwen 1.7B; Hint Whisper large-v3 if offered v3 22.06, SenseVoice 37.44 (script caveat above). the gap
(turbo is unusable for yue)
ja Rec Qwen0.6; Fast SenseVoice; Rec Whisper turbo (or Fun-ASR-MLT, 2.10); Fast turbo 4.82, v3 4.81, Qwen1.7 5.29, Cohere 5.13, medium
Hint Whisper turbo Qwen0.6/SenseVoice (7.63); Acc Fun-ASR-MLT or SenseVoice 7.63, Qwen0.6 8.61, FunASR-Nano 8.50,
Qwen 1.7B; Hint Whisper turbo MLT 2.10 (outlier, verify). Qwen 0.6B is not the best
choice for ja on this data.
ko Rec Qwen0.6; Fast SenseVoice; Rec Whisper turbo or keep Qwen0.6 (statistical Qwen1.7 4.60, v3 4.89, turbo 5.24, MLT 5.41, low
Hint Whisper turbo near-tie 5.24 vs 5.82); Fast Qwen0.6 (SenseVoice Qwen0.6 5.82, Cohere 6.57, SenseVoice 8.27.
8.27 is 40% worse); Acc Qwen 1.7B; Hint Whisper
ar Rec Qwen0.6; Hint Whisper Rec Whisper turbo; Acc Cohere Arabic 11.06 (or turbo 15.48, v3 14.92, Qwen1.7 14.91, Cohere 13.60, high that
shipped Cohere 13.60, or Qwen 1.7B); Fast: none Cohere-Arabic 11.06 vs Qwen0.6 24.51 and MLT 25.88. Qwen0.6
is wrong here
hi Rec Qwen0.6; Hint Whisper Rec Qwen0.6 (keep, 12.68 vs turbo 18.85); Acc Qwen1.7 7.84, Nemotron3.5 8.61, Voxtral3B 8.93, high
Qwen 1.7B; Hint Whisper (turbo is weak, 18.85) Qwen0.6 12.68, turbo 18.85, MLT 23.07
vi Rec Qwen0.6; Hint Whisper Rec Qwen0.6 (keep, ties turbo); Acc Qwen 1.7B or Qwen1.7 6.15, Cohere 7.39, MLT 8.22, Qwen0.6 9.32, medium
shipped Cohere (7.39); Hint Whisper turbo 9.48
tr Rec Qwen0.6; Hint Whisper Rec Whisper turbo; drop Qwen 0.6 (16.74) turbo 6.97, v3 6.51, Qwen1.7 9.46, Qwen0.6 16.74, high
Nemotron3.5 15.40
th Rec Qwen0.6; Hint Whisper Rec Qwen0.6 (keep); Acc Qwen 1.7B; Hint Whisper Qwen1.7 6.89, MLT 7.28, Qwen0.6 8.81, v3 8.78, medium
(turbo CER 13.15 is bad; use large-v3 8.78 if you turbo 13.15
offer it for Thai hints)
id Rec Qwen0.6; Hint Whisper Rec Whisper turbo (also gives hints); Fast Qwen0.6; Qwen1.7 5.37, v3 6.08, turbo 7.20, MLT 7.32, low
Acc Qwen 1.7B Qwen0.6 8.49
ms Rec Qwen0.6; Hint Whisper Rec Whisper turbo; drop Qwen0.6 as Rec (17.18) v3 7.59, turbo 8.64, MLT 9.11, Qwen1.7 10.42, medium
Qwen0.6 17.18. Qwen's own report: id/ms confusion
fa Rec Qwen0.6; Hint Whisper Rec Whisper turbo or Qwen 1.7B (both poor); flag Qwen1.7 28.29, v3 30.11, turbo 30.56, Qwen0.6 50.30 high on
as low accuracy in the UI "0.6 is bad"
fil Rec Qwen0.6; Hint Whisper Rec Whisper turbo turbo 12.08, v3 11.82, MLT 14.29, Qwen1.7 24.29, high
Qwen0.6 35.43
mk Rec Qwen0.6; Hint Whisper Rec Whisper turbo; Acc Whisper large-v3 (15.09) v3 15.09, turbo 17.85, Qwen1.7 18.22, Qwen0.6 35.09 high
A coherent small change set, if you want the minimum: (1) in the generic
QWEN_LANGUAGES branch, make Whisper turbo Recommended for ar, tr, ms, fil, fa,
mk, id and keep Qwen 0.6B Recommended only for hi, th, vi; (2) for ja use
Whisper turbo; (3) remove SenseVoice as Fastest for yue (and consider ja/ko);
(4) add Qwen3-ASR 1.7B as Most accurate wherever Qwen is offered.
The fallback arm _ => Whisper in choices_for_runtime is unreachable from
the UI: every code in LANGUAGES is covered by Auto, Parakeet v3, or the Qwen
set. It is only a guard.
Recognition hints
Hex currently enables hints only for Whisper (supports_recognition_hints: true). transcribe.cpp also documents --vocabulary/--prompt for Qwen3-ASR
0.6B and 1.7B ("system message"; the 0.6B "echoes the dictionary into the output
more often than the 1.7B") and --vocabulary hotwords for Fun-ASR-Nano and
MLT. Two options for hint-heavy users in these languages:
- Keep Whisper turbo as the Hints entry (works today), but know it is weak for yue (34.6), th (13.2), hi (18.9). Whisper large-v3 (1.67 GB) is the fix for yue (22.1) and th (8.8) and no better elsewhere.
- Qwen 1.7B with
vocabulary: better accuracy than Whisper turbo on ar, hi, vi, th, id, ja, ko, yue and tied on zh. This would needsupports_recognition_hints: trueon the Qwen models and a check that Hex maps its hint string to the vocabulary list. Not tested here; do not enable on 0.6B without testing the echo behavior.
Auto-detect
Today AUTO_LANGUAGE lists Whisper (Recommended), SenseVoice (Fastest) and
Qwen 0.6B (also Recommended).
- Drop SenseVoice as Fastest. It recognizes five languages
(
zh/yue/en/ja/ko). Auto-detect over arbitrary speech would route French or Hindi to a model that cannot transcribe them. SenseVoice is fine in Auto only if the user's languages are all five. - Whisper turbo as the single Recommended. 100 languages, hint support, and per-language accuracy on FLEURS beating Qwen 0.6B in 9 of the 14 Qwen-only languages above. Its weak spots are yue, th, hi, and short-clip language misdetection. Qwen's report (vendor) gives LID accuracy on Fleurs 30 languages: Whisper large-v3 94.6, Qwen 0.6B 97.1, Qwen 1.7B 98.7, with most Qwen errors being ms/id confusion. That is the one place Qwen has an edge, and it is vendor-reported on the vendor's chosen languages.
- Qwen3-ASR 1.7B as Most accurate for Auto (median 7.6 vs turbo 8.6, 30 languages), with Qwen 0.6B as Fastest only if you accept its tail languages (mean 21.4 across the set). A 1.7B model costs 2.19 GB and 45x. The VoxLingua107 ECAPA model that 0.4.x adds could do a cheap language pre-pass and route each clip to the right per-language Recommended model; that is a design choice, not tested here.
- Confidence: medium. Detect quality on short dictation utterances was not measured by anyone I could find; the FLEURS numbers are for known-language decoding.
What would raise confidence
- Hex's own fixtures for zh/ja/ko/yue with Traditional and Simplified scoring, across Qwen 0.6B and 1.7B, Whisper turbo, Fun-ASR-MLT/Nano, on dictation audio (short, noisy), not read Wikipedia.
- A Cantonese run scored script-normalized to see how much of SenseVoice's 37.4 and Whisper turbo's 34.6 is the Traditional/Simplified mismatch.
- Check whether Fun-ASR-MLT's ja 2.10 holds on Common Voice ja or CSJ.
- A short-utterance language-ID check for Whisper turbo vs Qwen 1.7B on the Auto set, since dictation clips are 2-10 s.
- Apple Silicon speed for each GGUF on a base M-series chip, not an M4 Max.
Sources
- transcribe.cpp (MIT,
handy-computer/transcribe.cpp)docs/models/:qwen3-asr-0.6b.md,qwen3-asr-1.7b.md,whisper-large-v3-turbo.md,whisper-large-v3.md,sensevoice-small.md,fun-asr-nano-2512.md,fun-asr-mlt-nano-2512.md,cohere-transcribe-03-2026.md,cohere-transcribe-arabic-07-2026.md,nemotron-3.5-asr-streaming-0.6b.md,voxtral-mini-3b-2507.md,granite-speech-4.1-2b.md;README.mdmodel table; tags v0.2.4, v0.3.0, v0.4.1src/arch/. All FLEURS numbers above are from these pages, Q8_0. - crates.io
transcribe-cpprelease dates (0.2.4 2026-09-25, 0.4.1 2026-10-22). - Qwen3-ASR Technical Report, arXiv 2601.21337, and the Qwen/Qwen3-ASR-1.7B model card (vendor): MLS/Common Voice/MLC-SLM/Fleurs, LID accuracy. Vendor-only.
- FunASR Model Open Source License v1.1 (
modelscope/FunASRMODEL_LICENSE). hf-audio/open-asr-leaderboard-resultsfile listing (English only).