No description
  • Rust 78.5%
  • JavaScript 6.6%
  • TypeScript 4%
  • HTML 4%
  • Shell 2%
  • Other 4.9%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Ryan Vogel ef133b8a4f
iOS keyboard: smoother, calmer motion for the live dictation preview (#2424)
* iOS keyboard: the live preview's motion, smooth and calm

What: one spring family (duration and bounce 0, UIKit's springDuration curve) for every
change while dictating, all of it drawn by one view so no memory comes back:
- Keys out, words in as recording starts: the keys fade (.2) as the words fade in rising
  6 pt (.3), the same frame. Words out, keys back as the dictation goes in: the words fade
  drifting 6 pt up toward the field (.15) as the keys fade in (.3); the words stop taking
  touches at once, so the keys work the moment the dictation ends.
- Words arriving (LiveWordsView): each new word fades in rising 4 pt (.3), a burst's words
  40 ms apart and all of them within 240 ms, so the last is in long before Apple's next
  burst (about once a second). "Listening…" fades out a beat (60 ms) ahead of the first words.
- Tentative to settled: the muted tone eases to the keys' ink (.3).
- A new line: the block moves up by a critically damped spring (.3) that carries on from
  where it is when another line comes, and the line leaving the top fades through a 14 pt band
  instead of being cut.
- A changed word ("Okay" to "Hey", "730." to "7.30."): the old word fades out where it was
  (.15) as the new one fades in (.2); words keep their place by position, so the words after
  it never re-fade, and a word that only gains a mark stays as it is.
- The recording bar's morph has no bounce any more (was damping .82) and its fades are the
  same spring (.2), so nothing bounces.
- Reduce Motion: fades only (.2), nothing rises, drifts or slides.
LiveWordsView draws the words with one TextKit 1 layout into one backing store the size of the
box, from a display link that runs only while something moves, and drops whole lines well out
of view so the lines that stay never re-break. It replaces the preview's label.

Why: Ryan asked for smoother motion with better easing after watching the phone recordings
(keys and words swapped in 180 ms with a double exposure; a burst's words popped in at once).

Verified: LiveDictationTests (10) on the Studio simulator; the Studio simulator with the 60 s
replay: footprint +2.7 MB at most while recording (+5.7 with #2410's label), 1,868 frames
drawn while moving, none late; frames of a recording checked for the start, a burst, a new
line and the end. code-shape.py passes.

* iOS keyboard: the preview's words move by Core Animation, not a display link

What: LiveWordsView no longer redraws every frame. It lays the words out and draws them once
per update, in one layer, and Core Animation does every frame of the motion: what changed
cross-fades in place (0.3 s, the cubic closest to a no-bounce spring: new words, a settled
tail turning to ink, a word the recogniser changed), the block moves up by whole lines with a
no-bounce spring (0.3 s) inside a box whose 14 pt band fades the line leaving the top, and once
at rest that line fades out of the band and the lines above the box are dropped from the layout
with nothing on screen changing. The per-word stagger and rise are gone.

Why: on the iPhone 17 Pro the display link drawing the words got only a quarter of its frames
on time while recording (intervals 12-20 ms 26%, 20-30 ms 23%, 30-45 ms 27%, longer 24%; the
drawing itself took 0.3 ms): the main thread is shared with the capture, the recogniser and the
Dot Scope. Core Animation's own animations keep the display's pace regardless.

Verified: LiveDictationTests (9, including whole-line scrolling and dropping the lines above the
box) and recordings on the Studio simulator: a burst, settling, a new line with the band's fade,
the drop at rest, the start and the end; 60 s replay +5.9 MB at most against +7.0 MB for the
same recording without the preview; 1.4 ms of main thread per update.

* iOS README: the live preview's motion, as it now runs

What: the live-words bullet in ios/README.md describes the motion as it ships: one family (a
no-bounce spring by its duration, and its closest cubic for the cross-fade), Core Animation
running every frame, what changes cross-fading in place while the rest stays exactly as it is,
whole-line scrolling through a 14 pt band, and Reduce Motion as cross-fades only. Replaces the
paragraph about per-word staggers and a display link, which the previous commit removed.

Why: the README is where the keyboard's behaviour is written down for the next person.

Verified on the iPhone 17 Pro with 9869899c installed, warm (Parakeet compiled before measuring):
- 60 s dictation, preview on: 59.1 MB at the end, 62.9 MB peak while recording, 76.3 MB at
  transcription (peak 77.3); #2410 was 60.1 / 66.5 / 78.7. Preview off: 58.3 / 60.0 / 75.3.
- The preview's main-thread share: 1.69 ms per update on average, 3.40 ms at most (242 updates).
- In the 30 fps phone recordings, words that didn't change hold the same brightness to the
  decimal through every cross-fade near them; a changing line eases over about 0.2 s with no
  stall; the field's text appears on the frame the preview's words go.

Correction to 9869899c's message: its "+7.0 MB for the same recording without the preview" on
the simulator wasn't measured (the simulator's memory script only runs with the preview); the
phone numbers above are the comparison.
2026-11-22 14:49:09 -05:00
.cargo Add KB-Whisper Medium for Swedish (#1991) (#1992) 2026-11-19 05:44:56 -05:00
.cloudflare/cache ci(aur): a dispatchable check that the AUR accepts the deploy key 2026-10-23 14:41:55 -04:00
.config feat(onboarding): the first run is one story, from a bad conversation to your first words (#1501) 2026-11-09 17:29:51 -08:00
.github x86_64: opt-in Ivy Bridge source build (HEX_X86_BASELINE=ivybridge) (#2419) 2026-11-22 14:36:17 -05:00
android iOS keyboard: Polish autocorrects with Hex's own model, word list and capitals (#2423) 2026-11-22 14:45:55 -05:00
app Keep the old Sparkle key so 2.3.1 and Swift Hex can update into the new Hex (t1217) (#1092) 2026-11-02 21:44:19 -08:00
assets Show Jay's photo in onboarding (#1630) 2026-11-10 13:41:20 -08:00
crates feat(screenshots): Export asks where to save, and recordings dim around their target (#2297) 2026-11-21 17:18:56 -08:00
design Captures: the Scrawl capsule and ink overlay on Rune 2026-10-26 10:48:55 -07:00
docs x86_64: opt-in Ivy Bridge source build (HEX_X86_BASELINE=ivybridge) (#2419) 2026-11-22 14:36:17 -05:00
ios iOS keyboard: smoother, calmer motion for the live dictation preview (#2424) 2026-11-22 14:49:09 -05:00
macos/HexMicrophoneDriver feat(macos): the app is anomaly.hex, a new app to macOS, from the first Anomaly-signed release 2026-10-23 14:57:13 -04:00
native macOS: close the Screen Recording guide once Hex reads the grant (#2086) 2026-11-20 14:50:03 -05:00
nix nix: include skills/ and the iOS cleaner in the package source (#2234) 2026-11-21 11:44:00 -08:00
packaging windows: sign the setup engine so smart app control can run setup (#1987) 2026-11-19 02:38:03 -05:00
perf perf: listening bench waits for the listener before measuring rest (#1615) 2026-11-09 16:19:11 -06:00
prototypes/app-shell Rename voice-control to hex everywhere, without migrations (#293) 2026-10-28 13:08:44 -04:00
release-notes feat: add local transcription service and resilient capture 2026-07-21 14:22:12 -04:00
resources linux: recolor the tray mark with the panel's text color (#1691) 2026-11-11 10:46:08 -05:00
scripts ci: make linux installer fixture server startup robust (#2168) 2026-11-21 04:24:19 -05:00
sdk add fluid speech pro to the speech model catalog (#2007) 2026-11-19 15:19:06 -05:00
site labs: hud height for the bottom dictation hud (macos) (#2418) 2026-11-22 14:31:32 -05:00
skills annotate: start capture summaries with [hex-annotate …] (#2230) 2026-11-21 14:34:56 -05:00
src x86_64: opt-in Ivy Bridge source build (HEX_X86_BASELINE=ivybridge) (#2419) 2026-11-22 14:36:17 -05:00
tests fix(settings): keep what's new in step with labs (#2409) 2026-11-22 13:37:35 -05:00
.gitignore iOS: German autocorrect capitalises common nouns (haus, auto, zeit) (#2169) 2026-11-21 05:30:03 -05:00
.hivemind.toml feat(land): add declarative .hivemind.toml land queue + Hex.app swap (t811) (#387) 2026-10-29 09:52:47 -07:00
.markdownlint-cli2.jsonc feat: unify desktop modes and platform runtime 2026-07-23 17:33:22 -04:00
AGENTS.md labs: signature line for dictation (#2319) 2026-11-22 00:47:26 -05:00
build.rs x86_64: opt-in Ivy Bridge source build (HEX_X86_BASELINE=ivybridge) (#2419) 2026-11-22 14:36:17 -05:00
Cargo.lock fix: drop parakeet's padding mel frame before the encoder (#2072) (#2076) 2026-11-20 13:01:29 -05:00
Cargo.toml fix: drop parakeet's padding mel frame before the encoder (#2072) (#2076) 2026-11-20 13:01:29 -05:00
clippy.toml Add agent marker and drop internal references (#702) 2026-10-31 18:30:32 -07:00
CONTRIBUTING.md docs: rewrite README minimal, shorten CONTRIBUTING 2026-11-01 12:44:35 -05:00
flake.lock feat(linux): add wlroots Wayland support and Nix packaging (#36) 2026-08-28 12:05:21 -04:00
flake.nix nix: build for aarch64-linux (#1057) 2026-11-02 14:11:35 -05:00
LICENSE feat: unify desktop modes and platform runtime 2026-07-23 17:33:22 -04:00
README.md Add KB-Whisper Medium for Swedish (#1991) (#1992) 2026-11-19 05:44:56 -05:00
ROADMAP.md Roadmap: Hex Mobile clipboard history (#2167) 2026-11-21 08:55:35 +00:00
SECURITY.md Rename voice-control to hex everywhere, without migrations (#293) 2026-10-28 13:08:44 -04:00
strobe.json perf: listening bench waits for the listener before measuring rest (#1615) 2026-11-09 16:19:11 -06:00
THIRD_PARTY_NOTICES.md add fluid speech pro to the speech model catalog (#2007) 2026-11-19 15:19:06 -05:00

Hex

Hex is local voice dictation for Mac, Windows and Linux. Hold a key, speak, and it pastes.

How it works

  • hold the shortcut, speak, then let go
  • Hex transcribes on your device and pastes into whatever app you're in
  • the first run downloads a speech model; after that nothing leaves your machine
  • experimental features live in Labs, at the bottom of the sidebar

What it does

  • hold the shortcut to dictate, or set Shortcut mode to Tap to start and stop with a press
  • the text lands at the cursor in whatever app you're in
  • Option-Shift-V pastes the last dictation again (Ctrl-Alt-V on Windows and Linux)
  • History keeps your dictations, searchable, for 7 days by default
  • Output runs every dictation through steps you choose (word replacements, built-in cleanups, your own scripts, an optional OpenCode rewrite), with different steps per app or website
  • Vocabulary is one list of names Hex should know; Whisper and Qwen3-ASR read it while transcribing, Parakeet models read it with Labs › Vocabulary help on, and the OpenCode rewrite uses it
  • Annotate records the screen while you draw and talk, on macOS, Linux and Windows (GNOME Wayland needs Labs › Annotate on GNOME)
  • an authenticated local API and the TypeScript SDK transcribe with the same model, for your own tools
  • Meetings is a macOS lab that records a call and writes the transcript

Output and History:

Hex output: the steps every dictation runs, a Try box, and different steps per app Hex history: past dictations, a search field, and one entry's raw transcript, app, processing and model

Speech models

Hex downloads one model the first time it runs and transcribes with it on your machine from then on. On an English system that's Parakeet Unified English: it writes while you talk, so the text is ready when you let go. Other languages start with the model recommended for them. That model also serves meetings and hex transcribe.

Settings' picker offers more, among others:

  • Parakeet v3: 25 European languages, and it hears which one you speak
  • Cohere Transcribe: the fewest wrong words, in 14 languages; a big download
  • Whisper large-v3-turbo: almost any language, and it reads your vocabulary
  • Qwen3-ASR 0.6B: Chinese and 29 more, and it reads your vocabulary
  • SenseVoice Small: Chinese, Japanese, Korean and English; a small download
  • Nemotron 3.5 ASR: writes while you talk, in 27 languages
  • Granite Speech 5.0: IBM's model, seven languages, with punctuation
  • one-language models: ivrit.ai Whisper for Hebrew, GigaAM v3 for Russian, NB-Whisper for Norwegian, KB-Whisper for Swedish, QwenCleo-ASR for Egyptian Arabic
  • more English models: Parakeet v2 and Underdog Bark 3.0

Add a GGUF model of your own with "Add model file…" in the picker; see your own speech models.

Downloads

Stable is the current release. Dev is the newest build of dev and updates itself from the dev channel.

Platform Stable Dev
macOS (Apple silicon) DMG DMG
Windows x64 Installer Installer
Windows ARM64 Installer Installer
Linux x86_64 Executable Executable
Linux x86_64 (Debian, Ubuntu) .deb .deb
Linux x86_64 (Fedora, openSUSE) .rpm .rpm
Linux ARM64 Executable Executable
Linux ARM64 (Debian, Ubuntu) .deb .deb
Linux ARM64 (Fedora, openSUSE) .rpm .rpm

Or install with:

  • Homebrew: brew install --cask anomalyco/tap/hex
  • AUR: yay -S hex-bin
  • install script (Linux): curl -fsSL https://anoma.ly/hex/install-linux.sh | sh
  • Nix (Linux): nix profile add github:anomalyco/hex

Command line

hex transcribe meeting.m4a prints a recording's transcript, whether or not the app is running. It reads WAV, AIFF, CAF, FLAC, MP3, Ogg, WebM, and MP4/M4A/MOV, including a video's soundtrack. The same hex controls the running app (hex status, hex dictation, hex settings); see docs/cli.md.

On macOS the CLI is inside the app. Homebrew links it for you; otherwise link it somewhere on your PATH that you own:

ln -s /Applications/Hex.app/Contents/MacOS/hex ~/.local/bin/hex

Linux and Windows installs put hex on your PATH.

More docs are in docs/.

Contributing

We don't take pull requests. Open an issue describing the bug or idea, and our agents usually turn it around fast.

MIT licensed.