mirror of
https://github.com/anomalyco/hex.git
synced 2026-11-22 21:23:02 +01:00
* Build the native Android dictation keyboard Add a three-page Compose setup and an InputMethodService with QWERTY editing, system IME switching, tap dictation and hold-to-talk. Capture inside the keyboard and decode a checksum-pinned, MIT-licensed Whisper tiny model so a fresh install works offline without an app switch, playback focus request or audio files. Verified on the Studio API 35 ARM64 emulator: clean assembleDebug, three debug/release unit cases, system permission and keyboard setup, actual key editing, two WAVs through the guest microphone, insertion into a separate editor, cancellation and continued media output. The merged debug manifest has no Internet permission. * Document Android setup and the recognizer decision Record the supported toolchain, model and runtime licences, offline-first trade-off, and phase 1 limits. Document the headless emulator microphone path used for verification so the next phase can repeat it. Checked the Studio build/run commands and both recognizers on the API 35 image with airplane mode enabled and media playing. * Measure on-device Android dictation across four languages Replace the phase-one single-phrase evidence with a fixed 40-clip multilingual, partly music-mixed corpus. Record per-clip errors, load, warm inference, memory, two-core sensitivity and delivered platform-service results separately. Keep an independent foreground editor and media track for mic-to-insertion verification. Verified on an API 35 ARM64 Studio emulator: Whisper tiny/base/small, Parakeet TDT v3 int8 and strictly on-device Android recognition. Small in its short window made 15/285 word errors; the platform service returned 33/40. Both native runners also decoded the notebook clip after tightening the PCM input checks. * Use verified Whisper small for styled, offline Android dictation Replace tiny-only English recognition with a pinned small model selected by the multilingual benchmark. Keep bundled tiny for first-run offline use and download failures. Snapshot the style, cleanup, language and translation task per recording so a paste override affects only the intended editor and dictation. Replace the recording status text and old meter with the iOS-style dot waveform, round cancel/finish controls and in-place spinner. Explain the sole network permission on welcome and bundle verified Inter v4.1 and its OFL notice for Compose and the keyboard. Verified assembleDebug and tests on the Studio. The Android formatter matched 41 applicable iOS examples. Exercised tiny before download, observed progress and verified small and Inter hashes. The real IME inserted all four styles and both Spanish paste choices in airplane mode, with music continuing in an external editor; checked recording and transcribing in both themes. * Add offline spatial typing assistance to the Android keyboard Replace literal-only English and Spanish key handling with a native Kotlin Gaussian tap decoder, context-weighted word pairs, missed-space readings, and confidence margins. Map the pinned, uncompressed iOS-compatible Google Books v3 assets; credit the CC BY counts, SCOWL and MPL word filters. Use hashed local rejection counts so a second undo stops that correction without saving typed text. Give the idle strip three frequency-ranked slots and add independent default-on key previews and system-aware haptics, plus slide-to-select accents. Commit space on the same key-up as letters: the previous posted click could reorder rapid input. Make a confident known spelling harder to replace than an unknown one. Verified on Studio API 35: assembleDebug and tests, byte-identical English and Spanish models, the exact centre-tapped typo sentence in both themes, one-backspace undo and suppression after two undos across an IME restart, ranked suggestions, accent insertion, independent switches and the system vibration gate. * Benchmark Android typing against iOS on synthetic key taps Replay the 2,000 held-out English sentences through the installed Kotlin decoder and suggestion path, keeping only public synthetic rows from the mixed iOS experiment. Preserve aggregate scores, the unmodified Google Books model builder, and the two model digests; no labelled personal typing, offsets, or raw logs are committed. Verified 1,461 errors over 13,870 words (10.53% Android; 8.39% iOS without offsets using the byte-identical model; 33.81% raw). On the Studio emulator the real editor received letters in 1.41 ms median and spaces in 3.16 ms across five exact sentence replays. Document the confidence margins, timing boundaries, feedback controls, licences and reproducible aggregate scorer. * Align Android typing with iOS and add German and Bokmål layouts and models Apply R1's English typo and contraction rules before spatial search and match its language weight, shortlist and valid-spelling margins. A mapped SCOWL spelling list supplies the validity check missing on Android. Scale vertical spread and the missing-space cost to real Android row geometry so "seehkw" still splits into "see how". Keep the existing en/es model bytes. Build the new German and Bokmål HXTM files with the shared iOS writer. German uses all Google Books v3 shards; Bokmål uses NB book counts filtered by the complete 2022 Ordbank snapshot. Pin the new assets, credit their sources and licences, and ship their real layouts, accents and suggestions. Replace the post-setup list with the iOS-style Home, local Dictate bar and four settings pages. Follow the system language by default; make the spoken language switchable on space, and optionally pin an independent layout. Verified on the Studio API 35 ARM64 emulator: 1,027 English and 1,374 Spanish word errors vs R1's 1,163 and 1,387 on the same 2,000 synthetic sentences per language. Ran all five unit tests in debug and release, inspected the packaged assets, and checked external-editor suggestions, corrections, undo and offline microphone insertion, plus Home and settings in both themes. The Swift reader round-tripped both new models; the identical iOS files are in the separate local commit 230a437e. * Build a signed, shrunk Android 16 upload bundle Replace the API 35 release defaults with API 36, an external upload key, R8 and resource shrinking. Omit the debug probes, benchmark receiver and unused permission, silence native speech diagnostics, and guard password-field context at the input connection. Give the download a generic user agent and ship the Android privacy policy offline. Verified on the Studio: jarsigner, bundletool and byte-identical installed splits on API 31 and API 36; all ELF load segments and APK native offsets meet 16 KB alignment. Fresh model downloads and offline insertion passed on both. Binder traces showed zero reads in four password variants versus ten in an ordinary editor. Five tests passed in each build variant. * Prepare the Android Play listing and device handoff Add the en-US listing, Data safety and IARC drafts, four release screenshots, launcher-derived store art and a physical-phone checklist. Replace the obsolete API 35 build instructions with the signed API 36 workflow. Flag that the public privacy URL still needs the Android text and that suggestions can include strong language. Verified title and description limits, native screenshot and artwork formats, model downloads and offline microphone insertion in an external editor on 2.5 GiB API 31 and 16 KB API 36 emulators. Recorded bundletool download size and sampled memory from the same signed release.
248 lines
11 KiB
Text
248 lines
11 KiB
Text
The collective work is Copyright 2000-2018 by Kevin Atkinson as well
|
|
as any of the copyrights mentioned below:
|
|
|
|
Copyright 2000-2018 by Kevin Atkinson
|
|
|
|
Permission to use, copy, modify, distribute and sell these word
|
|
lists, the associated scripts, the output created from the scripts,
|
|
and its documentation for any purpose is hereby granted without fee,
|
|
provided that the above copyright notice appears in all copies and
|
|
that both that copyright notice and this permission notice appear in
|
|
supporting documentation. Kevin Atkinson makes no representations
|
|
about the suitability of this array for any purpose. It is provided
|
|
"as is" without express or implied warranty.
|
|
|
|
Alan Beale <biljir@pobox.com> also deserves special credit as he has,
|
|
in addition to providing the 12Dicts package and being a major
|
|
contributor to the ENABLE word list, given me an incredible amount of
|
|
feedback and created a number of special lists (those found in the
|
|
Supplement) in order to help improve the overall quality of SCOWL.
|
|
|
|
The 10 level includes the 1000 most common English words (according to
|
|
the Moby (TM) Words II [MWords] package), a subset of the 1000 most
|
|
common words on the Internet (again, according to Moby Words II), and
|
|
frequently class 16 from Brian Kelk's "UK English Wordlist
|
|
with Frequency Classification".
|
|
|
|
The MWords package was explicitly placed in the public domain:
|
|
|
|
The Moby lexicon project is complete and has
|
|
been place into the public domain. Use, sell,
|
|
rework, excerpt and use in any way on any platform.
|
|
|
|
Placing this material on internal or public servers is
|
|
also encouraged. The compiler is not aware of any
|
|
export restrictions so freely distribute world-wide.
|
|
|
|
You can verify the public domain status by contacting
|
|
|
|
Grady Ward
|
|
3449 Martha Ct.
|
|
Arcata, CA 95521-4884
|
|
|
|
grady@netcom.com
|
|
grady@northcoast.com
|
|
|
|
The "UK English Wordlist With Frequency Classification" is also in the
|
|
Public Domain:
|
|
|
|
Date: Sat, 08 Jul 2000 20:27:21 +0100
|
|
From: Brian Kelk <Brian.Kelk@cl.cam.ac.uk>
|
|
|
|
> I was wondering what the copyright status of your "UK English
|
|
> Wordlist With Frequency Classification" word list as it seems to
|
|
> be lacking any copyright notice.
|
|
|
|
There were many many sources in total, but any text marked
|
|
"copyright" was avoided. Locally-written documentation was one
|
|
source. An earlier version of the list resided in a filespace called
|
|
PUBLIC on the University mainframe, because it was considered public
|
|
domain.
|
|
|
|
Date: Tue, 11 Jul 2000 19:31:34 +0100
|
|
|
|
> So are you saying your word list is also in the public domain?
|
|
|
|
That is the intention.
|
|
|
|
The 20 level includes frequency classes 7-15 from Brian's word list.
|
|
|
|
The 35 level includes frequency classes 2-6 and words appearing in at
|
|
least 11 of 12 dictionaries as indicated in the 12Dicts package. All
|
|
words from the 12Dicts package have had likely inflections added via
|
|
my inflection database.
|
|
|
|
The 12Dicts package and Supplement is in the Public Domain.
|
|
|
|
The WordNet database, which was used in the creation of the
|
|
Inflections database, is under the following copyright:
|
|
|
|
This software and database is being provided to you, the LICENSEE,
|
|
by Princeton University under the following license. By obtaining,
|
|
using and/or copying this software and database, you agree that you
|
|
have read, understood, and will comply with these terms and
|
|
conditions.:
|
|
|
|
Permission to use, copy, modify and distribute this software and
|
|
database and its documentation for any purpose and without fee or
|
|
royalty is hereby granted, provided that you agree to comply with
|
|
the following copyright notice and statements, including the
|
|
disclaimer, and that the same appear on ALL copies of the software,
|
|
database and documentation, including modifications that you make
|
|
for internal use or for distribution.
|
|
|
|
WordNet 1.6 Copyright 1997 by Princeton University. All rights
|
|
reserved.
|
|
|
|
THIS SOFTWARE AND DATABASE IS PROVIDED "AS IS" AND PRINCETON
|
|
UNIVERSITY MAKES NO REPRESENTATIONS OR WARRANTIES, EXPRESS OR
|
|
IMPLIED. BY WAY OF EXAMPLE, BUT NOT LIMITATION, PRINCETON
|
|
UNIVERSITY MAKES NO REPRESENTATIONS OR WARRANTIES OF MERCHANT-
|
|
ABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE OR THAT THE USE OF THE
|
|
LICENSED SOFTWARE, DATABASE OR DOCUMENTATION WILL NOT INFRINGE ANY
|
|
THIRD PARTY PATENTS, COPYRIGHTS, TRADEMARKS OR OTHER RIGHTS.
|
|
|
|
The name of Princeton University or Princeton may not be used in
|
|
advertising or publicity pertaining to distribution of the software
|
|
and/or database. Title to copyright in this software, database and
|
|
any associated documentation shall at all times remain with
|
|
Princeton University and LICENSEE agrees to preserve same.
|
|
|
|
The 40 level includes words from Alan's 3esl list found in version 4.0
|
|
of his 12dicts package. Like his other stuff the 3esl list is also in the
|
|
public domain.
|
|
|
|
The 50 level includes Brian's frequency class 1, words appearing
|
|
in at least 5 of 12 of the dictionaries as indicated in the 12Dicts
|
|
package, and uppercase words in at least 4 of the previous 12
|
|
dictionaries. A decent number of proper names is also included: The
|
|
top 1000 male, female, and Last names from the 1990 Census report; a
|
|
list of names sent to me by Alan Beale; and a few names that I added
|
|
myself. Finally a small list of abbreviations not commonly found in
|
|
other word lists is included.
|
|
|
|
The name files form the Census report is a government document which I
|
|
don't think can be copyrighted.
|
|
|
|
The file special-jargon.50 uses common.lst and word.lst from the
|
|
"Unofficial Jargon File Word Lists" which is derived from "The Jargon
|
|
File". All of which is in the Public Domain. This file also contain
|
|
a few extra UNIX terms which are found in the file "unix-terms" in the
|
|
special/ directory.
|
|
|
|
The 55 level includes words from Alan's 2of4brif list found in version
|
|
4.0 of his 12dicts package. Like his other stuff the 2of4brif is also
|
|
in the public domain.
|
|
|
|
The 60 level includes all words appearing in at least 2 of the 12
|
|
dictionaries as indicated by the 12Dicts package.
|
|
|
|
The 70 level includes Brian's frequency class 0 and the 74,550 common
|
|
dictionary words from the MWords package. The common dictionary words,
|
|
like those from the 12Dicts package, have had all likely inflections
|
|
added. The 70 level also included the 5desk list from version 4.0 of
|
|
the 12Dics package which is in the public domain.
|
|
|
|
The 80 level includes the ENABLE word list, all the lists in the
|
|
ENABLE supplement package (except for ABLE), the "UK Advanced Cryptics
|
|
Dictionary" (UKACD), the list of signature words from the YAWL package,
|
|
and the 10,196 places list from the MWords package.
|
|
|
|
The ENABLE package, mainted by M\Cooper <thegrendel@theriver.com>,
|
|
is in the Public Domain:
|
|
|
|
The ENABLE master word list, WORD.LST, is herewith formally released
|
|
into the Public Domain. Anyone is free to use it or distribute it in
|
|
any manner they see fit. No fee or registration is required for its
|
|
use nor are "contributions" solicited (if you feel you absolutely
|
|
must contribute something for your own peace of mind, the authors of
|
|
the ENABLE list ask that you make a donation on their behalf to your
|
|
favorite charity). This word list is our gift to the Scrabble
|
|
community, as an alternate to "official" word lists. Game designers
|
|
may feel free to incorporate the WORD.LST into their games. Please
|
|
mention the source and credit us as originators of the list. Note
|
|
that if you, as a game designer, use the WORD.LST in your product,
|
|
you may still copyright and protect your product, but you may *not*
|
|
legally copyright or in any way restrict redistribution of the
|
|
WORD.LST portion of your product. This *may* under law restrict your
|
|
rights to restrict your users' rights, but that is only fair.
|
|
|
|
UKACD, by J Ross Beresford <ross@bryson.demon.co.uk>, is under the
|
|
following copyright:
|
|
|
|
Copyright (c) J Ross Beresford 1993-1999. All Rights Reserved.
|
|
|
|
The following restriction is placed on the use of this publication:
|
|
if The UK Advanced Cryptics Dictionary is used in a software package
|
|
or redistributed in any form, the copyright notice must be
|
|
prominently displayed and the text of this document must be included
|
|
verbatim.
|
|
|
|
There are no other restrictions: I would like to see the list
|
|
distributed as widely as possible.
|
|
|
|
The 95 level includes the 354,984 single words, 256,772 compound
|
|
words, 4,946 female names and the 3,897 male names, and 21,986 names
|
|
from the MWords package, ABLE.LST from the ENABLE Supplement, and some
|
|
additional words found in my part-of-speech database that were not
|
|
found anywhere else.
|
|
|
|
Accent information was taken from UKACD.
|
|
|
|
The VarCon package was used to create the American, British, Canadian,
|
|
and Australian word list. It is under the following copyright:
|
|
|
|
Copyright 2000-2016 by Kevin Atkinson
|
|
|
|
Permission to use, copy, modify, distribute and sell this array, the
|
|
associated software, and its documentation for any purpose is hereby
|
|
granted without fee, provided that the above copyright notice appears
|
|
in all copies and that both that copyright notice and this permission
|
|
notice appear in supporting documentation. Kevin Atkinson makes no
|
|
representations about the suitability of this array for any
|
|
purpose. It is provided "as is" without express or implied warranty.
|
|
|
|
Copyright 2016 by Benjamin Titze
|
|
|
|
Permission to use, copy, modify, distribute and sell this array, the
|
|
associated software, and its documentation for any purpose is hereby
|
|
granted without fee, provided that the above copyright notice appears
|
|
in all copies and that both that copyright notice and this permission
|
|
notice appear in supporting documentation. Benjamin Titze makes no
|
|
representations about the suitability of this array for any
|
|
purpose. It is provided "as is" without express or implied warranty.
|
|
|
|
Since the original words lists come from the Ispell distribution:
|
|
|
|
Copyright 1993, Geoff Kuenning, Granada Hills, CA
|
|
All rights reserved.
|
|
|
|
Redistribution and use in source and binary forms, with or without
|
|
modification, are permitted provided that the following conditions
|
|
are met:
|
|
|
|
1. Redistributions of source code must retain the above copyright
|
|
notice, this list of conditions and the following disclaimer.
|
|
2. Redistributions in binary form must reproduce the above copyright
|
|
notice, this list of conditions and the following disclaimer in the
|
|
documentation and/or other materials provided with the distribution.
|
|
3. All modifications to the source code must be clearly marked as
|
|
such. Binary redistributions based on modified source code
|
|
must be clearly marked as modified versions in the documentation
|
|
and/or other materials provided with the distribution.
|
|
(clause 4 removed with permission from Geoff Kuenning)
|
|
5. The name of Geoff Kuenning may not be used to endorse or promote
|
|
products derived from this software without specific prior
|
|
written permission.
|
|
|
|
THIS SOFTWARE IS PROVIDED BY GEOFF KUENNING AND CONTRIBUTORS ``AS IS'' AND
|
|
ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
|
|
IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
|
|
ARE DISCLAIMED. IN NO EVENT SHALL GEOFF KUENNING OR CONTRIBUTORS BE LIABLE
|
|
FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
|
|
DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
|
|
OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
|
|
HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
|
|
LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
|
|
OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
|
|
SUCH DAMAGE.
|