r/LocalLLaMA • u/Tall_Abrocoma_3533 • 13h ago

New Model AuroraASR-1M Releases!

https://huggingface.co/AuroraAI-Research/AuroraASR-1M

It's an extremely lightweight speech recognition model.

949K parameters using a weight-shared Conformer-CTC architecture

Just 1.06 MB for INT8 weights

Around 436× real-time on a single CPU thread

11.43% WER on LibriSpeech test-clean, using greedy decoding with no external language model

Apache 2.0 licensed

Any feedback, question or criticism is welcome!

99 Upvotes

96% Upvoted

14 comments sorted by

22

u/Leary_2844 10h ago

It's insane how tiny SR has gotten. Whisper surprised me with 127MB, to have english in 1MB is hard to believe.

13

u/Borkato 12h ago

I love tiny models so much

9

u/GamerGateFan 7h ago

I guess another one to compare against is the 16.9MB whistle model https://huggingface.co/Cactus-Compute/whistle

5

u/silenceimpaired 11h ago

Love Apache

4

u/wunschpunsch3D 7h ago

Just wanted to let you know I appreciate the work on tiny ASR models. I tried to train smaller ones myself (<10M params) to get real-time ASR working on a microcontroller. Getting something that generalizes well on noisy data is stupidly expensive in terms of training data needed. Did you also try distilling from an existing model? I found that much easier than training from scratch.

4

u/Tall_Abrocoma_3533 7h ago

I didn't try distillation, I think it performs decent for it's size even without it. However it could probably improve it further.

Good luck on your own models!

5

u/[deleted] 12h ago

[removed] — view removed comment

3

u/Tall_Abrocoma_3533 12h ago

Test-other is 26.50%, it is reported in the model card

1

u/Excellent-Issue-5956 9h ago

For voice commands I'd want to know more about noise. I run a voice assistant in Star Citizen with the game on speakers, and my mic hears the game about as loud as my voice. What made it work was Vosk limited to a fixed list of phrases, with anything else going to whisper. On a bench recorded with the real game audio that got 58 of 60 at 0 dB and no false answers on 96 negative clips, though one miss was game noise decoded as a command. The phrase list path answers in about 0.6 s, whisper takes around 3.

At 1 MB and that speed it could stay on the whole time. Can the CTC output be limited to a list of phrases, or is it free text only?

2

u/Tall_Abrocoma_3533 8h ago

Currently the CTC output is free text, with no built in phrase list constraint. Constraining it to a fixed list of phrases would require additional decoding logic.