AI companies across the world are racing to make bigger and better models, but the problem is all of them need massive amounts of processing power. On the other end, some researchers and startups are creating smaller models that can run on edge devices, like your phone or computer.
One such startup, Underdog, has released a game built with its new voice model called Woof that’s only 32MB large.
The game features a room with a retro tech theme, a typewriter, and a CRT monitor. There is a desk lamp, which makes a sound when you click its switch. The intro warns users about “intrusive” cloud providers in the town — ostensibly a jab at cloud-based models.
You can interact with the typewriter and music tuner.
We made a game for our new frontier text-to-speech model, Woof. 31.7 MB, so small that it runs in your browser Play the game on X… all voices are Woof. Defeat Darkcloud for an invite https://t.co/ImUFYDCBQG pic.twitter.com/tthHx7ZGBK
You can type anything on the typewriter using your keyboard, and the game will speak it back. You can also rotate the tuner to generate different kinds of music.
All of this works within the browser through Underdog’s speech generation model, which, the company says, can run on most devices without any internet connection. The model has 31 million parameters and is open for everyone to download.
While such a small model likely won’t replace bigger models, it may still be enough to drive local assistant experiences or create personalized podcasts.
This demo comes weeks after Underdog launched Bark, a 167 MB speech-to-text model also designed to run on edge devices for transcription and dictation.
Sigil Wen, the founder of Underdog, told TechCrunch that he started building the app because, instead of using notetakers like Granola, he wanted to build his own system with AI models that can run on users’ devices and let them own their data.
“I think we will be able to run most capable models of today on the devices you already own within months. We just want to train the best open models that are American-made, that are open, that are capable and allow people to have private AI,” he said, referring to his manifesto.
In addition to the two voice models mentioned above, Underdog has also released a 27-billion-parameter model that can run on laptops, along with a waitlisted app that the company is positioning as a locally-hosted alternative to Muse and Instinct.
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.
Ivan covers global consumer tech developments at TechCrunch. He is based out of India and has previously worked at publications including Huffington Post and The Next Web.
You can contact or verify outreach from Ivan by emailing [email protected] or via encrypted message at ivan.42 on Signal.
Buy One Pass, Get a Second FreeCover more ground at TechCrunch’s ultimate founder bootcamp of the year by bringing your co-founder or partner for freeBook before the BOGO deal expires
Claude can now analyze your spending with its new Personal Finance tool
Aisha Malik
Data centers are turning to old jet engines as the wait for power grows
Aditya Mehta
New York City’s Mamdani criticizes Madison Square Garden owner over surveillance tech
Zack Whittaker
Y Combinator’s Garry Tan uses AI agents so much, he spends up to $200K a year on tokens
Julie Bort
Anthropic warns that it’s very close to RSI capability, aka self-building AI
Julie Bort
New York Times and other outlets sue web browser Brave over alleged content scraping
Rebecca Bellan
Ninja’s first-ever microwave just replaced two of my kitchen appliances at once
Lauren Forristal
Fox Style News Syndicate. Sourced from broadcast reporting: Read Full Source Coverage.