Smallest.ai raises $13M to build ultra-fast voice AI that sounds genuinely human

This post was originally published on this site.

image

While AI agents are increasingly capable of solving customer support problems, most people can still tell immediately when they’re talking to a machine instead of a human.

Smallest.ai, a startup founded in late 2024, is betting the next leap in voice agents will not come from making large language models faster, but from using smaller, specialized models built for human conversation. Simply put, the company wants to make speaking to an AI agent indistinguishable from talking to a human.

To do so, it’s developing a small voice model designed to mimic how humans process information by listening, thinking, and speaking simultaneously.

“While I’m speaking to you, you’re already thinking, and you might interrupt me if I talk for too long,” Sudarshan Kamath (pictured left), founder and CEO of Smallest.ai, told TechCrunch, adding that this is exactly how the startup’s model is designed to work.

To fuel this mission, Smallest.ai has raised $13 million in a Series A round, led by Seligman Ventures with participation from Sierra Ventures and 3one4 Capital. The fresh capital brings the startup’s total funding to over $21 million.

“The way an LLM works is you give it an entire prompt, and then it starts thinking,” Kamath said. While that latency is acceptable in a text chat, in a voice conversation, even a short pause feels unnatural. “If you think about how we are talking, I’m not giving you like a large clipping of my audio, and then you start thinking.”

The startup’s model serves as a real-time intelligence layer that enables natural customer conversations on specific topics, with virtually zero response lag. But if the model encounters a subject outside its limited knowledge base, Smallest.ai hands off the query to a large foundational model, briefly placing the customer on hold to “research” the issue — just as a real human would do.

Kamath believes that all AI agents will soon rely on two models: a small voice model for real-time interaction, and an “offline” LLM that is called upon as needed to solve complex problems.

Unlike large foundational models, Smallest.ai focuses strictly on voice-specific nuances, such as handling diverse accents, supporting dozens of languages, and operating in noisy environments.

The startup’s existing customers include companies in the voice space, including RingCentral and Truecaller. Kamath said that any customer support company, including newer ones like Sierra and Decagon, is a potential customer for the startup.  

When asked why a well-funded AI customer support company wouldn’t build its own voice model, Kamath said that for customer support startups, becoming “extremely good at doing voice is a distraction from their core business.”

Smallest.ai competes with voice AI leader ElevenLabs, as well as Cartesia and regional players like Sarvam that focus on local languages.

While some competitors apply voice AI to use cases, like audio dubbing and podcasting, Smallest.ai focuses strictly on real-time conversational voice agents for its enterprise customers.

“We want our models to break the Turing test,” Kamath said. “You should speak to our model and not know it’s AI or human. That’s the sole focus of the company.”

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Hot this week

Newcastle confirm Howe resignation as head coach

Newcastle confirm Howe resignation as head coachImage source, Getty...

Disgraced funeral boss who failed to bury bodies jailed for 20 years

Robert Bush also failed to cremate people and gave bereaved relatives the ashes of strangers.

Newcastle confirm Howe resignation as head coach

Eddie Howe steps down as head coach of Newcastle United after nearly five years in charge.

Budget to be held in October, Healey announces

The new chancellor pledged to move money and power out of Westminster, and into every postcode around Britain.

England and Wales on course for driest July on record

Met Office records indicate England and Wales are likely to have had their driest July since records began 190 years ago.

Topics

Newcastle confirm Howe resignation as head coach

Newcastle confirm Howe resignation as head coachImage source, Getty...

Disgraced funeral boss who failed to bury bodies jailed for 20 years

Robert Bush also failed to cremate people and gave bereaved relatives the ashes of strangers.

Newcastle confirm Howe resignation as head coach

Eddie Howe steps down as head coach of Newcastle United after nearly five years in charge.

Budget to be held in October, Healey announces

The new chancellor pledged to move money and power out of Westminster, and into every postcode around Britain.

England and Wales on course for driest July on record

Met Office records indicate England and Wales are likely to have had their driest July since records began 190 years ago.
spot_img

Related Articles

Popular Categories

spot_imgspot_img