Tag: voice AI

Prince Mario-Max Schaumburg-Lippe: Microsoft’s AI Voice Stack Transcribes 60 Languages Live

The Half-Second That Changes Everything About Talking to Machines

Here's the honest truth about voice AI: it's never been the intelligence that was the problem. Ask a voice agent a question and the model usually knows the answer. The problem is the wait. You speak, there's a pause, you start talking again, it talks over you. The whole exchange feels like a bad satellite interview, not a conversation.

Microsoft thinks it just fixed that. On October 1, the company's Microsoft AI division announced three new voice models, and the headline number is less than one second: a voice agent built entirely on Microsoft's first-party stack can now complete a full conversational turn in under a second. That's the threshold, according to TechTimes analysis, where an AI voice stops sounding like a walkie-talkie and starts sounding like a phone call.

What Actually Launched

The three models fill out a complete voice pipeline. MAI-Transcribe-2-Streaming is Microsoft's first streaming speech-to-text model — it listens and transcribes continuously, rather than waiting for a finished sentence. MAI-Voice-2.1 handles text-to-speech in 23 languages across 26 locales, and MAI-Voice-2.1-Flash is a lower-latency variant for situations where speed matters most.

All three are in public preview through Microsoft Foundry (alongside Azure AI Speech), plus MAI Playground and Vercel's AI Gateway.

The transcription specs are the part getting the most attention. MAI-Transcribe-2-Streaming supports 60 languages with automatic, continuous language detection — meaning a conversation can switch languages mid-sentence without anyone restarting a session. Interim transcript hypotheses arrive in roughly 100 milliseconds. And Microsoft says it ranks first for both partial and final transcription accuracy on the Artificial Analysis streaming benchmark: a 2.5% final word-error rate, 2.8% first-partial error rate, and 0.13 seconds to finalization. Those are vendor-reported numbers on a benchmark dated September 28, so independent confirmation is still pending — but even with that caveat, the performance bar is clearly high.

Why 60 Languages of Code-Switching Matters More Than Accuracy

Benchmarks get the headlines, but the more interesting feature is the language detection. Real conversations code-switch. A customer service call in Miami might drift between English and Spanish. A family call between generations in Manila might blend Tagalog and English in a single sentence. Most transcription systems handle this badly: you pick a language, and the model fights you when you stray.

Automatic, continuous detection treats multilingual speech the way people actually speak it. That matters enormously for accessibility tools, live translation, and the meetings business — the market where real-time transcription pays its rent. A transcript that follows the conversation instead of the settings menu is a small technical detail with outsized practical effect.

The voice side has its own interesting capability. MAI-Voice-2.1 can take one speaker identity and switch languages while keeping the same recognizable voice, with native accents and local phrasing. Voices can also be replicated from a few seconds of reference audio — consent-gated, Microsoft says, which is the right call given the obvious misuse potential of instant voice cloning.

Pricing That Signals a Land Grab

The pricing tells its own story. Transcription is offered at an introductory $0.54 per audio hour through the end of 2026. Voice generation costs $22 per million characters. That intro price on transcription isn't charity — it's Microsoft buying market share in a space where developers tend to build on whatever stack works first and stay there for years.

And there's the deeper strategic point the brief's research flagged: Microsoft is building its own speech stack rather than licensing one. That means the voice race is now about vertical integration, not just model quality. When the same company owns the models, the cloud, the benchmarks, and the developer platform, the moat isn't any single model — it's the whole pipeline working together.

Where This Goes Next

The obvious near-term winners are call centers, accessibility tools, and live translation services — anything where a half-second of latency is the difference between a product that works and one that frustrates. Longer term, the sub-second turn opens the door to voice agents that can genuinely hold a phone call: appointment booking, customer triage, language tutoring.

There's a broader infrastructure story underneath this, too. Real-time voice agents need serious compute behind them — the kind of capacity hyperscalers are racing to build, like the recent 400MW AI data center project in Japan and new efforts to squeeze more compute from the same power. Voice is latency-sensitive in a way batch transcription never was, and it will push demand for inference capacity closer to users.

Will Microsoft's #1 benchmark claim hold up under independent scrutiny? That's the question worth watching. But even discounting the marketing, the direction is clear: the age of the patient, slow voice bot is ending. The next generation answers before you've finished blinking. The question isn't whether voice agents will feel natural anymore — it's whether we're ready for machines that interrupt us in 60 languages.

The Takeaway

Voice was AI's weakest interface because latency, not intelligence, made it feel dumb. Microsoft's new stack attacks exactly that weakness — and the 60-language auto-detection might matter more than any benchmark. When the technology fades into the background, the conversation can finally begin.

Prince Mario-Max Schaumburg-Lippe: ElevenLabs Hits $22B Valuation, Launches Voice Model v4

Everyone spent the last two years arguing about which chatbot would win. Meanwhile, ElevenLabs went and proved the interface that actually matters is the one people have been using since Alexander Graham Bell: the phone call.

On September 30, the London-based AI voice company completed a $300 million employee tender offer that values it at $22 billion, twice the $11 billion valuation it carried after its $500 million Series D in February. That’s a doubling in seven months. The tender was co-led by Wellington and T. Rowe Price, with participation from existing backers Andreessen Horowitz and Lightspeed and new investors including EQT and Goldman Sachs.

And the same week, the company launched Eleven v4 and v4 Turbo, new text-to-speech models that natively speak, listen, and translate across more than 90 languages used by over 5.5 billion people, at sub-100-millisecond latency. Valuation doubling plus a flagship model launch in one week: that’s a company announcing it intends to own the category.

The number that explains the valuation

Forget the $22 billion for a second. The number that does the explaining is 15 million.

ElevenLabs says its voice agents now handle more than 15 million conversations every week, three times the level in February. And these aren’t demos. The agents are doing real enterprise work: processing refunds, renewing insurance policies, booking appointments. The client list includes Stripe, Deutsche Telekom, DoorDash’s SevenRooms, the insurer Admiral, and the sovereign governments of Ukraine and Greece.

That’s the tell. Chatbots got the headlines, but voice agents got the jobs. There’s a reason: for all the talk about conversational AI, the overwhelming majority of customer interactions at real businesses still happen by voice. The call center is the largest interface in commerce, and it runs on humans having the same conversations thousands of times a day. AI that can hold those conversations naturally, in 90-plus languages, with human-sounding expression, doesn’t need a market to be invented. The market is a phone line.

“We’re already seeing rapid adoption of expressive voice agents by enterprises and governments, who are deploying them in service of consumers and citizens,” said co-founder and CEO Mati Staniszewski. Founded in 2022 by Staniszewski and CTO Piotr Dabkowski, the company has gone from text-to-speech startup to one of Europe’s most valuable startups in four years. The velocity is the story.

Why voice is winning the agent race

There’s a thesis hiding in this valuation, and it’s worth spelling out: chat was the training wheels; voice is the vehicle.

Text chatbots had to teach users a new behavior. Voice agents meet users where they already are. Nobody needs onboarding to have a phone conversation. The elderly customer renewing an insurance policy, the traveler rebooking a flight, the citizen calling a government service line: they all already know how to talk. The AI just has to be good enough at listening and responding that the caller doesn’t notice the difference.

That last part is where the v4 models matter. Sub-100-millisecond latency is the threshold where conversation stops feeling like a walkie-talkie exchange and starts feeling like a person. Expressive speech, the pauses, the emphasis, the warmth, is what makes callers stay on the line instead of mashing zero for a human. ElevenLabs built its name on voice quality back when it was just a text-to-speech tool; now that quality is the moat around the agent business.

The multi-language angle is underrated too. Ninety languages spoken by 5.5 billion people means a single deployment can serve a global customer base without the traditional call-center model of staffing language queues. For governments and multinationals, that’s transformative. Ukraine and Greece using AI voice agents for citizen services is the kind of deployment that would have sounded like science fiction five years ago.

The tender offer tells its own story

One detail worth pausing on: this wasn’t a fundraise. A tender offer lets employees and existing shareholders sell stock to investors, providing liquidity without necessarily raising new capital for the company. The company didn’t need the money. Its people got paid.

That’s a retention weapon in the AI talent war. At $22 billion, with Goldman Sachs and T. Rowe Price buying in, ElevenLabs employees just got a very tangible reason to stay. In a market where top voice-AI researchers can name their price, keeping the team that built the thing is as important as any model release. The v4 launch the same week makes the message complete: we’re winning, we’re shipping, and we’re taking care of our people.

It’s also a signal about where smart money thinks the agent economy is going. The biggest AI investments of 2026 have flowed to agent developers as businesses race to automate customer service and back-office work. Voice is where that automation meets the customer directly. A $22 billion bet says the phone call is not a legacy channel to be replaced. It’s the channel to be upgraded.

What this means for the rest of us

A few practical readouts.

Expect to talk to AI more, and notice it less. Fifteen million conversations a week is still a rounding error against global call volume, but the growth rate is the thing. At 3x in seven months, the crossover point where a meaningful share of routine calls are AI-handled is closer than most people think. The good news: done well, it means no more hold music for a refund.

Voice quality is now a competitive dimension. If you’re building anything customer-facing with AI, the voice matters as much as the brain. The companies winning in this space compete on latency and expressiveness, not just accuracy. Users forgive a slightly wrong answer delivered warmly faster than a correct one delivered like a robot.

The “AI takes jobs” framing misses the point here. The calls being automated are the ones nobody wanted to staff: repetitive, high-volume, emotionally draining. The humans move up to the exceptions, the edge cases, the moments that actually need judgment. That’s been the pattern with every automation wave, and voice AI looks like it’s following the script.

Watch the government angle. Sovereign deployments in Ukraine and Greece are the leading edge of AI in public services. Multilingual, always-available, consistent: it’s a strong pitch for citizen services. Expect more governments to follow, and expect the procurement debates to be lively.

The bigger picture

The chatbot era taught the industry that people will talk to AI. The voice era is teaching it something more valuable: people will talk to AI the way they talk to people, about the boring stuff that keeps businesses running. Refunds. Renewals. Appointments. Fifteen million times a week.

ElevenLabs doubled its valuation in seven months because it found the biggest, most familiar interface in the world and made AI fluent in it. The phone call survived the internet, the smartphone, and the chatbot. Now it’s getting an upgrade.

If all this talk of conversation has you craving the real, unscripted kind, here’s what’s on around New York this week, from jazz nights to night markets. And if you’re the type who does their best thinking over something spicy, the city’s hottest chicken spots are ready when you are.

Prince Mario-Max Schaumburg-Lippe: Instinct Raises $1B to Build Your Personal AI Agent

The AI agent race just got its biggest vote of confidence yet. Instinct, a San Francisco startup building a personal AI agent that carries out everyday tasks autonomously, announced on September 28 that it has raised $1 billion in a Series C funding round at a $10 billion valuation, one of the largest AI funding rounds of 2026, and a signal that investors believe the era of truly autonomous AI assistants has arrived.

The round drew investments from Sequoia Capital, Benchmark, and Coatue. No single lead investor was named. It arrives roughly one month after Instinct disclosed a $250 million Series B at a $2.5 billion valuation: four times the valuation in about a month.

What it actually does

Strip away the funding hype and the product concept is simple: a personal AI agent that does things for you, not just with you.

Today’s AI assistants are conversationalists. They answer questions, draft emails, summarize documents. Useful, but fundamentally reactive. Instinct’s ambition is an agent that acts in the world on your behalf:

  • Planning trips. Not “here are some flight options” but a cross-country road trip handled start to finish: bookings, logistics, the details.
  • Making phone calls. The agent phones businesses and services on your behalf, navigating hold music, phone trees, and scheduling, then reports back when the task is done.
  • Handling the chores of modern life. Ordering the weekly groceries, canceling forgotten subscriptions, booking a handyman, arranging a ride to the airport.

The product remains in early access: users text or call it, and Instinct uses its own phone and computer, connecting to email, messaging, screen, audio, and location, to complete the whole task from start to finish, without users learning a new interface. Recent updates include Instinct Concierge, a white-glove service for high-touch cases, and a Trusted Person Network that lets Instinct assistants coordinate plans with one another on users’ behalf.

This is the “agentic AI” vision the industry has promised for years, and it’s fiendishly hard to execute. Booking a trip means navigating websites that actively resist automation. Calling a business means real-time voice interaction, understanding nuance, and knowing when to escalate to the human. Every task is a gauntlet of edge cases, and three top-tier firms backing it at $10 billion, a month after a $2.5 billion round, suggests the product is further along than the public realizes.

Why the founder matters this much

Instinct was founded by Noah Shinn, and his background explains a lot about the bet. Shinn came to Instinct after working as a research scientist at Sierra and conducting machine-learning research at Northeastern and MIT, where as a student he co-developed Reflexion, a framework where a language model checks its own output and uses feedback to improve, reported to have reached 91% accuracy on the HumanEval coding benchmark.

That research hints at his approach: getting an AI system to do a task is one problem; getting it to notice and recover from its own mistakes is another. For a personal agent, the second is the whole game.

The $10 billion thesis

Ten billion dollars is a staggering valuation for an early-access product. Here’s the thesis the investors are buying.

First: agents are the next platform shift. Just as mobile apps created trillion-dollar ecosystems on top of the smartphone, AI agents could create enormous value on top of foundation models. The company that owns the trusted agent relationship with consumers owns the interface to everything: commerce, travel, services. That’s a platform position worth paying up for.

Second: the voice interface is the unlock. Instinct’s ability to make phone calls is more than a feature. It’s a strategic moat. Huge swaths of the economy still run on phone calls: restaurants, contractors, doctors’ offices, customer service lines. An agent that can navigate the phone-based economy can do things no chatbot ever will. Voice AI has crossed a quality threshold in the last two years that makes this newly viable.

Third: trust compounds. Personal agents handle sensitive tasks: your money, your travel, your identity. Users will consolidate around agents they trust, creating powerful winner-take-most dynamics. Getting in early, with the right backers, is the whole game.

Not alone in the arena

Instinct isn’t the only one chasing the agent dream, which makes the valuation even more interesting. OpenAI has been building agent capabilities into ChatGPT, with operator-like features for web tasks. Google is weaving agents through Gemini and its ecosystem, with deep Android integration as a distribution advantage. Anthropic focuses on enterprise agents via its API and computer-use capabilities. Anthropic’s new workhorse model is the latest evidence. And Meta just landed the same week: Meta’s enterprise platform push bundles its own Muse personal agent into a corporate offering.

Instinct’s differentiation appears to be focus: not enterprise workflows, not developer tools, but the consumer’s personal agent. It’s the most ambitious version of the vision and the hardest to execute, because consumers are unforgiving. An agent that books the wrong flight loses the user’s trust permanently.

Where this could break

The risks are concrete:

  • Reliability at scale. Agent demos are magical; agent products are brutal. The gap between “works in the demo” and “works for millions of users on adversarial websites and phone systems” is where agent startups go to die.
  • Unit economics. Agentic tasks burn serious compute: long reasoning chains, voice generation, computer use. If each booked trip costs dollars in inference, the business model needs high-value tasks or subscription pricing users actually accept.
  • Trust incidents. A single high-profile failure, like a wrong booking, a mishandled call, or a privacy breach, could destroy the trust the entire business depends on.
  • Platform risk. Apple and Google control the mobile platforms where a personal agent must live. If they build equivalent capabilities into the OS, Instinct competes with the landlord.

Sequoia, Benchmark, and Coatue have presumably weighed these risks at length. A billion dollars says they like the answers.

What it means, depending on who you are

A consumer? The personal AI agent you’ve been promised for a decade may finally be arriving. Watch early reviews of its reliability on real tasks, not demos.

Building AI products? The $10 billion valuation resets comparables for the whole agent space and raises the bar. Focus on reliability and trust, not demo magic. That’s what the smart money is paying for.

An investor? In travel, hospitality, or services? An agent that books travel and calls businesses is either your best new distribution channel or your worst disintermediation nightmare. Possibly both. Start thinking now about how your booking flows and phone systems work when the “customer” is an AI.

The Bottom Line

A billion dollars at a ten-billion-dollar valuation, backed by three of the best firms in venture capital, for a personal AI agent that books your trips and makes your phone calls. That’s not a bet on a feature. It’s a bet that autonomous agents are the next great consumer platform, and that Noah Shinn’s team can build the one we trust with our lives. The agent era has been “coming soon” for years. With this round, “soon” just got a lot more credible.