Voice AI: infrastructure, platforms, and vertical applications
September 13 at 20:37 · $0.138 total
Voice AI Market Map
(1) Thesis
Voice AI is restructuring from a stack of discrete components (ASR → NLU → TTS) into vertically integrated, real-time conversational systems, collapsing infrastructure margins while value migrates to vertical applications that own workflows, data, and compliance moats.
---
(2) Segments
A. Core Model & Speech Infrastructure
Speech-to-text, text-to-speech, and speech-native foundation models
- ElevenLabs – TTS/voice cloning leader, now expanding into full conversational agents
- Deepgram – developer-focused ASR/STT APIs, low-latency streaming
- AssemblyAI – ASR plus speech understanding (summarization, sentiment)
- Cartesia – ultra-low-latency TTS built on state-space models
- OpenAI / Google – realtime speech-to-speech models (GPT-4o Realtime, Gemini Live) commoditizing the layer below
Dynamics: Rapid price compression as hyperscalers bundle speech into multimodal LLMs; independents survive on latency, voice quality, and developer experience — but each is racing up-stack.
B. Voice Agent Orchestration Platforms
Middleware for building, deploying, and monitoring voice agents
- Vapi – developer API for assembling voice agents from any model stack
- Retell AI – voice agent platform for phone-based automation
- LiveKit – open-source real-time infrastructure (WebRTC), powers ChatGPT voice mode
- Bland AI – enterprise phone agents at scale
- Sindarin (less certain on current traction) – conversational speech layer
Dynamics: The hottest, most crowded layer; thin differentiation and squeeze risk from both model providers above and vertical apps below. Winners will look like Twilio (distribution + reliability), losers like thin wrappers.
C. Vertical Applications — Healthcare
- Abridge – ambient clinical documentation, deep Epic integration
- Suki – voice assistant for physicians
- Nabla – ambient AI copilot for clinicians
- Hippocratic AI – patient-facing voice agents for care coordination
- Assort Health (earlier stage) – medical call center automation
Dynamics: Highest willingness-to-pay in voice AI; wins driven by EHR integration depth and clinical validation, not model quality. Abridge's Epic partnership shows distribution is the moat.
D. Vertical Applications — Customer Operations & Sales
- PolyAI – enterprise contact center voice assistants
- Sierra (Bret Taylor) – agentic customer experience, voice + chat
- Parloa – enterprise contact center automation (strong in Europe)
- Observe.AI – contact center intelligence and agent copilots
- Decagon (voice is newer for them) – AI customer support agents
Dynamics: Massive TAM (multi-hundred-billion BPO/contact-center spend) shifting from seat-based to outcome-based pricing; incumbents (NICE, Genesys, Five9) are acquiring or bundling aggressively.
E. Telephony & Real-Time Delivery Rails
- Twilio – programmable voice, now with AI-native offerings
- Telnyx – telephony infrastructure with AI voice APIs
- Daily – real-time video/audio infra; created the Pipecat open-source framework
- Agora – real-time engagement infrastructure
Dynamics: Stable, lower-margin utility layer enjoying a volume boom as every AI agent needs a phone number and low-latency transport; commodity risk offset by reliability requirements.
---
(3) Where Value Accrues: Vertical Applications (C & D)
Vertical apps win the most value because:
- Pricing power: they price against labor replacement ($30–60/hr fully-loaded agents), not API tokens — 10–100x the margin capture of infra
- Moats compound: workflow integration (EHRs, CRMs), compliance (HIPAA, PCI), and proprietary interaction data create switching costs infrastructure can't build
- Infrastructure is deflating: model costs fall ~10x/year; the orchestration layer is being squeezed from both sides. Value flows to whoever owns the customer relationship and the outcome.
Healthcare specifically leads on ACVs today; customer ops leads on total value in 3–5 years due to sheer market size.
---
(4) White-Space Opportunities
1. Voice agent trust & assurance layer. No dominant player provides real-time hallucination detection, compliance monitoring, regression testing, and audit trails specifically for production voice agents — an "observability + certification" layer that enterprises will require before deploying agents in regulated calls. (Coval and Hamming AI are early attempts in eval, but nobody owns runtime assurance + compliance certification end to end.)
2. Voice-native interfaces for deskless/industrial workers. Field service, logistics, manufacturing, and construction workers (~80% of the global workforce) can't type on the job. Nobody has built the hands-free, noise-robust, workflow-integrated voice layer for frontline work — the "Siri for the shop floor" that connects to CMMS/WMS/ERP systems. Current players are all screen-first or consumer-first; the hardware+software+vertical-integration combination remains unowned.
---
Confidence notes: Company positioning is accurate as of my knowledge cutoff; funding stages and exact product scope for earlier-stage names (Sindarin, Assort Health) should be re-verified. The orchestration segment is evolving fast — competitive positions there may have shifted materially.
Thesis
Voice AI is being restructured from a stack of separate ASR, NLU, TTS, and telephony components into a real-time, LLM-native agent stack where the model, orchestration, and vertical workflow are collapsing into one system—shifting value from raw speech models to workflow-owning applications.
Market Map
1. Voice AI Infrastructure & Models
Companies: OpenAI (Whisper, GPT-4o Realtime), Google (Gemini, Chirp), ElevenLabs, Deepgram, AssemblyAI, Cartesia Dynamics: ASR/TTS are commoditizing fast; differentiation now comes from real-time latency, emotional expressiveness, language coverage, and on-device/offline capability.
2. Voice Agent Orchestration & Telephony Platforms
Companies: Vapi, Retell AI, LiveKit, Twilio, Daily, Sierra AI Dynamics: This layer abstracts telephony, streaming, interruption handling, and LLM orchestration; it is the near-term developer control point but is becoming crowded.
3. Healthcare Ambient Voice
Companies: Abridge, Suki, Microsoft Nuance DAX, Nabla, Ambience Healthcare, Corti Dynamics: Adoption is driven by EHR integration, clinician burnout, and reimbursement; moats are specialty depth, compliance, and workflow integration.
4. Contact Center & Customer Experience
Companies: Intercom, Talkdesk, Cresta, Observe.AI, Uniphore, ASAPP Dynamics: Large budgets and clear ROI are shifting spend from agent-assist to autonomous voice agents; value is measured in cost per resolved contact and CSAT.
5. Physical Operations / Vertical Voice
Companies: SoundHound AI, Presto (less sure about current financial health/scale), Hi Auto (less sure about current scale), ConverseNow, Cerence Dynamics: Labor shortages drive adoption in restaurants, drive-thrus, and automotive; requires noise robustness, low latency, and deep POS/ordering integration, but deployments remain fragmented.
Where the Most Value Accrues
Vertical applications—especially healthcare ambient documentation and contact center automation—win the most long-term value. They own the workflow, compliance, and distribution, allowing them to price per outcome rather than per token or API call. Infrastructure and orchestration layers are critical but face commoditization from hyperscalers and open-source alternatives.
White-Space Opportunities
- Regulated, evidence-grade voice AI for legal and governance workflows Real-time voice agents for legal depositions, board meetings, tumor boards, or regulatory inspections that combine speaker diarization, evidence-grade audit trails, and compliance. Current players focus on clinical notes or contact centers, but no one owns the legal/regulatory meeting workflow end-to-end.
- Offline/noisy industrial voice AI for field operations Voice AI for construction, utilities, manufacturing, and logistics that works on-device, is noise-robust, and integrates with ERP/field service management. Existing voice AI is optimized for clean environments like call centers, clinics, and cars; no clear category leader covers industrial field workflows.