Supported Services

AI services integrated with Pipecat and their setup requirements

Transports

Transports exchange audio and video streams between the user and bot.

Service	Setup
DailyTransport	pip install "pipecat-ai[daily]"
FastAPIWebSocketTransport	pip install "pipecat-ai[websocket]"
HeyGenTransport	pip install "pipecat-ai[heygen]"
LemonSliceTransport	pip install "pipecat-ai[lemonslice]"
LiveKitTransport	pip install "pipecat-ai[livekit]"
SmallWebRTCTransport	pip install "pipecat-ai[webrtc]"
TavusTransport	pip install "pipecat-ai[tavus]"
WebSocket Transports	pip install "pipecat-ai[websocket]"
WhatsAppTransport	pip install "pipecat-ai[webrtc]"

Serializers

Serializers convert between frames and media streams, enabling real-time communication over a websocket.

Service	Setup
Exotel	No dependencies required
Genesys	No dependencies required
Plivo	No dependencies required
Telnyx	No dependencies required
Twilio	No dependencies required
Vonage	No dependencies required

Speech-to-Text

Speech-to-Text services receive and audio input and output transcriptions.

Service	Setup
AssemblyAI	pip install "pipecat-ai[assemblyai]"
AWS Transcribe	pip install "pipecat-ai[aws]"
Azure	pip install "pipecat-ai[azure]"
Cartesia	pip install "pipecat-ai[cartesia]"
Deepgram	pip install "pipecat-ai[deepgram]"
ElevenLabs	pip install "pipecat-ai[elevenlabs]"
Fal Wizper	pip install "pipecat-ai[fal]"
Gladia	pip install "pipecat-ai[gladia]"
Google	pip install "pipecat-ai[google]"
Gradium	pip install "pipecat-ai[gradium]"
Groq (Whisper)	pip install "pipecat-ai[groq]"
NVIDIA	pip install "pipecat-ai[nvidia]"
OpenAI	pip install "pipecat-ai[openai]"
Sarvam	pip install "pipecat-ai[sarvam]"
Soniox	pip install "pipecat-ai[soniox]"
Speechmatics	pip install "pipecat-ai[speechmatics]"
Whisper	pip install "pipecat-ai[whisper]"

Large Language Models

LLMs receive text or audio based input and output a streaming text response.

Service	Setup
Anthropic	pip install "pipecat-ai[anthropic]"
AWS Bedrock	pip install "pipecat-ai[aws]"
Azure	pip install "pipecat-ai[azure]"
Cerebras	pip install "pipecat-ai[cerebras]"
DeepSeek	pip install "pipecat-ai[deepseek]"
Fireworks AI	pip install "pipecat-ai[fireworks]"
Google Gemini	pip install "pipecat-ai[google]"
Google Vertex AI	pip install "pipecat-ai[google]"
Grok	pip install "pipecat-ai[grok]"
Groq	pip install "pipecat-ai[groq]"
Mistral	pip install "pipecat-ai[mistral]"
NVIDIA	pip install "pipecat-ai[nvidia]"
Novita AI	pip install "pipecat-ai[novita]"
Ollama	pip install "pipecat-ai[ollama]"
OpenAI	pip install "pipecat-ai[openai]"
OpenAI Responses	pip install "pipecat-ai[openai]"
OpenPipe	pip install "pipecat-ai[openpipe]"
OpenRouter	pip install "pipecat-ai[openrouter]"
Perplexity	pip install "pipecat-ai[perplexity]"
Qwen	pip install "pipecat-ai[qwen]"
SambaNova	pip install "pipecat-ai[sambanova]"
Sarvam	pip install "pipecat-ai[sarvam]"
Together AI	pip install "pipecat-ai[together]"

Text-to-Speech

Text-to-Speech services receive text input and output audio streams or chunks.

Service	Setup
Async	pip install "pipecat-ai[asyncai]"
AWS Polly	pip install "pipecat-ai[aws]"
Azure	pip install "pipecat-ai[azure]"
Camb AI	pip install "pipecat-ai[camb]"
Cartesia	pip install "pipecat-ai[cartesia]"
Deepgram	pip install "pipecat-ai[deepgram]"
ElevenLabs	pip install "pipecat-ai[elevenlabs]"
Fish	pip install "pipecat-ai[fish]"
Google	pip install "pipecat-ai[google]"
Gradium	pip install "pipecat-ai[gradium]"
Groq	pip install "pipecat-ai[groq]"
Hume	pip install "pipecat-ai[hume]"
Inworld	No dependencies required
Kokoro	pip install "pipecat-ai[kokoro]"
LMNT	pip install "pipecat-ai[lmnt]"
MiniMax	No dependencies required
Neuphonic	pip install "pipecat-ai[neuphonic]"
NVIDIA	pip install "pipecat-ai[nvidia]"
OpenAI	pip install "pipecat-ai[openai]"
Piper	No dependencies required
ResembleAI	pip install "pipecat-ai[resembleai]"
Rime	pip install "pipecat-ai[rime]"
Sarvam	No dependencies required
Smallest AI	pip install "pipecat-ai[smallest]"
Speechmatics	pip install "pipecat-ai[speechmatics]"
xAI	pip install "pipecat-ai[xai]"
XTTS	pip install "pipecat-ai[xtts]"

Speech-to-Speech

Speech-to-Speech services are multi-modal LLM services that take in audio, video, or text and output audio or text.

Service	Setup
AWS Nova Sonic	pip install "pipecat-ai[aws-nova-sonic]"
Gemini Live	pip install "pipecat-ai[google]"
Gemini Live Vertex AI	pip install "pipecat-ai[google]"
Grok Voice Agent	pip install "pipecat-ai[grok]"
OpenAI Realtime	pip install "pipecat-ai[openai]"
Ultravox	pip install "pipecat-ai[ultravox]"

Image Generation

Image generation services receive text inputs and output images.

Service	Setup
Azure	pip install "pipecat-ai[azure]"
fal	pip install "pipecat-ai[fal]"
Google	pip install "pipecat-ai[google]"
OpenAI	pip install "pipecat-ai[openai]"

Video

Video services enable you to build an avatar where audio and video are synchronized.

Service	Setup
HeyGen	pip install "pipecat-ai[heygen]"
Simli	pip install "pipecat-ai[simli]"
Tavus	pip install "pipecat-ai[tavus]"

Memory

Memory services can be used to store and retrieve conversations.

Service	Setup
mem0	pip install "pipecat-ai[mem0]"

Vision

Vision services receive a streaming video input and output text describing the video input.

Service	Setup
Moondream	pip install "pipecat-ai[moondream]"

Analytics & Monitoring

Analytics services help you better understand how your service operates.

Service	Setup
Sentry	pip install "pipecat-ai[sentry]"