StreamFluent Docs
Everything you need to set up real-time AI voice dubbing for your live streams. Stream in your language, reach every audience.
Quick Start
Get your first dubbed stream running in under five minutes using the OBS plugin.
Create your account
Sign up at streamfluent.ai with email or social login (Google, Twitch, Kick). You'll land on your dashboard immediately.
Install the OBS Plugin
Download the plugin for your OS from the OBS Plugin page. Install it into your OBS plugins folder (or run the installer on Windows) and restart OBS.
Log in and configure
Open View β Docks β StreamFluent.ai in OBS. Log in with Google, Twitch, Kick, or email. Select your audio source, choose target languages, and adjust caption and volume settings.
Go live
Click Connect in the StreamFluent dock β the status dot turns green when connected. Add the dubbed audio and caption sources to your scene, then start streaming in OBS as usual.
How It Works
StreamFluent processes your speech in real time β translating and re-voicing it into other languages while you stream.
OBS Plugin
RecommendedThe OBS plugin captures your microphone audio and sends it to StreamFluent's AI pipeline over a WebSocket connection. Your speech is transcribed, translated, and re-voiced β then the dubbed audio is returned as mixer sources directly in OBS.
Your video stream goes directly to your platform (Twitch, YouTube, Kick, etc.) without passing through StreamFluent's servers. Only audio is processed remotely, keeping latency low and stream quality unaffected.
RTMP Relay
AlternativeWith RTMP relay, you point your streaming software at StreamFluent's ingest server instead of your platform. We receive your full stream, process the audio through the AI pipeline, and distribute dubbed versions to your configured destinations.
Video is forwarded without re-encoding. Each translated audio track is remuxed with your original video and pushed to the corresponding destination channel.
AI Dubbing
AI Dubbing is the core of StreamFluent β real-time voice translation that converts your speech into other languages as you stream.
How Dubbing Works
When dubbing is active, StreamFluent runs three stages: speech recognition converts your voice to text, neural translation adapts it to each target language, and voice synthesis generates spoken audio using your selected voice profile.
The entire process runs with under one second of latency. Dubbed audio is delivered alongside your original audio β with the OBS plugin, it appears as separate mixer sources you can control independently.
Dubbing Modes
You can control how dubbing behaves for each target language:
| Mode | Behavior |
|---|---|
| Auto | Dub into the target language when it differs from your source language (default) |
| Original Only | Pass through your original audio with no dubbing β useful for your native-language output |
| Captions Only | No dubbed audio β viewers hear your original voice with translated captions |
Voice Technology
StreamFluent offers three tiers of voice technology depending on your plan.
| Tier | Technology | Plan |
|---|---|---|
| Basic TTS | Default male or female AI voice with natural intonation | All plans |
| Custom Voice | Choose from 28 premium voices with optional per-language overrides | Basic+ |
| Voice Cloning | Clone your own voice β record a 30-second sample and stream in your voice across all languages | Pro+ |
Setting Up Your Voice
- Navigate to Voice in the dashboard sidebar
- Choose your voice type: Basic (male/female toggle), Custom (browse 28 voices), or Replicated (clone your voice)
- For Voice Cloning: record or upload a 30-second sample. Status will change:
Not StartedβProcessingβReady - Preview your voice in any supported language from the Voice page
Voice Settings
| Setting | Range | Description |
|---|---|---|
| Speaking Rate | 0.5x β 2.0x | Speed of the dubbed voice output |
| Pitch Adjustment | -12 to +12 st | Shift pitch up or down in semitones |
| Emotion Preservation | on / off | Maintains emotional tone in dubbed audio Scale |
Supported Languages
StreamFluent supports 32 languages for both speech recognition (source) and translation (target). Every language works in both directions.
All supported languages work as both source (the language you speak) and target (the language you translate into):
Supported Platforms
StreamFluent works with all major streaming platforms:
OBS Plugin
The OBS plugin is the recommended way to use StreamFluent. It captures your audio locally, processes it through our AI pipeline, and returns dubbed audio directly into your OBS mixer.
How It Works
The plugin connects to StreamFluent via WebSocket. Your microphone audio is sent to our servers, processed through the AI pipeline (speech recognition β translation β voice synthesis), and dubbed audio is returned as virtual sources in your OBS mixer.
Your video stream goes directly to your platform β StreamFluent never touches it. Only audio is processed remotely, so your stream quality and stability are completely unaffected.
Installation
- Download the plugin for your OS from the OBS Plugin setup page
- Install the plugin into your OBS plugins folder (macOS/Linux) or run the installer (Windows)
- Restart OBS Studio
Login
Open View β Docks β StreamFluent.ai in OBS. You can authenticate using:
- Google, Twitch, or Kick (OAuth)
- Email and password
- API key from Dashboard β Settings
Configuration
Once logged in, configure your dubbing settings directly in the dock:
- Audio source β select which mic/audio input to capture
- Target languages β choose one or more languages to dub into
- Caption style β toggle captions and customize appearance
- Volume β adjust dubbed audio and original audio levels
OBS Sources
The plugin creates virtual sources for each target language that you add to your OBS scene:
StreamFluent Dub β [Language]Dubbed audio track for the target language
StreamFluent Captions β [Language]Live caption overlay for the target language
Going Live with the Plugin
- Click Connect in the StreamFluent dock β the status dot turns green
- Add dubbed audio and caption sources to your OBS scene
- Start streaming in OBS to your platform as usual
- Monitor transcription in the dock to confirm audio is being processed
Chrome Extension
The StreamFluent Chrome extension lets viewers watch any live stream dubbed into their language in real time.
How It Works
The extension works on Twitch, YouTube, Kick, Rumble, and other streaming sites. It captures the stream audio, sends it through StreamFluent's AI pipeline, and plays back dubbed audio in your chosen language β all in real time with under one second of latency.
Installation
- Visit the Chrome Web Store (link on the StreamFluent homepage)
- Click Add to Chrome and confirm the installation
- The StreamFluent icon appears in your browser toolbar
Setup
- Click the StreamFluent icon in your toolbar on any supported streaming site
- Log in with your StreamFluent account (Google, Twitch, Kick, or email)
- Select the source language (the language the streamer is speaking)
- Select the target language (the language you want to hear)
- Choose a voice for the dubbed audio
- Click Start Dubbing
Features
RTMP Relay
RTMP relay is an alternative connection method available on all plans. Instead of using the OBS plugin, you point your streaming software at StreamFluent's ingest server. We process your audio and distribute dubbed streams to your configured destinations.
How It Works
Your full RTMP stream (audio + video) is sent to StreamFluent's ingest servers. We separate audio and video β video is forwarded without re-encoding, and audio is processed through the AI pipeline. Each translated audio track is remuxed with your original video and pushed to the corresponding destination.
OBS Studio Setup
- Open OBS β Settings β Stream β Service: Custom
- Set Server to rtmp://ingest.streamfluent.ai/live
- Paste your Stream Key from the dashboard
- Click Start Streaming
Server: rtmp://ingest.streamfluent.ai/live
Stream Key: sk_live_xxxxxxxxxxxxxxxxxxxxxxxxStreamlabs Desktop Setup
- Open Streamlabs Desktop β Settings (gear icon) β Stream
- Set Stream Type to Streaming Services
- Choose Service: Custom
- Set Server to rtmp://ingest.streamfluent.ai/live
- Paste your Stream Key from your StreamFluent dashboard
- Click Done, then Go Live
Destinations
With RTMP relay, you configure destinations in your StreamFluent dashboard. A destination is a combination of language + platform + stream key.
- Go to Destinations in your dashboard
- Click Add Destination
- Select a target language for dubbing
- Choose a platform (Twitch, YouTube, Kick, or Rumble)
- Enter your channel name and stream key from that platform
- Enable or disable the destination at any time
Where to Find Stream Keys
Twitch: Dashboard β Settings β Stream β Primary Stream key
YouTube: YouTube Studio β Go Live β Stream settings β Stream key
Kick: Dashboard β Settings β Stream Key
Rumble: Rumble Studio β Stream settings β Stream URL & Key
Final Destination
Final Destination forwards your original, untranslated stream to your main channel. StreamFluent sits between your encoder and your platforms β translated versions go to language destinations, and the original goes to your main channel.
Stream to StreamFluent instead of your platform directly. We process your audio for translation destinations and simultaneously relay the original to your main channel.
- Go to Stream Settings in your dashboard
- Toggle on Final Destination
- Select your main platform (Twitch, YouTube, Kick, Rumble, or Custom RTMP URL)
- Enter the stream key for your main channel
Source Language
The source language tells StreamFluent what language you speak. This drives speech recognition, translation direction, and passthrough detection.
Setting Your Source Language
ConfigurationSet your source language in the OBS plugin dock or in Stream Settings on the dashboard (for RTMP relay). This tells StreamFluent what language your microphone audio is in and drives the entire pipeline:
- Speech-to-text β the recognition engine is configured for your source language
- Translation β text is translated from your source language to each target language
- Passthrough β target languages that match your source language skip dubbing entirely
Example Use Cases
| Scenario | Source Language | Target Languages |
|---|---|---|
| English speaker reaching global audiences | English | Spanish, Japanese, Korean, etc. |
| Japanese speaker streaming to English viewers | Japanese | English, Korean, Chinese |
| Korean streamer with dubbed & original channels | Korean | English, Japanese + Korean (passthrough) |
Audio Settings
Control how original and dubbed audio are mixed in your output.
| Setting | Default | Description |
|---|---|---|
| Original Volume | 20% | Volume of your original voice in dubbed output |
| Dubbed Volume | 100% | Volume of the AI-dubbed voice output |
| Auto-ducking | on | Automatically lowers original audio when dubbed voice is active |
| Noise Reduction | Light | Audio preprocessing before speech recognition. Options: Off, Light, Aggressive. Reduces background noise for cleaner transcription. |
Captions / Subtitles
Add live translated captions to your streams. Captions work independently of dubbing β use them alone, with dubbing, or not at all.
Enable Captions
ConfigurationToggle captions in the OBS plugin dock or in Stream Settings on the dashboard. Captions are unlimited on all plans.
Caption Settings
| Setting | Options | Description |
|---|---|---|
| Position | Bottom Center / Top Center | Where captions appear on the video |
| Font Size | 16px β 48px | Size of caption text (default 38px) |
| Background Color | Any hex color | Caption box background color (default black) |
| Background Opacity | 0.0 β 1.0 | Transparency of the caption background (default 0.7) |
| Font Color | Any hex color | Caption text color (default white) |
| Font | Noto Sans CJK / others | Caption font family |
| Caption Language | Translated / Original | Whether captions display in the translated language or your source language |
Caption Language Mode
The Caption Language setting controls which language the caption text appears in:
| Mode | Behavior | Best For |
|---|---|---|
| Translated | Captions appear in each target language. Spanish output shows Spanish captions, Japanese output shows Japanese captions. | Fully localized streams where viewers see everything in their language |
| Original | Captions stay in your source language. Audio is dubbed but subtitles remain in the original. | Dubbed audio + original-language subtitles for viewers learning a language |
Common Combinations
Dubbed Audio + Translated Captions
Full localization β viewers hear and read in their language.
Dubbed Audio + Original Captions
Dubbed voice with original subtitles β great for anime-style streams or language learners.
Original Audio + Translated Captions
Your real voice with translated subtitles β for audiences who prefer the authentic voice.
Going Live
Once configured, going live with StreamFluent takes just a few clicks.
With the OBS Plugin
- 1Click Connect in the StreamFluent dock β wait for the green status dot
- 2Verify your dubbed audio and caption sources are in your scene
- 3Start streaming in OBS to your platform as usual
- 4Monitor the transcription feed in the dock to confirm audio is being processed
With RTMP Relay
- 1Ensure your OBS stream output points to StreamFluent's RTMP server
- 2Verify your destinations are configured in the dashboard
- 3Click Start Streaming in OBS
- 4Open the Live Monitor in your dashboard to see real-time status
Live Monitor
The Live Monitor in your dashboard gives you a real-time overview of every active language output, live transcription, and the ability to hear your dubbed audio.
Language Cards
Each active language is shown as a card with live metrics. You can enable or disable individual languages mid-stream.
Live Transcription Feed
A real-time transcription panel shows what StreamFluent is hearing and translating. Interim (in-progress) text is shown in lighter text until finalized.
Language Tabs
Switch between translated languages using the tab bar above the transcription feed. Each tab shows your speech translated into that language in real time. An "Original" tab shows your untranslated speech.
Available language tabs match your active target languages.
TTS Audio Playback
Click the TTS button to hear the dubbed audio for the selected language directly in your browser. This lets you monitor what your translated audience is hearing without switching to their stream.
Audio clips play as new transcription chunks arrive. Toggle TTS off at any time to mute playback.
Plans & Usage Limits
StreamFluent uses usage-based pricing. Captions are unlimited on every plan. Each plan includes a monthly allotment of dubbed minutes. Free plans have a hard cap; paid plans allow pay-as-you-go overage.
| Resource | Free | Basic ($9.99/mo) | Starter ($27.99/mo) | Pro ($67.99/mo) | Scale ($249.99/mo) |
|---|---|---|---|---|---|
| Captions included | Unlimited | Unlimited | Unlimited | Unlimited | Unlimited |
| Dubbed audio included | 3 hours | 10 hours | 25 hours | 80 hours | 250 hours |
| Languages | 1 | Up to 2 | Up to 3 | Up to 7 | 15+ |
| Destinations (RTMP) | 1 | 1 | Up to 2 | Unlimited | Unlimited |
| When exceeded | Hard cap | Pay-as-you-go | Pay-as-you-go | Pay-as-you-go | Pay-as-you-go |
| Dubbed overage | β | $7.20/hr | $7.20/hr | $6.00/hr | $4.80/hr |
| Spend limit | β | Configurable | Configurable | Configurable | Configurable |
| Caption Customization | β | β | β | β | β |
| Custom Voice TTS | β | β | β | β | β |
| Multi-destination Output | β | β | β | β | β |
| RTMP Relay | β | β | β | β | β |
| Voice Cloning | β | β | β | β | β |
| Priority Support | β | β | β | β | β |
API Overview
All API routes live under /api/ and require authentication via JWT cookie or Bearer token.
Authentication
Authorization: Bearer your_api_token_hereGet your API token from Dashboard β Settings β API Key. Tokens are scoped to your account and can be regenerated at any time.
Destinations
/api/destinationsList all configured destinations
/api/destinationsCreate a new destination
/api/destinations/:idUpdate a destination
/api/destinations/:idDelete a destination
Voice Profile
/api/voiceGet current voice profile and settings
/api/voiceUpdate voice settings
/api/voice/uploadUpload a voice sample
/api/voiceDelete voice profile
Stream Config
/api/stream/configGet stream configuration
/api/stream/configUpdate stream configuration
/api/stream/config/regenerate-keyGenerate a new stream key
Sessions
/api/sessionsList stream sessions (paginated)
/api/sessions/:idGet a single session with details
Usage
/api/usageGet current month usage (caption minutes, dubbed minutes, overage)