Colonist Voices - AI Speech
This mod has been updated to make the barrier of entry far lower & free. visit this video for the most upt od at info in the description: [url=https://youtu.be/IABqrqrV5Qw]https://youtu.be/IABqrqrV5Qw[/url]
⚠️ WARNING: EXTREMELY VIBE CODED click away if you're not chill with that - also kind of expensive past a demo lmao uses alot of elevenlabs api calls which is only free up to a certain point
🎤 BRING YOUR COLONISTS TO LIFE WITH AI-GENERATED SPEECH!
Your colonists will now speak out loud with full emotional expression! Using OpenAI for intelligent dialogue and ElevenLabs V3 for realistic voice synthesis with emotional audio tags, your colonists will laugh, sigh, whisper, and react to their world like never before.
✨ FEATURES:
- 🗣️ Emotional AI Speech - Colonists use audio tags like [laughs], [sighs], [whispers], [excited], [frustrated]
- 🎭 Context-Aware - Speech reflects mood, health, relationships, and current activities
- 🎵 45+ Free Voices - Age and gender-matched voices (no custom voice limit!)
- ⚙️ Highly Configurable - Control frequency, triggers, and context depth
- 🔊 ElevenLabs V3 - Most expressive voice synthesis with full emotional range
- 🎲 Dynamic Speech - Colonists speak naturally based on their situation
🧠 WHAT THE AI KNOWS ABOUT YOUR COLONISTS:
BASIC INFO:
- Name, age, and gender
- Current activity (cooking, mining, socializing, hauling, etc.)
MOOD & THOUGHTS (Configurable):
- Active mood buffs/debuffs with numerical impact (+10 mood, -15 mood, etc.)
- Only significant thoughts (filters out minor mood changes below ±2)
- Both memory thoughts (ate lavish meal, witnessed death) and situational thoughts (slept in cold, impressive bedroom)
- Up to 5 most impactful thoughts at once
- Examples: "Ate lavish meal (+12 mood)", "Slept in the cold (-4 mood)", "New lover (+40 mood)"
HEALTH CONDITIONS (Configurable):
- Visible injuries and illnesses (gunshot wound, plague, flu, cryptosleep sickness)
- Severity percentages for lethal conditions (e.g., "Plague (73% severity)")
- Disease and infection states
- Only shows medically significant hediffs (filters out minor scratches)
- Up to 5 most significant health issues
- Examples: Speak with exhaustion when tired, panic when severely wounded
RECENT MEMORIES (Configurable):
- Events from the past 24 in-game hours
- Formatted with timestamps (moments ago, 3 hours ago, 1 day ago)
- Combat experiences, social interactions, witnessed deaths, bonding moments
- Configurable limit in settings
- Examples: "Witnessed ally's death (2 hours ago)", "Had deep conversation (6 hours ago)"
RELATIONSHIPS (Configurable):
- Direct relationships (spouse, lover, sibling, parent, child, friend, rival)
- Gender-specific relationship labels
- Up to 5 most important relationships
- Examples: Colonist mentions their spouse when happy, complains about rival when frustrated
ALL CONTEXT CATEGORIES ARE OPTIONAL - Toggle each one in mod settings to control what the AI sees!
⚠️ REQUIREMENTS:
- OpenAI API key (get at [url=https://steamcommunity.com/linkfilter/?u=http%3A%2F%2Fopenai.com%29]openai.com)[/url]
- ElevenLabs API key (get at elevenlabs.io - free tier works!)
- Internet connection
- Harmony mod (auto-installed)
⚡ YOU MUST GO TO MOD SETTINGS AND ENTER YOUR API KEYS FOR THIS TO WORK ⚡
💰 COST INFO:
This mod uses paid APIs. Estimated costs:
- OpenAI (gpt-4o-mini): ~$0.001-0.01 per speech generation
- ElevenLabs FREE tier: 10,000 characters/month (plenty for casual play!)
- Average speech is 50-150 characters
- That's roughly 60-200 speeches per month on free tier
- Paid ElevenLabs tiers available for heavy use
📝 SETUP:
1. Install mod and enable in game
2. Options → Mod Settings → Colonist Voices
3. Enter your OpenAI API key
4. Enter your ElevenLabs API key
5. Choose which context to include (thoughts, health, memories, relationships, activity)
6. Adjust speech frequency and cooldown to your preference
7. Play and enjoy! Your colonists should now start speaking!
🎮 HOW IT WORKS:
Colonists randomly speak based on their current situation. The AI analyzes their context and generates appropriate dialogue with emotional tags. They'll express:
- Joy during celebrations: "[excited] This is the BEST day ever!"
- Stress during raids: "[whispers urgently] They're everywhere... we need to hold the line..."
- Exhaustion when tired: "[exhausted sigh] I can barely keep my eyes open..."
- Pain when injured: "[groans in pain] That... really hurts..."
- Affection near loved ones: "[warmly] It's good to see you, my love."
- Frustration with rivals: "[annoyed] Ugh, I can't stand that person..."
- Fear during danger: "[panicked] No no no, this is bad!"
- Pride after success: "[proudly] I did it! Look at what I made!"
⚙️ CONFIGURATION OPTIONS:
Speech Frequency:
- Base Chance: How often colonists speak (default: 5% per hour)
- Minimum Cooldown: Time between speeches per colonist (default: 2 hours)
- Max Concurrent Requests: Limit simultaneous API calls (default: 3)
Voice Settings:
- Voice Stability: Creative (0.0), Natural (0.5), or Robust (1.0)
- Clarity + Similarity: Fine-tune voice generation
- Style Exaggeration: Control emotional expression intensity
Context Toggles (Choose what AI sees):
- Include Current Activity (what they're doing right now)
- Include Thoughts (mood buffs/debuffs)
- Include Health Conditions (injuries, illnesses)
- Include Recent Memories (events from past day)
- Include Relationships (spouses, lovers, rivals)
- Max Recent Memories: How many past events to include (default: 5)
🔧 TROUBLESHOOTING:
- No speech? Check API keys in mod settings
- "API Error"? Verify your keys are correct and have credits
- Speech too frequent? Increase cooldown or lower base chance
- Speech too rare? Decrease cooldown or increase base chance
- Want less context? Disable unnecessary toggles in settings
- Enable Debug Mode in settings for detailed logs
🎯 PERFORMANCE NOTES:
- Checks for speech every ~4 seconds (250 ticks)
- Only checks spawned, alive, non-downed colonists
- Respects cooldown timers per colonist
- Rate-limited to prevent API spam
- Minimal performance impact when not generating speech
🌟 TIPS FOR BEST RESULTS:
- Start with default settings and adjust from there
- Lower base chance if colonists speak too often
- Disable context categories you don't want AI to see
- Free ElevenLabs tier is enough for most players
- Enable debug mode if you want to see what the AI generates
Version: 1.0
RimWorld Version: 1.5+
For full documentation, troubleshooting, and updates, see the Steam Workshop page.
