FireRedChat - Little Red Book's open source full-duplex voice interaction system

What is FireRedChat

FireRedChat is an open source full-duplex voice interaction system for Xiaohongshu with real-time bidirectional dialog capabilities and support for controlled interruptions. Adopts modular design , including transcription control module , interaction module and dialogue manager , etc., supports cascade and semi-cascade architecture , can be flexibly deployed. The system is based on LiveKit The RTC Server realizes real-time communication, together with the AI-Agent Bot Server to handle intelligent agent responses, and the WebUI to provide user interaction interface. It is also equipped with Redis Server to support multi-node hosting, and TTS and ASR Server to handle speech synthesis and automatic speech recognition respectively.

FireRedChat Features

• Full-duplex real-time dialogIt supports users and AI agents to speak at the same time, realizing real-time two-way communication and natural and smooth interaction.
• Controlled Interrupt FunctionThe user can interrupt the AI agent's voice output at any time, and the AI can respond quickly to enhance interaction flexibility.
• Privacy and SecuritySupport private deployment, data storage and processing are done locally to ensure that user data is not leaked.
• Low Latency Interaction: Optimized communication architecture and efficient processing modules ensure low latency, close to industrial-grade standards.
• Voice Activity Detection: Streaming personalized speech activity detection technology is used to accurately identify the main speaker and suppress background noise.
• semantic end detection: Judge whether the user's voice is over or not through semantic analysis, avoiding misjudgment and improving the naturalness of interaction.
• modular design: The system consists of several independent modules, supporting flexible customization and expansion to adapt to different needs.
• Multi-scenario applicabilityIt is suitable for finance, medical care, government affairs, education, customer service and other fields to meet diversified application scenarios.
• Open Source Customizable: The code is open source and highly flexible for developers to deploy and customize according to their needs.

Core Benefits of FireRedChat

• full duplex interactionThe AI agent supports users and AI agents to speak at the same time, realizing real-time two-way conversation and more natural and smooth interaction.
• controlled interruptionThe user can interrupt the AI's voice output at any time, and the AI can respond quickly, improving the flexibility of interaction and user experience.
• Privacy: Supports private deployment, data storage and processing are done locally, ensuring user data security and no leakage.
• low latency: Optimized communication architecture and efficient processing modules ensure low-latency interactions that are close to industrial-grade standards and superior to other open-source frameworks.
• Voice Activity Detection: Adopts streaming personalized voice activity detection technology to accurately identify the main speaker, suppress background noise, and improve the success rate of user interruptions.
• semantic end detection: Judge whether the user's voice is finished through semantic analysis, avoiding misjudgment caused by voice pause and improving the naturalness of interaction.

What is the official website of FireRedChat

• Gtihub Warehouse:: https://github.com/FireRedTeam/FireRedChat
• arXiv Technical Paper:: https://arxiv.org/pdf/2509.06502
• Online Experience:: https://fireredteam.github.io/demos/firered_chat

Who is FireRedChat for?

• Businesses and Organizations: The need to build secure, efficient voice interaction systems for customer service, internal communications or business process automation.
• Developers & Technical Team: Desire to develop custom voice interaction applications that utilize open source code for secondary development and customization.
• educational organization: Used in online education platforms to provide real-time voice interactive teaching to enhance teaching effectiveness and student participation.
• Financial industry practitioners: The need to provide secure and efficient voice interaction services in scenarios such as financial counseling and trading assistance.
• healthcare practitioner: Used in scenarios such as remote medical consultation and patient guidance to improve service convenience through voice interaction.
• government branch: Used in scenes such as government hotlines and public services to provide intelligent voice services and improve government efficiency.