Developing an emotionally intelligent conversational AI assistant inspired by the movie 'Her', with dual processing options: fully local execution for maximum privacy or integration with ChatGPT Realtime API for enhanced performance and lower latency. Features natural emotion detection and expression in conversations.
Established project architecture with dual processing paths (local and API-based)
Implemented local speech-to-text using Whisper with emotion detection capabilities
Integrated OpenAI Realtime API for enhanced conversation fluidity and response quality
Developed emotional text-to-speech synthesis with voice modulation based on context
Currently optimizing latency and implementing memory for personalized emotional responses
Implemented memory system that adapts conversation style based on emotional history
A.M.A - Ask Me Anything