Senior AI Engineer – Voice & Conversational AI
Backend Developer
Senior
Artificial Intelligence
Conversational Ai
Data Analytics
Data Pipeline
Data Platform
Data Processing
Data Science
Databases
Engineer
Openai Realtime Api
Programming
Programming Language
Programming Languages
Real Time Ai
Speech To Speech
SQL
Streaming Apis
Voice Assistant
Voip Systems
Webrtc
Job Description
Tower Loan of Mississippi, LLC is building customer-facing voice and conversational AI that supports engagement and improves operational efficiency. In this on-site role in Flowood, MS, you will design, develop, and deliver production-grade AI voice experiences that connect real-time speech capabilities with secure business workflows.
As a senior engineer, you will work across large language models, conversation orchestration, and telecom integrations, while helping ensure reliability, safety, and measurable performance in live environments.
What you’ll do
- Design, develop, and maintain real-time AI voice applications using large language models, speech-to-speech capabilities, and conversational AI platforms.
- Build automated conversational workflows for customer service, payment reminders, promise-to-pay interactions, account servicing, and other business needs.
- Configure AI prompts, conversation policies, security controls, escalation procedures, and automated tool-calling capabilities.
- Implement conversation management features such as interruption handling, contextual awareness, fallback logic, and transfers to live representatives.
- Develop and integrate applications using OpenAI Live/Realtime APIs and other real-time AI technologies.
- Manage streaming audio, transcription, session processing, and system integrations to support responsive, dependable AI interactions.
- Integrate AI voice applications with SIP, VoIP, PBX, and enterprise telecommunications infrastructure for inbound and outbound calling.
- Create and maintain applications, APIs, and microservices using C#, .NET, Python, JavaScript/TypeScript, or other appropriate tools.
- Integrate AI applications with company databases, customer systems, payment platforms, messaging systems, and other business applications.
- Build secure AI-enabled functions for account lookup, customer verification, payment-related interactions, scheduling, and transfers to live representatives.
- Implement safeguards so AI interactions align with company policies, security requirements, and applicable legal and regulatory standards.
- Maintain accurate and auditable records of AI conversations, system activity, decisions, and automated transactions.
- Develop and run automated testing, conversation evaluations, and quality assurance processes to improve accuracy, reliability, and performance.
- Monitor system performance, including call outcomes, response times, errors, escalation rates, and other operational metrics.
- Design and maintain scalable, highly available systems with controls for capacity, error handling, and service interruptions.
- Lead technical development from initial concept through production implementation while maintaining security, reliability, and cost efficiency.
- Act as a senior technical resource for conversational AI technologies and provide guidance to other engineers.
- Perform all other duties as assigned.
Requirements
- Strong software engineering skills with experience developing and supporting production applications.
- Advanced knowledge of APIs, microservices, distributed systems, and real-time application architectures.
- Strong understanding of large language models, generative AI, conversational AI, and prompt engineering.
- Advanced troubleshooting, problem-solving, and systems analysis skills.
- Ability to design secure, scalable, and reliable technical solutions.
- Strong organizational and project management skills, with the ability to manage multiple priorities effectively.
- Bachelor’s degree in Computer Science, Software Engineering, Information Technology, Artificial Intelligence, or a related field preferred.
- Equivalent professional experience may be considered.
- Five or more years of professional software development experience preferred.
- Demonstrated experience developing and delivering production software systems required.
- Experience developing AI-powered applications, particularly conversational AI or large language model solutions, strongly preferred.
- Experience with real-time voice technologies and enterprise telephony systems preferred, including SIP, RTP, WebRTC, WebSocket, or similar.
- Experience with OpenAI Live/Realtime APIs and related AI development platforms preferred.
- Proficiency with C#, .NET, Python, JavaScript/TypeScript, or similar languages preferred.
- Experience with technologies such as SQL Server, Redis, Kafka, Docker, Kubernetes, REST APIs, Git, and CI/CD pipelines preferred.
- Familiarity with speech recognition, text-to-speech, RAG, AI evaluation frameworks, and AI safety controls preferred.
- Experience in consumer finance, lending, collections, banking, payment processing, telecommunications, or another regulated industry preferred.
Key technologies
- Large language models, speech-to-speech, conversational AI platforms
- OpenAI Live/Realtime APIs
- C#, .NET, Python, JavaScript/TypeScript
- SIP, VoIP, PBX
- SQL Server, Redis, Kafka, Docker, Kubernetes
- REST APIs, Git, CI/CD pipelines
- Speech recognition, text-to-speech, retrieval-augmented generation (RAG)
- RTP, WebRTC, WebSocket, streaming APIs
- AI evaluation frameworks, AI safety controls
- Microservices, distributed systems, real-time application architectures, automated tool-calling capabilities
Physical requirements
- Stand, walk, and/or sit for eight (8) hours a day.
- Communicate effectively, verbally, written, in person, via telephone, or electronically.
- Lift and maneuver up to 20 lbs.