Software Engineer (AI/ML)
Mia Labs, Inc., Austin Office
The role
We're hiring a Software Engineer (AI/ML) to work on our voice AI platform, the real-time pipeline of speech-to-text, LLM reasoning, and text-to-speech that powers every call. You'll work on latency, model quality, cost, and reliability across the full AI stack, and help shape which models and vendors we bet on. This is a deep, focused role on a small core product team, with direct mentorship from our AI lead.
What you will do
- Build and improve the real-time voice AI pipeline: speech-to-text, conversational LLM orchestration, and text-to-speech, with hard latency targets (we hold P90 end-to-end latency under 2 seconds and are pushing lower).
- Improve model performance in production, run evals for core functionality
- Improve instrumentation (OTel/Braintrust), build dashboards and alerting
- Optimize cost: squeezing more throughput out of open source LLMs
- Work with vendors like Anthropic, Microsoft/Azure OpenAI, Deepgram, and NVIDIA — testing new voice and language models, evaluating alternatives, and handling failover when a provider has issues.