Member of Technical Staff, Multimodal Speech
Hark, San Jose +1
The role
The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences.
As part of the Omni team, you will drive the development of advanced speech and audio capabilities within multimodal foundation models. You will work across the full stack—from data and modeling to training, evaluation, and real-time serving—pushing the boundaries of speech intelligence and human-computer interaction.
What you will do
- Drive research and development to advance speech and audio capabilities in multimodal models, including speech recognition, synthesis, and understanding.
- Develop and improve large-scale speech and audio data pipelines, including data collection, filtering, alignment, and synthetic data generation.
- Design and implement state-of-the-art models for speech and audio, including end-to-end multimodal architectures and real-time systems.