Engineering Manager
Inferact, San Francisco
- Pay
- $200K–$400K / year
- Work type
- Onsite
- Level
- Not stated, manager
- Area
- Software engineering, Inference & ML systems, ML / AI engineering
- Posted
- 24 days ago
About the role
Overview
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build.
About the Role
We're looking for an Engineering Manager to help scale a world-class, senior-heavy engineering organization working at the frontier of AI inference. You will lead a team of exceptional engineers across areas such as inference systems, performance, kernels, accelerators, and cloud infrastructure while creating the management capacity required for Inferact to keep growing quickly without sacrificing technical quality or execution speed.
This is a deeply technical management role. You will own team execution, hiring, coaching, prioritization, and operating rhythm, while staying close enough to the work to earn the trust of engineers solving hard systems problems. You will partner closely with engineering and company leadership to turn company priorities into clear technical direction, remove blockers, improve how the team works, and help every engineer do the highest-leverage work of their career.
Skills and Qualifications
Minimum qualifications:
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Demonstrated experience managing strong software engineers in technically demanding systems, infrastructure, ML systems, distributed systems, or performance-oriented environments.
- Strong technical credibility with the ability to understand architecture, ask useful questions, challenge assumptions, and help unblock senior engineers without becoming a bottleneck or overriding domain experts.
- Experience owning the full people-management lifecycle, including hiring, onboarding, 1:1s, feedback, performance management, career development, team health, and retention.
- Ability to translate ambiguous company priorities into clear team goals, sequencing, ownership, and execution plans while maintaining urgency in a fast-changing startup environment.
- Track record of building effective engineering operating rhythms around planning, decision-making, technical reviews, cross-team coordination, and accountability without creating unnecessary process.
- Strong judgment about when to dive into a technical problem, when to delegate, and how to create leverage for senior engineers rather than competing with them for ownership.
- 2+ years of management experience with 10+ reports.
Preferred qualifications:
- Experience leading teams working on AI / ML infrastructure, model serving, distributed systems, GPU infrastructure, compilers, performance engineering, cloud infrastructure, or developer platforms.
- Experience managing senior, staff, principal, research-adjacent, or PhD engineers in an environment where technical credibility and autonomy are especially important.
Similar roles at other companies
Pay not posted
Posted Aug 6, 2026
Applied Machine Learning Engineer
InferenceSan Francisco
$220K–$320K / yr
Posted Jan 5, 2026
Engineering Lead
InferBengaluru, Karnataka, IN
Pay not posted
Posted May 14, 2026
Member of Technical Staff, Inference
MirendilSan Francisco
$300K–$400K / yr
Posted Jun 24, 2026
Listed on Inferact's Ashby job board; checked 20 h ago. First seen by us 22 h ago. Being listed doesn't mean the team is actively interviewing. We found this board in a public directory and haven't yet confirmed it against the company's own careers page.