AI Inference Infrastructure Software Engineer (Kubernetes / Cloud)

About the role

Location: Seattle, WA (Hybrid - 3 days/week in office)

About ElastixAI:

ElastixAI is an early-stage Software startup on a mission to reinvent AI inference infrastructure from the ground up. We're building a next-generation inference platform that delivers unprecedented efficiency by tightly integrating machine learning, software stack, and custom hardware. Our philosophy is simple: the best performance comes from holistic co-design, where every layer, from model architecture to kernels to silicon, works in harmony.

If you're excited about pushing AI performance to physical limits and shaping the future of large-scale inference, we'd love to meet you.

Role Summary:

We're looking for an Inference Infrastructure Software Engineer to own and evolve the cloud and Kubernetes backbone behind our Token-as-a-Service platform. You'll be the connective tissue between our inference engine and the production environments where customers actually consume tokens — making sure our accelerated workloads run reliably, scale predictably, and deploy seamlessly across managed and self-hosted clusters.

This is a hands-on role with broad surface area. You'll touch everything from cluster bring-up, automating the software releases, and AI Accelerator scheduling to service reliability and cost optimization, working closely with our ML, runtime, and hardware teams to expose the full performance of our co-designed stack to end users.

Key Responsibilities:

- Build, operate, and evolve ElastixAI's Kubernetes infrastructure powering our Token-as-a-Service capability.

- Run accelerated inference workloads in production at scale, with strong SLAs around latency, throughput, and availability.

- Manage and harden our AWS, GCP, and on-prem infrastructure, including networking, storage, IAM, and observability layers tied to our services.

- Develop tooling and automation in Python, Bash, Rust, and Go to streamline deployments, rollouts, autoscaling, and incident response.

- Partner with the ML and runtime teams to productionize new inference capabilities, model deployments, and routing strategies.

- Contribute to capacity planning, cost optimization, and reliability engineering across multi-cloud and self-hosted environments.

- Help define the platform roadmap as we scale from early customers to broad production deployments.

- Be a member of the Elastix On-Call rotation

Required Qualifications:

- Minimum BS in Computer Science, Software Engineering, or a related field.

- 3–5 years of hands-on Kubernetes experience, including EKS, GKE, and/or self-hosted clusters.

- 2–3 years of production experience operating workloads on AWS or GCP.

- Proven track record running ML or inference services at scale on Kubernetes in production.

- Strong experience running accelerated workloads in Kubernetes, scheduling, drivers, device plugins, MIG, networking, and storage considerations.