LLM & Agentic AI Performance Engineer

About the role

Job Details:

Job Description:

The Role and Impact:

Join Intel's Data Center AI organization and help shape how LLM and Agentic AI workloads perform on Intel platforms.

Our team operates at a unique intersection of core performance optimization, AI frameworks, and customer-facing AI solutions. We bridge the gap between teams that deeply understand silicon and benchmarking and teams building real-world AI solutions, turning performance insights into software optimizations that developers and customers can use.

In this role, you will own end-to-end performance characterization and optimization of LLM and Agentic AI workloads, from Python-level frameworks and inference runtimes down to Linux, system architecture, and hardware performance counters.

This is not simply a benchmarking role. Benchmarking tells us what the number is. Your job is to understand why the number is what it is, identify the hardware or software bottleneck, and determine what needs to change to remove it.

Your work will translate into code contributions, framework optimizations, best-known configurations (BKCs), customer-ready solutions, and insights that help influence future Intel hardware and software.

If you enjoy working across the complete AI stack, from agent frameworks and LLM serving engines to NUMA, memory bandwidth, cache behavior, and silicon counters, this role provides an opportunity to work at that intersection.

About the Team:

The AI Solutions and Toolkit Engineering team is part of Intel's Data Center organization, focused on enabling modern AI workloads and solutions on Intel platforms.

We work across the AI ecosystem, collaborating with AI framework and runtime developers, performance and optimization teams, hardware architects, open-source communities, and solution engineering teams.

Our goal is to take deep platform capabilities and performance insights and translate them into practical, optimized AI solutions that developers and customers can deploy.

The team works across areas including LLM inference, Agentic AI, AI frameworks and runtimes, workload optimization, open-source software, and datacenter AI systems.

Key Responsibilities:

· Characterize and optimize LLM and Agentic AI workloads across the complete software and hardware stack.

· Identify performance bottlenecks across AI frameworks, inference runtimes, operating systems, memory, compute, and platform architecture.

· Design and develop hardware-aware and hardware-agnostic optimizations for AI frameworks and runtimes.

· Optimize LLM inference techniques including KV-cache management, attention, continuous batching, and quantization.

· Work hands-on with serving stacks such as vLLM, SGLang, TGI, or equivalent technologies.

· Analyze host and accelerator performance using tools such as VTune, EMON/PMU, perf, top-down analysis, and roofline modeling.