Senior Software Engineer, AI Infrastructure - Developer Tooling
ByteDance, San Jose, California
About the job
About the Team
We're building the AI-powered backbone of our developer tools. You'll work on three core systems: a retrieval infrastructure powering our AI products, a coding agent that assists users in writing code, and the evaluation frameworks that measure their effectiveness.
Responsibilities
Retrieval Systems (RAG Infrastructure)
- Design and scale retrieval pipelines including vector search, BM25, and hybrid retrieval strategies
- Build and optimize embedding pipelines, chunking strategies, and re-ranking systems
- Develop query understanding and rewriting components to improve retrieval relevance
- Manage vector database infrastructure at production scale
Coding Agent Development
- Build agent architectures that support multi-step code generation, refactoring, debugging, and diagnostics
- Implement tool-use patterns (function calling, code execution sandboxing, file system interaction)
- Develop context management strategies for long-form code understanding
Evaluation & Benchmarking