Software Development Manager, Core Search

About the role

The Search Engine organization designs, builds, and operates highly performant, fault-tolerant and scalable distributed search engine used by millions of Amazon customers worldwide every day.

We are evolving our search engine to better understand natural language queries and to be more personalized. This involves leveraging LLMs and other Deep Learning models in different parts of the search stack to improve the search experience.

Ideal candidates are expected to have an extensive background in distributed systems and experience with machine learning infrastructure. Strong candidates will have knowledge of LLM fundamentals and some experience in GPU programming.

Key job responsibilities

Technical Leadership

- Lead development of LLM/deep-learning relevance and ranking systems serving billions of queries at scale

- Improve search engine efficiency to reduce infrastructure cost

- Drive architecture and design decisions aligned with the search org vision

- Own full development and operations lifecycle of your team’s products

Team & People Management

- Manage engineering team: staffing, day-to-day execution, delivery commitments, and mentoring and career growth

- Report on development progress, quality, operations, and system performance

Strategy & Collaboration

- Define long-term vision and growth plans in partnership with Science and Engineering leaders

- Set development priorities and evangelize the team's work across the org

- 5+ years of engineering team management experience

- 10+ years of working directly within engineering teams experience

- 8+ years of developing large-scale, multi-tiered distributed software systems using distributed programming experience

- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations

- Experience delivering products against plan in a fast-paced, multi-disciplined, distributed-responsibility and often ambiguous environment

- Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy

- Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers

- Experience in written and verbal communication with the ability to present complex technical information in a clear and concise manner to executives and non-technical leaders

- Deep familiarity with the ML/DL infrastructure space and technologies, and experience owning large-scale, low-latency distributed systems that deploy and run ML models