RealityKit Spatial UI Rendering Engineer

About the role

Shape the future of spatial computing by building the rendering technologies that bring Apple's user interfaces into three dimensions. As part of the RealityKit team, you'll architect and optimize the systems that turn conventional app interfaces into spatial experiences, delivering exceptional visual fidelity, responsiveness, and power efficiency on Apple's next-generation vision products. Operating at the intersection of Core Animation, SwiftUI, and RealityKit, you'll advance the architecture that renders windows, text, and controls as spatial content in real time. You'll also shape RealityView, the API through which developers combine app UI with 3D content. Your work will define the visual quality and performance characteristics of spatial UI, establishing the foundation on which developers and users interact with apps across Apple's vision ecosystem.

DESCRIPTION

Description As a Spatial UI Rendering Engineer on the RealityKit team, you'll own the rendering quality, power, and performance of spatial UI and RealityView. You'll drive the evolution of the rendering pipeline that brings Core Animation content into RealityKit, and develop the GPU techniques necessary to ensure UI elements maintain exceptional clarity and performance under spatial viewing conditions. Your scope includes texture resolution and filtering strategies, foveated and multi-view rendering of UI content, and the shader and render-pass optimizations that preserve the clarity of text and controls while minimizing GPU, memory, and power cost. You'll also own how RealityView renders app UI and 3D content together, from the underlying rendering integration to the developer-facing behavior and APIs. You'll address complex rendering challenges, including maintaining legibility as viewing distance and render resolution change, rendering UI and 3D content together seamlessly, managing large texture workloads efficiently, and sustaining stable frame rates, memory, and power across extended sessions. You'll collaborate closely with the Core Animation, UI frameworks (UIKit, AppKit, and SwiftUI), Metal, and GPU teams to deliver cohesive solutions that meet Apple's standards for performance and user experience.

MINIMUM QUALIFICATIONS

Bachelor's degree in Computer Science, Computer Engineering, or equivalent practical experience 5+ years of professional experience in real-time graphics or rendering engine development Demonstrated ability to independently own and ship significant rendering features end to end Proficiency in C++ and shader programming languages (Metal Shading Language, GLSL, or HLSL) Solid understanding of texture sampling, filtering, and resolution management, and of GPU memory management and frame pacing Familiarity with foveated rendering, multi-view rendering, or other advanced real-time rendering techniques Proven record of diagnosing and resolving GPU performance, power, or memory issues using profiling tools such as Instruments, RenderDoc, PIX, or Perfetto Experience debugging complex rendering issues across multiple layers of the software stack Excellent communication and collaboration skills, with the ability to drive alignment across multiple partner teams