- Experience building LLM streaming experiences end-to-end
(token/partial-response streaming, tool/function calling orchestration, session state management, safety/guardrail hooks).
- Familiarity with OpenTelemetry and tracing/metrics patterns for streaming
RPCs (correlation IDs, span links, per-message metrics).
- Experience with Kubernetes/Docker and operating services in containerized
environments.
- Messaging/streaming systems (Kafka/RabbitMQ/SQS), caching (Redis), and
patterns for async orchestration alongside streaming.
- Security best practices for RPC systems: mTLS, authn/z, secrets management,
secure-by-default API design, abuse prevention (rate limiting, payload limits).
- Understanding of cost management and spend alerting for AI/LLM workloads.
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility.
These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success.