Site Reliability Engineer - Data Engineering
IMC, Sydney, Australia +1
About the job
Join our dynamic and high-impact Data Engineering team, where you'll be responsible for our large-scale data collection, storage, access and query platforms. The work includes the safe and reliable operation of the platform, as well as projects to evolve and expand the capabilities. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights.
You will join a growing team of four in Sydney which is part of the larger APAC Data Team, and will collaborate with counterparts in Chicago, Mumbai and Amsterdam.
Your Core Responsibilities
- Manage and monitor distributed systems, storage infrastructure, and data processing platforms, including Kafka, HDFS, Dremio, and in-house data pipelines.
- Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions.
- Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries.
- Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions.