The Data Platform Operations Engineer ensures the reliability and performance of the Performance Team's data systems, managing data workflows, monitoring ETLs, resolving data issues, and optimizing performance.
We are looking for a data-focused engineer with a strong operational focus to support the Performance Team's data platform at IMC. This role is responsible for the reliability, correctness, and performance of data systems that directly support performance analysis and decision-making.
The role is production-facing and works closely with the Performance team and aligned stakeholders to ensure data workflows are robust, observable, and efficient.
What you'll do:
What you bring:
Nice to Have
What Success Looks Like
The role is production-facing and works closely with the Performance team and aligned stakeholders to ensure data workflows are robust, observable, and efficient.
What you'll do:
- Own the operational health of the Performance Team's data platform
- Monitor and maintain ETLs and data pipelines for correctness, timeliness, and stability
- Design and maintain data quality checks, reports, and alerting specific to performance data
- Investigate and resolve data issues and pipeline failures, driving problems to root cause
- Own and troubleshoot GitLab CI/CD pipeline issues related to performance data workflows
- Monitor workloads and resource usage; identify and resolve imbalances and bottlenecks
- Build and maintain operational tooling, automation, and runbooks
- Continuously tune data pipelines and workloads to improve performance and resource efficiency
What you bring:
- 3+ years of experience in software engineering or data engineering with an operational or production focus
- A Bachelor's Degree in Computer Science or a related field is strongly preferred
- Proficiency in Python, with hands-on experience using PySpark and Pandas
- Experience supporting production ETL or data processing systems
- Familiarity with Git-based development workflows and CI/CD systems (GitLab preferred)
- Strong analytical skills and attention to detail
- Comfortable taking ownership in a performance- and reliability-critical environment
Nice to Have
- Experience working with performance-critical or high-throughput systems
- Exposure to workload scheduling, resource management, or cluster-based compute
What Success Looks Like
- Performance data pipelines are reliable, observable, and trusted
- Issues are detected early and resolved quickly with clear root-cause ownership
- Workloads are well-balanced and systems run efficiently
Top Skills
Ci/Cd
Git
Gitlab
Pandas
Pyspark
Python
IMC Trading Chicago, Illinois, USA Office
IMC Chicago opened its doors in 2000, becoming our first overseas office. It now hosts more than 650 employees, making it the largest IMC location. Home to the Chicago Mercantile Exchange (CME) and the Chicago Board Options Exchange (CBOE), the city is at the centre of the global market.
Similar Jobs at IMC Trading
.png){kind=avatar}
Fintech • Machine Learning • Software • Financial Services
Participate in a chess tournament at MIT for a chance to compete against Magnus Carlsen and network with traders. Open to all students.
Top Skills:
Chess.Com
Fintech • Machine Learning • Software • Financial Services
Connect with IMC Trading to stay informed about future opportunities and events.
Fintech • Machine Learning • Software • Financial Services
The Global Market Data Manager will lead the market data strategy, manage vendor relationships, and ensure compliance while supporting trading objectives.
Top Skills:
Compliance SoftwareMarket Data ManagementTrading Systems
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
