Design, build, and operate big-data and streaming platforms (Kafka, Hadoop, Dremio). Develop, deploy, and monitor data pipelines using Java, Python, Spark/Flink; collaborate on data modeling and ingestion, ensure data integrity and availability, act as a Big Data SME, and perform root-cause analysis.
We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets.
Core Responsibilities
Skills and Experience:
#LI-DNP
Core Responsibilities
- Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
- Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)
- Collaborate with development teams on data modeling, data ingestion, and capacity planning
- Work with users to ensure data integrity and availability
- Act as a Big Data SME and consult on a variety of data-related questions from users and developers
Skills and Experience:
- 5+ years experience working in a mature data engineering environment
- 3+ years of experience building Kafka streaming applications and/or maintaining Kafka clusters
- 2+ years of experience building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg, etc)
- Experience with Apache Spark, Apache Flink or similar tools
- Strong Java, Python, and SQL development skills
- Experience with common data-science toolkits, especially python-based
- Hands-on experience with Kubernetes and Docker
- Experience with monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie
- Strong statistical analysis skills
- Demonstrated ability to troubleshoot and conduct root-cause analysis
- Unix scripting experience (bash, python, etc.)
#LI-DNP
IMC Trading Chicago, Illinois, USA Office
IMC Chicago opened its doors in 2000, becoming our first overseas office. It now hosts more than 650 employees, making it the largest IMC location. Home to the Chicago Mercantile Exchange (CME) and the Chicago Board Options Exchange (CBOE), the city is at the centre of the global market.
Similar Jobs at IMC Trading
.png){kind=avatar}
Fintech • Machine Learning • Software • Financial Services
Build, operate, and scale large-scale data storage platforms (Hadoop, S3-compatible, enterprise storage). Tune Linux for I/O performance, automate deployments with Ansible/Puppet, implement observability with Prometheus, and partner with engineers on storage- and Kafka-focused data solutions. Familiarity with Kubernetes and development in Java/Python required.
Top Skills:
AnsibleClaudeHadoopJavaKafkaKubernetesLinuxPrometheusPuppetPythonS3S3-Compatible Enterprise StorageYarn
Fintech • Machine Learning • Software • Financial Services
Operate and maintain the Performance Team's data platform: ensure reliability, correctness, and performance of ETLs and pipelines; implement quality checks, alerting, runbooks, and automation; troubleshoot GitLab CI/CD and resource bottlenecks; continuously tune workloads for efficiency.
Top Skills:
Data PipelinesETLGitGitlab Ci/CdPandasPysparkPython
Fintech • Machine Learning • Software • Financial Services
The Data Center Engineer will manage physical servers and network hardware, ensuring their installation, maintenance, and troubleshooting, along with overseeing documentation and vendor coordination.
Top Skills:
BashFiber OpticsLinuxNetwork CablingNetwork DevicesPythonServer HardwareStorage Systems
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
