Build, operate, and scale large-scale data storage platforms (Hadoop, S3-compatible, enterprise storage). Tune Linux for I/O performance, automate deployments with Ansible/Puppet, implement observability with Prometheus, and partner with engineers on storage- and Kafka-focused data solutions. Familiarity with Kubernetes and development in Java/Python required.
We are hiring an Engineer to join our Data Engineering Infrastructure team, where you will help build and scale the storage and data platforms that power our HFT business. This is a hands-on role for someone who enjoys working close to the bare metal systems. Operating large-scale open-source storage, enterprise storage, tuning Linux systems for performance, automating infrastructure. As our data footprint grows, you will play a key part in keeping our infrastructure fast, reliable, and ready to scale.
Core Responsibilities:
Skills & Experience:
Core Responsibilities:
- Design, deploy, and operate large-scale data storage infrastructure, including Hadoop, enterprise storage and S3-compatible platforms
- Tune Linux systems for I/O throughput and overall performance
- Automate configuration and deployment using Ansible, Puppet or other automation platform
- Build observability into the platform with Prometheus and related tooling
- Partner with engineering teams to deliver reliable, well-architected data solutions with a focus on Storage and Kafka
- Familiarity with Kubernetes
Skills & Experience:
- 5+ years of experience in systems engineering with a strong focus on data storage
- Strong Linux fundamentals, debugging skills, including performance tuning for I/O throughput
- Hands-on experience with Ansible and Puppet for configuration management and automation
- Familiarity with open-source, S3 API compliant, and enterprise storage technologies
- Working knowledge of the Hadoop ecosystem, including YARN
- Experience in Java and Python
- Comfort working with AI-assisted development tools such as Claude (e.g., "vibecoding") in an enterprise setting
- Experience with Prometheus-based monitoring and alerting
IMC Trading Chicago, Illinois, USA Office
IMC Chicago opened its doors in 2000, becoming our first overseas office. It now hosts more than 650 employees, making it the largest IMC location. Home to the Chicago Mercantile Exchange (CME) and the Chicago Board Options Exchange (CBOE), the city is at the centre of the global market.
Similar Jobs at IMC Trading
.png){kind=avatar}
Fintech • Machine Learning • Software • Financial Services
As a Software Engineer, you will build AI systems to enhance developer workflows, implementing agents and servers, and ensuring code reliability through evaluation pipelines.
Top Skills:
AIJavaLlmPython
Fintech • Machine Learning • Software • Financial Services
Engineer and operate large-scale bare-metal Linux infrastructure, build automation and provisioning workflows, develop Python/Bash tools, extend monitoring/telemetry, manage configuration at fleet scale, troubleshoot performance and networking, and collaborate with stakeholders to maintain reliability and efficiency.
Top Skills:
AlertmanagerAnsibleBashCi/CdDnsDockerEbpfGitGrafanaHieraKubernetesLinuxLsofMulticastNcNtpPrometheusPtpPuppetPythonRoutingRpmStraceSystemdTcpTcpdumpUdp
Fintech • Machine Learning • Software • Financial Services
Design, build, and operate big-data and streaming platforms (Kafka, Hadoop, Dremio). Develop, deploy, and monitor data pipelines using Java, Python, Spark/Flink; collaborate on data modeling and ingestion, ensure data integrity and availability, act as a Big Data SME, and perform root-cause analysis.
Top Skills:
Alert ManagerAlertaBashDatabricksDockerDremioFlinkGrafanaHadoopHdfsIcebergJavaKafkaKubernetesOpsgeniePrometheusPythonS3SparkSQL
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
