Top Data Engineer Jobs in Chicago, IL

Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Data Engineer Interns support data pipelines, workflows, and platforms that enable analytics, reporting, automation, machine learning, and AI initiatives. Responsibilities include ingesting and transforming structured and unstructured data, applying data quality and validation practices, collaborating on scalable data solutions, and using Python, SQL, ETL processes, cloud technologies, and AI tools. The role includes mentorship, Agile exposure, and hands-on experience supporting data assets for insurance business needs.

Build and maintain ETL/ELT pipelines, ingest and transform structured and unstructured data, integrate APIs and external sources, improve data quality and monitoring, support dashboards and ML pipelines, optimize warehouse and cloud performance, and contribute to data governance and documentation.

Design, develop, and optimize enterprise-scale data platforms, pipelines, data lakes, warehouses, and analytical datasets on Azure and Snowflake. Build ETL/ELT processes using ADF, Databricks, PySpark, SQL, Python, and Snowflake. Manage data models, governance, security, quality, CI/CD, cloud migrations, and performance optimization. Collaborate with stakeholders, troubleshoot production issues, document solutions, and support Agile delivery.

Support design, development, and maintenance of data pipelines and infrastructure. Assist with ETL/ELT workflows, data ingestion, cleaning, validation, modeling, and warehousing. Document processes and collaborate with data teams to support analytics use cases.

Designs, builds, and manages cloud-based data systems, including pipelines, data lakes, warehouses, lakehouses, databases, and ETL processes. Develops optimized Python and SQL queries, improves workflow performance, and supports data movement between on-premises and cloud environments. Collaborates with leadership, analysts, research teams, and other departments to define requirements and reporting needs. Applies data governance, access controls, security, compliance, troubleshooting, and system support practices.

Lead data engineering teams in designing, developing, testing, implementing, and supporting cloud-based data solutions. Build distributed, full-stack, machine-learning-enabled systems using Java, Scala, Python, relational and NoSQL databases, streaming technologies, and cloud data warehouses. Collaborate with product managers and Agile teams, conduct code reviews and unit testing, optimize performance, mentor engineers, and adopt emerging technologies and interactive AI tools.

Design, build, and maintain Keboola-based data pipelines integrating multiple business systems to deliver accurate, scalable data for supply chain, logistics, and transportation analytics; collaborate with analysts and engineers; support documentation, governance, and pipeline automation.

Design, build, and maintain ETL/ELT pipelines and SSAS tabular models. Develop complex T-SQL queries and Power BI reports. Ensure data quality, optimize performance, and support migration of legacy systems into Microsoft BI environments while collaborating with stakeholders.

Own the design, development, maintenance, and performance of Microsoft Fabric data pipelines, centralized semantic models, DAX measures, and documentation. Ensure data quality, consistency, and trusted marketing metrics across sources. Partner with data engineering and BI teams on deployments and production issues, investigate model discrepancies, perform analytical work, mentor apprentices, and contribute to applied AI initiatives.

Designs and scales cloud-native data platforms and ingestion pipelines using AWS, Databricks, and Spark. Builds APIs, file-upload mechanisms, ETL/ELT workflows, data transformations, and Lakehouse architecture supporting analytics, machine learning, and operational use cases. Provides operational support for legacy C# .NET ingestion processes, troubleshoots pipelines, and promotes data governance, security, reliability, and documentation in a multi-tenant SaaS environment.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Build and lead the data engineering ecosystem supporting analytics, BI, and data science. Design scalable pipelines, cloud infrastructure, Snowflake data warehouses, governance controls, validation frameworks, and machine learning workflows. Collaborate with engineering, data science, product, and business stakeholders on architecture and technology decisions. Develop AI agents and secure enterprise AI integrations, participate in on-call and incident management, document standards, and mentor data engineers.

Develop and maintain automated data pipelines, API-driven workflows, and data integrations using Python, SQL, Databricks, and data lake architectures. Improve data quality through validation, schema design, and provider data mapping across diverse sources. Build analytics-ready datasets for predictive analysis, Power BI reporting, and GIS-based access analyses. Document data flows and technical configurations, support knowledge transfer, and collaborate with analysts, product owners, contractors, and government stakeholders.

Builds and maintains scalable data pipelines, ETL infrastructure, data warehouses, and analytics tools. The role assembles complex datasets, automates processes, optimizes data delivery architecture, and supports cross-functional data initiatives. Collaborates with executive, product, data, and design stakeholders to resolve technical issues and improve analytics systems. Requires proficiency in SAS, Python, Java, MATLAB, SQL, NoSQL, Hadoop, MapReduce, Hive, Presto, UNIX, and Linux, with JavaScript, R, and basic machine learning preferred.

Build and maintain enterprise data pipelines and infrastructure supporting natural-language querying, semantic search, knowledge graphs, and GraphRAG for the SEC. Responsibilities include onboarding data sources, processing XBRL and financial filing data, managing metadata and lineage, validating data quality, monitoring pipeline health, resolving integration issues, and using AWS data services. The role also requires compliance with federal security standards and collaboration with the Data Architect.

Build and operate large-scale data pipelines, web-scraping systems, and data-collection tools for AI datasets. Maintain analytical databases, optimize queries, troubleshoot pipeline and data-quality issues, manage containerized workloads across Kubernetes and Linux infrastructure, and support CI/CD workflows. The role also involves documenting technical processes, researching improvements, and developing scalable APIs in a fully remote environment.

Build and maintain scalable GCP-based data pipelines, ETL/ELT processes, and data models. Support migrations from legacy systems, enable ML integrations, enforce data quality and lineage, document Terraform modules, implement CI/CD across environments, and provide production support and performance tuning within Agile teams.

As the first in-house Data Engineer, you will own the data infrastructure, build and maintain data pipelines, and collaborate with teams to ensure quality data access and insights.

Build, maintain, and support production data pipelines and platform capabilities using Snowflake, dbt, Airflow or Cloud Composer, APIs, files, and cloud services. Responsibilities include ETL/ELT development, data modeling, testing, deployment, monitoring, troubleshooting, optimization, documentation, and data quality. The role partners with analytics, data science, finance, risk, marketing, product, and engineering teams, while supporting reliable, scalable, and cost-effective data systems and emerging AI data workflows.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

Build and operate cloud data capabilities, including ingestion pipelines, transformations, data models, curated data products, and data-quality controls. Use Snowflake, dbt, SQL, and Python to deliver governed data for analytics, applications, automation, and AI workflows. Implement testing, CI/CD, documentation, lineage, access controls, monitoring, incident resolution, and performance optimization. Collaborate with engineering, analytics, governance, security, and business teams in an Agile, product-oriented environment with active AI-assisted development.