Top Data Engineer Jobs in Chicago, IL

Lead Data Engineer designs, develops, tests, implements, and supports cloud-based data solutions. Collaborates with agile teams, mentors engineers, builds streaming and batch pipelines using big-data and cloud technologies, and ensures performant, well-tested code.

Own and operate the iMData platform: design and build Databricks-based ETL pipelines using PySpark and medallion architecture, create gold-layer star schemas, migrate assets from Synapse to Databricks, implement CI/CD and Terraform IaC, ensure data security and observability, mentor junior engineers, and collaborate with stakeholders and ML engineers to deliver production-grade analytics and AI-ready data.

Lead Data Engineer designs, develops, tests, and supports cloud-based data solutions. Collaborates with Agile teams on distributed, real-time, and ML-enabled systems using languages and data platforms (Java, Scala, Python, Go, Redshift, Snowflake). Mentors engineers, performs code reviews and unit tests, and drives technical innovation and experimentation.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.

The Senior Data Engineer will design and implement scalable data models in BigQuery using dbt for analytics and reporting, ensuring data governance and optimal performance.

Design, build, and automate scalable data platforms (lakehouses/warehouses). Implement and optimize ETL/ELT pipelines using Databricks and dbt, apply Medallion Architecture, manage IaC/CI-CD, ensure data security and governance, and integrate pipelines with BI tools while engaging with stakeholders.

Build and maintain production-grade data pipelines and ELT processes using Python, SQL, Airflow, and dbt within AWS. Design optimized schemas in PostgreSQL and Redshift, leverage AI/LLMs to improve development, automation, testing, and data quality, and scale infrastructure for large healthcare datasets.

Design, build, and maintain data pipelines, ETL/ELT processes, and data warehouses. Develop complex data models, tune SQL/PLSQL, support production BI/reporting, and collaborate with analysts and architects to deliver scalable analytics solutions. Mentor teammates and participate in agile delivery and production support.

Lead design, build, test, and support cloud-based data platforms and streaming systems. Collaborate across agile teams to deliver scalable ETL, real-time processing, data warehousing, and mentor engineers while ensuring code quality and performance.

Design, develop, and manage data infrastructure for internal and client projects, focusing on large-scale data pipelines, APIs, and cloud deployments.

Design, build, and maintain data warehouse infrastructure, semantic/dimensional models, metrics layer, and BI dashboards (Sigma, Power BI, Databricks). Build secure ELT pipelines, enforce governance and row-level security (Entra ID), enable self-service analytics and AI/ML integrations, triage BI issues, train stakeholders, and collaborate in Agile to deliver reliable, performant reporting and curated data products.

Lead Data Engineer responsible for designing, developing, testing, implementing, and supporting cloud-based data solutions. Collaborate across Agile teams to build distributed, real-time data and streaming systems, mentor engineers, perform unit tests and code reviews, and leverage big data, NoSQL, and cloud data warehousing technologies.

Design, build, and operate enterprise data pipelines and Lakehouse data products on Azure. Lead migrations, implement medallion architectures, optimize Spark and distributed SQL workloads, enforce CI/CD and observability, and support production incident response while partnering with architects, data scientists, and stakeholders.

Build and maintain scalable ELT pipelines and analytics-ready datasets in SQL Server. Integrate SaaS/APIs, implement automated data validation and testing, develop star/snowflake data models, optimize performance, and support BI integration (Power BI) while partnering with stakeholders and documenting data systems.

Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.

Lead architecture and buildout of a new graph-backed enterprise data platform: design ingestion, graph and relational storage, entity resolution pipelines, temporal models, ETL/ELT pipelines, governance, APIs, and production connectors. Ship scalable graph data models, traversal queries, and platform roadmap while enabling observability, security, and containerized deployments.

Build and maintain scalable, governed data pipelines from ingestion through transformation and integration. Implement schema validation, data quality checks, job monitoring, and production-grade APIs. Work with Python, SQL, Airflow, dbt, AWS (EMR, Athena, S3), Iceberg/Parquet, and contribute to CI/CD, observability, and on-call support while collaborating with analytics and product teams.

Build and maintain ETL/ELT data pipelines and storage for batch and real-time use. Partner with product and engineering to define requirements, ensure data quality, monitor pipeline health, integrate cloud data warehouses/lakes, optimize SQL/Python transformations, and document data flows and architecture.

Lead and mentor a data engineering team to design, build, test, and support cloud-based data solutions. Develop distributed, real-time and batch data pipelines using Java/Scala/Python, NoSQL and RDBMS, and cloud data warehousing (Redshift/Snowflake). Collaborate with product managers and Agile teams to deliver performant, production-ready systems.

Lead and administer cloud data warehouse platforms (e.g., Snowflake), design scalable data architectures and models, build and maintain ETL/ELT pipelines, implement CI/CD and version control, optimize performance and costs, migrate/load data from APIs/SaaS/ERP, and ensure security, governance, and testing best practices across the data lifecycle.

Design, build, and maintain scalable data pipelines, data lakes, and databases; ingest and map customer financial datasets; monitor pipeline reliability; translate business requirements into data flows and analytical insights to ensure high-quality, usable data.

Lead architecture and reliability of the data platform, build and harden ingestion (batch and CDC), own BigQuery+dbt transformations, establish testing/observability/governance, mentor engineers, develop Python tooling and APIs, run POCs for lakehouse/open table formats, and define AI-assisted development practices.

Build and maintain ETL/ELT pipelines, ingest and transform structured and unstructured data, integrate APIs and external sources, improve data quality and monitoring, support dashboards and ML pipelines, optimize warehouse and cloud performance, and contribute to data governance and documentation.

Develop custom connectors on Airbyte for data ingestion from various platforms, ensuring accurate data integration and transformation. Collaborate with stakeholders and perform testing for reliability.

The Snowflake Data Engineer will work on data cleansing and harmonization, moving from legacy systems to SAP S4, focusing on ETL/ELT development and view creation.