Top Data Engineer Jobs in Chicago, IL

Design, build, and maintain scalable Azure data pipelines and platforms using Azure Databricks, Synapse, Fabric, and Data Factory. Implement IaC (Bicep/ARM/Terraform), CI/CD with Azure DevOps, optimize Spark jobs, monitor platform stability, and collaborate with architects, BI developers, and clients to meet Azure best practices and business requirements.

Lead a team of engineers to design and implement data solutions using cloud technologies, optimizing data pipelines and collaborating with Agile teams to deliver impactful data-driven products.

Lead technical strategy and roadmap for an enterprise Databricks-based data platform. Drive governance, metadata, lineage, and semantic layer standards; build reusable data products; enable self-service analytics and scalable ML operations; mentor engineers and align platform investments with business outcomes.

Data Engineers at CapTech build and maintain data pipelines on cloud platforms, advise clients on technology usage, and ensure data architecture maximizes client value.

The Data Engineer will develop data pipelines, support data automation, collaborate with Agile teams, and ensure data reliability and performance. The role requires strong ETL skills and experience with relational databases, big data analysis, and CI/CD practices.

Lead design and implementation of a unified event-tracking data platform. Collaborate with Data, Product, and Engineering to build reusable event-publishing frameworks, monitoring/alerting, and deprecate legacy systems. Coach mid-level engineers, influence roadmap and processes, manage cloud/SaaS spend, create documentation, and participate in on-call rotations to ensure platform reliability and data trustworthiness.

The Data Engineer will design and maintain data pipelines, optimize cloud data warehouses, and collaborate with analytics teams while mentoring junior staff.

Build and maintain AWS-based ETL pipelines (Glue/PySpark, MWAA/Airflow, Lambda) to ingest and process terabytes of financial data into an S3 data lake using Iceberg/Parquet. Implement metadata, monitoring, tests (90% coverage), materialized views (Trino/Athena), CloudFormation deployments, documentation, and support agile delivery and operations for federal clients.

Design and build end-to-end geospatial data systems: ingest and process satellite imagery into columnar/chunked stores, expose results via GraphQL/REST and FastAPI, build Next.js/React dashboards, automate with IaC and CI/CD, orchestrate pipelines with Prefect, optimize petabyte-scale I/O, and lead hiring, mentoring, and engineering best practices.

Design, build, and maintain scalable ETL pipelines and data warehouse architecture using BigQuery, Databricks, and GCP. Ingest and transform high-volume data from Postgres, REST APIs, and other sources, improve reporting, create reusable code and tests, and collaborate in an Agile/SCRUM environment.

Build and maintain data marts, materialized views, and pipelines in an AWS Aurora PostgreSQL environment. Integrate data with downstream BI platforms (MicroStrategy), design/optimize workflows for analytics and reporting, monitor pipeline health and data quality, and support federal data security compliance (FISMA/NIST 800-53). Collaborate with engineering and product teams to enable data-driven features.

Design, develop, and manage data infrastructure for internal and client projects, focusing on large-scale data pipelines, APIs, and cloud deployments.

The role involves designing and optimizing data pipelines in Snowflake, developing ETL workflows, collaborating on data integration, ensuring data security, and performance monitoring.

The role involves building and maintaining financial data pipelines in Databricks, bridging Snowflake, and ensuring data accuracy for finance reporting.

As a Data Engineer, you will build and maintain data ingestion pipelines, develop data transformations, and migrate SQL Server processes to Azure-native solutions, supporting marketing campaigns and analytics teams.

Design, build, and maintain Databricks-based data pipelines and ETL/ELT processes using Python and SQL. Optimize workflows for performance and cost, support data modeling and cloud integrations (Azure/AWS/GCP), monitor and troubleshoot pipelines, document best practices, and collaborate with cross-functional teams.

Design, build, and maintain scalable data pipelines and models; collaborate with analysts and data scientists to provision prepared datasets; implement data quality, governance and monitoring; recommend technologies; lead root-cause analysis, code reviews and testing; mentor teammates and support production data environments.

The Snowflake Data Engineer will work on data cleansing and harmonization, moving from legacy systems to SAP S4, focusing on ETL/ELT development and view creation.

This role involves designing, building, and maintaining data pipelines on Snowflake. Responsibilities include ensuring data quality and collaborating with stakeholders to deliver solutions.

The AWS Data Engineer will work on a data cleansing and harmonization project, focusing on AWS ETL design and development using various AWS services.

The Snowflake Data Engineer will design, build, and maintain data pipelines on Snowflake, optimizing performance and ensuring data quality while collaborating with stakeholders.

The Snowflake Data Engineer and Product Owner will manage the Snowflake data analytics project, collaborating with stakeholders, leading Agile practices, and ensuring quality deliverables through effective team coordination and backlog management.

Develop custom connectors on Airbyte for data ingestion from various platforms, ensuring accurate data integration and transformation. Collaborate with stakeholders and perform testing for reliability.

The Data Engineer will develop and maintain data pipelines, perform data extraction and transformation, and support data analytics across the enterprise.

As a Principal Data Engineer, you'll design and maintain scalable data pipelines and frameworks using Azure technologies while collaborating with various teams to ensure data products support business decisions.