Top Data Engineer Jobs in Chicago, IL

Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.

Lead the reverse-engineering and migration of legacy ETL pipelines from SAP BusinessObjects Data Services and JD Edwards into dbt and Databricks architectures. Build automated data validation, maintain SQL Server write-back mechanisms, collaborate with client stakeholders, and lead and mentor a small engineering team. The role requires hands-on expertise in SQL, Python, Spark, orchestration, cloud platforms, and legacy ERP and ETL migrations.

Designs, builds, tests, and maintains scalable data infrastructure and ETL/ELT pipelines for mission partners. Uses AWS Glue, Glue Catalog, and Step Functions to integrate, migrate, transform, and validate data. Develops data models, schemas, queries, and production-ready datasets while collaborating with analytics and business teams. The role may also support AI/ML pipelines, data governance, DevOps workflows, Databricks, and real-time streaming architectures.

Architects, builds, tests, and maintains scalable data infrastructure and ELT/ETL pipelines using AWS Glue, Glue Catalog, and Step Functions. Performs data modeling, SQL querying, data migration, schema optimization, validation, and data quality improvements. Partners with analytics and business teams to transform raw data into production-ready datasets. The role may also support AI/ML pipelines, governance, access controls, DevOps workflows, and real-time data architectures.

Build, maintain, and optimize cloud data pipelines using SQL, Python, Snowflake, BigQuery, and dbt. Integrate data from APIs, databases, cloud storage, marketing platforms, and third-party sources. Implement data quality checks, monitoring, troubleshooting, automation, and performance improvements. Collaborate with architects, analytics teams, and stakeholders to deliver reliable, reusable, analytics-ready datasets.

Lead production data engineering workstreams for AI-enabled financial services solutions. Design Python and SQL pipelines, warehouse and lakehouse models, document ingestion and retrieval-ready data foundations. Implement data quality, lineage, access controls, testing, deployment, monitoring, and recovery processes. Mentor engineers, manage technical delivery, collaborate with clients and vendors, and contribute to reusable assets, proposals, and implementation roadmaps.

Designs and manages advanced data architectures, pipelines, ingestion frameworks, and data quality processes. Develops scalable data solutions across cloud, warehouse, lakehouse, and distributed computing platforms. Builds data consumption methods such as APIs, database views, and extracts while managing lineage, privacy, compliance, and transformation rules. Collaborates cross-functionally to improve data sourcing, accessibility, reliability, and processing efficiency.

Senior Data Engineer responsible for monitoring enterprise data pipelines, resolving production incidents, implementing data quality checks, automating operational workflows, and improving reliability across pharmacy data environments. The role also involves AI-enabled process optimization, data governance, documentation, technology evaluation, and operational best practices. Required experience includes data engineering, Azure cloud platforms, Scala or PySpark, SQL, Databricks, Airflow, Azure Data Factory, and production pipeline support.

Designs, builds, and operates scalable cloud data platforms, pipelines, and applications using Python, SQL, Spark, AWS, Databricks, Snowflake, and distributed data technologies. The role includes data modeling, real-time processing, data security, observability, architecture standards, stakeholder communication, mentoring, and collaboration with product, engineering, analytics, and machine learning teams.

Own Eve’s data platform end to end, including ingestion, orchestration, incremental dbt models, Snowflake administration, Terraform infrastructure, observability, access controls, and pipeline reliability. Build schema-change detection, freshness SLAs, CI environments, and incident processes while managing performance and compute costs. Partner with analytics engineers and stakeholders to maintain trusted data for reporting and AI systems, using AI-assisted development and documenting platform standards.

Design, build, and operate batch, streaming, and hybrid data pipelines in a regulated healthcare environment. Develop dbt models in BigQuery, ingest structured and unstructured clinical data, and implement data quality, lineage, governance, and compliance controls. Support ML workflows, CI/CD, monitoring, incident response, and platform architecture. Collaborate with data scientists, clinical, quality, security, and product teams while mentoring engineers and establishing standards.

Designs, builds, and operates scalable cloud data pipelines, platforms, and applications. Responsibilities include distributed data processing, data modeling, relational and NoSQL database development, data security, observability, orchestration, and data warehousing. The role collaborates with engineering, analytics, product, and data science teams; establishes reusable engineering patterns; communicates technical concepts; and mentors data professionals.

Designs, builds, operates, and modernizes secure ETL/ELT data pipelines for public health interoperability. Responsibilities include using NiFi, Kafka, Python, and SQL; deploying pipelines on Azure or AWS; implementing CI/CD with GitHub Actions; monitoring with Grafana; troubleshooting production systems; supporting legacy migrations; and ensuring data security, compliance, scalability, and reliability. The role collaborates with architects, integration engineers, data scientists, DevOps/SRE, and product teams.

Build and own scalable data pipelines using Python, dbt, Airflow, and Snowflake. Design data architecture, optimize performance, implement data quality and observability, troubleshoot production issues, and process diverse data sources. Support executive reporting and ad hoc analysis, contribute to Tableau visualization, collaborate with engineering and business stakeholders, and mentor teammates through reviews and knowledge sharing.

The AVP, Data Engineer will design and build data ingestion, transformation, and replication pipelines using SQL, Python, dbt, and Dagster. Responsibilities include translating requirements into technical designs, developing data products, debugging production issues, supporting testing, and improving data engineering practices. The role also involves data modeling, mentoring junior engineers, conducting code reviews, and providing technical leadership while remaining hands-on. Experience with modern data platforms, workflow orchestration, cloud ecosystems, and insurance or financial services is preferred.

Leads data architecture and engineering modernization across business domains. Designs and implements complex pipelines, integrations, data models, and orchestration using Snowflake, AWS, and Airflow. Establishes data quality, governance, security, testing, observability, CI/CD, and reliability practices. Provides architectural guidance, evaluates technical solutions, leads cross-team initiatives, mentors engineers, and improves platform performance and cost efficiency.

Build and maintain production ETL pipelines for structured and unstructured data, integrate machine learning models for enrichment, develop data transformations and quality monitoring, design warehouses and dimensional models, establish governance frameworks, and contribute to data architecture and platform improvements. Collaborate with data scientists, analysts, and engineering teams to deliver reliable, actionable intelligence.

Leads the architecture, development, and production operation of complex data pipelines and platforms. Resolves scalability, data quality, reliability, and architectural challenges; evaluates data technologies; mentors engineers; establishes engineering standards; partners with product, analytics, and operations teams; communicates technical trade-offs; and conducts proofs of concept to guide platform strategy.

Architect and own marketing data infrastructure, including Databricks pipelines, Gold Layer tables, semantic models, and ETL/ELT workflows. Build trusted data products for analytics, automation, and AI agents; translate ambiguous business needs into scalable solutions; lead cross-team initiatives; ensure reliability and data quality; mentor engineers and analysts; and develop, evaluate, and monitor production LLM and agent systems using Python and SQL.

Build and maintain scalable Snowflake-based ELT/ETL pipelines, production data models, and observability frameworks. Translate business requirements into reliable solutions supporting analytics, BI, and ML. Establish data quality, governance, lineage, security, and compliance practices while optimizing warehouse performance, cost, and data freshness. Collaborate with Analytics, Product, and Engineering teams, contribute to architecture decisions, evaluate Snowflake tooling, and use AI-assisted development tools to accelerate delivery.

Designs, builds, and optimizes scalable data collection, storage, access, and analytics systems. Creates and automates reliable data pipelines, supports data quality and governance, ensures SLA and performance compliance, and monitors pipeline operations. The role requires collaboration with analytics, business, and customer teams, with potential work involving AI/ML pipelines, Databricks, DevOps practices, streaming data, and event-driven architectures.

Designs and supports modern data platforms using Microsoft Fabric and Databricks. Builds scalable ingestion, transformation, orchestration, lakehouse, semantic modeling, and analytics solutions. Translates client business requirements into technical designs, optimizes SQL and Spark workloads, ensures data quality and performance, and enables Power BI reporting. The role is client-facing, collaborative, and consulting-oriented, requiring stakeholder communication, documentation, and adherence to engineering and delivery best practices.

Build and maintain scalable batch and incremental data pipelines using Python, SQL, and Snowflake. Develop data warehouse models, transformations, automation, quality checks, lineage, alerting, and performance optimizations. Collaborate with analysts, data scientists, and application teams to deliver trusted datasets, while documenting pipelines, schemas, and data contracts.

Build and maintain scalable batch and incremental data pipelines using Python, SQL, and Snowflake. Develop warehouse models, transformations, automation, data quality checks, lineage, alerting, and performance optimizations. Collaborate with analysts, data scientists, and application teams to deliver trusted datasets, while documenting pipelines, schemas, and data contracts.

Designs and maintains a scalable data platform supporting analytics, machine learning, and AI workloads. Builds tooling for reliable data pipelines, semantic layers, data agents, LLM applications, and evaluation systems. Ensures data quality, availability, observability, and reliability while establishing modeling, testing, and platform best practices. Collaborates with Data Science and Product Engineering, leads solutions from design through implementation, and contributes individually in a fast-paced startup environment.