Top Senior Data Engineer Jobs in Chicago, IL

Design, build, and operate scalable cloud data platforms, pipelines, and applications. Lead architectural decisions, establish reusable engineering patterns, evaluate technologies such as Snowflake and Databricks, and deliver distributed, real-time, and warehouse solutions. Collaborate with product, engineering, analytics, and data science teams while mentoring engineers and communicating technical outcomes to stakeholders.

Design, build, and support scalable cloud data platforms, pipelines, and applications. The role involves distributed data processing, data modeling, relational and NoSQL databases, data security, observability, orchestration, and real-time pipelines. It also requires influencing cross-functional teams, mentoring data professionals, establishing engineering standards, and communicating technical outcomes to stakeholders.

Leads data engineering teams and technical strategy for scalable cloud data platforms. Oversees architecture, pipelines, data models, quality, observability, and operational standards across Databricks, Spark, Python, and Snowflake environments. Mentors engineers, drives large-scale data initiatives, evaluates platform choices, and collaborates with product and software teams to deliver reliable data solutions.

Designs and leads scalable batch and real-time data pipelines supporting AI/ML applications, LLMs, RAG workflows, predictive models, and executive data products. Responsibilities include data architecture, feature stores, governance, security, lineage, performance and cost optimization, and cross-functional technical leadership. The role partners with data scientists, program managers, executives, and engineering teams to deliver reliable enterprise data solutions.

Designs and manages advanced data architectures, pipelines, ingestion frameworks, and data quality processes. Develops scalable data solutions across cloud, warehouse, lakehouse, and distributed computing platforms. Builds data consumption methods such as APIs, database views, and extracts while managing lineage, privacy, compliance, and transformation rules. Collaborates cross-functionally to improve data sourcing, accessibility, reliability, and processing efficiency.

Designs, builds, and operates scalable cloud data platforms, pipelines, and applications using Python, SQL, Spark, AWS, Databricks, Snowflake, and distributed data technologies. The role includes data modeling, real-time processing, data security, observability, architecture standards, stakeholder communication, mentoring, and collaboration with product, engineering, analytics, and machine learning teams.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Lead design and implementation of data infrastructure, pipelines, and warehouses using Azure Data Factory, Databricks, and Snowflake. Manage data modeling, quality, security, and analytics frameworks. Lead client accounts, mentor teams, and drive innovation to deliver data-driven business insights.

Lead design and implementation of scalable data infrastructure, pipelines, and transformations using cloud platforms. Build and optimize data warehouses (Snowflake, Databricks), orchestrate workflows (Airflow, Hadoop), ensure data quality and security, and coach teams to deliver analytics solutions that drive tax practice insights and client outcomes.

Design and build data infrastructure, pipelines, and transformations using Azure Data Factory, Azure Databricks, and Snowflake. Develop data architecture and modeling, maintain data lakes/warehouses, ensure data quality and security, optimize performance, and collaborate with clients to deliver tailored data solutions and governance.

Designs, builds, and maintains secure data pipelines, ETL processes, data warehouses, and quality controls. Collects, validates, cleanses, and analyzes data; develops SQL queries, Tableau dashboards, and AWS-based solutions; investigates data integrity issues; documents standards; and partners with stakeholders to deliver technical solutions using Agile and DevOps practices.

Own Eve’s data platform end to end, including ingestion, orchestration, incremental dbt models, Snowflake administration, Terraform infrastructure, observability, access controls, and pipeline reliability. Build schema-change detection, freshness SLAs, CI environments, and incident processes while managing performance and compute costs. Partner with analytics engineers and stakeholders to maintain trusted data for reporting and AI systems, using AI-assisted development and documenting platform standards.

Design, build, and operate scalable batch and streaming data pipelines, lakehouse and warehouse models, and data services. Own datasets end to end, improve Snowflake, Iceberg, Spark, and Flink performance and reliability, implement governance and observability, and support graph-serving data models. Partner with product and engineering teams, participate in on-call, review code and designs, and mentor junior engineers.

Leads data architecture, data warehouse design, ETL development, and scalable analytics solutions using cloud and modern data technologies. Develops Python, SQL, and JavaScript code; optimizes distributed systems and CI/CD pipelines; troubleshoots production systems; evaluates emerging technologies and AI tooling; collaborates with technical and business stakeholders; and mentors junior engineers.

Design, build, and maintain Keboola-based data pipelines integrating multiple business systems to deliver accurate, scalable data for supply chain, logistics, and transportation analytics; collaborate with analysts and engineers; support documentation, governance, and pipeline automation.

Develops enterprise data pipelines, streaming ingestion systems, AWS data lakes, Snowflake warehouses, analytics solutions, and MarkLogic integrations. Designs data and software architectures, REST APIs, and JavaScript modules while supporting Agile software development. Requires extensive experience with AWS data services, Python, JavaScript, Java, databases, ETL, web development, data integration, and enterprise information architecture.

Senior Data Engineer responsible for monitoring enterprise data pipelines, resolving production incidents, implementing data quality checks, automating operational workflows, and improving reliability across pharmacy data environments. The role also involves AI-enabled process optimization, data governance, documentation, technology evaluation, and operational best practices. Required experience includes data engineering, Azure cloud platforms, Scala or PySpark, SQL, Databricks, Airflow, Azure Data Factory, and production pipeline support.

Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.

Design, build, and operate big-data and streaming platforms (Kafka, Hadoop, Dremio). Develop, deploy, and monitor data pipelines using Java, Python, Spark/Flink; collaborate on data modeling and ingestion, ensure data integrity and availability, act as a Big Data SME, and perform root-cause analysis.

Administer, architect, optimize, secure, and automate PostgreSQL, MySQL, and Snowflake databases in Azure. The role develops resilient database solutions for healthcare applications, manages performance, access controls, encryption, backups, and disaster recovery, and creates technical documentation. It collaborates across Scrum teams, presents solutions to stakeholders, evaluates emerging technologies, uses approved AI tools, solves complex database challenges, and mentors junior engineers.

Build and own Snout’s data foundation, including PostgreSQL and dbt warehouses, ingestion pipelines, dimensional models, data quality, documentation, and reliable rebuilds. Reconcile data from veterinary practice-management systems, support LLM/AI tooling, translate stakeholder needs into technical plans, and establish the foundation for a future data team and analyst.

Design, develop, and operate large-scale data ingestion, transformation, enrichment, and processing pipelines across cloud, hybrid, and on-premises environments. Build distributed services using Java, Python, and Kafka; optimize data models and platform performance; deploy applications on Kubernetes; support infrastructure automation and CI/CD; troubleshoot production systems; and collaborate with customers and solution architects on implementations.

Designs, builds, and maintains enterprise data pipelines, ETL processes, integrations, data infrastructure, and complex data models. The role supports analytics partners, develops scalable data warehouse solutions, tunes SQL and databases, troubleshoots production issues, and collaborates with architects, analysts, developers, and stakeholders. Responsibilities include end-to-end project delivery, data modeling, big data engineering, production support, agile planning, and mentoring team members.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Lead the architecture and development of Vercel’s next-generation data platform, supporting batch and real-time integrations, analytics, data warehousing, and AI/ML workloads. Design scalable systems using Kafka, ClickHouse, Tinybird, and Snowflake; establish data governance and security standards; guide architectural decisions and roadmaps; collaborate with engineering, product, security, compliance, and leadership teams; write production code; and mentor engineers.