The Data Engineer will design, implement, and optimize data pipelines for analytics and AI, transforming raw data into structured datasets, utilizing technologies like Databricks and SQL.
Who are we looking for?
A technical Data Engineer who is responsible for designing, building, and implementing data infrastructure that powers the organization’s analytics, system integrations, and AI initiatives. This role is responsible for architecting scalable pipelines that ingest data from a wide range of applications, APIs, databases, files, and SaaS platforms into Databricks.
Why Daniels Health?
Daniels Health is a mission-driven global innovator in healthcare waste management, operating across the U.S., Australia, Canada, Europe, and South Africa. We're experiencing significant global growth—expanding our U.S. footprint through key facility acquisitions, strengthening our presence in Europe, and growing operations in Australia, Canada, and South Africa. As a consistently recognized industry leader, we're scaling our data and AI capabilities to power smarter decision-making, seamless integrations, and sustainable innovation across our rapidly expanding global operations.
What you will do:
- Architect, build, and maintain robust ELT/ETL pipelines ingesting data from custom applications, third‑party APIs, databases, files, and SaaS platforms into Databricks.
- Develop and maintain reverse ETL pipelines to move curated data from Databricks back into operational or application systems.
- Transform raw data into structured and governed bronze and silver datasets using PySpark, SQL, Databricks notebooks/jobs and similar languages.
- Implement schema management, data normalization, change-data-capture processing, and incremental load strategies.
- Optimize ETL performance, data storage, and job execution costs.
Candidate Profile:
- 5+ years of data engineering or software engineering experience
- Advanced SQL and Python expertise with proven ability to write efficient, scalable code
- Expert level experience using Databricks
- Familiarity with GitHub, version control workflows, and automated testing practices
- Understanding of data quality frameworks and experience working in Agile/Scrum environments
- Deep understanding of data modeling techniques, ETL/ELT, and medallion architecture.
Be Part of Daniels Health's Global Growth Story
If you want to build high‑quality data products that drive meaningful outcomes—and you're energized by the idea of supporting a company scaling worldwide—we'd love to meet you.
Apply now and help shape the future of analytics at Daniels Health.
Candidates must currently reside in the United States and be authorized to work without sponsorship.
Daniels Health & Sharpsmart is an equal opportunity employer. In accordance with anti-discrimination law, it is the purpose of this policy to effectuate these principles and mandates. Daniels Health & Sharpsmart prohibit discrimination and harassment of any type and affords equal employment opportunities to employees and applicants without regard to race, color, religion, sex, age, national origin, disability status, protected veteran status, or any other characteristic protected by law. Daniels Health & Sharpsmart conforms to the spirit as well as to the letter of all applicable laws and regulations.
Daniels Health Chicago, Illinois, USA Office
111 W Jackson Blvd, Chicago, IL, United States, 60604
Similar Jobs
eCommerce • Information Technology • Retail • Industrial
The Data Engineer III will design, build, and optimize data pipelines and backend systems, integrating with SAP and supporting analytics applications. Responsibilities include developing ETL workflows, backend applications, and ensuring data quality.
Top Skills:
SparkAws GlueCloudFormationDockerGithub ActionsKafkaKubernetesPostgresPythonSap DatasphereSap S/4HanaScalaSnowflakeSQLTerraform
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
As a Data Engineer II, you will build, scale, and optimize data platforms, focusing on ETL/ELT pipelines, and collaborate with data scientists and AI engineers to support data-driven applications and insights.
Top Skills:
DatabricksDbtPythonRdsRedshiftSnowflakeSparkSQL
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
As a Senior Developer Advocate, you will lead community engagement in Data Observability, create content, mentor teams, and enhance product feedback from engineers.
Top Skills:
SparkBigQueryDatabricksGoJavaKafkaPythonScalaSnowflakeSQL
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
