1upHealth is powering the digital transformation of the healthcare industry with our industry leading platform. By making healthcare data easily accessible and computable, we are on a mission to improve the patient experience, improve the quality of care, and reduce the overall cost of care.
We are seeking an experienced Senior Data Engineer to join our team and play a crucial role in designing, implementing, and optimizing scalable data solutions. In this role, you will work with modern data technologies, distributed systems, and cloud platforms to build efficient, high-performance data pipelines that support analytics, AI/ML, and business intelligence initiatives.
You will:
- Design, develop, and implement robust ETL/ELT data pipelines for large-scale data ingestion, transformation, and storage.
- Ensure data quality, integrity, and governance by implementing validation techniques, data monitoring, and automated testing.
- Collaborate with cross-functional teams, including data scientists, analysts, platform engineers, and business stakeholders, to develop scalable and reusable data solutions.
- Automate deployments and testing using CI/CD pipelines with Git, Terraform, GitHub Actions, or Jenkins.
- Design and build custom data tools and abstractions to support analytics, machine learning, and real-time data processing.
- Work with DevOps and platform teams to establish efficient deployment and monitoring processes for internal and external data products.
- Develop and implement alerting, monitoring, and observability frameworks for data pipelines to ensure reliability and proactive issue resolution.
- Contribute to the data architecture and strategy, driving improvements in scalability, performance, and cost optimization.
- Stay up to date with emerging technologies and industry best practices to continuously enhance data engineering capabilities.
We are looking for people who have:
- 5+ years of hands-on experience in data engineering, with expertise in distributed data processing and big data frameworks (e.g., Apache Spark, Apache Iceberg, Trino, Apache Airflow, dbt, Dagster).
- Advanced programming skills in Scala or Python for data transformation and automation.
- Experience with real-time data streaming technologies such as Apache Flink, Spark Streaming, or Kafka.
- Strong experience in performance tuning for Spark and optimizing large-scale data workflows.
- Proficiency in SQL and database management, with hands-on experience in Massively Parallel Processing (MPP) databases such as Amazon Redshift, Snowflake, Teradata.
- Familiarity with cloud-based data services (AWS, RDS, DynamoDB) and containerized infrastructure (EKS, Docker, Kubernetes).
- Hands-on experience integrating DevOps and CI/CD practices in data engineering using GitHub Actions, Jenkins, or Terraform.
- Proven ability to build monitoring, alerting, and observability tools for data pipelines to ensure high availability and reliability.
- Experience in data mapping, validation, and testing frameworks to ensure accuracy and consistency.
- Exposure in machine learning/deep learning using PyTorch, Tensorflow, or Keras (PyTorch preferred)
- Exposure to machine learning workflows and familiarity with MLOps tools for model deployment and lifecycle management.
- Self-starter with strong problem-solving skills who thrives in a fast-paced, agile environment.
Nice to Have:
- Experience working with healthcare data standards (e.g., HL7, FHIR) and regulatory compliance.
- Familiarity with reporting and visualization tools such as Superset, Grafana, Tableau.
- Understanding of data security, compliance, and governance frameworks (e.g., HIPAA, GDPR, SOC 2).
Why Join Us?
✅ Impact-Driven Work – Be a key player in building data solutions that advance analytics and enable AI-driven innovations in the healthcare sector.
✅ Cutting-Edge Technology Stack – Work with modern big data, cloud, and AI-driven solutions.
✅ Collaborate with Experts – Join a team of top engineers to solve complex data challenges.
✅ Career Growth – Opportunity to lead projects and drive technical innovations.
If you're passionate about building scalable data solutions and working with the latest in data engineering and AI-driven analytics, we’d love to hear from you! 🚀
Security Alert: 1upHealth only uses email domains of First Name. Last [email protected] or [email protected] to communicate with prospects. You will never receive an email from a third-party email service such as gmail. In addition, we will never ask a candidate for employment to share personal information (such as banking information, social security numbers, passport, etc), purchase their own equipment, or pay to apply to an open position.
Top Skills
Similar Jobs
What you need to know about the Chicago Tech Scene
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
