Design, build, and maintain scalable ETL/ELT data pipelines and BigQuery data models. Implement Airflow workflows, CI/CD for deployments, ensure data quality and performance, and collaborate with data scientists, analysts, and business teams to deliver reliable analytics-ready data.
We are looking for a skilled Data Engineer with strong experience in building, optimizing, and maintaining scalable data platforms and pipelines. The ideal candidate will work closely with data scientists, analysts, and business teams to ensure reliable, high-quality data delivery across analytics and reporting use cases.
Key Skills & Technologies- Strong programming experience in Python and SQL
- Hands-on experience with Google Cloud Platform (GCP) services
- Expertise in BigQuery for data warehousing, performance tuning, and cost optimization
- Experience with ETL/ELT frameworks and large-scale data pipeline development
- Workflow orchestration using Apache Airflow
- CI/CD implementation for data pipelines using tools like Git, Jenkins, or Cloud Build
- Solid understanding of data modeling, partitioning, and schema design
- Experience with cloud storage, data validation, and monitoring
- Knowledge of containerization (Docker) and basic DevOps practices is a plus
- Design, develop, and maintain scalable and reliable data pipelines
- Build and optimize ETL/ELT processes to ingest data from multiple sources
- Develop and manage data models in BigQuery to support analytics and reporting
- Implement automated workflows and scheduling using Airflow
- Ensure data quality, integrity, and performance across pipelines
- Collaborate with cross-functional teams to gather requirements and deliver data solutions
- Apply CI/CD best practices to support efficient and reliable deployments
- Troubleshoot and resolve data pipeline and performance issues
Graduate in Data Science, Computer Science, Statistics, or a related field. 3-4 years of experience in data science or data analysis.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and operate scalable data pipelines and AI-ready data products from large structured and unstructured sources (OCR/images/documents). Enable production Generative AI (RAG, semantic search), ensure data quality/observability, orchestrate CI/CD and infra-as-code, and mentor engineers while collaborating with product, analytics, and compliance teams.
Top Skills:
AirflowAWSAzureChartjsDatabricksDatabricksDeequDelta LakeDockerEvent HubsGCPGithub ActionsGreat ExpectationsJavaKafkaKinesisKubernetesLlmOcrPlotlyPysparkPythonRagScalaSeabornSemantic SearchSnowflakeSparkSQLTerraform
Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Own and modernize Upside s analytics data platform: migrate pipelines, reduce cost, improve governance, design reusable modeling/orchestration patterns, deliver domain-critical data products, lead cross-functional initiatives, mentor engineers, and support ML and product teams.
Top Skills:
AWSCi/CdDagsterDatabricksDbtSnowflakeTerraform
Artificial Intelligence • Legal Tech
Founding data engineer responsible for consolidating multiple data sources into a BigQuery warehouse, building ETL/ELT pipelines, creating self-serve data tools (including natural-language/LLM agents), enabling analytics and personalization, and defining data engineering standards and infrastructure for a growing AI product.
Top Skills:
BigQueryData LakeEtl/EltGoogle Cloud PlatformLlmsPythonSQLTerraformText-To-Sql
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
