Build and maintain scalable ETL/ELT pipelines using Azure Data Factory, Snowflake, dbt, and SQL. Develop data models, transformations, tests, and documentation; ingest data from APIs, databases, files, and enterprise applications; optimize performance; ensure data quality; troubleshoot failures; and support production deployments and monitoring.
This is a remote position.
We are looking for an experienced Data Engineer with strong hands-on experience in Azure Data Factory (ADF), Snowflake, dbt, and SQL. The ideal candidate will be responsible for building and maintaining scalable data pipelines, transforming data, and developing reliable data solutions for analytics and reporting.
- Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory (ADF).
- Build and optimize data solutions using Snowflake as the cloud data warehouse.
- Develop data transformation models using dbt (Data Build Tool).
- Write complex and optimized SQL queries, stored procedures, views, and transformations.
- Develop data pipelines to ingest data from various sources including APIs, databases, files, and enterprise applications.
- Perform data cleansing, transformation, validation, and reconciliation to ensure data quality and accuracy.
- Implement incremental data loads, scheduling, dependency management, and error handling in ADF.
- Develop scalable and optimized Snowflake data models, tables, views, and SQL transformations.
- Build and maintain dbt models, tests, macros, and documentation.
- Troubleshoot pipeline failures, data issues, and performance problems across ADF, Snowflake, and dbt.
- Work with business analysts, data architects, and other engineering teams to understand data requirements and deliver solutions.
- Support production deployments, monitoring, and ongoing enhancement of data pipelines.
- 4+ years of experience in Data Engineering.
- Strong hands-on experience with:
- Azure Data Factory (ADF)
- Snowflake
- dbt
- Advanced SQL
- Azure Data Factory (ADF)
- Strong understanding of ETL/ELT concepts and data warehousing.
- Experience developing complex data pipelines and data transformations.
- Good understanding of dimensional data modeling, including fact and dimension tables.
- Experience with Snowflake performance optimization and query tuning.
- Hands-on experience with dbt models, tests, incremental models, macros, and Jinja.
- Strong troubleshooting and production support skills.
- Experience with Azure cloud services, particularly Azure Storage, Azure Functions, Databricks, or Key Vault.
- Experience integrating data through REST APIs, JSON, CSV, and relational databases.
- Experience with Python or PySpark is a plus.
- Experience with Git and CI/CD using Azure DevOps or similar tools.
- Understanding of data governance, data quality, and security best practices.
- Experience working with large-scale enterprise data platforms.
Similar Jobs
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Leads technical accounting, SEC and external financial reporting, complex US GAAP analysis, audit and SOX compliance. Drives finance transformation through BlackLine’s Customer Zero initiative, responsible AI adoption, reporting workflow automation, and data warehouse implementation. Advises senior finance and cross-functional leaders, develops the accounting team, partners with Product and Engineering, and represents BlackLine with customers and industry stakeholders.
Top Skills:
Bi/Reporting ToolsBlacklineData WarehousingErp/Reporting SystemsSnowflakeVerity Ai
.png){kind=logo}
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Supports IT services for live events and remote operations, including endpoint devices, network infrastructure, remote infrastructure kits, inventory, documentation, dashboards, and vendor coordination. The role partners with broadcast, digital, and security teams, implements technology and AI initiatives, and provides onsite support at remote event locations. Extensive travel, overtime, weekends, and non-traditional hours may be required.
Top Skills:
GrafanaLan/WanMicrosoft CopilotRoutersSelectoraiSevoneSnmpSwitches
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Leads corporate communications technology products and platforms, including intranet, CMS, email marketing, event management, and employee engagement solutions. Defines product strategy, roadmaps, backlogs, requirements, and success measures; partners with stakeholders, engineering teams, architects, and vendors to deliver scalable solutions. Oversees projects, budgets, risks, testing, deployment, governance, and operational readiness while providing technical guidance, resolving complex issues, and mentoring junior team members.
Top Skills:
AgileCampaign Management ToolsCmsDigital Asset Management TechnologiesEmail Marketing PlatformsEmployee Engagement TechnologiesEvent Management PlatformsExcelInternet PlatformsIntranet PlatformsJIRAPowerPoint
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
