Design and modernize a scalable, secure data platform: build ETL/ELT pipelines (batch and near-real-time), migrate/operate SQL Server on AWS RDS, support transition to Microsoft Fabric, optimize performance, enforce security and governance (SOC 2), and enable AI-ready data in collaboration with engineering and business teams.
Job Summary & ResponsibilitiesPosition Summary
Climate Pros is seeking a Senior Data Engineer to support the design, development, and modernization of our data platform. This role focuses on building scalable, secure, and high-performing data systems aligned with long-term architecture and business needs.
You will contribute to key initiatives including transitioning to cloud-managed relational databases (currently SQL Server on AWS RDS, with future consideration for platforms such as PostgreSQL), evolving toward Microsoft Fabric, and enabling data for advanced analytics and AI.
- Design scalable data models for operational and analytical use
- Develop relational, dimensional, and analytical data structures
- Ensure consistency and integrity across systems
- Design solutions portable across database platforms where practical
- Build and maintain ETL/ELT pipelines
- Support batch and near real-time data processing
- Automate ingestion and transformation processes
- Support SQL Server workloads in AWS RDS
- Assist transition toward Microsoft Fabric
- Align with long-term data platform strategy
- Optimize performance and reliability
- Resolve bottlenecks and ensure availability
- Implement secure data practices and controls
- Support compliance (e.g., SOC 2)
- Support AI-ready data structures and integrations
- Work with engineering, architecture, and business teams
- 7+ years data engineering experience
- Strong SQL and relational database expertise (SQL Server, PostgreSQL, etc.)
- Experience with ETL/ELT and cloud platforms (AWS/Azure)
- Strong data modeling and performance tuning skills
- Experience with AWS RDS, Redshift, DMS
- Experience with Microsoft Fabric or Power BI
- Experience across multiple database platforms (SQL Server, PostgreSQL)
- Exposure to AI/ML data environments
Similar Jobs
Artificial Intelligence • Cloud • Information Technology • Legal Tech • Productivity • Software
Own and operate the iMData platform: design and build Databricks-based ETL pipelines using PySpark and medallion architecture, create gold-layer star schemas, migrate assets from Synapse to Databricks, implement CI/CD and Terraform IaC, ensure data security and observability, mentor junior engineers, and collaborate with stakeholders and ML engineers to deliver production-grade analytics and AI-ready data.
Top Skills:
Apache KafkaAzure DatabricksCi/CdCollibraDatabricksDatabricks Asset Bundles (Dabs)Databricks Mcp ConnectorDelta LakeGithub ActionsInformaticaMicrosoft Event HubMicrosoft SynapsePower BIPysparkPythonSalesforceSparkTerraformZendesk
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.
Top Skills:
AirflowAWSAzureDagsterData LakeDatabricksDelta LakeETLGCPGitGitPrefectPysparkPythonRest ApisSparksqlSQL
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial
Design, build, and document cloud-based data ingestion pipelines and standardized data models for the Digital Intelligence Warehouse. Collaborate with international business and technical teams, run proofs of concept, report status to leadership, and perform administrative tasks via Azure DevOps.
Top Skills:
AWSAzure DevopsBigQueryETLGCPMS OfficePythonReverse EtlSnowflakeSQL
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
