Leads a multi-year migration from Amazon Redshift to Databricks on AWS, designs Medallion architecture and data models, develops SQL and Python ETL pipelines, and establishes data quality and governance standards. Manages 4–5 data engineers and Power BI developers while partnering with stakeholders to support trusted reporting and analytics. The role requires hands-on architecture and engineering, technical leadership, LLM-enabled workflow development, and clear communication across technical and non-technical teams.
Authority Brands Inc. is a leading provider of home services, building brands that support the success of our franchisees, as well as bettering the lives of the homeowners we serve and the people we employ.
Authority Brands is seeking a highly skilled principal data architect with 10+ years of relevant experience to lead a data analytics platform migration from Redshift to Databricks and lead a small team (4-5 direct reports) of data engineers & Power BI developers. This will be a muiti-year transformation and hands on experience is required to build out the Medallion architecture.
Key Responsibilities:
- Lead analytics platform migration in AWS from Redshift environment (S3, RDS, Lambda, Glue) to new Databricks environment.
- Design, build, and optimize logical data model and stand up bronze, silver and gold semantic layer in Databricks.
- Develop and optimize complex SQL and Python‑based ETL processes across AWS service
- Own data modeling and schema design to support analytics, reporting, and downstream use cases.
- Partner with cross‑functional teams to understand data requirements and deliver well‑governed solutions.
- Establish and uphold data quality, validation, and documentation standards across pipelines and datasets.
- Monitor pipeline performance and proactively identify opportunities to improve reliability, scalability, and efficiency.
- Communicate technical concepts and data tradeoffs clearly to both technical and non‑technical stakeholders.
- Support the enablement of metrics, dashboards, and reporting by providing well‑modeled, trusted data foundations.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field. Graduate degree in similar domain preferred.
- 10+ years of experience in data architecture & engineering or a closely related role.
- Strong SQL expertise and experience working with large datasets.
- Proficiency in Python for ETL, automation, and data pipeline development.
- Hands‑on experience with Databricks and Redshift environments within AWS data services
- Experience with data modeling, version control (Git), and CI/CD practices.
- Hands‑on experience leveraging LLMs such as Claude for accelerating data engineering workflows, including code generation, ETL transformations, test creation, schema documentation, and troubleshooting.
- Strong understanding of prompt design and model constraints within enterprise security guidelines
- Strong problem‑solving skills and ability to work independently in a fast‑moving environment.
- Excellent communication skills and comfort collaborating with cross‑functional partners.
We believe our greatest assets are our employees, we offer competitive salaries and a full benefits package to include, PTO, paid holidays, 401(k) and more.
Authority Brands Inc. conducts drug screens and background checks on applicants who accept employment offers. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions however we do not sponsor Visa’s at this time.
Authority Brands Inc. is an Equal Opportunity Employer
Similar Jobs
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Owns end-to-end patient access cases for specialty pharmaceutical products, including benefits investigation, prior authorization, appeals, copay and interim-care support, prescription triage, appointment coordination, and post-fill follow-up. Serves as the primary contact for patients, caregivers, and healthcare providers while documenting cases, reporting adverse events, coordinating HUB partners and vendors, and ensuring compliant reimbursement and access communications.
Top Skills:
Copay PortalsDocusignKiteworksPbm SystemsPolarisSpecialty Pharmacy Networks
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Leads Jellyfish’s corporate marketing strategy, brand, communications, editorial, analyst relations, social media, executive voice, and thought leadership. Owns market positioning, content and research releases, brand identity, discovery efforts, team development, and performance measurement. Partners with executive, research, and product marketing leaders to establish Jellyfish as an authority among engineering leaders and drive demand through compelling narratives about AI’s impact on software development.
Top Skills:
AI
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
The Manager, Sales Architect leads the Sales Architect team, qualifying prospects, managing project handoffs, and designing solutions for technology sales.
Top Skills:
AccountingEnterprise SoftwareErpInformation Systems
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
