CIBC Logo

CIBC

Lead Data Engineer (Databricks, SQL)

Reposted 6 Days Ago
Be an Early Applicant
In-Office
Chicago, IL, USA
150K-170K Annually
Senior level
In-Office
Chicago, IL, USA
150K-170K Annually
Senior level
The Lead Data Engineer will manage U.S. Data Strategy capabilities, translating business objectives into cloud data solutions, while ensuring scalability and security. This includes ETL, analytics, and technical leadership in a hybrid work environment.
The summary above was generated by AI

We’re building a relationship-oriented bank for the modern world. We need talented, passionate professionals who are dedicated to doing what’s right for our clients.

At CIBC, we embrace your strengths and your ambitions, so you are empowered at work. Our team members have what they need to make a meaningful impact and are truly valued for who they are and what they contribute.

To learn more about CIBC, please visit CIBC.com

US Technology, Infrastructure & Innovation (US TI&I) enables the continuous transformation of our Bank by accelerating the shift to digital, strengthening operational resilience, simplifying what we do, improving CIBC's speed to market and protecting our Bank's assets.

The teams work to maximize the investment in resources and technology while building an appropriate balance between high-touch client service and our fiduciary responsibility to protect CIBC, our clients, and our shareholders from undue risk.

What You’ll Be Doing

The Lead Data Engineer (Databricks, SQL) will own end-to-end delivery of U.S. Data Strategy capabilities, including ETL, analytics, and data consumption, aligned to a multi-year product roadmap. They will translate business and product objectives into secure, scalable cloud data solutions in partnership with Product, Architecture, Data, and key stakeholders. Continuously improve SDLC throughput via intake/estimation and KPI management, and drive innovation through proofs of concept and continuous modernization. This is a hands-on position.

CIBC we enable the work environment most optimal for you to thrive in your role. You’ll have the flexibility to manage your work activities within a hybrid work arrangement where you’ll spend 2 days per week on-site, while other days may be remote.

How You’ll Succeed

  • Strategic Delivery: Set goals aligned to strategy; translate priorities into roadmaps, metrics, dependencies, and release plans; manage capacity and resourcing. Leverage GitHub Copilot in development best practices.

  • Technical Strategy and Architecture: Define secure, scalable architecture; modernize and reduce technical debt. Drive best practice engineering through automation, testing, CI/CD, observability, and continuous improvement.

  • Industry and Domain Leadership: Apply banking/domain expertise to guide platform direction and improve client and operational outcomes.

  • Risk and Compliance Oversight: Embed risk management and security/privacy by design; ensure regulatory compliance and partner with Compliance/Audit. You oversee risk management activities within their area, influence risk culture, and align risk management with departmental goals. You also Oversee compliance adherence within their area of responsibility; ensure alignment with regulatory requirements; engage with Compliance and Audit teams as needed.

  • Lead by Example: Provide Technical Leadership, be able to develop solutions based on Databricks/Python/PySpark as well as strong SQL Server experience.

Who You Are

  • You possess 8-12 years of related experience OR Combination of education and experience, ideally within financial services or tech.

  • You possess Azure/Databricks data engineering expertise (PySpark/Scala, ETL, Azure SQL, REST APIs). Expertise in data ingestions, data pipeline development, and optimization, reporting, and advanced analytics using Azure and Databricks (Pyspark/Scala) services and/or SQL Server/SSIS is a must.

  • Strong SQL Server development experience (required) and SSIS (desired) along with strong pipeline delivery skills (ingestion, transformation, optimization, reporting/analytics).

  • You bring DevOps/SDLC excellence (CI/CD, environment integrity, security, compliance, release management) along with an exposure to Integration and BI Tools such as Tableau, Cognos or Power BI. Automation mindset to reduce manual processes and improve operational efficiency is desired.

  • Agile delivery mastery (Jira/Azure DevOps, story writing/pointing, velocity management).

  • Executive-level communication for technical recommendations and governance forums.

  • Degree/diploma in Computer Science, Engineering, MIS, or related field or relevant certifications and/or completion of a relevant bootcamp

  • Extensive knowledge of banking products (desired), services, and industry regulations; expert understanding of current industry trends and developments; ability to influence strategic decisions using industry knowledge

California residents — your privacy rights regarding your actual or prospective employment

At CIBC, we offer a competitive total rewards package. This role has an expected salary range of $150,000.00 - $170,000.00 for the Chicago market based on experience, qualifications, and location of the position. The successful candidate may be eligible to participate in the relevant business unit’s incentive compensation plan, which may also include a discretionary bonus component. CIBC offers a full range of benefits and programs to meet our employee’s needs; including Medical, Dental, Vision, Health Savings Account, Life Insurance, Disability, and Other Insurance Plans, Paid Time Off (including Sick Leave, Parental Leave and Vacation), Holidays and 401(k), in addition to other special perks reserved for our team members.”

This position does not offer visa sponsorship.

#LI-TA

What CIBC Offers

At CIBC, your goals are a priority. We start with your strengths and ambitions as an employee and strive to create opportunities to tap into your potential. We aspire to give you a career, rather than just a paycheck.

  • We work to recognize you in meaningful, personalized ways including a competitive salary, incentive pay, banking benefits, a benefits program*, a vacation offering, wellbeing support, and MomentMakers, our social, points-based recognition program.

  • Our spaces and technological toolkit will make it simple to bring together great minds to create innovative solutions that make a difference for our clients.

  • We cultivate a culture where you can express your ambition through initiatives like Purpose Day; a paid day off dedicated for you to use to invest in your growth and development.

*Subject to plan and program terms and conditions

What you need to know

  • CIBC is committed to creating an inclusive environment where all team members and clients feel like they belong. We seek applicants with a wide range of abilities and we provide an accessible candidate experience. If you need accommodation, please contact [email protected]

  • You need to be legally eligible to work at the location(s) specified above and, where applicable, must have a valid work or study permit.

  • We may ask you to complete an attribute-based assessment and other skills tests (such as simulation, coding, MS Office). Our goal for the application process is to get to know more about you, all that you have to offer, and give you the opportunity to learn more about us.

Job Location

IL-70 W Madison St, 8th Fl

Employment Type

Regular

Weekly Hours

40

Skills

Analytical Thinking, Application Development, Applications Programming, Azure API Management, Azure App Service, Azure Blob Storage, Azure Repos, Azure Storage, Databricks Platform, Databricks SQL, Databricks Unity Catalog, Emerging Technologies, Mentoring Staff, Microsoft Azure, Microsoft Azure Databricks, Microsoft Azure Functions, PySpark, Python Software Development, SQL Server Integration Services (SSIS), SSIS Packages, Work Collaboratively

Top Skills

Azure
Cognos
Databricks
Github Copilot
Power BI
Pyspark
Python
SQL
SQL Server
Ssis
Tableau

Similar Jobs

12 Days Ago
Hybrid
Chicago, IL, USA
179K-225K Annually
Senior level
179K-225K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
As a Lead Data Engineer at Capital One, you will design and implement data solutions, optimize data pipelines, and collaborate with Agile teams to enhance data quality and governance.
Top Skills: AWSAws GlueCassandraDatabricksEtl ToolsGenaiLinuxMongodbNoSQLPythonSnowflakeSparkSQLUnix
2 Hours Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
178K-214K Annually
Senior level
178K-214K Annually
Senior level
eCommerce • Healthtech • Kids + Family • Retail • Social Media
As a Senior Product Designer, you'll own user experiences for registry creation and management, balancing usability and emotional design across web and mobile platforms. You'll collaborate with Product and Engineering teams, defining problems, refining journeys, and iterating on design concepts using Figma and feedback from users.
Top Skills: Figma
3 Hours Ago
Hybrid
Chicago, IL, USA
109K-120K Annually
Senior level
109K-120K Annually
Senior level
Agency • Gaming • Marketing Tech • Mobile • Analytics
The Account Manager will support McDonald's Packaging category operations, coordinate delivery of services, ensure effective communication, and manage customer relationships effectively.
Top Skills: Communication SkillsCustomer EngagementProject Management

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account