Lead the architecture, development, governance, reliability, security, and optimization of a Databricks lakehouse platform. Design data models and ingestion pipelines, tune Spark and SQL workloads, establish observability and operational practices, implement CI/CD and testing standards, and mentor engineers. Partner with stakeholders to deliver scalable data capabilities while guiding responsible adoption of AI-assisted development tools and validating their security, correctness, and performance.
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.
As a Lead Software Engineer at JPMorganChase within the Corporate - Employee Platforms, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.
As a Lead Software Engineer at JPMorganChase within the Corporate - Employee Platforms, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.
We use AI-assisted development as part of our day-to-day workflow, including GitHub Copilot for coding and native Databricks tools such as Databricks SQL Assistant and Genie to accelerate development, troubleshooting, and self-service analytics—while maintaining strong engineering controls and review practices.
Job responsibilities
- Platform leadership & architecture — Define and drive the technical roadmap for our Databricks lakehouse/database platform (ingestion, storage, modeling, serving) with clear standards and reference patterns.
- Data modeling & database engineering — Design curated datasets (e.g., medallion architecture) using Delta Lake, dimensional/semantic modeling where appropriate, and enforce consistent naming, partitioning, and performance practices.
- Reliability & operations — Build for availability and predictable performance; establish SLOs, runbooks, alerting, incident response, and operational hygiene for pipelines and SQL workloads.
- Security, governance & access controls — Implement and maintain strong governance (e.g., Unity Catalog), least-privilege access, auditing, data classification, and lifecycle management.
- Performance & cost management — Tune Spark/SQL workloads, optimize clusters/warehouses, manage caching and storage patterns, and implement cost observability/chargeback as needed.
- Engineering excellence — Set standards for code quality, testing, CI/CD, branching strategy, documentation, and review. Establish reusable libraries/templates and enforce consistency across teams.
- Mentorship & collaboration — Coach engineers, lead design reviews, and partner with stakeholders to translate business needs into scalable data platform capabilities.
- Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
- Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
Required qualifications, capabilities, and skills
- 7+ years in data engineering/platform engineering, with hands-on Databricks experience in production environments.
- Strong proficiency in Spark (PySpark/Scala) and SQL, including performance tuning and troubleshooting.
- Proven experience building and operating data platforms: batch/stream ingestion, transformation frameworks, orchestration, and curated data layers.
- Experience with Data Lake, (DataBricks, SnowFlake, or AWS) table design, and optimization (partitioning, Z-ORDER, file sizing).
- Familiarity with Unity Catalog (or equivalent governance tooling): permissions, catalogs/schemas, lineage/auditing concepts.
- Solid software engineering fundamentals: Git, CI/CD, automated testing, code reviews, modular design, and documentation.
- Experience implementing observability (logs/metrics/traces), data quality checks, and monitoring for pipelines and SQL workloads.
- Strong communication skills and demonstrated ability to lead technical decisions across teams.
- Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
- Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices
Preferred qualifications, capabilities, and skills
- Databricks features: Workflows, Delta Live Tables (DLT), Structured Streaming, Databricks SQL Warehouses.
- Transformation frameworks (e.g., dbt) and semantic layer patterns.
- Infrastructure-as-code (e.g., Terraform) and automated environment provisioning.
- Experience with regulated-data environments, privacy controls, and enterprise data governance programs.
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
JPMorganChase Chicago, Illinois, USA Office
Chicago, IL, United States
Similar Jobs
.png)
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Lead product vision, strategy, adoption, roadmap prioritization, user research, metrics, and cross-functional execution for an AI-powered B2B insurance submissions platform. Partner across design, engineering, marketing, customer experience, and operations; manage integrations with adjacent products; resolve dependencies; communicate strategy and outcomes to senior leadership; and mentor other product managers.
Top Skills:
AgileAIApplied EpicConfluenceJIRA
Information Technology • Professional Services • Financial Services
Business Analyst supporting market infrastructure for a global clearing firm. Translates process and product improvements into end-to-end IT solutions, coordinating with developers, risk, operations, commercial teams, exchanges, brokers, and other stakeholders. Responsibilities include managing complex implementations, leading change processes, documenting progress, meeting regulatory and external deadlines, and improving post-trade systems and tooling. The role requires expertise in derivatives and equities post-trade lifecycles, FIX, SQL, and Excel.
Top Skills:
BitbucketConfluenceFix ProtocolGitGoanywhere Managed File TransferJIRAExcelSQL
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead end-to-end NetSuite implementations as a functional consultant and team manager. Manage finance transformation initiatives, NetSuite order-to-cash, purchase-to-pay, and account-to-report workstreams, Advanced Revenue Management and SuiteBilling implementations, customizations, integrations, and testing. Lead onshore and offshore teams, address client needs, communicate complex concepts, and apply accounting and finance expertise to deliver effective technology solutions.
Top Skills:
Erp IntegrationsNetSuiteNetsuite Advanced Revenue ManagementNetsuite Multibook AccountingOracleSuitebilling
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
