Discover
We power a network that helps people achieve a brighter financial future.
Riverwoods, IL
Remote
Hybrid

Lead Data Engineer

Sorry, this job was removed at 6:05 a.m. (CST) on Tuesday, June 29, 2021
Find out who's hiring remotely in Chicago.
See all Remote Data + Analytics jobs in Chicago
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

Discover. A brighter future.

With us, you’ll do meaningful work from Day 1. Our collaborative culture is built on three core behaviors: We Play to Win, We Get Better Every Day & We Succeed Together. And we mean it — we want you to grow and make a difference at one of the world's leading digital banking and payments companies. We value what makes you unique so that you have an opportunity to shine.

Come build your future, while being the reason millions of people find a brighter financial future with Discover.

Job Description  

Discover Commerce Exchange (DCX) is the Gold Standard for enriched merchant data at DFS, and the solution provides detailed merchant data to cardholders as well as internal and external clients. As part of our Discover Commerce Exchange (DCX) team you will:

· Develop data-driven solutions with current and next generation technologies to meet evolving business needs. 

· Provide technical design and develop Extract/Transform/Load (ETL) applications that interface with all key Discover applications. 

· Serve as a technical consultant in understanding business needs, assessing impacts, and providing solution options.

· Act as a Leader, guiding development efforts across the team and ensuring best practices are followed.

 

How You’ll Do It 

· Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks.

· Work extensively within the Cloud ecosystem and migrate data from Teradata to AWS-based platform.

· Deploy and provide support for application codes and analytical models. 

· Provide senior-level technical consulting to peer data engineers during design and development for highly complex and critical data projects. 

· Create and enhance data solutions that enable seamless integration and flow of data across the data ecosystem.

· Provide business analysis and develop ETL code and scripting to meet all technical specifications and business requirements according to the established designs.

· Develop real-time data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, Python and AWS-based solutions.

· Utilize multiple development languages/tools such as Python, SPARK, Hive, Java to build prototypes and evaluate results for effectiveness and feasibility.

· Develop application systems that comply with the standard system development methodology and concepts for design, programming, backup, and recovery to deliver solutions that have superior performance and integrity.

· Contribute to determining programming approach, tools, and techniques that best meet the business requirements.

· Provide subject matter expertise in the analysis, preparation of specifications and plans for the development of data processes.

· Offer system support as part of a support rotation with other team members.

· Operationalize open source data-analytic tools for enterprise use.

· Ensure data governance policies are followed by implementing or validating data lineage, quality checks, and data classification.

· Understand and follow the company development lifecycle to develop, deploy and deliver the solutions.

· Designs and develops data ingestion frameworks leveraging open source tools and data processing frameworks.

· Designs and develops complex and critical data projects.

· Develops, implements, and supports application codes and analytical models.

· Creates and enhances data solutions that enable seamless integration and flow of data across the data ecosystem.

· Designs and develops real time processing solutions

 

Minimum Qualifications

At a minimum, here’s what we need from you:

· Bachelor's degree in Information Technology, or related field

· 4+ years of experience in data platform administration/engineering , or related 

 

Desired Qualifications

If we had our say, we'd also look for:

· 6+ years of experience in data platform administration/engineering

· Knowledge and experience using query languages (SQL, Cypher) for relational and graph databases

· Willingness to continuously learn & share learnings with others

· Capability to collaborate with stakeholders and project leaders to understand requirements, deliverables, and set expectations on tasks that you will be responsible for 

· Ability to work in a fast-paced, rapidly changing environment

· Experience working in an agile and collaborative team environment

· Excellent written and verbal communication, presentation and professional speaking skills 

· Passion for learning and interest in pursuing classroom training and self-discovery on a variety of emerging technologies 

· Hands-on experience with Amazon Web Services (AWS)-based solutions such as Lambda, Dynamodb, Snowflake and S3 

· Experience in migrating ETL processes (not just data) from relational warehouse databases to AWS-based solutions

· Experience within the financial industry 

#Remote

#BI-Remote

#LI-KE

What are you waiting for? Apply today!

The same way we treat our employees is how we treat all applicants – with respect. Discover Financial Services is an equal opportunity employer (EEO is the law). We thrive on diversity & inclusion. You will be treated fairly throughout our recruiting process and without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status in consideration for a career at Discover.

See More
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

What are Discover Perks + Benefits

Discover Benefits Overview

Start enjoying great benefits Day 1 — We support you with the same dedication we bring to all of our customers. Our comprehensive benefits package features first-class insurance, financial planning support and excellent perks designed to help you reach your goals and live a rich, healthy life.

Check out more of our amazing employee benefits at mydiscoverbenefits.com

Culture
Volunteer in local community
Discover’s business is built on helping people, and we invest in the community (Blessing Backpacks, Boys & Girls Clubs, Big Brothers/Sisters) to demonstrate our commitment to a brighter future.
Partners with nonprofits
Open door policy
OKR operational model
Team based strategic planning
Open office floor plan
Flexible work schedule
Remote work program
Diversity
Dedicated diversity and inclusion staff
Mandated unconscious bias training
Diversity manifesto
Diversity employee resource groups
Hiring practices that promote diversity
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
You can open a separate Health Care FSA (HCFSA) and contribute up to $2,650 tax-free from your paycheck to reimburse yourself for eligible out-of-pocket expenses.
Disability insurance
Employees receive Short-Term Disability Insurance at no cost.
Dental insurance
Discover offers two dental plan options — Standard and Premier — both are administered by MetLife.
Vision insurance
Discover offers two vision plan options — Standard and Premier through VSP.
Health insurance
Discover offers a variety of medical plans for you and eligible family members, so that you can choose the benefit plan that suits your needs.
Life insurance
As a Discover employee, you receive Basic Life Insurance of one times your HWEE (up to $500,000) at no cost to you.
Pet insurance
Purchase medical coverage at a discounted rate for your beloved family pet. The more pets you insure, the greater the discount.
Wellness programs
Help balance your work and personal life with a wide variety of free and discounted resource and referral services including family and relationship counseling and financial guidance.
Mental health benefits
Financial & Retirement
401(K)
You may elect to contribute 1% to 30% of your eligible base salary, commissions and bonus on a pre-tax basis, up to IRS limits every year.
401(K) matching
Discover matches up to 6% of the pre-tax contributions you make to the 401(k) Plan.
Employee stock purchase plan
The ESPP provides eligible employees with an opportunity to purchase shares of Discover common stock through payroll deductions at a 5% discount.
Performance bonus
Charitable contribution matching
Child Care & Parental Leave Benefits
Childcare benefits
Generous parental leave
Family medical leave
Adoption Assistance
Discover helps eligible employees and their families with the costs of adoption by reimbursing certain expenses.
Company sponsored family events
Vacation & Time Off Benefits
Generous PTO
Discover has a Paid Time Off of 4 to 5 Weeks of paid time per year.
Paid volunteer time
Paid holidays
Discover provides 7 paid holidays.
Paid sick days
Office Perks
Commuter benefits
When you enroll in the Commuter Benefits Program at WageWorks, you’ll save on taxes on mass-transit passes, parking and other eligible expenses.
Company-sponsored outings
Onsite office parking
Recreational clubs
Relocation assistance
Fitness stipend
Onsite gym
Discover has fitness centers and Weight Watchers® programs at all five major locations.
Professional Development Benefits
Job training & conferences
Tuition reimbursement
Discover provides tuition reimbursement and a full-ride bachelor's degree program for select online degree programs.
Lunch and learns
Promote from within
Mentorship program
Continuing education stipend
Continuing education available during work hours
Online course subscriptions available
Customized development tracks

More Jobs at Discover

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about DiscoverFind similar jobs like this