Oh Snap!
This job is no longer active - but you can still view the details below.

Principal Data Engineer

| North Suburbs

At Discover, be part of a culture where diversity, teamwork and collaboration reign. Join a company that is just as employee-focused as it is on its customers and is consistently awarded for both. We’re all about people, and our employees are why Discover is a great place to work. Be the reason we help millions of consumers build a brighter financial future and achieve yours along the way with a rewarding career.

We’re a direct banking and payment services company built on a legacy of innovation and customer service. Our employees have always played a big part in our success. We support, challenge and inspire employees to continually develop their skills, advance their career and help grow our business.

Discover Financial Services is seeking a Principal Data Engineer to join our Advanced Analytics Data team. Successful candidates will partner with our business partners to understand their data needs, and build data pipelines using cutting edge technologies like Kinesis/Kafka. Additionally you will explore the use of Python, Scala, Spark APIs to enrich data for our data scientists.

The ideal candidate will be passionate about Discover Financial Services data and its mission.

Where you can make an impact:

  • Drive highly visible projects include translating business and technology requirements into our Cloud ETL/ELT architecture.
  • Develop real-time data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, Kinesis, Java, NoSQL DBs, AWS EMR.
  • Collaborate with cross functional teams such as AWS cloud & platform engineering, DBAs and business teams.
  • Provide our highest senior level technical capabilities to architect and implement our data on cloud roadmap.

You are:

  • Highly productive: Ability to deliver with minimal oversight on a day-to-day basis. This role is intended for somebody who is passionate about data and developing solutions to generate data insights.
  • Fierce fast attitude: Must be motivated to work hard in a fast-paced environment with other high caliber engineers
  • Multi-tasking and prioritization expertise: Enjoy balancing numerous different priorities and demands.
  • Learner: Passionate learner who enjoys education through class room training and self-discovery on a variety of emerging technologies
  • Leader: Decision making capabilities while gathering information and demonstrating leadership to management, and junior level staff.

Responsible for using knowledge to apply a hands-on approach with next generation technologies to contribute to the team that delivers the latest data-driven platforms & next generation analytic technologies.

Responsibilities

  • Provides senior-level technical consulting to peer-data engineers during design and development for highly complex and critical data projects.
  • Provides engineering leadership to create and enhance data solutions enabling seamless integration and flow of data across the data ecosystem.
  • Designs and develops data ingestion frameworks leveraging Open-Source tools such as NiFi, Sqoop, Hive, Java, Pig, Python, as well as data processing/transformation frameworks leveraging Open-Source tools.
  • Provides support for deployed data applications and analytical models.
  • Designs and develops real-time processing solutions using Open-Source tools.

Minimum Qualifications

At a minimum, here’s what we need from you:

  • Bachelor’s Degree in Computer Science or related field
  • 6+ years of experience in Data Platform Administration/Engineering

Preferred Qualifications

If we had our say, we’d also look for:

  • 8+ years of experience in Data Platform Administration/Engineering
  • Experience in Agile methodologies
  • Experience with SQL is a must and exposure to Snowflake
  • Proficiency in scripting languages such as Shell/Python/Scala/Java
  • Well versed with Linux/Unix operating system
  • Prior experience with Banking or Financial domain
  • Good understanding of Big Data technology trends, with knowledge of technologies such as Kinesis, Kafka, Spark, Hive, pySpark
  • Experience with one of the ETL tools Abinitio, Informatica or Data Stage
  • Experience with AWS Cloud Services

#LI-KE

Discover Financial Services is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran status, among other things, or as a qualified individual with a disability.

So, what are you waiting for? Apply today!

Read Full Job Description

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • JavaLanguages
    • PythonLanguages
    • ScalaLanguages
    • SqlLanguages
    • Neo4jLanguages
    • RLanguages
    • AngularJSFrameworks
    • HadoopFrameworks
    • SparkFrameworks
    • SpringFrameworks
    • Amazon Web ServicesFrameworks
    • AnsibleFrameworks
    • AWS PortfolioFrameworks
    • BlockchainFrameworks
    • ChefFrameworks
    • CloudFoundryFrameworks
    • DockerFrameworks
    • Google Cloud PlatformFrameworks
    • KubernetesFrameworks
    • Lambda ArchitectureFrameworks
    • OpenAPIFrameworks
    • OpenShiftFrameworks
    • CassandraDatabases
    • HiveDatabases
    • MongoDBDatabases
    • OracleDatabases
    • TeradataDatabases
    • ServerlessDatabases
    • TerraformDatabases
    • Google AnalyticsAnalytics
    • SparkAnalytics
    • H20Analytics
    • Machine Learning Analytics
    • Natural Language Processing Analytics
    • Programmable BotsAnalytics
    • AgileManagement
    • SafeManagement
    • LeanManagement
    • Continuous Delivery Management
    • DevSecOpsManagement
    • Reactive ProgrammingManagement
    • Site Reliability EngineeringManagement
    • SalesforceCRM

Location

Our headquarters is located in the northwest suburbs of Chicago and we also have a downtown Chicago office which is known as the“The 606”.

An Insider's view of Discover

What’s the vibe like in the office?

The cool thing about working at Discover is the wonderful collaborative environment we have and all the smart, talented and fun people we work with every day to continuously work on innovations.

Hiba

AWS Cloud Engineer

What does your typical day look like?

I enjoy working at Discover because I get to work with and collaborate with talented people who are passionate about what they do, and together we get to help others. We work constructively and cross-functionally to provide the best and newest products for our users and provide exceptional support for our customers!

Mandy

Project Manager, Advanced Analytics Platform

How does the company support your career growth?

There are two reasons I enjoy working at Discover. First, I enjoy the challenging and meaningful work. Second, my career path at Discover is mine to shape. My managers have supported me when I wanted to learn more and move within the company.

George

Senior Manager, Software Engineering

What is your vision for the company?

My vision of the company is that we create rewarding experiences in lives of our customers every day through analytics.

Kumar

SVP, CDO Advanced Analytics Platforms

What’s the vibe like in the office?

I love working at Discover because of how the company invests in its people and innovation. The environment is encouraging and the smart people around you makes it an amazing experience every day!

Brent

Director, Digital Analytics

What are Discover Perks + Benefits

Discover Benefits Overview

Start enjoying great benefits Day 1 — We support you with the same dedication we bring to all of our customers.Our comprehensive benefits package features first-class insurance, financial planning support and excellent perks designed to help you reach your goals and live a rich, healthy life.

Check out more of our amazing employee benefits at mydiscoverbenefits.com

Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
You can open a separate Health Care FSA (HCFSA) and contribute up to $2,650 tax-free from your paycheck to reimburse yourself for eligible out-of-pocket expenses.
Disability Insurance
Employees receive Short-Term Disability Insurance at no cost.
Dental Benefits
Discover offers two dental plan options — Standard and Premier — both are administered by MetLife.
Vision Benefits
Discover offers two vision plan options — Standard and Premier through VSP.
Health Insurance Benefits
Discover offers a variety of medical plans for you and eligible family members, so that you can choose the benefit plan that suits your needs.
Life Insurance
As a Discover employee, you receive Basic Life Insurance of one times your HWEE (up to $500,000) at no cost to you.
Pet Insurance
Purchase medical coverage at a discounted rate for your beloved family pet. The more pets you insure, the greater the discount.
Wellness Programs
Help balance your work and personal life with a wide variety of free and discounted resource and referral services including family and relationship counseling and financial guidance.
Onsite Gym
Discover has fitness centers and Weight Watchers® programs at all five major locations.
Retirement & Stock Options Benefits
401(K)
You may elect to contribute 1% to 30% of your eligible base salary, commissions and bonus on a pre-tax basis, up to IRS limits every year.
401(K) Matching
Discover matches up to 6% of the pre-tax contributions you make to the 401(k) Plan.
Employee Stock Purchase Plan
The ESPP provides eligible employees with an opportunity to purchase shares of Discover common stock through payroll deductions at a 5% discount.
Performance Bonus
Child Care & Parental Leave Benefits
Child Care Benefits
Generous Parental Leave
Flexible Work Schedule
Remote Work Program
Family Medical Leave
Adoption Assistance
Discover helps eligible employees and their families with the costs of adoption by reimbursing certain expenses.
Vacation & Time Off Benefits
Generous PTO
Discover has a Paid Time Off of 4 to 5 Weeks of paid time per year.
Paid Volunteer Time
Paid Holidays
Discover provides 7 paid holidays.
Paid Sick Days
Perks & Discounts
Casual Dress
Commuter Benefits
When you enroll in the Commuter Benefits Program at WageWorks, you’ll save on taxes on mass-transit passes, parking and other eligible expenses.
Company Outings
Game Room
Parking
Recreational Clubs
Relocation Assistance
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement
Discover provides tuition reimbursement and a full-ride bachelor's degree program for select online degree programs.
Diversity Program
More Jobs at Discover100 open jobs
All Jobs
Data + Analytics
Design + UX
Dev + Engineer
Marketing
Operations
Product
Project Mgmt
Developer
new
North Suburbs
Design + UX
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Marketing
new
North Suburbs
Data + Analytics
new
North Suburbs
Product
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
Chicago
Developer
new
Chicago
Project Mgmt
new
North Suburbs
Operations
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Project Mgmt
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
Chicago
Developer
new
North Suburbs
Project Mgmt
new
North Suburbs
Operations
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
Chicago
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Project Mgmt
new
North Suburbs
Data + Analytics
new
North Suburbs
Product
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
Chicago
Data + Analytics
new
Chicago
Data + Analytics
new
Chicago
Operations
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Product
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Operations
new
North Suburbs
Product
new
North Suburbs
Operations
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Operations
new
North Suburbs
Developer
new
North Suburbs
Product
new
North Suburbs
Operations
new
North Suburbs
Developer
new
Chicago
Operations
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Operations
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs