Lead Data Platform Engineer

| North Suburbs

Job Description

At Discover, be part of a culture where diversity, teamwork and collaboration reign. Join a company that is just as employee-focused as it is on its customers and is consistently awarded for both. We’re all about people, and our employees are why Discover is a great place to work. Be the reason we help millions of consumers build a brighter financial future and achieve yours along the way with a rewarding career.

We are seeking bright, talented and driven engineers to join a team of passionate and innovative technologists. In this role, you will experience hands on engineering and administration experience on Discovers next generation platforms supporting the most critical payments applications for all of Discover network brands.

You will be empowered (yes, empowered) to apply software engineering techniques and discipline to production operations and help us deliver the world’s greatest solutions. You will provide feedback into the architecture and application design for each next generation of Payment Services development. If you are the type of person that loves driving technology problem solving sessions; has a tireless passion to increase the performance, resiliency and availability of IT solutions serving the greatest Customers and Partners in the World.

To be successful (and we know you can be), you will need to have a strong IT understanding with work experience in off- and on-premise cloud based and virtual system infrastructure and peripheral services including network, firewall, and database management. We also need you to understand the application development and quality assurance ends of the spectrum as you will need to interface with that crew as well. During problem escalations you are the driver of the team that finds the root cause, restores functionality, and proposes the long term solution.

Sounds awesome doesn’t it? We think so but we ultimately need you to make this a reality. You will be exposed to the latest technologies in the Industry while helping us create the next generation of Payment Service solutions. It’s all cutting edge and you have the opportunity to be right in the middle of it. If you’re motivated by leading your work vs. following a checklist, enjoy advocating for and driving change as well as inventing features or projects that solve a business challenge. Join our team.

Responsibilities:

  • Contributing member of a high performing engineering and administration team over Critical Hadoop Application clusters.

  • Provide technical expertise to design efficient engineering solutions for next generation platforms which include the following technologies: (Kafka, Storm, Spark, Solr, Zookeeper, NiFi, HBase, HDFS, HIVE, YARN, Ranger, Knox, Ambari and Kerberos)

  • Big Data Cluster platform provisioning-administration

  • Big Data Cluster Resiliency and Performance engineering and administration

  • Big Data Cluster Security Implementations

  • Big Data engineering and administration for high availability, replications and disaster recovery solutions

  • Big Data database engineering and administration

  • Leverage DevOps techniques and practices to include Continuous Integration, Continuous Deployment test build automation working with key application architects and application developers

  • Level 2/3 “go to” team for operational support

  • Develops and leads an Agile team focused on next-generation data and analytic technologies.

  • Provides technical consulting in support of the creation and enhancement of analytical platforms and tools.

  • Provides technical consulting to application development teams during application design and development for highly complex and critical data projects.

  • Partners on a team to deliver data projects, including migration to new data technologies for unstructured, streaming, and high-volume data.

  • Develops and deploys big data applications.

  • Builds and administers large scale data platforms. Integrates next-generation data analytic tools into the big data ecosystem.

  • Responsible for supporting the delivery of data-driven platforms and next-generation analytical technologies.

#LI-MF1

Minimum Qualifications

At a minimum, here’s what we need from you:

  • Bachelor’s Degree in Computer Science, or related field
  • 2+ years of experience in Data Platform Administration, Engineering, or related field
  • In lieu of a degree, 6+ years of experience in Data Platform Administration, Engineering, or related field

Preferred Qualifications

If we had our say, we’d also look for:

  • 4+ years’ experience working with Hadoop Cluster Engineering and Administration
  • A level of hands-on experience working with Kafka, Storm, Spark, Solr, Zookeeper, NiFi, HBase, HDFS, HIVE, YARN, Ranger, Knox, Ambari and Kerberos
  • Experience leveraging DevOps techniques
  • 4+ years of experience in Data Platform Administration, Engineering, or related field

Discover Financial Services is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran status, among other things, or as a qualified individual with a disability.

Read Full Job Description

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • JavaLanguages
    • PythonLanguages
    • ScalaLanguages
    • SqlLanguages
    • Neo4jLanguages
    • RLanguages
    • AngularJSFrameworks
    • HadoopFrameworks
    • SparkFrameworks
    • SpringFrameworks
    • Amazon Web ServicesFrameworks
    • AnsibleFrameworks
    • AWS PortfolioFrameworks
    • BlockchainFrameworks
    • ChefFrameworks
    • CloudFoundryFrameworks
    • DockerFrameworks
    • Google Cloud PlatformFrameworks
    • KubernetesFrameworks
    • Lambda ArchitectureFrameworks
    • OpenAPIFrameworks
    • OpenShiftFrameworks
    • CassandraDatabases
    • HiveDatabases
    • MongoDBDatabases
    • OracleDatabases
    • TeradataDatabases
    • ServerlessDatabases
    • TerraformDatabases
    • Google AnalyticsAnalytics
    • SparkAnalytics
    • H20Analytics
    • Machine Learning Analytics
    • Natural Language Processing Analytics
    • Programmable BotsAnalytics
    • AgileManagement
    • SafeManagement
    • LeanManagement
    • Continuous Delivery Management
    • DevSecOpsManagement
    • Reactive ProgrammingManagement
    • Site Reliability EngineeringManagement
    • SalesforceCRM

Location

Our headquarters is located in the northwest suburbs of Chicago and we also have a downtown Chicago office which is known as the“The 606”.

An Insider's view of Discover

What’s the vibe like in the office?

The cool thing about working at Discover is the wonderful collaborative environment we have and all the smart, talented and fun people we work with every day to continuously work on innovations.

Hiba

AWS Cloud Engineer

What does your typical day look like?

I enjoy working at Discover because I get to work with and collaborate with talented people who are passionate about what they do, and together we get to help others. We work constructively and cross-functionally to provide the best and newest products for our users and provide exceptional support for our customers!

Mandy

Project Manager, Advanced Analytics Platform

How does the company support your career growth?

There are two reasons I enjoy working at Discover. First, I enjoy the challenging and meaningful work. Second, my career path at Discover is mine to shape. My managers have supported me when I wanted to learn more and move within the company.

George

Senior Manager, Software Engineering

What is your vision for the company?

My vision of the company is that we create rewarding experiences in lives of our customers every day through analytics.

Kumar

SVP, CDO Advanced Analytics Platforms

What’s the vibe like in the office?

I love working at Discover because of how the company invests in its people and innovation. The environment is encouraging and the smart people around you makes it an amazing experience every day!

Brent

Director, Digital Analytics

What are Discover Perks + Benefits

Discover Benefits Overview

Start enjoying great benefits Day 1 — We support you with the same dedication we bring to all of our customers.Our comprehensive benefits package features first-class insurance, financial planning support and excellent perks designed to help you reach your goals and live a rich, healthy life.

Check out more of our amazing employee benefits at mydiscoverbenefits.com

Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
You can open a separate Health Care FSA (HCFSA) and contribute up to $2,650 tax-free from your paycheck to reimburse yourself for eligible out-of-pocket expenses.
Disability Insurance
Employees receive Short-Term Disability Insurance at no cost.
Dental Benefits
Discover offers two dental plan options — Standard and Premier — both are administered by MetLife.
Vision Benefits
Discover offers two vision plan options — Standard and Premier through VSP.
Health Insurance Benefits
Discover offers a variety of medical plans for you and eligible family members, so that you can choose the benefit plan that suits your needs.
Life Insurance
As a Discover employee, you receive Basic Life Insurance of one times your HWEE (up to $500,000) at no cost to you.
Pet Insurance
Purchase medical coverage at a discounted rate for your beloved family pet. The more pets you insure, the greater the discount.
Wellness Programs
Help balance your work and personal life with a wide variety of free and discounted resource and referral services including family and relationship counseling and financial guidance.
Onsite Gym
Discover has fitness centers and Weight Watchers® programs at all five major locations.
Retirement & Stock Options Benefits
401(K)
You may elect to contribute 1% to 30% of your eligible base salary, commissions and bonus on a pre-tax basis, up to IRS limits every year.
401(K) Matching
Discover matches up to 6% of the pre-tax contributions you make to the 401(k) Plan.
Employee Stock Purchase Plan
The ESPP provides eligible employees with an opportunity to purchase shares of Discover common stock through payroll deductions at a 5% discount.
Performance Bonus
Child Care & Parental Leave Benefits
Child Care Benefits
Generous Parental Leave
Flexible Work Schedule
Remote Work Program
Family Medical Leave
Adoption Assistance
Discover helps eligible employees and their families with the costs of adoption by reimbursing certain expenses.
Vacation & Time Off Benefits
Generous PTO
Discover has a Paid Time Off of 4 to 5 Weeks of paid time per year.
Paid Volunteer Time
Paid Holidays
Discover provides 7 paid holidays.
Paid Sick Days
Perks & Discounts
Casual Dress
Commuter Benefits
When you enroll in the Commuter Benefits Program at WageWorks, you’ll save on taxes on mass-transit passes, parking and other eligible expenses.
Company Outings
Game Room
Parking
Recreational Clubs
Relocation Assistance
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement
Discover provides tuition reimbursement and a full-ride bachelor's degree program for select online degree programs.
Diversity Program
More Jobs at Discover92 open jobs
All Jobs
Data + Analytics
Dev + Engineer
Operations
Product
Project Mgmt
Project Mgmt
new
North Suburbs
Operations
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Project Mgmt
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
Chicago
Developer
new
North Suburbs
Project Mgmt
new
North Suburbs
Operations
new
North Suburbs
Project Mgmt
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
Chicago
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Project Mgmt
new
North Suburbs
Data + Analytics
new
North Suburbs
Product
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
Chicago
Data + Analytics
new
Chicago
Data + Analytics
new
Chicago
Operations
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Product
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Operations
new
North Suburbs
Product
new
North Suburbs
Operations
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Operations
new
North Suburbs
Developer
new
North Suburbs
Product
new
North Suburbs
Operations
new
North Suburbs
Developer
new
Chicago
Operations
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Operations
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs