Lead Data Platform Engineer

| Chicago

Job Description

 

Do you want to be on the forefront of the next BIG thing in advancing the analytic technology landscape? Are you driven by the thought of being involved at the ground level of an enterprise wide transformation? Do you enjoy solving complex business problems in a fast paced, collaborative environment?

Discover Financial Services is seeking a bright, driven, and talented individual to join a team of passionate and innovative technologists.

*** THIS POSITION WILL BE BASED IN OUR HEADQUARTERS IN RIVERWOODS ILLINOIS WITH THE FLEXIBILITY OF WORKING A FEW DAYS A WEEK FROM OUR DOWNTOWN CHICAGO OFFICE ***

In this role, you will use your experience and hands on approach with next generation technologies to contribute to a team that delivers the latest streaming & next generation data technologies.

 

Responsibilities:

  • Contributing member of a high performing, agile team focused on next generation data & analytic technologies.
  • Create and enhance analytic platforms & tools that enable state of the art, next generation Big Data capabilities to analytic users and applications.
  • Assist application development teams during application design and development for highly complex and critical data projects.
  • Code and integrate open source solutions into the data analytic ecosystem.
  • Develop fast prototype solutions by integrating various open source components.
  • Operationalization of open source data analytic tools for enterprise use.
  • Be part of teams delivering all data projects including migration to new data technologies for unstructured, streaming and high volume data.
  • Building efficient data platform for structured and unstructured data.
  • Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm and Kafka
  • Utilizing programming languages like Java, Spark, Python with an emphasis in tuning, optimization and best practices for application developers
  • Provide solutions for data engineers such as NIFI processors and workflows
  • Developing data management and governance tools on an open source framework
  • Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of end user capabilities
  • Developing data solutions on cloud deployments such as AWS
  • Industry experience in Financial Services or other regulated industries
  • Hands on experience leading delivery through Agile methodologies
  • Management practices by adhering to required standards and processes

 

Minimum Qualifications

At a minimum, here’s what we need from you:

  • Bachelor’s Degree in Computer Science, or related field
  • 5+ years of experience in Data Platform Administration, Engineering, or related field
  • In lieu of a degree, 6+ years of experience in Data Platform Administration, Engineering, or related field

 

 

 

Preferred Qualifications

If we had our say, we’d also look for:

  • 1+ years Hadoop administration
  • 1+ years experience with various tools and frameworks that enable capabilities within the data ecosystem (Hadoop, Kafka, NIFI, Hive, YARN, HBase, NoSQL)
  • Experience developing software solutions to build out capabilities on a Big Data and other Enterprise Data Platforms
  • Experience with solving problems and delivering high quality results in a fast paced environment
  • Experience with NIFI specifically with developing custom processors and workflows
  • Experience managing NOSQL databases such HBASE , Casandra, MongoDB
  • Expertise in coding in Python, Hive, R, Spark, Java with emphasis on tuning / optimization
  • Experience developing data solutions on AWS
  • Experience designing, developing, and implementing ETL and relational database platforms
  • Experience working with automated build and continuous integration systems (Chef, Jenkins, Docker)
  • Experience managing code on Github
  • Experience with data mining, machine learning, statistical modeling tools or underlying algorithms

#LI-KE

 

 

The same way we treat our employees is how we treat all applicants – with respect. Discover Financial Services is an equal opportunity employer (EEO is the law). We thrive on diversity & inclusion. You will be treated fairly throughout our recruiting process and without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status in consideration for a career at Discover.

Read Full Job Description

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • JavaLanguages
    • PythonLanguages
    • ScalaLanguages
    • SqlLanguages
    • Neo4jLanguages
    • RLanguages
    • AngularJSFrameworks
    • HadoopFrameworks
    • SparkFrameworks
    • SpringFrameworks
    • Amazon Web ServicesFrameworks
    • AnsibleFrameworks
    • AWS PortfolioFrameworks
    • BlockchainFrameworks
    • ChefFrameworks
    • CloudFoundryFrameworks
    • DockerFrameworks
    • Google Cloud PlatformFrameworks
    • KubernetesFrameworks
    • Lambda ArchitectureFrameworks
    • OpenAPIFrameworks
    • OpenShiftFrameworks
    • CassandraDatabases
    • HiveDatabases
    • MongoDBDatabases
    • OracleDatabases
    • TeradataDatabases
    • ServerlessDatabases
    • TerraformDatabases
    • Google AnalyticsAnalytics
    • SparkAnalytics
    • H20Analytics
    • Machine Learning Analytics
    • Natural Language Processing Analytics
    • Programmable BotsAnalytics
    • AgileManagement
    • SafeManagement
    • LeanManagement
    • Continuous Delivery Management
    • DevSecOpsManagement
    • Reactive ProgrammingManagement
    • Site Reliability EngineeringManagement
    • SalesforceCRM

Location

Our headquarters is located in the northwest suburbs of Chicago and we also have a downtown Chicago office which is known as the“The 606”.

An Insider's view of Discover

What’s the vibe like in the office?

The cool thing about working at Discover is the wonderful collaborative environment we have and all the smart, talented and fun people we work with every day to continuously work on innovations.

Hiba

AWS Cloud Engineer

What does your typical day look like?

I enjoy working at Discover because I get to work with and collaborate with talented people who are passionate about what they do, and together we get to help others. We work constructively and cross-functionally to provide the best and newest products for our users and provide exceptional support for our customers!

Mandy

Project Manager, Advanced Analytics Platform

How does the company support your career growth?

There are two reasons I enjoy working at Discover. First, I enjoy the challenging and meaningful work. Second, my career path at Discover is mine to shape. My managers have supported me when I wanted to learn more and move within the company.

George

Senior Manager, Software Engineering

What is your vision for the company?

My vision of the company is that we create rewarding experiences in lives of our customers every day through analytics.

Kumar

SVP, CDO Advanced Analytics Platforms

What’s the vibe like in the office?

I love working at Discover because of how the company invests in its people and innovation. The environment is encouraging and the smart people around you makes it an amazing experience every day!

Brent

Director, Digital Analytics

What are Discover Perks + Benefits

Discover Benefits Overview

Start enjoying great benefits Day 1 — We support you with the same dedication we bring to all of our customers.Our comprehensive benefits package features first-class insurance, financial planning support and excellent perks designed to help you reach your goals and live a rich, healthy life.

Check out more of our amazing employee benefits at mydiscoverbenefits.com

Culture
Volunteer in local community
Discover’s business is built on helping people, and we invest in the community (Blessing Backpacks, Boys & Girls Clubs, Big Brothers/Sisters) to demonstrate our commitment to a brighter future.
Partners with Nonprofits
Friends outside of work
Intracompany committees
Open door policy
Team owned deliverables
Group brainstorming sessions
Open office floor plan
Diversity
Dedicated Diversity/Inclusion Staff
Unconscious bias training
Someone's primary function is managing the company's diversity and inclusion initiatives
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
You can open a separate Health Care FSA (HCFSA) and contribute up to $2,650 tax-free from your paycheck to reimburse yourself for eligible out-of-pocket expenses.
Disability Insurance
Employees receive Short-Term Disability Insurance at no cost.
Dental Benefits
Discover offers two dental plan options — Standard and Premier — both are administered by MetLife.
Vision Benefits
Discover offers two vision plan options — Standard and Premier through VSP.
Health Insurance Benefits
Discover offers a variety of medical plans for you and eligible family members, so that you can choose the benefit plan that suits your needs.
Life Insurance
As a Discover employee, you receive Basic Life Insurance of one times your HWEE (up to $500,000) at no cost to you.
Pet Insurance
Purchase medical coverage at a discounted rate for your beloved family pet. The more pets you insure, the greater the discount.
Wellness Programs
Help balance your work and personal life with a wide variety of free and discounted resource and referral services including family and relationship counseling and financial guidance.
Onsite Gym
Discover has fitness centers and Weight Watchers® programs at all five major locations.
Retirement & Stock Options Benefits
401(K)
You may elect to contribute 1% to 30% of your eligible base salary, commissions and bonus on a pre-tax basis, up to IRS limits every year.
401(K) Matching
Discover matches up to 6% of the pre-tax contributions you make to the 401(k) Plan.
Employee Stock Purchase Plan
The ESPP provides eligible employees with an opportunity to purchase shares of Discover common stock through payroll deductions at a 5% discount.
Performance Bonus
Child Care & Parental Leave Benefits
Child Care Benefits
Generous Parental Leave
Flexible Work Schedule
Remote Work Program
Family Medical Leave
Adoption Assistance
Discover helps eligible employees and their families with the costs of adoption by reimbursing certain expenses.
Vacation & Time Off Benefits
Generous PTO
Discover has a Paid Time Off of 4 to 5 Weeks of paid time per year.
Paid Volunteer Time
Paid Holidays
Discover provides 7 paid holidays.
Paid Sick Days
Perks & Discounts
Casual Dress
Commuter Benefits
When you enroll in the Commuter Benefits Program at WageWorks, you’ll save on taxes on mass-transit passes, parking and other eligible expenses.
Company Outings
Game Room
Parking
Recreational Clubs
Relocation Assistance
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement
Discover provides tuition reimbursement and a full-ride bachelor's degree program for select online degree programs.
Diversity Program
Promote from within
Online course subscriptions available
More Jobs at Discover72 open jobs
All Jobs
Data + Analytics
Dev + Engineer
Marketing
Operations
Product
Project Mgmt
Data + Analytics
new
North Suburbs
Project Mgmt
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Product
new
North Suburbs
Data + Analytics
new
Chicago
Operations
new
North Suburbs
Developer
new
Chicago
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Project Mgmt
new
North Suburbs
Data + Analytics
new
North Suburbs
Project Mgmt
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Marketing
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
Chicago
Developer
new
North Suburbs
Operations
new
North Suburbs
Operations
new
North Suburbs
Developer
new
North Suburbs
Operations
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Product
new
North Suburbs
Operations
new
Chicago
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Project Mgmt
new
Chicago
Developer
new
North Suburbs
Project Mgmt
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
Chicago
Developer
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
Chicago
Data + Analytics
new
Chicago
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Operations
new
North Suburbs
Data + Analytics
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs
Developer
new
North Suburbs