Lead Data Engineer
Discover. A brighter future.
With us, you’ll do meaningful work from Day 1. Our collaborative culture is built on three core behaviors: We Play to Win, We Get Better Every Day & We Succeed Together. And we mean it — we want you to grow and make a difference at one of the world's leading digital banking and payments companies. We value what makes you unique so that you have an opportunity to shine.
Come build your future, while being the reason millions of people find a brighter financial future with Discover.
Job Description
Discover Financial Services is seeking a Lead Data Engineer to join our Enterprise Technology organization. Successful candidates will partner with our business partners to understand their reporting & data needs, design and help the team build pipelines using Next-Gen tools & new capabilities. Additionally you will be responsible to achieve operational excellence and efficient ways to manage projects and production support. The ideal candidate will be passionate about Discover Financial Service’s data and its mission.
What You’ll Do
- Provide engineering leadership to create and enhance data solutions enabling seamless integration and flow of data across the data ecosystem.
- Design and develop data ingestion frameworks leveraging Open-Source tools such as NiFi, Kafka, Java, Pig, Spark, Python, as well as data processing/transformation frameworks leveraging Open-Source tools.
- Build micro services based designs & solutions within the ETL data pipeline on Container Platforms (e.g Kubernetes & Open Shift)
- Create POC's of new ideas, scale them into Generic Patterns, and able to drive the team with technology thought leadership, bring in new ideas and bringing the engineering culture.
- Provide support for deployed data applications and analytical models.
How You’ll Do It
- Develop and maintain complex front-ends focused on user experience.
- Develop and maintain back-end systems.
- Work with key stakeholders to design complex solutions and lead from inception to production.
- Create and maintain DevOps processes, application infrastructure, and utilize cloud services (including database systems and models).
- Innovate on and advocate for best practices and improved team processes.
- Mentor junior team members.
- Support live systems to ensure business continuity.
- Designs and develops data ingestion frameworks leveraging open source tools and data processing frameworks.
- Designs and develops complex and critical data projects.
- Develops, implements, and supports application codes and analytical models.
- Creates and enhances data solutions that enable seamless integration and flow of data across the data ecosystem.
- Designs and develops real time processing solutions.
Qualifications You’ll Need
The Basics
- Bachelor’s degree in information technology or related field
- 6+ years of experience in data platform administration/engineering or related field
- In lieu of degree, 8+ years of experience in data platform administration/engineering or related field
Bonus Points If You Have
- Well versed with AWS, Cloud Platforms and experience on hybrid cloud data strategy solutions along with experience working with / in Data Warehouse teams that solve big data problems and challenges.
- Working or conceptual knowledge of Ab Initio / ETL technologies, MPP Databases, Stream Data Platforms with knowledge on Qlik Replicate, Kafka, K-SQL
- AWS / Cloud / Data Warehouse Certification a big plus
- Self-starter, Engineering Mindset, Innovator & Individual Contributor, Bring ideas to whiteboard and adopt with an agile mindset.
- Bonus, if the candidates are experienced with Customers, Contact Preferences, Marketing and Financial domains.
#Remote
#BI-Remote
#LI-KE
What are you waiting for? Apply today!
The same way we treat our employees is how we treat all applicants – with respect. Discover Financial Services is an equal opportunity employer (EEO is the law). We thrive on diversity & inclusion. You will be treated fairly throughout our recruiting process and without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status in consideration for a career at Discover.