Principal Data Engineer
Discover. A more rewarding way to work.
At Discover Financial Services, you’ll find yourself in the company of some of the industry’s smartest and most reliable professionals. And at a company that rewards dedication, values innovation and supports growth.
Thrive in an environment that promotes teamwork and shared success. Build on a foundation of mutual respect. Join the company that understands rewarding careers like no other, with this exceptional opportunity:
Job Description:
At Discover, be part of a culture where diversity, teamwork and collaboration reign. Join a company that is just as employee-focused as it is on its customers and is consistently awarded for both. We’re all about people, and our employees are why Discover is a great place to work. Be the reason we help millions of consumers build a brighter financial future and achieve yours along the way with a rewarding career.
As a member of Business Technology, Enterprise Software Quality Management team, Principal Data Engineer is responsible for providing technical strategic leadership and subject matter expertise for the overall Test Delivery organization and specifically in Test Data Management.
Responsible for using knowledge to apply a hands-on approach with next generation technologies to contribute to the team that delivers the latest data-driven platforms & next generation analytic technologies.
Responsibilities
- Provides senior-level technical consulting to peer-data engineers during design and development for highly complex and critical data projects.
- Provides engineering leadership to create and enhance data solutions enabling seamless integration and flow of data across the data ecosystem.
- Designs and develops data ingestion frameworks leveraging Open-Source tools such as NiFi, Sqoop, Hive, Java, Pig, Python, as well as data processing/transformation frameworks leveraging Open-Source tools.
- Provides support for deployed data applications and analytical models.
- Designs and develops real-time processing solutions using Open-Source tools.
- Promote a risk-aware culture, ensure efficient and effective risk and compliance management practices by adhering to required standards and processes.
- Lead a team of members and assist building enhanced software capabilities in the area of Test Data Management (TDM), Continuous Integration and tools around it.
- Proven experience developing strategic system architecture plans in the area of expertise.
- Experience conducting technology, trends, standards and products research in the area of expertise
- Define and Maintain Quality Metrics for the Product.
- Acts as the in-house guide on applications, systems and/or processes to internal clients in identifying and resolving, processing/reporting programming problems.
- Build the Performance Strategy and manage the overall execution of the approach.
- Incrementally improve the tools and processes to meet enterprise demands.
- Excellent written and verbal communication skills
- Promote a risk-aware culture, ensure efficient and effective risk and compliance management practices by adhering to required standards and processes.
Skills:
Minimum Qualifications
At a minimum, here’s what we need from you:
- Bachelor’s Degree in Computer Science or related field
- 6+ years of experience in Data Platform Administration/Engineering Minimum
Preferred Qualifications
If we had our say, we’d also look for:
- 10+ year’s work experience in being part of TDM or Quality Architecture for a large organization
- Ability to collaborate with Development and Application Architects to design for testability
- 5+ Years of experience in leveraging Test Data Management Tools like Optim, Informatica or Grid Tools on Sub-setting, Masking & Data Governance capabilities.
- 8+ years of experience in Data Platform Administration / Engineering
- Ability to collaborate with Development and Application Architects to design for testability
- Hands on experience with at least one scripting language (Perl, Groovy, Python)
- Experience on RDBMS databases, Teradata, Oracle, DB2 or MS SQL Server
- Experience on NoSQL databases, MongoDB, Redis, or DataStax
- Knowledge on ETL/ Data warehouse concepts, Data analytics, Big data is an advantage
- Comprehensive understanding of Agile process and methodology
- Scaled Agile Framework Experience
- Experience in using CICD Stack tools like Github, Jenkins, Nexus, Sonarqube and Nexus or equivalent tools
- Experience in IBM Optim
- Experience on Data Generation Tools and technologies
- Ability to design Tools and Utilities leveraging technologies to solve a problem
- Excellent written and verbal communication skills
#LI- BG1
Discover Financial Services is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran status, among other things, or as a qualified individual with a disability.
So, what are you waiting for? Apply today!