Senior Manager, Streaming Data Engineering
Discover. A brighter future.
With Discover, you’ll have the chance to make a difference at one of the world’s leading digital banking and payments companies. From Day 1, you’ll do meaningful work you’re passionate about, with the support and resources you need for success. We value what makes each employee unique and provide a collaborative, team-based culture that gives everyone an opportunity to shine. Be the reason millions of people find a brighter financial future, while building the future you want, here at Discover.
Job Description
We are seeking a technical manager that will lead a new streaming data enablement team within our Advanced Analytics technology organization. You will be responsible for helping to build and curate a team of high performing data engineers and architects that are tasked with building products to support Discover’s new real time data initiatives. Your team’s products will be used across many different data engineering teams enabling them to build data pipelines that support machine learning modeling, BI reporting, and other new innovative use cases.
This is an exciting opportunity to influence our data organization’s roadmaps and bring value with creating new cutting edge platforms and capabilities. You directly will be responsible for helping to drive the streaming data product strategy and implementation.
You will work heavily on AWS based infrastructures and use newer technologies such as containerization. For instance, your team will work in technologies such as Kafka, KSQLDB, Qlik / Attunity Data Replication, Open Shift Container platform, Python, Java, Spark APIs, EMR, MPP Databases (Snowflake & Redshift), NoSQL DBs, and other various AWS services (Lambda, Glue, Step Functions..)
Some of your team’s initial efforts include building out our new real-time streaming based change data capture (CDC) platform, defining frameworks for real-time data pipelines, and API/webhooks data ingestion tooling.
As a Sr. Manager of a new team you will be responsible for recruiting high performing application engineers/architects while also developing and mentoring existing team members. Additionally, you will need to be able to demonstrate the technical aptitude to learn new technologies as you will be working in a rapidly evolving landscape delivering transformative products.
***This role has the opportunity to work 100% remote from home***
Responsibilities
- Deliver on our Advanced Analytics strategy, ranging from implementing open-source and third-party based cloud and automation tools to building integrated solutions that meet enterprise needs
- Build a culture of learning and innovation with the ability to learn new data technologies / practices and spearheading cloud adoption within the organization
- Bring a passion to stay on top of tech trends, experiment with and learn new technologies, participate in technology communities and act as an internal mentor to users of these platforms
- Manages software ownership and development from initial concept through continuous improvement.
- Coaches and mentors team members. Supports individuals to achieve their individual development goals. Utilizes Agile and Lean practices to identify and solve systemic issues.
- Utilizes tools to support data driven decision making. Identifies and removes blockers to enable the team to meet business goals.
- Consults with management in the analysis of short and long range business requirements and recommends innovations.
- Encourage innovation, implementation of cutting edge technologies and align solution to meet our customer needs
- Ability to set technology strategy and vision for the team
- Proven track record of developing junior and experienced engineers/ technicians
- Proficiency with Cloud technologies and concepts (AWS preferred)
- Experience leading transformation from traditional to next-gen data-analytic technology solutions
Skills Required
- Bachelors Degree in Information Technology or related field
- Minimum of 8+ years of work experience in Application Development or related experience
- Minimum of 2+ years of work experience as a people manager
Skills Desired
- Qlik / Attunity Replicate
- Kafka platform (kconnect, ksqldb, etc..)
- Container technology a plus (OpenShift, Kubernetes)
- Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM
- Snowflake MPP database experience a plus
- Graph database experience a plus
- Hands-on experience integrating open source components into data-analytic solutions
- Working with vendors to enhance tool capabilities to meet enterprise needs
- Knowledge of application development lifecycles, & continuous integration/deployment practices
- Proficient in at least one programming language (Python, Java, Scala, Java)
- Experience in version control systems such as Git.
- Experience in ETL / Data application development
- Experience working with Spark Streaming and real-time analytic frameworks
- Willingness to continuously learn & share learnings with others
- Ability to work in a fast-paced, rapidly changing environment
- Very strong verbal & written communication skills
- Experience within the Financial industry
#LI-KE
What are you waiting for? Apply today!
The same way we treat our employees is how we treat all applicants – with respect. Discover Financial Services is an equal opportunity employer (EEO is the law). We thrive on diversity & inclusion. You will be treated fairly throughout our recruiting process and without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status in consideration for a career at Discover.