Job Description

***Please note that we are unable to provide visa sponsorship now or in the future for this opportunity***

As a Data Engineer, you will design & develop Extract/Transform/Load (ETL) applications that will interface with all key Discover applications. Position requires excellent communication skills for understanding business vision and the ability to translate the vision into technical artifacts. Technical analysis and design background is desirable to ensure that provided solutions are flexible, architecturally sound and reusable for future analytical and operational Data Stores.

Responsibilities

• Develop data driven solutions utilizing current and next generation technologies to meet evolving business needs.
• Ability to quickly identify an opportunity and recommend possible technical solutions.
• Utilize multiple development languages/tools such as AbInitio, SPARK, SQL to build prototypes and evaluate results for effectiveness and feasibility.
• Operationalize open source data-analytic tools for enterprise use.
• Develop real-time data ingestion and stream-analytic solutions leveraging technologies such as Spark and other AWS solutions.
• Custom Data pipeline development (Cloud and locally hosted).
• Work heavily within the Cloud ecosystem.
• Provide support for deployed data applications and analytical models by being a trusted advisor to Data Scientists and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers.
• Provide subject matter expertise in during story grooming.
• Be an active member of an Agile development team.
• Ensure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.

Required Skills

At a minimum, here’s what we need from you:

• Bachelor’s Degree in Engineering, Computer Science, Mathematics or related field, or 2 years of professional development experience
• Experience with Amazon Web Services (AWS) based solutions such as RDS, Lambda, Dynamodb, Snowflake and S3.
• Experience in building & utilizing tools and frameworks within the Big Data ecosystem including AbInitio, Spark, SQL.
• Deep knowledge and very strong in SQL, and Relational Databases
• Willingness to continuously learn & share learnings with others
• Ability to work in a fast-paced, rapidly changing environment
• Very strong verbal & written communication skills

Preferred Qualifications

If we had our say, we’d also look for:

• Experience in migrating ETL processes (not just data) from relational warehouse Databases to AWS based solutions.
• Experience within the Financial industry
• Experience in building & utilizing tools and frameworks within the Big Data ecosystem including Ab Initio, Hadoop, Kafka, Hive, Spark.

***Please note that we are unable to provide visa sponsorship now or in the future for this opportunity***

#LI-KE

Discover Financial Services is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran status, among other things, or as a qualified individual with a disability.