Principal Data Engineer - IHM
Discover. A brighter future.
With Discover, you’ll have the chance to make a difference at one of the world’s leading digital banking and payments companies. From Day 1, you’ll do meaningful work you’re passionate about, with the support and resources you need for success. We value what makes each employee unique and provide a collaborative, team-based culture that gives everyone an opportunity to shine. Be the reason millions of people find a brighter financial future, while building the future you want, here at Discover.
Job Description
TITLE: Principal Data Engineer
DUTIES: DFS Corporate Services LLC seeks Principal Data Engineer in Riverwoods, IL to develop data driven solutions utilizing current and next generation technologies to meet evolving business needs. Identifies opportunities and recommends possible technical solutions. Works extensively with AWS ecosystem using AWS services as well as Hadoop ecosystems to migrate data from Teradata to Hadoop. Operationalize open source data-analytic tools for enterprise use. Develops real time data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, NIFI, Python, HBase Kinesis and EMR. Supports custom Data pipeline development. Provides support for deployed data application and analytical models by being a trusted advisor to Data Scientists and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers. Provide subject matter expertise in the analysis, preparation of specifications and plans for development of data processes. Ensures proper data governance policies are followed by implementing or validating Data Lineage, Quality Checks and Classification. Promote a risk-aware culture, ensure efficient and effective risk and compliance management practices by adhering to required standards and processes.
REQUIREMENTS: Bachelor’s degree or foreign equivalent in Electrical Engineering, Electronic Engineering, Database Administrations, Information Technology or a related field and eight (8) years of progressively responsible experience in job offered or related position: designing and developing ETL jobs to load business related data into the Enterprise Data Warehouse; developing data ingestion and stream-analytic solutions; supporting custom data pipeline developments; participating within a Hadoop ecosystem and migrating data from Teradata to Hadoop; utilizing development language and technologies including ETL tools such as Microsoft R, Java and Ab Initio to build prototypes. Five (5) years of experience must include using technologies including C++, Kafka, Apache Spark, NIFI, Python, Hive, HBase Kinesis and EMR.
What are you waiting for? Apply today!
The same way we treat our employees is how we treat all applicants – with respect. Discover Financial Services is an equal opportunity employer (EEO is the law). We thrive on diversity & inclusion. You will be treated fairly throughout our recruiting process and without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status in consideration for a career at Discover.