Principal Data Engineer-IHM
TITLE: Principal Data Engineer
DUTIES: DFS Corporate Services LLC seeks Principal Data Engineer in Riverwoods, IL to participate in projects including translating business and technology requirements into ETL/ELT architecture. Develop data ingestion and analytic solutions. Provide technical capabilities to architect and implement big data roadmap. Utilize multiple development languages and tools to build prototypes and evaluate results for effectiveness and feasibility. Work with the Enterprise Decision and Data Management department’s developer community to support technical initiatives and provide input into best practices. Build high quality software for large scale and highly available systems. Utilizing open source data-analytic tools for enterprise use. Provide subject matter expertise in the analysis, preparation of specifications and plans for the development of data processes. Ensure proper data governance policies are followed by architecting and building data lineage, quality checks, data classification systems and frameworks. Promote a risk-aware culture, ensure efficient and effective risk and compliance management practices by adhering to required standards and processes.
REQUIREMENTS: Bachelor’s degree or foreign equivalent in Computer Science, Information Technology or a related field and six (6) years of progressively responsible experience in job offered or related position: providing support for deployed data applications and analytical models; migrating data from Teradata; utilizing tools including Python, SQL, and Java; and utilizing ETL tools including DataStage or Ab Initio. One (1) year of experience must include utilizing cloud technologies including AWS or Azure; creating data pipelines on Hadoop; and utilizing technologies including Spark, Scala, HBase and Hive.
The same way we treat our employees is how we treat all applicants – with respect. Discover Financial Services is an equal opportunity employer (EEO is the law). We thrive on diversity & inclusion. You will be treated fairly throughout our recruiting process and without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status in consideration for a career at Discover.