Principal Data Engineer-IHM
Job Description
THIS NOTICE IS POSTED IN CONNECTION WITH AN APPLICATION FOR PERMANENT ALIEN LABOR CERTIFICATION. ANY PERSON MAY COMMENT OR PROVIDE DOCUMENTARY EVIDENCE BEARING ON THIS APPLICATION TO: CERTIFYING OFFICER, U.S. DEPARTMENT OF LABOR EMPLOYMENT & TRAINING ADMINISTRATION, ATLANTA NATIONAL PROCESSING CENTER, HARRIS TOWER, 233 PEACHTREE STREET, NE, SUITE 410, ATLANTA, GA 30303
DUTIES: DFS Corporate Services LLC seeks Principal Data Engineer in Riverwoods, IL to develop data driven solutions utilizing current and next generation technologies to meet evolving business needs. Ability to quickly identify an opportunity and recommend possible technical solutions. Operationalize open source data-analytic tools for enterprise use. Participate in custom data pipeline development including Cloud and locally hosted. Provide support for deployed data applications and analytical models by working with data scientists and data consumers to identify data problems and guide issue resolution. Provide subject matter expertise in the analysis, preparation of specifications and plans for the development of data processes. Ensure proper data governance policies are followed by implementing or validating data lineage, quality checks and classification. Promote a risk-aware culture, ensure efficient and effective risk and compliance management practices by adhering to required standards and processes.
REQUIREMENTS: Bachelor’s degree or foreign equivalent in Electrical Engineering, Computer Science or a related field and six (6) years of progressively responsible experience in job offered or related position: utilizing development languages and tools including Python, SPARK, HBase, Hive, Microsoft R and Java to build prototypes; developing data ingestion and stream-analytic solutions using technologies including Kafka, Apache Spark, NIFI, Python, HBase and Hadoop; participating within a Hadoop ecosystem; and performing continuous integration and deployment using Jenkins. In the alternative, the employer will accept a Master’s degree and four (4) years of experience in the above listed skills.
Discover Financial Services is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran status, among other things, or as a qualified individual with a disability.