Master Data Engineer-IHM
Discover. A more rewarding way to work.At Discover Financial Services, you’ll find yourself in the company of some of the industry’s smartest and most reliable professionals. And at a company that rewards dedication, values innovation and supports growth.Thrive in an environment that promotes teamwork and shared success. Build on a foundation of mutual respect. Join the company that understands rewarding careers like no other, with this exceptional opportunity: Job
Description:
TITLE: Master Data Engineer DUTIES: DFS Corporate Services LLC seeks Master Data Engineer in Riverwoods, IL to support development of next generation data & analytic technologies. Build platforms and deploying cloud based tools and solutions with technologies like AWS, EMR, RDS, and Kinesis. Perform data migration from on premises environments into AWS. Design and implement availability, scalability, and performance plans for the AWS managed service environment. Automate environment configuration and deployment with tools like Chef and Cloud Foundry. Develop distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm, NIFI, and Kafka. Leverage DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, and Build Automation and test Driven Development to enable the rapid delivery of end user capabilities. Utilize programming languages like Java. Assist application development teams during application design and development for highly complex and critical data projects. Support performance tuning and monitor Hadoop clusters in an enterprise production environment. Support custom Data pipeline development (Cloud and locally hosted). Operationalize data management and governance tools on an open source framework. Promote a risk-aware culture, ensure effective risk and compliance management practices by adhering to required standards and processes.
Skills:
REQUIREMENTS : Bachelor’s degree or foreign equivalent in Computer Science, Computer Engineering, Mechanical Engineering or a related field and five (5) years of progressively responsible experience: implementing highly available, scalable, and secure software systems in big data and web applications areas in the financial services domain; utilizing Agile software development methodology; leveraging DevOps techniques including continuous integration, continuous deployment, test automation, build automation, and test driven development to deliver end user capabilities; supporting JVM targeted development using Java/Spring framework; programming in Linux/Unix including shell scripting, basic commands, and solution engineering; utilizing big data ecosystems tools and frameworks including Hadoop, Kafka, Nifi, Hive, Spark, HBase, NoSQL, Zeppelin, Elasticsearch, and Kibana. One (1) year of experience must include performing infrastructure automation using Chef Recipes and Docker containers. QUALIFIED APPLICANTS: Please apply directly through our website www.mydiscovercareer.com for Job ID 44319 by clicking on “Apply Now.” No calls. Equal Opportunity Employer/disability/vet. We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class.