Lead Data Platform Engineer
Discover. A more rewarding way to work.At Discover Financial Services, you’ll find yourself in the company of some of the industry’s smartest and most reliable professionals. And at a company that rewards dedication, values innovation and supports growth.Thrive in an environment that promotes teamwork and shared success. Build on a foundation of mutual respect. Join the company that understands rewarding careers like no other, with this exceptional opportunity: Job Description:
Do you want to be on the forefront of the next BIG thing in advancing the analytic technology landscape? Are you driven by the thought of being involved at the ground level of an enterprise wide transformation? Do you enjoy solving complex business problems in a fast paced, collaborative environment?Discover Financial Services is seeking a bright, driven, and talented individual to join a team of passionate and innovative technologists. *** THIS POSITION WILL BE BASED IN OUR HEADQUARTERS IN RIVERWOODS ILLINOIS WITH THE FLEXIBILITY OF WORKING A FEW DAYS A WEEK FROM OUR DOWNTOWN CHICAGO OFFICE *** In this role, you will use your experience and hands on approach with next generation technologies to contribute to a team that delivers the latest streaming & next generation data technologies.Responsibilities:
- Contributing member of a high performing, agile team focused on next generation data & analytic technologies
- Create and enhance analytic platforms & tools that enable state of the art, next generation Big Data capabilities to analytic users and applications
- Engineering and integrating Hadoop modules such as YARN & MapReduce, and related Apache projects such as Hive, Hbase, Pig
- Assist application development teams during application design and development for highly complex and critical data projects
- Code and integrate open source solutions into the data analytic ecosystem
- Develop fast prototype solutions by integrating various open source components
- Operationalization of open source data analytic tools for enterprise use
- Be part of teams delivering all data projects including migration to new data technologies for unstructured, streaming and high volume data
- Building efficient data platform for structured and unstructured data
- Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm and Kafka
- Utilizing programming languages like Java, Spark, Python with an emphasis in tuning, optimization and best practices for application developers
- Provide solutions for data engineers such as NIFI processors and workflows
- Manage NoSQL databases like HBase, Cassandra and MongoDB
- Developing data management and governance tools on an open source framework
- Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of end user capabilities
- Developing data solutions on cloud deployments such as AWS
- Industry experience in Financial Services or other regulated industries
- Hands on experience leading delivery through Agile methodologies
- Management practices by adhering to required standards and processes
- Promote a risk-aware culture, ensure efficient and effective risk and compliance management practices by adhering to require standards and processes.
Skills Required:
- Bachelors Degree
- 5+ years work experience
- 2+ years Linux/Unix including basic commands, shell scripting and solution engineering
- 0-1 years Hadoop administration
- 0-1 years experience with various tools and frameworks that enable capabilities within the data ecosystem (Hadoop, Kafka, NIFI, Hive, YARN, HBase, NoSQL)
Skills Desired:
- Experience developing software solutions to build out capabilities on a Big Data and other Enterprise Data Platforms
- Experience with solving problems and delivering high quality results in a fast paced environment
- Experience with NIFI specifically with developing custom processors and workflows
- Experience managing NOSQL databases such HBASE , Casandra, MongoDB
- Expertise in coding in Python, Hive, R, Spark, Java with emphasis on tuning / optimization
- Experience developing data solutions on AWS
- Experience designing, developing, and implementing ETL and relational database platforms
- Experience working with automated build and continuous integration systems (Chef, Jenkins, Docker)
- Experience managing code on Github
- Experience with data mining, machine learning, statistical modeling tools or underlying algorithms
About Us
Since Discover launched in 1986, weve made a business of redefining the credit card industry for the better. We were first to have no annual fee, first to offer cash rewards, first to provide 24/7 customer service, and we rank #1 in customer loyalty. As a Fortune
500 company, we strive to provide our employees with an environment where they can contribute in a way thats different from other large institutions. If youre looking for a place to make a difference and let your voice shine through, wed love to meet you.
Apply today at discover.com/careers.
Discover Financial Services is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran status, among other things, or as a qualified individual with a disability. Skills:
Building and administering large scale data platforms such as Hadoop data Lake, integrating next-gen data analytic tools into the Big data ecosystem, Expertise in Real-time data technologies such as Spark, Flink, Kafka, NIFILeveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of end user capabilitiesUtilizing Hadoop modules such as YARN & MapReduce, and related Apache projects such as Hive, Hbase, PigUtilizing programming languages like Java, Python and NoSQL databases like CassandraDeveloping and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm and KafkaBe part of teams delivering all data projects including migration to new data technologies for unstructured, streaming and high volume dataProvide senior level technical consulting to application development teams during application design and development for highly complex and critical data projectsProvide senior level technical consulting to create and enhance analytic platforms & tools that enables state of the art, next generation Big Data capabilities to analytic users and applicationsBuild and lead a high-performing, agile team focused on next generation data & analytic technologies We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class.