Senior Hadoop Administrator
Job Description Summary
The IT Operations team at CCC has an open position for a Sr. Hadoop Administrator. In this role, you will help CCC to transform its business analytics to create best-in-industry analytics capabilities. You will design, build and maintain our big data technologies, specifically providing support for our Hadoop environments. You will work closely with product/project teams, information engineers, data scientists as well as other infrastructure support teams.
We look for Engineers who along with having Hadoop Administrative experience also like to learn new tools and technologies in an ever-changing big data landscape.
Job Duties
- Understand CCC's business, business systems, and impacts of infrastructure on business operations
- Install, maintain, upgrade, troubleshoot & support cloud-based Hadoop clusters & related components
- Ensure cloud-based Hadoop clusters are implemented to meet CCC's standards & service level requirements
- Ensure that cloud-based Hadoop clusters will meet operational/disaster recovery requirements
- Provide Hadoop problem solving expertise, identifies and mitigates root cause(s) of issues
- Provide performance tuning for Hadoop cluster environment
- Monitor Hadoop cluster connectivity, file systems and performance
- Manage and analyze Hadoop log files
- Responsible for troubleshooting and development on Hadoop technologies such as HDFS, Hive, Sqoop, Zookeeper, Spark, MapReduce2, YARN, HBase, Tez, Kafka
- Document CCC’s cloud-based Hadoop clusters
- Interact with BI team, developers, operations teams (database, network, etc.) to ensure big data applications are highly available and performant.
- Collaborate with application teams to install operating system, Hadoop updates, patches & version upgrades as required
- Participate in 24x7 on-call support rotation
- Lead and participate in technical incident calls to restore service related to Hadoop environment problems in production environments under time-bound situations
- Evaluate and recommend tools as appropriate
Qualifications
- Bachelor's degree or equivalent experience
- Minimum 5 years information systems experience in a large enterprise systems environment supporting mission-critical systems and applications
- Experience (2+ years) with Hortonworks/Cloudera Hadoop Cluster environments
- Expert level skills in cloud-based Hadoop cluster deployment, maintenance & performance tuning
- Advanced knowledge of Hadoop technologies such as HDFS, Hive, Sqoop, Zookeeper, Spark, MapReduce2, YARN, HBase, Tez, Kafka
- A high degree of demonstrated technical excellence across multiple technologies and computing platform technical specialties
- Experience with creating automated alerts in a production environment
- Knowledge/experience in UNIX admin support skills such as file systems management
- Basic project management and team coordination skills
- Advanced level of performance tuning Spark Cluster/Yarn Cluster is a plus
- Python scripting is a plus.
- Excellent problem-solving skills across multiple disciplines
- Excellent verbal and written communication skills
Why Choose CCC
We promote a healthy work-life balance and offer generous benefit plans and resources designed with employee satisfaction in mind.
What we value is simple - customers, employee commitment, collaboration and clear communication.
We hire people who will embrace the company’s goals and productively contribute in ways that help us serve the customer, innovate, and stay strong.
We make it a priority to keep employees healthy, happy and enriched.
- Healthy - Wellness programs and Perkspot/employee discount program
- Happy – Recognition programs, a confidential employee assistance program, and flexible work arrangements such as staggered start times
- Enriched – Tuition reimbursement, training and learning programs, and leadership development opportunities
Our corporate headquarters is located in downtown Chicago within the historic Merchandise Mart—a certified LEED (Leadership in Energy and Environmental Design) building.
CCC Information Services was ranked #17 in the Top 100 Digital Companies in Chicago in 2017 by Built In Chicago, an online community for digital technology entrepreneurs in Chicago.