Principal Hadoop Administrator at Epsilon (Chicago, IL)

| Chicago
Sorry, this job was removed at 11:13 a.m. (CST) on Saturday, July 9, 2022
Find out who's hiring in Chicago.
See all Developer + Engineer jobs in Chicago
Apply Now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
Company Description
Job Description
We are currently seeking a talented Principal Hadoop Admin for managing Big data, with DevOps experience on Linux Infrastructure. You will help optimize and integrate new infrastructure via continuous integration methodologies.
What You Will Be Doing:
  • Establish milestones for necessary contributions from departments and develop processes to facilitate their collaboration
  • Support cloud and On-Prem servers including security configurations, patching, and troubleshooting.
  • Develop scripts for automating client/server functions
  • Monitor automated systems recovery solutions
  • Assist other scrum team engineers in creating practical demonstrations of proposed solutions and demonstrating them to other members of the team
  • Provide detailed specifications for proposed solutions including materials, manpower and time necessary
  • Provide clear goals for all areas of a project and develop steps to oversee their timely execution
  • Work closely with engineering professionals within the company to maintain hardware and software needed for projects to be completed efficiently
  • Mentor and train other engineers throughout the company and seek to continually improve processes companywide
  • Work alongside project management teams to successfully monitor progress and implementation of initiatives
  • Responsible for implementation and ongoing administration of Hadoop infrastructure
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
  • Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, HBase and Yarn access for the new users
  • Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Enterprise, etc.
  • Performance tuning of Hadoop clusters and Spark routines
  • Screen Hadoop cluster job performances and capacity planning
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files
  • File system management and monitoring
  • HDFS support and maintenance
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
  • Collaborating with application teams to perform Hadoop updates, patches, version upgrades when required
  • Work with Vendor support teams on support tasks
  • General operational expertise such as good troubleshooting skills, understanding of system's capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
  • The most essential requirements are: They should be able to deploy Hadoop cluster, monitor critical parts of the cluster, and troubleshoot failures
  • Solid Understanding on premise and Cloud network architectures
  • Additional Hadoop skills like Sentry, Spark, Kafka, Oozie, etc

Preferred Skills
  • Kerberos administration skills
  • Experience with Cloudera or Hortonworks distribution
  • Familiarity with DevOps tools like Ansible, Fabric, Shell/Python scripting
  • 5 years hand-on experience on Cloud platforms - AWS or Azure
  • Experience in large project implementation using: AWS EC2, ELB, S3, IAM, ECS etc.
  • Experience developing engineering applications for a large corporation
  • Demonstrated project development and leadership skills
  • Current understanding of best practices regarding system security measures
  • Experience working together with teams from several departments to facilitate the orderly execution of a proposed project plan
  • Professional experience and a high-level understanding of working with various operating systems and their implications
  • Knowledge of Troubleshooting Core Java Applications is a plus
  • Proven track record in incorporating latest operational tools into big data platforms
  • Kubernetes working knowledge

What You Need for this Position
  • Bachelor's in Computer Science or related discipline preferred
  • 10+ years of Linux system administration
  • 10+ years of Hadoop infrastructure administration

Qualifications
Additional Information
When you're one of us, you get to run with the best. For decades, we've been helping marketers from the world's top brands personalize experiences for millions of people with our cutting-edge technology, solutions and services. Epsilon's best-in-class identity gives brands a clear, privacy-safe view of their customers, which they can use across our suite of digital media, messaging and loyalty solutions. We process 400+ billion consumer actions each day and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Positioned at the core of Publicis Groupe, Epsilon is a global company with more than 8,000 employees around the world. Check out a few of these resources to learn more about what makes Epsilon so EPIC:
  • Culture: https://www.epsilon.com/us/about-us/our-culture-epsilon
  • DE&I: https://www.epsilon.com/us/about-us/diversity-equity-inclusion
  • CSR: https://www.epsilon.com/us/about-us/corporate-social-responsibility
  • Life at Epsilon: https://www.epsilon.com/us/about-us/epic-blog

Great People Deserve Great Benefits
We know that we have some of the brightest and most talented associates in the world, and we believe in rewarding them accordingly. If you work here, expect competitive pay, comprehensive health coverage, and endless opportunities to advance your career.
Epsilon is an Equal Opportunity Employer. Epsilon's policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories.
Epsilon will provide accommodations to applicants needing accommodations to complete the application process.
REF126732J
#LI-AM1
Read Full Job Description
Apply Now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Technology we use

  • Engineering
    • C#Languages
    • C++Languages
    • JavaLanguages
    • JavascriptLanguages
    • PerlLanguages
    • PHPLanguages
    • PythonLanguages
    • RLanguages
    • ScalaLanguages
    • SqlLanguages
    • MapRLanguages
    • D3JSLibraries
    • jQueryLibraries
    • ReactLibraries
    • Juptyer NotebookLibraries
    • AngularJSFrameworks
    • Backbone.jsFrameworks
    • CakePHPFrameworks
    • Ember.jsFrameworks
    • HadoopFrameworks
    • LaravelFrameworks
    • Node.jsFrameworks
    • SparkFrameworks
    • TensorFlowFrameworks
    • HbaseFrameworks
    • Kafka Frameworks
    • StormFrameworks
    • GreenplumDatabases
    • NoSQLDatabases

Location

35 W Wacker Dr, Chicago, IL 60601

An Insider's view of Epsilon

What's something quirky about your company?

We have a company band, made up of anywhere from 30 to 40 employees at a given time. The band has a large following and performs at charity events around Chicago. They also perform a full set at Epsilon’s holiday party each year at the House of Blues. My jaw hit the floor when I saw my peers up on stage rocking out.

Paul

Senior Automation & Infrastructure Engineer

How do you collaborate with other teams in the company?

We collaborate through storytelling. It’s not ‘how’ we build it, but rather ‘why’ we build it. We need to tell stakeholders a story about a consumer pain point, solving it in a differentiated manner and the larger vision. Then, collaboration occurs as we incorporate feedback and have a motivated team building towards a shared vision.

Matt

VP, Product Management:

How would you describe the company’s work-life balance?

Epsilon has a very good work-life balance, including flexible time off. As a young adult, traveling around the world is one my top priorities and working with a company that aligns with that is a huge plus. I have had the flexibility to visit 7 countries. That flexibility is one of many things that has kept me at Epsilon for over 7 years.

Alba

Manager, Engineering

What are Epsilon Perks + Benefits

Epsilon Benefits Overview

At Epsilon, we offer benefits and perks that enable our associates to thrive and foster a culture of innovation.

Culture
Volunteer in local community
Epsilon participates in local community activities such as the Greater Chicago Food Depository, Off the Street Club, Chicago Cares Serve-A-Thon, Habitat for Humanity and Ronald McDonald House.
Partners with Nonprofits
Friends outside of work
Eat lunch together
Intracompany committees
Epsilon has a Social Committee that organizes social, charitable and sports activities.
Daily sync
Open door policy
Group brainstorming sessions
Open office floor plan
Diversity
Dedicated Diversity/Inclusion Staff
Unconscious bias training
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Wellness Programs
Onsite Gym
Team workouts
Epsilon team fitness initiatives include intramural softball, volleyball and soccer.
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Performance Bonus
Match charitable contributions
Child Care & Parental Leave Benefits
Child Care Benefits
Epsilon provides back-up care benefits.
Flexible Work Schedule
What matters is what you achieve, not how many hours you clock. So take time off to enjoy your family and friends when you need it.
Remote Work Program
Family Medical Leave
Adoption Assistance
Vacation & Time Off Benefits
Unlimited Vacation Policy
Generous PTO
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Beer on Tap
Casual Dress
Commuter Benefits
Company Outings
Epsilon hosts an annual summer boat party on Lake Michigan and a holiday party at the House of Blues, where our employee-run band performs the live entertainment all night.
Game Room
Happy Hours
Happy hours are hosted at team's discretion.
Parking
Recreational Clubs
Fitness Subsidies
Professional Development Benefits
Job Training & Conferences
Epsilon offers employees professional development opportunities like on-site training courses and the ability to attend job-related conferences and seminars.
Tuition Reimbursement
Lunch and learns
Epsilon hosts lunch and learn meetings on occasion.
Promote from within
Mentorship program
Our mentorship program includes 1-to-1 program and career mentoring.
Time allotted for learning
Epsilon encourages employees to complete 48 hours of professional development training per year.
Online course subscriptions available

More Jobs at Epsilon

Apply Now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
Save jobView Epsilon's full profileSee more Epsilon jobs