Kafka Administrator

| Chicago

Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer and more useful for everyone.

At the heart of that mission are the people that work here—the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real problems and put your talents towards transforming transportation.

That’s because at Arity, we believe work and life shouldn’t be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don’t just want you to see yourself here. We want you to be yourself here.

 

 

The Engineering Team

 

Our engineers are fueled by a passion to impact the future of mobility. They push the boundaries of telematics and transportation tech by creating and supporting cutting-edge products. As part of an Agile team, they are armed with the freedom to innovate and the opportunity to see projects through from start to finish. Using a variety of languages and a top-notch technology stack, our engineers make critical advances in areas like sensor technology, enterprise engineering and platform development. Our team understands what it means to collaborate and communicate in an interconnected global team, all while having trust, transparency and empathy for the end user. Which is pretty cool, if you ask us.

 

 

 

The Role

 

As a Kafka Administrator, you will be responsible for assisting with the design, architecture, implementation, and on-going support of Arity’s Kafka clusters on AWS.

Responsibilities

  • Manage large scale multi-nodes Kafka cluster environments residing on AWS.
  • Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
  • Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster.
  • Creation of key performance metrics, measuring the utilization, performance and overall health of the cluster.
  • Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
  • Research and recommend innovative, and where possible, automated approaches for system administration tasks.
  • Ability to closely calibrate with product managers and lead engineers.
  • Provide guidance in the creation and modification of standards and procedures.
  • Proactively monitor and setup alerting mechanism for Kafka Cluster and supporting hardware to ensure system health and maximum availability.
  • Proven ability to lead multiple high priorities initiative with aggressive timelines leveraging an agile framework.
  • Comfortable performing in a fast paced, dynamic and ambiguous business environment.
  • Ability to concentrate on a wide range of loosely defined complex situations, which require creativity and originality, where guidance and counsel may be unavailable.
  • Demonstrated a product mindset with an ability to set forward thinking and direction.

 

 

 

Qualifications

 

  • 1+ years of solid Kafka Admin experience in managing critical 24/7 applications
  • Design, build, assemble, and configure application or technical architecture components using business requirements.
  • Hands-on experience with Kafka clusters hosted on Amazon cloud is a plus.
  • Experience in Kafka build pipelines using Ansible, Cloud formation templates, shells etc.
  • Exposure to Hortonworks HDP and HDF is a big plus
  • Exposure to Ni-Fi, Flink is a big plus
  • Experience in Jenkins, GitHub
  • Experience in implementing security & authorization (permission based) on Kafka cluster.
  • Experience in open source Kafka, zookeepers, Kafka connect, schema registry Avro schemas.
  • High availability cluster setup, maintenance and ongoing support
  • Create topics, setup redundancy cluster, deploy monitoring tools, alerts Has good knowledge of best practices
  • Exposure to Kafka APIs
  • Hands on experience in standing up and administrating Kafka platform which includes creating a backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, h/w sizing, performance monitoring, broker security, topic security, consumer/producer access management(ACL)
  • Knowledge of Kafka API (development experience is a plus)
  • Provide technical expertise and guidance to production support staff.
  • Involvement with grouping/clustering and high volume systems.
  • Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
  • Manage large scale multi-nodes cluster environments residing on AWS
  • Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka cluster
  • Knowledge of best practices related to security, performance, and disaster recovery.
  • Proven track record of sound, effective decision making.
  • Excellent listening and communication skills. 

    o Must be able to communicate technical information clearly, able to ‘translate’ between diverse groups of technical and non-technical individuals.

    o Ability to synthesize large amounts of complex data into meaningful conclusions and present recommendations to a vast array of individuals.

    o Partner with business units in order to improve the effectiveness of business decisions.

    o Ability to structure documents to effectively communicate with senior leadership and drive alignment and decision making.
  • Bachelor’s Degree required, Master’s Degree Preferred.
  •  

Heads up: when you click “apply now” you’ll be directed to the Allstate careers site. You’re still looking at an Arity job, but because we were founded by Allstate, we share the same application system.

Read Full Job Description

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • JavaLanguages
    • JavascriptLanguages
    • KotlinLanguages
    • PythonLanguages
    • RLanguages
    • ScalaLanguages
    • SqlLanguages
    • SwiftLanguages
    • ReactLibraries
    • ReduxLibraries
    • PandasLibraries
    • Sci-KitLearnLibraries
    • NumpyLibraries
    • MatplotlibLibraries
    • HadoopFrameworks
    • SparkFrameworks
    • SpringFrameworks
    • PysparkFrameworks
    • HiveFrameworks
    • ImpalaFrameworks
    • KafkaFrameworks
    • NiFiFrameworks
    • CassandraDatabases
    • MongoDBDatabases
    • OracleDatabases
    • Google AnalyticsAnalytics
    • AxureDesign
    • InVisionDesign
    • SketchDesign
    • MuralDesign
    • SmaplyDesign
    • ConfluenceManagement
    • JIRAManagement
    • Pivotal TrackerManagement
    • TrelloManagement
    • TrackerManagement
    • WordpressCMS
    • SalesforceCRM
    • PardotCRM

Location

Arity's located in the Merchandise Mart, the heart of Chicago's tech scene. Mobility is what we do & you can find us using all forms to get to work.

An Insider's view of Arity

What’s the vibe like in the office?

At Arity, you’re encouraged to see yourself and be yourself. When you walk through the door, you are part of something bigger than yourself and are empowered to achieve and be better than when you first started here. The space and culture facilitate collaboration & are designed to spark innovation, allowing us to accelerate the future of mobility.

Taylor, Steph & Rachel

Culture team

What's the biggest problem your team is solving?

The mission of our team is to derive meaningful events and features from raw telematics data, with a mix of physics, signal processing, machine learning, & experimentation. Derived from big data, we're developing best-in-class solutions for collision and distracted driving detection which is disrupting the mobility space.

Venu & Kyle

Data Scientists, Advanced Sensor Insights Team

What makes someone successful on your team?

Product Managers on my team are go-getters. They dive into an ambiguous market and drive our business by leveraging core competencies that achieve solutions. To be successful, they think big, have entrepreneurial drive, wear multiple hats, and have a positive, resilient attitude. Above all, we win together and do this by building each other up.

Rachel

Group Product Manager, Shared Mobility Solutions Team

How do your team's ideas influence the company's direction?

At Arity, we solve problems that impact society. Arity Engineering plays a critical role in developing products that incorporate capabilities our customers want with solutions they need. When a customer has a challenge, we leverage the group’s collective learning to work towards an optimized solution. We rarely come across something we can’t solve.

Emad

Vice President, Engineering

How do you collaborate with other teams in the company?

When collaborating with other teams at Arity, transparency is essential. That means communicating clearly, as well as understanding and respecting other's perspectives. Everyone has strengths that they bring to the table, and open communication allows my team to find those superpowers to work efficiently and successfully deliver to our customers.

Shireen

Salesforce Product Owner, Customer Success Team

What are Arity Perks + Benefits

Arity Benefits Overview

Arity was founded by The Allstate Corporation, but you’ll be working for—and at—Arity. It’s the best of both worlds. You’ll get access to the full suite of Allstate benefits and work in a fast-paced startup culture. That’s more than just free breakfasts, brain breaks and ping pong. It’s a culture that encourages you to be you.

Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
If enrolled, you have coverage for certain periodic vision exams, eyeglass lenses and frames, or contact lenses, up to a designated dollar amount.
Health Insurance Benefits
Life Insurance
Wellness Programs
Retirement & Stock Options Benefits
401(K)
We also provide a cash balance pension benefit, at no cost, to eligible employees based on their eligible compensation and years of service with the company. Employees are vested after 3 years.
401(K) Matching
Child Care & Parental Leave Benefits
Family Medical Leave
Arity offers up to 12 weeks of unpaid, job-protected leave per year for any employee eligible under the Family and Medical Leave Act (FMLA).
Adoption Assistance
Vacation & Time Off Benefits
Generous PTO
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Commuter Benefits
Company Outings
Free Daily Meals
Game Room
Stocked Kitchen
Recreational Clubs
Fitness Subsidies
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement
Diversity Program

Additional Perks + Benefits

Looking for more info? You can find details here: https://www.allstategoodlife.com.

More Jobs at Arity43 open jobs
All Jobs
Data + Analytics
Design + UX
Dev + Engineer
HR
Legal
Operations
Product
Project Mgmt
Sales
Product
new
Chicago
Project Mgmt
new
Chicago
Project Mgmt
new
Chicago
Operations
new
Chicago
Project Mgmt
new
Chicago
Data + Analytics
new
Chicago
Data + Analytics
new
Chicago
Data + Analytics
new
Chicago
Design + UX
new
Chicago
Developer
new
Chicago
Data + Analytics
new
Chicago
Developer
new
Chicago
Developer
new
Chicago
Developer
new
Chicago
Developer
new
Chicago
Operations
new
Chicago
Developer
new
Chicago
Developer
new
Chicago
Developer
new
Chicago
Developer
new
Chicago
Developer
new
Chicago
Developer
new
Chicago
Data + Analytics
new
Chicago
Developer
new
Chicago
Data + Analytics
new
Chicago
Developer
new
Chicago
Data + Analytics
new
Chicago
Project Mgmt
new
Chicago
Developer
new
Chicago
Design + UX
new
Chicago
HR
new
Chicago
Product
new
Chicago
Operations
new
Chicago
Developer
new
Chicago
Data + Analytics
new
Chicago
Product
new
Chicago
Developer
new
Chicago
Product
new
Chicago