Arity-Cloud Platform Engineer (Remote)
Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer and more useful for everyone.
At the heart of that mission are the people that work here—the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real problems and put your talents towards transforming transportation.
That’s because at Arity, we believe work and life shouldn’t be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don’t just want you to see yourself here. We want you to be yourself here.
The Team
As a member of the Data Streaming team, you will be responsible for the design, architecture, implementation, capacity planning, performance tuning and on-going support of Arity’s streaming and batch data processing platform. You will be an innovative thinker, an expert communicator, and an agile problem solver looking to join an exciting team. You will utilize cutting edge technologies to deliver software solutions within Arity’s cloud environment. Success candidates can learn and adapt quickly and use every tool at your disposal—software, algorithms, statistical models, and beyond—to understand and effectively tackle hard problems.
The Role
• Build large scale multi-node, highly performant and highly available streaming pipelines and clusters that can rapidly evolve to handle new technologies, techniques, and automation approaches
• Perform high-level, day-to-day operational maintenance, support, and upgrades for the stream and batch data processing infrastructure
• Create key performance metrics, measuring the utilization, performance and overall health of the clusters and infrastructure
• Plan and implement new hardware and software releases for the data processing infrastructure
• Research and recommend innovative and automated approaches for system administration tasks
• Calibrate with product owners, product managers and lead engineers and testers
• Create standards, procedures and best practices for high availability and and disaster recovery
• Proactively monitor and setup alerting mechanism for the clusters and supporting hardware to ensure system health and maximum availability
Qualifications
• A college degree or equivalent experience in Computer Science or similar field, including a solid understanding of Computer Science fundamentals
• Minimum 3-5 years of experience working with stream and batch data processing environments
• Lead multiple high priorities initiative with aggressive timelines leveraging an agile framework
• Comfortable performing in a fast paced, dynamic and ambiguous business environment
• Ability to concentrate on a wide range of loosely defined complex situations, which require creativity and originality, where guidance and counsel may be unavailable
• Excellent listening and communication skills
• Strong problem solving skills with the ability to offer why one technical solutions is more preferable than another
• Ability to analyze and interpret complex concepts
• Ability to work in a team environment in a collaborative manner and remote teams
• Proven track record of sound, effective decision making
• Prior experience working on streaming processing systems using technologies similar to Apache Flink, Apache Spark, Apache NiFi, Apache Kafka, Elasticsearch stacks.
• Experience building infrastructure in a cloud computing environment, data processing systems or distributed systems
• Strong working knowledge of Streaming data platform architecture, administration, features and characteristics, cost optimization techniques and security
• Experience working with Python or other scripting languages, Terraform, and a good understanding of AWS services (Cloud Formation Templates, EC2, Cloudwatch, S3)
• Experience in designing, building, deploying and administering the streaming and batch processing infrastructure
• Strong knowledge in writing shell scripts and Ansible playbooks, TerraForm Groovy scripts, and creating Jenkins pipelines for cluster deployments
• Strong knowledge and experience working with CLI tools, JMX settings, performance tuning, monitoring and managing critical 24/7 applications, optimizing the infrastructure, and troubleshooting AWS deployed infrastructure issues
The candidate(s) offered this position will be required to submit to a background investigation, which includes a drug screen.
That’s the day-to-day, now let’s talk about the rest of it. As we mentioned, Arity was founded by The Allstate Corporation. But you’ll be working for—and at—Arity. It’s the best of both worlds. You’ll get access to the full suite of Allstate benefits and work in a fast-paced startup culture. That’s more than just free breakfasts and brain breaks. It’s a culture that encourages you to be you.
Sound like a fit? Apply now! We can’t wait to meet you.
The salary for this level position is $75,900 - $138,300. The salary offered is commensurate with experience.
Arity.com Instagram Twitter LinkedIn
The candidate(s) offered this position will be required to submit to a background investigation, which includes a drug screen.
That’s the day-to-day, now let’s talk about the rest of it. As we mentioned, Arity was founded by The Allstate Corporation. But you’ll be working for—and at—Arity. It’s the best of both worlds. You’ll get access to the full suite of Allstate benefits and work in a fast-paced startup culture. That’s more than just free breakfasts and brain breaks. It’s a culture that encourages you to be you.
Sound like a fit? Apply now! We can’t wait to meet you.
Arity.com Instagram Twitter LinkedIn
Allstate generally does not sponsor individuals for employment-based visas for this position.
Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.
For jobs in San Francisco, please click "here" for information regarding the San Francisco Fair Chance Ordinance.
For jobs in Los Angeles, please click "here" for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.
To view the “EEO is the Law” poster click “here”. This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs
To view the FMLA poster, click “here”. This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.
It is the Company’s policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee’s ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment
