Easy Apply
Easy Apply
As a Big Data DevOps Lead, you will improve Big Data infrastructure efficiency, lead architecture efforts, and provide on-call support for production systems.
Summary:
As a Senior or Lead Big Data DevOps Engineer, you will be working with a team responsible for setting up, scaling, and maintaining Big Data infrastructure and tools in private and public cloud environments.
Main Responsibilities:
• Driving improvement of the efficiency of Big Data infrastructure.
- Coordinating cross-team infrastructure and Big Data initiatives.
- Leading Big Data – related architecture and design efforts.
- Ensuring availability, efficiency, and reliability of the Big Data infrastructure.
- Building and supporting tools for operational tasks.
• Evaluating, designing, deploying monitoring tools. - Design and implementation of DR/BC practices and procedures.
- On-call support of production systems.
Requirements:
• 7+ years of experience working with Hadoop, preferably Open Source.
- 3+ years of leading Big Data, DevOps, SRE, DBA, or development team.
- Experience setting up and running Hadoop clusters of 1000+ nodes.
- Solid knowledge of NoSQL databases, preferably Cassandra or ScyllaDB.
- Experience running and troubleshooting Kafka.
- Working knowledge of at least one of: Terraform, Ansible, SaltStack, Puppet.
• Proficiency in shell scripting.
Nice to have:
• Experience with Prometheus.
- Experience managing Showflake.
• Solid knowledge of Graphite and Grafana. - Python or Perl scripting skills.
- Experience with installing and managing Aerospike.
- DBA experience with one of: PostgreSQL, MySQL, MariaDB.
Top Skills
Aerospike
Ansible
Cassandra
Grafana
Graphite
Hadoop
Kafka
Mariadb
MySQL
NoSQL
Perl
Postgres
Prometheus
Puppet
Python
Saltstack
Scylladb
Shell Scripting
Showflake
Terraform
Similar Jobs at Zeta Global
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Principal Software Engineer will lead technical and thought innovations for product features, mentor teams, and collaborate on system infrastructure and architecture, requiring a deep expertise in software and data technologies.
Top Skills:
AerospikeApache AirflowApache LuigiAWSBashCi/CdDjangoDockerDynamoDBEmrFastapiHbaseHdfsHiveJavaKafkaKubernetesMySQLOpen Table FormatsPostgresPythonRedisScalaScyllaSnowflakeSparkTerraform
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Senior Frontend Engineer will design and implement scalable web applications, focusing on performance and user experience, while leading core component development on a marketing automation platform.
Top Skills:
AjaxApacheCSS3Es6+GoHTMLHTTPHttp2.0JavaJavaScriptNginxNode.jsPythonReactRestTypescriptWebpackWebsockets
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Senior Software Engineer will design and maintain data infrastructure, coordinate with analysts on ETL processes, and collaborate on data products while ensuring data quality and availability.
Top Skills:
AirflowAWSFastapiHivePythonSnowflakeSpark
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory