Design and evaluate cloud infrastructure, Kubernetes, IaC, AWS, and CI/CD solutions for GenAI training and inference environments. Create technical scenarios, reference solutions, evaluation rubrics, and feedback for AI-generated infrastructure outputs. Troubleshoot production Kubernetes and distributed-system failures while applying cloud architecture, security, reliability, observability, and operational best practices.
This role is for one of our clients
Compensation: $75 - $110 per hour
We are seeking an experienced Cloud / DevOps Engineer (Infra & IaC) to contribute to a cutting-edge GenAI environment focused on building and improving large-scale AI training and inference infrastructure.
The ideal candidate will bring strong, hands-on expertise in Kubernetes, AWS cloud services, Infrastructure-as-Code (IaC), and CI/CD. You will apply your real-world infrastructure engineering experience to evaluate technical workflows, create high-quality reference solutions, identify gaps in AI-generated outputs, and help establish rigorous standards for cloud and DevOps reasoning.
This is a full-time engagement requiring 40 hours per week, Monday through Friday.
RequirementsKey Responsibilities
- Collaborate with research and engineering teams to identify knowledge gaps and improve AI model performance across cloud infrastructure, DevOps, Kubernetes, and Infrastructure-as-Code domains.
- Design realistic and technically challenging tasks covering Kubernetes troubleshooting, AWS service integration, infrastructure automation, and production operations.
- Develop accurate, detailed reference solutions for complex infrastructure engineering scenarios.
- Review and evaluate AI-generated technical solutions for correctness, reliability, scalability, security, and adherence to production best practices.
- Provide clear, structured written feedback highlighting technical gaps, incorrect assumptions, and opportunities for improvement.
- Create detailed evaluation criteria, rubrics, and benchmarks for assessing Kubernetes troubleshooting, IaC architecture, AWS integrations, and CI/CD reasoning.
- Develop scenarios involving cluster failures, infrastructure automation, deployment workflows, service integrations, and operational reliability.
- Work closely with other technical subject matter experts to maintain consistency, accuracy, and quality across evaluation datasets.
- Translate practical production experience into structured guidance that can be used to improve AI-generated infrastructure solutions.
- 4+ years of professional experience in Cloud Infrastructure, DevOps, Site Reliability Engineering, Platform Engineering, or a closely related field.
- Strong hands-on experience managing Kubernetes in production environments, including diagnosing, troubleshooting, and resolving cluster failures and operational issues.
- Experience with Kubernetes beyond simply writing manifests or consuming managed Kubernetes control planes.
- Proven production experience with Infrastructure-as-Code, particularly Terraform and/or AWS CDK.
- Strong practical knowledge of AWS cloud services, including production integration with services such as:
- AWS Lambda
- API Gateway
- DynamoDB
- Experience designing, implementing, and maintaining CI/CD pipelines for production workloads.
- Strong understanding of cloud architecture, infrastructure automation, deployment strategies, observability, reliability, and operational best practices.
- Demonstrated career progression with increasing ownership and responsibility in infrastructure, DevOps, or platform engineering.
- Ability to commit reliably to 40 hours per week during standard weekdays.
- Excellent written and verbal communication skills, with the ability to explain complex technical concepts and engineering decisions clearly.
- Strong analytical and troubleshooting abilities, particularly when diagnosing distributed systems and infrastructure failures.
- Experience working with large-scale cloud infrastructure or highly distributed systems.
- Familiarity with Kubernetes networking, security, storage, scaling, and cluster lifecycle management.
- Experience implementing infrastructure security and reliability best practices.
- Knowledge of AWS architecture patterns and cloud-native application design.
- Experience with GitOps, containerization, monitoring, logging, and observability platforms.
- Familiarity with modern DevOps and platform engineering methodologies.
- Experience reviewing or evaluating technical documentation, engineering solutions, or AI-generated outputs.
In this role, your production infrastructure expertise will help establish high-quality standards for AI systems working with complex Cloud, DevOps, Kubernetes, AWS, and IaC problems.
You will play a key role in transforming practical engineering knowledge into structured tasks, reference solutions, evaluation frameworks, and high-quality technical feedback that can improve the capabilities of next-generation AI models.
Equal OpportunityWe are committed to providing equal employment opportunities to all qualified candidates. Employment decisions are made without regard to legally protected characteristics, and reasonable accommodations are available throughout the hiring and engagement process upon request.
Similar Jobs
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Lead commercial strategy across Rapid7’s product portfolio, including pricing, packaging, positioning, bundling, value-based pricing, and go-to-market execution. The role partners with Product, Sales, Marketing, RevOps, Finance, and Deal Desk to analyze commercial metrics, develop models, guide CPQ and operational tooling, monitor competitors, and present recommendations to senior leadership. The position requires strong quantitative analysis, financial modeling, cross-functional influence, and execution in a B2B SaaS environment.
Top Skills:
Business Intelligence PlatformsDashboardsData Warehouse ToolingEnterprise CpqSpreadsheet ModelingSQL
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Architects and delivers foundational systems for an autonomous security investigation platform supporting MDR. Responsibilities include distributed data pipelines, query engines, orchestration, ML model infrastructure, scalability, reliability, observability, technical standards, design reviews, mentorship, and cross-team architecture. The role partners with ML, product, data science, and platform teams to solve complex technical problems across real-time security operations.
Top Skills:
Amazon S3AWSData MeshDistributed Query EnginesDynamoDBEmbedding SystemsFlinkKafkaLlmsMl/Ai
Artificial Intelligence • Big Data • Healthtech • Software • Biotech
Leads end-to-end IVD, companion diagnostic, clinical trial assay, tumor profiling, and SaMD development programs. Aligns internal cross-functional teams and biopharma partners across strategy, validation, clinical operations, regulatory submission, manufacturing, and commercialization. Owns governance, milestones, budgets, resources, risks, and partner relationships while delivering programs through regulatory approval or pivotal clinical trials.
Top Skills:
Analytical ValidationAssay DevelopmentBioinformaticsBlaClinical ValidationCompanion Diagnostics (Cdx)Design ControlsEu IvdrFda Regulatory RequirementsIndIvdMaaNdaPhase I/Ii/IiiSoftware As A Medical Device (Samd)
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
