Easy Apply
Easy Apply
As a Staff Software Engineer in Reliability, you will ensure the reliability of Temporal Cloud, implement reliability practices, conduct testing, and mentor engineers.
About Us
SummaryTemporal is an open source programming model that can simplify code, make applications more reliable, and help developers focus on the important things like delivering features faster. We are on a mission to be the reliable foundation of every developer’s toolbox, and are building the team that will make that happen.
Our values guide us —they are present in how we show up, make decisions, and work together to make an impact. We’re curious, driven, collaborative, genuine and humble.
Temporal is growing and we are looking for those who share our values, challenge 'standard' thinking, and want to influence our future. If you have a passion for improving the developer experience, building world-class open-source software and communities, and want to be a part of our amazing team, we'd love to hear from you!
Join our Reliability team as a Staff Software Engineer, where you’ll own the reliability of operating Temporal Cloud end to end. You will help define and measure reliability expectations, harden systems through gamedays and chaos testing, and build the tooling and practices that make reliability visible and continuously improving across services and operational processes. We’re looking for someone who thrives in ambiguity, enjoys turning reliability goals into concrete engineering work, and can lead cross-team efforts that make systems more resilient at scale.
What You’ll Do- Own reliability outcomes for operating Temporal Cloud end to end, partnering across engineering, infrastructure, and product to drive measurable improvements.
- Define, implement, and evolve reliability targets and associated practices, including alerting thresholds, operational readiness criteria, and escalation paths.
- Plan and run gamedays to validate incident response, operational procedures, and cross-team coordination under realistic failure scenarios.
- Build and scale a chaos testing program that exercises failure modes safely and drives remediation work that reduces real risk.
- Define and maintain a reliability scorecard across services and key operational processes, and use it to prioritize reliability investments.
- Lead load testing and performance testing efforts, including test design, tooling, and analysis of bottlenecks and capacity constraints.
- Improve observability standards (metrics, logs, traces, dashboards) so reliability signals are consistent, actionable, and easy to audit.
- Drive post-incident learning and corrective actions, ensuring fixes are durable and reduce recurrence risk over time.
- Make system-level tradeoffs across reliability, performance, cost, and velocity, and document decisions clearly for long-term maintainability.
- Mentor other engineers and raise the bar on reliability engineering practices across teams.
- Strong computer science fundamentals, especially in distributed systems, concurrency, and performance.
- Demonstrated ability to design and build complex systems that operate reliably under high load and partial failure.
- Experience driving reliability improvements across multiple services, not just within a single codebase.
- Hands-on experience with at least one of: gamedays, chaos testing, load testing, or building reliability scorecards.
- Strong judgment in ambiguous situations, including the ability to prioritize reliability work based on risk and impact.
- Excellent communication skills, including the ability to align multiple stakeholders on reliability goals, plans, and tradeoffs.
- A collaborative mindset and a track record of mentoring and leveling up engineering practices.
- Experience operating multi-tenant systems and designing protections against noisy-neighbor behaviors.
- Deep expertise in observability (metrics design, tracing strategy, dashboard standards) and alert hygiene.
- Experience building internal platforms or tooling that enables other teams to meet reliability standards.
- Familiarity with workflow orchestration systems or durable execution platforms.
- Open source contributions, especially in infrastructure or distributed systems.
- Base Salary Range - $212,000 - $286,200, depending on qualifications and location
- Additionally, this role is eligible to participate in Temporal's equity plan.
Compensation ranges reflect salary and commission compensation (when applicable) across several geographic markets. Employment offers carefully consider multiple factors, including prior experience, knowledge, expertise, skillset, market location, and job level assessed during the interview process.
Employee benefits and perks below are for full-time employees, part-time or temporary positions are excluded.
U.S. Benefits
- Unlimited PTO, 12 Holidays + 2 Floating Holidays
- 100% Premiums Coverage for Medical, Dental, and Vision
- AD&D, LT & ST Disability, and Life Insurance (Standard & Supplemental Available)
- Empower 401K Plan
- Additional Perks for Learning & Development, Lifestyle Spending, In-Home Office Setup, Professional Memberships, WFH Meals, Internet Stipend and more!
International Benefits
Paid Time Off (PTO) and Benefits outside the United States vary by country, and are issued in partnership with Remote.com. Additionally, Temporal offers perks to all international employees for learning & career development, a lifestyle spending account, in-home office setup (in addition to company-issued hardware), professional memberships, work-from-home meals, and access to the Calm app for mental wellness.
Travel
Temporal is a globally distributed, collaborative team that values opportunities for in-person connection. Occasional travel may be required for company events, team offsites, and other meaningful moments that bring us together.
Additional Perks
- $3,600 / Year Work from Home Meals
- $1,800 / Year Professional Enrichment (Career Development & Professional Memberships)
- $1,200 / Year Lifestyle Spending Account
- $1,000 / Year In-Home Office Setup (In addition to Temporal issued equipment - laptop, monitor, keyboard, mouse, trackpad, and extension power cable at no cost to you)
- $74 / Month Reimbursement for Internet
- Calm App Subscription for Mental Health & Wellness
Temporal Technologies is an Equal Opportunity Employer. Temporal Technologies does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status, or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need. We embrace and celebrate differences and diversity.
Temporal is committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. If you need to request a reasonable accommodation, please let your Recruiter know so we can assist.
We are not working with external recruitment agencies, thanks.
Top Skills
Chaos Testing
Distributed Systems
Observability Tools
Performance Testing
Similar Jobs
Healthtech • Other • Social Impact • Software • Telehealth
The Staff Software Engineer will enhance observability, maintain CI/CD pipelines, and ensure system reliability, collaborating across teams for effective infrastructure management.
Top Skills:
AWSKubernetes
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
As a Solution Consultant for Identity & Security, you will partner with Sales to design solutions addressing identity and security challenges, support complex sales cycles, deliver demonstrations, and ensure technical accuracy during the sales process. You will engage with customers to translate security capabilities into business outcomes and maintain strong stakeholder relationships through effective communication and technical expertise.
Top Skills:
Access ManagementAIIdentity GovernanceRisk ManagementSaaS
Cloud • Security • Software • Cybersecurity • Automation
The Regional Marketing Manager develops campaigns and events to drive sales pipeline growth, coordinating logistics, budgets, and marketing materials while collaborating with cross-functional teams.
Top Skills:
MarketoSalesforce
What you need to know about the Chicago Tech Scene
With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.
Key Facts About Chicago Tech
- Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
- Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
- Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
- Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory
