LaunchDarkly Logo

LaunchDarkly

Head of Experimentation

Posted 9 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
256K-414K Annually
Senior level
Remote
Hiring Remotely in United States
256K-414K Annually
Senior level
Lead the Experimentation pillar: set strategy, deliver roadmap, and drive commercial outcomes. Productize AI-native experimentation, expand warehouse-native capabilities, win high-maturity data-science buyers, run a high-performing product organization, and represent the category externally to drive adoption and competitive wins.
The summary above was generated by AI
About the Job:

Feature management and experimentation have converged into a single market, and the buying dynamic at the top has shifted. Engineering teams are no longer the sole evaluator — data scientists and data-focused PMs now carry equal weight on the largest deals. The bar for statistical depth, warehouse ergonomics, and experiment-first workflows is rising quickly.

In traditional experimentation we have built the foundation: a trusted runtime control plane, a growing experimentation engine, and early warehouse-native capabilities. We are winning lower-maturity buyers at healthy rates. We are not yet consistently winning the most sophisticated data organizations. Closing that gap is the job.

In AI experimentation, we have an early lead: the AI-native tooling category has invested in evaluation and conceded production experimentation, and we already have the primitives (statistical significance, multi-armed bandits, experiment-aware guardrails) that no AI-native competitor ships. Extending that lead is the other half of the job.

This leader will own whether LaunchDarkly becomes the definitive experimentation platform in an AI-accelerated world.

Responsibilities:
  • Own the Experimentation pillar. Direct leadership of the Product team. Partner with Engineering and Design counterparts in a triad model. Accountable for the pillar's strategy, roadmap delivery, and commercial outcomes. Make the investment case across the in-product experimentation experience, the warehouse-native analysis layer, and the infrastructure that scales them.
  • Make experimentation the measurement layer of the AI SDLC. Partner with our AI product, observability, and core feature management leaders to productize the capabilities we already have as AI-native primitives. Build a closed loop from offline evaluation through production experiments, to automatic promotion and rollback, to a self-improving feedback loop for agents.
  • Win the high-maturity buyer. Earn the technical confidence of senior data scientists and data-focused PMs. Decide what statistical depth, warehouse coverage, and experiment-first workflow capabilities are non-negotiable, and get them shipped on a timeline that wins pivotal reference deals.
  • Make warehouse-native a weapon. Expand coverage across major data warehouses and query layers. Deliver parity on analysis-only mode, variance reduction, ratio and percentile metrics, exposure validation, and arbitrary-window analysis.
  • Operate a high-performing function. Run a disciplined roadmap, ship predictably against quarterly commitments, drive AI-assisted engineering productivity inside the org, and hire where gaps exist.
  • Be the external face of the category. Credibly represent the product with Data scientists, PMs, experimenters, analysts, and partners. Translate the strategy to the field and equip sales to win head-to-head.
How you'll be measured: 
  • Win rate on experimentation-involved deals, especially head-to-head competitive evaluations — step change in the first year, sustained improvement thereafter.
  • Reference-grade customers at the top of the maturity curve, including named strategic logos.
  • Monthly active customers and active-account ARR growth against plan.
  • Experimentation attach rate on new and expansion enterprise deals.
  • Engineering throughput — roadmap delivery velocity and AI-assisted development adoption inside the function.
Qualifications:
  • Senior product leader (GM, VP, or equivalent) with a track record of owning a product line that competes on statistical rigor and data infrastructure.
  • Deep, operator-level fluency in experimentation methodology: causal inference, variance reduction, ratio metrics, sequential testing, exposure design, multi-armed bandits, and composite/multi-objective metrics — and the realities of running these at scale against production data warehouses and against non-deterministic systems where output variance, not just user variance, drives sample-size and significance decisions.
  • Has earned credibility with data science leaders and experimentation specialists at sophisticated organizations — and can recruit them.
  • Has led a function that includes engineering, design, and data science. Comfortable setting a multi-quarter roadmap, championing investment allocation, and reporting results to an executive team and board.
  • Clear, direct communicator. Decides fast with incomplete information. Prefers shipping and learning to requirements documents.
  • Opinionated about where experimentation is going in an AI-native world — and specifically, how agents and autonomous systems will use experimentation infrastructure differently than human teams do.

Preferred Qualifications: 

  • You have built or scaled experimentation at an organization where it was core infrastructure, not a secondary analytics capability.
  • You have personally won competitive evaluations where a sophisticated data-science organization was the deciding voice.
  • You have shipped warehouse-native data products and understand the operational realities of running experiments directly against customer data infrastructure.
  • You see experimentation as how software teams prove that any change — whether built by a person or an AI agent — actually worked. That evidence layer is core infrastructure, not a reporting afterthought.

Pay:

Target pay ranges based on Geographic Zones* for Level M5: 

  • Zone 1: San Francisco/Bay Area or NYC Metropolitan Area, Boston, Seattle - $301,000 - $414,000**
  • Zone 2: Irvine, LA, Monterey, Santa Barbara, Santa Rosa, Austin, Portland, Philadelphia, Chicago - $271,000 - $373,000**
  • Zone 3: All other US locations - $256,000 - $352,000**
  • All Zones inclusive of 20% Bonus   

LaunchDarkly operates from a place of high trust and transparency; we are happy to state the pay range for our open roles to best align with your needs. Exact compensation may vary based on skills, experience, and location.

*Within the United States, our geographic pay zones are defined by counties surrounding major metropolitan areas.
**Restricted Stock Units (RSUs), health, vision, and dental insurance, and mental health benefits in addition to salary.

About LaunchDarkly:

Modern software delivery was supposed to be the foundation for a thriving digital business but reality has proven otherwise. Slow, inefficient development cycles, costly outages, and fragmented customer experiences are preventing developers from building their best software. The LaunchDarkly platform helps developers innovate on new features faster while protecting them with a safety valve to instantly rewind when things go wrong. Developers can target product experiences to any customer segment and maximize the business impact of every feature. And by gradually rolling out new application components, they escape nightmare "big-bang" technology migrations. 

The LaunchDarkly platform was built to guide engineers to the next frontier of DevOps by:

  • Improving the velocity and stability of software releases, without the fear of end customer outages
  • Delivering targeted experiences by easily personalizing features to customer cohorts
  • Maximizing the business impact of every feature through the ability to experiment and optimize
  • Coordinating the release and optimization of software to provide consistent experiences across mobile platforms and device types
  • Improving the effectiveness and productivity of engineering teams, by providing insights into engineering cadence and stability

At LaunchDarkly, we believe in the power of teams. We're building a team that is humble, open, collaborative, respectful and kind. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, veteran status, or disability status. LD invites any applicant to review our written Affirmative Action Plan. To do so, contact People Ops at [email protected]

Do you need a disability accommodation?

Fill out this accommodations request form and someone from our People Operations team will contact you for assistance. 

Your safety matters to us. To protect yourself from potential scams, LaunchDarkly recruiters will only contact you from @LaunchDarkly.com email addresses or via LinkedIn from "Verified Recruiter" accounts. Be cautious of emails from other domains.  Legitimate LaunchDarkly recruiters will never ask for money, fees, or banking information before making a job offer. LaunchDarkly will never make a job offer without conducting a formal interview process. Our interview process does not involve asking detailed questions by email. If you are ever unsure about a communication that you receive, don't click any links—visit Careers | LaunchDarkly  directly for confirmed job openings and links to apply.

Please notify us of any fraudulent representation by sending an email to [email protected].

Similar Jobs

4 Days Ago
Remote
United States
100K-170K Annually
Mid level
100K-170K Annually
Mid level
Digital Media
Own the first 30-day client experience from signed contract to handoff: lead kickoff/onboarding, build initial paid-ad campaign infrastructure, validate assets/tracking, manage multiple onboardings, prevent risks, and partner with Sales and Growth to improve close rates and onboarding through AI, automation, and process improvements.
Top Skills: AIAsanaGoogle AdsHubspotKiteLinkedin AdsMeta Ads
An Hour Ago
Remote or Hybrid
65K-95K Annually
Senior level
65K-95K Annually
Senior level
Agency • Artificial Intelligence • Consumer Web • Digital Media • Analytics • Design
Manage end-to-end paid media campaigns across multiple clients and channels, including strategy, setup, optimization, tracking, and reporting. Analyze performance data, maintain tracking (GA4/Tag Manager), build reports and dashboards, and present insights to clients. Collaborate with account, creative, and analytics teams to drive growth and improve ROI while staying current on platform best practices.
Top Skills: Conversions ApiFacebook/Meta AdsGoogle AdsGoogle Analytics (Ga4)Google Looker StudioGoogle SheetsGoogle Tag ManagerLinkedin AdsMicrosoft/Bing AdsPerformance MaxPinterest AdsProgrammatic AdvertisingReddit AdsTwitter/X AdsYoutube Ads
An Hour Ago
Remote
United States
190K-190K Annually
Senior level
190K-190K Annually
Senior level
Security • Cybersecurity
Design, build, and deploy production-grade ML systems for ICS/xOT cybersecurity, including threat detection, anomaly detection, NLP/LLM applications, and scalable data pipelines with observability and MLOps practices for cloud and on-prem environments.
Top Skills: Ci/CdDockerGoHuggingfaceJavaKubernetesLlmsMessage QueuingMlopsModel VersioningNlpPipeline OrchestrationPythonPyTorchRetrieval-Augmented Generation (Rag)RustScikit-LearnSQLStream ProcessingTensorFlow

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account