Technical Lead, Experimentation Science (BK or SF)
Company Description
As an Etsy employee, you can do the work you love, be yourself, and make an impact in the lives of millions. Our commitments to diversity and inclusion, team culture and the spaces where we work all reflect our mission to keep commerce human.
Job Description
Etsy is an international marketplace with 65M+ handmade and vintage items from passionate artists, designers and vintage collectors.
Within the central Data organization, Experimentation Science team focuses on making online & offline experimentation faster and more robust for Etsy. We develop self service tools that are being consumed by our Machine Learning, Analytics, Engineering and Product partners.
We are looking for an experienced technical leader who can help build Etsy’s next generation experimentation platform.
Qualifications
What You'll Do:
Push the state of the art and apply the latest advances to improve experimentation at Etsy.
Prototype, optimize, and productionize experimentation techniques for both A/B and non-traditional experiments.
Build ML specific experimentation solutions (interleaving, MABs, Human annotation) to speed up algorithm development.
Work closely with engineers to scale experimentation solutions across Etsy products.
Work closely with product partners to understand their needs and translate them into practical solutions.
Share impactful and innovative work in the wider experimentation research community, including presenting at top-tier ML/DS/Stats conferences.
Basic requirements:
You have a track record of building methods/tools for offline and/or online experimentation.
You have a strong understanding of fundamentals of experimentation science including A/B testing, and causal analysis.
You are comfortable with Python, GoogleSQL, Pig, git, etc for writing robust prototype code. You are excited about learning new tools to help you get the job done.
Preferred requirements:
You have a Ph.D. degree in Statistics, Economics, Computer Science or related engineering fields and 5+ years of practical experimentation experience , or 8 years of experience in experimentation experience.
You are comfortable working with groups outside engineering and translating high-level business requirements into technical architecture. You should also be able to comfortably communicate with non-engineers about the technical details of our experimentation platform.
You have strong leadership skills including growing and mentoring others.
You have experience in experimentation in two-sided marketplaces.
Additional Information
At Etsy, we believe that a diverse, equitable and inclusive workplace makes us a more relevant, more competitive, and more resilient company. We welcome people from all backgrounds, ethnicities, cultures, and experiences. Etsy is an equal opportunity employer. We do not discriminate on the basis of race, color, ancestry, religion, national origin, sexual orientation, age, citizenship, marital or family status, disability, gender identity or expression, veteran status, or any other legally protected status. We will ensure that individuals with disabilities are provided a reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. While Etsy supports visa sponsorship, sponsorship opportunities may be limited to certain roles and skillsets.