CSC Generation Logo

CSC Generation

Senior QA Engineer, AI & Automation

Posted 4 Hours Ago
In-Office or Remote
Hiring Remotely in San Jose, CA
Senior level
In-Office or Remote
Hiring Remotely in San Jose, CA
Senior level
Build and maintain AI-assisted automated testing across web, API, and mobile using Playwright. Integrate quality gates into GitHub Actions, reduce flaky tests, and provide functional, regression, API, performance, and exploratory testing. Evaluate AI-powered customer experiences, track quality metrics, convert defects into regression tests, and mentor QA engineers. Partner with engineering teams on risk-based test strategies, CI/CD validation, and responsible use of AI-generated test code.
The summary above was generated by AI

Adventure is our Culture. Join a team that celebrates a lifestyle as bold as the terrain we love. At Backcountry, we are rooted in adventure, recognition, and wellbeing on and off the mountain. We spotlight employee stories, celebrate milestones, and offer exclusive outdoor perks. Whether you are at HQ, in a retail store, or remote, you will be part of a team that thrives on energy, exploration, and connection.


Reports to: Senior Retail Technology Architect

Location: Remote (US, Canada, or Costa Rica)

What You'll Do

    Build AI-Accelerated Test Automation
  • Build and maintain scalable automation suites using Playwright across web, API, and mobile, contributing to broader QA frameworks and release validation standards.
  • Use AI coding assistants and agents (Claude Code, GitHub Copilot, Cursor, Playwright's planner/generator/healer agents) to generate test plans, test cases, page objects, and test data from requirements, Jira stories, and PR diffs.
  • Review, validate, and harden every AI-generated test before it merges — you own the correctness of the suite regardless of what wrote the code.
  • Drive down flaky tests and maintenance cost through resilient locator strategies, AI-assisted self-healing, and automated failure triage.
  • Integrate automated quality gates into GitHub Actions CI/CD so every deploy is validated by the pipeline rather than by manual sign-off.
  • Build and maintain functional, regression, API, and performance/load testing coverage using tools like Postman, JMeter, or k6.
  • Apply Testing Judgment Where It Matters
  • Determine what should be automated, what can be delegated to AI, and what requires human testing — balancing coverage, risk, and release timelines.
  • Perform focused exploratory testing on new features, UI/UX changes, and complex user flows to catch edge cases and usability issues that automation and AI miss.
  • Turn every escaped defect into an automated regression check so the suite strengthens with each release.
  • Partner with engineers to embed tests, API contract checks, and AI-assisted code review early in the SDLC to reduce downstream defect costs.
  • Help define how to test AI-powered customer experiences (search, recommendations) where outputs are non-deterministic and need evaluation rubrics rather than exact assertions.
  • Track and report quality metrics (automation coverage, defect escape rate, flake rate, test cycle time) to show where automation is paying off.
  • Contribute to a High-Performing Team
  • Collaborate with QA peers and engineering teams, sharing knowledge, best practices, and the AI prompts and workflows that work.
  • Provide input on quality practices and process improvements across the engineering org, focusing on reducing manual regression and UAT effort.
  • Support and mentor QA engineers on automation and responsible AI-assisted testing, fostering a culture of quality ownership.

Required Qualifications

  • 5+ years of experience in Quality Assurance and Testing, including 3+ years building and maintaining test automation that runs in CI/CD.
  • Proven, hands-on experience with Playwright for web and API E2E automation; Cypress or Selenium experience is a plus.
  • Strong automation fundamentals: ability to design, build, and maintain scalable, reliable test suites and frameworks, and to diagnose and eliminate flaky tests.
  • Strong proficiency in TypeScript/JavaScript or Python (Java a plus); you write test code to the same standard as production code.
  • Hands-on, day-to-day use of AI coding tools (Claude Code, GitHub Copilot, or Cursor) to write, refactor, and debug test code, with the discipline to validate and correct AI-generated output.
  • Experience integrating automated tests into CI/CD pipelines (GitHub Actions preferred), including parallel execution, reporting, and quality gates.
  • Solid experience with functional, regression, API, and performance/load testing (Postman, JMeter, k6, or equivalent).
  • Strong exploratory testing skills and the judgment to build risk-based test strategies across automated, AI-assisted, and manual coverage.
  • Demonstrated SDLC and Agile experience with defect lifecycle management using Jira and TestRail.
  • Ability to operate effectively under a steady release cadence and manage competing priorities with minimal supervision.

Preferred Qualifications

  • E-commerce QA automation experience, particularly in environments shipping frequently with CI/CD integration.
  • Experience building or adopting agentic testing workflows (AI test generation, self-healing tests, MCP-connected tools, or LLM-based failure triage).
  • Experience testing AI/ML-powered features such as search, recommendations, or LLM-generated content, including evaluation of non-deterministic output.
  • Familiarity with BrowserStack or similar cloud device and browser grids.
  • Experience with observability tooling like Grafana or GCP-based infrastructure, including using production signals to prioritize test coverage.
  • Strong communication and collaboration skills, with the ability to work cross-functionally.

Why Join

    The people who do best here are builders. They take ownership, move fast, and want to see the direct impact of their work.

  • Cross-Functional Impact: Your work touches every engineering team and every release — automation coverage and quality gates you build directly shape what ships to customers across web, mobile, and API.
  • AI-First Skill Building: You will work at the frontier of AI-assisted testing, using and evaluating emerging tools daily and building expertise that is defining the next generation of quality engineering.
  • End-to-End Ownership: You own the automation framework, the CI/CD quality gates, and the testing strategy — from choosing what to automate to deciding how to evaluate non-deterministic AI features.
  • Competitive Benefits (US): Paid time off policies, 401(k) match, medical/dental/vision and a variety of supplemental policies, and employee discounts across our portfolio of brands.
  • Competitive Benefits (Canada): Paid time off policies, RRSP match, medical, dental, and vision coverage, a variety of supplemental benefit options, and employee discounts across our portfolio of brands.
  • Competitive Benefits (Costa Rica): We offer an attractive benefits package including primarily remote work, private medical and life insurance, additional paid time off, monthly allowances and reimbursements, employee discounts, and opportunities for professional growth.

Interview Process

    1. Recruiter Screen - A 30-minute conversation with our recruiting team to align on the role, your background, and what you are looking for.
    2. Hiring Manager Interview - A deeper conversation focused on your automation experience, AI-assisted testing approach, and how you balance coverage with release velocity.
    3. Technical / Case Discussion - A hands-on session covering Playwright automation design, CI/CD integration, and your approach to evaluating and hardening AI-generated tests.
    4. In-Person Interview - We'd like to meet you at our Salt Lake City office. Details and logistics will be arranged with your recruiter.
    5. Reference Checks - Conducted in parallel with the final stages where possible.
    6. Offer - We move quickly for the right candidate.

    Interview process is subject to change. Any updates will be communicated promptly and clearly.

Please Note

  • Part of our interview process is a mandatory in-person interview with someone on our team prior to an offer.  Candidates that are unwilling or unable to meet for an in-person interview will be removed from consideration immediately.   
  • Due to a high volume of fraudulent applications, you must share a valid LinkedIn profile URL in the application questions below to be considered. If you do not have a LinkedIn profile, you must provide a credible reason in that field and supply alternative evidence of your professional background to verify your identity.

Similar Jobs

2 Months Ago
In-Office or Remote
United States
38K-133K Annually
Expert/Leader
38K-133K Annually
Expert/Leader
Agency • Information Technology
Lead QA Automation for agentic AI products by designing eval pipelines, golden datasets, and automated tests for tool-use, hallucination detection, latency/token monitoring, and regression across models and prompts. Integrate performance testing into CI/CD and collaborate with AI engineers to convert requirements into measurable automated evaluations.
Top Skills: Ci/CdClaude 3.5CypressDeepevalGpt-4JSONLangsmithPlaywrightPromptfooPytestPythonRagRagasSeleniumSQL
4 Minutes Ago
Remote
United States
222K-355K Annually
Senior level
222K-355K Annually
Senior level
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Leads Toast’s enterprise Enablement strategy across learning design, knowledge management, customer training, certification, and internal enablement. Drives AI-era transformation, customer product activation, self-service, employee proficiency, and role mastery. Partners with Product and Customer Care on AI-ready knowledge and self-service strategy, establishes metrics and governance, leads product-launch education, and reports enablement impact to senior leadership.
Top Skills: Generative Ai
4 Minutes Ago
Remote
United States
124K-198K Annually
Senior level
124K-198K Annually
Senior level
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Build AI workflows, agents, and customer-facing web experiences that accelerate website production and improve conversion. The role involves optimizing Contentful-based processes, configuring chat, enrichment, voice AI, and personalization tools, running experiments, establishing AI guardrails, monitoring performance, and training marketing teams on reusable AI systems. Collaboration spans Web Platform, CRO, SEO, product marketing, legal, privacy, and brand teams.
Top Skills: AnthropicClayContentfulGeminiMcpN8NOpenaiRagWorkatoZapier

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account