Infatica Logo

Infatica

Senior Scraping Engineer (Web scraping & Anti-bot)

Posted 4 Days Ago
Remote
Hiring Remotely in Georgia, USA
Senior level
Remote
Hiring Remotely in Georgia, USA
Senior level
Lead architectural decisions for a web scraping platform, focusing on infrastructure, anti-bot measures, and development processes. Engage in DevOps/SRE tasks and ensure code quality and monitoring.
The summary above was generated by AI

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Engineer for our web scraping development team who will lead and drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure. 

Key Responsibilities

Architecture Design

  • Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
  • Control-plane: API, authorization, billing, quotas, monitoring
  • Infrastructure: microservices, Docker/K8s, CI/CD, observability

Development Ownership

  • Establish development and release processes
  • Code quality control and technical decision oversight

Anti-Bot Research & Bypass

  • Browser and network-level fingerprinting (JA3, TLS, CDP)
  • Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

DevOps / SRE

  • CI/CD setup, Helm charts, scaling configuration
  • Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

Requirements

- 4-6+ years in backend, data engineering, automation, or high-load systems.

- Strong production web scraping experience with protected / dynamic / JS-heavy websites.

- Python async stack; Go experience is a plus.

- Experience with Playwright, Puppeteer, Selenium, Scrapy, browser automation, CDP.

- Strong understanding of HTTP, TLS, HTTP/2, cookies, sessions, headers, proxies.

- Redis, queues/message brokers, Docker, CI/CD, observability.

- Kubernetes experience is preferred; deep K8s/SRE is a plus, not a hard blocker within this budget.

- Ability to write clear technical documentation in English.

- Ownership mindset: reliability, monitoring, incident debugging, cost control


Benefits
  • Participate in developing the company's key product from scratch
  • High autonomy and influence on architecture and team decisions
  • Budget for conferences, courses, and work tools
  • Competitive compensation package
  • Remote work flexibility

Join us 

This is a unique opportunity to build a world-class product from the ground up and establish yourself as a key technical decision-maker in a rapidly growing company.

Apply now and become the technical leader who shapes our platform's future!

Similar Jobs

5 Hours Ago
Easy Apply
Remote
United States
Easy Apply
139K-192K Annually
Mid level
139K-192K Annually
Mid level
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
As a Product Designer, you will create user experiences for borrower-facing flows, translate product requirements into designs, collaborate with teams, and iterate on feedback to impact borrower interactions positively.
Top Skills: Figma
5 Hours Ago
Easy Apply
Remote
United States
Easy Apply
162K-225K Annually
Senior level
162K-225K Annually
Senior level
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
As a Senior Product Designer at Upstart, you will design AI-driven payment experiences, translating complex workflows into user-friendly interfaces and collaborating with cross-functional teams to enhance borrower interactions and success.
Top Skills: FigmaPrototyping Tools
5 Hours Ago
Easy Apply
Remote
United States
Easy Apply
157K-218K Annually
Senior level
157K-218K Annually
Senior level
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
As a Staff Data Analyst, you'll drive data analysis, build business intelligence tools, and collaborate across teams to optimize Upstart's servicing strategy, while mentoring junior analysts.
Top Skills: DatabricksDbtLookerModePythonRRedshiftSnowflakeSQLTableau

What you need to know about the Chicago Tech Scene

With vibrant neighborhoods, great food and more affordable housing than either coast, Chicago might be the most liveable major tech hub. It is the birthplace of modern commodities and futures trading, a national hub for logistics and commerce, and home to the American Medical Association and the American Bar Association. This diverse blend of industry influences has helped Chicago emerge as a major player in verticals like fintech, biotechnology, legal tech, e-commerce and logistics technology. It’s also a major hiring center for tech companies on both coasts.

Key Facts About Chicago Tech

  • Number of Tech Workers: 245,800; 5.2% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: McDonald’s, John Deere, Boeing, Morningstar
  • Key Industries: Artificial intelligence, biotechnology, fintech, software, logistics technology
  • Funding Landscape: $2.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Pritzker Group Venture Capital, Arch Venture Partners, MATH Venture Partners, Jump Capital, Hyde Park Venture Partners
  • Research Centers and Universities: Northwestern University, University of Chicago, University of Illinois Urbana-Champaign, Illinois Institute of Technology, Argonne National Laboratory, Fermi National Accelerator Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account