Scraping Tech Lead (Web scraping & Anti-bot)
Infatica.io is a global provider of proxy and DaaS solutions. We’re building our own high-load web scraping platform: an API that allows you to submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems. The platform supports both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).
We are now looking for an experienced Tech Lead for our web scraping development team who will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of our cutting‑edge scraping infrastructure.
Key Responsibilities
Architecture Design – Data‑plane: high‑parallel crawler, session management, anti‑bot bypass, CAPTCHA solver. Control‑plane: API, authorization, billing, quotas, monitoring. Infrastructure: microservices, Docker/K8s, CI/CD, observability.
Development Leadership – Team building: hiring backend, browser, DevOps, and QA engineers; establishing development and release processes; code quality control and technical decision oversight.
Anti‑Bot Research & Bypass – Browser and network‑level fingerprinting (JA3, TLS, CDP); protection bypass for Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others.
DevOps / SRE – CI/CD setup, Helm charts, scaling configuration; monitoring organization (Prometheus, Grafana, Loki) and SLA processes.
Requirements
5+ years of engineering experience in high‑load backend/data platforms.
Extensive Scraping experience (mandatory).
Excellent understanding of HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC).
Experience with async Python and Go (ideally both), Redis, queues, message brokers.
Advanced level DevOps tools: Kubernetes, Helm, Prometheus, CI/CD.
Experience analyzing and bypassing bot protection systems – strong plus.
Fluent English (all documentation and part of the team are English‑speaking).
Decision‑making skills, mentoring abilities, and accountability for results.
Benefits (What We Offer)
Participate in developing the company’s key product from scratch.
High autonomy and influence on architecture and team decisions.
Budget for conferences, courses, and work tools.
Competitive compensation package.
Remote work flexibility.
This is a unique opportunity to build a world‑class product from the ground up and establish yourself as a key technical decision‑maker in a rapidly growing company.
Apply now and become the technical leader who shapes our platform’s future!
#J-18808-Ljbffr