Infatica Logo

Infatica

Senior Scraping Engineer (Web scraping & Anti-bot)

Posted 2 Days Ago
Remote
Hiring Remotely in Georgia, USA
Senior level
Remote
Hiring Remotely in Georgia, USA
Senior level
Lead architectural decisions for a web scraping platform, focusing on infrastructure, anti-bot measures, and development processes. Engage in DevOps/SRE tasks and ensure code quality and monitoring.
The summary above was generated by AI

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Engineer for our web scraping development team who will lead and drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure. 

Key Responsibilities

Architecture Design

  • Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
  • Control-plane: API, authorization, billing, quotas, monitoring
  • Infrastructure: microservices, Docker/K8s, CI/CD, observability

Development Ownership

  • Establish development and release processes
  • Code quality control and technical decision oversight

Anti-Bot Research & Bypass

  • Browser and network-level fingerprinting (JA3, TLS, CDP)
  • Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

DevOps / SRE

  • CI/CD setup, Helm charts, scaling configuration
  • Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

Requirements

- 4-6+ years in backend, data engineering, automation, or high-load systems.

- Strong production web scraping experience with protected / dynamic / JS-heavy websites.

- Python async stack; Go experience is a plus.

- Experience with Playwright, Puppeteer, Selenium, Scrapy, browser automation, CDP.

- Strong understanding of HTTP, TLS, HTTP/2, cookies, sessions, headers, proxies.

- Redis, queues/message brokers, Docker, CI/CD, observability.

- Kubernetes experience is preferred; deep K8s/SRE is a plus, not a hard blocker within this budget.

- Ability to write clear technical documentation in English.

- Ownership mindset: reliability, monitoring, incident debugging, cost control


Benefits
  • Participate in developing the company's key product from scratch
  • High autonomy and influence on architecture and team decisions
  • Budget for conferences, courses, and work tools
  • Competitive compensation package
  • Remote work flexibility

Join us 

This is a unique opportunity to build a world-class product from the ground up and establish yourself as a key technical decision-maker in a rapidly growing company.

Apply now and become the technical leader who shapes our platform's future!

Similar Jobs

45 Minutes Ago
Remote or Hybrid
United States
117K-158K Annually
Senior level
117K-158K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
The Manager will lead client and project management in delivering technology solutions, overseeing project plans, team development, and methodologies for service area growth at Wipfli.
Top Skills: Accounting SystemsFixed Asset ManagementProject Management Software
57 Minutes Ago
Remote or Hybrid
USA
Mid level
Mid level
Machine Learning • Payments • Security • Software • Financial Services
As a Software Engineer Lead, you will create and lead the design and development of software solutions, provide technical guidance, and facilitate problem resolution.
Top Skills: Application DevelopmentSoftware Solutions
An Hour Ago
Remote or Hybrid
2 Locations
123K-123K Annually
Expert/Leader
123K-123K Annually
Expert/Leader
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The Client Experience Product Manager Director at PwC leads product management strategies, overseeing project execution, and cultivating client relationships to ensure the development of innovative software solutions.
Top Skills: Product ManagementSoftware SolutionsTechnology Architecture

What you need to know about the Charlotte Tech Scene

Ranked among the hottest tech cities in 2024 by CompTIA, Charlotte is quickly cementing its place as a major U.S. tech hub. Home to more than 90,000 tech workers, the city’s ecosystem is primed for continued growth, fueled by billions in annual funding from heavyweights like Microsoft and RevTech Labs, which has created thousands of fintech jobs and made the city a go-to for tech pros looking for their next big opportunity.

Key Facts About Charlotte Tech

  • Number of Tech Workers: 90,859; 6.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lowe’s, Bank of America, TIAA, Microsoft, Honeywell
  • Key Industries: Fintech, artificial intelligence, cybersecurity, cloud computing, e-commerce
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (CED)
  • Notable Investors: Microsoft, Google, Falfurrias Management Partners, RevTech Labs Foundation
  • Research Centers and Universities: University of North Carolina at Charlotte, Northeastern University, North Carolina Research Campus

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account