Scraper Developer
Full Job Description
Anaqua is seeking a Scraper Developer to join the Online Brand Protection team. This hands-on role involves maintaining and expanding web scraping systems across marketplaces, websites, domain registries, and social media platforms within Hyderabad, Telangana. You will build resilient scrapers that overcome anti-bot defenses using Python-based stacks (including Playwright and Selenium), delivering clean data to developers and analysts.
Key responsibilities include:
- Maintaining and enhancing existing scrapers across various sources including marketplaces, webshops, domain/WHOIS registries, and social media platforms in the Indian region and globally.
- Building new scrapers from initial site analysis to production deployment for uncovered data sources.
- Ensuring reliability against anti-bot defenses using rotating proxies, browser fingerprinting, request pacing, header management, and CAPTCHA-solving techniques.
- Monitoring scraper health, diagnosing failures due to site changes or geo-specific blockers, and implementing quick fixes.
- Packaging scrapers in containerized environments (Docker) with proper version control using Git.
Requirements:
- 3+ years of experience in web scraping against sites with active anti-scraping mechanisms.
- Strong Python skills including practical application of Playwright and Selenium.
- Experience managing proxies, request headers, cookies, and browser fingerprinting libraries.
- Solid understanding of HTTP, HTML, DOM, XHR/fetch techniques for dynamic content loading.
- Proficiency with Google Cloud infrastructure and virtual machines.
This role reports to the Technical Lead. Exposure to Java or TypeScript is beneficial as the platform evolves. Join a team working on high-scale IP data extraction solutions that inform strategies for major global brands and law firms.
Company
Anaqua
Anaqua, Inc. is a leading provider of integrated intellectual property (IP) management technology solutions and services. Headquartered in Boston with global operations across the U.S., Europe, Asia, ...