Senior Python Data Scraping Enginee...
Full Job Description
About the Role
Join the Tendem project as a Senior Python Data Scraping Engineer to drive specialized data scraping workflows. You will handle end-to-end extraction from complex websites, ensuring accuracy for real-world AI applications using tools like Apify and OpenRouter.
Key Responsibilities
- Own complete data extraction workflows with full coverage and reliability.
- Leverage custom workflows to accelerate collection while meeting requirements.
- Extract from dynamic/interactive sources (JavaScript, AJAX) adapting to site changes.
- Enforce strict data quality standards through validation and cross-source checks.
- Scale operations using efficient batching or parallelization for large datasets.
Educational Qualifications
Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science is preferred. At least 5+ years of experience in data engineering or web scraping is required.
Technical Skills (Essential)
- Strong Python expertise: BeautifulSoup, Selenium for dynamic content and APIs via proxies.
- Data cleaning, normalization, and validation delivering structured CSV/JSON datasets.
- Anti-bot mechanisms handling at scale.
- Cloud infrastructure experience (AWS/Docker).
- LLM frameworks like LangChain or OpenRouter applied to automation tasks.
Requirements
You must be methodical, detail-oriented, and self-directed with strong troubleshooting skills. Upper-intermediate English proficiency is required.
Company
Mindrift
Mindrift is a global leader in data services for AI, established since 2014 and operated by Toloka (Nebius Group). The platform connects domain experts with projects from leading technology companies ...