Senior Python Data Scraping Enginee...

Mindrift seeks Senior Python Data Scraping Engineers to join the Tendem project (tendem.ai) and drive specialized data scraping workflows for real-world applications. In this part-time remote freelance role, you will leverage your expertise in web scraping, data extraction, and processing to deliver accurate, reliable, and high-quality datasets. Your responsibilities include designing end-to-end extraction workflows for complex websites, handling dynamic content (JavaScript, AJAX, infinite scroll), and ensuring data quality through validation, normalization, and structured output (CSV, JSON, Google Sheets). You will utilize tools like Apify, OpenRouter, and custom workflows while adapting to evolving site structures and anti-bot mechanisms.

Key qualifications include 5+ years of experience in data engineering, web scraping, automation, or software development, with proficiency in Python (BeautifulSoup, Selenium), cloud infrastructure (AWS), containerization (Docker), and LLM frameworks (LangChain, OpenRouter). Strong attention to detail, self-directed problem-solving, and independent troubleshooting are essential. A GitHub link is a plus. Contributors earn up to $30/hour equivalent, with workloads estimated at 10–20 hours/week during active phases.