Senior Member

D. E. Shaw is a global investment and technology development firm managing over $90 billion in investment capital as of March 1, 2026, with offices across North America, Europe, and Asia. Since its inception in 1988, the firm has built an international reputation for successful investing, driven by innovation, meticulous risk management, and the caliber of its staff. D. E. Shaw maintains a significant presence in global capital markets, investing in a diverse range of companies and financial instruments in both developed and developing economies.

We are seeking resourceful and exceptional candidates for the Data Engineer role within our product development teams in Hyderabad, Bengaluru, and Gurugram. At DESIS, Data Engineers develop Web Robots (Web Spiders) to crawl the web and retrieve data in various formats including HTML, plain text, PDFs, and Excel, for both structured and unstructured data. Key responsibilities include scraping website data into a structured format, building automated and custom reports for business intelligence, and automating end-to-end data pipelines.

What You'll Do Day-to-Day:

As a Data Engineering team member, you will be instrumental in various aspects of data extraction. This includes understanding business group data requirements, reverse-engineering websites and their data retrieval processes, developing web robots to automate data extraction, and building monitoring systems to ensure data integrity and quality. You will also manage changes in website dynamics and layouts for clean downloads, construct scraping and parsing systems to transform raw data into structured formats, and provide operational support for high availability and zero data loss. Additional tasks involve storing extracted data in recommended databases, building high-performing, scalable data extraction systems, and automating data pipelines.

Who We're Looking For:

Basic Qualifications:

• 2 to 4 years of experience in website data extraction and scraping.
• Strong knowledge of relational databases, writing complex SQL queries, and performing ETL operations.
• Proficiency in Python for data manipulation and processing.
• Expertise in Python frameworks such as Requests, UrlLib2, Selenium, Beautiful Soup, and Scrapy.
• A solid understanding of HTTP requests and responses, HTML, CSS, XML, JSON, and JavaScript.
• Proficiency with Chrome's debugging tools for reverse-engineering website dynamics.
• A strong academic background and demonstrable accomplishments.
• A BCA/MCA/BS/MS degree with a robust foundation and practical application of knowledge in data structures and algorithms.
• Excellent problem-solving and analytical skills.
• Strong debugging capabilities.

Interested candidates can apply via our website: https://www.deshawindia.com/recruit/jobs/Ads/Link/SrDataExtEnggDec25

We encourage candidates with relevant experience looking to restart their careers after a break to apply. Learn about Recommence, our gender-neutral return-to-work initiative.

The Firm offers excellent benefits, a casual, collegial working environment, and an attractive compensation package. For more details on our recruitment process and applicant data handling, please visit https://www.deshawindia.com/careers.

Members of the D. E. Shaw group are committed to non-discrimination in employment based on sex, race, color, caste, creed, religion, pregnancy, national origin, age, military service eligibility, veteran status, sexual orientation, marital status, disability, or any other protected class.