Lead Consultant – Data Engineer.

Genpact is seeking a skilled Lead Consultant – Data Engineer for our Hyderabad, Telangana location. In this pivotal role, you will harness cloud technologies to manage and analyze data, with a strong emphasis on Databricks, Azure Data Factory (ADF), Python, PySpark, and Unity Catalog. You will be instrumental in designing, building, and optimizing scalable data pipelines, ensuring data quality, and collaborating with cross-functional teams to drive advanced analytics and AI initiatives. This is an opportunity to work at the forefront of AI and digital innovation, helping global enterprises transform and achieve their goals.

Responsibilities:

• Data Pipeline Design and Development: Architect, build, and optimize data ingestion and transformation pipelines using Azure ADF and Databricks. Implement data integration and transformation solutions. Develop and deploy data models and solutions using Azure services.
• Data Management and Optimization: Ingest, transform, and wrangle data from diverse sources for advanced analytics. Design, implement, and deploy data loaders. Monitor and optimize data pipelines for performance and reliability.
• Collaboration and Support: Collaborate with cross-functional teams to gather requirements. Provide input to machine learning (ML) and cloud engineers. Assist ML engineers with data preparation and analysis.
• Data Quality and Security: Implement data quality checks, validation rules, and governance policies. Troubleshoot and resolve data-related issues. Implement data security and privacy measures.
• Implement Unity Catalog: Manage data governance and security using Unity Catalog. Develop scalable data ingestion or ETL from Workday and HR systems. Apply data best practices.

Qualifications:

• Bachelor’s degree in computer science, Information Technology, Business, or a related field.
• Proven experience with Databricks, Azure ADF, Python, PySpark, and Unity Catalog.
• Experience with data ingestion or ETL from Workday or other HR systems.
• Experience with RBAC security models in Unity Catalog.
• Exposure to CI/CD DevOps practices.
• Proficiency in PySpark and SQL for data transformation, querying, analysis, and modeling.
• Expertise in Azure Databricks and Azure Data Factory.
• Strong Python programming skills for data manipulation.

Preferred Qualifications:

• Certifications in Azure data engineering or related fields.

Join Genpact to be a transformation leader, drive change for global enterprises, and accelerate your career in AI, automation, and digital innovation.