Databricks Senior Developer at Cognizant, Pune

Cognizant is seeking a highly skilled Senior Developer with 7 to 10 years of experience for a hybrid role in Pune, Maharashtra, India. This position offers day shifts and involves working on innovative projects.

About the Role

We are looking for an expert in Python, Databricks SQL, Databricks Workflows, and PySpark. You will be instrumental in developing and maintaining scalable data processing systems, collaborating with cross-functional teams to design and implement efficient data operations, and optimizing Databricks SQL queries for improved performance. Your responsibilities will include providing technical expertise in Python, overseeing data source integration, ensuring data quality and integrity, troubleshooting complex technical issues, and contributing to the continuous improvement of data processing frameworks.

Key Responsibilities

• Develop and maintain scalable data processing systems using Python and PySpark to enhance data analytics capabilities.
• Collaborate with cross-functional teams to design and implement Databricks Workflows that streamline data operations.
• Optimize Databricks SQL queries to improve data retrieval performance and ensure efficient data management.
• Provide technical expertise in Python programming to support the development of robust data solutions.
• Oversee the integration of data sources into Databricks environments to facilitate seamless data processing.
• Ensure data quality and integrity by implementing best practices in data validation and error handling.
• Troubleshoot and resolve complex technical issues related to Databricks and PySpark environments.
• Contribute to the continuous improvement of data processing frameworks and methodologies.
• Mentor junior developers and provide guidance on best practices in data engineering.
• Collaborate with stakeholders to gather requirements and translate them into technical specifications.
• Conduct code reviews to ensure adherence to coding standards and best practices.
• Stay updated with the latest industry trends and technologies to drive innovation in data engineering.
• Document technical processes and workflows to support knowledge sharing and team collaboration.

Required Qualifications

• Strong proficiency in Python programming and its application in data engineering.
• Expertise in Databricks SQL and its use in optimizing data queries.
• Hands-on experience with Databricks Workflows for efficient data processing.
• Proficiency in PySpark for developing scalable data solutions.
• Excellent problem-solving skills and the ability to troubleshoot complex technical issues.
• Solid understanding of data integration techniques and best practices.
• Strong communication skills to collaborate effectively with cross-functional teams.

Certifications

Databricks Certified Data Engineer Associate and Python Institute PCEP Certification are required.