PySpark

PySpark/Scala Developer Job Opportunity in Chennai

Tata Consultancy Services is seeking an experienced PySpark/Scala Developer to join their team in Chennai, Tamil Nadu. This role focuses on working with a leading bank's Risk Management team on specific projects and requirements related to risk models in consumer and wholesale banking.

Key Responsibilities:

• Develop, fine-tune, and implement programs and applications using Python, PySpark, and Scala on Big Data/Hadoop platforms.
• Enhance Machine Learning models using PySpark or Scala.
• Collaborate with Data Scientists to build ML models based on business requirements and manage the full ML lifecycle from development to production deployment.
• Participate in feature engineering, model training, scoring, and retraining processes.
• Architect data pipelines and automate data ingestion and model jobs.

Required Skills and Competencies:

• A minimum of 5 years of professional experience.
• Strong analytical skills for sophisticated statistical analysis using bureau/vendor data, customer performance data, and macro-economic data.
• Proven working experience with PySpark and Scala for developing and validating models and code in Credit Risk/Banking domains.
• Experience with distributed systems such as Hadoop/MapReduce, Spark, and streaming data processing.
• Familiarity with cloud architecture.
• Proficiency with machine learning frameworks and libraries (e.g., scikit-learn, SparkML, TensorFlow, PyTorch).
• Experience in systems integration, web services, and batch processing.
• Experience migrating codes to PySpark/Scala is considered a significant advantage.
• Ability to act as a liaison between business and IT, communicating business needs to IT and data constraints to the business, aligning business strategy with IT strategy and processes.

Good to Have Skills:

• Exposure to Machine Learning Techniques.

This is a technology role within the function of Developer.