BIU:Data Engineer

Axis Bank, specifically the BIU team in Mumbai or Bangalore, is seeking a Data Engineer with approximately 2 years of hands-on experience. This role is crucial for building and optimizing scalable data pipelines using PySpark within distributed platforms like Hadoop/Spark ecosystems (HDFS, Hive, Yarn). The Data Engineer will be responsible for developing ETL processes, ensuring data quality, implementing data validation, and performing data modeling for analytical datasets. Key responsibilities include debugging production issues, tuning Spark jobs for performance, collaborating with cross-functional teams to meet requirements, and maintaining high standards of documentation and coding practices. A strong foundation in PySpark, SQL, data warehousing concepts, and analytical problem-solving is essential. Experience with Informatica PowerCenter/IICS is considered a plus.