IN_Senior Associate_Data Engineer_E...

About the Role

Join PwC's Software & Product Innovation team in Emerging Businesses to deliver cutting-edge solutions using AI, blockchain, and IoT.

Key Responsibilities:

• Design, build, and maintain robust ETL/ELT pipelines on Azure (Databricks/HDInsight) using Apache Spark (PySpark/Scala).
• Orchestrate complex data workflows with Azure Data Factory and Databricks Jobs.
• Manage secure data lakes on ADLS Gen2 with Delta Lake, optimizing for performance and cost.
• Implement end-to-end data quality, testing, observability, and governance (AAD RBAC, Key Vault).
• Collaborate cross-functionally to deliver trusted datasets for BI, ML, and applications.
• Contribute to IaC, CI/CD pipelines, incident response, and continuous improvement initiatives.

Mandatory Skills:

6+ years of Data Engineering experience on Azure; Expert-level Spark (PySpark/Scala); Hands-on Databricks/Azure HDInsight; Advanced Python & SQL; Strong data modeling with Parquet/ORC/Avro; Git proficiency.

Preferred Skills:

Kafka/Event Hubs, Terraform/Bicep, Docker/AKS, Snowflake/Synapse integration, and PII/security compliance knowledge.