DE-NCLC-Power BI plus Azure Data Ar...

Azure Data Architect / Azure Lead Data Engineer – Consulting

Join EY's GDS Consulting team as a Digital & Emerging specialist, focusing on Microsoft accounts. You will work with cutting-edge Microsoft BI technologies and collaborate across Consulting services to deliver innovative data solutions.

The Opportunity

We are seeking experienced professionals with expertise in Azure and Data Engineering to join our Data Platform team in Noida, India. This is an excellent opportunity to contribute to a leading firm and significantly impact the growth of our service offerings.

Key Responsibilities:

• Design and implement scalable Azure/Microsoft Fabric data architectures for batch and real-time processing.
• Develop and optimize ETL/ELT pipelines using Azure Data Factory, Azure Synapse, Azure Databricks, or Microsoft Fabric.
• Build and maintain data integration solutions with PySpark and ADLS.
• Implement data models and storage solutions in Azure SQL and Synapse for analytics and reporting.
• Manage data ingestion from diverse sources including APIs, databases, and streaming platforms.
• Ensure data quality, consistency, and security across the data platform.
• Design and develop real-time data processing solutions using Azure Event Hub, Azure Stream Analytics, and Azure Functions.
• Facilitate seamless integration for streaming data pipelines and event-driven architectures.
• Collaborate with data scientists, analysts, and business stakeholders to define data requirements.
• Translate business needs into effective technical solutions and provide expert data engineering guidance.
• Optimize data pipelines for performance, scalability, and cost-efficiency.
• Implement and enforce best practices for data governance, security, and compliance.
• Stay abreast of the latest Azure data services and technologies to drive innovation.
• Mentor junior engineers and lead technical discussions within the team.

Skills and Attributes for Success:

• Collaborate with engagement team members on planning, risk assessments, and work program development.
• Ability to manage senior stakeholders effectively.
• Proven experience leading teams to deliver high-quality results within project timelines.

Must-Have Skills:

• Expertise in designing and developing Power BI/Power BI Fabric integration and reporting solutions.
• Proficiency in Azure Databricks or Azure Synapse for data processing and analytics.
• Expertise in PySpark for big data processing and transformations.
• Strong experience with Azure Data Factory (ADF) for orchestration and ETL/ELT processes.
• Solid knowledge of Azure SQL and ADLS for data storage and querying.

Good-to-Have Skills:

• Familiarity with Azure Event Hub and Azure Stream Analytics for real-time data processing.
• Experience with Azure Functions and Logic Apps for event-driven workflows.
• Knowledge of Python for data manipulation and scripting.
• Understanding of Dataverse for data integration.
• Excellent written and communication skills.
• Ability to deliver compelling technical demonstrations.
• A quick learner with a "can-do" attitude.
• Demonstrate and apply strong project management skills, fostering teamwork and accountability.

Certifications (Preferred):

• DP-203: Data Engineering on Microsoft Azure.
• DP-600/DP-700: Fabric Data Analyst/Fabric Data Engineer.
• Databricks Data Engineer Associate or Professional Certification.
• Databricks Certified Associate Developer for Apache Spark.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• Minimum 8 years of overall IT experience, with at least 5 years in data analytics and data engineering.
• Proven track record of designing and implementing large-scale data solutions.
• Strong problem-solving abilities and capacity to thrive in a fast-paced environment.

Ideally, you'll also have:

• Analytical ability to manage multiple projects and prioritize tasks effectively.
• Ability to operate independently with minimal supervision.

What working at EY offers:

At EY, we are committed to supporting our clients, from emerging startups to Fortune 500 companies, across a diverse range of industries. We provide opportunities to work on inspiring and meaningful projects, with a strong focus on education, coaching, and practical experience for your professional development. You will have the autonomy to control your career progression with an individual development plan, quickly taking on responsible and challenging assignments within an interdisciplinary environment that values high quality and knowledge sharing. Additionally, we offer:

• Support, coaching, and feedback from engaging colleagues.
• Opportunities to develop new skills and advance your career.
• The freedom and flexibility to manage your role effectively.

EY is dedicated to building a better working world, fostering long-term value for clients, people, and society, and strengthening trust in capital markets. Enabled by data and technology, our diverse global teams provide assurance and help clients grow, transform, and operate.