Staff Data Engineer - Pune, India

Company: BP

Location: India - Pune

Entity: Technology

Job Family Group: IT&S Group

We are seeking a highly skilled Senior Data Engineer to join our Agile software delivery team, working within an Agile Scrum framework. This role is integral to delivering business analysis and consulting activities for our specialized domain, leveraging sophisticated technical capabilities. You will be responsible for building and maintaining effective working relationships with various customers, ensuring adherence to relevant standards, and implementing process and system improvements to drive business value.

Key Responsibilities:

• Participate actively in daily scrums, sprint reviews, retrospectives, and backlog prioritization.
• Coach, mentor, and support the data engineering squad in all aspects of data engineering and solutions development, including requirements gathering, analysis, design, coding, testing, implementation, and operational support.
• Collaborate closely with the Product Owner to understand requirements and user stories, and to plan and estimate delivery timelines.
• Proactively engage with Product Owners, Data Architects, Data Scientists, Business Analysts, and Visualization Developers to achieve acceptance criteria.
• Utilize and excel with tools and techniques such as AWS Data Lake, Redshift, Glue, and Spark SQL, Athena.

Years of Experience: 13-15

Essential Domain Expertise:

• Proven experience with Big Data Technologies, including AWS, Redshift, Glue, and PySpark.
• Experience with MPP (Massive Parallel Processing) databases such as Teradata and Netezza is beneficial.
• Understanding of challenges in Big Data environments, including large table sizes and data distribution.
• Proficiency in programming languages like SQL and Python.
• Experience in Data Modeling, including Third Normal Form and Dimensional Modelling.
• Strong Data Pipelining skills, including data blending.
• Experience with data visualization tools such as Tableau and Power BI is a plus.
• Expertise in Data Management, covering Data Quality and Security.
• Experience working in a cloud environment, specifically AWS.
• Familiarity with Development/Delivery methodologies, including Agile and SDLC.
• Experience working in a geographically disparate team.

Travel Requirement: Up to 10% travel is expected.

Relocation Assistance: Eligible for relocation within the country.

Remote Type: Hybrid of office and remote working.

Skills: Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem Solving.

Equal Opportunity Employer: BP is an equal opportunity employer and values diversity. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Adjustments/accommodations for individuals with accessibility needs in the recruitment process can be requested.

Contingent Employment: Depending on the role, employment may be contingent upon adherence to local policy, including pre-placement drug screening, medical review, and background checks.