Staff Data Engineer

BP is seeking a Staff Data Engineer in Pune, India, to join its Technology division within the IT&S Group. As a Data Engineer, you will be instrumental in designing, constructing, installing, testing, and maintaining highly scalable data management systems. Your role will involve building the infrastructure for generating, collecting, and analyzing large datasets, developing and maintaining architectures like databases and large-scale processing systems, and ensuring these architectures support data analytics and prepare data for predictive modeling.

Key responsibilities include developing data set processes for data modeling and mining, integrating new data management technologies, and collaborating with data scientists and analysts to ensure data accuracy and accessibility. You will be part of a cross-disciplinary team, working closely with software engineers, data scientists, data managers, and business partners. This role requires independently identifying problems, architecting, designing, implementing, and maintaining reliable and scalable data infrastructure. You will act as a tech lead for projects, manage project delivery using agile methodologies, and write, deploy, and maintain software for data management and quality assurance at BP.

Adherence to software engineering best practices, including technical design, unit testing, monitoring, code reviews, and documentation, is essential. You will be responsible for deploying secure and well-tested software that meets privacy and compliance requirements, and for developing and improving CI/CD pipelines. Site Reliability Engineering best practices, including on-call rotations, SLA definition, and infrastructure as code, are also key aspects of this role. You will contribute to improving developer velocity and engineering excellence, participate in industry working groups for standard evolution, and mentor others in data engineering.

To succeed in this role, you will need typically 8+ years of deep, hands-on experience in designing, planning, productionizing, maintaining, and documenting reliable and scalable data infrastructure and data products in complex environments. Proficiency in one or more object-oriented programming languages such as Spark, Python, Scala, Java, or C# is required, along with experience on RDBMS. Strong knowledge of databases, SQL, and data modeling is essential. You should possess deep knowledge and hands-on experience across the data lifecycle, staying current with industry developments. Excellent stakeholder management skills and the ability to lead large initiatives through technical influence are crucial. A continuous learning and improvement mindset is expected. A BS degree in computer science or a related field, or equivalent knowledge and experience, is required.

While prior experience in the energy industry is not required, a strong foundation in data engineering principles and practices is valued. This hybrid role involves up to 10% travel and is eligible for relocation assistance within India. BP is an equal opportunity employer committed to diversity and inclusion.