Data Engineer

Boston Consulting Group (BCG) is a leading global management consulting firm dedicated to partnering with businesses and society to tackle significant challenges and seize opportunities. BCG was a pioneer in business strategy and continues to drive transformational change for organizations, enabling growth, building competitive advantage, and delivering bottom-line impact. We recognize that success in today's landscape requires a blend of digital and human capabilities. Our diverse, worldwide teams leverage deep industry and functional knowledge, along with varied perspectives, to inspire change. BCG provides cutting-edge solutions through management consulting, technology and design services, and corporate and digital ventures.

As a Data Engineer within BCG's X team, you will collaborate closely with consulting teams on a wide array of advanced analytics and engineering projects. Your role will involve applying analytical methodologies to deliver significant value to BCG's consulting engagements and practice areas by providing essential data engineering expertise. You will be instrumental in designing, developing, and maintaining robust data pipelines, systems, and solutions that enable our clients to make well-informed business decisions. This involves close collaboration with cross-functional teams, including data scientists, analysts, and business stakeholders, to ensure the delivery of high-quality data solutions that precisely meet client requirements.

Key Responsibilities:

• Deliver original analysis and insights to case teams, taking ownership of analytics modules and integrating seamlessly with the case team.
• Design, develop, and maintain efficient and robust data pipelines for extracting, transforming, and loading data from diverse sources into data warehouses, data lakes, and other storage solutions.
• Build scalable, reliable, secure, and cost-effective data-intensive solutions using programming languages such as Python and PySpark.
• Utilize Big Data querying and analysis tools including PySpark, Hive, Snowflake, and Databricks.
• Leverage expertise in at least one major Cloud platform (AWS, GCP, Azure).
• Implement automation and deployment tools like Airflow, Jenkins, and GitHub Actions, alongside infrastructure-as-code technologies such as Terraform and CloudFormation.
• Apply a strong understanding of DevOps principles, CI/CD pipelines, orchestration, and containerization tools like Docker and Kubernetes.
• Demonstrate a foundational understanding of Machine Learning methodologies and pipelines.
• Communicate analytical insights effectively through sophisticated synthesis and packaging of results, including presentations and charts, and collaborate with consultants to capture and integrate case team learnings into new best practices.

Qualifications and Skills:

• Bachelor's or Master's degree in Computer Science, Engineering, or Technology.
• 2-4 years of experience in Data Engineering, with a proven track record of delivering analytics solutions in a commercial setting. Consulting experience is a plus.
• Proficient understanding of distributed computing principles and Spark cluster management.
• Hands-on experience with data engineering tasks such as productizing data pipelines, building CI/CD pipelines, and code orchestration using tools like Airflow and DevOps practices.
• Strong software engineering concepts and best practices, including API design, testing frameworks, and packaging.
• Experience with NoSQL databases (e.g., HBase, Cassandra, MongoDB).
• Knowledge of web development technologies.
• Understanding of machine learning system design and development stages.
• Excellent communication skills for effective collaboration with both technical and non-technical team members.
• Strong analytical and problem-solving abilities with hands-on experience in end-to-end analytics delivery.

You will collaborate with case teams, client technical points of contact, and the broader X team in Gurgaon/Gurugram, India.