Project Partner

Role
Senior Data Engineer (Project Partner)

Location
Kolkata, West Bengal, India

Employment Type
Contractual

Report To
Manager-AID

Values

• Challenge: Innovate through insight
• Honesty: Do the right thing
• Accountability: Commit to acting with a sense of ownership
• Reliability: Gain the trust of customers
• Teamwork: Build a strong team
• Safety: Pursue the world’s highest level of safety culture

Areas of Responsibilities

• Understand business requirements for analytics and data interpretation.
• Be involved in discussions relating to the technical and functional design of sprints/modules/projects.
• Design and implement end-to-end data solutions (storage, integration, processing, visualization) in Azure.
• Ingest data into Azure Data Lake Storage (ADLS) from various sources such as SQL Server, Excel, Oracle, Azure SQL, etc.
• Extract data from one database and load it into another.
• Build data architecture for ingestion, processing, and surfacing of data for large-scale applications.
• Utilize various scripting languages to combine systems, understanding their nuances and benefits.
• Research and discover new methods to acquire data and new applications for existing data.
• Collaborate with other members of the data team, including data architects, data analysts, and data scientists.
• Prepare datasets for analysis and interpretation.
• Perform statistical analysis and fine-tuning using test results.
• Create libraries and extend existing frameworks.
• Create design documents based on discussions and assist in providing technical solutions for business processes.

Required Skill Set

• In-depth understanding of database management systems, Online Analytical Processing (OLAP), and ETL (Extract, Transform, Load) frameworks.
• Knowledge in Azure SQL Database, Azure Data Lake, Azure Data Factory (ADF), and Azure Blob Storage.
• Recreate existing application logic and functionality in the Azure Data Lake, Data Factory, SQL Database, and SQL Data Warehouse environment.
• Demonstrate strong technical leadership by making architectural decisions and guiding the team in data pipeline design.
• Communicate effectively with stakeholders to align on technical requirements across product, analytics, and infrastructure teams.
• Provide mentoring and technical guidance to mid-level and junior members to support their skill development.

Educational Background
M.Tech / B.E / B.Tech / MCA

Preferred Work Experience
6-9 years of relevant experience.