Data Engineer

About The Role:

Join our data engineering team to support and enhance our data initiatives. You will collaborate closely with senior engineers to design, construct, and manage scalable data pipelines on the Azure platform. This is an excellent opportunity for professional development in a dynamic environment.

Key Responsibilities:

• Assist in the development and maintenance of ETL/ELT pipelines utilizing Azure Data Factory.
• Create, refine, and test data transformation workflows using Azure Databricks, with PySpark and SQL.
• Engage with stakeholders to understand data requirements and support analytical and reporting needs.
• Aid senior engineers in architecting scalable and secure data solutions.
• Conduct data validation and quality checks to ensure data integrity and reliability.
• Monitor, troubleshoot, and optimize data pipelines for peak performance and cost-efficiency.
• Collaborate effectively with data analysts, data scientists, and other engineering teams.

Required Skills & Experience:

• A minimum of 13 years of experience in a Data Engineer role or a related data-focused position.
• Demonstrated hands-on experience with Azure Databricks, including PySpark and Delta Lake.
• Proficiency in Azure Data Factory, covering pipelines, triggers, and activities.
• Solid understanding of SQL, including optimization techniques, joins, and fundamental data modeling principles.
• Familiarity with Azure storage solutions such as ADLS Gen2 and Blob Storage.
• Basic knowledge of CI/CD concepts and version control systems like Git.
• Excellent problem-solving abilities and a proactive approach to learning new technologies.

Good to Have:

• Prior exposure to Azure Synapse, Azure Functions, or event streaming services like Event Hub/Kafka.
• Experience working with both structured and unstructured datasets.
• Proficiency in Python for scripting purposes.
• Knowledge of data warehousing concepts, including Star and Snowflake schemas.

Why Join Us:

• Gain invaluable experience working alongside seasoned data engineers and accelerate your career growth.
• Engage with modern data platforms and leverage cutting-edge Azure technologies.
• Benefit from a supportive work environment that fosters learning, ownership, and innovation.
• Contribute significantly to end-to-end data engineering projects.