Clean Harbors•4h ago
Career Pages
Azure Data Engineer
India, TS, Hyderabad, 500018
Full Time
Senior Level
N/A
N/A
N/A
Responsibilities
Qualifications & Requirements
Experience Level: Senior Level
Full Job Description
Clean Harbors is seeking an experienced Azure Data Engineer to join our team in Hyderabad. This role is crucial for designing, implementing, and managing robust data solutions on the Microsoft Azure cloud platform. You will work with diverse Azure data storage options, develop and implement efficient data integration processes, and leverage big data technologies to manage and analyze large datasets. This position also involves supporting AI initiatives and contributing to Power BI reporting.
Responsibilities
- Prioritize health and safety by adhering to all policies, processes, and acting in a safe manner.
- Design scalable, performant, and cost-effective data storage systems that meet organizational requirements.
- Develop and implement data integration processes, utilizing tools like Azure Data Factory, to extract, transform, and load (ETL) data from various sources into Azure data warehouses or data lakes.
- Employ big data technologies such as Apache Spark for handling and analyzing vast volumes of data.
- Collaborate with data scientists to curate datasets and engineer features for AI initiatives.
- Implement and optimize data retrieval processes for Power BI solutions.
Qualifications
- Master’s degree in Computer Science, Statistics, Mathematics, or a related field; a Bachelor’s degree with substantial relevant experience will be considered.
- A minimum of 5 years of data engineering experience with Azure technologies including Azure Data Factory, Azure Synapse Analytics, Azure Stream Analytics, Azure Event Hubs, Azure Data Lake Storage, and Azure Databricks.
- Proven experience in designing and implementing data pipelines and engineering infrastructure for machine learning systems.
- Strong command of data processing languages such as SQL, Python, and Scala.
- Demonstrated experience with AI implementations and Power BI.
- Hands-on experience with Microsoft Azure’s data services, including Azure Machine Learning, Azure Databricks, and Azure Data Factory.
- Familiarity with Azure Cognitive Services for integrating AI capabilities like vision, language, and decision functionalities into applications.
- Proficiency in handling large datasets and experience with data processing tools like SQL, Pandas, and big data technologies such as Apache Spark.
- Proficiency in Python, .NET C#, and API development.
- Experience with SQL, NoSQL databases, and Data Fabric architectures.
- Excellent communication and problem-solving skills, with the ability to think algorithmically and translate complex findings into compelling narratives for non-technical stakeholders.
- Microsoft Certified: Azure Data Engineer Associate certification is preferred.
Company
Clean Harbors
Clean Harbors, Inc. is a leading North American provider of environmental, energy, and industrial services. Founded in 1980 and headquartered near Boston, the NYSE-listed company has grown into a $6.5...
India, TS, Hyderabad, 500018
Posted on Career Pages