
Data Engineer
Responsibilities
Qualifications & Requirements
Experience Level: Mid Level
Full Job Description
About the Role
Join Eaton during this exciting era of power management, where we are reimagining innovation by adapting digital technologies—connected devices, data models, and insights—to transform power management for safer, more sustainable, and more efficient power use. Our teams collaborate to build the best digital solutions for our customers.
We are seeking a Data Engineer to be based in Pune, India. At Eaton, making our work exciting, engaging, and meaningful, ensuring safety, health, and wellness, and being a model of inclusion & diversity are embedded in our values, vision, and aspirational goals.
The Center for Intelligent Power at Eaton Corporation is looking for a Data Engineer responsible for designing, developing, and maintaining our data infrastructure and systems. You will collaborate with cross-functional teams to understand data requirements, implement data pipelines, and ensure the availability, reliability, and scalability of our data solutions.
You should be proficient in several programming languages and understand the end-to-end software development cycle, including CI/CD and software release processes. Additionally, you will be responsible for developing and maintaining Power BI reports and dashboards, ensuring they meet business requirements and provide actionable insights. You will work closely with stakeholders to gather requirements and deliver high-quality data visualizations that drive decision-making.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and data integration processes to extract, transform, and load (ETL) data from various sources into our data warehouse or data lake.
- Collaborate with stakeholders to understand data requirements and translate them into efficient and scalable data engineering solutions.
- Optimize data models, database schemas, and data processing algorithms to ensure efficient and high-performance data storage and retrieval.
- Implement and maintain data quality and data governance processes, including data cleansing, validation, and metadata management.
- Work closely with data scientists, analysts, and business intelligence teams to support their data needs and enable data-driven decision-making.
- Develop and implement data security and privacy measures to ensure compliance with regulations and industry best practices.
- Monitor and troubleshoot data pipelines, identifying and resolving performance or data quality issues in a timely manner.
- Stay up-to-date with emerging technologies and trends in the data engineering field, evaluating and recommending new tools and frameworks to enhance data processing and analytics capabilities.
- Build insights using various BI tools, including Power BI.
- Collaborate with infrastructure and operations teams to ensure the availability, reliability, and scalability of data systems and infrastructure.
- Mentor and provide technical guidance to junior data engineers, promoting best practices and knowledge sharing.
Qualifications
- Bachelor's degree from an accredited institution.
- 3+ years of experience in Data Engineering and Power BI.
- 3+ years of experience in data analytics.
Skills
- Proficiency in Apache Spark and Python.
- Experience with Azure services such as Data Bricks, Docker, and Function App.
- Familiarity with Git.
- Working knowledge of Airflow.
- Knowledge of Kubernetes and Docker.
- Expertise in Power BI, including:
- Data Visualization: Creating interactive and visually appealing dashboards and reports.
- Data Modeling: Designing and implementing data models, relationships, hierarchies, and calculated columns/measures.
- DAX (Data Analysis Expressions): Creating complex calculations and aggregations.
- Power Query: Data transformation and preparation.
- Integration: Integrating Power BI with various data sources (SQL databases, Excel, cloud services).
- Performance Optimization: Optimizing Power BI reports for performance and scalability.
- Security: Implementing row-level security and managing user access.
- Collaboration: Sharing and collaborating on Power BI reports and dashboards.
- Best Practices: Familiarity with Power BI best practices and staying updated with the latest features.
- Proficiency in using Power BI.
- Background in SQL and experience working with relational databases.
- Bachelor's Degree in Computer Science, Software Engineering, or Information Technology.
- Experience with Cloud Development Platforms such as Azure and AWS, and their associated data storage options.
- Experience with CI/CD (Continuous Integration/Delivery) tools like Jenkins, GIT, and Travis-CI.
- Experience with virtual build environments (Containers, VMs, Microservices) and container orchestration (Docker Swarm, Kubernetes/Red Hat OpenShift).
- Experience with relational and non-relational database systems, including SQL, Postgres SQL, NoSQL, MongoDB, and CosmosDB.