IBM•1h ago
Naukri
Data Engineer
Navi Mumbai
Mid Level
N/A
N/A
N/A
Qualifications
10/10 matched
Experience Level: Mid Level
- </b></li><li> Strong understanding of ETL pipelines
- data modeling
- and data warehousing concepts.</li><li>Strong proficiency in PythonExpertise in Python programming with a focus on data processing and manipulation. Data Processing FrameworksKnowledge of data processing libraries such as Pandas
- NumPy.</li><li>SQL ProficiencyExperience writing optimized SQL queries for large-scale data analysis and transformation.</li><li>Cloud PlatformsExperience working with cloud platforms like AWS
- or GCP
- including using cloud storage systems</li> <br /> <br /> Preferred technical and professional experience <br /> <li>Define
- and implement an architecture strategy and standards for end-to-end monitoring.</li><li>Partner with the rest of the technology teams including application development
- enterprise architecture
- testing services
- network engineering
Full Job Description
Data Engineer - Data Platforms at IBM in Navi Mumbai
Join IBM as a Data Engineer focused on Data Platforms in Navi Mumbai. In this role, you will be instrumental in the development and design of applications, offering essential support and guidance to project teams on complex coding, issue resolution, and execution.
Primary Responsibilities:
- Lead the design and construction of innovative solutions leveraging the latest technologies, prioritizing business value and user requirements.
- Drive continuous improvement through rigorous testing of built solutions within an agile framework.
- Explore and implement cutting-edge technology trends to create optimized and creative solutions.
Required Qualifications:
- Bachelor's Degree
- Experience with Apache Spark, including in-depth knowledge of its architecture, core APIs, and PySpark for distributed data processing.
- Familiarity with Big Data Technologies such as Hadoop, HDFS, and Kafka.
- Strong understanding of Data Engineering principles, including ETL pipelines, data modeling, and data warehousing concepts.
- High proficiency in Python, with a focus on data processing and manipulation.
- Experience with data processing libraries like Pandas and NumPy.
- Proficiency in SQL, capable of writing optimized queries for large-scale data analysis and transformation.
- Experience working with cloud platforms (AWS, Azure, or GCP), including cloud storage systems.
Preferred Qualifications:
- Master's Degree
- Experience in defining, driving, and implementing architecture strategies and standards for end-to-end monitoring.
- Proven ability to partner effectively with cross-functional technology teams, including application development, enterprise architecture, testing services, and network engineering.
- Familiarity with detection and prevention tools for company products, platforms, and customer-facing applications is a plus.
Company
IBM
Navi Mumbai
Posted on Naukri