IBM•2h ago
Naukri
Data Engineer
Pune
Mid Level
N/A
N/A
N/A
Full Job Description
As a Software Developer specializing in Data Integration at IBM in Pune, you will leverage the power of data to uncover compelling insights and intricate patterns. Your role will involve contributing to data gathering, storage, and both batch and real-time processing pipelines.
In close collaboration with diverse teams, you will play a pivotal part in selecting the most suitable data management systems and identifying critical data essential for insightful analysis. As a Data Engineer, you will be instrumental in overcoming challenges related to database integration and deciphering complex, unstructured datasets.
Responsibilities may include:
- Implementing and validating predictive models, alongside creating and maintaining statistical models focused on big data, incorporating a variety of statistical and machine learning techniques.
- Designing and implementing enterprise search applications, such as Elasticsearch and Splunk, to meet client requirements.
- Working within an Agile, collaborative environment, partnering with scientists, engineers, consultants, and database administrators from various backgrounds to apply analytical rigor and statistical methods to predict behaviors.
- Building teams or writing programs to cleanse and integrate data efficiently and reusably, developing predictive or prescriptive models, and evaluating modeling results.
Qualifications:
Required Education: Bachelor's Degree
Preferred Education: Master's Degree
Required Technical and Professional Expertise:
- Extensive experience with Continuous Flow Graph tools for point-based development.
- Proficiency in designing, developing, and maintaining ETL processes using Ab Initio tools.
- Skilled in writing, testing, and deploying Ab Initio graphs, scripts, and other necessary components.
- Aptitude for troubleshooting and resolving data processing issues, along with performance optimization.
- Data Integration: Expertise in extracting, transforming, and loading data from various sources into data warehouses, operational data stores, or other target systems.
- Experience working with diverse data formats, including structured, semi-structured, and unstructured data.
Preferred Technical and Professional Experience:
- Demonstrated ability to thrive in a team environment with excellent verbal and written communication skills.
- Capacity to engage with internal and external clients to understand and define business needs, offering analytical solutions.
- Ability to effectively communicate findings to both technical and non-technical audiences.
Company
IBM
Pune
Posted on Naukri