IBM•1h ago
Naukri
Data Engineer
Kolkata
Mid Level
N/A
N/A
N/A
Full Job Description
Data Engineer - Data Platforms
Join IBM in Kolkata as an Associate Software Developer focused on Data Engineering. You will leverage the power of data to uncover insights and patterns. Your responsibilities will include contributing to data gathering, storage, and both batch and real-time processing. You will collaborate with diverse teams to select appropriate data management systems and identify critical data for analysis. As a Data Engineer, you will address challenges in database integration and work with complex, unstructured datasets.
Key Responsibilities:
- Implement and validate predictive models, and create/maintain statistical models for big data using various statistical and machine learning techniques.
- Design and implement enterprise search applications such as Elasticsearch and Splunk based on client requirements.
- Work in an Agile, collaborative environment, partnering with scientists, engineers, consultants, and database administrators to apply analytical rigor and statistical methods to predict behaviors.
- Develop reusable programs to cleanse and integrate data efficiently, create predictive or prescriptive models, and evaluate modeling results.
Education:
- Required: Bachelor's Degree
- Preferred: Master's Degree
Technical and Professional Expertise:
- Develop/convert databases (e.g., Hadoop to GCP) for specific objects (tables, views, procedures, functions, triggers) between database platforms.
- Implement specific data replication mechanisms (CDC, file data transfer, bulk data transfer, etc.).
- Expose data as APIs.
- Participate in modernization roadmap journeys, including analysis of discovery and outcome, leading workshops, and identifying application dependencies, source, and target database incompatibilities.
- Analyze non-functional requirements (security, HA, RTO/RPO, storage, compute, network, performance benchmarks, etc.).
- Prepare effort estimates, Work Breakdown Structures (WBS), staffing plans, RACI charts, RAID logs, etc.
- Lead teams in adopting appropriate tools for various migration and modernization methods.
Preferred Experience:
- Excellent verbal and written communication skills, with a strong aptitude for teamwork.
- Ability to communicate with internal and external clients to understand and define business needs, and provide analytical solutions.
- Ability to effectively communicate results to both technical and non-technical audiences.
Company
IBM
Kolkata
Posted on Naukri