Data Engineer

Job Summary: A Data Engineer is sought to lead the architecture, design, and development of data warehousing solutions. This role involves technical guidance, ensuring best practices in data warehousing and ETL/ELT processes, and developing robust data integration pipelines. The Data Engineer will leverage Snowflake and AWS Glue for data management and optimization, and apply AI/ML concepts, including integrating solutions like Cortex AI and AWS Bedrock. Domain expertise in Finance, Accounts, and Manufacturing is crucial for developing tailored data solutions. Collaboration with stakeholders to gather and analyze business requirements is a key responsibility.

Responsibilities:

• Lead the architecture, design, and development of data warehousing solutions.
• Provide technical guidance and mentorship to the data engineering team.
• Ensure best practices in data warehousing, ETL/ELT processes, and data integration.
• Design, develop, and optimize ETL/ELT pipelines using industry-standard tools.
• Ensure data accuracy, integrity, and consistency across data sources.
• Monitor and troubleshoot ETL/ELT processes for timely and accurate data loading.
• Implement and manage data warehousing solutions using Snowflake.
• Utilize AWS Glue for data integration and ETL/ELT tasks.
• Optimize data storage and retrieval processes for enhanced performance.
• Apply AI/ML concepts to extract insights from large datasets.
• Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.
• Leverage knowledge in Finance, Accounts, and Manufacturing to understand business requirements.
• Develop data solutions that address specific needs within these domains.
• Collaborate with stakeholders to gather and analyze business requirements.

Requirements:

• Overall, 3 to 5 years of experience, with 2+ years in Data Analytics and Digital solutions, including exposure to Lakehouse architecture.
• B.Tech in Computer Science or IT.
• Technical expertise in data models, data mining, and segmentation techniques.
• Knowledge of programming languages (e.g., Java and Python) and hands-on experience with SQL database design.
• Exposure to Cortex AI, AWS Bedrock, Copilot Studio (good to have).
• Strong analytical and problem-solving skills.
• Strong influencing and communication skills (written, verbal, presentation) with the ability to be a thought partner/coach.
• Exposure to Cloud ETL/ELT, Cloud DWH, AI and ML tools.
• Domain expertise in Finance, Accounts, and Manufacturing.
• Exposure to agile software development and/or development management.
• Positive attitude and motivation to deliver high-quality results.
• Ability to respond positively and calmly to shifting priorities, demands, and timelines.