Data Engineer

Responsibilities:

• Analyze and organize raw data to derive actionable insights.
• Build and maintain robust data systems and pipelines, with a focus on technologies like Apache Nifi.
• Evaluate business needs and translate them into technical objectives.
• Identify and interpret complex trends and patterns within datasets.
• Conduct in-depth data analysis and effectively report on findings.
• Prepare data for advanced analytical techniques, including prescriptive and predictive modeling.
• Develop and implement algorithms and prototypes to solve business challenges.
• Integrate and combine information from diverse data sources.
• Continuously explore and implement methods to enhance data quality and reliability, leveraging tools such as Spark.
• Utilize Airflow for scheduling and executing complex py-spark jobs.
• Identify strategic opportunities for data acquisition.
• Develop and maintain analytical tools and programs to support data initiatives.
• Collaborate closely with data scientists and architects on critical projects.

Requirements and Skills:

• Possess 2-3 years of dedicated experience as a Data Engineer.
• Demonstrate technical expertise in data modeling, data mining, and segmentation techniques.
• Proficient in programming languages such as Java and Python.
• Exhibit hands-on experience with SQL database design and implementation.
• Showcase strong numerical and analytical skills, with a keen eye for detail.
• Hold a Bachelor's Degree in Computer Science, IT, or a related field; a Master's degree is advantageous.
• A Data Engineering certification, such as IBM Certified Data Engineer, is a plus.