Crypto Data Engineer

Token Metrics is seeking a talented and adaptable Big Data Engineer to support our Data Scientists and Engineering team. In this role, you will be instrumental in constructing robust data frameworks using tools like SQL, Python, R, Java, and C++. You will leverage machine learning techniques to develop and maintain analytical structures, staying current with leading programming and deployment strategies. Collaboration with colleagues will be key to ensuring project requirements are met throughout the data lifecycle.

Responsibilities

• Collaborate with colleagues and clients to understand and define project requirements.
• Design and implement infrastructure for accessing and analyzing big data.
• Optimize existing data frameworks for enhanced performance.
• Conduct thorough testing to ensure the reliability and usability of data structures.
• Build and manage data pipelines integrating various data sources (API, CSV, JSON, etc.).
• Prepare raw data for efficient manipulation by Data Scientists.
• Implement effective data validation and reconciliation processes.
• Ensure data backup and accessibility for relevant team members.
• Stay abreast of industry best practices and emerging technologies to improve data output quality.

Requirements

• Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or a related discipline. A Master's degree in a relevant field is a significant advantage.
• Minimum of 3 years of professional experience in programming (Python, Java, or similar).
• Minimum of 3 years of experience with SQL & NoSQL databases (Snowflake Cloud DW and MongoDB experience are beneficial).
• Minimum of 3 years of experience in schema design and dimensional data modeling.
• Expert proficiency in SQL, NoSQL, Python, C++, Java, and R.
• Expertise in building Data Lakes, Data Warehouses, or equivalent data storage solutions.
• Expertise in AWS Cloud services.
• Strong analytical and problem-solving capabilities.
• Ability to work effectively both independently and as part of a team.
• Proven ability to manage multiple tasks and prioritize effectively with minimal supervision.