Crypto Data Engineer
Responsibilities
Qualifications & Requirements
Experience Level: Senior Level
Full Job Description
Token Metrics is seeking a versatile Big Data Engineer to enhance the capabilities of our Data Scientists and Engineering team. This role involves leveraging a variety of tools and techniques to build robust data frameworks using languages such as SQL, Python, R, Java, and C++. You will apply machine learning methodologies to develop and maintain analytical structures, staying current with dominant programming and deployment strategies in the big data and crypto space. Collaboration with colleagues will be essential to ensure our data solutions align with project requirements.
Responsibilities
- Collaborate with colleagues and clients to clearly define project requirements.
- Design and implement infrastructure for accessing and analyzing large-scale datasets.
- Optimize and refactor existing data frameworks for improved performance.
- Conduct thorough testing of data structures to ensure reliability and fitness for purpose.
- Develop data pipelines to ingest diverse data types from various sources, including APIs, CSV, and JSON.
- Prepare and cleanse raw data to make it readily usable for Data Scientists.
- Implement and maintain rigorous data validation and reconciliation processes.
- Ensure all work is securely backed up and accessible to authorized team members.
- Stay abreast of industry best practices and emerging technologies to continuously improve data output quality.
Requirements
- Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or a closely related field.
- A Master's degree in a relevant discipline is a significant advantage.
- Minimum of 3 years of professional development experience in Python, Java, or another programming language.
- Minimum of 3 years of experience with SQL and NoSQL databases. Experience with Snowflake Cloud DW and MongoDB is a plus.
- Minimum of 3 years of experience in schema design and dimensional data modeling.
- Expert proficiency in SQL, NoSQL, Python, C++, Java, and R.
- Expertise in building Data Lakes, Data Warehouses, or equivalent data storage solutions.
- Extensive experience with AWS Cloud services.
- Exceptional analytical and problem-solving abilities.
- Ability to work effectively both independently and as part of a team.
- Proven capacity to manage multiple tasks and deadlines with minimal supervision.
Company
Token Metrics
Token Metrics is a leading provider of artificial intelligence-driven insights for cryptocurrency investors. We empower individuals and institutions worldwide with advanced tools to build profitable p...