Crypto Data Engineer
Responsibilities
Qualifications & Requirements
Experience Level: Senior Level
Full Job Description
Astra DAO is seeking a multi-talented Big Data Engineer to support our Data Scientists and Engineering team. As a Big Data Engineer, you will be instrumental in constructing robust frameworks using tools and techniques like SQL, Python, R, Java, and C++. You will leverage machine learning techniques to build and maintain data analysis structures, staying current with dominant programming and deployment strategies. Collaboration with team members will be key to ensuring project needs are met throughout the development process.
Responsibilities
- Collaborate with colleagues and clients to understand and define project requirements.
- Design and build infrastructure for accessing and analyzing big data.
- Optimize existing data frameworks for improved performance.
- Conduct thorough testing to ensure the functionality and reliability of data structures.
- Develop data pipelines from various sources (APIs, CSV, JSON, etc.) handling diverse data types.
- Prepare raw data for efficient manipulation by Data Scientists.
- Implement effective data validation and reconciliation methodologies.
- Ensure proper data backup and accessibility for relevant team members.
- Stay informed about industry best practices and emerging technologies to enhance output quality.
Requirements
- Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or a related field.
- A Master's degree in a relevant field is a significant advantage.
- Minimum of 3 years of development experience in Python, Java, or any other programming language.
- Minimum of 3 years of experience with SQL and NoSQL databases (Snowflake Cloud DW and MongoDB experience is a plus).
- Minimum of 3 years of experience in schema design and dimensional data modeling.
- Expert proficiency in SQL, NoSQL, Python, C++, Java, and R.
- Expertise in building Data Lakes, Data Warehouses, or equivalent data storage solutions.
- Expertise in AWS Cloud services.
- Strong analytical and problem-solving capabilities.
- Ability to work effectively both independently and as part of a team.
- Capacity to manage multiple tasks and responsibilities with minimal supervision.
Company
Astra DAO
Astra DAO is a cutting-edge automated crypto asset allocator built on the Ethereum blockchain. We offer advanced investment strategies to retail participants through an innovative model that creates m...