Astar Data•1h ago
Naukri
Data Engineer
Hybrid - Gurugram
Full Time
Mid Level
N/A
N/A
N/A
Responsibilities
Qualifications & Requirements
Experience Level: Mid Level
Full Job Description
Data Engineer - Big Data Architect
Astar Data, based in Gurugram, is seeking a detail-oriented and self-starting Data Engineer to join a dynamic team focused on building world-class, large-scale Big Data architectures. This role offers a hybrid work model. You will collaborate with engineering and analytics teams, contributing to projects for a diverse clientele ranging from startups to Fortune 500 companies. Your primary focus will be on coding and developing robust Big Data solutions.
Key Responsibilities:
- Embrace and implement excellent development practices, including check-in policies, unit testing, and code deployment.
- Be a hands-on coder proficient in languages like Python or PySpark, with extensive experience in the Big Data stack including Hadoop, MapReduce, Spark, HBase, and Elasticsearch.
- Demonstrate a strong understanding of programming principles and development best practices.
- Show initiative in learning new concepts and technologies, translating them into scalable engineering solutions.
- Gain valuable experience in application development, integration development, and data management.
- Engage directly with clients across leading Fortune 500 companies on a daily basis to understand and align with their strategic initiatives.
- Stay current with the latest technological advancements to maximize ROI for both customers and Astar Data.
- Design and implement APIs, abstractions, and integration patterns to address complex distributed computing challenges.
- Define technical requirements, manage data extraction and transformation, automate job execution, productionize data pipelines, and explore new Big Data technologies within parallel processing environments.
- Contribute to a culture of strategic thinking, unconventional problem-solving, and analytical, data-driven decision-making.
- Bring raw intellect, talent, and energy to a fast-paced, entrepreneurial, and agile private company.
- Excel as both a leader and a hands-on contributor.
Qualifications:
- Proven track record of relevant work experience.
- A degree in Computer Science or a related technical discipline is required.
- Must have hands-on experience with functional and object-oriented programming in Python or PySpark.
- Extensive hands-on experience with the Big Data stack, including Hadoop, MapReduce, Spark, HBase, and Elasticsearch.
- Solid understanding of AWS services and experience working with APIs and microservices.
- Excellent written and verbal communication skills.
- Ability to collaborate effectively with a diverse group of engineers, data scientists, and product managers.
- Comfort working in a fast-paced startup environment.
Preferred Qualifications:
- Experience with agile methodologies.
- Proficiency in database modeling and development, data mining, and data warehousing.
- Experience in the architecture and delivery of enterprise-scale applications, including developing frameworks and design patterns.
- Ability to understand and tackle complex technical challenges, propose comprehensive solutions, and mentor junior staff.
- Experience working with large, complex datasets from a variety of sources.
Company
Astar Data
Hybrid - Gurugram
Posted on Naukri