Data Engineer - Delhi / NCR (Hybrid)
Astar Data
Join Astar Data as a Software Development Engineer and contribute to building cutting-edge, large-scale Big Data architectures. This hybrid role in Delhi/NCR offers a fantastic opportunity for a detail-oriented self-starter to work with a growing team.
You will be a hands-on coder, primarily focusing on Python or Pyspark, and leverage your expertise in the Big Data ecosystem including Hadoop, Mapreduce, Spark, Hbase, and ElasticSearch. A solid understanding of programming principles, development practices (check-in policy, unit testing, code deployment), and enterprise-level code is essential. We are looking for individuals with excellent application development, integration, and data management experience.
As part of our team, you'll interface daily with Fortune 500 clients to understand their strategic requirements and align our solutions with their key initiatives. Staying abreast of the latest technologies to maximize ROI for both clients and Astar Data is crucial. You will design and implement APIs, abstractions, and integration patterns to tackle complex distributed computing challenges, and gain experience in defining technical requirements, data extraction and transformation, automating and productionizing jobs, and exploring new big data technologies in parallel processing environments.
We seek strategic thinkers with an unconventional, out-of-the-box approach. An analytical, data-driven orientation, raw intellect, talent, and energy are critical. The ideal candidate possesses an entrepreneurial spirit, understands the demands of a high-growth private company, and can excel as both a leader and a hands-on contributor.
Responsibilities:
- Apply strong development practices with hands-on coding in Python or Pyspark.
- Utilize hands-on experience with the Big Data stack: Hadoop, Mapreduce, Spark, Hbase, ElasticSearch.
- Demonstrate a good understanding of programming principles and development practices (check-in policy, unit testing, code deployment).
- Act as a self-starter, quickly grasping new concepts and technologies for large-scale engineering developments.
- Excel in application development and support, integration development, and data management.
- Interface daily with leading Fortune 500 clients to understand strategic requirements.
- Stay updated on the latest technologies to ensure maximum ROI for customers and Astar Data.
- Design and implement APIs, abstractions, and integration patterns for distributed computing problems.
- Gain experience in defining technical requirements, data extraction, data transformation, job automation, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment.
- Exhibit a strategic and analytical, data-driven mindset.
- Demonstrate raw intellect, talent, and energy.
- Possess an entrepreneurial and agile approach, understanding the dynamics of a high-growth company.
- Be capable of both leadership and hands-on execution.
Qualifications:
- Proven track record of relevant work experience.
- Bachelor's degree in Computer Science or a related technical discipline is required.
- Must have experience with functional and object-oriented programming in Python or Pyspark.
- Hands-on experience with the Big Data stack (Hadoop, Mapreduce, Spark, Hbase, ElasticSearch).
- Good understanding of AWS services and experience working with APIs and microservices.
- Effective written and verbal communication skills.
- Ability to collaborate with diverse engineers, data scientists, and product managers.
- Comfort working in a fast-paced start-up environment.
Preferred Qualifications:
- Experience in agile methodology.
- Experience with database modeling and development, data mining, and warehousing.
- Experience in the architecture and delivery of enterprise-scale applications.
- Proficiency in developing frameworks and design patterns.
- Ability to tackle technical challenges, propose comprehensive solutions, and guide junior staff.
- Experience working with large, complex data sets from various sources.
