Data Engineer - Hybrid - Chennai
Join Astar Data as a Software Development Engineer and contribute to building world-class large-scale Big Data architectures. This hybrid role in Chennai requires a strong understanding of programming principles and hands-on experience in languages like Java, Python, or Pyspark. You will spend a significant portion of your time coding and developing innovative solutions.
Responsibilities
- Uphold excellent development practices, including hands-on coding in Python or Pyspark.
- Gain practical experience with the Big Data stack, including Hadoop, Mapreduce, Spark, Hbase, and ElasticSearch.
- Demonstrate a solid understanding of programming principles and development practices like unit testing and code deployment.
- Exhibit self-starting capabilities to quickly learn new concepts and translate them into large-scale engineering developments.
- Excel in application development, support, integration development, and data management.
- Collaborate with Sigmoid's key client initiatives, interfacing daily with Fortune 500 companies to understand strategic requirements.
- Stay abreast of the latest technologies to maximize ROI for customers and Sigmoid.
- Design and implement APIs, abstractions, and integration patterns to address complex distributed computing challenges.
- Apply experience in defining technical requirements, data extraction, data transformation, automating and productionizing jobs, and exploring new big data technologies in a parallel processing environment.
- Embrace a culture of strategic and unconventional thinking, with an analytical and data-driven orientation.
- Bring raw intellect, talent, and energy to the team, demonstrating an entrepreneurial and agile mindset suitable for a high-growth company.
- Exhibit the ability to be both a leader and a hands-on contributor.
Qualifications
- A proven track record of relevant work experience and a degree in Computer Science or a related technical discipline are required.
- Mandatory experience with functional and object-oriented programming in Python or Pyspark.
- Hands-on experience with the Big Data stack including Hadoop, Mapreduce, Spark, Hbase, and ElasticSearch.
- Proficiency in AWS services and experience working with APIs and microservices.
- Effective written and verbal communication skills.
- Ability to collaborate effectively with a diverse team of engineers, data scientists, and product managers.
- Comfort working in a fast-paced startup environment.
Preferred Qualifications
- Experience in agile methodologies.
- Experience with database modeling and development, data mining, and warehousing.
- Experience in architecture and delivery of enterprise-scale applications, including developing frameworks and design patterns.
- Ability to understand and tackle technical challenges, propose comprehensive solutions, and guide junior staff.
- Experience working with large, complex data sets from various sources.
