Senior Data Platform Engineer

BigID is seeking a talented Senior Data Platform Engineer to join our dynamic Data Platform team in Chennai. This role is ideal for an experienced professional with a strong background in data engineering, particularly with Kafka and Elasticsearch, to architect, develop, and maintain our cutting-edge data platforms. You will collaborate extensively with cross-functional teams to ensure the scalability, reliability, and performance of our data solutions. As a Senior Data Platform Engineer, you will be instrumental in designing, developing, implementing, and troubleshooting our big data architecture. Your expertise in Elastic, Kafka, and Node.js will be vital in ensuring the optimal performance of our data systems.

Key Responsibilities:

• Implement robust data processing pipelines using Kafka for real-time data streaming.
• Optimize and manage search functionalities utilizing Elastic technologies.
• Partner with product managers, data analysts, and other stakeholders to define requirements and translate them into technical specifications.
• Conduct code reviews, enforce coding best practices, and maintain high standards in data handling and software development.
• Stay abreast of emerging trends and technologies in big data, proposing enhancements to our architecture and processes.
• Proactively troubleshoot and resolve system issues to minimize downtime and ensure high availability.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
• A minimum of 8 years of experience in the software engineering domain.
• Over 5 years of hands-on experience with big data technologies, with a specific focus on MongoDB, Elastic Stack, and Kafka.
• Proficiency in Node.js, particularly with the NestJS framework and TypeScript.
• Solid understanding of data modeling, ETL processes, and data warehousing principles.
• Exceptional problem-solving and analytical skills.
• A strong grasp of CI/CD principles.
• Experience working with both external and internal APIs and SDKs.

Preferred Skills:

• Experience with Java.
• Familiarity with Docker and Kubernetes.
• Experience with cloud platforms such as AWS or Azure.

What We Offer:

• Equity participation for all employees.
• Hybrid work environment.
• Engaging team events and company outings.
• Comprehensive statutory and leave benefits.
• Health Insurance coverage.

Our Core Values: Care, Do, Try, and Shine.

We are committed to fostering an inclusive and equitable culture where innovation thrives, diverse voices are heard, and everyone belongs. Learn more about our commitment to diversity and inclusion.

Job Candidate Privacy Notice.

Candidates must possess the ability to exercise independent judgment with minimal supervision.

BigID is an E-Verify Participant.