Big Data Platform Engineer / Site Reliability Engineer (SRE) at Cognyte, Pune, India

Cognyte is seeking a highly skilled Big Data Platform Engineer / Site Reliability Engineer (SRE) to join our team in Pune, India. This role is crucial for supporting our enterprise customers' big data infrastructure deployments and ensuring their operational success. The ideal candidate is a hands-on technical professional capable of working both remotely and on-site at customer locations, with a commitment to providing emergency support when critical issues arise, including during weekends.

Key Responsibilities

• Provide comprehensive technical support for customer big data clusters and installations, ensuring ongoing operational stability.
• Lead and execute installation and upgrade projects for big data platforms, utilizing both remote back-office support and on-premises on-site interventions.
• Undertake travel to customer sites as required for installations, upgrades, and the resolution of critical technical issues.
• Be available for weekend and after-hours support to address and resolve customer site crises promptly.
• Develop, maintain, and troubleshoot installation automation scripts and tools to streamline deployment processes.
• Build and manage continuous integration and continuous deployment (CI/CD) pipelines to enhance efficiency and reliability.
• Design, develop, and improve monitoring solutions for our big data infrastructure to ensure proactive issue detection and resolution.

Required Technical Skills

Core Infrastructure & Automation

• Ansible: Advanced proficiency in developing playbooks and automating infrastructure management.
• Bash: Strong capabilities in shell scripting for system administration and deployment tasks.
• Python: Solid programming skills essential for developing automation tools and utilities.
• RedHat Linux: Deep understanding of RedHat Enterprise Linux, including system administration and package management.

CI/CD & Virtualization

• Jenkins: Proven experience in building and maintaining CI/CD pipelines.
• VMware vSphere: Expertise in virtual infrastructure management and deployment.

Big Data Ecosystem (Required)

• Apache Spark: Experience in cluster configuration, tuning, and troubleshooting.
• YARN: Proficiency in resource management and cluster administration.
• HDFS: Skilled in distributed file system management and optimization.
• Apache Kafka: Experience in deploying and maintaining streaming platforms.
• Apache ZooKeeper: Knowledge of configuration and management of coordination services.

Preferred (Bonus) Skills

• Kubernetes: Experience with container orchestration and cloud-native deployments (including Vanilla, Open Shift, RKE).
• Harbor: Familiarity with container registry management.
• Longhorn: Experience with distributed storage solutions.

Work Environment & Requirements

• This is a hybrid role, blending remote work with essential customer site visits.
• Willingness and ability to travel domestically and potentially internationally to customer locations are required.
• Flexibility in scheduling, including availability for weekend emergency support, is necessary.
• This role requires strong customer-facing communication skills, essential for direct interaction during installations and support engagements.

Ideal Candidate Profile

• Possess 3-5 years of experience with big data infrastructure and automation.
• Demonstrate a proven track record in customer-facing technical roles.
• Exhibit strong problem-solving abilities, particularly under pressure.
• Be self-motivated with the capacity to work independently at customer sites.

Cognyte is a leading provider of big data solutions, committed to delivering exceptional value to our enterprise customers worldwide. Join our innovative R&D team in Pune and contribute to the future of big data technology.