SDET - Kafka

About the Role:

We are seeking a skilled SDET with expertise in Kafka testing and ETL PySpark validation to join our dynamic team in Hyderabad. This role focuses on ensuring the quality and reliability of our data streaming pipelines.

Key Responsibilities:

• Kafka Testing: Design and implement automated tests for Kafka producers, consumers, and topics. Verify message delivery, ordering, and data integrity within streaming pipelines. Test consumer group management, offset tracking, and error handling mechanisms.
• ETL & PySpark Validation: Test PySpark ETL jobs that interact with Kafka topics. Validate data transformations, ensure schema compliance, and confirm adherence to Service Level Agreements (SLAs). Conduct end-to-end data validation for ingestion to consumption workflows.
• Test Automation: Develop and maintain robust automation frameworks using Python, Java, or similar technologies. Integrate automated tests into CI/CD pipelines (e.g., Jenkins, GitLab). Create reusable test utilities for Kafka payload validation, schema checking, and data quality assurance.
• Quality Assurance: Perform comprehensive testing, including smoke, regression, integration, and performance testing. Identify, document, and track defects with clear reproduction steps. Collaborate closely with Data Engineers and Platform teams to establish and validate acceptance criteria.

Work Schedule & Location:

• Shift: 1:00 PM - 10:00 PM IST
• Work Mode: 4 days Work From Office (WFO) in Hyderabad + 1 day Work From Home (WFH)
• Work Days: Monday to Friday (flexibility on the WFH day)

What We Offer:

• A competitive salary package commensurate with your experience.
• Flexible work arrangements, balancing office and remote work.
• Comprehensive health insurance and wellness benefits.
• Opportunities for professional growth and development.
• Exposure to cutting-edge data streaming architectures.
• A collaborative and agile team environment.
• Potential for career advancement within the high-demand data engineering ecosystem.

Job Type: Full-Time

Experience: 5-8 Years

Eligibility: Professionals with experience in Kafka, PySpark, and QA Automation.