Lead Data Engineer
Full Job Description
About The Role
HackerRank's data platform stands at an inflection point. Following a successful modernization from Redshift to StarRocks + Apache Hudi, we have reduced export latencies significantly and are now building the AI-native data layer that powers revenue-generating features like natural language querying for HackerRank for Work customers.
What You Will Do
- Own and evolve our high-scale data platform (StarRocks OLAP, Apache Hudi Data Lake, Trino, Spark, Apache Ranger) ensuring peak performance, reliability, and security.
- Build the next-gen AI-optimized data layer with clean, structured datasets to power natural language querying and AI add-on features for enterprise customers.
- Own in-product data features including exports, insights dashboards, interview analytics, and self-serve Custom Reports interfaces.
- Enable self-service pipelines for internal teams (AI platform, analytics, go-to-market), reducing ad-hoc requests and scaling access across the organization.
- Enforce robust data security through Apache Ranger policies and confidence-scoring guardrails for AI-generated outputs.
- Lead technical design reviews and define engineering standards for our growing data team.
- Partner with Product Managers and business stakeholders to proactively scope AI-enabled data use cases that drive company outcomes.
Who You Are
We are looking for a Lead Data Engineer with 6+ years of experience, including at least 2 years in a senior or lead capacity. Essential qualifications include deep expertise in OLAP databases (StarRocks, ClickHouse), data lake technologies (Apache Hudi, Iceberg), and distributed query engines like Trino/Presto.
Ideal candidates will have strong communication skills to translate technical decisions for non-technical stakeholders. Experience with AI/LLM-adjacent work such as confidence scoring or agentic pipelines is a significant plus. This role thrives in lean environments where your impact scales across the entire company, allowing you to shape data strategies without waiting for a roadmap.
Company
HackerRank
HackerRank is a leading technology hiring platform trusted by over 2,500 innovative companies worldwide to assess developer skills and accelerate innovation.We empower tech recruiters and hiring manag...