Sr. Data Engineer

Role Overview

You will own, extend, and harden the multimodal data infrastructure powering our global AI training supply chain. Working directly with leadership, you will build production-grade pipelines that ingest real-world audio, video, and egocentric capture data into AWS-scale storage, then manage GPU-backed technical validation to deliver datasets for frontier AI lab customers.

Key Responsibilities

• Owning the full pipeline: ingestion, lake management, quality validation, and compute handoff.
• Developing robust Python async patterns, subprocess management, and API clients for large-scale data processing.

Requirements

• 4+ years of experience in data engineering with end-to-end pipeline ownership.
• Production-grade expertise with AWS services including Athena, Glue, S3, DynamoDB, and Lake Formation.
• Mastery of Apache Hudi or Delta Lake for schema evolution, partition strategies, and upsert patterns.
• Demonstrated experience building large-scale media data pipelines: audio/video conversion, metadata extraction, chunking, and egocentric/multimodal dataset creation (hard requirement).