Key Job Responsibilities

• Design and build scalable near-real-time (NRT) streaming and batch data pipelines that support Amazon's global transportation network.
• Develop data products and tools to streamline the entire data lifecycle, encompassing data ingestion, processing, backfill, storage, vending, and operational support modules.
• Collaborate closely with stakeholders in operations and analytics teams to understand their requirements, design effective solutions, and deliver datasets and tools that enable faster and more informed decision-making.
• Take ownership of data quality and implement enhancements for datasets that drive operational excellence and improve customer experience.
• Work with cross-functional teams to standardize analytics capabilities and build AI-powered automation.
• Utilize AWS cloud technologies to transform raw data into actionable metrics.
• Drive continuous improvement through code reviews, design discussions, adherence to operational best practices, and ensuring security compliance.

A Day in the Life

Your typical day involves working backward from stakeholder needs, clarifying ambiguities, and building essential data products and tools. You will spend time writing code for data pipelines and developing tools for ingestion, processing, storage, and vending, often in collaboration with software engineers.

Some days will be dedicated to design discussions concerning data infrastructure, pipelines, and tools. Beyond coding, you will be responsible for documenting datasets, tools, and runbooks, and actively participating in code reviews. During on-call rotations, you will monitor pipeline health.

The dynamic nature of this role is what makes it exciting; you'll partner with stakeholders, TPMs, and SDEs to build scalable data pipelines and tools that have a direct impact on the operational efficiency of Amazon's transportation network.

About The Team

ShipTech Analytics serves as the foundational data and analytics backbone for Amazon's global transportation network. The team is dedicated to building standardized data solutions that streamline analytics processes and enable faster decision-making for operations teams worldwide. Team members actively collaborate with cross-functional partners to deliver impactful data products and tools.

The team is actively modernizing systems, constructing near-real-time architectures, and implementing AI-powered automation. Team members are provided with opportunities to mentor colleagues, prototype innovative ideas, and shape the future of data analytics within the organization. The team fosters a culture of collaboration across geographies, with members in multiple locations working cohesively to support global operations.

Basic Qualifications

• 1+ years of data engineering experience.
• Proficiency in SQL.
• Experience with data modeling, data warehousing, and building ETL pipelines.
• Experience with at least one scripting language (e.g., Python, KornShell, Scala).

Preferred Qualifications

• Experience with big data technologies such as Hadoop, Hive, Spark, and EMR.
• Experience with AWS technologies including Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions.