Data Engineer
Full Job Description
Join ShipTech Analytics (STA) as a Data Engineer and become a key contributor to the data and analytics infrastructure that powers Amazon's global transportation network. Our vision is to build an intelligent, autonomous, and scalable performance management and decision support system for Amazon Transportation.
As a Data Engineer I, you will be responsible for creating standardized data solutions to support operations teams worldwide. This includes developing both near-real-time (NRT) streaming and batch processing pipelines that deliver essential insights for strategic decision-making. You will also develop data tools that facilitate self-service analytics, automate operational tasks, and contribute to innovative AI-powered solutions that deliver automated insights across the entire transportation network.
Key job responsibilities
- Design and build scalable near-real-time (NRT) streaming and batch data pipelines that support Amazon's global transportation network.
- Build data products and data tools to streamline the entire data lifecycle, encompassing data ingestion, processing, backfill, storage, vending, and operational support modules.
- Collaborate closely with stakeholders across operations and analytics teams to understand their needs, design effective solutions, and deliver datasets and data tools that enable faster, more informed decision-making.
- Take ownership of data quality and implement enhancements for datasets that drive operational excellence and improve customer experience.
- Work with cross-functional teams to standardize analytics capabilities and build AI-powered automation.
- Utilize AWS cloud technologies to transform raw data into actionable metrics.
- Promote continuous improvement through rigorous code reviews, insightful design discussions, adherence to operational best practices, and ensuring security compliance.
A day in the life
You will work backwards from stakeholder needs, clarifying any ambiguities and building the data products and tools required. Throughout your day, you'll be writing code for data pipelines and developing tools for ingestion, processing, storage, and vending in collaboration with software engineers.
Some days will involve participating in design discussions focused on data infrastructure, pipelines, and tools.
Beyond coding, your responsibilities will include documenting datasets, tools, and runbooks, as well as participating in code reviews. When on-call, you will monitor pipeline health.
The role offers variety, with opportunities to partner with stakeholders, TPMs, and SDEs to build scalable data pipelines and tools that directly impact the operations of Amazon's transportation network.
About The Team
ShipTech Analytics serves as the central data and analytics hub for Amazon's global transportation network. The team is dedicated to building standardized data solutions that enhance analytics capabilities and empower operations teams worldwide with faster decision-making. Team members collaborate with cross-functional partners to deliver impactful data products and tools.
The team is actively modernizing systems, building advanced near-real-time architectures, and developing AI-powered automation. Team members have the chance to mentor colleagues, prototype new ideas, and influence the future direction of data analytics within Amazon. The team fosters a collaborative environment across geographies, with members in multiple locations working together to support global operations.
Basic Qualifications
- A minimum of 1 year of data engineering experience.
- Proficiency in SQL.
- Experience with data modeling, data warehousing, and building ETL pipelines.
- Experience with at least one query language, such as SQL, PL/SQL, DDL, MDX, HiveQL, or SparkSQL.
- Experience with at least one scripting language, such as Python or KornShell.
Preferred Qualifications
- Experience with big data technologies including Hadoop, Hive, Spark, or EMR.
- Experience with ETL tools such as Informatica, ODI, SSIS, BODI, or Datastage.
We foster an inclusive culture that empowers Amazonians to deliver outstanding results for our customers. If you have a disability and require workplace accommodation or adjustment during the application and hiring process, including support for interviews or onboarding, please visit amazon.jobs/content/en/how-we-hire/accommodations for more information. If your country/region is not listed, please contact your Recruiting Partner.
Company