DATA ENGINEER

Description

Join ShipTech Analytics (STA) as a Data Engineer to build the data and analytics backbone powering Amazon's global transportation network. You'll contribute to our vision of building an intelligent, autonomous, and scalable performance management and decision support system across Amazon Transportation.

As a Data Engineer I, you'll work on building standardized data solutions that empower operations teams worldwide. You'll develop both near-real-time (NRT) streaming pipelines and batch processing pipelines that deliver critical insights for decision-making. You'll also build data tools that enable self-service analytics and automate operational tasks, while contributing to innovative AI-powered solutions delivering automated insights across the transportation network.

Key job responsibilities

- Design and build scalable near-real-time (NRT) streaming and batch data pipelines supporting Amazon's global transportation network.
- Build data products and data tools that streamline the complete data lifecycle including data ingestion, processing, backfill, storage, vending, and operational support modules.
- Partner closely with stakeholders across operations and analytics teams to understand requirements, design solutions, and deliver datasets and data tools that enable faster, more informed decision-making
- Own data quality and implement enhancements for datasets that enable operational excellence and improve customer experience
- Collaborate with cross-functional teams to standardize analytics capabilities and build AI-powered automation
- Leverage AWS cloud technologies to transform raw data into actionable metrics
- Drive continuous improvement through code reviews, design discussions, operational best practices, and security compliance

Basic Qualifications

- 1+ years of data engineering experience
- Experience with SQL
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more scripting language (e.g., Python, KornShell, Scala)

Preferred Qualifications

- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions