Data Engineer IV

About the Role

At PDI Technologies, we empower leading convenience retail and petroleum brands with cutting-edge technology solutions. As a Data Engineer IV (Senior), you will lead complex data integration initiatives and design scalable cloud-based data solutions for enterprise analytics.

Key Responsibilities:

• Design, develop, and optimize scalable AWS-native data pipelines supporting reporting and business intelligence.
• Establish engineering standards and best practices for platform reliability and scalability using IaC (Terraform) and CI/CD.
• Apply AI/ML techniques to enhance automated data quality checks, anomaly detection, and intelligent pipeline monitoring.
• Semantic layer development within lakehouse architectures using Apache Iceberg and Parquet.
• Mentor engineering teams, drive technical decisions, and partner with stakeholders to solve complex business problems.

Qualifications:

Bachelor's degree or equivalent experience. 8+ years in data engineering/cloud platforms (AWS S3, Glue, Redshift). Expertise in SQL/Python/PySpark for ETL/ELT. Strong grasp of dimensional modeling and modern cloud architecture.