Data Warehouse Architect 3

Role Overview

We are looking for an experienced Data Engineering Lead to excel in data modeling, Lakehouse and Medallion Architecture concepts, and the delivery of data/ML products using an agile DevOps framework. The ideal candidate must demonstrate mastery of distributed data architectures essential for operational ML applications.

Required Experience

• Bachelors Degree required.
• Minimum 4 years hands-on experience hydrating enterprise Data Lakes on Cloud Service Providers (AWS, Azure, or Google) from relational and unstructured sources by building ETL/ELT pipelines.
• Minimum of 2 years enforcing Data Sharing Policies to ensure proper access control for data products.

Tech Stack & Skills

You must have proficiency in frameworks including Spark, Kafka, Kubernetes, SageMaker, DBT, Juniper Notebooks, Docker, SQL, and visualization tools like Power BI/Tableau. Preferred skills include Terraform/YAML/DAGs for infrastructure as code.

Key Responsibilities

• Oversee the design, development, and maintenance of data pipelines that move and transform data for analytics systems.
• Architect and optimize storage solutions and orchestration frameworks.
• Led mentor staff and provide technical guidance on code reviews.
• Collaborate with cross-functional partners including data scientists and business stakeholders.

Desired Qualifications

Candidates should have a BS in Computer Science or related field. Experience modeling Relational data services using Python/Pyspark/SQL to extract data into Lakehouse Medallion architecture is required. Demonstrated expertise in designing Star-schema based operational data stores for Power BI visualization is essential.