Data Engineer

Role Overview

We are seeking a skilled Data Engineer to build and maintain robust data ingestion pipelines within a modern, AI-native environment.

Key Responsibilities:

• Pipeline Development: Build and maintain ingestion pipelines into Snowflake from diverse source systems (Dataverse, SQL Server, APIs, files) using Azure Data Factory.
• Data Modeling & Transformation: Develop transformation logic in Snowflake following a strict medallion architecture (bronze → silver → gold), utilizing Coalesce for orchestrated SQL transformations.
• Automation & Scripting: Write Python to handle orchestration, automation, custom connectors, and lightweight services.
• AI Integration: Partner with AI coding agents (GitHub Copilot, Claude Code, Cortex) daily. You must be effective at directing these tools rather than just using autocomplete.
• Governance & Documentation: Apply data governance and lineage standards through Atlan; contribute to internal documentation and runbooks.
• Collaboration & Operations: Participate in code reviews, manage CI/CD via Azure DevOps, and perform on-call rotations for production pipelines.