Senior Data Engineer

About The Role

Join the RAPID team as a Senior Data Engineer driving the Altair modernization program on Azure. You will design scalable data pipelines using Databricks and PySpark to support reinsurance analytics, property & casualty loss ratio calculations, and end-to-end workflow automation.

Your Day Will Look Like:

• Data Pipeline Development: Build ETL/ELT workflows on Azure Data Lake Storage with Unity Catalog, ensuring data quality, lineage, and compliance across structured/unstructured sources like Meridian and Workflow Studio.
• Domain Expertise: Collaborate with SMEs to translate complex reinsurance business requirements into technical solutions using RAPID technology stack standards.
• AI & Automation: Integrate Azure OpenAI, LLM capabilities, and Genie Spaces/Agents to enable intelligent data intake and automated workflows.
• Platform Optimization: Monitor pipeline performance on Azure, implement CI/CD processes, and lead root-cause analysis for production issues.

Educational Requirements

Bachelor's degree in Engineering, Computer Science, or related field with 7+ years of experience developing large-scale ETL/ELT pipelines using Python (PySpark), SQL, Azure Data Factory, and cloud data warehouses.