Bigdata Backend Engineer

Role Overview

We are seeking an experienced Senior Programmer Analyst to design, develop, and optimize enterprise-grade data reconciliations and automated control pipelines within our Technology team. This role requires deep technical expertise in financial services environments to build scalable solutions that drive automation across Capital Markets operations.

Key Responsibilities:

• Design and deploy complex multi-way matching algorithms using proprietary engines like TLM SmartStream, Duco, or Gresham.
• Engineer automated break classification logic to categorize discrepancies and accelerate root-cause analysis for high-throughput transaction processing systems.
• Develop robust data extraction, transformation, and ingestion pipelines utilizing Python (Pandas, NumPy, PySpark), SQL, and Apache Spark for large-scale financial datasets.
• Collaborate with business analysts to translate BRDs into technical designs, ensuring seamless integration between upstream Systems of Record and central data distribution hubs.
• Package and deploy containerized services using Docker/Kubernetes while maintaining automated CI/CD pipelines via Jenkins or GitLab.
• Serve as a Subject Matter Expert (SME) on reconciliation logic, advising peers and stakeholders to resolve complex technical challenges.

Required Qualifications:

• Bachelor's/Master's in CS, Information Systems, Software Engineering, Financial Technology, or related quantitative field.
• 6–8+ years of hands-on experience in software development, data engineering, and reconciliation systems within Financial Services/Capital Markets.
• Advanced proficiency in Python (APIs, automation) and SQL (optimization, complex joins).
• Familiarity with Java/Scala or C# for microservices integration is a plus.