Senior Software Engineer –Gen AI Pl...

About Citi's Application, Platform and Engineering Group

We are Citi's Application, Platform and Engineering group, a dynamic startup within the Chief Technology Office, tasked with shaping the future of technology across the entire bank. Our mission is to define the AI and engineering strategy for Citi. We are a diverse team of talented engineers, product managers, and subject matter experts focused on transforming ambitious concepts into reality by engineering cutting-edge products at a planetary scale. We are committed to utilizing the most modern technology and engineering disciplines, including generative AI, cloud-native architectures, robust security practices, modern application stacks, open-source technologies, and the latest advancements in the Kubernetes ecosystem.

Your Role as a Generative AI Senior Engineer

Generative AI is a rapidly evolving field, and as a Senior Engineer, you will serve as the technical anchor and visionary for this critical domain at Citi. We are seeking individuals who can demonstrate a strong track record of architecting and scaling complex projects. Ideally, your experience should highlight sophisticated distributed architectures, systematic evaluation of Large Language Model (LLM) behaviors at scale, and a proven ability to foster technical consensus across large, complex organizations. You will be instrumental in engineering scaled, robust services and platforms centered around generative AI, potentially including the development of CLIs, SDKs, and runtimes.

Key Responsibilities and Opportunities

• Engineering at Scale: Develop and maintain scaled, resilient services and platforms focused on generative AI applications.
• Thought Leadership: Drive the architectural vision and lead the foundational 0-1 build of enterprise-grade AI platforms and products.
• System Design: Architect and implement high-quality, highly reliable, and secure distributed systems, prioritizing both developer and user experience.
• Strategic Direction: Pioneer "firsts" in the Generative AI space for Citi, acting as a key contributor to the bank's overall technical strategy.
• Scale & Iterate: Continuously refine and scale Generative AI products to manage immense throughput, proactively addressing the intricate needs of internal customers.
• Cross-Organizational Influence: Facilitate technical alignment across multiple engineering organizations, dismantling silos to deliver unified AI capabilities.

What We're Looking For

Required Technical Skillsets:

A minimum of 9 years of hands-on engineering experience is essential. Proficiency is required in:

• Languages & Frameworks: Go (microservices), React 19+/TypeScript
• Cloud & Orchestration: OpenShift/Kubernetes, GitOps CI/CD
• Databases & Caching: MongoDB/Redis/S3
• APIs & Communication: REST/gRPC/WebSockets
• LLMs & AI: Claude/Gemini/proprietary LLMs
• Security: OAuth/JWT/Vault
• Monitoring: Prometheus/Grafana/ELK

Experience That Will Help You Succeed:

• Modern Stacks Mastery: Expert-level fluency in Golang and Python, with extensive experience building concurrent, high-throughput systems.
• Cloud-Native & Infrastructure: Deep expertise in the Kubernetes ecosystem, container orchestration, and modern security paradigms (e.g., Gatekeeper, zero-trust).
• Applied Generative AI: A solid understanding of language models, embeddings models, and Retrieval Augmented Generation (RAG) architectures is desirable.
• AI Infrastructure: Proven experience in designing control planes, sandboxing systems for AI experimentation, and managing large-scale vector stores and search algorithms.
• Data Engineering: Extensive experience in large-scale ETL development and data pipeline architecture.
• Security & Governance: Experience with bug bounty programs, responsible disclosure, and AI safety/guardrail implementations.
• Startup Agility: Experience leading technical initiatives in fast-paced startup environments or driving similar agility within a large enterprise.

Qualities We Value:

• Distinguished, deep-dive software engineering expertise and architectural leadership experience.
• A results-driven mindset, embracing flexibility to maximize impact and shape enterprise-level technical decisions.
• A proactive, influential approach, willing to step beyond defined roles to shape broader engineering culture.
• A passion for pair programming and hands-on coding, leading by example and staying close to the codebase.
• Enthusiasm for architecting machine learning and GenAI applications at an unprecedented global scale.
• A relentless drive to push the boundaries of machine learning and generative AI, contributing to Citi's future.

Our Beliefs:

• We foster a seamless integration of engineering and research, expecting technical leaders to bridge this gap.
• We are product-focused, dedicated to building robust, scalable, and user-friendly solutions.
• We thrive in a fast-paced environment, tackling cutting-edge problems through continuous learning and adaptation.
• We embrace pair programming and a lean methodology, actively minimizing bureaucracy.
• We prioritize rapid delivery, iteration, and flexibility over upfront perfect solutions.