Senior MLOps Engineer

Senior MLOps Engineer

The Horizontal Data Science Enablement Team within SSO Data Science at Mastercard is seeking a Senior MLOps Engineer for its Gurugram location. This role is pivotal in addressing complex MLOps challenges, overseeing the organization-wide Databricks platform, building robust CI/CD and automation pipelines, and championing best practices in machine learning operations.

Responsibilities:

• Administer, configure, and maintain Databricks clusters and workspaces.
• Monitor Databricks clusters for high workloads and excessive usage costs, proactively alerting stakeholders to maintain cluster health.
• Implement and manage security protocols, including access controls and data encryption, ensuring compliance with Mastercard standards.
• Facilitate the integration of diverse data sources into Databricks, ensuring data flow and consistency.
• Identify and resolve issues related to Databricks infrastructure, providing timely support to users and stakeholders.
• Assist in the development of MLOps solutions, including but not limited to: model monitoring, feature catalog/store management, model lineage maintenance, and CI/CD pipelines for model lifecycle management from development to production.
• Maintain live services by measuring and monitoring availability, latency, and overall system health.

Required Experience:

• Master's degree in Computer Science, Software Engineering, or a related field.
• Strong experience with Databricks, including management of roles and resources.
• Experience with MLOps solutions such as MLFlow.
• Proficiency in data analysis, data observability, data ingestion, and data integration.
• A minimum of 2 years of experience in DevOps, SRE, or general systems engineering.
• A minimum of 2 years of hands-on experience with industry-standard CI/CD tools like Git/BitBucket, Jenkins, Maven, Artifactory, and Chef.
• Strong coding abilities in Python or other languages like Java and C++, with a solid understanding of SQL fundamentals.
• A systematic problem-solving approach complemented by strong communication skills.

Desirable Qualifications:

• SQL tuning experience.
• Strong automation experience.
• Ability to operate effectively in a 24x7 global environment across multiple time zones.