Software Engineer III

About the Role

Join Google as a Software Engineer III specializing in AI/ML for Google Cloud, based in Hyderabad / Secunderabad, Telangana, India. This permanent role is your opportunity to shape the future of AI by developing next-generation technologies that power Google's products. You'll work on projects at a massive scale, pushing the boundaries of information retrieval, distributed computing, large-scale system design, networking, data storage, security, artificial intelligence, natural language processing, and more. As a versatile engineer, you'll have the chance to switch teams and projects, demonstrating leadership and enthusiasm for tackling diverse, full-stack challenges in a rapidly evolving technological landscape.

Key Responsibilities

• Optimize foundational models, including LLMs and Diffusion models, within key frameworks like vLLM, MaxText, and MaxDiffusion to provide immediate AI capabilities to Google Cloud customers.
• Collaborate with customers and Customer Engineering teams to assess AI/ML model performance on Google Cloud infrastructure, identifying and resolving technical bottlenecks to ensure customer success.
• Work with internal infrastructure teams to enhance support for demanding AI workloads and contribute to product improvements by reporting bugs and suggesting enhancements.
• Perform performance profiling, debugging, and troubleshooting for training and inference workloads, and maintain/update documentation and educational content.
• Triage, debug, and resolve system issues by analyzing root causes and their operational impact.
• Design and implement specialized Machine Learning solutions utilizing advanced ML infrastructure.

Minimum Qualifications

• Bachelor's degree or equivalent practical experience.
• 2 years of software development experience in languages like Python.
• 1 year of experience with ML infrastructure, covering areas such as model deployment, evaluation, data processing, and debugging.
• 1 year of experience with Generative AI concepts (e.g., Large Language Models, Multi-Modal, Large Vision Models) and hands-on experience with text, image, video, or audio generation.

Preferred Qualifications

• Master's degree or PhD in Computer Science or a related technical field.
• Experience with Generative AI, Large Language Models (LLM), or Machine Learning infrastructure, including model deployment, performance optimization, profiling, and debugging large-scale workloads.
• Experience with distributed computing utilizing Graphics Processing Units (GPUs) or Tensor Processing Units (TPUs).
• Proven ability to collaborate effectively with cross-functional teams.
• A knack for thriving in dynamic environments with continuously advancing AI technologies.

About Google's Equal Opportunity Commitment

Google is committed to fostering an inclusive and equitable workplace. We are proud to be an equal opportunity employer and an affirmative action employer. We value diversity and are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We consider qualified applicants regardless of criminal histories, in accordance with applicable laws. For more information, please review Google's EEO Policy and EEO is the Law. If you require accommodation due to a disability or special need, please complete our Accommodations for Applicants form.