Senior Software Engineer, AI/ML GenAI
Company: Google
Location: Sunnyvale
Posted on: April 2, 2026
|
|
|
Job Description:
Minimum qualifications: Bachelor’s degree or equivalent
practical experience. 5 years of experience programming in Python
or C++. 3 years of experience with ML infrastructure (e.g., model
deployment, model evaluation, optimization, data processing,
debugging). 3 years of experience testing, maintaining, or
launching software products. 1 year of experience with GenAI
techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with
GenAI-related concepts (language modeling, computer vision). 1 year
of experience with software design and architecture. Preferred
qualifications: Master's degree or PhD in Computer Science or
related technical field. 5 years of experience with data structures
and algorithms. 1 year of experience in a technical leadership
role. Experience developing accessible technologies. About the job
The mission of our team is to serve open-source/partner Gen AI
models reliable, performant, cost effective, easy-to-use Enterprise
customers. The service enables scalable and reliable serving of
these models on Vertex AI Platform, with a variety of features
(e.g., Dynamic Shared Quota, Provisioned Throughput, etc.). In this
role, you will be passionate about building AI/ML model serving
infrastructure, experiences with machine learning, Gen AI/LLM
serving, capacity management to work with us and build successful
product. The AI and Infrastructure team is redefining what’s
possible. We empower Google customers with breakthrough
capabilities and insights by delivering AI and Infrastructure at
unparalleled scale, efficiency, reliability and velocity. Our
customers include Googlers, Google Cloud customers, and billions of
Google users worldwide. We're the driving team behind Google's
groundbreaking innovations, empowering the development of our
cutting-edge AI models, delivering unparalleled computing power to
global services, and providing the essential platforms that enable
developers to build the future. From software to hardware our teams
are shaping the future of world-leading hyperscale computing, with
key teams working on the development of our TPUs, Vertex AI for
Google Cloud, Google Global Networking, Data Center operations,
systems research, and much more. The US base salary range for this
full-time position is $174,000-$252,000 bonus equity benefits. Our
salary ranges are determined by role, level, and location. Within
the range, individual pay is determined by work location and
additional factors, including job-related skills, experience, and
relevant education or training. Your recruiter can share more about
the specific salary range for your preferred location during the
hiring process. Please note that the compensation details listed in
US role postings reflect the base salary only, and do not include
bonus, equity, or benefits. Learn more about benefits at Google .
Responsibilities Design and implement GenAI solutions, leverage ML
infrastructure, and evaluate tradeoffs between different techniques
and their application domains. Design and develop the
enterprise-grade AI model serving platform to empower cloud
customers with the latest open-source Generative AI/LLM models on
GCP/Vertex AI Platform. Drive cross-team collaborations and
alignments to deliver features directly impacting enterprise
customer business. Work with external customers to understand their
requirements, analyze capacity requirements, onboard workload,
perform benchmarking, load testings. Maintain high standards for
quality through design reviews and code reviews.
Keywords: Google, Antioch , Senior Software Engineer, AI/ML GenAI, IT / Software / Systems , Sunnyvale, California
