About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Join the team as we envision the direction of and the next generation of Google’s workload orchestration. In the AI/ML era, the "physics" of infrastructure requires decision-making in milliseconds, which currently makes Generative AI (GenAI) inference incompatible with runtime requirements. To solve this, our team is implementing a Cognitive Architecture where AI agents act as "Principal Engineers," observing complex signals to write, validate, and deploy new deterministic orchestration code. This is a high-impact role where you will help define how Google-scale infrastructure utilizes GenAI to achieve infinite adaptability without compromising the millisecond-level reliability our production systems demand.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

Responsibilities

• Lead the development of the GenAI prototypes, defining the frameworks and components necessary for AI-driven orchestration.
• Architect system loops. Implement the interaction between the deterministic C++/Go code and the GenAI Reasoning Agents.
• Develop validation engines. Build data-driven verification systems to ensure AI-generated code, configurations, and decisions provide good quality output.
• Define execution intent. Contribute to the design of a new outcome-oriented execution intent language that allows users to define "what" they want (e.g., SLOs, business goals) rather than "how" to orchestrate.
• Optimize infrastructure. Use AI to improve resource utilization, create dynamic allocation models, and develop specialized fast systems tailored to specific workload archetypes like training and inference.