Insights from AI related Product Launches at Google Next'23 conference

Google Next'23 conference in San Francisco is a blowout event with the tickets sold out a month in advance. We were fortunate to the attend the conference and take some valuable insights from the event. As the AI ecosystem is evolving, Google made significant launch announcements this year. The press release by Google can be found here

Duets : Google Cloud + Refnik Anadol (Above Image Credits)

As we attended the conference, we were overwhelmed by the plethora of announcements and developments that were going on within the AI ecosystem. There was the buzz word AI everywhere, in every product, service, and sentence. To get a sense of the launch announcements and developments, and to synthesize the information further, we overlaid our smart org framework discussed in one of our earlier insights with the AI related launches.

We believe the above picture represents the announcements and innovations as it relates to a typical architecture of a smart organization, and where Google Cloud tools could be leveraged.

--------------------------------------------------------------------------------------

Glossary :

1. GKE Enterprise : This enables multi-cluster horizontal scaling required for the most demanding, mission-critical AI/ML workloads.

2. Vertex AI Platform : A comprehensive AI platform—Vertex AI—that enables customers to build, deploy, and scale machine learning models. Customers have access to more than 100 foundation models, including third-party and popular open-source versions, as well as industry-specific models like Sec-PaLM 2 for cybersecurity and Med-PaLM 2 for healthcare and life sciences.

a) Vertex AI Search and Conversation: Now generally available, the tools enable organizations to create Search and Chat applications using their data in just minutes, with minimal coding and enterprise-grade management and security built in.

b) PaLM 2, Imagen and Codey Upgrades: This includes updating PaLM 2 to 32k context windows so enterprises can easily process longer form documents like research papers and books.

c) Tools for tuning: For PaLM 2 and Codey, Google Cloud is making adapter tuning generally available, and introducing a new method for Imagen, called Style Tuning, so enterprises can create images aligned to brand guidelines with a small amount of reference images.

d) New models: Google Cloud announced availability of Llama 2 and Code Llama from Meta, and Technology Innovative Institute's Falcon LLM, a popular open-source model, as well as pre-announced Claude 2 from Anthropic. Google Cloud will be the only cloud provider offering both adapter tuning and RLHF for Llama 2.

e) Vertex AI extensions: Developers can access, build, and manage extensions that deliver real-time information, incorporate company data, and take action on the user's behalf.

f) Digital Watermarking on Vertex AI: Powered by Google DeepMind SynthID, this is a state-of-the art technology that embeds the watermark directly into the image of pixels, making it invisible to the human eye and difficult to tamper with.

g) Colab Enterprise: This managed service combines the ease-of-use of Google's Colab notebooks with enterprise-level security and compliance capabilities, helping data scientists accelerate AI workflows.

3. AI Accelerator - Cloud TPUV5e: This is Google Cloud's most cost-efficient, versatile, and scalable purpose-built AI accelerator to date. Now, customers can use a single Cloud TPU platform to run both large-scale AI training and inferencing.

4. Duet AI in Workspace and Google Cloud

Google Cloud unveiled Duet AI at I/O in May, introducing powerful new features across Workspace and showcasing developer features such as code and chat assistance in Google Cloud. During the Next '23 conference, Google Cloud is making Duet AI in Google Workspace generally available, while expanding the preview capabilities of Duet AI in Google Cloud, with general availability coming later this year.

a) Duet AI in Google Meet: Duet AI will take notes during video calls, send meeting summaries, and even automatically translate captions in 18 languages. Duet AI in Meet also today unveiled studio look, studio lighting, and studio sound.

b) Duet AI in Google Chat: Users can chat directly with Duet AI to ask questions about their content, get a summary of documents shared in a space, and catch up on missed conversations.

c) Software development: Duet AI provides expert assistance across the entire software development lifecycle, enabling developers to stay in flow-state longer by minimizing context switching to help them be more productive. In addition to code completion and code generation, it can assist with code refactoring and building APIs using simple natural language prompts.

d) Application and infrastructure operations: Operators can chat with Duet AI in natural language across a number of services directly in the Google Cloud Console to quickly retrieve "how to" information about infrastructure configuration, deployment best practices, and expert recommendations on cost and performance optimization.

e) Data Analytics: Duet AI in BigQuery provides contextual assistance for writing SQL queries as well as Python code, generates full functions and code blocks, auto-suggests code completions and explains SQL statements in natural language, and can generate recommendations based on your schema and metadata.

f) Accelerating and modernizing databases: Duet AI in Cloud Spanner, AlloyDB and Cloud SQL, helps generate code to structure, modify, or query data using natural language.

g) Security Operations: Duet AI is also coming to security products including Chronicle Security Operations, Mandiant Threat Intelligence, and Security Command Center, which can empower security professionals to more efficiently prevent threats, reduce toil in security workflows, and uplevel security talent.

5. A3 VMs with NVIDIA H100 GPU: A3 VMs powered by NVIDIA's H100 GPU will be generally available next month, enabling organizations to achieve three times better training performance over prior generation A2.

6. Cloud :

a) Cross-Cloud Network: This is a global networking platform that helps customers connect and secure applications across clouds. It is open, workload-optimized, and offers ML-powered security to deliver zero trust.

b) Google Distributed Cloud (GDC): GDC is designed to meet the unique demands of organizations that want to run workloads at the edge or in their data centers. The GDC portfolio will bring AI to the edge, with Vertex AI integrations and a new managed offering of AlloyDB Omni on GDC Hosted.

7. Security :

a) Mandiant Hunt for Chronicle: This service integrates the latest insights into attacker behavior from Mandiant's frontline experts with Chronicle Security Operations' ability to quickly analyze and search security data, helping customers gain elite-level support without the burden of hiring, tooling, and training.

b) Agentless vulnerability scanning: These posture management capabilities in Security Command Center detect operating system, software, and network vulnerabilities on Compute Engine virtual machines.

c) Network security advancements: Cloud Firewall Plus adds advanced threat protection and next-generation firewall (NGFW) capabilities to our distributed firewall service, powered by Palo Alto Networks; and Network Service Integration Manager allows network admins to easily integrate trusted third-party NGFW virtual appliances for traffic inspection.

8. Data & Analytics

a) BigQuery Studio: A single interface for data engineering, analytics, and predictive analysis, BigQuery Studio helps increase efficiency for data teams.

b) AlloyDB AI: An integral part of AlloyDB, our PostgreSQL-compatible database service, AlloyDB AI offers an integrated set of capabilities for easily building GenAI apps including high-performance and vector queries.

c) New Data Cloud Partners: Partners, like Confluent, DataRobot, Dataiku, Datastax, Elastic, MongoDB, Neo4j, Redis, SingleStore, and Starburst are all launching new capabilities to help customers accelerate and enhance gen AI development with data.

9. Ecosystem Expansion : Partners are also using Vertex AI to build their own features for customers – including Box, Canva, Salesforce, UKG, and many others. New partner announcements include:

a) DocuSign is piloting new gen AI features, built with Vertex AI, for its billion-plus users. This includes a new "smart contract assistant" in DocuSign that can summarize, explain, and answer questions about complex contracts and other documents.

b) SAP is building new solutions utilizing SAP data and Vertex AI that will help enterprises apply gen AI to important business use cases, like streamlining automotive manufacturing or improving sustainability.

c) Workday's applications for Finance and HR are now live on Google Cloud and they are working with Google Cloud to develop new gen AI capabilities within the flow of Workday, as part of its multicloud strategy. This includes the ability to generate high-quality job descriptions and to bring Google Cloud gen AI to app developers via the skills API in Workday Extend, while helping to ensure the highest levels of data security and governance for customers' most sensitive information.