Google Vertex AI

LLM service implementation using Google’s Vertex AI with OpenAI-compatible interface

Overview

GoogleVertexLLMService provides access to Google’s language models through Vertex AI while maintaining an OpenAI-compatible interface. It inherits from OpenAILLMService and supports all OpenAI features while connecting to Google’s enterprise AI services with enhanced security and compliance.

Vertex AI LLM API Reference

Pipecat’s API methods for Google Vertex AI integration

Example Implementation

Browse examples using Vertex AI models

Vertex AI Documentation

Official Google Vertex AI documentation

Google Cloud Console

Access Vertex AI and manage credentials

Installation

To use Google Vertex AI services, install the required dependencies:

pip install "pipecat-ai[google]"

Prerequisites

Google Cloud Setup

Before using Google Vertex AI LLM services, you need:

1. Google Cloud Account: Sign up at Google Cloud Console
2. Project Setup: Create a project and enable the Vertex AI API
3. Service Account: Create a service account with Vertex AI permissions
4. Authentication: Set up credentials via service account key or Application Default Credentials

Required Environment Variables

• GOOGLE_APPLICATION_CREDENTIALS: Path to your service account key file (recommended)
• Or use Application Default Credentials for cloud deployments