Vertex AI

Overview

This guide shows you how to integrate Latitude Telemetry into an application that uses Google Cloud Vertex AI.

You’ll keep calling Vertex AI exactly as you do today. Telemetry simply observes and enriches those calls.

Requirements

A Latitude account and API key
A Latitude project slug
A project that uses the Vertex AI SDK

Steps

Install

TypeScript
Python

npm install @latitude-data/telemetry

pnpm add @latitude-data/telemetry

yarn add @latitude-data/telemetry

bun add @latitude-data/telemetry

pip install latitude-telemetry

uv add latitude-telemetry

poetry add latitude-telemetry

Initialize and use

TypeScript
Python

import { Latitude, capture } from "@latitude-data/telemetry"
import { VertexAI } from "@google-cloud/vertexai"
import * as VertexAISDK from "@google-cloud/vertexai"

const latitude = new Latitude({
  apiKey: process.env.LATITUDE_API_KEY!,
  project: process.env.LATITUDE_PROJECT_SLUG!,
  instrumentations: { vertexai: VertexAISDK },
})


const vertexAI = new VertexAI({
  project: process.env.GCP_PROJECT_ID!,
  location: "us-central1",
})
const model = vertexAI.getGenerativeModel({ model: "gemini-1.5-flash" })

await capture("generate-reply", async () => {
  const result = await model.generateContent("Hello")
  return result.response.candidates?.[0].content.parts[0].text
})

await latitude.shutdown()

import vertexai
from vertexai.generative_models import GenerativeModel

from latitude_telemetry import Latitude, capture

latitude = Latitude(
    api_key="your-api-key",
    project="your-project-slug",
    instrumentations={"vertexai": vertexai},
)

vertexai.init(project="your-gcp-project", location="us-central1")
model = GenerativeModel("gemini-1.5-flash")

def generate_reply():
    response = model.generate_content("Hello")
    return response.text

capture("generate-reply", generate_reply)

latitude.shutdown()

Seeing Your Traces

Once connected, traces appear automatically in Latitude:

Open your project in the Latitude dashboard
Each execution shows input/output messages, model, token usage, latency, and errors

Google AI Platform Groq

⌘I

Overview

Getting Started

Observe

Understand

Refine

Security and Compliance

Deployment

Development

More

Overview

Requirements

Steps

Seeing Your Traces

​Overview

​Requirements

​Steps

​Seeing Your Traces

Overview

Requirements

Steps

Seeing Your Traces