Evaluate any generative AI model with Vertex AI
Evaluate any generative AI model with Vertex AI


Author: Google Cloud Tech – Duration: 00:06:22
Colab Notebook: Review Gemma 2 with the Gen AI review service on Vertex AI → https://goo.gle/4iIAZpI
Documents: Gen AI Evaluation Service on Vertex AI → https://goo.gle/3VOThvJ
Reference: Model-Based Metrics Prompts → https://goo.gle/3P4s7ND
Learn how to evaluate open models with the Gen AI evaluation service on Vertex AI. Follow along as Googlers Wietse Venema and Ivan Nardini present a Colab notebook that demonstrates how to evaluate Gemma 2 (an open model) using the XSum dataset. It covers calculation-based metrics (RED, F1 score) and model-based metrics (using Gemini as a judge). Use cases covered in this video include model selection, fine-grained evaluation, build optimization, rapid engineering, and rapid migration. Watch more Google Cloud: Building with Hugging Face → https://goo.gle/BuildWithHuggingFace
Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech
#GoogleCloud #HuggingFace Speakers: Wietse Venema, Ivan Nardini Products mentioned: Vertex AI, Gemini






