Evaluate any generative AI model with Vertex AI

Evaluate any generative AI model with Vertex AI

14 January 2025 • 16:00
SHARE
Futur-IA: Evaluate any generative AI model with Vertex AI

Author: Google Cloud Tech – Duration: 00:06:22

Colab Notebook: Review Gemma 2 with the Gen AI review service on Vertex AI → https://goo.gle/4iIAZpI

Documents: Gen AI Evaluation Service on Vertex AI → https://goo.gle/3VOThvJ

Reference: Model-Based Metrics Prompts → https://goo.gle/3P4s7ND

Learn how to evaluate open models with the Gen AI evaluation service on Vertex AI. Follow along as Googlers Wietse Venema and Ivan Nardini present a Colab notebook that demonstrates how to evaluate Gemma 2 (an open model) using the XSum dataset. It covers calculation-based metrics (RED, F1 score) and model-based metrics (using Gemini as a judge). Use cases covered in this video include model selection, fine-grained evaluation, build optimization, rapid engineering, and rapid migration. Watch more Google Cloud: Building with Hugging Face → https://goo.gle/BuildWithHuggingFace

Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech

#GoogleCloud #HuggingFace Speakers: Wietse Venema, Ivan Nardini Products mentioned: Vertex AI, Gemini

Tags:
SHARE

SHARE

NEWSLETTER: Recevez le meilleur de l'actu IA!

Follow us on social networks (French)


              Vidnoz AI

Catégorie:  Video

Vidnoz AI is a video generator tool that allows teams, businesses, and users to create engaging AI videos quickly and affordably. By eliminating the need for cameras, actors and studios, Vidnoz AI saves time and money. Users have reported saving up to 80% on video creation costs and creating videos 10x faster than before. Main[...]


WP Dev AI

Catégorie:  Developer tools

WP Dev AI allows users to effortlessly create custom features for WordPress websites through AI-generated code, eliminating the need for expensive developers. With clear instructions and code snippets accessible at any time, users can effectively improve their WordPress sites without technical expertise. Main Features: AI-powered code generation: Instantly translate feature descriptions into functional code snippets[...]

Leonardo AI

Catégorie:  Image generator

Unleash your creativity with the power of Leonardo Ai. This software allows you to create high-quality visual assets for your projects with unmatched quality, speed and style consistency. It allows you to cultivate originality, offers simplified mastery and boosts innovation, making it an essential tool for various creative activities. Main Features: Image generation: Leonardo's image[...]


              Suno.ai

Catégorie:  Music

Suno.ai is revolutionary software that allows anyone, from shower singers to professional artists, to create music without the need for musical instruments. With just your imagination, you can create your own songs effortlessly. Suno.ai offers a unique and exciting approach to music creation, making it accessible to everyone. Main Features: Music creation based on imagination:[...]

Popular news

Tags