65,000-node Kubernetes AI platform: a reality

65,000-node Kubernetes AI platform: a reality

13 November 2024 • 18:00
SHARE
Futur-IA: 65,000-node Kubernetes AI platform: a reality

Author: Google Cloud Tech – Duration: 00:03:06

The size of generative AI models continues to increase, with current models reaching hundreds of billions of parameters and the most advanced approaching 2 trillion. Training such large models on modern accelerators requires clusters exceeding 10,000 nodes. GKE, which currently supports the world’s largest managed Kubernetes clusters with 15,000 nodes, has the capacity to handle these demanding training workloads. In anticipation of further advancements and even larger models, we are introducing support for 65,000 node clusters. This expansion, combined with innovations in accelerator computing power, will enable the training of models with 10 trillion or more parameters. Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech

Tags:
SHARE

SHARE

NEWSLETTER: Recevez le meilleur de l'actu IA!

Follow us on social networks (French)


              Vidnoz AI

Catégorie:  Video

Vidnoz AI is a video generator tool that allows teams, businesses, and users to create engaging AI videos quickly and affordably. By eliminating the need for cameras, actors and studios, Vidnoz AI saves time and money. Users have reported saving up to 80% on video creation costs and creating videos 10x faster than before. Main[...]


WP Dev AI

Catégorie:  Developer tools

WP Dev AI allows users to effortlessly create custom features for WordPress websites through AI-generated code, eliminating the need for expensive developers. With clear instructions and code snippets accessible at any time, users can effectively improve their WordPress sites without technical expertise. Main Features: AI-powered code generation: Instantly translate feature descriptions into functional code snippets[...]

Leonardo AI

Catégorie:  Image generator

Unleash your creativity with the power of Leonardo Ai. This software allows you to create high-quality visual assets for your projects with unmatched quality, speed and style consistency. It allows you to cultivate originality, offers simplified mastery and boosts innovation, making it an essential tool for various creative activities. Main Features: Image generation: Leonardo's image[...]


              Suno.ai

Catégorie:  Music

Suno.ai is revolutionary software that allows anyone, from shower singers to professional artists, to create music without the need for musical instruments. With just your imagination, you can create your own songs effortlessly. Suno.ai offers a unique and exciting approach to music creation, making it accessible to everyone. Main Features: Music creation based on imagination:[...]

Popular news

Tags