NVIDIAxCESGA Workshop

The NeMo framework provides an accelerated workflow for training with 3D parallelism techniques. It offers a choice of several customization techniques and is optimized for at-scale inference of large-scale models for language and image applications, with multi-GPU and multi-node configurations. NeMo makes generative AI model development easy, cost-effective, and fast for enterprises. During this workshop, we will learn how to leverage NeMo Framework to train a foundation model. We’ll cover from preparing a dataset that can be fed into the model, to launch the model training and analyze its output.

• 09.00 - 09.30: Check-in
• 09.30 - 09.45: Welcome from CESGA and plans to support the AI community
• 09.45 - 10.00: Introduction to NVIDIA AI Technology Center
• 10.00 - 11.00: Cluster access and Slurm workshop
• 11.00 - 11.30: Coffee Break
• 11.30 - 13.30: How to train LLMs using NeMo Framework