Article Source

• LLMOps; Everything You Need to Know to Manage LLMs

LLMOps; Everything You Need to Know to Manage LLMs

Abstract

With the recent surge in popularity of ChatGPT and other LLMs such as Dolly, many people are going to start training, tuning, and deploying their own custom models to solve their domain-specific challenges. When training and tuning these models, there are certain considerations that need to be accounted for in the MLOps process that differ from traditional machine learning. Come watch this session where you’ll gain a better understanding of what to look out for when starting to enter the world of applying LLMs in your domain.

In this session, you’ll learn about:

• Grabbing foundational models and fine-tuning them
• Optimizing resource management such as GPUs
• Integrating human feedback and reinforcement learning to improve model performance
• Different evaluation methods for LLMs

Talk by: Joseph Bradley and Eric Peter