Gllm Training

This documentation covers the Gllm Training library, which is part of the GLLM Monorepo.

API Reference

The following modules are available in this library:

• Base Hyperparams Trainer: Base class for TRL hyperparameter trainers.
• Base Trainer: Base classes and utilities for trainers.
• Cloud Storage: Cloud storage module for GLLM training.
• Config: Configuration module for GLLM training.
• Constants: Contains all constants used throughout the gllm_training package.
• Data Loader: Module for data loading and handling.
• Dpo Trainer: DPO (Direct Preference Optimization) trainer module.
• Ft Libraries: Framework registry for managing fine-tuning libraries.
• Grpo Trainer: Group-Oriented (GRPO) Trainer module for GLLM training.
• Preprocessor: Preprocessor module for data preprocessing and template processing.
• Schema: Schema package for gllm_training.
• Sft Trainer: Supervised fine-tuning trainer module for GLLM training.
• Utils: Utility functions and helpers for GLLM training.