Constants
gllm_training.constants
Contains all constants used throughout the gllm_training package.
Reviewer
- Muhammad Afif Al Hawari (muhammad.a.a.hawari@gdplabs.id)
References
NONE
GPU_AVAILABLE = torch.cuda.is_available()
module-attribute
ErrorMessageConstants(ERROR_NO_ROWS_PROCESSED='No rows could be processed successfully')
dataclass
Constants for error messages.
ERROR_NO_ROWS_PROCESSED: str = 'No rows could be processed successfully'
class-attribute
instance-attribute
GeneralConstants(TEMPLATE_TRUNCATE_LENGTH=100, MAX_FAILED_ROWS_TO_LOG=5, RANDOM_SEED=42, CACHE_TIMEOUT=300, SFT_HYPERPARAMETER_PREFIX='sft_fine_tuned_hyperparam_', GRPO_HYPERPARAMETER_PREFIX='grpo_fine_tuned_hyperparam_', DPO_HYPERPARAMETER_PREFIX='dpo_fine_tuned_hyperparam_', GRPO_TRAIN_STEPS_LOG_FILE='grpo_train_steps.jsonl', DPO_TRAIN_STEPS_LOG_FILE='dpo_train_steps.jsonl', SFT_TRAIN_STEPS_LOG_FILE='sft_train_steps.jsonl', EXPERIMENT_DIR_TEMPLATE='{base_output_dir}/exp_{experiment_id}/{model_name}')
dataclass
Constants for general configuration.
CACHE_TIMEOUT: int = 300
class-attribute
instance-attribute
DPO_HYPERPARAMETER_PREFIX: str = 'dpo_fine_tuned_hyperparam_'
class-attribute
instance-attribute
DPO_TRAIN_STEPS_LOG_FILE: str = 'dpo_train_steps.jsonl'
class-attribute
instance-attribute
EXPERIMENT_DIR_TEMPLATE: str = '{base_output_dir}/exp_{experiment_id}/{model_name}'
class-attribute
instance-attribute
GRPO_HYPERPARAMETER_PREFIX: str = 'grpo_fine_tuned_hyperparam_'
class-attribute
instance-attribute
GRPO_TRAIN_STEPS_LOG_FILE: str = 'grpo_train_steps.jsonl'
class-attribute
instance-attribute
MAX_FAILED_ROWS_TO_LOG: int = 5
class-attribute
instance-attribute
RANDOM_SEED: int = 42
class-attribute
instance-attribute
SFT_HYPERPARAMETER_PREFIX: str = 'sft_fine_tuned_hyperparam_'
class-attribute
instance-attribute
SFT_TRAIN_STEPS_LOG_FILE: str = 'sft_train_steps.jsonl'
class-attribute
instance-attribute
TEMPLATE_TRUNCATE_LENGTH: int = 100
class-attribute
instance-attribute
PromptTemplateConstants(SYSTEM_PROMPT='You are a helpful assistant.', USER_PROMPT='{query}', SYSTEM_PROMPT_COL='system', USER_PROMPT_COL='user', PROMPT_ID_COL='name')
dataclass
Constants for prompt template processing.