EvSys

local_sft

LocalSFT - TRL SFTTrainer wrapper.

Pre-conditions:

  • ctx.backend.name == 'local'
  • ctx.extras['backend_handles']['model'] / ['tokenizer'] are set
  • ctx.extras['train_rows'] contains rows with 'messages' (chat format)
attributelogger
= logging.getLogger(__name__)