Usage

Contents:

• Setup
  • Prerequisites
  • Setup
  • Extras
• Datasets
  • Build a Dataset
  • Environments
  • Parallelism
  • Explore a Dataset with a Shell
  • Use a Dataset in a Script
  • Split a Dataset
  • Repartition a Dataset
  • Drop or Keep Columns
  • Rename Columns
• Modeling
  • Tokenizer Training
  • Tokenization
  • Pre-Training (Maked Language Modeling)
  • Fine-Tuning (Multi-Modal Summarization)