Undertale

Contents:

• Usage
  • Setup
    • Prerequisites
    • Setup
    • Extras
      • Binary Ninja Setup
  • Datasets
    • Build a Dataset
    • Environments
    • Parallelism
    • Explore a Dataset with a Shell
      • Large Datasets
    • Use a Dataset in a Script
    • Split a Dataset
    • Repartition a Dataset
    • Merge Datasets
    • Shuffle a Dataset
    • Filter or Exclude Rows
    • Drop or Keep Columns
    • Rename Columns
    • Cast Column Data Types
  • Modeling
    • Tokenization
      • Tokenizer Training
      • Tokenization
    • Pre-Training (Masked Language Modeling)
      • Tensorboard
      • Inference
    • Fine-Tuning (Sequence Classification)
      • Inference
    • Fine-Tuning (Multi-Modal Sequence Summarization)
      • Prerequisites
      • Dataset Preparation
      • Training
      • Inference
      • Evaluation
• Development
  • Architecture
  • Recommended Reading
  • Conventions
    • Code Style
    • Linting & Type Checking
    • Pre-Commit Hooks
    • Code Comments
    • Feature Branching
    • Linear History & Squash Merging
    • Conventional Commits
  • Workflows
    • Clone the Repository
    • Start Developing a New Feature or Fix
    • Open a Pull Request
    • Update Your Feature Branch with Upstream Changes
    • Merge a Pull Request
    • Start Developing a New Feature or Fix That Depends on Another Unmerged Pull Request
  • Setup
    • Prerequisites
    • Setup
    • Code Style
    • Documentation
    • Testing
    • Extras
      • Binary Ninja Setup
• Reference
  • undertale
    • exceptions
      • Error
      • EnvironmentError
      • PathError
      • PathDoesNotExist
      • PathExists
      • SchemaError
    • logging
      • setup_logging()
      • get_logger()
    • models
      • classification
        • ClassificationCollator
        • ClassificationHead
          • ClassificationHead.forward()
        • InstructionTraceTransformerEncoderForSequenceClassification
          • InstructionTraceTransformerEncoderForSequenceClassification.forward()
      • configuration
        • InstructionTraceTransformerEncoderConfiguration
      • custom
        • InstructionTracePositionEmbedding
          • InstructionTracePositionEmbedding.compute_instruction_index()
          • InstructionTracePositionEmbedding.compute_argument_index()
          • InstructionTracePositionEmbedding.forward()
        • InstructionTraceTransformerEncoder
          • InstructionTraceTransformerEncoder.forward()
      • dataset
        • ParquetDataset
          • ParquetDataset.validate()
        • ChunkedSampler
        • load()
        • DataModule
      • maskedlm
        • MaskedLMCollator
        • MaskedLMHead
          • MaskedLMHead.forward()
        • InstructionTraceTransformerEncoderForMaskedLM
          • InstructionTraceTransformerEncoderForMaskedLM.forward()
          • InstructionTraceTransformerEncoderForMaskedLM.infer()
      • summarization
        • tokenize_summaries_gpt2()
        • SummarizationCollator
        • MLPConnector
          • MLPConnector.forward()
        • TransformerConnector
          • TransformerConnector.forward()
        • InstructionTraceTransformerEncoderForSequenceSummarizationGPT2
          • InstructionTraceTransformerEncoderForSequenceSummarizationGPT2.encode()
          • InstructionTraceTransformerEncoderForSequenceSummarizationGPT2.forward()
          • InstructionTraceTransformerEncoderForSequenceSummarizationGPT2.generate()
        • summarize_tokenized()
        • evaluate_summarized()
      • tokenizer
        • preprocess_tokens()
        • merge_preprocessed_tokens()
        • train_tokenizer()
        • tokenize()
        • save()
        • load()
      • transformer
        • Attention
          • Attention.forward()
        • MultiHeadAttention
          • MultiHeadAttention.forward()
        • FeedForward
          • FeedForward.forward()
        • TransformerEncoderLayer
          • TransformerEncoderLayer.forward()
        • PositionEmbedding
          • PositionEmbedding.forward()
        • TransformerEncoder
          • TransformerEncoder.forward()
      • tuning
        • find_optimal_batch_size()
    • parsers
      • ArgumentParser
        • ArgumentParser.setup()
      • DatasetArgumentParser
      • ModelArgumentParser
    • pipeline
      • Cluster()
      • Client()
      • merge()
      • read_directory()
      • fanout()
      • flush()
      • binary
        • segment_and_disassemble_binary()
      • cpp
        • compile_cpp()
      • dask
        • Cluster()
        • Client()
        • merge()
        • read_directory()
        • fanout()
        • flush()
      • json
        • split_json()
        • merge_json()
        • average_json()
      • parquet
        • ParquetOperation
        • HashColumn
        • Deduplicate
        • Drop
        • Keep
        • Filter
        • Exclude
        • Rename
        • Shuffle
        • Cast
        • Repartition
        • modify_parquet()
      • tarfile
        • extract_tarfile()
        • compress_tarfile()
      • zip
        • unzip_file()
        • zip_file()
    • schema
      • Dataset
        • Dataset.id
      • SourceDataset
        • SourceDataset.source
      • BinaryDataset
        • BinaryDataset.binary
      • BinaryDatasetWithSource
      • FunctionDataset
        • FunctionDataset.name
      • FunctionDatasetWithSource
      • DisassembledFunctionDataset
      • DisassembledFunctionDatasetWithSource
      • SummarizedDataset
        • SummarizedDataset.summary
      • TokenizedDataset
        • TokenizedDataset.tokens
        • TokenizedDataset.mask
      • TokenizedClassificationDataset
        • TokenizedClassificationDataset.label
      • TokenizedSummarizationDataset
        • TokenizedSummarizationDataset.summary_tokens
        • TokenizedSummarizationDataset.summary_mask
    • utils
      • timestamp()
      • assert_path_exists()
      • cache_path()
      • get_or_create_file()
      • get_or_create_directory()
      • find()
      • write_parquet()
      • subprocess()
      • RemoteException
      • datasets
        • cast
          • parse_cast()
        • drop
        • exclude
        • filter
          • parse_clause()
        • merge
        • rename
          • parse_rename()
        • repartition
        • shell
          • main()
          • pandas
          • polars
        • shuffle
        • split
          • parse_split()
          • split()
      • models
        • cache
          • build
            • build()
          • load
            • load()
• Glossary
• About
  • Disclaimer
    • License