Undertale

Contents:

• Usage
  • Setup
    • Prerequisites
    • Setup
    • Extras
      • Binary Ninja Setup
  • Datasets
    • Build a Dataset
    • Environments
    • Parallelism
    • Explore a Dataset with a Shell
      • Large Datasets
    • Use a Dataset in a Script
    • Split a Dataset
    • Repartition a Dataset
    • Drop or Keep Columns
    • Rename Columns
  • Modeling
    • Tokenizer Training
    • Tokenization
    • Pre-Training (Maked Language Modeling)
      • Tensorboard
      • Inference
    • Fine-Tuning (Multi-Modal Summarization)
      • Inference
• Development
  • Architecture
  • Recommended Reading
  • Conventions
    • Code Style
    • Linting & Type Checking
    • Pre-Commit Hooks
    • Code Comments
    • Feature Branching
    • Linear History & Squash Merging
    • Conventional Commits
  • Workflows
    • Clone the Repository
    • Start Developing a New Feature or Fix
    • Open a Pull Request
    • Update Your Feature Branch with Upstream Changes
    • Merge a Pull Request
    • Start Developing a New Feature or Fix That Depends on Another Unmerged Pull Request
  • Setup
    • Prerequisites
    • Setup
    • Code Style
    • Documentation
    • Testing
    • Extras
      • Binary Ninja Setup
• Reference
  • undertale
    • exceptions
      • Error
      • EnvironmentError
      • PathError
      • PathDoesNotExist
      • PathExists
      • SchemaError
    • logging
      • setup_logging()
      • get_logger()
    • models
      • custom
        • InstructionTracePositionEmbedding
          • InstructionTracePositionEmbedding.compute_instruction_index()
          • InstructionTracePositionEmbedding.compute_argument_index()
          • InstructionTracePositionEmbedding.forward()
        • InstructionTraceTransformerEncoder
          • InstructionTraceTransformerEncoder.forward()
      • dataset
        • ParquetDataset
      • maskedlm
        • MaskedLMCollator
        • MaskedLMHead
          • MaskedLMHead.forward()
        • InstructionTraceTransformerEncoderForMaskedLM
          • InstructionTraceTransformerEncoderForMaskedLM.forward()
          • InstructionTraceTransformerEncoderForMaskedLM.infer()
        • InstructionTraceTransformerEncoderForMaskedLMConfiguration
      • tokenizer
        • preprocess_tokens()
        • merge_preprocessed_tokens()
        • train_tokenizer()
        • tokenize()
        • save()
        • load()
      • transformer
        • Attention
          • Attention.forward()
        • MultiHeadAttention
          • MultiHeadAttention.forward()
        • FeedForward
          • FeedForward.forward()
        • TransformerEncoderLayer
          • TransformerEncoderLayer.forward()
        • PositionEmbedding
          • PositionEmbedding.forward()
        • TransformerEncoder
          • TransformerEncoder.forward()
      • tuning
        • find_optimal_batch_size()
    • parsers
      • ArgumentParser
        • ArgumentParser.setup()
      • DatasetArgumentParser
      • ModelArgumentParser
    • pipeline
      • Cluster()
      • Client()
      • merge()
      • fanout()
      • flush()
      • binary
        • segment_and_disassemble_binary()
      • cpp
        • compile_cpp()
      • dask
        • Cluster()
        • Client()
        • merge()
        • fanout()
        • flush()
      • json
        • split_json()
        • merge_json()
      • parquet
        • ParquetOperation
        • HashColumn
        • Deduplicate
        • Drop
        • Keep
        • Rename
        • Repartition
        • modify_parquet()
      • tarfile
        • extract_tarfile()
        • compress_tarfile()
    • schema
      • Dataset
        • Dataset.id
      • SummarizedMixin
        • SummarizedMixin.summary
      • SourceDataset
        • SourceDataset.source
      • SummarizedSourceDataset
      • BinaryDataset
        • BinaryDataset.binary
      • BinaryDatasetWithSource
      • FunctionDataset
        • FunctionDataset.name
      • FunctionDatasetWithSource
      • DisassembledFunctionDataset
      • DisassembledFunctionDatasetWithSource
      • SummarizedDisassembledFunctionDatasetWithSource
      • VulnerabilityDisassembledFunctionDatasetWithSource
    • utils
      • timestamp()
      • assert_path_exists()
      • cache_path()
      • get_or_create_file()
      • get_or_create_directory()
      • find()
      • write_parquet()
      • subprocess()
      • RemoteException
      • datasets
        • drop
        • rename
          • parse_rename()
        • repartition
        • shell
          • main()
          • pandas
          • polars
        • split
          • parse_split()
          • split()
• Glossary
• About
  • Disclaimer
    • License