Undertale

Contents:

• Usage
  • Setup
    • Prerequisites
    • Setup
  • Datasets
    • Build a Dataset
    • Explore a Dataset with a Shell
    • Use a Dataset in a Script
    • VLLM Server Integration
  • Modeling
    • Pretoken Processing
    • Tokenizer Training
    • Tokenization
    • Pre-Training (Maked Language Modeling)
      • Inference
    • Fine-Tuning (Contrastive Embeddings)
      • Inference
    • Fine-Tuning (Multi-Modal Summarization)
      • Inference
• Development
  • Architecture
  • Recommended Reading
  • Conventions
    • Code Style
    • Linting
    • Pre-Commit Hooks
    • Code Comments
    • Feature Branching
    • Linear History & Squash Merging
    • Conventional Commits
  • Workflows
    • Clone the Repository
    • Start Developing a New Feature or Fix
    • Open a Pull Request
    • Update Your Feature Branch with Upstream Changes
    • Merge a Pull Request
    • Start Developing a New Feature or Fix That Depends on Another Unmerged Pull Request
  • Setup
    • Prerequisites
    • Setup
    • Code Style
    • Documentation
    • Extras
      • Installing Ghidra on MacOS
• Reference
  • undertale
    • datasets
      • apt
        • LoadAPTPackages
        • APTpkg
      • assemblage
        • vcpkg
          • AssemblageVcpkgReader
          • AssemblageVcpkg
        • windows
          • AssemblageWindowsReader
          • AssemblageWindows
      • base
        • Dataset
          • Dataset.schema
          • Dataset.get_executor()
          • Dataset.get_pipeline()
          • Dataset.load()
          • Dataset.store()
        • WRITERS
        • DEFAULT_WRITER
        • EXECUTORS
        • DEFAULT_EXECUTOR
        • main()
      • googlecodejam
        • GoogleCodeJam
      • humanevalx
        • HumanEvalX
      • nixpkgs
        • FindNixpkgs
        • EnrichGithubPackages
        • BuildNixpkgs
        • ExtractBinaryDataset
        • NixPkgs
      • pipeline
        • compilers
          • cpp
            • CppCompiler
        • disassemblers
          • binaryninja
            • BinaryNinjaDisassembler
              • BinaryNinjaDisassembler.run()
          • capstone
            • CapstoneDisassembler
          • ghidra
            • build_control_flow_graph()
            • GhidraDisassembler
          • radare2
            • RadareDisassembler
          • rizin
            • RizinDisassembler
        • formatters
          • item
            • ITEMPretokenizer
            • ITEMTokenizer
        • pairs
          • pairwise_contrastive
            • PairwiseContrastive
        • segmenters
          • binaryninja
            • BinaryNinjaFunctionSegmenter
          • ghidra
            • GhidraFunctionSegmenter
          • lief
            • LIEFFunctionSegmenter
          • rizin
            • RizinFunctionSegmentAndDisassemble
        • summarizers
          • VLLMSummarizer
          • vllm
            • VLLMSummarizer
      • schema
        • InvalidSchemaError
        • Schema
          • Schema.get_members()
          • Schema.to_features()
          • Schema.validate()
        • WholeBinary
          • WholeBinary.binary
          • WholeBinary.Optional
            • WholeBinary.Optional.source
            • WholeBinary.Optional.architecture
            • WholeBinary.Optional.compiler
        • Function
          • Function.code
          • Function.disassembly
          • Function.Optional
            • Function.Optional.id
            • Function.Optional.source
            • Function.Optional.architecture
            • Function.Optional.compiler
            • Function.Optional.function_name
        • PairwiseContrasting
          • PairwiseContrasting.first
          • PairwiseContrasting.second
        • TripletContrasting
          • TripletContrasting.anchor
          • TripletContrasting.positive
          • TripletContrasting.negative
        • SummarizedFunction
      • scripts
        • pretokenize
          • Pretokenizer
        • shell
        • tokenize
          • Tokenizer
      • xlcost
        • XLCost
    • evaluation
    • logging
      • setup_logging()
    • models
      • item
        • TransformerEncoder
        • TransformerEncoderForMaskedLM
        • TransformerEncoderForSequenceSimilarity
        • TransformerEncoderForSequenceClassification
        • TransformerEncoderForSequenceSummarizationGPT2
        • evaluate_maskedlm
        • finetune_embedding
        • finetune_summarization
        • infer_embedding
        • infer_maskedlm
        • infer_similarity
        • infer_summarization
        • model
          • TransformerEncoder
          • TransformerEncoderForMaskedLM
          • TransformerEncoderForSequenceSimilarity
          • TransformerEncoderForSequenceClassification
          • TransformerEncoderForSequenceSummarizationGPT2
        • pretrain_dataflow
        • pretrain_maskedlm
          • ProgressBar
            • ProgressBar.get_metrics()
          • ValidationCallback
            • ValidationCallback.on_validation_end()
        • tokenizer
          • train()
    • patch
      • patch_filelock_flock_unsupported()
    • utils
      • suppress_sigint()
      • allow_sigint()
• Glossary
• About
  • Disclaimer
    • License