vllm

Classes

VLLMSummarizer(*args, **kwargs)

Summarizes the given source code with a vllm server.
class undertale.datasets.pipeline.summarizers.vllm.VLLMSummarizer(*args, **kwargs)

Bases: PipelineStep

Summarizes the given source code with a vllm server.

Parameters:

  • field – The name of the field you would like to summarize.

  • model – The model to be used for summarization.

  • prompt – The prompt to use for summarization.

  • temperature – Model generation temperature.

  • maximum_tokens – The maximum number of tokens to generate.

Input:

Any data that you would like to summarize.

Output:

Adds the field summary, to the document metadata. Does not modify the text field.