Finetune a pretrained model on a pairwise contrastive task.
Contents:
TransformerEncoder
TransformerEncoderForMaskedLM
TransformerEncoderForSequenceSimilarity
TransformerEncoderForSequenceClassification
TransformerEncoderForSequenceSummarizationGPT2