Refactor ContrastiveDataset and ContrastiveDistillationDataset #579

Open

DemirTonchev wants to merge 23 commits intohuggingface:mainfrom DemirTonchev:refactor-contrds

+141-110

Commits on Dec 20, 2024

fixed to work with processing_class instead tokenizer after transformers 4.45.2
DemirTonchev
committed

Commits on Dec 23, 2024

refactor attempt for ContrastiveDataset so that it does not blow RAM with bigger dataset
DemirTonchev
committed

Commits on Dec 25, 2024

Commits on Dec 26, 2024

typing fix
DemirTonchev
committed

Commits on Jan 11, 2025

Commits on Jan 12, 2025

cleanup leftovers attributes from old logic
DemirTonchev
committed