"Getting the most out of your tokenizer for pre-training and domain adaptation."

Gautier Dagan, Gabriel Synnaeve, Baptiste Rozière (2024)

Details and statistics

DOI: 10.48550/ARXIV.2402.01035

access: open

type: Informal or Other Publication

metadata version: 2024-02-09

a service of  Schloss Dagstuhl - Leibniz Center for Informatics