Clue-instruct dataset and different models fine-tuned on it.
Andrea Zugarini
azugarini
AI & ML interests
Natural Language Processing, Language Models, Language Model Compression
Recent Activity
published
a model
about 1 month ago
expertai/PharmaER.IT-gold-only_xlm-roberta-base
published
a model
about 1 month ago
expertai/PharmaER.IT-full_xlm-roberta-large
published
a model
about 1 month ago
expertai/PharmaER.IT-gold-only_xlm-roberta-large
Organizations
Collection of research on tokenizers' adaptation to specific domains and/or languages. Special focus on sequence compression directions
-
Fast Vocabulary Transfer for Language Model Compression
Paper • 2402.09977 • Published • 2 -
Multi-Word Tokenization for Sequence Compression
Paper • 2402.09949 • Published -
Zero-Shot Tokenizer Transfer
Paper • 2405.07883 • Published • 5 -
Language Model Tokenizers Introduce Unfairness Between Languages
Paper • 2305.15425 • Published • 1
Clue-instruct dataset and different models fine-tuned on it.
Collection of research on tokenizers' adaptation to specific domains and/or languages. Special focus on sequence compression directions
-
Fast Vocabulary Transfer for Language Model Compression
Paper • 2402.09977 • Published • 2 -
Multi-Word Tokenization for Sequence Compression
Paper • 2402.09949 • Published -
Zero-Shot Tokenizer Transfer
Paper • 2405.07883 • Published • 5 -
Language Model Tokenizers Introduce Unfairness Between Languages
Paper • 2305.15425 • Published • 1
