Fill-Mask
Transformers
Safetensors
Marathi
mt5
text2text-generation
trimmed
mt5-small-mar-16384 / tokenizer_config.json
lbourdois's picture
Trimmed google/mt5-small for Marathi (16384 tokens)
856ff06 verified
{
"eos_token": "</s>",
"unk_token": "<unk>",
"pad_token": "<pad>",
"extra_ids": 0
}