Question about output embedding vector of ModernBERT

#12

by meaningful96 - opened Dec 23, 2024

Dec 23, 2024

Are the output CLS and token embedding vectors L2 normalized on a per-token basis?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment