Can continuous tokens be treated as embeddings?

[ogencoglu]

Thanks for the great work!

Can continuous tokens be treated as embeddings or latent representations for downstream applications like clustering or similarity search or just supervised learning in general? What exactly is the difference of let's say DINOv2 embeddings vs Cosmos when you have the causal setup?