v0.1.0

Release Notes

This is the very first release of Langsfer.

It contains:

• Embedding initialization methods:

  • WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  • CLP-Transfer: Efficient language model training through cross-lingual and progressive transfer learning.
  • FOCUS: Effective Embedding Initialization for Specializing Pretrained Multilingual Models on a Single Language.

• Tutorial notebooks showing how to use the 3 implemented methods

Full Changelog: https://github.com/AnesBenmerzoug/langsfer/commits/v0.1.0