Code

Parameter input rotary-freq#263

Code

Open

jmercat wants to merge 6 commits intomlfoundations:mainmlfoundations/open_lm:mainfrom jmercat:rotary_freqjmercat/open_lm_:rotary_freqCopy head branch name to clipboard

+109-10

Commits

Commits on Apr 30, 2024

• Add parameter input rotary-freq to change the rotary positional embedding frequency parameter

  jmercat

  committed
  fde6e25

  Copy full SHA for fde6e25

Commits on May 16, 2024

• Avoid loading different frequency in rotary embedding

  jmercat

  committed
  9a92986

  Copy full SHA for 9a92986

• Updated rotary to get rid of buffer but remain compatible with older versions, added test

  jmercat

  committed
  e04a833

  Copy full SHA for e04a833

• load strict in test

  jmercat

  committed
  8fe2d45

  Copy full SHA for 8fe2d45

• black formatted

  jmercat

  committed
  d66caa9

  Copy full SHA for d66caa9

Commits on Jun 17, 2024

• Merge branch 'main' into rotary_freq

  jmercat

  authored
  34ac883

  Copy full SHA for 34ac883