Code

[WIP] hadamard support#222

Code

Open

wenhuach21 wants to merge 5 commits intomainintel/auto-round:mainfrom hadamardintel/auto-round:hadamardCopy head branch name to clipboard

+4,835

Commits

Commits on Aug 12, 2024

• tmp change

  wenhuach21

  committed
  3613644

  Copy full SHA for 3613644

• add fuse norm and a variant of sq

  wenhuach21

  committed
  9ba1c9f

  Copy full SHA for 9ba1c9f

Commits on Aug 15, 2024

• initial support hadamard transform, layernorm must be fused. Online hadamard has not supported yet

  wenhuach21

  committed
  64f5301

  Copy full SHA for 64f5301

• Merge branch 'main' into hadamard

  wenhuach21

  authored
  f34998a

  Copy full SHA for f34998a

Commits on Aug 16, 2024

• add support of Qwen2, mistral/phi3 could not easily support due to tied lm-head though we could manually change the insert place of hadamard transform

  wenhuach21

  committed
  18dfd01

  Copy full SHA for 18dfd01