Skip to content

support grouped query attention(MQA & GQA) for flash_attn #31

support grouped query attention(MQA & GQA) for flash_attn

support grouped query attention(MQA & GQA) for flash_attn #31