We are planning to integrate a few SOTA pretrained models. Which one are you interested in? #86

minghui · 2022-05-12T08:16:54Z

minghui
May 12, 2022
Maintainer

We are planning to integrate a few SOTA pretrain models. Which one are you interested in?

Mengzi model, the SOTA 'small' Chinese pretrained model (https://github.com/Langboat/Mengzi)

23%

PaLM: Pathway Language model from Google (affordable scale, e.g. 5.4B or 0.54B version, not 540B for sure...)

17%

K-BERT: Knowledge powered PLM, https://arxiv.org/abs/1909.07606

35%

Dalle2: OpenAI Dalle2, text to image generator, https://openai.com/dall-e-2/

23%

17 votes