Skip to content

Issues: hpcaitech/ColossalAI

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

420 Open 1,280 Closed
420 Open 1,280 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[BUG]:The program froze while attempting R1 Lora bug Something isn't working
#6234 opened Feb 28, 2025 by ygxw0909
2 tasks done
[BUG]: cannot import name 'CpuAdamArmExtension' from 'colossalai.kernel.extensions' (unknown location) bug Something isn't working
#6233 opened Feb 28, 2025 by Fence
2 tasks done
[BUG]: how to fine tune DeepSeek-R1-Distill-Qwen-7B with lora bug Something isn't working
#6232 opened Feb 28, 2025 by AI-HR
2 tasks done
1
[BUG]: 【R1 SFT Bug，loss should start from 1】 bug Something isn't working
#6227 opened Feb 27, 2025 by 447428054
2 tasks done
[BUG]: RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn bug Something isn't working
#6225 opened Feb 27, 2025 by klompn
2 tasks done
DeepSeekV3 lora fine tune, allocate memory too big !
#6224 opened Feb 26, 2025 by wotulong
DeepSeek 671B Fine-Tuning , how to merge lora model
#6222 opened Feb 26, 2025 by Roysky
2
[BUG]: Lora load error bug Something isn't working
#6221 opened Feb 25, 2025 by 447428054
2 tasks done
[BUG]: EP16 negative split bug Something isn't working
#6220 opened Feb 25, 2025 by 447428054
2 tasks done
【Question】What is the minimum number of GPUs required to train deepseek 671B with GRPO? How about using LoRA?
#6219 opened Feb 25, 2025 by LiuShixing
[BUG]: /bin/bash: line 0: export: `NPU-VISIBLE-DEVICES=0,1,2,3,4,5,6,7': not a valid identifier bug Something isn't working
#6217 opened Feb 24, 2025 by Gera001
2 tasks done
2
Respecting regulations and stabilizing the ecosystem by activists bug Something isn't working
#6216 opened Feb 24, 2025 by MASIHMIRSALI
2 tasks done
1
Full parameter finetuning of R1
#6215 opened Feb 23, 2025 by Opdoop
[BUG]: Precision overflow occurs when moe forward is performed bug Something isn't working
#6212 opened Feb 21, 2025 by zh2333
2 tasks done
2
[BUG]: failed to install coati in npu docker environment bug Something isn't working
#6209 opened Feb 20, 2025 by wangyuan249
2 tasks done
[BUG]: 该如何安装colossal到NPU上，看项目有相关描述，但没找到相关教程 bug Something isn't working
#6205 opened Feb 20, 2025 by obj12
2 tasks done
4
[BUG]: bug Something isn't working
#6202 opened Feb 19, 2025 by Hongyuan-Liu
2 tasks done
1
【Question】Question about initial finetune loss
#6201 opened Feb 19, 2025 by SolenoidWGT
2
[DOC]: Update the documentation of ShardConfig for 1D, 2D, 2.5D, 3D tensor parallelism documentation Improvements or additions to documentation
#6197 opened Feb 18, 2025 by giriprasad51
it free?
#6193 opened Feb 15, 2025 by werruww
[FEATURE]: Expert Parallel for qwen/deepseek enhancement New feature or request
#6180 opened Jan 12, 2025 by Guodanding
4
[BUG]: RuntimeError: mat1 and mat2 must have the same dtype, but got Float and BFloat16 bug Something isn't working
#6169 opened Dec 25, 2024 by balcklive
1 task done
Hybrid Parallel Plugin下TP显存比同配置下deepspeed要高？？？
#6161 opened Dec 17, 2024 by duomicoding
5
[BUG]: Gemini saved an additional portion of the weights while using tie_word_embeddings=True bug Something isn't working
#6160 opened Dec 13, 2024 by ericxsun
1 task done
update shardformer for transformers=4.46
#6157 opened Dec 10, 2024 by duomicoding
ProTip! Type g i on any issue or pull request to go back to the issue listing page.