Skip to content

Issues: xrsrke/pipegoose

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Multimodal MoE help wanted Extra attention is needed High Priority
#61 opened Dec 11, 2023 by xrsrke
Distributed CLIP help wanted Extra attention is needed
#60 opened Dec 10, 2023 by xrsrke
End-to-end FP8 training help wanted Extra attention is needed High Priority
#45 opened Nov 26, 2023 by xrsrke
1 of 8 tasks
Tensor Parallelism
#37 opened Nov 20, 2023 by 3outeille
Distributed Logger good first issue Good for newcomers
#33 opened Nov 14, 2023 by xrsrke
2 tasks
Save and load checkpoints good first issue Good for newcomers help wanted Extra attention is needed
#29 opened Nov 8, 2023 by xrsrke
Lazy initialization of massive models help wanted Extra attention is needed
#25 opened Oct 27, 2023 by xrsrke
Sequence Parallelism
#22 opened Oct 25, 2023 by xrsrke
6 tasks
Mixture of Experts
#19 opened Oct 25, 2023 by xrsrke
3 of 11 tasks
Trainer good first issue Good for newcomers
#18 opened Oct 25, 2023 by xrsrke
3 tasks
Implement new tensor parallelism technique help wanted Extra attention is needed
#17 opened Oct 25, 2023 by xrsrke
Setup documentation good first issue Good for newcomers help wanted Extra attention is needed
#16 opened Oct 25, 2023 by xrsrke
Mixed precision training in FP16 help wanted Extra attention is needed
#14 opened Oct 25, 2023 by xrsrke
3 tasks
Fused Optimizer
#13 opened Oct 25, 2023 by xrsrke
3 tasks
Kernel Fusion using torch.jit good first issue Good for newcomers
#10 opened Oct 25, 2023 by xrsrke
3 tasks
Port CUDA Kernels good first issue Good for newcomers help wanted Extra attention is needed
#8 opened Oct 25, 2023 by xrsrke
2 tasks
Gradient Checkpointing
#4 opened Oct 25, 2023 by xrsrke
ProTip! Type g i on any issue or pull request to go back to the issue listing page.