Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How to finetune with multi resolution? #491

Open
trouble-maker007 opened this issue Nov 12, 2024 · 2 comments
Open

How to finetune with multi resolution? #491

trouble-maker007 opened this issue Nov 12, 2024 · 2 comments
Assignees
@zRzRzRzRzRzRzR

Comments

@trouble-maker007
Copy link

Is there any plan release the code of multi resolution finetune with sat? I found that the current sft.yaml file is not adjust with the v1.5 ckpt
@zRzRzRzRzRzRzR zRzRzRzRzRzRzR self-assigned this Nov 12, 2024
@zRzRzRzRzRzRzR
Copy link
Member

In the fine-tuning section, we will provide a fine-tuning version of diffusers. The model version of diffusers will be released this week, and it is expected to be fine-tuned on cogvideox-factory

@trouble-maker007
Copy link
Author

@zRzRzRzRzRzRzR Could you add some comments to this code? What is the role of OFS embedding?
https://github.com/THUDM/CogVideo/blob/main/sat/dit_video_concat.py#L721

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zRzRzRzRzRzRzR zRzRzRzRzRzRzR

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@trouble-maker007 @zRzRzRzRzRzRzR