Kohaku-Blueleaf and GitHub
b20ba1f27c
Fix #9537 ( #9576 )
2025-08-27 12:45:02 -04:00
Kohaku-Blueleaf and GitHub
eb2f78b4e0
[Training Node] algo support, grad acc, optional grad ckpt ( #9015 )
...
* Add factorization utils for lokr
* Add lokr train impl
* Add loha train impl
* Add adapter map for algo selection
* Add optional grad ckpt and algo selection
* Update __init__.py
* correct key name for loha
* Use custom fwd/bwd func and better init for loha
* Support gradient accumulation
* Fix bugs of loha
* use more stable init
* Add OFT training
* linting
2025-07-23 20:57:27 -04:00
Kohaku-Blueleaf and GitHub
1205afc708
Better training loop implementation ( #8820 )
2025-07-09 11:41:22 -04:00
Kohaku-Blueleaf and GitHub
181a9bf26d
Support Multi Image-Caption dataset in lora training node ( #8819 )
...
* initial impl of multi img/text dataset
* Update nodes_train.py
* Support Kohya-ss structure
2025-07-08 20:18:04 -04:00
Kohaku-Blueleaf and GitHub
520eb77b72
LoRA Trainer: LoRA training node in weight adapter scheme ( #8446 )
2025-06-13 19:25:59 -04:00
Kohaku-Blueleaf and GitHub
2ab9618732
Fix the bugs in OFT/BOFT moule ( #7909 )
...
* Correct calculate_weight and load for OFT
* Correct calculate_weight and loading for BOFT
2025-05-02 13:12:37 -04:00
Kohaku-Blueleaf and GitHub
a8f63c0d5b
Support dora_scale on both axis ( #7727 )
2025-04-22 05:01:27 -04:00
Kohaku-Blueleaf and GitHub
966c43ce26
Add OFT/BOFT algorithm in weight adapter ( #7725 )
2025-04-22 04:59:47 -04:00
Kohaku-Blueleaf and GitHub
1f3fba2af5
Unified Weight Adapter system for better maintainability and future feature of Lora system ( #7540 )
2025-04-21 20:15:32 -04:00
Kohaku-BlueleafandGitHub