comfyanonymous and GitHub
722bc73319
Make text generation work with ministral model. ( #13395 )
...
Needs template before it works properly.
2026-04-13 20:43:57 -04:00
comfyanonymous and GitHub
31283d2892
Implement Ernie Image model. ( #13369 )
2026-04-11 22:29:31 -04:00
comfyanonymous and GitHub
2a1f402601
Make Qwen 8B work with TextGenerate node. ( #13160 )
2026-03-25 23:21:44 -04:00
Jukka Seppänen and GitHub
404d7b9978
feat: Support Qwen3.5 text generation models ( #12771 )
2026-03-25 22:48:28 -04:00
Talmaj and GitHub
d49420b3c7
LongCat-Image edit ( #13003 )
2026-03-21 23:51:05 -04:00
comfyanonymous and GitHub
0301ccf745
Small cleanup and try to get qwen 3 work with the text gen. ( #12537 )
2026-02-19 22:42:28 -05:00
Jukka Seppänen and GitHub
6d11cc7354
feat: Add basic text generation support with native models, initially supporting Gemma3 ( #12392 )
2026-02-18 20:49:43 -05:00
rattus and GitHub
ae79e33345
llama: use a more efficient rope implementation ( #12434 )
...
Get rid of the cat and unary negation and inplace add-cmul the two
halves of the rope. Precompute -sin once at the start of the model
rather than every transformer block.
This is slightly faster on both GPU and CPU bound setups.
2026-02-12 19:56:42 -05:00
comfyanonymous and GitHub
26dd7eb421
Fix ace step nan issue on some hardware/pytorch configs. ( #12289 )
2026-02-04 18:25:06 -05:00
comfyanonymous and GitHub
fe2511468d
Support the 4B ace step 1.5 lm model. ( #12257 )
...
Can be used as an alternative to the 1.7B
2026-02-03 19:01:38 -05:00
comfyanonymous and GitHub
85fc35e8fa
Fix mac issue. ( #12250 )
2026-02-03 12:19:39 -05:00
223364743c
llama: cast logits as a comfy-weight ( #12248 )
...
This is using a different layers weight with .to(). Change it to use
the ops caster if the original layer is a comfy weight so that it picks
up dynamic_vram and async_offload functionality in full.
Co-authored-by: Rattus <rattus128@gmail.com >
2026-02-03 11:31:36 -05:00
comfyanonymous and GitHub
3c1a1a2df8
Basic support for the ace step 1.5 model. ( #12237 )
2026-02-03 00:06:18 -05:00
comfyanonymous and GitHub
873de5f37a
KV cache implementation for using llama models for text generation. ( #12195 )
2026-01-31 21:11:11 -05:00
comfyanonymous and GitHub
e755268e7b
Config for Qwen 3 0.6B model. ( #11998 )
2026-01-20 23:08:31 -05:00
comfyanonymous and GitHub
3b832231bb
Flux2 Klein support. ( #11890 )
2026-01-15 10:33:15 -05:00
comfyanonymous and GitHub
f2b002372b
Support the LTXV 2 model. ( #11632 )
2026-01-05 01:58:59 -05:00
comfyanonymous and GitHub
1bdc9a947f
Remove duplicate import of model_management ( #11587 )
2025-12-31 19:29:55 -05:00
woctordho and GitHub
0aa7fa464e
Implement sliding attention in Gemma3 ( #11409 )
2025-12-20 00:16:46 -05:00
comfyanonymous and GitHub
878db3a727
Implement the Ovis image model. ( #11030 )
2025-12-01 20:56:17 -05:00
comfyanonymous and GitHub
e9aae31fa2
Z Image model. ( #10892 )
2025-11-25 18:41:45 -05:00
comfyanonymous and GitHub
d196a905bb
Lower vram usage for flux 2 text encoder. ( #10887 )
2025-11-25 14:58:39 -05:00
comfyanonymous and GitHub
6b573ae0cb
Flux 2 ( #10879 )
2025-11-25 10:50:19 -05:00
comfyanonymous and GitHub
17027f2a6a
Add a way to disable the final norm in the llama based TE models. ( #10794 )
2025-11-18 22:36:03 -05:00
comfyanonymous and GitHub
8aea746212
Implement gemma 3 as a text encoder. ( #10241 )
...
Not useful yet.
2025-10-06 22:08:08 -04:00
comfyanonymous and GitHub
1fee8827cb
Support for qwen edit plus model. Use the new TextEncodeQwenImageEditPlus. ( #9986 )
2025-09-22 16:49:48 -04:00
contentis and GitHub
97652d26b8
Add explicit casting in apply_rope for Qwen VL ( #9759 )
2025-09-08 15:08:18 -04:00
comfyanonymous and GitHub
dfa791eb4b
Rope fix for qwen vl. ( #9435 )
2025-08-19 20:47:42 -04:00
comfyanonymous and GitHub
4977f203fa
P2 of qwen edit model. ( #9412 )
...
* P2 of qwen edit model.
* Typo.
* Fix normal qwen.
* Fix.
* Make the TextEncodeQwenImageEdit also set the ref latent.
If you don't want it to set the ref latent and want to use the
ReferenceLatent node with your custom latent instead just disconnect the
VAE.
2025-08-18 22:38:34 -04:00
comfyanonymous and GitHub
c012400240
Initial support for qwen image model. ( #9179 )
2025-08-04 22:53:25 -04:00
comfyanonymous and GitHub
ec70ed6aea
Omnigen2 model implementation. ( #8669 )
2025-06-25 19:35:57 -04:00
comfyanonymous
3e8155f7a3
More flexible long clip support.
...
Add clip g long clip support.
Text encoder refactor.
Support llama models with different vocab sizes.
2025-04-15 10:32:21 -04:00
comfyanonymous
85ef295069
Make applying embeddings more efficient.
...
Adding new tokens no longer makes a whole copy of the embeddings weight
which can be massive on certain models.
2025-03-05 17:34:38 -05:00
comfyanonymous
e5ea112a90
Support Lumina 2 model.
2025-02-04 04:16:30 -05:00
comfyanonymous
a4f59bc65e
Pick attention implementation based on device in llama code.
2024-12-18 01:30:20 -05:00
comfyanonymous
bda1482a27
Basic Hunyuan Video model support.
2024-12-16 19:35:40 -05:00
comfyanonymousandGitHub
Jukka SeppänenandGitHub
TalmajandGitHub
rattusandGitHub
woctordhoandGitHub
contentisandGitHub
comfyanonymous