722bc73319
Make text generation work with ministral model. ( #13395 )
...
Needs template before it works properly.
2026-04-13 20:43:57 -04:00
31283d2892
Implement Ernie Image model. ( #13369 )
2026-04-11 22:29:31 -04:00
2a1f402601
Make Qwen 8B work with TextGenerate node. ( #13160 )
2026-03-25 23:21:44 -04:00
404d7b9978
feat: Support Qwen3.5 text generation models ( #12771 )
2026-03-25 22:48:28 -04:00
d49420b3c7
LongCat-Image edit ( #13003 )
2026-03-21 23:51:05 -04:00
0301ccf745
Small cleanup and try to get qwen 3 work with the text gen. ( #12537 )
2026-02-19 22:42:28 -05:00
6d11cc7354
feat: Add basic text generation support with native models, initially supporting Gemma3 ( #12392 )
2026-02-18 20:49:43 -05:00
ae79e33345
llama: use a more efficient rope implementation ( #12434 )
...
Get rid of the cat and unary negation and inplace add-cmul the two
halves of the rope. Precompute -sin once at the start of the model
rather than every transformer block.
This is slightly faster on both GPU and CPU bound setups.
2026-02-12 19:56:42 -05:00
26dd7eb421
Fix ace step nan issue on some hardware/pytorch configs. ( #12289 )
2026-02-04 18:25:06 -05:00
fe2511468d
Support the 4B ace step 1.5 lm model. ( #12257 )
...
Can be used as an alternative to the 1.7B
2026-02-03 19:01:38 -05:00
85fc35e8fa
Fix mac issue. ( #12250 )
2026-02-03 12:19:39 -05:00
223364743c
llama: cast logits as a comfy-weight ( #12248 )
...
This is using a different layers weight with .to(). Change it to use
the ops caster if the original layer is a comfy weight so that it picks
up dynamic_vram and async_offload functionality in full.
Co-authored-by: Rattus <rattus128@gmail.com >
2026-02-03 11:31:36 -05:00
3c1a1a2df8
Basic support for the ace step 1.5 model. ( #12237 )
2026-02-03 00:06:18 -05:00
873de5f37a
KV cache implementation for using llama models for text generation. ( #12195 )
2026-01-31 21:11:11 -05:00
e755268e7b
Config for Qwen 3 0.6B model. ( #11998 )
2026-01-20 23:08:31 -05:00
3b832231bb
Flux2 Klein support. ( #11890 )
2026-01-15 10:33:15 -05:00
f2b002372b
Support the LTXV 2 model. ( #11632 )
2026-01-05 01:58:59 -05:00
1bdc9a947f
Remove duplicate import of model_management ( #11587 )
2025-12-31 19:29:55 -05:00
0aa7fa464e
Implement sliding attention in Gemma3 ( #11409 )
2025-12-20 00:16:46 -05:00
878db3a727
Implement the Ovis image model. ( #11030 )
2025-12-01 20:56:17 -05:00
e9aae31fa2
Z Image model. ( #10892 )
2025-11-25 18:41:45 -05:00
d196a905bb
Lower vram usage for flux 2 text encoder. ( #10887 )
2025-11-25 14:58:39 -05:00
6b573ae0cb
Flux 2 ( #10879 )
2025-11-25 10:50:19 -05:00
17027f2a6a
Add a way to disable the final norm in the llama based TE models. ( #10794 )
2025-11-18 22:36:03 -05:00
8aea746212
Implement gemma 3 as a text encoder. ( #10241 )
...
Not useful yet.
2025-10-06 22:08:08 -04:00
1fee8827cb
Support for qwen edit plus model. Use the new TextEncodeQwenImageEditPlus. ( #9986 )
2025-09-22 16:49:48 -04:00
97652d26b8
Add explicit casting in apply_rope for Qwen VL ( #9759 )
2025-09-08 15:08:18 -04:00
dfa791eb4b
Rope fix for qwen vl. ( #9435 )
2025-08-19 20:47:42 -04:00
4977f203fa
P2 of qwen edit model. ( #9412 )
...
* P2 of qwen edit model.
* Typo.
* Fix normal qwen.
* Fix.
* Make the TextEncodeQwenImageEdit also set the ref latent.
If you don't want it to set the ref latent and want to use the
ReferenceLatent node with your custom latent instead just disconnect the
VAE.
2025-08-18 22:38:34 -04:00
c012400240
Initial support for qwen image model. ( #9179 )
2025-08-04 22:53:25 -04:00
ec70ed6aea
Omnigen2 model implementation. ( #8669 )
2025-06-25 19:35:57 -04:00
3e8155f7a3
More flexible long clip support.
...
Add clip g long clip support.
Text encoder refactor.
Support llama models with different vocab sizes.
2025-04-15 10:32:21 -04:00
85ef295069
Make applying embeddings more efficient.
...
Adding new tokens no longer makes a whole copy of the embeddings weight
which can be massive on certain models.
2025-03-05 17:34:38 -05:00
e5ea112a90
Support Lumina 2 model.
2025-02-04 04:16:30 -05:00
a4f59bc65e
Pick attention implementation based on device in llama code.
2024-12-18 01:30:20 -05:00
bda1482a27
Basic Hunyuan Video model support.
2024-12-16 19:35:40 -05:00
comfyanonymous
Jukka Seppänen
Talmaj
rattus
woctordho
contentis
comfyanonymous