andreas/ComfyUI
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Files
1c8d11e48a822327e7b77ccacdb56bccf3e20072
ComfyUI/comfy/sd1_clip.py
comfyanonymous 1c8d11e48a Support different types of tokenizers. 
Support tokenizers without an eos token.

Pass full sentences to tokenizer for more efficient tokenizing.
2024-12-10 15:03:39 -05:00

24 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink