58 Commits

Include renames

Author	SHA1	Message	Date
comfyanonymous	f87810cd3e	Let tokenizers return weights to be stored in the saved checkpoint.	2024-07-25 10:52:09 -04:00
comfyanonymous	10c919f4c7	Make it possible to load tokenizer data from checkpoints.	2024-07-24 16:43:53 -04:00
comfyanonymous	0a4c49c57c	Support MT5.	2024-07-23 15:35:28 -04:00
comfyanonymous	88ed893034	Allow SPieceTokenizer to load model from a byte string.	2024-07-23 14:17:42 -04:00
comfyanonymous	14764aa2e2	Rename LLAMATokenizer to SPieceTokenizer.	2024-07-22 12:21:45 -04:00
comfyanonymous	1305fb294c	Refactor: Move some code to the comfy/text_encoders folder.	2024-07-15 17:36:24 -04:00
comfyanonymous	29c2e26724	Better tokenizing code for AuraFlow.	2024-07-12 01:15:25 -04:00
comfyanonymous	9f291d75b3	AuraFlow model implementation.	2024-07-11 16:52:26 -04:00