Tools for training certain AI models.
(Command-line script based)
I am primarily focused on txt2img models. I created this new program because I want to create a model with a currently unsupported architecture. None of the existing programs had all the features I wanted, so I wrote my own, instead of trying to mod one of those.
The actual "train a model" scripts are under trainer
but before you train a mode, you need a dataset to train it on. So there are some relevant scripts for that under dataset_scripts
The primary features I like about my own scripts are:
-
Easy to understand and prune structure for tensor caching
-
Easier-to-understand flow(for me, anyway) for the actual training
-
Full training config gets coped alongside the resulting model
-
Currently, only SD1.5 unet supported
-
Currently, Only "diffusers" format supported
-
The tensor caches are not compressed. This can be a space issue for things like T5, which end up making very large text embedding files. Not a problem for CLIP cache files.