Something funky with Dreambooth on the last build (Patreon)
Content
It seen that there is a bug with some hardware + Accelerator Library + Float32 with Float16 calculations. It only happen once some numbers get to really low values.
I'm almost sure it something to do with the way Accelerator handle some variables.
I did some tests and it seen fixed, but will test a little more tomorrow to make sure, since it happen at random at some point in training, it can take some time between each test.
Thanks for all the reports on this and feedback, it made it faster to find the problem. Will also take a look the other callers to see if this may also happen on the regular prompt2img.