-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Brandon/flux model loading #6739
Commits on Aug 26, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 5256f26 - Browse repository at this point
Copy the full SHA 5256f26View commit details -
Configuration menu - View commit details
-
Copy full SHA for 562c2cc - Browse repository at this point
Copy the full SHA 562c2ccView commit details -
Configuration menu - View commit details
-
Copy full SHA for b617631 - Browse repository at this point
Copy the full SHA b617631View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6a068cc - Browse repository at this point
Copy the full SHA 6a068ccView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5149a3e - Browse repository at this point
Copy the full SHA 5149a3eView commit details -
Use the FluxPipeline.encode_prompt() api rather than trying to run th…
…e two text encoders separately.
Configuration menu - View commit details
-
Copy full SHA for 761e49f - Browse repository at this point
Copy the full SHA 761e49fView commit details -
Got FLUX schnell working with 8-bit quantization. Still lots of rough…
… edges to clean up.
Configuration menu - View commit details
-
Copy full SHA for 5e1b3e9 - Browse repository at this point
Copy the full SHA 5e1b3e9View commit details -
Configuration menu - View commit details
-
Copy full SHA for e71c7d0 - Browse repository at this point
Copy the full SHA e71c7d0View commit details -
Make 8-bit quantization save/reload work for the FLUX transformer. Re…
…load is still very slow with the current optimum.quanto implementation.
Configuration menu - View commit details
-
Copy full SHA for f7753be - Browse repository at this point
Copy the full SHA f7753beView commit details -
Configuration menu - View commit details
-
Copy full SHA for 28654ec - Browse repository at this point
Copy the full SHA 28654ecView commit details -
Configuration menu - View commit details
-
Copy full SHA for 40e9a4e - Browse repository at this point
Copy the full SHA 40e9a4eView commit details -
Configuration menu - View commit details
-
Copy full SHA for df1ac07 - Browse repository at this point
Copy the full SHA df1ac07View commit details -
Configuration menu - View commit details
-
Copy full SHA for 11279ab - Browse repository at this point
Copy the full SHA 11279abView commit details -
Configuration menu - View commit details
-
Copy full SHA for bcb7f8e - Browse repository at this point
Copy the full SHA bcb7f8eView commit details -
Split a FluxTextEncoderInvocation out from the FluxTextToImageInvocat…
…ion. This has the advantage that we benfit from automatic caching when the prompt isn't changed.
Configuration menu - View commit details
-
Copy full SHA for 3f1fbc6 - Browse repository at this point
Copy the full SHA 3f1fbc6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 06d35c3 - Browse repository at this point
Copy the full SHA 06d35c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for b1cf2f5 - Browse repository at this point
Copy the full SHA b1cf2f5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 31c8d76 - Browse repository at this point
Copy the full SHA 31c8d76View commit details -
Configuration menu - View commit details
-
Copy full SHA for 17f5952 - Browse repository at this point
Copy the full SHA 17f5952View commit details -
Configuration menu - View commit details
-
Copy full SHA for 52ff3c7 - Browse repository at this point
Copy the full SHA 52ff3c7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 307a130 - Browse repository at this point
Copy the full SHA 307a130View commit details -
Configuration menu - View commit details
-
Copy full SHA for 27f33bb - Browse repository at this point
Copy the full SHA 27f33bbView commit details -
Configuration menu - View commit details
-
Copy full SHA for e157ff3 - Browse repository at this point
Copy the full SHA e157ff3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6779e03 - Browse repository at this point
Copy the full SHA 6779e03View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4bb3438 - Browse repository at this point
Copy the full SHA 4bb3438View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6b0f5f4 - Browse repository at this point
Copy the full SHA 6b0f5f4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3814cd7 - Browse repository at this point
Copy the full SHA 3814cd7View commit details -
Configuration menu - View commit details
-
Copy full SHA for a6ad70e - Browse repository at this point
Copy the full SHA a6ad70eView commit details -
Add backend functions and classes for Flux implementation, Update the…
… way flux encoders/tokenizers are loaded for prompt encoding, Update way flux vae is loaded
Configuration menu - View commit details
-
Copy full SHA for f3096a8 - Browse repository at this point
Copy the full SHA f3096a8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5fc6c28 - Browse repository at this point
Copy the full SHA 5fc6c28View commit details -
Configuration menu - View commit details
-
Copy full SHA for 68d28db - Browse repository at this point
Copy the full SHA 68d28dbView commit details -
Configuration menu - View commit details
-
Copy full SHA for f3ebbe1 - Browse repository at this point
Copy the full SHA f3ebbe1View commit details -
Configuration menu - View commit details
-
Copy full SHA for efab4a3 - Browse repository at this point
Copy the full SHA efab4a3View commit details -
Install sub directories with folders correctly, ensure consistent dty…
…pe of tensors in flux pipeline and vae
Configuration menu - View commit details
-
Copy full SHA for 95a2d97 - Browse repository at this point
Copy the full SHA 95a2d97View commit details -
Select dev/schnell based on state dict, use correct max seq len based…
… on dev/schnell, and shift in inference, separate vae flux params into separate config
Configuration menu - View commit details
-
Copy full SHA for 98151ce - Browse repository at this point
Copy the full SHA 98151ceView commit details -
Fix FLUX output image clamping. And a few other minor fixes to make i…
…nference work with the full bfloat16 FLUX transformer model.
Configuration menu - View commit details
-
Copy full SHA for 5d7e154 - Browse repository at this point
Copy the full SHA 5d7e154View commit details -
Configuration menu - View commit details
-
Copy full SHA for 870ecd3 - Browse repository at this point
Copy the full SHA 870ecd3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 24829b9 - Browse repository at this point
Copy the full SHA 24829b9View commit details -
Configuration menu - View commit details
-
Copy full SHA for f36c6d0 - Browse repository at this point
Copy the full SHA f36c6d0View commit details -
Configuration menu - View commit details
-
Copy full SHA for bebc6d3 - Browse repository at this point
Copy the full SHA bebc6d3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3f845d9 - Browse repository at this point
Copy the full SHA 3f845d9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8b3e386 - Browse repository at this point
Copy the full SHA 8b3e386View commit details -
Configuration menu - View commit details
-
Copy full SHA for 35c263a - Browse repository at this point
Copy the full SHA 35c263aView commit details -
Configuration menu - View commit details
-
Copy full SHA for ec360ee - Browse repository at this point
Copy the full SHA ec360eeView commit details -
Configuration menu - View commit details
-
Copy full SHA for c822c3d - Browse repository at this point
Copy the full SHA c822c3dView commit details -
Update doc string for import_local_model and remove access_token sinc…
…e it's only usable for local file paths
Configuration menu - View commit details
-
Copy full SHA for 19238ed - Browse repository at this point
Copy the full SHA 19238edView commit details -
Configuration menu - View commit details
-
Copy full SHA for ede26a7 - Browse repository at this point
Copy the full SHA ede26a7View commit details -
Configuration menu - View commit details
-
Copy full SHA for f0408bb - Browse repository at this point
Copy the full SHA f0408bbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9e888b1 - Browse repository at this point
Copy the full SHA 9e888b1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6afb113 - Browse repository at this point
Copy the full SHA 6afb113View commit details -
Add docs to the requantize(...) function explaining why it was copied…
… from optimum-quanto.
Configuration menu - View commit details
-
Copy full SHA for 519bf71 - Browse repository at this point
Copy the full SHA 519bf71View commit details -
Configuration menu - View commit details
-
Copy full SHA for c549a49 - Browse repository at this point
Copy the full SHA c549a49View commit details -
update flux_model_loader node to take a T5 encoder from node field in…
…stead of hardcoded list, assume all models have been downloaded
Configuration menu - View commit details
-
Copy full SHA for 41fb09b - Browse repository at this point
Copy the full SHA 41fb09bView commit details -
Configuration menu - View commit details
-
Copy full SHA for c66ccad - Browse repository at this point
Copy the full SHA c66ccadView commit details -
add FLUX schnell starter models and submodels as dependenices or adho…
…c download options
Configuration menu - View commit details
-
Copy full SHA for 9020a8a - Browse repository at this point
Copy the full SHA 9020a8aView commit details -
fix(ui): only exclude flux main models from linear UI dropdown, not m…
…odel manager list
Configuration menu - View commit details
-
Copy full SHA for 7264920 - Browse repository at this point
Copy the full SHA 7264920View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3fe9582 - Browse repository at this point
Copy the full SHA 3fe9582View commit details -
Configuration menu - View commit details
-
Copy full SHA for 24831d4 - Browse repository at this point
Copy the full SHA 24831d4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6899762 - Browse repository at this point
Copy the full SHA 6899762View commit details -
Configuration menu - View commit details
-
Copy full SHA for f67c4da - Browse repository at this point
Copy the full SHA f67c4daView commit details -
Configuration menu - View commit details
-
Copy full SHA for a04d479 - Browse repository at this point
Copy the full SHA a04d479View commit details -
Configuration menu - View commit details
-
Copy full SHA for 192eda7 - Browse repository at this point
Copy the full SHA 192eda7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3c861fd - Browse repository at this point
Copy the full SHA 3c861fdView commit details -
Configuration menu - View commit details
-
Copy full SHA for dcfdc00 - Browse repository at this point
Copy the full SHA dcfdc00View commit details -
Configuration menu - View commit details
-
Copy full SHA for f51dd36 - Browse repository at this point
Copy the full SHA f51dd36View commit details -
Update load_flux_model_bnb_llm_int8.py to work with a single-file FLU…
…X transformer checkpoint.
Configuration menu - View commit details
-
Copy full SHA for 3c9811f - Browse repository at this point
Copy the full SHA 3c9811fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9982bc2 - Browse repository at this point
Copy the full SHA 9982bc2View commit details -
Configuration menu - View commit details
-
Copy full SHA for c5c60f5 - Browse repository at this point
Copy the full SHA c5c60f5View commit details -
Remove automatic install of models during flux model loader, remove n…
…o longer used import function on context
Configuration menu - View commit details
-
Copy full SHA for 5f3e325 - Browse repository at this point
Copy the full SHA 5f3e325View commit details -
Configuration menu - View commit details
-
Copy full SHA for bc6e1ba - Browse repository at this point
Copy the full SHA bc6e1baView commit details -
Configuration menu - View commit details
-
Copy full SHA for 407796c - Browse repository at this point
Copy the full SHA 407796cView commit details -
Configuration menu - View commit details
-
Copy full SHA for d4ec434 - Browse repository at this point
Copy the full SHA d4ec434View commit details -
Configuration menu - View commit details
-
Copy full SHA for 374dc82 - Browse repository at this point
Copy the full SHA 374dc82View commit details -
Configuration menu - View commit details
-
Copy full SHA for 80a46d2 - Browse repository at this point
Copy the full SHA 80a46d2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5406a2f - Browse repository at this point
Copy the full SHA 5406a2fView commit details -
Configuration menu - View commit details
-
Copy full SHA for c9c4e47 - Browse repository at this point
Copy the full SHA c9c4e47View commit details -
Configuration menu - View commit details
-
Copy full SHA for 22a3b3d - Browse repository at this point
Copy the full SHA 22a3b3dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5307a6f - Browse repository at this point
Copy the full SHA 5307a6fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5e9ef4b - Browse repository at this point
Copy the full SHA 5e9ef4bView commit details -
Move prepare_latent_image_patches(...) to sampling.py with all of the…
… related FLUX inference code.
Configuration menu - View commit details
-
Copy full SHA for 0e9f6f7 - Browse repository at this point
Copy the full SHA 0e9f6f7View commit details -
Run FLUX VAE decoding in the user's preferred dtype rather than float…
…32. Tested, and seems to work well at float16.
Configuration menu - View commit details
-
Copy full SHA for b5c937e - Browse repository at this point
Copy the full SHA b5c937eView commit details -
Configuration menu - View commit details
-
Copy full SHA for f34a923 - Browse repository at this point
Copy the full SHA f34a923View commit details -
Configuration menu - View commit details
-
Copy full SHA for b8d4630 - Browse repository at this point
Copy the full SHA b8d4630View commit details -
Configuration menu - View commit details
-
Copy full SHA for a31c02b - Browse repository at this point
Copy the full SHA a31c02bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9899e42 - Browse repository at this point
Copy the full SHA 9899e42View commit details -
Configuration menu - View commit details
-
Copy full SHA for cfcd860 - Browse repository at this point
Copy the full SHA cfcd860View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4089ff2 - Browse repository at this point
Copy the full SHA 4089ff2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 54c48c3 - Browse repository at this point
Copy the full SHA 54c48c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5af214b - Browse repository at this point
Copy the full SHA 5af214bView commit details -
Configuration menu - View commit details
-
Copy full SHA for f4612a9 - Browse repository at this point
Copy the full SHA f4612a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 18c0ec3 - Browse repository at this point
Copy the full SHA 18c0ec3View commit details -
Downgrade revert torch version after removing optimum-qanto, and othe…
…r minor version-related fixes.
Configuration menu - View commit details
-
Copy full SHA for 098db5c - Browse repository at this point
Copy the full SHA 098db5cView commit details -
Update t5 encoder formats to accurately reflect the quantization stra…
…tegy and data type
Configuration menu - View commit details
-
Copy full SHA for dbdd851 - Browse repository at this point
Copy the full SHA dbdd851View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1d6c83b - Browse repository at this point
Copy the full SHA 1d6c83bView commit details -
Replace swish() with torch.nn.functional.silu(h). They are functional…
…ly equivalent, but in my test VAE deconding was ~8% faster after the change.
Configuration menu - View commit details
-
Copy full SHA for 1413ff9 - Browse repository at this point
Copy the full SHA 1413ff9View commit details -
Configuration menu - View commit details
-
Copy full SHA for bd1b37d - Browse repository at this point
Copy the full SHA bd1b37dView commit details -
Configuration menu - View commit details
-
Copy full SHA for d159fe6 - Browse repository at this point
Copy the full SHA d159fe6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 877b88e - Browse repository at this point
Copy the full SHA 877b88eView commit details -
Configuration menu - View commit details
-
Copy full SHA for ae94e48 - Browse repository at this point
Copy the full SHA ae94e48View commit details -
Configuration menu - View commit details
-
Copy full SHA for f046a38 - Browse repository at this point
Copy the full SHA f046a38View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9f6f404 - Browse repository at this point
Copy the full SHA 9f6f404View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9a530c7 - Browse repository at this point
Copy the full SHA 9a530c7View commit details -
Configuration menu - View commit details
-
Copy full SHA for bb80697 - Browse repository at this point
Copy the full SHA bb80697View commit details -
Configuration menu - View commit details
-
Copy full SHA for 642a953 - Browse repository at this point
Copy the full SHA 642a953View commit details -
Configuration menu - View commit details
-
Copy full SHA for a90d098 - Browse repository at this point
Copy the full SHA a90d098View commit details -
Configuration menu - View commit details
-
Copy full SHA for 40a3fa5 - Browse repository at this point
Copy the full SHA 40a3fa5View commit details -
Configuration menu - View commit details
-
Copy full SHA for b9238b6 - Browse repository at this point
Copy the full SHA b9238b6View commit details -
Rename params for flux and flux vae, add comments explaining use of t…
…he config_path in model config
Configuration menu - View commit details
-
Copy full SHA for 5a5ca10 - Browse repository at this point
Copy the full SHA 5a5ca10View commit details -
Configuration menu - View commit details
-
Copy full SHA for bf59ab3 - Browse repository at this point
Copy the full SHA bf59ab3View commit details -
Configuration menu - View commit details
-
Copy full SHA for bd2692b - Browse repository at this point
Copy the full SHA bd2692bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d42e67 - Browse repository at this point
Copy the full SHA 5d42e67View commit details -
Configuration menu - View commit details
-
Copy full SHA for c510234 - Browse repository at this point
Copy the full SHA c510234View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3b29bad - Browse repository at this point
Copy the full SHA 3b29badView commit details