1
0
Fork 0
Commit Graph

847 Commits

Author SHA1 Message Date
Sean Sube aec540a524
feat(api): add server setting for CUDA memory limit (#211) 2023-03-18 13:40:37 -05:00
Sean Sube af326a784f
fix(api): avoid loading encoder twice when using LoRAs and inversions together 2023-03-18 13:39:35 -05:00
Sean Sube 9f9b73b780
fix(api): use ORT session for correct device when loading blended nets 2023-03-18 13:39:04 -05:00
Sean Sube c465b61fb5
fix(scripts): check for ORT modules 2023-03-18 13:21:17 -05:00
Sean Sube 84718e5928
feat(scripts): add env debug script (#191) 2023-03-18 13:16:59 -05:00
Sean Sube 17e4fd7b06
feat(scripts): add model type guessing script (#210) 2023-03-18 13:01:05 -05:00
Sean Sube 5b308d5fc1
lint(api): improve logging for inversion tokens 2023-03-18 12:04:39 -05:00
Sean Sube 2cb0a6be3c
more lint 2023-03-18 11:55:06 -05:00
Sean Sube e104c81e19
apply lint 2023-03-18 11:50:09 -05:00
Sean Sube a1f17c0877
fix dest paths for blended nets 2023-03-18 11:37:16 -05:00
Sean Sube f465120cad
use conversion dest path when applying additional nets 2023-03-18 11:34:05 -05:00
Sean Sube 1f6105a8fe
make blend functions take tuples rather than split lists 2023-03-18 10:50:48 -05:00
Sean Sube 6cd0b4f7eb
fix extras schema 2023-03-18 10:24:16 -05:00
Sean Sube 40c92f054b
add networks as conversion arg 2023-03-18 10:22:24 -05:00
Sean Sube 5dd14c19ce
feat(api): build a single token for multi-layer Textual Inversions (#212) 2023-03-18 07:47:36 -05:00
Sean Sube af62c1c3b6
apply lint 2023-03-18 07:41:29 -05:00
Sean Sube e3bf04ab8f
feat(api): add section to extras file for additional networks 2023-03-18 07:40:57 -05:00
Sean Sube c3979246df
make blending happen once after conversion 2023-03-18 07:14:22 -05:00
Sean Sube 32b2a76a0b
fix(api): download additional networks to their own subdir in models 2023-03-18 07:07:05 -05:00
Sean Sube 84bd852837
feat(api): blend LoRAs and Textual Inversions from extras file 2023-03-18 07:01:24 -05:00
Sean Sube 1d44f985a4
fix(api): restore python 3.8 compatibility 2023-03-17 23:07:10 -05:00
Sean Sube c943a55a44
fix(api): move imports of patches modules into function 2023-03-17 23:06:39 -05:00
Sean Sube fc9245f4ee
fix(buil): limit torchvision versions to match torch 2023-03-17 22:42:37 -05:00
Sean Sube a21750ff8e
fix(build): pin Torch to 1.x for now 2023-03-17 21:31:15 -05:00
Sean Sube 4de8c160c9
fix(build): make sure Torch is installed first in containers 2023-03-17 19:41:34 -05:00
Sean Sube 226710a015
fix(api): use exception level logs 2023-03-16 22:29:07 -05:00
Sean Sube d9bae80778
fix(build): install wheel for basicsr 2023-03-16 21:46:30 -05:00
Sean Sube d3a17ec648
fix logging metadata 2023-03-16 21:45:57 -05:00
Sean Sube 4b832f3d8d
more lint, more trace 2023-03-16 20:22:20 -05:00
Sean Sube 9f0a6f134e
fix(api): move model conversion messages to trace level 2023-03-16 19:37:25 -05:00
Sean Sube c397c1e42a
apply sonar lint 2023-03-16 18:47:04 -05:00
Sean Sube f4c0c52029
apply lint 2023-03-16 18:35:30 -05:00
Sean Sube 959798eabb
feat(api): add trace log level 2023-03-16 18:34:47 -05:00
Sean Sube c8c5e9f42e
fix(api): handle more out-of-memory errors in the workers 2023-03-16 18:34:28 -05:00
Sean Sube 315e5a3837
fix(api): add theoretical support for 3x3 conv in LoRA 2023-03-15 19:37:17 -05:00
Sean Sube 8e8e230ffd
apply lint 2023-03-15 19:27:29 -05:00
Sean Sube 506cf9f65f
feat(api): blend Textual Inversions from prompt 2023-03-15 17:14:52 -05:00
Sean Sube 973ad0f682
fix inversion var 2023-03-15 08:57:17 -05:00
Sean Sube b451196dfa
add prefix to inversion path 2023-03-15 08:55:35 -05:00
Sean Sube 421ed632b1
only use name from first inversion 2023-03-15 08:53:15 -05:00
Sean Sube b2eb406197
fix(api): handle CUDA memory errors in workers 2023-03-15 08:51:29 -05:00
Sean Sube a2e21f427f
feat(api): load Textual Inversions from prompt 2023-03-15 08:51:12 -05:00
Sean Sube 829cedc934
fix error when prompt has no LoRA tokens 2023-03-15 08:35:44 -05:00
Sean Sube a7f77a033d
feat(api): parse LoRA weights from prompt 2023-03-15 08:30:31 -05:00
Sean Sube 45166f281e
apply lint 2023-03-14 23:32:47 -05:00
Sean Sube 91210ee236
remove extra param, correct output path 2023-03-14 23:32:18 -05:00
Sean Sube 8cf6f2215d
fix(scripts): diff model nodes as well 2023-03-14 22:58:36 -05:00
Sean Sube 143904fc51
feat(api): parse LoRA names from prompt 2023-03-14 22:28:18 -05:00
Sean Sube 03f4e1b922
start wiring LoRAs into prompt 2023-03-14 22:10:33 -05:00
Sean Sube ce05e76947
load base models from model dir, use correct ORT provider 2023-03-14 21:57:37 -05:00
Sean Sube 56a4519818
test loading UNet and encoder with LoRAs 2023-03-14 21:27:23 -05:00
Sean Sube 2a8c85cb3e
feat(api): blend ONNX models in memory 2023-03-14 19:38:27 -05:00
Sean Sube 4c17edb267
feat(api): add conversion script for LoRAs from sd-scripts (#213) 2023-03-14 18:17:00 -05:00
Sean Sube 0b1aa26be5
blend LoRAs into a valid ONNX UNet (#213) 2023-03-12 13:38:51 -05:00
Sean Sube cf429ad715
fix(tests): add reference image for UniPC scheduler 2023-03-11 14:43:36 -06:00
Sean Sube a9906faec8
chore(release): 0.8.1 2023-03-11 14:32:05 -06:00
Sean Sube 919f88c7d0
fix(tests): clear cache between tests 2023-03-11 13:59:09 -06:00
Sean Sube 9555a7a3ea
lint(api): only log new worker message if some workers need to be restarted 2023-03-11 13:30:54 -06:00
Sean Sube 9c65922526
lint(api): remove unnecessary delete calls 2023-03-11 13:30:33 -06:00
Sean Sube 575cb8831b
fix(api): make cache global within each worker process (#227) 2023-03-11 13:30:11 -06:00
Sean Sube 01d3519aa3
fix(api): remove unused num_workers logic from server 2023-03-11 08:17:27 -06:00
Sean Sube 8e5d0871c8
log which cache items have been pruned 2023-03-11 08:06:22 -06:00
Sean Sube cb2b054fde
fix(api): only run GC when a diffusion model has been replaced 2023-03-11 08:06:03 -06:00
Sean Sube a195bc100d
chore(release): 0.8.0 2023-03-10 22:06:33 -06:00
Sean Sube 58250976d4
fix(tests): update blend refs for release tests 2023-03-10 21:58:40 -06:00
Sean Sube cd11e8f3ab
use a proper fake config class 2023-03-10 18:57:01 -06:00
Sean Sube df1504d9b0
use fake VAE config 2023-03-10 18:50:01 -06:00
Sean Sube 555de5e07d
fix(api): correct VAE config check 2023-03-10 18:46:07 -06:00
Sean Sube e960ee1d85
fix(api): patch VAE for SD upscaling on older versions of diffusers (#234) 2023-03-10 18:42:11 -06:00
Sean Sube 6bdaa4a4ed
fix(api): make stage-specific source image optional in GFPGAN stage (#233) 2023-03-10 18:15:31 -06:00
Sean Sube da3d95ff49
fix(api): include bottom margin when calculating output size 2023-03-10 17:59:16 -06:00
Sean Sube fe437e8cd4
feat: add support for UniPC multistep scheduler (#226) 2023-03-09 08:00:59 -06:00
Sean Sube 3d0f2434af
fix(tests): make release tests more strict, update DEIS reference 2023-03-08 23:17:54 -06:00
Sean Sube 312d8d251a
fix(tests): add release test for partial blending 2023-03-08 23:06:52 -06:00
Sean Sube d794835d20
fix(tests): use correct endpoint in release tests for blend mode 2023-03-08 22:56:53 -06:00
Sean Sube 21c60709bc
fix(api): move prompt splitting logging to debug level 2023-03-08 22:55:58 -06:00
Sean Sube 6c47542d46
fix(api): correct continuation syntax for Windows launch scripts 2023-03-08 21:43:02 -06:00
Sean Sube 35303c7d20
feat(api): add a way to pass extra args to the conversion script 2023-03-08 21:38:51 -06:00
Sean Sube 25c41c8d66
feat(api): add an option to remove temporary Torch files after converting to ONNX (#122) 2023-03-08 21:38:17 -06:00
Sean Sube 6e71775782
fix(api): load LPW pipeline from local source (#224) 2023-03-08 19:47:22 -06:00
Sean Sube 7bd98d4a46
apply lint 2023-03-07 23:57:39 -06:00
Sean Sube bc21165fd9
fix path ref 2023-03-07 23:54:32 -06:00
Sean Sube c0b88733b8
fix(api): check for cache rather than converted model before fetch 2023-03-07 23:51:27 -06:00
Sean Sube 843e2f1ff3
feat(api): look for an index file when checking for converted models (#222) 2023-03-07 23:40:04 -06:00
Sean Sube 30b08c6d6d
fix(api): log correct token when converting Textual Inversions 2023-03-07 23:05:53 -06:00
Sean Sube 6542646005
fix(api): match format in schema for sd-concepts 2023-03-07 22:53:05 -06:00
Sean Sube 85ff700525
apply lint 2023-03-07 22:40:17 -06:00
Sean Sube 0a4f83ac0f
feat(api): add range syntax to expand numbered tokens (#179) 2023-03-07 20:48:26 -06:00
Sean Sube 66c42485cb
feat(api): add support for extremely long prompts 2023-03-07 19:00:25 -06:00
Sean Sube c45915e558
fix(api): use server model path while converting SD checkpoints (#221) 2023-03-07 18:55:14 -06:00
Sean Sube 9d9bd1a639
apply lint 2023-03-07 08:02:53 -06:00
Sean Sube 6e8d51b9fa
fix(build): reset old coverage before running tests 2023-03-06 19:41:56 -06:00
Sean Sube af1c3c7839
fix(api): track items removed from cache 2023-03-06 07:34:09 -06:00
Sean Sube 339868de4d
fix(api): use pipeline class name in cache key 2023-03-05 21:54:09 -06:00
Sean Sube 55576ae87c
fix(api): include cache keys in logs 2023-03-05 21:50:01 -06:00
Sean Sube 35dc8a0bc4
improve exit logging 2023-03-05 21:37:39 -06:00
Sean Sube c0a01efef4
fix(api): track currently active worker for each device 2023-03-05 21:28:21 -06:00
Sean Sube 57fed94337
fix(api): exit worker on memory allocation errors 2023-03-05 21:11:33 -06:00
Sean Sube cb460a0c59
fix(api): add worker PID to log messages 2023-03-05 20:25:02 -06:00
Sean Sube 4ae4ce176c
fix(api): attempt to recycle leaking workers when a job finishes 2023-03-05 20:13:28 -06:00