Sean Sube
|
66e938f9ab
|
split steps before and after highres
|
2023-03-31 23:32:05 -05:00 |
Sean Sube
|
cdaf1b8e5d
|
feat(api): add support for highres images
|
2023-03-31 23:27:16 -05:00 |
Sean Sube
|
27c6e71890
|
fix(api): add coloredlogs to base deps
|
2023-03-30 23:43:40 -05:00 |
Sean Sube
|
205ff3e403
|
feat(exe): add specs and launch scripts for Windows EXE bundle (#305)
|
2023-03-30 21:02:23 -05:00 |
Sean Sube
|
1cd436d643
|
feat(api): add setup scripts for Windows
|
2023-03-30 21:01:55 -05:00 |
Sean Sube
|
b4ac7c6259
|
chore(release): 0.9.0
|
2023-03-28 18:57:24 -05:00 |
Sean Sube
|
93fcfd1422
|
fix(api): update LPW pipeline (#298)
|
2023-03-28 17:34:23 -05:00 |
Sean Sube
|
2bbc5d877f
|
lint(api): explicitly bind the device pool to shutdown callback
|
2023-03-27 17:13:45 -05:00 |
Sean Sube
|
c2f8fb1d31
|
fix(api): combine names for ONNX fp16 optimization
|
2023-03-27 08:55:01 -05:00 |
Sean Sube
|
73e9cf8b66
|
fix(api): disable internal fp16 for VAE encoder (#290)
|
2023-03-27 08:10:40 -05:00 |
Sean Sube
|
afa8f5e706
|
feat(api): add optimization for internal fp16 conversion
|
2023-03-26 22:41:12 -05:00 |
Sean Sube
|
d7e548037a
|
fix(tests): make release tests fail if image was not successful (#287)
|
2023-03-26 20:45:27 -05:00 |
Sean Sube
|
0ea0442f02
|
apply lint
|
2023-03-26 18:24:22 -05:00 |
Sean Sube
|
4ddd69ba07
|
fix(api): watch for progress events from leaking workers
|
2023-03-26 18:22:16 -05:00 |
Sean Sube
|
e1219cca90
|
fix(api): close queues after stopping workers
|
2023-03-26 18:21:53 -05:00 |
Sean Sube
|
dca8a97796
|
feat(api): pin pytorch versions and update nightly ORT
|
2023-03-26 18:21:21 -05:00 |
Sean Sube
|
bb5d0635d1
|
sonar lint
|
2023-03-26 15:53:20 -05:00 |
Sean Sube
|
36bfccae09
|
fix(api): include worker totals in status endpoint
|
2023-03-26 15:49:43 -05:00 |
Sean Sube
|
2d2283e1eb
|
fix(api): attempt to read progress updates from recycled workers
|
2023-03-26 15:31:16 -05:00 |
Sean Sube
|
27500eccb5
|
fix(api): do not move jobs from pending to running until progress is reported
|
2023-03-26 14:22:59 -05:00 |
Sean Sube
|
0af406c47f
|
only enqueue jobs from progress worker
|
2023-03-26 14:02:57 -05:00 |
Sean Sube
|
ccf8d51e08
|
feat(api): split up status endpoint by job status
|
2023-03-26 11:57:00 -05:00 |
Sean Sube
|
ea36082e43
|
add job count to healthy worker logs
|
2023-03-26 11:53:06 -05:00 |
Sean Sube
|
8eab92a7df
|
define device on pending job
|
2023-03-26 11:49:58 -05:00 |
Sean Sube
|
83884bcafa
|
enqueue jobs on idle workers during progress check
|
2023-03-26 11:48:27 -05:00 |
Sean Sube
|
14ade83937
|
fix(api): enqueue next job when previous one finishes and after recycling worker
|
2023-03-26 11:41:45 -05:00 |
Sean Sube
|
f3ab25f671
|
lint(api): add start method to worker pool
|
2023-03-26 11:30:07 -05:00 |
Sean Sube
|
2b179bebac
|
fix(api): always reset job counter when creating new device worker
|
2023-03-26 11:22:03 -05:00 |
Sean Sube
|
55e44e8ac9
|
fix(api): increment job counter for worker when it starts a new job (#283)
|
2023-03-26 11:18:27 -05:00 |
Sean Sube
|
e552a5560f
|
feat(api): check device worker pool and recycle on a regular interval (#284)
|
2023-03-26 11:09:22 -05:00 |
Sean Sube
|
aeb71ad50a
|
lint lock name
|
2023-03-26 08:30:34 -05:00 |
Sean Sube
|
580d621209
|
fix(api): make format list in schema match code
|
2023-03-26 08:28:14 -05:00 |
Sean Sube
|
95a61f3573
|
fix(api): restart worker threads when their respective queues are full
|
2023-03-25 13:46:12 -05:00 |
Sean Sube
|
88f4713e23
|
fix(api): use lock when restarting workers
|
2023-03-25 09:47:51 -05:00 |
Sean Sube
|
2c47904057
|
lint(api): use constant for model filename
|
2023-03-24 08:14:19 -05:00 |
Sean Sube
|
6b4c046867
|
pass pool to threads
|
2023-03-22 22:58:46 -05:00 |
Sean Sube
|
86c1b29c31
|
lint(api): extract worker thread main functions (#279)
|
2023-03-22 22:55:34 -05:00 |
Sean Sube
|
4dd68ea6b6
|
fix(api): restart worker threads if they crash
|
2023-03-22 19:58:46 -05:00 |
Sean Sube
|
fa71d87e2c
|
apply lint
|
2023-03-21 22:19:50 -05:00 |
Sean Sube
|
e445d2afaa
|
fix hidden state conversion
|
2023-03-21 22:08:17 -05:00 |
Sean Sube
|
c8aad8554e
|
fix(api): convert back to model format after blending, convert samples as needed (#274)
|
2023-03-21 22:05:14 -05:00 |
Sean Sube
|
0315a8cbc6
|
fix(api): apply fp16 optimizations to LoRA and Textual Inversion blending
|
2023-03-21 21:45:27 -05:00 |
Sean Sube
|
4f6574c88e
|
sonar lint fixes
|
2023-03-21 17:11:38 -05:00 |
Sean Sube
|
a660d9f1b1
|
apply lint
|
2023-03-20 22:28:48 -05:00 |
Sean Sube
|
7f459e0e29
|
correct extensions in ignore list
|
2023-03-19 23:31:11 -05:00 |
Sean Sube
|
f779fbd5cc
|
fix(api): remove prefix before downloading for HF hub
|
2023-03-19 23:30:31 -05:00 |
Sean Sube
|
19712262e6
|
fix(api): filter out temporary files from model lists (#271)
|
2023-03-19 23:26:05 -05:00 |
Sean Sube
|
ae3bcf3b8b
|
fix(api): add HF hub download to fetch logic for Inversion concepts
|
2023-03-19 20:32:21 -05:00 |
Sean Sube
|
0732058aa8
|
feat(api): detect Textual Inversion type from keys (#262)
|
2023-03-19 20:16:52 -05:00 |
Sean Sube
|
fe498b16f0
|
fix(api): embed Inversion concepts using their name
|
2023-03-19 19:01:22 -05:00 |
Sean Sube
|
19d4d554c3
|
fix(api): add base token for Textual Inversion as sum layer
|
2023-03-19 18:04:21 -05:00 |
Sean Sube
|
aefa5b4613
|
fix(api): clear job cancelled flag when worker starts a new job (#269)
|
2023-03-19 17:57:14 -05:00 |
Sean Sube
|
8acc15f52e
|
fix(api): better error handling around tensor loading
|
2023-03-19 15:38:43 -05:00 |
Sean Sube
|
07622690dc
|
fix(api): use Torch JIT and fallback loading
|
2023-03-19 15:31:35 -05:00 |
Sean Sube
|
b797b3d616
|
fix(api): do not assume file extension for additional networks
|
2023-03-19 15:27:51 -05:00 |
Sean Sube
|
33008531e9
|
fix(api): load blending tensors onto CPU
|
2023-03-19 15:13:54 -05:00 |
Sean Sube
|
1c631c28d3
|
feat(api): add flag for ORT float16 optimizations
|
2023-03-19 11:59:35 -05:00 |
Sean Sube
|
b8f816323e
|
fix(api): correctly load server env for conversion
|
2023-03-19 10:39:09 -05:00 |
Sean Sube
|
98e488319c
|
use fp16 optimization flag during conversion, add to admin docs
|
2023-03-19 10:33:46 -05:00 |
Sean Sube
|
edd32f6044
|
apply lint, fix up log levels
|
2023-03-19 10:25:09 -05:00 |
Sean Sube
|
6f283c5c02
|
proxy nets that need fp16 conversion
|
2023-03-19 10:18:22 -05:00 |
Sean Sube
|
bbd4c0fd72
|
dtype logging for potential fp16 params
|
2023-03-19 09:59:08 -05:00 |
Sean Sube
|
243a2d9df6
|
apply lint
|
2023-03-19 09:29:06 -05:00 |
Sean Sube
|
27bd10d2f7
|
fix(api): restrict CLIP skip token to integers, allow negative LoRA and Inversion weights
|
2023-03-19 09:13:40 -05:00 |
Sean Sube
|
e6d7d30225
|
move tensor logs to trace level
|
2023-03-19 09:11:55 -05:00 |
Sean Sube
|
0e43acc0f7
|
fix(api): fetch sources and additional networks by default
|
2023-03-19 09:09:03 -05:00 |
Sean Sube
|
b82246fdab
|
parse CLIP skip count from prompt
|
2023-03-19 08:43:39 -05:00 |
Sean Sube
|
46d1b5636d
|
normalize hidden states without using CLIP model class
|
2023-03-19 08:40:06 -05:00 |
Sean Sube
|
2ef00599b6
|
experimental CLIP skip
|
2023-03-19 08:17:40 -05:00 |
Sean Sube
|
9a949806d3
|
apply lint
|
2023-03-18 21:48:51 -05:00 |
Sean Sube
|
645da3d1a6
|
fix(api): allow dash in network names
|
2023-03-18 21:48:20 -05:00 |
Sean Sube
|
a9e55ff9f2
|
remove references to inversion parameter
|
2023-03-18 19:47:22 -05:00 |
Sean Sube
|
5363037ab1
|
use network name in label key
|
2023-03-18 19:43:00 -05:00 |
Sean Sube
|
61d12b8ebd
|
include model type in label when present
|
2023-03-18 19:34:03 -05:00 |
Sean Sube
|
f8f36e602c
|
feat(api): load i18n labels from additional networks
|
2023-03-18 19:25:22 -05:00 |
Sean Sube
|
2e89fd43d3
|
fix(api): only remove running jobs from running state
|
2023-03-18 19:21:40 -05:00 |
Sean Sube
|
716e009611
|
serialize networks
|
2023-03-18 19:21:15 -05:00 |
Sean Sube
|
2d112104fb
|
feat: show additional networks in client
|
2023-03-18 19:15:23 -05:00 |
Sean Sube
|
e5862d178c
|
fix(api): assume inversion tokens are embeddings for now
|
2023-03-18 18:35:11 -05:00 |
Sean Sube
|
ed8a7c8934
|
fix(api): move prompt parsing logs to trace level
|
2023-03-18 17:32:32 -05:00 |
Sean Sube
|
d321321507
|
fix fields
|
2023-03-18 17:28:59 -05:00 |
Sean Sube
|
1d52dc684d
|
init last progress on worker context
|
2023-03-18 17:27:41 -05:00 |
Sean Sube
|
e08a9aa2ab
|
add pending job list to pool
|
2023-03-18 17:26:28 -05:00 |
Sean Sube
|
8cbdad3a71
|
feat(api): add pending field to image ready response
|
2023-03-18 17:25:13 -05:00 |
Sean Sube
|
15b6e036e1
|
fix(api): maintain list of pending jobs
|
2023-03-18 17:15:18 -05:00 |
Sean Sube
|
588c8c7fdb
|
fix(api): track last progress within worker
|
2023-03-18 15:32:49 -05:00 |
Sean Sube
|
5106dd48a9
|
remove another ref to finished queue
|
2023-03-18 15:27:07 -05:00 |
Sean Sube
|
b026566ccb
|
remove remaining references to finished queue and worker
|
2023-03-18 15:26:19 -05:00 |
Sean Sube
|
d1565b056e
|
apply lint, make missing images an error
|
2023-03-18 15:16:41 -05:00 |
Sean Sube
|
7cf5554bef
|
feat(api): add error flag to image ready response
|
2023-03-18 15:13:42 -05:00 |
Sean Sube
|
f336cc5d02
|
fix(api): provide noise parameter to SD upscaling (#196)
|
2023-03-18 14:02:30 -05:00 |
Sean Sube
|
391a707c84
|
fix(scripts): check Torch CUDA devices (#242)
|
2023-03-18 13:54:12 -05:00 |
Sean Sube
|
a9456f4a16
|
fix(api): bump default model cache to 5 (#242)
|
2023-03-18 13:47:39 -05:00 |
Sean Sube
|
aec540a524
|
feat(api): add server setting for CUDA memory limit (#211)
|
2023-03-18 13:40:37 -05:00 |
Sean Sube
|
af326a784f
|
fix(api): avoid loading encoder twice when using LoRAs and inversions together
|
2023-03-18 13:39:35 -05:00 |
Sean Sube
|
9f9b73b780
|
fix(api): use ORT session for correct device when loading blended nets
|
2023-03-18 13:39:04 -05:00 |
Sean Sube
|
c465b61fb5
|
fix(scripts): check for ORT modules
|
2023-03-18 13:21:17 -05:00 |
Sean Sube
|
84718e5928
|
feat(scripts): add env debug script (#191)
|
2023-03-18 13:16:59 -05:00 |
Sean Sube
|
17e4fd7b06
|
feat(scripts): add model type guessing script (#210)
|
2023-03-18 13:01:05 -05:00 |
Sean Sube
|
5b308d5fc1
|
lint(api): improve logging for inversion tokens
|
2023-03-18 12:04:39 -05:00 |
Sean Sube
|
2cb0a6be3c
|
more lint
|
2023-03-18 11:55:06 -05:00 |
Sean Sube
|
e104c81e19
|
apply lint
|
2023-03-18 11:50:09 -05:00 |
Sean Sube
|
a1f17c0877
|
fix dest paths for blended nets
|
2023-03-18 11:37:16 -05:00 |
Sean Sube
|
f465120cad
|
use conversion dest path when applying additional nets
|
2023-03-18 11:34:05 -05:00 |
Sean Sube
|
1f6105a8fe
|
make blend functions take tuples rather than split lists
|
2023-03-18 10:50:48 -05:00 |
Sean Sube
|
6cd0b4f7eb
|
fix extras schema
|
2023-03-18 10:24:16 -05:00 |
Sean Sube
|
40c92f054b
|
add networks as conversion arg
|
2023-03-18 10:22:24 -05:00 |
Sean Sube
|
5dd14c19ce
|
feat(api): build a single token for multi-layer Textual Inversions (#212)
|
2023-03-18 07:47:36 -05:00 |
Sean Sube
|
af62c1c3b6
|
apply lint
|
2023-03-18 07:41:29 -05:00 |
Sean Sube
|
e3bf04ab8f
|
feat(api): add section to extras file for additional networks
|
2023-03-18 07:40:57 -05:00 |
Sean Sube
|
c3979246df
|
make blending happen once after conversion
|
2023-03-18 07:14:22 -05:00 |
Sean Sube
|
32b2a76a0b
|
fix(api): download additional networks to their own subdir in models
|
2023-03-18 07:07:05 -05:00 |
Sean Sube
|
84bd852837
|
feat(api): blend LoRAs and Textual Inversions from extras file
|
2023-03-18 07:01:24 -05:00 |
Sean Sube
|
1d44f985a4
|
fix(api): restore python 3.8 compatibility
|
2023-03-17 23:07:10 -05:00 |
Sean Sube
|
c943a55a44
|
fix(api): move imports of patches modules into function
|
2023-03-17 23:06:39 -05:00 |
Sean Sube
|
fc9245f4ee
|
fix(buil): limit torchvision versions to match torch
|
2023-03-17 22:42:37 -05:00 |
Sean Sube
|
a21750ff8e
|
fix(build): pin Torch to 1.x for now
|
2023-03-17 21:31:15 -05:00 |
Sean Sube
|
4de8c160c9
|
fix(build): make sure Torch is installed first in containers
|
2023-03-17 19:41:34 -05:00 |
Sean Sube
|
226710a015
|
fix(api): use exception level logs
|
2023-03-16 22:29:07 -05:00 |
Sean Sube
|
d9bae80778
|
fix(build): install wheel for basicsr
|
2023-03-16 21:46:30 -05:00 |
Sean Sube
|
d3a17ec648
|
fix logging metadata
|
2023-03-16 21:45:57 -05:00 |
Sean Sube
|
4b832f3d8d
|
more lint, more trace
|
2023-03-16 20:22:20 -05:00 |
Sean Sube
|
9f0a6f134e
|
fix(api): move model conversion messages to trace level
|
2023-03-16 19:37:25 -05:00 |
Sean Sube
|
c397c1e42a
|
apply sonar lint
|
2023-03-16 18:47:04 -05:00 |
Sean Sube
|
f4c0c52029
|
apply lint
|
2023-03-16 18:35:30 -05:00 |
Sean Sube
|
959798eabb
|
feat(api): add trace log level
|
2023-03-16 18:34:47 -05:00 |
Sean Sube
|
c8c5e9f42e
|
fix(api): handle more out-of-memory errors in the workers
|
2023-03-16 18:34:28 -05:00 |
Sean Sube
|
315e5a3837
|
fix(api): add theoretical support for 3x3 conv in LoRA
|
2023-03-15 19:37:17 -05:00 |
Sean Sube
|
8e8e230ffd
|
apply lint
|
2023-03-15 19:27:29 -05:00 |
Sean Sube
|
506cf9f65f
|
feat(api): blend Textual Inversions from prompt
|
2023-03-15 17:14:52 -05:00 |
Sean Sube
|
973ad0f682
|
fix inversion var
|
2023-03-15 08:57:17 -05:00 |
Sean Sube
|
b451196dfa
|
add prefix to inversion path
|
2023-03-15 08:55:35 -05:00 |
Sean Sube
|
421ed632b1
|
only use name from first inversion
|
2023-03-15 08:53:15 -05:00 |
Sean Sube
|
b2eb406197
|
fix(api): handle CUDA memory errors in workers
|
2023-03-15 08:51:29 -05:00 |
Sean Sube
|
a2e21f427f
|
feat(api): load Textual Inversions from prompt
|
2023-03-15 08:51:12 -05:00 |
Sean Sube
|
829cedc934
|
fix error when prompt has no LoRA tokens
|
2023-03-15 08:35:44 -05:00 |
Sean Sube
|
a7f77a033d
|
feat(api): parse LoRA weights from prompt
|
2023-03-15 08:30:31 -05:00 |
Sean Sube
|
45166f281e
|
apply lint
|
2023-03-14 23:32:47 -05:00 |
Sean Sube
|
91210ee236
|
remove extra param, correct output path
|
2023-03-14 23:32:18 -05:00 |
Sean Sube
|
8cf6f2215d
|
fix(scripts): diff model nodes as well
|
2023-03-14 22:58:36 -05:00 |
Sean Sube
|
143904fc51
|
feat(api): parse LoRA names from prompt
|
2023-03-14 22:28:18 -05:00 |
Sean Sube
|
03f4e1b922
|
start wiring LoRAs into prompt
|
2023-03-14 22:10:33 -05:00 |
Sean Sube
|
ce05e76947
|
load base models from model dir, use correct ORT provider
|
2023-03-14 21:57:37 -05:00 |
Sean Sube
|
56a4519818
|
test loading UNet and encoder with LoRAs
|
2023-03-14 21:27:23 -05:00 |
Sean Sube
|
2a8c85cb3e
|
feat(api): blend ONNX models in memory
|
2023-03-14 19:38:27 -05:00 |
Sean Sube
|
4c17edb267
|
feat(api): add conversion script for LoRAs from sd-scripts (#213)
|
2023-03-14 18:17:00 -05:00 |
Sean Sube
|
0b1aa26be5
|
blend LoRAs into a valid ONNX UNet (#213)
|
2023-03-12 13:38:51 -05:00 |
Sean Sube
|
cf429ad715
|
fix(tests): add reference image for UniPC scheduler
|
2023-03-11 14:43:36 -06:00 |
Sean Sube
|
a9906faec8
|
chore(release): 0.8.1
|
2023-03-11 14:32:05 -06:00 |
Sean Sube
|
919f88c7d0
|
fix(tests): clear cache between tests
|
2023-03-11 13:59:09 -06:00 |
Sean Sube
|
9555a7a3ea
|
lint(api): only log new worker message if some workers need to be restarted
|
2023-03-11 13:30:54 -06:00 |
Sean Sube
|
9c65922526
|
lint(api): remove unnecessary delete calls
|
2023-03-11 13:30:33 -06:00 |
Sean Sube
|
575cb8831b
|
fix(api): make cache global within each worker process (#227)
|
2023-03-11 13:30:11 -06:00 |
Sean Sube
|
01d3519aa3
|
fix(api): remove unused num_workers logic from server
|
2023-03-11 08:17:27 -06:00 |
Sean Sube
|
8e5d0871c8
|
log which cache items have been pruned
|
2023-03-11 08:06:22 -06:00 |
Sean Sube
|
cb2b054fde
|
fix(api): only run GC when a diffusion model has been replaced
|
2023-03-11 08:06:03 -06:00 |
Sean Sube
|
a195bc100d
|
chore(release): 0.8.0
|
2023-03-10 22:06:33 -06:00 |
Sean Sube
|
58250976d4
|
fix(tests): update blend refs for release tests
|
2023-03-10 21:58:40 -06:00 |
Sean Sube
|
cd11e8f3ab
|
use a proper fake config class
|
2023-03-10 18:57:01 -06:00 |
Sean Sube
|
df1504d9b0
|
use fake VAE config
|
2023-03-10 18:50:01 -06:00 |
Sean Sube
|
555de5e07d
|
fix(api): correct VAE config check
|
2023-03-10 18:46:07 -06:00 |
Sean Sube
|
e960ee1d85
|
fix(api): patch VAE for SD upscaling on older versions of diffusers (#234)
|
2023-03-10 18:42:11 -06:00 |
Sean Sube
|
6bdaa4a4ed
|
fix(api): make stage-specific source image optional in GFPGAN stage (#233)
|
2023-03-10 18:15:31 -06:00 |
Sean Sube
|
da3d95ff49
|
fix(api): include bottom margin when calculating output size
|
2023-03-10 17:59:16 -06:00 |
Sean Sube
|
fe437e8cd4
|
feat: add support for UniPC multistep scheduler (#226)
|
2023-03-09 08:00:59 -06:00 |
Sean Sube
|
3d0f2434af
|
fix(tests): make release tests more strict, update DEIS reference
|
2023-03-08 23:17:54 -06:00 |
Sean Sube
|
312d8d251a
|
fix(tests): add release test for partial blending
|
2023-03-08 23:06:52 -06:00 |
Sean Sube
|
d794835d20
|
fix(tests): use correct endpoint in release tests for blend mode
|
2023-03-08 22:56:53 -06:00 |
Sean Sube
|
21c60709bc
|
fix(api): move prompt splitting logging to debug level
|
2023-03-08 22:55:58 -06:00 |
Sean Sube
|
6c47542d46
|
fix(api): correct continuation syntax for Windows launch scripts
|
2023-03-08 21:43:02 -06:00 |
Sean Sube
|
35303c7d20
|
feat(api): add a way to pass extra args to the conversion script
|
2023-03-08 21:38:51 -06:00 |
Sean Sube
|
25c41c8d66
|
feat(api): add an option to remove temporary Torch files after converting to ONNX (#122)
|
2023-03-08 21:38:17 -06:00 |
Sean Sube
|
6e71775782
|
fix(api): load LPW pipeline from local source (#224)
|
2023-03-08 19:47:22 -06:00 |
Sean Sube
|
7bd98d4a46
|
apply lint
|
2023-03-07 23:57:39 -06:00 |
Sean Sube
|
bc21165fd9
|
fix path ref
|
2023-03-07 23:54:32 -06:00 |
Sean Sube
|
c0b88733b8
|
fix(api): check for cache rather than converted model before fetch
|
2023-03-07 23:51:27 -06:00 |
Sean Sube
|
843e2f1ff3
|
feat(api): look for an index file when checking for converted models (#222)
|
2023-03-07 23:40:04 -06:00 |
Sean Sube
|
30b08c6d6d
|
fix(api): log correct token when converting Textual Inversions
|
2023-03-07 23:05:53 -06:00 |
Sean Sube
|
6542646005
|
fix(api): match format in schema for sd-concepts
|
2023-03-07 22:53:05 -06:00 |
Sean Sube
|
85ff700525
|
apply lint
|
2023-03-07 22:40:17 -06:00 |
Sean Sube
|
0a4f83ac0f
|
feat(api): add range syntax to expand numbered tokens (#179)
|
2023-03-07 20:48:26 -06:00 |
Sean Sube
|
66c42485cb
|
feat(api): add support for extremely long prompts
|
2023-03-07 19:00:25 -06:00 |
Sean Sube
|
c45915e558
|
fix(api): use server model path while converting SD checkpoints (#221)
|
2023-03-07 18:55:14 -06:00 |
Sean Sube
|
9d9bd1a639
|
apply lint
|
2023-03-07 08:02:53 -06:00 |
Sean Sube
|
6e8d51b9fa
|
fix(build): reset old coverage before running tests
|
2023-03-06 19:41:56 -06:00 |
Sean Sube
|
af1c3c7839
|
fix(api): track items removed from cache
|
2023-03-06 07:34:09 -06:00 |
Sean Sube
|
339868de4d
|
fix(api): use pipeline class name in cache key
|
2023-03-05 21:54:09 -06:00 |
Sean Sube
|
55576ae87c
|
fix(api): include cache keys in logs
|
2023-03-05 21:50:01 -06:00 |
Sean Sube
|
35dc8a0bc4
|
improve exit logging
|
2023-03-05 21:37:39 -06:00 |
Sean Sube
|
c0a01efef4
|
fix(api): track currently active worker for each device
|
2023-03-05 21:28:21 -06:00 |
Sean Sube
|
57fed94337
|
fix(api): exit worker on memory allocation errors
|
2023-03-05 21:11:33 -06:00 |
Sean Sube
|
cb460a0c59
|
fix(api): add worker PID to log messages
|
2023-03-05 20:25:02 -06:00 |
Sean Sube
|
4ae4ce176c
|
fix(api): attempt to recycle leaking workers when a job finishes
|
2023-03-05 20:13:28 -06:00 |
Sean Sube
|
3a4928e59b
|
fix(api): prevent workers from blocking on their progress queues
|
2023-03-05 20:07:06 -06:00 |
Sean Sube
|
edc55ae8b4
|
fix(api): finished job notification should not block worker
|
2023-03-05 19:53:44 -06:00 |
Sean Sube
|
cfc20d3133
|
fix(api): improve cache logging
|
2023-03-05 19:30:52 -06:00 |
Sean Sube
|
39b9741b24
|
fix(api): show VRAM percent in logs
|
2023-03-05 19:23:23 -06:00 |
Sean Sube
|
7a3a81a4ef
|
fix(api): track and repeatedly attempt to recycle leaking workers (#219)
|
2023-03-05 18:58:13 -06:00 |
Sean Sube
|
ccd15c1921
|
set torch and ORT as extra indexes
|
2023-03-05 18:15:41 -06:00 |
Sean Sube
|
05c628d8a6
|
fix(build): use platform-specific requirements for containers
|
2023-03-05 17:55:44 -06:00 |
Sean Sube
|
31054c4ee3
|
feat(api): add requirements file for each platform (#193)
|
2023-03-05 17:55:23 -06:00 |
Sean Sube
|
d5a3b0fed8
|
feat(gui): add local params and API stub so client can load without a server (#181)
|
2023-03-05 16:23:26 -06:00 |
Sean Sube
|
468870e2e7
|
apply lint
|
2023-03-05 08:14:47 -06:00 |
Sean Sube
|
00fa9c5807
|
feat(api): collect labels from textual inversions (#144)
|
2023-03-05 08:00:25 -06:00 |
Sean Sube
|
b198b3baff
|
fix(api): attempt to validate extra translation strings
|
2023-03-05 07:53:23 -06:00 |
Sean Sube
|
6d2dd0a043
|
apply lint
|
2023-03-05 07:20:43 -06:00 |
Sean Sube
|
539d0febce
|
load extras during server init
|
2023-03-05 07:20:37 -06:00 |
Sean Sube
|
537c67619e
|
fix strings endpoint
|
2023-03-05 07:20:34 -06:00 |
Sean Sube
|
5d459ab17c
|
feat: allow users to add their own labels for models (#144)
|
2023-03-05 07:20:31 -06:00 |
Sean Sube
|
628812fb0b
|
fix(api): correct conversion imports
|
2023-03-04 23:03:15 -06:00 |
Sean Sube
|
43d4d4b86d
|
chore(api): dedupe model listing logic
|
2023-03-04 22:26:27 -06:00 |
Sean Sube
|
10fbafaff0
|
fix(api): correct imports
|
2023-03-04 22:25:49 -06:00 |
Sean Sube
|
7b88371832
|
lint(api): use load pattern in server submodule
|
2023-03-04 22:13:09 -06:00 |
Sean Sube
|
bb1d945761
|
lint(api): submodules for major libs
|
2023-03-04 22:12:35 -06:00 |
Sean Sube
|
39d36618e6
|
feat(api): add support for custom tokens for textual inversions (#179)
|
2023-03-02 23:32:20 -06:00 |
Sean Sube
|
22e9d54408
|
apply lint
|
2023-03-02 22:32:37 -06:00 |
Sean Sube
|
be1c8cd79f
|
feat(api): support ckpt inversions by splitting multivector embeddings into multiple tokens
|
2023-03-02 22:11:27 -06:00 |
Sean Sube
|
9a0d2051fb
|
fix(api): better logging when converting textual inversions
|
2023-03-02 07:57:59 -06:00 |
Sean Sube
|
46aac263d5
|
feat(api): initial support for textual inversion embeddings from civitai and others (#179)
|
2023-03-01 19:09:51 -06:00 |
Sean Sube
|
1f3a5f6f3c
|
fix(api): track completed jobs for each device worker (#170)
|
2023-03-01 19:09:18 -06:00 |
Sean Sube
|
4b77a00ca7
|
fix(api): load tokenizer with textual inversions
|
2023-03-01 19:08:31 -06:00 |
Sean Sube
|
21fc7c5968
|
fix(api): mark all convert methods as no_grad
|
2023-03-01 08:26:40 -06:00 |
Sean Sube
|
b44e644f9e
|
fix(scripts): pass protocol and port to all test scripts
|
2023-03-01 08:26:22 -06:00 |
Sean Sube
|
bf6cf4ce77
|
restore launch script
|
2023-03-01 08:25:46 -06:00 |
Sean Sube
|
3f9f94fcb5
|
apply lint, remove unused
|
2023-02-28 23:05:17 -06:00 |
Sean Sube
|
2f4ab20f61
|
use filename for tensors
|
2023-02-28 22:49:53 -06:00 |
Sean Sube
|
74aae1b027
|
fix(api): write external weights into same directory as optimized model
|
2023-02-28 22:47:02 -06:00 |
Sean Sube
|
dbf9eaf1a4
|
fix(api): run shape inference before converting models to fp16
per discussion in https://github.com/microsoft/onnxruntime/issues/14827
|
2023-02-28 22:36:45 -06:00 |
Sean Sube
|
86984be5d4
|
better error logging during conversion
|
2023-02-28 22:36:36 -06:00 |
Sean Sube
|
9ef89db8b0
|
extract tensors after conversion
|
2023-02-28 22:36:33 -06:00 |
Sean Sube
|
7e65e21410
|
reload model from proto file before converting
|
2023-02-28 22:36:26 -06:00 |
Sean Sube
|
2210ee849b
|
only convert inner nodes with ORT conversion helpers
|
2023-02-28 22:26:04 -06:00 |
Sean Sube
|
b532570f54
|
fix(api): reuse ORT session params for each device
|
2023-02-28 22:24:38 -06:00 |
Sean Sube
|
565873b3ae
|
test half precision on all diffusion models
|
2023-02-28 22:23:55 -06:00 |
Sean Sube
|
1f9efb433a
|
apply lint
|
2023-02-28 22:04:55 -06:00 |
Sean Sube
|
12fb7f52bb
|
fix(api): sanitize filenames in user input
|
2023-02-28 21:56:12 -06:00 |
Sean Sube
|
c99aa67220
|
name threads, max queues, type/lint fixes
|
2023-02-28 21:44:52 -06:00 |
Sean Sube
|
c95ac1fbdd
|
avoid terminating workers because it breaks their queues
|
2023-02-28 08:53:17 -06:00 |
Sean Sube
|
0011f079d4
|
daemonize queue collectors
|
2023-02-28 06:55:15 -06:00 |
Sean Sube
|
cad0d37604
|
some pending queue logging
|
2023-02-27 23:43:38 -06:00 |
Sean Sube
|
4ae3d9caa2
|
remove task done
|
2023-02-27 23:18:37 -06:00 |
Sean Sube
|
7e0ccdb1af
|
remove pending queues after joining
|
2023-02-27 23:14:20 -06:00 |
Sean Sube
|
1ce98ace33
|
add value error handling
|
2023-02-27 23:12:53 -06:00 |
Sean Sube
|
f7f438e767
|
directly rejoin pool
|
2023-02-27 23:03:42 -06:00 |
Sean Sube
|
da6ae5d62f
|
more logging around shutdown, close queues
|
2023-02-27 23:01:26 -06:00 |
Sean Sube
|
988088d64e
|
quit workers on keyboard signal
|
2023-02-27 22:52:43 -06:00 |
Sean Sube
|
953e5abd36
|
handle empty errors
|
2023-02-27 22:45:29 -06:00 |
Sean Sube
|
136759285d
|
set queue timeouts
|
2023-02-27 22:37:43 -06:00 |
Sean Sube
|
0793b61c3a
|
consistently pass job key to workers
|
2023-02-27 22:25:53 -06:00 |
Sean Sube
|
61373d530a
|
fix Windows entrypoint
|
2023-02-27 20:08:52 -06:00 |
Sean Sube
|
06f06f5a11
|
error handling in all threads
|
2023-02-27 19:48:51 -06:00 |
Sean Sube
|
113ad05293
|
typo
|
2023-02-27 17:36:26 -06:00 |
Sean Sube
|
2327b24022
|
join all threads
|
2023-02-27 17:35:31 -06:00 |
Sean Sube
|
66a20e60fe
|
run logger in a thread, clean up status
|
2023-02-27 17:14:53 -06:00 |
Sean Sube
|
13395933dc
|
always put progress in active jobs
|
2023-02-26 20:41:16 -06:00 |
Sean Sube
|
a37d1a4550
|
use progress queue
|
2023-02-26 20:37:22 -06:00 |
Sean Sube
|
401ee20526
|
fix finished flag
|
2023-02-26 20:13:16 -06:00 |
Sean Sube
|
525ee24e91
|
track started and finished jobs
|
2023-02-26 20:09:42 -06:00 |
Sean Sube
|
eb82e73e59
|
initialize list of finished jobs
|
2023-02-26 15:26:54 -06:00 |
Sean Sube
|
b931da1d2c
|
fix imports, lint
|
2023-02-26 15:21:58 -06:00 |
Sean Sube
|
85118d17c6
|
clear worker flags between jobs, attempt to record finished jobs again
|
2023-02-26 15:06:40 -06:00 |
Sean Sube
|
d1961afdbc
|
re-implement cancellation
|
2023-02-26 14:36:32 -06:00 |
Sean Sube
|
584dddb5d6
|
lint all the new stuff
|
2023-02-26 14:15:30 -06:00 |
Sean Sube
|
b880b7a121
|
set process titles, terminate workers
|
2023-02-26 13:09:24 -06:00 |
Sean Sube
|
6502e1e3c8
|
recycle worker pool after 10 jobs
|
2023-02-26 12:58:38 -06:00 |
Sean Sube
|
e0737e9e08
|
update progress and finished flag from worker
|
2023-02-26 12:51:11 -06:00 |
Sean Sube
|
f115326da7
|
apply patches within workers
|
2023-02-26 12:32:48 -06:00 |
Sean Sube
|
e1d0ad54b7
|
lock per worker, torch before ORT
|
2023-02-26 12:24:51 -06:00 |
Sean Sube
|
d765a6f01b
|
make logger start up well
|
2023-02-26 11:16:33 -06:00 |
Sean Sube
|
6998e8735c
|
rejoin worker pool
|
2023-02-26 10:47:31 -06:00 |
Sean Sube
|
06c74a7a96
|
feat(api): remove Flask app from global scope
|
2023-02-26 10:15:12 -06:00 |
Sean Sube
|
943281feb5
|
wire up worker jobs
|
2023-02-25 23:55:30 -06:00 |
Sean Sube
|
f898de8c54
|
background workers, logger
|
2023-02-25 23:49:39 -06:00 |
Sean Sube
|
e46a1e5fd0
|
begin switching to per-device torch mp workers
|
2023-02-25 23:16:32 -06:00 |
Sean Sube
|
e03b637f54
|
fix(api): only run CUDA GC on CUDA devices
|
2023-02-25 22:32:01 -06:00 |
Sean Sube
|
6809d2da82
|
fix(scripts): update release tests with support for batches
|
2023-02-25 18:01:05 -06:00 |
Sean Sube
|
cb8e9e7080
|
fix scheduler caching
|
2023-02-25 13:14:34 -06:00 |
Sean Sube
|
18f59f034d
|
avoid passing None as encoder
|
2023-02-25 13:12:58 -06:00 |
Sean Sube
|
3626d69f40
|
fix(api): correctly handle missing inversion param
|
2023-02-25 12:54:51 -06:00 |
Sean Sube
|
973b0a9352
|
add context arg
|
2023-02-25 12:13:22 -06:00 |
Sean Sube
|
d88f13cbd7
|
lint LoRA code and extras, replace public paths with context ones
|
2023-02-25 12:12:10 -06:00 |
Sean Sube
|
ce74183e97
|
blend LoRAs into existing model
|
2023-02-25 11:53:43 -06:00 |
Sean Sube
|
f8658c88cd
|
fix(build): disable preview rules in black
|
2023-02-25 11:53:40 -06:00 |
Sean Sube
|
e8b5ff250d
|
add none option to inversion menu
|
2023-02-25 11:53:37 -06:00 |
Sean Sube
|
7ad8385c5b
|
load from encoder path, add default param
|
2023-02-25 11:53:34 -06:00 |
Sean Sube
|
2e7de16778
|
feat: add a way to select textual inversions
|
2023-02-25 11:53:32 -06:00 |
Sean Sube
|
45f5fca383
|
use correct fn to make dirs
|
2023-02-25 11:53:29 -06:00 |
Sean Sube
|
3dfaef041e
|
fix devices, make subdir
|
2023-02-25 11:53:26 -06:00 |
Sean Sube
|
3f4b3fa322
|
load CLIP on training device
|
2023-02-25 11:53:23 -06:00 |
Sean Sube
|
6b4ced2608
|
load inversions from extras file
|
2023-02-25 11:53:20 -06:00 |
Sean Sube
|
9dedfc7b28
|
add experimental LoRA blender
|
2023-02-25 11:53:17 -06:00 |
Sean Sube
|
a31f7b9e1f
|
feat(api): convert Textual Inversion weights
|
2023-02-25 11:53:13 -06:00 |
Sean Sube
|
947a1bfdec
|
fix variable names
|
2023-02-25 11:26:10 -06:00 |
Sean Sube
|
44393e3770
|
feat(api): add txt2txt endpoint
|
2023-02-25 11:20:36 -06:00 |
Sean Sube
|
fd013c88ef
|
fix(api): enable optimizations during model conversion
|
2023-02-23 18:43:49 -06:00 |
Sean Sube
|
14c7e6a78c
|
apply lint
|
2023-02-21 08:26:09 -06:00 |
Sean Sube
|
82016a163a
|
restore single output in chain pipeline stages
|
2023-02-21 08:14:04 -06:00 |
Sean Sube
|
33ab23a474
|
convert to list of outputs
|
2023-02-20 23:47:43 -06:00 |
Sean Sube
|
b65e4e7cbe
|
use batch size when generating latents
|
2023-02-20 21:57:46 -06:00 |
Sean Sube
|
62048298d7
|
fix(scripts): reduce steps/time on leak test
|
2023-02-20 21:46:54 -06:00 |
Sean Sube
|
2c8bd4b043
|
read batch parameter from request
|
2023-02-20 21:46:23 -06:00 |
Sean Sube
|
5f3b84827b
|
feat(api): add batch size to txt2img and img2img pipelines (#195)
|
2023-02-20 08:35:18 -06:00 |
Sean Sube
|
0deaa8898d
|
fix(api): add missing params to SD upscale
|
2023-02-19 23:30:48 -06:00 |
Sean Sube
|
c1189aad96
|
feat: add eta parameter (fixes #194)
|
2023-02-19 23:29:26 -06:00 |
Sean Sube
|
40e396a2c4
|
sonar lint fixes
|
2023-02-19 22:10:35 -06:00 |
Sean Sube
|
c5eae688e3
|
chore(api): automate release tests for blend mode
|
2023-02-19 15:18:22 -06:00 |
Sean Sube
|
62a6f14cb5
|
chore(api): automate more of the release test plan
|
2023-02-19 15:00:23 -06:00 |
Sean Sube
|
47643867be
|
more release tests
|
2023-02-19 11:20:59 -06:00 |
Sean Sube
|
f561dfae83
|
fix(api): correct blending mask (fixes #188)
|
2023-02-19 11:04:11 -06:00 |
Sean Sube
|
c459e96523
|
fix(api): report accurate size when face correction is run twice
|
2023-02-19 10:27:05 -06:00 |
Sean Sube
|
9a7770fe48
|
feat(test): add release regression testing script
|
2023-02-19 10:25:27 -06:00 |
Sean Sube
|
f7eefe4bd2
|
more sonar lint
|
2023-02-19 07:54:27 -06:00 |
Sean Sube
|
c69e342ee4
|
apply sonar lint
|
2023-02-19 07:53:20 -06:00 |
Sean Sube
|
30978e3e5b
|
fix(api): only run GC is devices are passed
|
2023-02-19 07:41:16 -06:00 |
Sean Sube
|
3789862a6f
|
mark unused params, fix shared lists
|
2023-02-19 07:37:29 -06:00 |
Sean Sube
|
b7a780bacc
|
correct param name for upscale mask
|
2023-02-18 22:53:57 -06:00 |
Sean Sube
|
30f16035bc
|
fix upscale copy ctor
|
2023-02-18 22:36:26 -06:00 |
Sean Sube
|
ac1f7449bb
|
fix(api): use stage source when available
|
2023-02-18 22:11:44 -06:00 |
Sean Sube
|
25c56c7d5c
|
fix imports
|
2023-02-18 20:28:21 -06:00 |
Sean Sube
|
3fd90a667d
|
lint(api): remove unused strength param from inpaint pipeline
|
2023-02-18 18:56:56 -06:00 |
Sean Sube
|
1a45aa68fa
|
clean up some exports, lint
|
2023-02-18 18:55:42 -06:00 |
Sean Sube
|
2b83f942af
|
restore original LPW names
|
2023-02-18 18:55:02 -06:00 |
Sean Sube
|
4d93c13431
|
apply lint, fix shadowed names
|
2023-02-18 17:59:13 -06:00 |
Sean Sube
|
b4f7973c1e
|
lint(api): use consistent name for source/mask images to avoid conflict with kwargs
|
2023-02-18 16:35:57 -06:00 |
Sean Sube
|
7b8ced0f68
|
feat(api): prefer chain stage parameters over request parameters (#138)
|
2023-02-18 16:27:48 -06:00 |
Sean Sube
|
bfdb071c2d
|
chore(docs): explain model optimizations
|
2023-02-18 16:06:05 -06:00 |
Sean Sube
|
e0a62ccbb5
|
better ONNX optimization logging
|
2023-02-18 15:47:31 -06:00 |
Sean Sube
|
881b290116
|
return session options properly
|
2023-02-18 15:45:28 -06:00 |
Sean Sube
|
5b4c370a1b
|
feat(api): enable ONNX optimizations through env
|
2023-02-18 15:44:39 -06:00 |
Sean Sube
|
0d2211ff25
|
apply lint
|
2023-02-18 14:14:13 -06:00 |
Sean Sube
|
f534fbb92c
|
fix(api): restore separate upscale and correction stages
|
2023-02-18 11:59:39 -06:00 |
Sean Sube
|
118695d68c
|
fix(api): add error handling for optimizations
|
2023-02-18 11:57:18 -06:00 |
Sean Sube
|
ab6462d095
|
feat(api): enable optimizations for SD pipelines based on env vars (#155)
|
2023-02-18 11:53:13 -06:00 |
Sean Sube
|
ff57527274
|
remove unused enum
|
2023-02-18 11:16:33 -06:00 |
Sean Sube
|
ffc4eb09f1
|
update reported image size when correction is run twice
|
2023-02-18 11:14:34 -06:00 |
Sean Sube
|
6dd0edc374
|
apply lint
|
2023-02-18 11:05:38 -06:00 |
Sean Sube
|
f051af359d
|
make default order match type
|
2023-02-18 11:05:23 -06:00 |
Sean Sube
|
ecf3c03f0f
|
feat: add parameter to run correction before upscaling (#132)
|
2023-02-18 11:04:08 -06:00 |
Sean Sube
|
b2de114c8c
|
fix(api): disable progress in diffusers pipelines
|
2023-02-18 09:42:38 -06:00 |
Sean Sube
|
8dd55cc556
|
fix(api): disable HF hub progress
|
2023-02-18 09:37:27 -06:00 |
Sean Sube
|
15060e6c7d
|
fix(api): create conversion context from environment vars
|
2023-02-18 09:31:20 -06:00 |
Sean Sube
|
b4e66ef502
|
feat(api): add flag to disable progress bars (#158)
|
2023-02-18 09:26:13 -06:00 |
Sean Sube
|
400e579491
|
Merge branch 'feat/113-onnx-resrgan'
|
2023-02-18 09:23:36 -06:00 |
Sean Sube
|
b3b10b4746
|
apply lint
|
2023-02-18 08:46:46 -06:00 |
Sean Sube
|
338fc237c7
|
fix(api): convert Real ESRGAN v3 using same arch as runtime
|
2023-02-18 08:41:15 -06:00 |
Sean Sube
|
431db6e3f8
|
repack size into tuples
|
2023-02-18 05:47:34 -06:00 |
Sean Sube
|
3ca02d4875
|
fix(api): make size params iterable
|
2023-02-18 05:44:43 -06:00 |
Sean Sube
|
0e108daa0f
|
fix(api): resize images to min dimensions by padding if necessary (#172)
|
2023-02-18 05:35:53 -06:00 |
Sean Sube
|
2c9d96d2ee
|
feat(api): use ONNX for Real ESRGAN v3 model
|
2023-02-17 23:25:42 -06:00 |
Sean Sube
|
ce8c7205dc
|
apply lint
|
2023-02-17 22:49:13 -06:00 |