1
0
Fork 0
Commit Graph

812 Commits

Author SHA1 Message Date
Sean Sube ed694aa64f
pass highres scale param to upscaling method 2023-04-01 15:15:56 -05:00
Sean Sube e4f55af380
fix scale in upscale copy ctor 2023-04-01 14:59:59 -05:00
Sean Sube 89c3b2a403
correctly upscale highres tiles 2023-04-01 14:41:35 -05:00
Sean Sube 6d23491529
only run correction before highres when selected in options 2023-04-01 14:39:48 -05:00
Sean Sube f451d8db74
feat: add method parameter for highres mode 2023-04-01 14:26:45 -05:00
Sean Sube 0f79f420b7
apply lint 2023-04-01 12:06:31 -05:00
Sean Sube e0e09996de
fix(api): restart workers on HIP memory errors 2023-04-01 12:06:14 -05:00
Sean Sube 6aac0fe56b
fix(api): restart workers on MIOPEN memory errors 2023-04-01 11:59:03 -05:00
Sean Sube 3c2bab3156
fix highres steps max 2023-04-01 11:50:10 -05:00
Sean Sube 4f41145792
add highres to txt2img tab and request 2023-04-01 11:39:32 -05:00
Sean Sube ba09748e94
feat(gui): add highres parameters 2023-04-01 11:26:10 -05:00
Sean Sube f462d80cc4
run correction before highres 2023-03-31 23:55:51 -05:00
Sean Sube ca80e92707
fix progress for highres, increase img2img steps 2023-03-31 23:52:33 -05:00
Sean Sube 4ab1b6cc88
resize tiles before running refinement steps 2023-03-31 23:39:25 -05:00
Sean Sube 66e938f9ab
split steps before and after highres 2023-03-31 23:32:05 -05:00
Sean Sube cdaf1b8e5d
feat(api): add support for highres images 2023-03-31 23:27:16 -05:00
Sean Sube 93fcfd1422
fix(api): update LPW pipeline (#298) 2023-03-28 17:34:23 -05:00
Sean Sube 2bbc5d877f
lint(api): explicitly bind the device pool to shutdown callback 2023-03-27 17:13:45 -05:00
Sean Sube c2f8fb1d31
fix(api): combine names for ONNX fp16 optimization 2023-03-27 08:55:01 -05:00
Sean Sube 73e9cf8b66
fix(api): disable internal fp16 for VAE encoder (#290) 2023-03-27 08:10:40 -05:00
Sean Sube afa8f5e706
feat(api): add optimization for internal fp16 conversion 2023-03-26 22:41:12 -05:00
Sean Sube 0ea0442f02
apply lint 2023-03-26 18:24:22 -05:00
Sean Sube 4ddd69ba07
fix(api): watch for progress events from leaking workers 2023-03-26 18:22:16 -05:00
Sean Sube e1219cca90
fix(api): close queues after stopping workers 2023-03-26 18:21:53 -05:00
Sean Sube bb5d0635d1
sonar lint 2023-03-26 15:53:20 -05:00
Sean Sube 36bfccae09
fix(api): include worker totals in status endpoint 2023-03-26 15:49:43 -05:00
Sean Sube 2d2283e1eb
fix(api): attempt to read progress updates from recycled workers 2023-03-26 15:31:16 -05:00
Sean Sube 27500eccb5
fix(api): do not move jobs from pending to running until progress is reported 2023-03-26 14:22:59 -05:00
Sean Sube 0af406c47f
only enqueue jobs from progress worker 2023-03-26 14:02:57 -05:00
Sean Sube ccf8d51e08
feat(api): split up status endpoint by job status 2023-03-26 11:57:00 -05:00
Sean Sube ea36082e43
add job count to healthy worker logs 2023-03-26 11:53:06 -05:00
Sean Sube 8eab92a7df
define device on pending job 2023-03-26 11:49:58 -05:00
Sean Sube 83884bcafa
enqueue jobs on idle workers during progress check 2023-03-26 11:48:27 -05:00
Sean Sube 14ade83937
fix(api): enqueue next job when previous one finishes and after recycling worker 2023-03-26 11:41:45 -05:00
Sean Sube f3ab25f671
lint(api): add start method to worker pool 2023-03-26 11:30:07 -05:00
Sean Sube 2b179bebac
fix(api): always reset job counter when creating new device worker 2023-03-26 11:22:03 -05:00
Sean Sube 55e44e8ac9
fix(api): increment job counter for worker when it starts a new job (#283) 2023-03-26 11:18:27 -05:00
Sean Sube e552a5560f
feat(api): check device worker pool and recycle on a regular interval (#284) 2023-03-26 11:09:22 -05:00
Sean Sube aeb71ad50a
lint lock name 2023-03-26 08:30:34 -05:00
Sean Sube 95a61f3573
fix(api): restart worker threads when their respective queues are full 2023-03-25 13:46:12 -05:00
Sean Sube 88f4713e23
fix(api): use lock when restarting workers 2023-03-25 09:47:51 -05:00
Sean Sube 2c47904057
lint(api): use constant for model filename 2023-03-24 08:14:19 -05:00
Sean Sube 6b4c046867
pass pool to threads 2023-03-22 22:58:46 -05:00
Sean Sube 86c1b29c31
lint(api): extract worker thread main functions (#279) 2023-03-22 22:55:34 -05:00
Sean Sube 4dd68ea6b6
fix(api): restart worker threads if they crash 2023-03-22 19:58:46 -05:00
Sean Sube fa71d87e2c
apply lint 2023-03-21 22:19:50 -05:00
Sean Sube e445d2afaa
fix hidden state conversion 2023-03-21 22:08:17 -05:00
Sean Sube c8aad8554e
fix(api): convert back to model format after blending, convert samples as needed (#274) 2023-03-21 22:05:14 -05:00
Sean Sube 0315a8cbc6
fix(api): apply fp16 optimizations to LoRA and Textual Inversion blending 2023-03-21 21:45:27 -05:00
Sean Sube 4f6574c88e
sonar lint fixes 2023-03-21 17:11:38 -05:00
Sean Sube a660d9f1b1
apply lint 2023-03-20 22:28:48 -05:00
Sean Sube 7f459e0e29
correct extensions in ignore list 2023-03-19 23:31:11 -05:00
Sean Sube f779fbd5cc
fix(api): remove prefix before downloading for HF hub 2023-03-19 23:30:31 -05:00
Sean Sube 19712262e6
fix(api): filter out temporary files from model lists (#271) 2023-03-19 23:26:05 -05:00
Sean Sube ae3bcf3b8b
fix(api): add HF hub download to fetch logic for Inversion concepts 2023-03-19 20:32:21 -05:00
Sean Sube 0732058aa8
feat(api): detect Textual Inversion type from keys (#262) 2023-03-19 20:16:52 -05:00
Sean Sube fe498b16f0
fix(api): embed Inversion concepts using their name 2023-03-19 19:01:22 -05:00
Sean Sube 19d4d554c3
fix(api): add base token for Textual Inversion as sum layer 2023-03-19 18:04:21 -05:00
Sean Sube aefa5b4613
fix(api): clear job cancelled flag when worker starts a new job (#269) 2023-03-19 17:57:14 -05:00
Sean Sube 8acc15f52e
fix(api): better error handling around tensor loading 2023-03-19 15:38:43 -05:00
Sean Sube 07622690dc
fix(api): use Torch JIT and fallback loading 2023-03-19 15:31:35 -05:00
Sean Sube b797b3d616
fix(api): do not assume file extension for additional networks 2023-03-19 15:27:51 -05:00
Sean Sube 33008531e9
fix(api): load blending tensors onto CPU 2023-03-19 15:13:54 -05:00
Sean Sube 1c631c28d3
feat(api): add flag for ORT float16 optimizations 2023-03-19 11:59:35 -05:00
Sean Sube b8f816323e
fix(api): correctly load server env for conversion 2023-03-19 10:39:09 -05:00
Sean Sube 98e488319c
use fp16 optimization flag during conversion, add to admin docs 2023-03-19 10:33:46 -05:00
Sean Sube edd32f6044
apply lint, fix up log levels 2023-03-19 10:25:09 -05:00
Sean Sube 6f283c5c02
proxy nets that need fp16 conversion 2023-03-19 10:18:22 -05:00
Sean Sube bbd4c0fd72
dtype logging for potential fp16 params 2023-03-19 09:59:08 -05:00
Sean Sube 243a2d9df6
apply lint 2023-03-19 09:29:06 -05:00
Sean Sube 27bd10d2f7
fix(api): restrict CLIP skip token to integers, allow negative LoRA and Inversion weights 2023-03-19 09:13:40 -05:00
Sean Sube e6d7d30225
move tensor logs to trace level 2023-03-19 09:11:55 -05:00
Sean Sube 0e43acc0f7
fix(api): fetch sources and additional networks by default 2023-03-19 09:09:03 -05:00
Sean Sube b82246fdab
parse CLIP skip count from prompt 2023-03-19 08:43:39 -05:00
Sean Sube 46d1b5636d
normalize hidden states without using CLIP model class 2023-03-19 08:40:06 -05:00
Sean Sube 2ef00599b6
experimental CLIP skip 2023-03-19 08:17:40 -05:00
Sean Sube 9a949806d3
apply lint 2023-03-18 21:48:51 -05:00
Sean Sube 645da3d1a6
fix(api): allow dash in network names 2023-03-18 21:48:20 -05:00
Sean Sube a9e55ff9f2
remove references to inversion parameter 2023-03-18 19:47:22 -05:00
Sean Sube 5363037ab1
use network name in label key 2023-03-18 19:43:00 -05:00
Sean Sube 61d12b8ebd
include model type in label when present 2023-03-18 19:34:03 -05:00
Sean Sube f8f36e602c
feat(api): load i18n labels from additional networks 2023-03-18 19:25:22 -05:00
Sean Sube 2e89fd43d3
fix(api): only remove running jobs from running state 2023-03-18 19:21:40 -05:00
Sean Sube 716e009611
serialize networks 2023-03-18 19:21:15 -05:00
Sean Sube 2d112104fb
feat: show additional networks in client 2023-03-18 19:15:23 -05:00
Sean Sube e5862d178c
fix(api): assume inversion tokens are embeddings for now 2023-03-18 18:35:11 -05:00
Sean Sube ed8a7c8934
fix(api): move prompt parsing logs to trace level 2023-03-18 17:32:32 -05:00
Sean Sube d321321507
fix fields 2023-03-18 17:28:59 -05:00
Sean Sube 1d52dc684d
init last progress on worker context 2023-03-18 17:27:41 -05:00
Sean Sube e08a9aa2ab
add pending job list to pool 2023-03-18 17:26:28 -05:00
Sean Sube 8cbdad3a71
feat(api): add pending field to image ready response 2023-03-18 17:25:13 -05:00
Sean Sube 15b6e036e1
fix(api): maintain list of pending jobs 2023-03-18 17:15:18 -05:00
Sean Sube 588c8c7fdb
fix(api): track last progress within worker 2023-03-18 15:32:49 -05:00
Sean Sube 5106dd48a9
remove another ref to finished queue 2023-03-18 15:27:07 -05:00
Sean Sube b026566ccb
remove remaining references to finished queue and worker 2023-03-18 15:26:19 -05:00
Sean Sube d1565b056e
apply lint, make missing images an error 2023-03-18 15:16:41 -05:00
Sean Sube 7cf5554bef
feat(api): add error flag to image ready response 2023-03-18 15:13:42 -05:00
Sean Sube f336cc5d02
fix(api): provide noise parameter to SD upscaling (#196) 2023-03-18 14:02:30 -05:00
Sean Sube a9456f4a16
fix(api): bump default model cache to 5 (#242) 2023-03-18 13:47:39 -05:00
Sean Sube aec540a524
feat(api): add server setting for CUDA memory limit (#211) 2023-03-18 13:40:37 -05:00