742 Commits

Author	SHA1	Message	Date
Sean Sube	ccd15c1921	set torch and ORT as extra indexes	2023-03-05 18:15:41 -06:00
Sean Sube	05c628d8a6	fix(build): use platform-specific requirements for containers	2023-03-05 17:55:44 -06:00
Sean Sube	31054c4ee3	feat(api): add requirements file for each platform (#193)	2023-03-05 17:55:23 -06:00
Sean Sube	d5a3b0fed8	feat(gui): add local params and API stub so client can load without a server (#181)	2023-03-05 16:23:26 -06:00
Sean Sube	468870e2e7	apply lint	2023-03-05 08:14:47 -06:00
Sean Sube	00fa9c5807	feat(api): collect labels from textual inversions (#144)	2023-03-05 08:00:25 -06:00
Sean Sube	b198b3baff	fix(api): attempt to validate extra translation strings	2023-03-05 07:53:23 -06:00
Sean Sube	6d2dd0a043	apply lint	2023-03-05 07:20:43 -06:00
Sean Sube	539d0febce	load extras during server init	2023-03-05 07:20:37 -06:00
Sean Sube	537c67619e	fix strings endpoint	2023-03-05 07:20:34 -06:00
Sean Sube	5d459ab17c	feat: allow users to add their own labels for models (#144)	2023-03-05 07:20:31 -06:00
Sean Sube	628812fb0b	fix(api): correct conversion imports	2023-03-04 23:03:15 -06:00
Sean Sube	43d4d4b86d	chore(api): dedupe model listing logic	2023-03-04 22:26:27 -06:00
Sean Sube	10fbafaff0	fix(api): correct imports	2023-03-04 22:25:49 -06:00
Sean Sube	7b88371832	lint(api): use load pattern in server submodule	2023-03-04 22:13:09 -06:00
Sean Sube	bb1d945761	lint(api): submodules for major libs	2023-03-04 22:12:35 -06:00
Sean Sube	39d36618e6	feat(api): add support for custom tokens for textual inversions (#179)	2023-03-02 23:32:20 -06:00
Sean Sube	22e9d54408	apply lint	2023-03-02 22:32:37 -06:00
Sean Sube	be1c8cd79f	feat(api): support ckpt inversions by splitting multivector embeddings into multiple tokens	2023-03-02 22:11:27 -06:00
Sean Sube	9a0d2051fb	fix(api): better logging when converting textual inversions	2023-03-02 07:57:59 -06:00
Sean Sube	46aac263d5	feat(api): initial support for textual inversion embeddings from civitai and others (#179)	2023-03-01 19:09:51 -06:00
Sean Sube	1f3a5f6f3c	fix(api): track completed jobs for each device worker (#170)	2023-03-01 19:09:18 -06:00
Sean Sube	4b77a00ca7	fix(api): load tokenizer with textual inversions	2023-03-01 19:08:31 -06:00
Sean Sube	21fc7c5968	fix(api): mark all convert methods as no_grad	2023-03-01 08:26:40 -06:00
Sean Sube	b44e644f9e	fix(scripts): pass protocol and port to all test scripts	2023-03-01 08:26:22 -06:00
Sean Sube	bf6cf4ce77	restore launch script	2023-03-01 08:25:46 -06:00
Sean Sube	3f9f94fcb5	apply lint, remove unused	2023-02-28 23:05:17 -06:00
Sean Sube	2f4ab20f61	use filename for tensors	2023-02-28 22:49:53 -06:00
Sean Sube	74aae1b027	fix(api): write external weights into same directory as optimized model	2023-02-28 22:47:02 -06:00
Sean Sube	dbf9eaf1a4	fix(api): run shape inference before converting models to fp16 ... per discussion in https://github.com/microsoft/onnxruntime/issues/14827	2023-02-28 22:36:45 -06:00
Sean Sube	86984be5d4	better error logging during conversion	2023-02-28 22:36:36 -06:00
Sean Sube	9ef89db8b0	extract tensors after conversion	2023-02-28 22:36:33 -06:00
Sean Sube	7e65e21410	reload model from proto file before converting	2023-02-28 22:36:26 -06:00
Sean Sube	2210ee849b	only convert inner nodes with ORT conversion helpers	2023-02-28 22:26:04 -06:00
Sean Sube	b532570f54	fix(api): reuse ORT session params for each device	2023-02-28 22:24:38 -06:00
Sean Sube	565873b3ae	test half precision on all diffusion models	2023-02-28 22:23:55 -06:00
Sean Sube	1f9efb433a	apply lint	2023-02-28 22:04:55 -06:00
Sean Sube	12fb7f52bb	fix(api): sanitize filenames in user input	2023-02-28 21:56:12 -06:00
Sean Sube	c99aa67220	name threads, max queues, type/lint fixes	2023-02-28 21:44:52 -06:00
Sean Sube	c95ac1fbdd	avoid terminating workers because it breaks their queues	2023-02-28 08:53:17 -06:00
Sean Sube	0011f079d4	daemonize queue collectors	2023-02-28 06:55:15 -06:00
Sean Sube	cad0d37604	some pending queue logging	2023-02-27 23:43:38 -06:00
Sean Sube	4ae3d9caa2	remove task done	2023-02-27 23:18:37 -06:00
Sean Sube	7e0ccdb1af	remove pending queues after joining	2023-02-27 23:14:20 -06:00
Sean Sube	1ce98ace33	add value error handling	2023-02-27 23:12:53 -06:00
Sean Sube	f7f438e767	directly rejoin pool	2023-02-27 23:03:42 -06:00
Sean Sube	da6ae5d62f	more logging around shutdown, close queues	2023-02-27 23:01:26 -06:00
Sean Sube	988088d64e	quit workers on keyboard signal	2023-02-27 22:52:43 -06:00
Sean Sube	953e5abd36	handle empty errors	2023-02-27 22:45:29 -06:00
Sean Sube	136759285d	set queue timeouts	2023-02-27 22:37:43 -06:00
Sean Sube	0793b61c3a	consistently pass job key to workers	2023-02-27 22:25:53 -06:00
Sean Sube	61373d530a	fix Windows entrypoint	2023-02-27 20:08:52 -06:00
Sean Sube	06f06f5a11	error handling in all threads	2023-02-27 19:48:51 -06:00
Sean Sube	113ad05293	typo	2023-02-27 17:36:26 -06:00
Sean Sube	2327b24022	join all threads	2023-02-27 17:35:31 -06:00
Sean Sube	66a20e60fe	run logger in a thread, clean up status	2023-02-27 17:14:53 -06:00
Sean Sube	13395933dc	always put progress in active jobs	2023-02-26 20:41:16 -06:00
Sean Sube	a37d1a4550	use progress queue	2023-02-26 20:37:22 -06:00
Sean Sube	401ee20526	fix finished flag	2023-02-26 20:13:16 -06:00
Sean Sube	525ee24e91	track started and finished jobs	2023-02-26 20:09:42 -06:00
Sean Sube	eb82e73e59	initialize list of finished jobs	2023-02-26 15:26:54 -06:00
Sean Sube	b931da1d2c	fix imports, lint	2023-02-26 15:21:58 -06:00
Sean Sube	85118d17c6	clear worker flags between jobs, attempt to record finished jobs again	2023-02-26 15:06:40 -06:00
Sean Sube	d1961afdbc	re-implement cancellation	2023-02-26 14:36:32 -06:00
Sean Sube	584dddb5d6	lint all the new stuff	2023-02-26 14:15:30 -06:00
Sean Sube	b880b7a121	set process titles, terminate workers	2023-02-26 13:09:24 -06:00
Sean Sube	6502e1e3c8	recycle worker pool after 10 jobs	2023-02-26 12:58:38 -06:00
Sean Sube	e0737e9e08	update progress and finished flag from worker	2023-02-26 12:51:11 -06:00
Sean Sube	f115326da7	apply patches within workers	2023-02-26 12:32:48 -06:00
Sean Sube	e1d0ad54b7	lock per worker, torch before ORT	2023-02-26 12:24:51 -06:00
Sean Sube	d765a6f01b	make logger start up well	2023-02-26 11:16:33 -06:00
Sean Sube	6998e8735c	rejoin worker pool	2023-02-26 10:47:31 -06:00
Sean Sube	06c74a7a96	feat(api): remove Flask app from global scope	2023-02-26 10:15:12 -06:00
Sean Sube	943281feb5	wire up worker jobs	2023-02-25 23:55:30 -06:00
Sean Sube	f898de8c54	background workers, logger	2023-02-25 23:49:39 -06:00
Sean Sube	e46a1e5fd0	begin switching to per-device torch mp workers	2023-02-25 23:16:32 -06:00
Sean Sube	e03b637f54	fix(api): only run CUDA GC on CUDA devices	2023-02-25 22:32:01 -06:00
Sean Sube	6809d2da82	fix(scripts): update release tests with support for batches	2023-02-25 18:01:05 -06:00
Sean Sube	cb8e9e7080	fix scheduler caching	2023-02-25 13:14:34 -06:00
Sean Sube	18f59f034d	avoid passing None as encoder	2023-02-25 13:12:58 -06:00
Sean Sube	3626d69f40	fix(api): correctly handle missing inversion param	2023-02-25 12:54:51 -06:00
Sean Sube	973b0a9352	add context arg	2023-02-25 12:13:22 -06:00
Sean Sube	d88f13cbd7	lint LoRA code and extras, replace public paths with context ones	2023-02-25 12:12:10 -06:00
Sean Sube	ce74183e97	blend LoRAs into existing model	2023-02-25 11:53:43 -06:00
Sean Sube	f8658c88cd	fix(build): disable preview rules in black	2023-02-25 11:53:40 -06:00
Sean Sube	e8b5ff250d	add none option to inversion menu	2023-02-25 11:53:37 -06:00
Sean Sube	7ad8385c5b	load from encoder path, add default param	2023-02-25 11:53:34 -06:00
Sean Sube	2e7de16778	feat: add a way to select textual inversions	2023-02-25 11:53:32 -06:00
Sean Sube	45f5fca383	use correct fn to make dirs	2023-02-25 11:53:29 -06:00
Sean Sube	3dfaef041e	fix devices, make subdir	2023-02-25 11:53:26 -06:00
Sean Sube	3f4b3fa322	load CLIP on training device	2023-02-25 11:53:23 -06:00
Sean Sube	6b4ced2608	load inversions from extras file	2023-02-25 11:53:20 -06:00
Sean Sube	9dedfc7b28	add experimental LoRA blender	2023-02-25 11:53:17 -06:00
Sean Sube	a31f7b9e1f	feat(api): convert Textual Inversion weights	2023-02-25 11:53:13 -06:00
Sean Sube	947a1bfdec	fix variable names	2023-02-25 11:26:10 -06:00
Sean Sube	44393e3770	feat(api): add txt2txt endpoint	2023-02-25 11:20:36 -06:00
Sean Sube	fd013c88ef	fix(api): enable optimizations during model conversion	2023-02-23 18:43:49 -06:00
Sean Sube	14c7e6a78c	apply lint	2023-02-21 08:26:09 -06:00
Sean Sube	82016a163a	restore single output in chain pipeline stages	2023-02-21 08:14:04 -06:00
Sean Sube	33ab23a474	convert to list of outputs	2023-02-20 23:47:43 -06:00