1023 Commits

All Branches

Search

Author	SHA1	Message	Date
Sean Sube	9ef89db8b0	extract tensors after conversion	2023-02-28 22:36:33 -06:00
Sean Sube	7e65e21410	reload model from proto file before converting	2023-02-28 22:36:26 -06:00
Sean Sube	2210ee849b	only convert inner nodes with ORT conversion helpers	2023-02-28 22:26:04 -06:00
Sean Sube	b532570f54	fix(api): reuse ORT session params for each device	2023-02-28 22:24:38 -06:00
Sean Sube	565873b3ae	test half precision on all diffusion models	2023-02-28 22:23:55 -06:00
Sean Sube	1f9efb433a	apply lint	2023-02-28 22:04:55 -06:00
Sean Sube	12fb7f52bb	fix(api): sanitize filenames in user input	2023-02-28 21:56:12 -06:00
Sean Sube	c99aa67220	name threads, max queues, type/lint fixes	2023-02-28 21:44:52 -06:00
Sean Sube	c95ac1fbdd	avoid terminating workers because it breaks their queues	2023-02-28 08:53:17 -06:00
Sean Sube	0011f079d4	daemonize queue collectors	2023-02-28 06:55:15 -06:00
Sean Sube	cad0d37604	some pending queue logging	2023-02-27 23:43:38 -06:00
Sean Sube	4ae3d9caa2	remove task done	2023-02-27 23:18:37 -06:00
Sean Sube	7e0ccdb1af	remove pending queues after joining	2023-02-27 23:14:20 -06:00
Sean Sube	1ce98ace33	add value error handling	2023-02-27 23:12:53 -06:00
Sean Sube	f7f438e767	directly rejoin pool	2023-02-27 23:03:42 -06:00
Sean Sube	da6ae5d62f	more logging around shutdown, close queues	2023-02-27 23:01:26 -06:00
Sean Sube	988088d64e	quit workers on keyboard signal	2023-02-27 22:52:43 -06:00
Sean Sube	953e5abd36	handle empty errors	2023-02-27 22:45:29 -06:00
Sean Sube	136759285d	set queue timeouts	2023-02-27 22:37:43 -06:00
Sean Sube	0793b61c3a	consistently pass job key to workers	2023-02-27 22:25:53 -06:00
Sean Sube	61373d530a	fix Windows entrypoint	2023-02-27 20:08:52 -06:00
Sean Sube	06f06f5a11	error handling in all threads	2023-02-27 19:48:51 -06:00
Sean Sube	113ad05293	typo	2023-02-27 17:36:26 -06:00
Sean Sube	2327b24022	join all threads	2023-02-27 17:35:31 -06:00
Sean Sube	66a20e60fe	run logger in a thread, clean up status	2023-02-27 17:14:53 -06:00
Sean Sube	13395933dc	always put progress in active jobs	2023-02-26 20:41:16 -06:00
Sean Sube	a37d1a4550	use progress queue	2023-02-26 20:37:22 -06:00
Sean Sube	401ee20526	fix finished flag	2023-02-26 20:13:16 -06:00
Sean Sube	525ee24e91	track started and finished jobs	2023-02-26 20:09:42 -06:00
Sean Sube	eb82e73e59	initialize list of finished jobs	2023-02-26 15:26:54 -06:00
Sean Sube	b931da1d2c	fix imports, lint	2023-02-26 15:21:58 -06:00
Sean Sube	85118d17c6	clear worker flags between jobs, attempt to record finished jobs again	2023-02-26 15:06:40 -06:00
Sean Sube	d1961afdbc	re-implement cancellation	2023-02-26 14:36:32 -06:00
Sean Sube	584dddb5d6	lint all the new stuff	2023-02-26 14:15:30 -06:00
Sean Sube	b880b7a121	set process titles, terminate workers	2023-02-26 13:09:24 -06:00
Sean Sube	6502e1e3c8	recycle worker pool after 10 jobs	2023-02-26 12:58:38 -06:00
Sean Sube	e0737e9e08	update progress and finished flag from worker	2023-02-26 12:51:11 -06:00
Sean Sube	f115326da7	apply patches within workers	2023-02-26 12:32:48 -06:00
Sean Sube	e1d0ad54b7	lock per worker, torch before ORT	2023-02-26 12:24:51 -06:00
Sean Sube	d765a6f01b	make logger start up well	2023-02-26 11:16:33 -06:00
Sean Sube	6998e8735c	rejoin worker pool	2023-02-26 10:47:31 -06:00
Sean Sube	06c74a7a96	feat(api): remove Flask app from global scope	2023-02-26 10:15:12 -06:00
Sean Sube	943281feb5	wire up worker jobs	2023-02-25 23:55:30 -06:00
Sean Sube	f898de8c54	background workers, logger	2023-02-25 23:49:39 -06:00
Sean Sube	e46a1e5fd0	begin switching to per-device torch mp workers	2023-02-25 23:16:32 -06:00
Sean Sube	e03b637f54	fix(api): only run CUDA GC on CUDA devices	2023-02-25 22:32:01 -06:00
Sean Sube	6809d2da82	fix(scripts): update release tests with support for batches	2023-02-25 18:01:05 -06:00
Sean Sube	cb8e9e7080	fix scheduler caching	2023-02-25 13:14:34 -06:00
Sean Sube	18f59f034d	avoid passing None as encoder	2023-02-25 13:12:58 -06:00
Sean Sube	3626d69f40	fix(api): correctly handle missing inversion param	2023-02-25 12:54:51 -06:00