22 Commits

Author	SHA1	Message	Date
Sean Sube	13510dbacd	fix(api): prefer device with lower index when queue is tied	2023-02-04 17:03:01 -06:00
Sean Sube	d75cd50a62	fix non-generic types	2023-02-04 16:57:00 -06:00
Sean Sube	5c07fff8b4	lint(api): type fields in job pool class defs	2023-02-04 16:55:42 -06:00
Sean Sube	ae434f5c11	fix(api): add device index to job status endpoint	2023-02-04 16:55:20 -06:00
Sean Sube	ed2e15a67e	fix(api): exclude finished jobs when load balancing	2023-02-04 16:54:44 -06:00
Sean Sube	de6e3b4e27	only return device index	2023-02-04 16:40:24 -06:00
Sean Sube	bf3f227d66	fix(api): default to first available device when there are no other jobs	2023-02-04 16:37:36 -06:00
Sean Sube	efee374c16	feat(api): load-balance background jobs between devices	2023-02-04 16:22:50 -06:00
Sean Sube	f6a6c997bb	lint(api): log which device is assigned to which job	2023-02-04 15:56:32 -06:00
Sean Sube	5e0231c01b	feat(api): distribute jobs to devices using round-robin (#38)	2023-02-04 15:49:05 -06:00
Sean Sube	4e5ad54471	improve device logging	2023-02-04 14:01:30 -06:00
Sean Sube	a212d954eb	fix provider lookup	2023-02-04 13:52:32 -06:00
Sean Sube	98b6e4dd03	feat(api): add provider for each available CUDA device (#38)	2023-02-04 13:49:34 -06:00
Sean Sube	732aa27b92	fix(api): log number of background workers on startup	2023-02-04 12:29:30 -06:00
Sean Sube	53f492459f	feat(api): log errors from background jobs	2023-02-04 11:56:34 -06:00
Sean Sube	87bbce4fff	return progress through chain	2023-02-04 11:08:22 -06:00
Sean Sube	157ed6da70	feat(api): add status endpoint	2023-02-04 10:59:03 -06:00
Sean Sube	ac7657defd	add debug logs to progress	2023-02-04 10:50:41 -06:00
Sean Sube	294c831d02	feat(api): add progress to ready endpoint	2023-02-04 10:16:30 -06:00
Sean Sube	1491a9e1e0	cancel jobs correctly	2023-02-04 10:10:40 -06:00
Sean Sube	c3b0c5e3e3	make initial thread pool optional	2023-02-04 10:07:58 -06:00
Sean Sube	6426cff741	feat(api): switch to device pool for background workers	2023-02-04 10:06:22 -06:00