2.4 KiB
2.4 KiB
Compatibility
Contents
Driver Versions
- CUDA
- 11.6
- 11.7
- ROCm
- 5.2
- 5.4 seems like it might work
Container/Platform Acceleration
Runtime | CUDA | DirectML | ROCm | CPU |
---|---|---|---|---|
docker | yes | no, 1 | maybe, 2 | yes |
podman | 3 | no, 1 | maybe, 2 | yes |
Container Notes
- no package available: https://github.com/ssube/onnx-web/issues/63
- should work but testing failed: https://github.com/ssube/onnx-web/issues/10
- should work, not tested: https://gist.github.com/bernardomig/315534407585d5912f5616c35c7fe374
Model/Platform Acceleration
Model | ONNX | CUDA | DirectML | ROCm | CPU |
---|---|---|---|---|---|
Stable Diffusion | yes | yes | yes | yes | yes |
- txt2img | yes | ^ | ^ | ^ | ^ |
- img2img | yes | ^ | ^ | ^ | ^ |
- inpaint | yes | ^ | ^ | ^ | ^ |
- upscale | yes | ^ | ^ | ^ | ^ |
Real ESRGAN | yes | no, 1 | yes | no, 2 | yes |
- x2/x4 plus | yes | ^ | ^ | ^ | ^ |
- v3 | yes | ^ | ^ | ^ | ^ |
GFPGAN | no | - | - | - | - |
CodeFormer | no | - | - | - | - |
Model Notes
-
Real ESRGAN running on CUDA falls back to the CPU provider with an unspecified error
-
Real ESRGAN running on ROCm crashes with an error:
File "/home/ssube/onnx-web/api/onnx_web/upscale.py", line 67, in __call__ output = self.session.run([output_name], { File "/home/ssube/onnx-web/api/onnx_env/lib/python3.8/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 200, in run return self._sess.run(output_names, input_feed, run_options) onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : Non-zero status code returned while running FusedConv node. Name:'/body/body.0/rdb1/conv1/Conv' Status Message: MIOPEN failure 1: miopenStatusNotInitialized ; GPU=0 ; hostname=ssube-notwin ; expr=status_;