1
0
Fork 0
onnx-web/docs/compatibility.md

62 lines
2.4 KiB
Markdown
Raw Normal View History

# Compatibility
## Contents
- [Compatibility](#compatibility)
- [Contents](#contents)
- [Driver Versions](#driver-versions)
- [Container/Platform Acceleration](#containerplatform-acceleration)
- [Container Notes](#container-notes)
- [Model/Platform Acceleration](#modelplatform-acceleration)
- [Model Notes](#model-notes)
## Driver Versions
- CUDA
- 11.6
- 11.7
- ROCm
- 5.2
- 5.4 seems like it might work
## Container/Platform Acceleration
| Runtime | CUDA | DirectML | ROCm | CPU |
| ------- | ---- | -------- | -------- | --- |
| docker | yes | no, 1 | maybe, 2 | yes |
| podman | 3 | no, 1 | maybe, 2 | yes |
### Container Notes
1. no package available: https://github.com/ssube/onnx-web/issues/63
2. should work but testing failed: https://github.com/ssube/onnx-web/issues/10
3. should work, not tested: https://gist.github.com/bernardomig/315534407585d5912f5616c35c7fe374
## Model/Platform Acceleration
| Model | ONNX | CUDA | DirectML | ROCm | CPU |
| ---------------- | ---- | ----- | -------- | ----- | --- |
| Stable Diffusion | yes | yes | yes | yes | yes |
| - txt2img | yes | ^ | ^ | ^ | ^ |
| - img2img | yes | ^ | ^ | ^ | ^ |
| - inpaint | yes | ^ | ^ | ^ | ^ |
| - upscale | yes | ^ | ^ | ^ | ^ |
| Real ESRGAN | yes | no, 1 | yes | no, 2 | yes |
| - x2/x4 plus | yes | ^ | ^ | ^ | ^ |
| - v3 | yes | ^ | ^ | ^ | ^ |
| GFPGAN | no | - | - | - | - |
| CodeFormer | no | - | - | - | - |
### Model Notes
1. Real ESRGAN running on CUDA falls back to the CPU provider with an unspecified error
2. Real ESRGAN running on ROCm crashes with an error:
```none
File "/home/ssube/onnx-web/api/onnx_web/upscale.py", line 67, in __call__
output = self.session.run([output_name], {
File "/home/ssube/onnx-web/api/onnx_env/lib/python3.8/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 200, in run
return self._sess.run(output_names, input_feed, run_options)
onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : Non-zero status code returned while running FusedConv node. Name:'/body/body.0/rdb1/conv1/Conv' Status Message: MIOPEN failure 1: miopenStatusNotInitialized ; GPU=0 ; hostname=ssube-notwin ; expr=status_;
```