onnx-web/docs/compatibility.md

Compatibility

Contents

• Compatibility
  • Contents
  • Driver Versions
  • Container/Platform Acceleration
    • Container Notes
  • Model/Platform Acceleration
    • Model Notes

Driver Versions

• CUDA
  • 11.6
  • 11.7
• ROCm
  • 5.2
  • 5.4 seems like it might work

Container/Platform Acceleration

Runtime	CUDA	DirectML	ROCm	CPU
docker	yes	no, 1	maybe, 2	yes
podman	3	no, 1	maybe, 2	yes

Container Notes

1. no package available: https://github.com/ssube/onnx-web/issues/63
2. should work but testing failed: https://github.com/ssube/onnx-web/issues/10
3. should work, not tested: https://gist.github.com/bernardomig/315534407585d5912f5616c35c7fe374

Model/Platform Acceleration

Model	ONNX	CUDA	DirectML	ROCm	CPU
Stable Diffusion	yes	yes	yes	yes	yes
- txt2img	yes	^	^	^	^
- img2img	yes	^	^	^	^
- inpaint	yes	^	^	^	^
- upscale	yes	^	^	^	^
Real ESRGAN	yes	no, 1	yes	no, 2	yes
- x2/x4 plus	yes	^	^	^	^
- v3	yes	^	^	^	^
GFPGAN	no	-	-	-	-
CodeFormer	no	-	-	-	-

Model Notes

1. Real ESRGAN running on CUDA falls back to the CPU provider with an unspecified error

2. Real ESRGAN running on ROCm crashes with an error:

      File "/home/ssube/onnx-web/api/onnx_web/upscale.py", line 67, in __call__
        output = self.session.run([output_name], {
      File "/home/ssube/onnx-web/api/onnx_env/lib/python3.8/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 200, in run
        return self._sess.run(output_names, input_feed, run_options)
    onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : Non-zero status code returned while running FusedConv node. Name:'/body/body.0/rdb1/conv1/Conv' Status Message: MIOPEN failure 1: miopenStatusNotInitialized ; GPU=0 ; hostname=ssube-notwin ; expr=status_;