# Compatibility

## Contents

- [Compatibility](#compatibility)
  - [Contents](#contents)
  - [Driver Versions](#driver-versions)
  - [Container/Platform Acceleration](#containerplatform-acceleration)
    - [Container Notes](#container-notes)
  - [Model/Platform Acceleration](#modelplatform-acceleration)
    - [Model Notes](#model-notes)

## Driver Versions

- CUDA
  - 11.6
  - 11.7
- ROCm
  - 5.2
  - 5.4 seems like it might work

## Container/Platform Acceleration

| Runtime | CUDA | DirectML | ROCm     | CPU |
| ------- | ---- | -------- | -------- | --- |
| docker  | yes  | no, 1    | maybe, 2 | yes |
| podman  | 3    | no, 1    | maybe, 2 | yes |

### Container Notes

1. no package available: https://github.com/ssube/onnx-web/issues/63
2. should work but testing failed: https://github.com/ssube/onnx-web/issues/10
3. should work, not tested: https://gist.github.com/bernardomig/315534407585d5912f5616c35c7fe374

## Model/Platform Acceleration

| Model            | ONNX | CUDA  | DirectML | ROCm  | CPU |
| ---------------- | ---- | ----- | -------- | ----- | --- |
| Stable Diffusion | yes  | yes   | yes      | yes   | yes |
| - txt2img        | yes  | ^     | ^        | ^     | ^   |
| - img2img        | yes  | ^     | ^        | ^     | ^   |
| - inpaint        | yes  | ^     | ^        | ^     | ^   |
| - upscale        | yes  | ^     | ^        | ^     | ^   |
| Real ESRGAN      | yes  | no, 1 | yes      | no, 2 | yes |
| - x2/x4 plus     | yes  | ^     | ^        | ^     | ^   |
| - v3             | yes  | ^     | ^        | ^     | ^   |
| GFPGAN           | no   | -     | -        | -     | -   |
| CodeFormer       | no   | -     | -        | -     | -   |

### Model Notes

1. Real ESRGAN running on CUDA falls back to the CPU provider with an unspecified error
2. Real ESRGAN running on ROCm crashes with an error:

   ```none
      File "/home/ssube/onnx-web/api/onnx_web/upscale.py", line 67, in __call__
        output = self.session.run([output_name], {
      File "/home/ssube/onnx-web/api/onnx_env/lib/python3.8/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 200, in run
        return self._sess.run(output_names, input_feed, run_options)
    onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : Non-zero status code returned while running FusedConv node. Name:'/body/body.0/rdb1/conv1/Conv' Status Message: MIOPEN failure 1: miopenStatusNotInitialized ; GPU=0 ; hostname=ssube-notwin ; expr=status_;
    ```