瀏覽代碼

Merge pull request #2988 from dhiltgen/rocm_docs

Refined ROCm troubleshooting docs
Daniel Hiltgen 1 年之前
父節點
當前提交
280da44522
共有 1 個文件被更改,包括 30 次插入24 次删除
  1. 30 24
      docs/troubleshooting.md

+ 30 - 24
docs/troubleshooting.md

@@ -70,30 +70,36 @@ cat /proc/cpuinfo| grep flags  | head -1
 ## AMD Radeon GPU Support
 
 Ollama leverages the AMD ROCm library, which does not support all AMD GPUs. In
-some cases you can force the system to try to use a close GPU type.  For example
-The Radeon RX 5400 is `gfx1034` (also known as 10.3.4) however, ROCm does not
-support this patch-level, the closest support is `gfx1030`.  You can use the
-environment variable `HSA_OVERRIDE_GFX_VERSION` with `x.y.z` syntax.  So for
-example, to force the system to run on the RX 5400, you would set
-`HSA_OVERRIDE_GFX_VERSION="10.3.0"` as an environment variable for the server.
-
-At this time, the known supported GPU types are the following: (This may change from
-release to release)
-- gfx900
-- gfx906
-- gfx908
-- gfx90a
-- gfx940
-- gfx941
-- gfx942
-- gfx1030
-- gfx1100
-- gfx1101
-- gfx1102
-
-This will not work for all unsupported GPUs.  Reach out on [Discord](https://discord.gg/ollama)
-or file an [issue](https://github.com/ollama/ollama/issues) for additional help.
-
+some cases you can force the system to try to use a similar LLVM target that is
+close.  For example The Radeon RX 5400 is `gfx1034` (also known as 10.3.4)
+however, ROCm does not currently support this target. The closest support is
+`gfx1030`.  You can use the environment variable `HSA_OVERRIDE_GFX_VERSION` with
+`x.y.z` syntax.  So for example, to force the system to run on the RX 5400, you
+would set `HSA_OVERRIDE_GFX_VERSION="10.3.0"` as an environment variable for the
+server.  If you have an unsupported AMD GPU you can experiment using the list of
+supported types below.
+
+At this time, the known supported GPU types are the following LLVM Targets.
+This table shows some example GPUs that map to these LLVM targets:
+| **LLVM Target** | **An Example GPU** |
+|-----------------|---------------------|
+| gfx900 | Radeon RX Vega 56 |
+| gfx906 | Radeon Instinct MI50 |
+| gfx908 | Radeon Instinct MI100 |
+| gfx90a | Radeon Instinct MI210 |
+| gfx940 | Radeon Instinct MI300 |
+| gfx941 | |
+| gfx942 | |
+| gfx1030 | Radeon PRO V620 |
+| gfx1100 | Radeon PRO W7900 |
+| gfx1101 | Radeon PRO W7700 |
+| gfx1102 | Radeon RX 7600 |
+
+AMD is working on enhancing ROCm v6 to broaden support for families of GPUs in a
+future release which should increase support for more GPUs.
+
+Reach out on [Discord](https://discord.gg/ollama) or file an
+[issue](https://github.com/ollama/ollama/issues) for additional help.
 
 ## Installing older versions on Linux