-
|
It seems that this model of graphics card is not found in the compatibility list…… |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
|
Rocm5.7 can run stably |
Beta Was this translation helpful? Give feedback.
-
|
any version of rocm will work since gfx1031 can 100% compatibility run gfx1030 code with the hsa version override envvar |
Beta Was this translation helpful? Give feedback.
Rocm5.7 can run stably
6750gre&ubuntu 22.04.5&rocm5.7&llama
07:50:05-839448 INFO Output generated in 1.37 seconds (16.02 tokens/s, 22
tokens, context 1000, seed 801900742)
prompt processing progress, n_past = 1017, n_tokens = 53, progress = 0.052114
prompt eval time = 364.77 ms / 53 tokens ( 6.88 ms per token, 145.30 tokens per second)
eval time = 200.75 ms / 7 tokens ( 28.68 ms per token, 34.87 tokens per second)
total time = 565.52 ms / 60 tokens