[ROCm] Failure to run chandra on AMD MI210

#4
by XianHong1101 - opened

We are attempting to run the VLM model datalab-to/chandra on an AMD MI210 GPU using the official ROCm Docker images.

Does vLLM on the ROCm (AMD) platform currently support VLM models like datalab-to/chandra that require --trust-remote-code?

It seems the custom code for these models is CUDA-specific and/or the vLLM-ROCm loader does not support their architecture.

Thank you!

Sign up or log in to comment