Question: Is it possible to use Colqwen with vLLM? #194
Description
vLLM should support Qwen models, but Colqwen isn't a simple Qwen fine-tune, so I am wondering whether someone used the two successfully.
{{ message }}
vLLM should support Qwen models, but Colqwen isn't a simple Qwen fine-tune, so I am wondering whether someone used the two successfully.