[Usage]: Qwen/Qwen2-VL-7B-Instruct #10994
Description
The model to consider.
https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct
The closest model vllm already supports.
No response
What's your difficulty of supporting the model you want?
i deployed the model using vllm using the below command .
vllm serve Qwen/Qwen2-VL-7B-Instruct
How could i call this endpoint using curl command ?
i used this curl command:
curl http://localhost:8000/v1/chat/completions -H "Content-Type: application/json" -d '{"model":"Qwen/Qwen2-VL-7B-Instruct","messages":[{"role":"system","content":"You are Qwen, a vision-language AI assistant created by Alibaba Cloud."},{"role":"user","content":"Describe this image in detail. [Image: '"$(base64 -w 0 /home/azureuser/qwen/test.jpeg)"']"}],"temperature":0.7,"top_p":0.8,"max_tokens":100}'
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.