Streaming + tools
#5
by
Viti2019
- opened
I am curious when streaming with tool use will work out of the box with vllm?
I am curious when streaming with tool use will work out of the box with vllm?
Same here, looking forward to testing this model out with streaming and tool calling for my use cases!
Yeah we sadly don't have good support for that yet! We'll try to improve it 🔜