-
Notifications
You must be signed in to change notification settings - Fork 387
Open
Labels
LLMRelated to language model / embedderRelated to language model / embedderV2agentRelated to cat agent (reasoner / prompt engine)Related to cat agent (reasoner / prompt engine)endpointsRelated to http / ws endpointsRelated to http / ws endpoints
Description
Discussed in #748
Originally posted by NeverOccurs March 13, 2024
Hi I really love your works. Just a quick question, when I use local ollama models sometimes it produces gibberish and never stops. I have to restart the container and it is quite annoying. How to mannually interrupt a generating process when I don't want it to continue? Many thanks in advance!
Metadata
Metadata
Assignees
Labels
LLMRelated to language model / embedderRelated to language model / embedderV2agentRelated to cat agent (reasoner / prompt engine)Related to cat agent (reasoner / prompt engine)endpointsRelated to http / ws endpointsRelated to http / ws endpoints