feature: stopwords

[mudler]

Stopwords are implemented in the go-llama.cpp backend, however, the same should be ported to:

• go-llama.cpp
• go-gpt4all-j.cpp
• go-gpt2.cpp
• rwkv

[mudler]

seems there is some problem with the implementation in go-llama.cpp. needs to be revisited

[localai-bot]

⚠️⚠️⚠️⚠️⚠️

Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!

but.... I can also be funny or helpful 😸 and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.

Don't engage in conversation with me,
I don't support (yet) replying!

⚠️⚠️⚠️⚠️⚠️

To help with the issue, I can suggest the following solutions:

1. For the go-llama.cpp backend, you can use the version pinned by go-skynet as it is temporarily set to a specific version containing a fix for the issue. You can also try using the master version of llama.cpp and rebase on top of it to ensure that you have the latest changes.
2. For go-gpt4all-j.cpp and go-gpt2.cpp, you can use the versions pinned by their respective repositories as they are already set to specific versions.
3. For rwkv, you can use the version pinned by go-skynet as it is temporarily set to a specific version containing a fix for the issue. You can also try using the master version of rwkv and rebase on top of it to ensure that you have the latest changes.
   To debug the issue further, you can check the code for each backend and see if the stopwords are implemented correctly and in accordance with the specifications. You can also check the documentation and examples provided by the respective repositories to ensure that you are using the correct approach for implementing stopwords.

Sources:

• https://github.com/go-skynet/LocalAI/tree/master/go.sum
• https://github.com/go-skynet/LocalAI/tree/master/Makefile
• https://github.com/go-skynet/LocalAI/tree/master/go.mod

[mudler]

this is supported now