Something I’ve been working on for a while and now I’m pretty happy with it. It’s Popcorn, the Depressed AI Cat!!!
Popcorn is running using ChrisRude’s https://github.com/chrisrude/oobabot. I found the real challenge here was getting the old API running in Oobabooga. I can’t remember exactly how I got it going but backing up the folders seemed to allow me to transfer to a new computer for the bot. Now time for hello world.
Configuration of the bot via config.yaml file was necessary to achieve functional behavior. https://github.com/chrisrude/oobabot/blob/main/docs/CONFIG.md had all the information needed to configure max tokens and other behaviors that were necessary. I found the prompt to require quite a bit of tweaking since I’m using the Llama-2 Chat model from TheBloke. After configuration no more hallucinations!!