What is currently the leading chatbot that can be self hosted on your computer?

I have heard about alot of them and it seems like everyone and there dog is making one however I’m not sure which one I should be use.

​

Edit : I am running a 3060 with 12GB of ram

  • randomsnark@lemmy.mlEnglish
    1·
    1 year ago

    I haven’t tried running any myself so my knowledge is just from having glanced at a few discussions in AI communities when it’s come up, but I think Mistral 7B might be the current best, or a fine-tune of it such as Mistral 7B OpenOrca or Mistral 7B OpenHermes.