Dissk@alien.topB to Self-Hosted Main@selfhosted.forum · 1 year ago

Ollama - super easy to host local LLM

6

7

Ollama - super easy to host local LLM

Dissk@alien.topB to Self-Hosted Main@selfhosted.forum · 1 year ago

6

GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally

Get up and running with Llama 2 and other large language models locally - GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally

Chat

Gamma@beehaw.org
link
fedilink
English
arrow-up
3·
1 year ago
There’s also an unofficial web frontend https://github.com/ollama-webui/ollama-webui

Though I can’t get compose to use my gpu

Self-Hosted Main@selfhosted.forum

main@selfhosted.forum

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !main@selfhosted.forum

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.

For Example

Service: Dropbox - Alternative: Nextcloud
Service: Google Reader - Alternative: Tiny Tiny RSS
Service: Blogger - Alternative: WordPress

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

Awesome-Selfhosted List of Software
Awesome-Sysadmin List of Software

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
37 users / 6 months
1 local subscriber
504 subscribers
1.82K Posts
10.4K Comments
Modlog

mods:
communick@selfhosted.forum