A platform for running local LLMs on CPU or GPU.
Running
The platform requires the daemon running:
ollama serve
And then run a model:
ollama run <model-name>
List models
ollama list
A platform for running local LLMs on CPU or GPU.
The platform requires the daemon running:
ollama serve
And then run a model:
ollama run <model-name>
ollama list