Ollama installation
From Notes_Wiki
Home > Local system based AI tools > Ollama > Ollama installation
Installing ollama on Rocky 9.x
To install Ollama on local system use following steps:
- Install ollama directly from site using:
- curl -fsSL https://ollama.com/install.sh | sh
- We can also install specific version of ollama using syntax similar to below example:
- curl -fsSL https://ollama.com/install.sh | OLLAMA_VERSION=0.5.7 sh
- For this look at model release versions at https://github.com/ollama/ollama/releases
- Check whether ollama service is running via:
- systemctl status ollama
- After this run ollama on local system via below commands and test:
- ollama run deepseek-r1:1.5b
-
- The above command may take considerable time when run for first time as it download the entire model. deepseek-r1:1.5b model in above example is 1.1GB in size. So first the command will download 1.1GB model and only after that we can prompt ">>>" to type our queries.
- The ollama service runs as ollama user with home folder as /usr/share/ollama. Consider moving /usr/share/ollama to partition with more space and create symoblic link at the original place.
- Edit /etc/systemd/system/ollama.service and append one more Environment condition
- Environment="OLLAMA_HOST=0.0.0.0"
- Restart service
- systemctl daemon-reload
- systemctl restart ollama
-
- Without above we cannot use Ollama from n8n etc. over http://localhost:11434/
- To close the system use:
- /bye
- Between any two queries which are unrelated we can clear the context using:
-
- /clear
-
Home > Local system based AI tools > Ollama > Ollama installation