Ollama Installation and Configuration - Linux Systems

summary

This section learns how to complete the Ollama Installation and configuration of Ollama, as well as updates to Ollama, installation of specific versions, viewing logs and uninstallation.

I. Quick Installation

Ollama Download: https://ollama.com/download

Ollama official home page: https://ollama.com

Ollama official GitHub source code repository: https://github.com/ollama/ollama/

The official website provides a command line quick install.

curl -fsSL https://ollama.com/install.sh | sh

This command will automatically download the latest version of Ollama and complete the installation. The following commands are common for Ollama usage:

ollama serve # start ollama
ollama create # Creates a model from a model file.
ollama show # display model information
ollama run # to run a model
ollama pull # Pulls the model from the registry.
ollama push # Push model to registry
ollama list # lists models
ollama cp # copy model
ollama rm # delete model
ollama help # Get help information about any command

• Verify that the installation is complete, in the Exec Enter at:

ollama-h

The output is as follows: that means the installation was successful 🎉

• Enabling and using Ollama

First, open Ollama in the terminal and hang it in the background

ollama serve

library (ollama.com)Here is Ollama's model library, search for the model you want, open a new terminal and start!

ollama run llama3

The download speed depends on your bandwidth and is ready to use ✌Remember to use the control + D Exit Chat

II. Manual installation

Note: If an older version of ollama was previously installed, you will need to complete a manual uninstallation.sudo rm -rf /usr/lib/ollama More requirements 👉Referencesofficial website

2.1 Download and unzip the installation package that matches the operating system

curl -L https://ollama.com/download/ollama-linux-amd64.tgz -o ollama-linux-amd64.tgz
sudo tar -C /usr -xzf ollama-linux-amd64.tgz

AMD GPUsDownload:

curl -L https://ollama.com/download/ollama-linux-amd64-rocm.tgz -o ollama-linux-amd64-rocm.tgz
sudo tar -C /usr -xzf ollama-linux-amd64-rocm.tgz

ARM 64Download:

curl -L https://ollama.com/download/ollama-linux-arm64.tgz -o ollama-linux-arm64.tgz
sudo tar -C /usr -xzf ollama-linux-arm64.tgz

2.2 Start Ollama and verify

Enter the following command to start Ollama:

ollama serve

Verify that ollama is running successfully by opening another terminal and entering the following command

ollama-v

2.3 Add Ollama as a self-starting service (recommended)

First, create users and groups for Ollama:

sudo useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama
sudo usermod -a -G ollama $(whoami)

Then in that position:/etc/systemd/system/ollama.service Creating a service file

[Unit]
Description=Ollama Service
After=network-online.target
[Service]
ExecStart=/usr/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="PATH=$PATH"
[Install]
WantedBy=default.target

Finally start the service:

sudo systemctl daemon-reload
sudo systemctl enable ollama

III. Updates

Run the previous installation statement again to update Ollama:

curl -fsSL https://ollama.com/install.sh | sh

Or re-download the latest Ollama package:

curl -L https://ollama.com/download/ollama-linux-amd64.tgz -o ollama-linux-amd64.tgz
sudo tar -C /usr -xzf ollama-linux-amd64.tgz

IV. Installation of specific versions

set up OLLAMA_VERSIONFields,, you can install the corresponding version

curl -fsSL https://ollama.com/install.sh | OLLAMA_VERSION=0.5.7 sh

V. Viewing the log

View the logs of Ollama running as a startup service:

journalctl -e -u ollama

VI. Uninstallation

• Delete the Ollama service:

sudo systemctl stop ollama
sudo systemctl disable ollama
sudo rm /etc/systemd/system/ollama.service

• Remove the Ollama binary from the bin directory: /usr/local/bin ,/usr/bin ,/bin

sudo rm $ (which ollama)

• Delete downloaded models and Ollama service users and groups:

sudo rm -r /usr/share/ollama
sudo userdel ollama
sudo groupdel ollama

• Delete downloaded library files

sudo rm -rf /usr/local/lib/ollama