Ollama is a tool that allows users to run large language models (LLMs) locally on their machines without relying on cloud services. This ensures greater privacy, data control, and offline usage capabilities.

• Local Model Execution: Install and run AI models directly on your device, such as Llama 3.3, DeepSeek-R1, Phi-4, Mistral, and Gemma 2.
• Cross-Platform Compatibility: Available for macOS, Linux, and Windows, making it accessible on multiple environments.
• Command Line Interface (CLI): Operates through the terminal or command prompt, offering efficient interaction with installed models.
• Privacy and Data Control: Since the tool runs locally, your data is not sent to external servers, ensuring enhanced security and privacy.

1. Download and Install:

1. Visit [Ollama Official Website](https://ollama.com/) and download the appropriate version for your operating system.
2. Follow the installer instructions to complete the setup.

2. Using the Terminal:

1. After installation, open your system's terminal or command prompt.
2. Run models using simple commands. For example, to run the Mistral model, use:

    
~$ ollama run mistral

Ollama supports several popular large language models, including but not limited to:

• Llama (all versions)
• DeepSeek-R1
• Phi-4
• Mistral
• Gemma 2

1. Offline Functionality: No internet connection is needed once models are installed.
2. Data Security: Data remains on the local device, eliminating the risk of data breaches from cloud services.
3. High Performance: Running models locally can offer faster responses depending on system specifications.

Ollama supports a list of models available on [ollama.com/library](https://ollama.com/library)

Here are some example models that can be downloaded:

You should have at least 8 GB of RAM available to run the 7B models, 16 GB to run the 13B models, and 32 GB to run the 33B models.

Create a model

ollama create is used to create a model from a Modelfile.

ollama create mymodel -f ./Modelfile

Pull a model

ollama pull llama3.2

  This command can also be used to update a local model. Only the diff will be pulled.

Remove a model

ollama rm llama3.2

Copy a model

ollama cp llama3.2 my-model

Multiline input

For multiline input, you can wrap text with “”“:

”““Hello,

… world! … ””“ I'm a basic program that prints the famous “Hello, world!” message to the console.

Multimodal models

ollama run llava “What's in this image? /Users/jmorgan/Desktop/smile.png”

  Output: The image features a yellow smiley face, which is likely the central focus of the picture.

Pass the prompt as an argument

ollama run llama3.2 “Summarize this file: $(cat README.md)”

  Output: Ollama is a lightweight, extensible framework for building and running language models on the local machine. It provides a simple API for creating, running, and managing models, as well as a library of pre-built models that can be easily used in a variety of applications.

Show model information

ollama show llama3.2

List models on your computer

ollama list

List which models are currently loaded

ollama ps

Stop a model which is currently running

ollama stop llama3.2

Start Ollama ollama serve is used when you want to start ollama without running the desktop application.

For more detailed information and tutorials, visit [Ollama's official website](https://ollama.com/) or check out this [video overview](https://www.youtube.com/watch?v=wxyDEqR4KxM).