Bargawiki

You've loaded an old revision of the document! If you save it, you will create a new version with this data.

====== Ollama: Local Large Language Model Execution ======

Ollama is a tool that allows users to run large language models (LLMs) locally on their machines without relying on cloud services. This ensures greater privacy, data control, and offline usage capabilities.

===== Key Features =====
  * **Local Model Execution:** Install and run AI models directly on your device, such as Llama 3.3, DeepSeek-R1, Phi-4, Mistral, and Gemma 2.
  * **Cross-Platform Compatibility:** Available for macOS, Linux, and Windows, making it accessible on multiple environments.
  * **Command Line Interface (CLI):** Operates through the terminal or command prompt, offering efficient interaction with installed models.
  * **Privacy and Data Control:** Since the tool runs locally, your data is not sent to external servers, ensuring enhanced security and privacy.

===== Installation and Basic Usage =====
1. **Download and Install:** 
   - Visit [Ollama Official Website](https://ollama.com/) and download the appropriate version for your operating system.
   - Follow the installer instructions to complete the setup.
   
2. **Using the Terminal:**
   - After installation, open your system's terminal or command prompt.
   - Run models using simple commands. For example, to run the Mistral model, use:
     ```
     ollama run mistral
     ```

===== Supported Models =====
Ollama supports several popular large language models, including but not limited to:
  * **Llama** (all versions)
  * **DeepSeek-R1**
  * **Phi-4**
  * **Mistral**
  * **Gemma 2**
  
===== Advantages of Ollama =====
  - **Offline Functionality:** No internet connection is needed once models are installed.
  - **Data Security:** Data remains on the local device, eliminating the risk of data breaches from cloud services.
  - **High Performance:** Running models locally can offer faster responses depending on system specifications.

===== Learn More =====
For more detailed information and tutorials, visit [Ollama's official website](https://ollama.com/) or check out this [video overview](https://www.youtube.com/watch?v=wxyDEqR4KxM).

Edit summary

Note: By editing this page you agree to license your content under the following license: CC Attribution-Share Alike 4.0 International