Ollama

Deploy Ollama bundled with Open WebUI. Ollama is an open source platform for downloading, running, and managing large language models (LLMs) on your own machine, without relying on cloud-hosted services. Open WebUI provides a web-based chat interface for interacting with the models.

1. Deploy Ollama

 Estimated deployment time: 5–10 minutes

Follow the deployment instructions from the Get started section to configure the app, deploy it, and verify software installation.

For information on the app-specific configurations, see the Configuration options section.

Base distribution and plan

  • Supported distribution: Ubuntu 24.04 LTS
  • Recommended plans: RTX4000 Ada x1 small or larger GPU instance for best performance

Configuration options

Configure the required options to deploy your instance. For additional customization, add advanced options.

The table maps the Cloud Manager UI fields to their corresponding API/CLI keys (stackscript_data) required for automated deployments.

StackScript ID: 2088700

UI fieldAPI/CLI keyDescription
Required options
Limited sudo useruser_nameYour preferred username for the limited sudo user, entered without any capital letters, spaces, or special characters.
When adding a limited sudo user, the user is created with a strong generated password for your new Linode instance, and the account is assigned to the sudo group, which provides elevated permissions when running commands with the sudo prefix.
Note: For easier and more secure access with the sudo user, add an account SSH key for the Cloud Manager user during deployment and select that user as an authorized_user. Their SSH pubkey will be assigned to both the root and limited sudo users.
Email address (for the Let's Encrypt SSL certificate)soa_email_addressThe email used to receive notifications about the renewal of the Let's Encrypt SSL certificate. This allows you to visit Open WebUI securely through a browser.
Open WebUI admin nameopenwebui_login_nameThe name associated with your Open WebUI administrator account, required during initial setup.
Open WebUI admin emailopenwebui_login_emailThe email used to log in to Open WebUI.
Ollama ModelllmA valid Ollama-supported LLM model. For example, llama3.2:3b, qwen2.5:7b, or mistral:7b.
You can view all the latest models at https://ollama.com/search
Advanced options
Disable root access over SSHdisable_rootApplies to a limited sudo user. To block the root user from logging in over SSH, select Yes. Defaults to No.
Note: When you disable the root user from logging in over SSH and don't provide a valid Account SSH Key assigned to the authorized_user, you can still switch to the root user. To do that, log in as root via the Lish console and run cat /home/$USERNAME/.credentials to view the generated password for the limited sudo user.
Linode API tokentoken_passwordApplies to a custom domain. The Linode API token if you want to use Linode's DNS Manager to manage DNS records for your custom domain. Follow Manage personal access tokens to get your token on your account with Read/Write access to Domains.
  • If you provide the token along with the subdomain and domain, the installation attempts to create DNS records via the Linode API.
  • If you don't provide the token, you need to manually configure your DNS records through your DNS provider and point them to the IP address of the new instance.
SubdomainsubdomainApplies to a custom domain. The subdomain you want to use, like blog for blog.example.com. Use it only if you specify a Domain.
DomaindomainApplies to a custom domain. The domain name you want to use, like example.com. Use it only if you specify a Linode API token.
Optional data exporter Add-onsadd_onsAn option to include add-ons for your deployment. Possible values are:
  • none (default)
  • alloy
  • node_exporter
  • mysqld_exporter
  • newrelic

Notes:

  • After the app deployment completes, the passwords for your Open WebUI admin user and limited sudo user are generated and stored in the .credentials file in the home directory. Log in to your instance as root through the Lish console or SSH, then run cat /home/$USERNAME/.credentials to view its contents.
  • You can automatically configure a custom domain (optional) during deployment. To do that:
    1. First, configure your domain to use Linode’s name servers via your registrar. See Configure your domain's authoritative name servers for details.
    2. Once you complete that, specify the Linode API token, subdomain, and domain for the app in Cloud Manager or via API/CLI/Terraform.

Use API, CLI, or Terraform

In addition to deploying the app to a new Linode instance via Cloud Manager, you can also use the Linode API, CLI, or Terraform. When running the operation, you need to provide the StackScript ID, supported Linux distribution, and app-specific fields along with the standard Linode deployment configurations.

Note: Generate a personal access token to authenticate your API, CLI, or Terraform requests.

curl --location 'https://api.linode.com/v4/linode/instances' \
    --header 'Content-Type: application/json' \
    --header 'Accept: application/json' \
    --header 'Authorization: Bearer abc123def456hij789klm' \
    --data-raw '{
        "region": "us-east",
        "type": "g6-standard-2",
        "image": "linode/ubuntu24.04",
        "label": "my-ollama-one-click-app",
        "root_pass": "@C0mpl3x#P@ssw0rd",
        "stackscript_id": 2088700,
        "stackscript_data": {
            "user_name":"jsmith",
            "soa_email_address":"jsmith@example.com",
            "openwebui_login_name":"jsmith-admin",
            "openwebui_login_email":"jsmith-admin@example.com",
            "llm":"llama3.2:3b"
        }
    }'
linode-cli linodes create \
    --region us-east \
    --type g6-standard-2 \
    --label my-ollama-one-click-app \
    --image linode/ubuntu24.04 \
    --root_pass @C0mpl3x#P@ssw0rd \
    --stackscript_id 2088700 \
    --stackscript_data '{"user_name":"jsmith", "soa_email_address":"jsmith@example.com", "openwebui_login_name":"jsmith-admin", "openwebui_login_email":"jsmith-admin@example.com", "llm":"llama3.2:3b"}'
resource "linode_instance" "my-linode" {
    region         = "us-east"
    type           = "g6-standard-2"
    label          = "my-ollama-one-click-app"
    image          = "linode/ubuntu24.04"
    root_pass      = "@C0mpl3x#P@ssw0rd"
    stackscript_id = 2088700
    stackscript_data = {
        "user_name"             = "jsmith"
        "soa_email_address"     = "jsmith@example.com"
        "openwebui_login_name"  = "jsmith-admin"
        "openwebui_login_email" = "jsmith-admin@example.com"
        "llm"                   = "llama3.2:3b"
    }
}

2. Access Open WebUI

Once your app has finished deploying, you can log in to the Open WebUI interface using your browser.

  1. Open your web browser and navigate to one of these:

    • https://DOMAIN/, where DOMAIN can be replaced with your custom domain entered during deployment.
    • Your Linode instance's rDNS domain. For example, https://192-0-2-1.ip.linodeusercontent.com. See the Manage IP addresses on a Linode guide for details on viewing IP addresses and rDNS.
  2. Log in with the admin email and password from the .credentials file.

    To get the credentials, run the sudo cat /home/$USERNAME/.credentials command through the Lish console or SSH. The .credentials file contains:

    • Sudo Username and Password: Your limited sudo user credentials.
    • Open WebUI Admin Name: The admin username for the web interface.
    • Open WebUI Admin Email: The admin email address.
    • Open WebUI Admin Password: The admin password for logging in.
  3. After successfully logging in, you can start using the Ollama model.

Additional resources

For more information about the installed packages, see their official documentation.

📘

Note that we can't vouch for the accuracy or timeliness of externally hosted resources.


Did this page help you?