Gemma3

Deploy Google Gemma3 bundled with Open WebUI. Gemma3 is an open source large language model from Google DeepMind. Open WebUI provides a web-based chat interface for interacting with the model.

During deployment, you can choose between two model sizes: 4B for efficient performance or 12B for enhanced capabilities.

1. Deploy Gemma3

 Estimated deployment time: 5–10 minutes

Base distribution and plan

• Supported distribution: Ubuntu 24.04 LTS
• Recommended plans: All GPU plan types and sizes can be used. The 4B model requires at least 16GB of RAM, while the 12B model requires at least 32GB of RAM.

Configuration options

StackScript ID: 1997012

Notes:

• After the app deployment completes, the passwords for your Open WebUI admin user and limited sudo user are generated and stored in the .credentials file in the home directory. Log in to your instance as root through the Lish console or SSH, then run cat /home/$USERNAME/.credentials to view its contents.
• You can automatically configure a custom domain (optional) during deployment. To do that:
  1. First, configure your domain to use Linode’s name servers via your registrar. See Configure your domain's authoritative name servers for details.
  2. Once you complete that, specify the Linode API token, subdomain, and domain for the app in Cloud Manager or via API/CLI/Terraform.

Use API, CLI, or Terraform

curl --location 'https://api.linode.com/v4/linode/instances' \
    --header 'Content-Type: application/json' \
    --header 'Accept: application/json' \
    --header 'Authorization: Bearer abc123def456hij789klm' \
    --data-raw '{
        "region": "us-east",
        "type": "g6-standard-2",
        "image": "linode/ubuntu24.04",
        "label": "my-gemma3-one-click-app",
        "root_pass": "@C0mpl3x#P@ssw0rd",
        "stackscript_id": 1997012,
        "stackscript_data": {
            "user_name":"jsmith",
            "openwebui_login_name":"jsmith-admin",
            "openwebui_login_email":"jsmith-admin@example.com",
            "hf_token": "1a23bc45DE678fg9hIj0klmNop1QrsT2Uv34Wxy5Z67"
        }
    }'

linode-cli linodes create \
    --region us-east \
    --type g6-standard-2 \
    --label my-gemma3-one-click-app \
    --image linode/ubuntu24.04 \
    --root_pass @C0mpl3x#P@ssw0rd \
    --stackscript_id 1997012 \
    --stackscript_data '{"user_name":"jsmith", "openwebui_login_name":"jsmith-admin", "openwebui_login_email":"jsmith-admin@example.com", "hf_token": "1a23bc45DE678fg9hIj0klmNop1QrsT2Uv34Wxy5Z67"}'

resource "linode_instance" "my-linode" {
    region         = "us-east"
    type           = "g6-standard-2"
    label          = "my-gemma3-one-click-app"
    image          = "linode/ubuntu24.04"
    root_pass      = "@C0mpl3x#P@ssw0rd"
    stackscript_id = 1997012
    stackscript_data = {
        "user_name"             = "jsmith"
        "openwebui_login_name"  = "jsmith-admin"
        "openwebui_login_email" = "jsmith-admin@example.com"
        "hf_token"              = "1a23bc45DE678fg9hIj0klmNop1QrsT2Uv34Wxy5Z67"
    }
}

2. Access Open WebUI

Once your app has finished deploying, you can log in to the Open WebUI interface using your browser.

1. Open your web browser and navigate to one of these:

   • https://DOMAIN/, where DOMAIN can be replaced with your custom domain entered during deployment.
   • Your Linode instance's rDNS domain. For example, https://192-0-2-1.ip.linodeusercontent.com. See the Manage IP addresses on a Linode guide for details on viewing IP addresses and rDNS.

2. Log in with the admin email and password from the .credentials file.

   To get the credentials, run the sudo cat /home/$USERNAME/.credentials command through the Lish console or SSH. The .credentials file contains:

   • Sudo Username and Password: Your limited sudo user credentials.
   • Open WebUI Admin Name: The admin username for the web interface.
   • Open WebUI Admin Email: The admin email address.
   • Open WebUI Admin Password: The admin password for logging in.

3. After successfully logging in, you can start chatting with the Gemma3 model.

Work with RAG operations

Open WebUI provides built-in support for RAG (Retrieval Augmented Generation) operations, allowing you to upload documents and chat with them. By default, the deployment supports file uploads up to 100MB.

If you need to upload larger documents, you can modify the NGINX configuration. To do that:

1. Edit the NGINX virtual host configuration file located at /etc/nginx/sites-enabled/your-domain.
2. Update the client_max_body_size directive to a larger value. For example, client_max_body_size 500M; for 500MB.
3. Reload NGINX using sudo systemctl reload nginx.

Additional resources

For more information about the installed packages, see their official documentation.

• Gemma3 Official Documentation
• Google Gemma 3 4B Model
• Google Gemma 3 12B Model
• Open WebUI Documentation