Guide
Training

Install the NVIDIA CUDA toolkit on GPU instances

Suggest Edits

To take advantage of the powerful parallel processing capabilities offered by GPU Compute Instances equipped with NVIDIA Quadro RTX cards, you first need to install NVIDIA's CUDA Toolkit. This guide walks you through deploying a GPU Compute Instance and installing the CUDA Toolkit.

  1. Deploy a GPU Compute Instance using Cloud Manager, the Linode CLI, or the Linode API. It's recommended to follow the instructions within the following guides:

    Be sure to select a distribution that's compatible with the NVIDIA CUDA Toolkit. Review NVIDIA's System requirements to learn which distributions are supported.

  2. Upgrade your system and install the kernel headers and development packages for your distribution. See NVIDIA's Pre-installation actions for additional information.

    • Ubuntu and Debian

      sudo apt update && sudo apt upgrade
sudo apt install build-essential linux-headers-$(uname -r)

    • CentOS/RHEL 8, AlmaLinux 8, Rocky Linux 8, and Fedora

      sudo dnf upgrade
sudo dnf install gcc kernel-devel-$(uname -r) kernel-headers-$(uname -r)

    • CentOS/RHEL 7

      sudo yum update
sudo yum install gcc kernel-devel-$(uname -r) kernel-headers-$(uname -r)

  3. Install the NVIDIA CUDA Toolkit software that corresponds to your distribution.

    1. Navigate to the NVIDIA CUDA Toolkit Download page. This page provides the installation instructions for the latest version of the CUDA Toolkit.

    2. Under the Select Target Platform section, choose the following options:

      • Operating System: Linux

      • Architecture: x86_64

      • Distribution: Select the distribution you have installed on your GPU Compute Instance (such as Ubuntu).

      • Version: Select the distribution version that's installed (such as 22.04).

      • Installer Type: Select from one of the following methods:

        • rpm (local) or deb (local): Stand-alone installer that contains dependencies. This is a much larger initial download size but is recommended for most users.

        • rpm (network) or deb (network): Smaller initial download size as dependencies are managed separately through the package management system. Some distributions may not contain the dependencies needed and you may receive an error when installing the CUDA package.

        • runfile (local): Installs the software outside of your package management system, which is typically not desired or recommended.

          🚧

          If you decide to use the runfile installation method, you may need to install gcc and other dependencies before running the installer file. In addition, you also need to disable any existing nouveau drivers that installed on most distributions by default. The runfile method is not covered in this guide. Instead, reference NVIDIA's runfile installation instructions for Ubuntu, Debian, CentOS, Fedora, or openSUSE.

      Screenshot of the CUDA Toolkit Downloads page

    3. The Download Installer (or similar) section should appear and display a list of commands needed to download and install the CUDA Toolkit. Run each command listed there.

    4. Reboot the GPU Compute Instance after all the commands have completed successfully.

    5. Run nvidia-smi to verify that the NVIDIA drivers and CUDA Toolkit are installed successfully. This command should output details about the driver version, CUDA version, and the GPU itself.

  4. You should now be ready to run your CUDA-optimized workloads. You can optionally download NVIDIA's CUDA code samples and review CUDA's Programming Guide to learn more about developing software to take advantage of a GPU Compute Instance.

Optional: After you have completed the installation, you can capture a custom image of the Compute Instance and use it the next time you need to deploy a GPU Compute Instance.

NVIDIA documentation

Updated about 1 month ago