Instance types & specifications

Mithril offers several instances of various NVIDIA GPU types fit for your workloads. We will continue to add instance types over time.

Depending on your instance type, Ethernet or InfiniBand interconnect may be available.

VM image

You can choose between one of the supported VM images. We recommend Ubuntu24.04 2025.10.10 for the latest software, best performance, and updated security. This image is the default if none is specified in the launch specification.

Image name
NVIDIA driver
CUDA
Notes
NVIDIA container toolkit
OS

Ubuntu24.04 2025.10.10

580.95.05

13.0

1.17.8

Ubuntu 24.04 LTS

Ubuntu24.04 2025.08.01

570.86.10

12.8

Does not support executing binaries from persistent storage

1.17.8

Ubuntu 24.04 LTS

Ubuntu22.04 2024.07.24

535.183.01

12.2

Ubuntu 22.04

You can use startup scripts to customize your environment during the startup process of your instances.

Hardware specifications

Each instance comes with its own ephemeral storage (outlined below) with NVMe SSD. This storage will exist until the instance has been terminated or pre-empted. There is no cost to use the ephemeral storage. Ephemeral storage is automatically mounted for you (and re-mounted after preemptions) at /mnt/local.

Instance name
GPU type
GPU memory (GB)
GPU quantity
# CPU cores
RAM (GB)
Ephemeral Storage (GB)

1x A100 80GB SXM

A100 SXM

80

1

26

190

1,750

2x A100 80GB SXM

A100 SXM

80

2

52

380

3,500

4x A100 80GB SXM

A100 SXM

80

4

102

760

7,000

8x A100 80GB SXM

A100 SXM

80

8

204

1,520

14,000

8x H100 80GB SXM*

H100 SXM

80

8

104+

1,800+

6,400+

* There are multiple 8xH100 instance types on the platform depending on the region; the instance type shown here is the minimum on the platform. Refer to the instance specifications in the Mithril Platform for the most up-to-date information on instance type specifications by region.

Last updated