Instance types & specifications
Mithril offers several instances of various NVIDIA GPU types fit for your workloads. We will continue to add instance types over time.
Depending on your instance type, Ethernet or InfiniBand interconnect may be available.
VM image
You can choose between one of the supported VM images. We recommend Ubuntu24.04 2025.10.10 for the latest software, best performance, and updated security. This image is the default if none is specified in the launch specification.
Ubuntu24.04 2025.10.10
580.95.05
13.0
Improved fileshare performance
1.17.8
Ubuntu 24.04 LTS
Ubuntu24.04 2025.08.01
570.86.10
12.8
Does not support executing binaries from persistent storage
1.17.8
Ubuntu 24.04 LTS
Ubuntu22.04 2024.07.24
535.183.01
12.2
Ubuntu 22.04
You can use startup scripts to customize your environment during the startup process of your instances.
Hardware specifications
Each instance comes with its own ephemeral storage (outlined below) with NVMe SSD. This storage will exist until the instance has been terminated or pre-empted. There is no cost to use the ephemeral storage. Ephemeral storage is automatically mounted for you (and re-mounted after preemptions) at /mnt/local.
1x A100 80GB SXM
A100 SXM
1
26
190
1,750
2x A100 80GB SXM
A100 SXM
2
52
380
3,500
4x A100 80GB SXM
A100 SXM
4
102
760
7,000
8x A100 80GB SXM
A100 SXM
8
204
1,520
14,000
8x H100 80GB SXM*
H100 SXM
8
104+
1,800+
6,400+
* There are multiple 8xH100 instance types on the platform depending on the region; the instance type shown here is the minimum on the platform. Refer to the instance specifications in the Mithril Platform for the most up-to-date information on instance type specifications by region.
Memory (RAM) configuration
To improve Spot startup times by up to 25%, we recommend launching bids with less RAM configured in the launch specification. This is ideal for light workloads or development use cases that require fast startup but low resource utilization.
Use the console or API to launch instances with less RAM.
At any point after launch, RAM can be adjusted from 100GB up to the instance type's default. In order to adjust the RAM for an order, the bid must be paused and resumed, which will restart all instances in the order.
By default, instances are launched with the maximum memory (RAM) allowed for the instance type.

Note that this feature is only available for Spot instances at this time.
Last updated