Instance types & specifications

Mithril offers several instances of various NVIDIA GPU types fit for your workloads. We will continue to add instance types over time.

Depending on your instance type, Ethernet or InfiniBand interconnect may be available.

VM image

You can choose between one of the supported VM images. We recommend Ubuntu24.04 2025.10.10 for the latest software, best performance, and updated security. This image is the default if none is specified in the launch specification.

Image name	NVIDIA driver	CUDA	Notes	NVIDIA container toolkit	OS
Ubuntu24.04 2025.10.10	580.95.05	13.0	Improved fileshare performance	1.17.8	Ubuntu 24.04 LTS
Ubuntu24.04 2025.08.01	570.86.10	12.8	Does not support executing binaries from persistent storage	1.17.8	Ubuntu 24.04 LTS
Ubuntu22.04 2024.07.24	535.183.01	12.2			Ubuntu 22.04

You can use startup scripts to customize your environment during the startup process of your instances.

Hardware specifications

Each instance comes with its own ephemeral storage (outlined below) with NVMe SSD. This storage will exist until the instance has been terminated or pre-empted. There is no cost to use the ephemeral storage. Ephemeral storage is automatically mounted for you (and re-mounted after preemptions) at /mnt/local.

Achieve 25% faster start-up times when configuring your instances with RAM lower than the default! RAM can be specified in the console or API, with smaller amounts enabling faster start-up time. Note the compute price does not change based on how much RAM you have — pricing is per GPU hour.

Instance name	GPU type	GPU memory (GB)	GPU quantity	# CPU cores	Default RAM (GB)	Ephemeral Storage (GB)
1x A100 80GB SXM	A100 SXM	80	1	26	190	1,750
2x A100 80GB SXM	A100 SXM	80	2	52	380	3,500
4x A100 80GB SXM	A100 SXM	80	4	102	760	7,000
8x A100 80GB SXM	A100 SXM	80	8	204	1,520	14,000
8x H100 80GB SXM*	H100 SXM	80	8	104+	1,800+	6,400+

* There are multiple 8xH100 instance types on the platform depending on the region; the instance type shown here is the minimum on the platform. Refer to the instance specifications in the Mithril Platform for the most up-to-date information on instance type specifications by region.

Memory (RAM) configuration

To improve Spot startup times by up to 25%, we recommend launching bids with less RAM configured in the launch specification. This is ideal for light workloads or development use cases that require fast startup but low resource utilization.

Use the console or API to launch instances with less RAM.

At any point after launch, RAM can be adjusted from 100GB up to the instance type's default. In order to adjust the RAM for an order, the bid must be paused and resumed, which will restart all instances in the order.

By default, instances are launched with the maximum memory (RAM) allowed for the instance type.

Note that this feature is only available for Spot instances at this time.