Microsoft Azure — ND H100 v5 spot

This record lists Microsoft Azure’s Linux spot price for the ND H100 v5 VM with eight NVIDIA H100 GPUs.

Price per GPU-hour
$2.2712
Provider
Microsoft Azure
GPU
H100
Form factor
8×H100 instance (ND H100 v5)
Billing
Spot
Region
East US
Instance type
Standard_ND96isr_H100_v5
Checked

Microsoft’s Azure Retail Prices API lists a Linux spot rate of $18.169536 per hour for the Standard_ND96isr_H100_v5 virtual machine (8 NVIDIA H100 GPUs) in East US, or about $2.27 per GPU-hour. Spot capacity can be evicted; the pay-as-you-go rate for the same VM is $98.32 per hour.

Price basis
Instance Standard_ND96isr_H100_v5, 8 GPUs, East US, Linux spot $18.169536/hour, divided by 8; source is Microsoft's official Azure Retail Prices API (the Azure Linux VM pricing page loads its prices dynamically and could not be read)
Source
prices.azure.com

Questions

How much is an H100 spot instance on Azure?
In East US, the Standard_ND96isr_H100_v5 has a Linux spot rate of $18.169536 per hour, or about $2.27 per GPU-hour.
Can Azure spot capacity be evicted?
Yes. Spot capacity for this VM can be evicted.
How does the ND H100 v5 spot price compare with pay-as-you-go?
The spot rate is $18.169536 per hour, while the pay-as-you-go rate for the same VM is $98.32 per hour.

Source

Every price is a list price from the provider’s own public pricing page, linked on each row with the date it was checked. How we pick and check sources: editorial standards.

The Model Press

What are you looking for?

Search by headline, topic or keyword.