Microsoft Azure · NVIDIA A100 40GB
A100 40GB on Microsoft Azure
As of , Microsoft Azure lists the NVIDIA A100 40GB from $3.40 per GPU-hour on-demand (westus2), read . Among the 22 providers we track with an on-demand rate for this card, that is #22; the median rate card is $1.99, so Microsoft Azure is 71% above it. The cheapest is $0.69 on Trooper.AI. Microsoft Azure’s cheapest rate of any market is $0.75 (spot, westus2), capacity that can be taken back or shared, so it is not ranked as on-demand.
Microsoft Azure’s A100 40GB rates
On-demand
| GPU · what is sold | $ / GPU-hour | Read | Source |
|---|---|---|---|
| Standard_ND96asr_A100_v4API$27.20/node ÷ 8 · westus2 | $3.40 | captured | Deploy ↗ |
Spot / interruptible
| GPU · what is sold | $ / GPU-hour | Read | Source |
|---|---|---|---|
| Standard_ND96asr_A100_v4API$5.98/node ÷ 8 · westus2 · −$2.65 (−78%) vs its on-demand $3.40 | $0.75 | captured | Deploy ↗ |
Reserved (committed use)
| GPU · what is sold | $ / GPU-hour | Read | Source |
|---|---|---|---|
| Standard_ND96asr_A100_v4API3-year · $10.88/node ÷ 8 · westus2 · min. commitment 3yr · −$2.04 (−60%) vs its on-demand $3.40 | $1.36 | captured | Reserve ↗ |
| Standard_ND96asr_A100_v4API1-year · $18.83/node ÷ 8 · westus2 · min. commitment 1yr · −$1.05 (−31%) vs its on-demand $3.40 | $2.35 | captured | Reserve ↗ |
Providers near this rate
Each provider’s cheapest live on-demand rate for the NVIDIA A100 40GB, Microsoft Azure among them, 6 of 22. The full list is on the NVIDIA A100 40GB page.
| Place | Provider | USD / GPU-hour | Read | Deploy |
|---|---|---|---|---|
| #1 |  Trooper.AI from | $0.69 | captured | Deploy ↗ |
| #18 |  Google Cloud GPU only | $2.93 | captured | Deploy ↗ |
| #19 |  Oracle Cloud (OCI) | $3.05 | captured | Deploy ↗ |
| #20 |  Paperspace | $3.09 | captured | Deploy ↗ |
| #21 |  Cloud.ru Evolution | $3.14 | captured | Deploy ↗ |
| #22 | Microsoft Azure | $3.40 | captured | Deploy ↗ |
More: every NVIDIA A100 40GB rate at every provider on the NVIDIA A100 40GB page (price history) · every card at Microsoft Azure on Microsoft Azure’s page · Microsoft Azure vs Trooper.AI, card by card. This page as data: /providers/azure/prices.json.
Data updated: