Independent comparison Updated April 2026 20 GPU providers tested Real hourly pricing

A100 cloud comparison · April 2026

Best A100 Cloud Providers 2026

The cost-effective workhorse for ML — 18 clouds with A100 40GB and 80GB compared. From $1.09/h to $3.67/h for identical hardware.

The A100 market in April 2026

The NVIDIA A100 remains the workhorse for ML in 2026. While H100 has more raw FP8 throughput, A100 wins on cost-effectiveness for fine-tuning models up to 70B parameters, embedding generation, image training and most research workloads.

18 clouds offer A100 on-demand. Price varies 3.4× — from $1.09/h (Vast.ai community 80GB) to $3.67/h (AWS on-demand). Availability is significantly better than H100; stockouts are rare except on hyperscalers during peak hours.

Best value picks: RunPod and Lambda Labs for production reliability, Vast.ai for batch training, Hetzner GPU for EU/GDPR compliance.

ProviderStarting PriceTop GPUsHighlightsRatingCTA
H Hyperstackfrom $0.11/hRTX A6000, A100 80GB, H100 ≤80GB
  • Outstanding entry pricing for A6000
  • Full networking stack (VPC, firewall, NAT)
★★★★☆ 4.3View pricing
T TensorDockfrom $0.21/hRTX 4090, RTX 3090, A100 80GB ≤80GB
  • Among the cheapest H100 access in 2026
  • Wide host network = better availability
★★★★☆ 4.2View pricing
Hetzner GPUfrom €0.35/hA100 PCIe, GTX 1080 ≤80GB
  • Best GPU pricing in Europe
  • GDPR and EU data residency compliant
★★★★☆ 4.2View pricing
M Massed Computefrom $0.35/hRTX A6000, A40, A100 80GB ≤80GB
  • Strong A6000 / A40 lineup at moderate price
  • Pre-built VFX and AI templates
★★★★☆ 4.1View pricing
J Jarvis Labsfrom $0.39/hRTX 6000 Ada, A100 40GB, A100 80GB ≤80GB
  • Excellent pricing for H100
  • RTX 6000 Ada — 48GB at moderate cost
★★★★☆ 4.3View pricing
C Crusoefrom $0.40/hH100, H200, B200 ≤192GB
  • Among the cheapest H200 access — from $2.10/h
  • B200 availability while most clouds wait-list
★★★★☆ 4.4View pricing
Paperspacefrom $0.45/hA100, A6000, RTX 4000 ≤80GB
  • Best notebook experience of any cloud GPU
  • Team collaboration features built-in
★★★★☆ 4.3View pricing
OVH GPUfrom €0.54/hT4, V100, A100 ≤80GB
  • Strong EU data sovereignty guarantees
  • Established cloud provider with SLA
★★★★☆ 3.9View pricing
T Together AIfrom $1.49/hH100, H200, A100 80GB ≤141GB
  • Best-in-class inference performance
  • Excellent open-source model coverage
★★★★☆ 4.4View pricing
C CoreWeavefrom $2.06/hH100 SXM, A100 SXM, A40 ≤80GB
  • Best multi-node GPU cluster performance
  • High-speed InfiniBand interconnects
★★★★☆ 4.4View pricing
Google Cloud GPUfrom $2.48/hA100 40GB, A100 80GB, H100 ≤80GB
  • Best TPU availability for TF workloads
  • Deep Vertex AI + BigQuery integration
★★★★☆ 4.3View pricing
Azure GPU (NCv3/NDA)from $2.94/hA100, H100, V100 ≤80GB
  • Deep OpenAI / Azure OpenAI integration
  • Best choice for Microsoft-stack enterprises
★★★★☆ 4.1View pricing
AWS GPU (EC2)from $3.06/hA100, H100, V100 ≤80GB
  • Most comprehensive ML toolchain (SageMaker)
  • Spot instances for massive cost savings
★★★★☆ 4.2View pricing
#1
V

Vast.ai

Cheapest GPU cloud — peer-to-peer marketplace for budget training

from $0.10/h ★ 4.1
  • Absolute cheapest GPU compute available
  • Widest GPU variety including consumer cards
View pricing →
Price accurate?
#2
H

Hyperstack

Global GPU cloud specialist — H100, A100 80GB and L40 from $0.11/h

from $0.11/h ★ 4.3
  • Outstanding entry pricing for A6000
  • Full networking stack (VPC, firewall, NAT)
View pricing →
Price accurate?
#3
R

RunPod

Best value GPU cloud — huge selection, community + secure cloud

from $0.20/h ★ 4.6
  • Cheapest community GPUs from $0.20/h
  • Massive GPU variety including H100
View pricing →
Price accurate?
#4
T

TensorDock

Marketplace GPU cloud — RTX 4090 from $0.21/h, H100 from $1.99/h

from $0.21/h ★ 4.2
  • Among the cheapest H100 access in 2026
  • Wide host network = better availability
View pricing →
Price accurate?
#5

Hetzner GPU

Affordable EU GPU servers — A100 at European prices

from €0.35/h ★ 4.2
  • Best GPU pricing in Europe
  • GDPR and EU data residency compliant
View pricing →
Price accurate?
#6
M

Massed Compute

Workstation-grade GPUs for AI/ML/VFX — A100 from $1.79/h

from $0.35/h ★ 4.1
  • Strong A6000 / A40 lineup at moderate price
  • Pre-built VFX and AI templates
View pricing →
Price accurate?

Frequently Asked Questions

A100 40GB or 80GB — which should I rent? +

For Llama-3 8B / Mistral 7B / Stable Diffusion training: 40GB is sufficient and ~30% cheaper. For Llama-3 70B QLoRA, video AI, or batch sizes >32 on 13B models: 80GB. The price gap shrinks further with FlashAttention-3 and 8-bit optimizers.

A100 vs H100 — when is A100 the right choice? +

Choose A100 for: fine-tuning models ≤70B with QLoRA, ML research, image generation, RAG/embedding pipelines, and any workload not bottlenecked by FP8/Transformer Engine. H100 is only worth the premium for full fine-tunes of large models, multi-node training, or production inference of >70B models.

Cheapest A100 80GB available right now? +

Vast.ai community at $1.09/h (interruptible) is the absolute cheapest. For reliable production: RunPod Secure at $1.79/h or Lambda Labs at $1.79/h. AWS p4d on-demand is $3.67/h — avoid unless you need SageMaker integration.

Is A100 still relevant in 2026 with H100 around? +

Yes — A100 is the cost-effective default for most ML workloads. H100 dominates only large-scale training (≥70B full fine-tune, multi-node) and high-throughput FP8 inference. For ~80% of practical ML, A100 80GB is the better buy.

A100 in Europe (GDPR-compliant)? +

Hetzner GPU offers A100 PCIe in Germany and Finland at €0.35/h — the cheapest A100 in Europe. OVH (FR/DE) offers A100 at €0.54/h. Both are GDPR-compliant. CoreWeave also has EU H100/A100 capacity.