Independent comparison Updated July 2026 20 GPU providers tested Real hourly pricing
We earn commissions from partner links on this page.

GPU cloud comparison · July 2026

Best GPU Cloud Hosting — 20 Providers Compared

We tested and priced 20 GPU cloud providers so you don't overpay. From $0.10/h community GPUs to enterprise H100 clusters at $4+/h.

Some links are affiliate links — we earn a commission at no extra cost to you. Prices verified July 2026. Always check the provider's site for current pricing.

GPU Cloud Comparison Table

Sorted by rating. Click any provider to see full details below.

Only chasing the lowest price? Our cheapest GPU cloud ranking starts at $0.02/h. Running bursty inference instead of training? Compare serverless GPU platforms — per-second billing, scale-to-zero.

ProviderRatingStarting PriceTop GPUsHighlightsAction
CoreWeave★★★★☆ 4.4from $1.25/hL40S, H100 SXM ≤80GB
  • Best multi-node GPU cluster performance
  • High-speed InfiniBand interconnects
View pricing
Paperspace★★★★☆ 4.3from $0.45/hA100, A6000 ≤80GB
  • Best notebook experience of any cloud GPU
  • Team collaboration features built-in
View pricing
Google Cloud GPU★★★★☆ 4.3from $0.71/hA100 40GB, A100 80GB ≤80GB
  • Best TPU availability for TF workloads
  • Deep Vertex AI + BigQuery integration
View pricing
Together AI★★★★☆ 4.3from $3.99/hH100, H200 ≤141GB
  • Best-in-class inference performance
  • Excellent open-source model coverage
View pricing
Jarvis Labs★★★★☆ 4.3from $0.41/hA30, L4 ≤80GB
  • A30 from $0.41/h, A100 40GB from $0.89/h
  • RTX Pro 6000 Blackwell — 96GB on a single card
View pricing
Hetzner GPU★★★★☆ 4.2from €1.42/hRTX 4000 SFF Ada, RTX PRO 6000 ≤80GB
  • 96GB VRAM on a single card
  • EU jurisdiction and euro invoicing
View pricing
AWS GPU (EC2)★★★★☆ 4.2from $0.53/hA100, H100 ≤80GB
  • Most comprehensive ML toolchain (SageMaker)
  • Spot instances for massive cost savings
View pricing
Crusoe★★★★☆ 4.2from $1.50/hH100, H200 ≤192GB
  • H200 HGX at $4.29/h with InfiniBand multi-node
  • B200 availability while most clouds wait-list
View pricing
TensorDock★★★★☆ 4.2from $0.10/hRTX 4090, RTX 3090 ≤80GB
  • Among the cheapest H100 access in 2026
  • Wide host network = better availability
View pricing
Azure GPU (NCv3/NDA)★★★★☆ 4.1from $0.53/hA100, H100 ≤80GB
  • Deep OpenAI / Azure OpenAI integration
  • Best choice for Microsoft-stack enterprises
View pricing
Hyperstack★★★★☆ 4.1from $0.15/hRTX A4000, RTX A6000 ≤80GB
  • Outstanding entry pricing for A6000
  • Full networking stack (VPC, firewall, NAT)
View pricing
Massed Compute★★★★☆ 4.1from $0.35/hRTX A6000, A40 ≤80GB
  • Strong A6000 / A40 lineup at moderate price
  • Pre-built VFX and AI templates
View pricing
Scaleway★★★★☆ 4.0from €0.79/hL4, L40S ≤80GB
  • Strong EU presence (Paris + Amsterdam)
  • Mature cloud platform (S3, k8s, networking)
View pricing
OVH GPU★★★★☆ 3.9from €0.36/hT4, V100 ≤80GB
  • Strong EU data sovereignty guarantees
  • Established cloud provider with SLA
View pricing
Salad★★★★☆ 3.9from $0.02/hRTX 3090, RTX 4090 ≤24GB
  • Cheapest consumer GPUs — RTX 3090 from $0.09/h
  • Massive horizontal scale (1000+ nodes)
View pricing

GPU Cloud Price Comparison — H100 & A100 $/h

Providers advertise different starting tiers, so a headline price rarely compares like for like. Below is the cheapest published on-demand price for the same GPU, normalized to a single-GPU hourly rate (8-GPU instances divided by 8). Verified against each provider's live pricing page, July 2026.

NVIDIA H100 80GB — on-demand $/h per GPU

Provider$/h per GPUConfiguration
RunPod Cheapest$1.99Community Cloud · H100 PCIe
Lambda Labs$3.29H100 PCIe · on-demand
CoreWeave$6.16HGX H100 · $49.24/node ÷ 8
AWS$6.88p5.48xlarge $55.04/h ÷ 8
Azure$6.98NC40ads H100 v5 · 1 GPU
Google Cloud$11.06a3-highgpu-8g $88.49/h ÷ 8

NVIDIA A100 80GB — on-demand $/h per GPU

Provider$/h per GPUConfiguration
RunPod Cheapest$1.19Community Cloud · A100 PCIe
CoreWeave$2.70$21.60/node ÷ 8
Lambda Labs$2.798× A100 SXM · per GPU
Azure$3.67NC24ads A100 v4 · 1 GPU
Google Cloud$5.07a2-ultragpu-1g · 1 GPU
AWS$5.12p4de.24xlarge $40.96/h ÷ 8

Specialist clouds (RunPod, Lambda) undercut the hyperscalers by 2–5× on identical silicon. Estimate your own workload with the GPU cost calculator. Marketplace pricing (Vast.ai) and consumer cards are excluded here — see the cheapest GPU cloud ranking for those.

Detailed Provider Reviews

In-depth analysis of each GPU cloud with pros, cons, and best-fit scenarios.

#1

RunPod Editor's Choice

Best value GPU cloud — huge selection, community + secure cloud

from $0.16/h
★★★★★ 4.6
Best Value RTX A5000RTX 3090RTX 4090RTX A6000L40SA100 80GBH100H200B200 up to 80GB VRAM
Pros
  • Cheapest community GPUs from $0.16/h
  • Massive GPU variety including H100
  • Serverless endpoints for inference APIs
  • Great UI and pod management
Cons
  • Community cloud less reliable than dedicated
  • Storage costs add up over time
  • Support can be slow on free tier
Best for: Fine-tuning LLMsStable DiffusionTrainingInference
#2

Lambda Labs Editor's Choice

On-demand H100 clusters — developer-favourite for serious ML

from $0.69/h
★★★★★ 4.5
Enterprise Quadro RTX 6000A100 40GBA100 80GBH100A10 up to 80GB VRAM
Pros
  • Reliable on-demand H100 availability
  • No complex setup — SSH ready in seconds
  • Lambda Stack saves setup time
  • Competitive pricing vs hyperscalers
Cons
  • Limited GPU types vs RunPod
  • Fewer EU datacenter options
  • No serverless endpoints
Best for: LLM trainingResearchFine-tuningMulti-GPU jobs
#3

Vast.ai Editor's Choice

Cheapest GPU cloud — peer-to-peer marketplace for budget training

from $0.03/h
★★★★ 4.1
Budget RTX 3090RTX 4090A100H100RTX 3060 up to 80GB VRAM
Pros
  • Absolute cheapest GPU compute available
  • Widest GPU variety including consumer cards
  • Good for fault-tolerant batch jobs
  • Marketplace competition drives prices down
Cons
  • Hosts can take instances offline anytime
  • Variable reliability across providers
  • Less suitable for time-sensitive inference
Best for: Batch trainingBudget experimentsStable DiffusionData processing
#4

Paperspace

Gradient notebooks + GPU VMs — great for ML teams

from $0.45/h
★★★★ 4.3
Notebooks A100A6000RTX 4000V100 up to 80GB VRAM
Pros
  • Best notebook experience of any cloud GPU
  • Team collaboration features built-in
  • Free tier with limited GPU hours
  • Good documentation and tutorials
Cons
  • Pricier than RunPod for raw compute
  • Limited GPU types vs competitors
  • Gradient platform has occasional issues
Best for: NotebooksML teamsPrototypingEducation
#5

CoreWeave

Enterprise H100 clusters — Kubernetes-native GPU cloud

from $1.25/h
★★★★ 4.4
Enterprise L40SH100 SXMA100 SXMA40 up to 80GB VRAM
Pros
  • Best multi-node GPU cluster performance
  • High-speed InfiniBand interconnects
  • Purpose-built for AI workloads
  • Strong enterprise support
Cons
  • Expensive — not for hobbyists
  • Requires Kubernetes knowledge
  • Sales-led process for large clusters
Best for: Large-scale trainingFoundation modelsEnterprise AIMulti-node jobs
#6

Hetzner GPU

EU-sovereign dedicated GPU servers — RTX PRO 6000 Blackwell 96GB

from €1.42/h
★★★★ 4.2
eu-sovereign RTX 4000 SFF AdaRTX PRO 6000 up to 80GB VRAM
Pros
  • 96GB VRAM on a single card
  • EU jurisdiction and euro invoicing
  • Dedicated hardware nobody else shares
  • No minimum term, immediate cancellation
Cons
  • Not the cheap option — €1.42/h vs €0.36/h at OVH
  • Only two SKUs, one currently out of stock
  • No A100, no H100, no SXM datacenter parts
  • Monthly servers, not per-hour cloud VMs
Best for: EU complianceDedicated hardwareLarge-VRAM single-card workLong-running workloads
#7

OVH GPU

European GPU cloud with NVIDIA T4 and V100 options

from €0.36/h
★★★★ 3.9
Enterprise T4V100A100 up to 80GB VRAM
Pros
  • Strong EU data sovereignty guarantees
  • Established cloud provider with SLA
  • Multi-region EU availability
  • Good for government/regulated industries
Cons
  • Older GPU lineup (V100 still prominent)
  • More complex setup vs RunPod
  • Higher prices than Hetzner for GPU
Best for: EU projectsInferenceModerate trainingGDPR requirements
#8

Google Cloud GPU

TPU + GPU powerhouse — best ecosystem for TensorFlow

from $0.71/h
★★★★ 4.3
Hyperscaler A100 40GBA100 80GBH100T4L4 up to 80GB VRAM
Pros
  • Best TPU availability for TF workloads
  • Deep Vertex AI + BigQuery integration
  • Global infrastructure and reliability
  • Preemptible instances cut costs significantly
Cons
  • Expensive on-demand pricing
  • Complex billing — easy to overspend
  • Steep learning curve for GCP newcomers
Best for: TensorFlow workloadsTPU trainingEnterprise AIVertex AI pipelines
#9

AWS GPU (EC2)

Largest GPU fleet worldwide — P4/P5 instances for enterprise

from $0.53/h
★★★★ 4.2
Hyperscaler A100H100V100T4Inferentia2 up to 80GB VRAM
Pros
  • Most comprehensive ML toolchain (SageMaker)
  • Spot instances for massive cost savings
  • Best compliance certifications globally
  • Inferentia for cost-effective inference
Cons
  • Most expensive on-demand GPU pricing
  • Complex pricing model
  • Not beginner-friendly for pure GPU rental
Best for: Enterprise MLOpsSageMaker pipelinesProduction inferenceRegulated industries
#10

Azure GPU (NCv3/NDA)

Microsoft's GPU cloud — best for Azure ML and enterprise AI

from $0.53/h
★★★★ 4.1
Hyperscaler A100H100V100T4 up to 80GB VRAM
Pros
  • Deep OpenAI / Azure OpenAI integration
  • Best choice for Microsoft-stack enterprises
  • Strong compliance and government certifications
  • Azure ML Studio for no-code ML
Cons
  • High on-demand pricing
  • Complex portal and billing
  • Vendor lock-in with Azure ecosystem
Best for: Azure ML pipelinesMicrosoft stack AIEnterprise complianceOpenAI API users
#11

Crusoe

Climate-aligned GPU cloud — H100, H200, B200 and MI300X on green energy

from $1.50/h
★★★★ 4.2
specialist H100H200B200A100 80GBL40SMI300X up to 192GB VRAM
Pros
  • H200 HGX at $4.29/h with InfiniBand multi-node
  • B200 availability while most clouds wait-list
  • InfiniBand 3.2 Tb interconnects for serious multi-node
  • Climate-positive operations (uses flared methane)
Cons
  • Smaller GPU variety than RunPod
  • Region selection limited (mostly US + Iceland)
  • Sales-led for large deployments
Best for: LLM training at scaleMulti-node H100/H200 jobsSustainable AI workloadsAMD MI300X clusters
#12

Nebius Editor's Choice

EU-sovereign AI cloud from the Netherlands — full GDPR compliance, H100 to B200

from $1.55/h
★★★★★ 4.5
eu-sovereign H100H200B200L40SA100 80GB up to 192GB VRAM
Pros
  • Strong EU data residency — perfect for German / EU enterprise
  • Modern hardware including B200 SXM
  • Managed cluster orchestration included
  • Strong customer support in European hours
Cons
  • More expensive on-demand than RunPod / Vast.ai
  • EU-only regions (no US datacenters)
  • Smaller global presence than hyperscalers
Best for: EU-sovereign AI workloadsGDPR-bound enterprisesFrontier model trainingEuropean startups
#13

Together AI

Inference-first GPU cloud — H100/H200 with optimized serving stacks

from $3.99/h
★★★★ 4.3
specialist H100H200A100 80GBL40S up to 141GB VRAM
Pros
  • Best-in-class inference performance
  • Excellent open-source model coverage
  • Strong fine-tuning workflow
  • Token-based pricing for variable load
Cons
  • Less GPU variety than RunPod
  • Focus is inference, not raw training
  • Custom interconnects not exposed
Best for: High-throughput inferenceOpen-source LLM servingLlama / Mistral fine-tuningProduction AI APIs
#14

Hyperstack

Global GPU cloud specialist — RTX A4000 from $0.15/h, plus H100, H200 and B200

from $0.15/h
★★★★ 4.1
specialist RTX A4000RTX A6000L40A100 80GBH100H200B200B300 up to 80GB VRAM
Pros
  • Outstanding entry pricing for A6000
  • Full networking stack (VPC, firewall, NAT)
  • UK / EU regions for European latency
  • Reservation discount up to 75%
Cons
  • No B200 / H200 yet (April 2026)
  • Smaller marketing footprint than RunPod
  • Limited template marketplace
Best for: Budget training jobsStable Diffusion at scaleVPC-isolated workloadsEU-friendly compute
#15

TensorDock

Marketplace GPU cloud — RTX A4000 from $0.10/h, RTX 4090 $0.35/h, H100 SXM5 $2.25/h

from $0.10/h
★★★★ 4.2
marketplace RTX 4090RTX 3090A100 80GBH100L40S up to 80GB VRAM
Pros
  • Among the cheapest H100 access in 2026
  • Wide host network = better availability
  • Per-second billing for short jobs
  • Free egress saves on data-heavy workloads
Cons
  • Reliability varies by host
  • No managed cluster orchestration
  • Support is community-led
Best for: Budget GPU rentalsStable Diffusion fine-tuningShort-burst trainingIndie ML developers
#16

Salad

Distributed inference cloud — RTX 3090 $0.09/h, RTX 4090 $0.16/h

from $0.02/h
★★★★ 3.9
inference-budget RTX 3090RTX 4090RTX 3080RTX 3070 up to 24GB VRAM
Pros
  • Cheapest consumer GPUs — RTX 3090 from $0.09/h
  • Massive horizontal scale (1000+ nodes)
  • Auto-fleet management for inference
  • No data-egress charges
Cons
  • Distributed = no persistent storage
  • Not suitable for training
  • Latency varies by node geography
Best for: Stateless inferenceStable Diffusion bulk generationEmbedding generationCost-sensitive batch jobs
#17

Jarvis Labs

On-demand A30 / A100 / H100 from $0.41/h

from $0.41/h
★★★★ 4.3
specialist A30L4A100 40GBA100 80GBRTX Pro 6000H100H200 up to 80GB VRAM
Pros
  • A30 from $0.41/h, A100 40GB from $0.89/h
  • RTX Pro 6000 Blackwell — 96GB on a single card
  • Polished UI for non-DevOps users
  • Quick spinup, low friction
Cons
  • Smaller GPU variety than RunPod
  • No serverless / autoscaling
  • Limited European presence
Best for: Researchers and indie developersLlama fine-tuningStable Diffusion trainingJupyter notebook users
#18

Lyceum Editor's Choice

EU-sovereign AI cloud — H100 to H200 with full data residency

from $1.19/h
★★★★ 4.2
eu-sovereign A100 80GBH100H200L40S up to 141GB VRAM
Pros
  • Strong EU data residency (no US transit)
  • H200 availability in Europe
  • ISO 27001 + SOC 2 certifications
  • European billing and contracts
Cons
  • Smaller capacity than US-based clouds
  • Higher base price than RunPod / Vast.ai
  • Limited GPU variety beyond Nvidia
Best for: EU-regulated industriesGDPR-strict workloadsEuropean public sectorHealth and finance AI
#19

Massed Compute

Workstation-grade GPUs for AI/ML/VFX — A100 from $1.79/h

from $0.35/h
★★★★ 4.1
specialist RTX A6000A40A100 80GBH100RTX 6000 Ada up to 80GB VRAM
Pros
  • Strong A6000 / A40 lineup at moderate price
  • Pre-built VFX and AI templates
  • RDP/VNC for visual workflows
  • Per-second billing
Cons
  • US-only datacenters
  • No serverless inference
  • Smaller community than RunPod
Best for: VFX and 3D renderingStable Diffusion fine-tuningWorkstation-style AI devMulti-tenant studios
#20

Scaleway

European cloud with H100 SXM and L40S — Paris and Amsterdam regions

from €0.79/h
★★★★ 4.0
eu-sovereign L4L40SH100H100 SXM up to 80GB VRAM
Pros
  • Strong EU presence (Paris + Amsterdam)
  • Mature cloud platform (S3, k8s, networking)
  • Per-minute billing
  • EUR pricing avoids USD volatility
Cons
  • More expensive than US specialists like RunPod
  • No B200 / H200 yet
  • Limited capacity for big training runs
Best for: European startupsGDPR-compliant inferencek8s-based AI deploymentsEU enterprise

Frequently Asked Questions

What is the cheapest GPU cloud in 2026? +

RunPod is the best-value GPU cloud in 2026 — from $0.16/h (RTX A5000 Community Cloud) with the strongest price-to-reliability ratio of the 20 providers we test, plus Serverless endpoints and persistent volumes. If you only chase the absolute lowest price: Vast.ai marketplace instances start at $0.10/h (interruptible).

Is RunPod reliable enough for production? +

RunPod's Secure Cloud is reliable for production with dedicated datacenter hardware. Community Cloud is cheaper but hosts can take instances offline. For always-on inference, use Secure Cloud or Lambda Labs.

Which GPU cloud has H100s available? +

Lambda Labs, CoreWeave, RunPod, AWS (p5), and Google Cloud all offer H100 access. CoreWeave has the largest H100 cluster inventory. Prices range from ~$2/h (Lambda) to $4+/h (AWS on-demand).

Should I use AWS/GCP/Azure or a specialist GPU cloud? +

For pure GPU compute, specialist clouds (RunPod, Lambda, Vast.ai) are 2–5× cheaper than hyperscalers. Use AWS/GCP/Azure only if you need tight ML service integration (SageMaker, Vertex AI) or strict enterprise compliance.

What GPU do I need for fine-tuning Llama 3 70B? +

You need at least an A100 80GB, or 2× A100 40GB in NVLink. For Llama 3 8B, a 24GB RTX 3090/4090 is sufficient. RunPod is the best value option for both.