NVIDIA A100

NVIDIA40–80GB HBM2eSXM4 / PCIeAmpere

Data updated 2026-11-04 15:09 UTC · refreshed every 5 min

Current Price

$1.50/hr

From $0.64/hr · lowest live offer

100 GPU · High availability

Current Price

$1.50

+15.0% (24h)

Available Now

100 GPU

High availability

Total in Network

589 GPU

Live data

Utilization

83.0%

High

Market history

Price Tracking

USD/hour (minimum · median)

Available GPUs

Ready to rent

Total in Network

Infrastructure Growth

Which LLMs run on one NVIDIA A100

Open VRAM calculator with A100

Estimated with our VRAM calculator for a single card: 8K context, 4 concurrent users, vLLM-style serving.

Largest that fitsINT4 / AWQ

Qwen3.6 35B A3B

35B MoE · 3B active

23.8 of 40 GB59%

~117 tok/s per stream

Details

Where the memory goes

  • Model weights21.88 GB
  • KV cache0.67 GB
  • Activations0.01 GB
  • CUDA & framework1.19 GB
Precision
INT4 / AWQ
Serving preset
8K context × 4 users
Users at this context
100
Spare context in leftover VRAM
631K
Fit score
79/100 · Moderate
Open in VRAM calculator
BalancedFP16

Qwen3-14B

14B

35.6 of 40 GB89%

~38 tok/s per stream

Details

Where the memory goes

  • Model weights28.00 GB
  • KV cache6.44 GB
  • Activations0.13 GB
  • CUDA & framework1.07 GB
Precision
FP16
Serving preset
8K context × 4 users
Users at this context
6
Spare context in leftover VRAM
35K
Fit score
56/100 · High
Open in VRAM calculator
CompactFP16

Qwen3.5-4B

4B

11.4 of 40 GB28%

~100 tok/s per stream

Details

Where the memory goes

  • Model weights9.20 GB
  • KV cache1.07 GB
  • Activations0.06 GB
  • CUDA & framework1.02 GB
Precision
FP16
Serving preset
8K context × 4 users
Users at this context
110
Spare context in leftover VRAM
785K
Fit score
94/100 · Comfortable
Open in VRAM calculator

Estimates, not benchmarks: real usage depends on the runtime, context and batch settings.

Technical Specifications

Memory

40–80GB HBM2e

FP32 Performance

39 TFLOPS

Tensor Performance

624 TFLOPS

Memory Bandwidth

2.0 TB/s

Architecture

Ampere

TDP

400W

FP64 Performance

19.5 TFLOPS

CUDA Cores

6912

Tensor Cores

432

Ideal Use Cases

AI TrainingDeep LearningHPCScientific ResearchData Analytics

About NVIDIA A100

The NVIDIA A100 is a proven AI accelerator available in SXM4 and PCIe form factors, widely used for training large neural networks.

The NVIDIA A100 features 40–80GB of HBM2e memory with 2.0 TB/s bandwidth, making it excellent for ai training, deep learning, hpc. With 624 TFLOPS tensor performance and 39 TFLOPS FP32 compute, this NVIDIA Ampere GPU delivers exceptional performance for demanding workloads.

Currently, 589 GPU A100 GPUs are available in the GPUniq network with 83.0% utilization. The average rental price is $1.50 per hour, with 100 GPU ready for immediate deployment.

A100 vs similar GPUs — specs & live rental prices

Prices are live minimum / median USD per hour on the GPUniq marketplace, as of 2026-11-04 15:09 UTC.

GPUVRAMArchitectureFP32TensorBandwidthTDPMin $/hrMedian $/hrAvailable
A10040–80GB HBM2eAmpere39 TFLOPS624 TFLOPS2.0 TB/s400W$0.60$1.3187
A4048GB GDDR6Ampere37.4 TFLOPS150 TFLOPS696 GB/s300W$0.36$0.9125
A1024GB GDDR6Ampere31.2 TFLOPS125 TFLOPS600 GB/s150W$0.34$0.352

Frequently Asked Questions

How much does it cost to rent NVIDIA A100?

The current rental price for NVIDIA A100 is $1.50 per hour on GPUniq. Prices may vary based on demand and availability.

What is NVIDIA A100 best used for?

NVIDIA A100 is ideal for AI Training, Deep Learning, HPC, Scientific Research, Data Analytics. With 40–80GB of HBM2e memory and 624 TFLOPS tensor performance, it excels at demanding AI and compute workloads.

How many NVIDIA A100 GPUs are available for rent?

Currently, there are 100 GPU available for immediate rental out of 589 GPU total in the GPUniq network. The current utilization is 83.0%.

Which LLMs can run on NVIDIA A100?

On a single NVIDIA A100, our VRAM calculator fits Qwen3.6 35B A3B (INT4 / AWQ, 23.8 of 40 GB); Qwen3-14B (FP16, 35.6 of 40 GB); Qwen3.5-4B (FP16, 11.4 of 40 GB) — estimated at 8K context with 4 concurrent users.

What are the specifications of NVIDIA A100?

NVIDIA A100 features 40–80GB HBM2e memory, 39 TFLOPS FP32 performance, 624 TFLOPS tensor performance, 2.0 TB/s memory bandwidth, and 400W TDP. It uses the Ampere architecture.

Related GPUs in Ampere Series

GPU rental guides

NVIDIA official specificationsAPI docsAbout GPUniqContact supportPrivacy policyTerms of use

$1.50/hr

A100 · 100 GPU

Rent now