NVIDIA A40

NVIDIA48GB GDDR6PCIe Gen4Ampere

Data updated 2026-11-04 15:09 UTC · refreshed every 5 min

Current Price

$0.85/hr

From $0.42/hr · lowest live offer

25 GPU · Good availability

Current Price

$0.85

-1.9% (24h)

Available Now

25 GPU

Good availability

Total in Network

89 GPU

Live data

Utilization

71.9%

Stable

Market history

Price Tracking

USD/hour (minimum · median)

Available GPUs

Ready to rent

Total in Network

Infrastructure Growth

Which LLMs run on one NVIDIA A40

Open VRAM calculator with A40

Estimated with our VRAM calculator for a single card: 8K context, 4 concurrent users, vLLM-style serving.

Largest that fitsINT4 / AWQ

Qwen3.6 35B A3B

35B MoE · 3B active

23.8 of 48 GB49%

~65 tok/s per stream

Details

Where the memory goes

  • Model weights21.88 GB
  • KV cache0.67 GB
  • Activations0.01 GB
  • CUDA & framework1.19 GB
Precision
INT4 / AWQ
Serving preset
8K context × 4 users
Users at this context
148
Spare context in leftover VRAM
982K
Fit score
85/100 · Moderate
Open in VRAM calculator
BalancedFP16

Qwen3-14B

14B

35.6 of 48 GB74%

~18 tok/s per stream

Details

Where the memory goes

  • Model weights28.00 GB
  • KV cache6.44 GB
  • Activations0.13 GB
  • CUDA & framework1.07 GB
Precision
FP16
Serving preset
8K context × 4 users
Users at this context
11
Spare context in leftover VRAM
71K
Fit score
68/100 · High
Open in VRAM calculator
CompactFP16

Qwen3.5-4B

4B

11.4 of 48 GB24%

~54 tok/s per stream

Details

Where the memory goes

  • Model weights9.20 GB
  • KV cache1.07 GB
  • Activations0.06 GB
  • CUDA & framework1.02 GB
Precision
FP16
Serving preset
8K context × 4 users
Users at this context
140
Spare context in leftover VRAM
1.0M
Fit score
95/100 · Comfortable
Open in VRAM calculator

Estimates, not benchmarks: real usage depends on the runtime, context and batch settings.

Technical Specifications

Memory

48GB GDDR6

FP32 Performance

37.4 TFLOPS

Tensor Performance

150 TFLOPS

Memory Bandwidth

696 GB/s

Architecture

Ampere

TDP

300W

FP64 Performance

0.6 TFLOPS

CUDA Cores

10752

Tensor Cores

336

Ideal Use Cases

AI InferenceProfessional VisualizationRenderingData ScienceVirtual Workstation

About NVIDIA A40

The NVIDIA A40 is a versatile data center GPU for AI inference, visualization, and rendering.

The NVIDIA A40 features 48GB of GDDR6 memory with 696 GB/s bandwidth, making it excellent for ai inference, professional visualization, rendering. With 150 TFLOPS tensor performance and 37.4 TFLOPS FP32 compute, this NVIDIA Ampere GPU delivers exceptional performance for demanding workloads.

Currently, 89 GPU A40 GPUs are available in the GPUniq network with 71.9% utilization. The average rental price is $0.85 per hour, with 25 GPU ready for immediate deployment.

A40 vs similar GPUs — specs & live rental prices

Prices are live minimum / median USD per hour on the GPUniq marketplace, as of 2026-11-04 15:09 UTC.

GPUVRAMArchitectureFP32TensorBandwidthTDPMin $/hrMedian $/hrAvailable
A4048GB GDDR6Ampere37.4 TFLOPS150 TFLOPS696 GB/s300W$0.36$0.9125
A10040–80GB HBM2eAmpere39 TFLOPS624 TFLOPS2.0 TB/s400W$0.60$1.3187
A1024GB GDDR6Ampere31.2 TFLOPS125 TFLOPS600 GB/s150W$0.34$0.352

Frequently Asked Questions

How much does it cost to rent NVIDIA A40?

The current rental price for NVIDIA A40 is $0.85 per hour on GPUniq. Prices may vary based on demand and availability.

What is NVIDIA A40 best used for?

NVIDIA A40 is ideal for AI Inference, Professional Visualization, Rendering, Data Science, Virtual Workstation. With 48GB of GDDR6 memory and 150 TFLOPS tensor performance, it excels at demanding AI and compute workloads.

How many NVIDIA A40 GPUs are available for rent?

Currently, there are 25 GPU available for immediate rental out of 89 GPU total in the GPUniq network. The current utilization is 71.9%.

Which LLMs can run on NVIDIA A40?

On a single NVIDIA A40, our VRAM calculator fits Qwen3.6 35B A3B (INT4 / AWQ, 23.8 of 48 GB); Qwen3-14B (FP16, 35.6 of 48 GB); Qwen3.5-4B (FP16, 11.4 of 48 GB) — estimated at 8K context with 4 concurrent users.

What are the specifications of NVIDIA A40?

NVIDIA A40 features 48GB GDDR6 memory, 37.4 TFLOPS FP32 performance, 150 TFLOPS tensor performance, 696 GB/s memory bandwidth, and 300W TDP. It uses the Ampere architecture.

Related GPUs in Ampere Series

GPU rental guides

NVIDIA official specificationsAPI docsAbout GPUniqContact supportPrivacy policyTerms of use

$0.85/hr

A40 · 25 GPU

Rent now