NVIDIA L4

NVIDIA24GB GDDR6PCIe Gen4Ada Lovelace

Data updated 2026-11-04 21:40 UTC · refreshed every 5 min

Current Price

$1.01/hr

From $0.75/hr · lowest live offer

23 GPU · Good availability

Current Price

$1.01

+15.2% (24h)

Available Now

23 GPU

Good availability

Total in Network

66 GPU

Live data

Utilization

65.2%

Stable

Market history

Price Tracking

USD/hour (minimum · median)

Available GPUs

Ready to rent

Total in Network

Infrastructure Growth

Which LLMs run on one NVIDIA L4

Open VRAM calculator with L4

Estimated with our VRAM calculator for a single card: 8K context, 4 concurrent users, vLLM-style serving.

Largest that fitsINT4 / AWQ

GPT-OSS 20B

21B MoE · 3.6B active

14.2 of 24 GB59%

~28 tok/s per stream

Details

Where the memory goes

  • Model weights12.24 GB
  • KV cache0.82 GB
  • Activations0.02 GB
  • CUDA & framework1.12 GB
Precision
INT4 / AWQ
Serving preset
8K context × 4 users
Users at this context
51
Spare context in leftover VRAM
329K
Fit score
79/100 · Moderate
Open in VRAM calculator
BalancedFP8

Qwen3.5-9B

9B

14.9 of 24 GB62%

~19 tok/s per stream

Details

Where the memory goes

  • Model weights12.69 GB
  • KV cache1.07 GB
  • Activations0.05 GB
  • CUDA & framework1.05 GB
Precision
FP8
Serving preset
8K context × 4 users
Users at this context
38
Spare context in leftover VRAM
239K
Fit score
77/100 · Moderate
Open in VRAM calculator
CompactFP16

Qwen3.5-4B

4B

11.4 of 24 GB47%

~26 tok/s per stream

Details

Where the memory goes

  • Model weights9.20 GB
  • KV cache1.07 GB
  • Activations0.06 GB
  • CUDA & framework1.02 GB
Precision
FP16
Serving preset
8K context × 4 users
Users at this context
51
Spare context in leftover VRAM
345K
Fit score
86/100 · Moderate
Open in VRAM calculator

Estimates, not benchmarks: real usage depends on the runtime, context and batch settings.

Technical Specifications

Memory

24GB GDDR6

FP32 Performance

30.3 TFLOPS

Tensor Performance

242 TFLOPS

Memory Bandwidth

300 GB/s

Architecture

Ada Lovelace

TDP

72W

FP64 Performance

0.3 TFLOPS

CUDA Cores

7424

Tensor Cores

232

Ideal Use Cases

AI InferenceVideo TranscodingEdge AILLM Serving

About NVIDIA L4

The NVIDIA L4 is an ultra-efficient inference accelerator built on Ada Lovelace, ideal for serving LLMs.

The NVIDIA L4 features 24GB of GDDR6 memory with 300 GB/s bandwidth, making it excellent for ai inference, video transcoding, edge ai. With 242 TFLOPS tensor performance and 30.3 TFLOPS FP32 compute, this NVIDIA Ada Lovelace GPU delivers exceptional performance for demanding workloads.

Currently, 66 GPU L4 GPUs are available in the GPUniq network with 65.2% utilization. The average rental price is $1.01 per hour, with 23 GPU ready for immediate deployment.

L4 vs similar GPUs — specs & live rental prices

Prices are live minimum / median USD per hour on the GPUniq marketplace, as of 2026-11-04 21:40 UTC.

GPUVRAMArchitectureFP32TensorBandwidthTDPMin $/hrMedian $/hrAvailable
L424GB GDDR6Ada Lovelace30.3 TFLOPS242 TFLOPS300 GB/s72W$0.75$1.0122
L40S48GB GDDR6Ada Lovelace91.6 TFLOPS733 TFLOPS864 GB/s350W$0.72$1.1131
L4048GB GDDR6Ada Lovelace90.5 TFLOPS724 TFLOPS864 GB/s300W$0.77$1.1916

Frequently Asked Questions

How much does it cost to rent NVIDIA L4?

The current rental price for NVIDIA L4 is $1.01 per hour on GPUniq. Prices may vary based on demand and availability.

What is NVIDIA L4 best used for?

NVIDIA L4 is ideal for AI Inference, Video Transcoding, Edge AI, LLM Serving. With 24GB of GDDR6 memory and 242 TFLOPS tensor performance, it excels at demanding AI and compute workloads.

How many NVIDIA L4 GPUs are available for rent?

Currently, there are 23 GPU available for immediate rental out of 66 GPU total in the GPUniq network. The current utilization is 65.2%.

Which LLMs can run on NVIDIA L4?

On a single NVIDIA L4, our VRAM calculator fits GPT-OSS 20B (INT4 / AWQ, 14.2 of 24 GB); Qwen3.5-9B (FP8, 14.9 of 24 GB); Qwen3.5-4B (FP16, 11.4 of 24 GB) — estimated at 8K context with 4 concurrent users.

What are the specifications of NVIDIA L4?

NVIDIA L4 features 24GB GDDR6 memory, 30.3 TFLOPS FP32 performance, 242 TFLOPS tensor performance, 300 GB/s memory bandwidth, and 72W TDP. It uses the Ada Lovelace architecture.

Related GPUs in Ada Lovelace Series

GPU rental guides

NVIDIA official specificationsAPI docsAbout GPUniqContact supportPrivacy policyTerms of use

$1.01/hr

L4 · 23 GPU

Rent now