NVIDIA L40S

NVIDIA48GB GDDR6PCIe Gen4Ada Lovelace

Data updated 2026-11-04 15:09 UTC · refreshed every 5 min

Current Price

$1.21/hr

From $0.81/hr · lowest live offer

28 GPU · Good availability

Current Price

$1.21

+0.0% (24h)

Available Now

28 GPU

Good availability

Total in Network

172 GPU

Live data

Utilization

83.7%

High

Market history

Price Tracking

USD/hour (minimum · median)

Available GPUs

Ready to rent

Total in Network

Infrastructure Growth

Which LLMs run on one NVIDIA L40S

Open VRAM calculator with L40S

Estimated with our VRAM calculator for a single card: 8K context, 4 concurrent users, vLLM-style serving.

Largest that fitsINT4 / AWQ

Qwen3.6 35B A3B

35B MoE · 3B active

23.8 of 48 GB49%

~77 tok/s per stream

Details

Where the memory goes

  • Model weights21.88 GB
  • KV cache0.67 GB
  • Activations0.01 GB
  • CUDA & framework1.19 GB
Precision
INT4 / AWQ
Serving preset
8K context × 4 users
Users at this context
148
Spare context in leftover VRAM
982K
Fit score
85/100 · Moderate
Open in VRAM calculator
BalancedFP16

Qwen3-14B

14B

35.6 of 48 GB74%

~22 tok/s per stream

Details

Where the memory goes

  • Model weights28.00 GB
  • KV cache6.44 GB
  • Activations0.13 GB
  • CUDA & framework1.07 GB
Precision
FP16
Serving preset
8K context × 4 users
Users at this context
11
Spare context in leftover VRAM
71K
Fit score
68/100 · High
Open in VRAM calculator
CompactFP16

Qwen3.5-4B

4B

11.4 of 48 GB24%

~64 tok/s per stream

Details

Where the memory goes

  • Model weights9.20 GB
  • KV cache1.07 GB
  • Activations0.06 GB
  • CUDA & framework1.02 GB
Precision
FP16
Serving preset
8K context × 4 users
Users at this context
140
Spare context in leftover VRAM
1.0M
Fit score
95/100 · Comfortable
Open in VRAM calculator

Estimates, not benchmarks: real usage depends on the runtime, context and batch settings.

Technical Specifications

Memory

48GB GDDR6

FP32 Performance

91.6 TFLOPS

Tensor Performance

733 TFLOPS

Memory Bandwidth

864 GB/s

Architecture

Ada Lovelace

TDP

350W

FP64 Performance

1.5 TFLOPS

CUDA Cores

18176

Tensor Cores

568

Ideal Use Cases

AI InferenceVideo ProcessingGraphics RenderingGenerative AILLM Inference

About NVIDIA L40S

The NVIDIA L40S combines AI acceleration with professional graphics capabilities for diverse workloads.

The NVIDIA L40S features 48GB of GDDR6 memory with 864 GB/s bandwidth, making it excellent for ai inference, video processing, graphics rendering. With 733 TFLOPS tensor performance and 91.6 TFLOPS FP32 compute, this NVIDIA Ada Lovelace GPU delivers exceptional performance for demanding workloads.

Currently, 172 GPU L40S GPUs are available in the GPUniq network with 83.7% utilization. The average rental price is $1.21 per hour, with 28 GPU ready for immediate deployment.

L40S vs similar GPUs — specs & live rental prices

Prices are live minimum / median USD per hour on the GPUniq marketplace, as of 2026-11-04 15:09 UTC.

GPUVRAMArchitectureFP32TensorBandwidthTDPMin $/hrMedian $/hrAvailable
L40S48GB GDDR6Ada Lovelace91.6 TFLOPS733 TFLOPS864 GB/s350W$0.91$1.2138
L4048GB GDDR6Ada Lovelace90.5 TFLOPS724 TFLOPS864 GB/s300W$0.77$1.1917
L424GB GDDR6Ada Lovelace30.3 TFLOPS242 TFLOPS300 GB/s72W$0.75$1.0121

Frequently Asked Questions

How much does it cost to rent NVIDIA L40S?

The current rental price for NVIDIA L40S is $1.21 per hour on GPUniq. Prices may vary based on demand and availability.

What is NVIDIA L40S best used for?

NVIDIA L40S is ideal for AI Inference, Video Processing, Graphics Rendering, Generative AI, LLM Inference. With 48GB of GDDR6 memory and 733 TFLOPS tensor performance, it excels at demanding AI and compute workloads.

How many NVIDIA L40S GPUs are available for rent?

Currently, there are 28 GPU available for immediate rental out of 172 GPU total in the GPUniq network. The current utilization is 83.7%.

Which LLMs can run on NVIDIA L40S?

On a single NVIDIA L40S, our VRAM calculator fits Qwen3.6 35B A3B (INT4 / AWQ, 23.8 of 48 GB); Qwen3-14B (FP16, 35.6 of 48 GB); Qwen3.5-4B (FP16, 11.4 of 48 GB) — estimated at 8K context with 4 concurrent users.

What are the specifications of NVIDIA L40S?

NVIDIA L40S features 48GB GDDR6 memory, 91.6 TFLOPS FP32 performance, 733 TFLOPS tensor performance, 864 GB/s memory bandwidth, and 350W TDP. It uses the Ada Lovelace architecture.

Related GPUs in Ada Lovelace Series

GPU rental guides

NVIDIA official specificationsAPI docsAbout GPUniqContact supportPrivacy policyTerms of use

$1.21/hr

L40S · 28 GPU

Rent now