Tesla M40 Specifications
Maxwell cut FP64 to a thirty-second of FP32 and aimed squarely at neural network training — the first Tesla designed for deep learning rather than HPC.
Buy it for
Cheap 24 GB of contiguous VRAM for experiments where speed does not matter — loading a large model to inspect it, or coursework.
Look elsewhere if
You want to train or serve anything. Maxwell has no tensor cores and no fast FP16, so it runs modern workloads in FP32 at a fraction of the throughput of a current card.
Will it fit your system?
Passively cooled — needs server airflow
This card has no fans. It relies on a chassis forcing air through its heatsink. In a normal desktop it will throttle within minutes and can overheat outright. It needs a rack server with high-static-pressure fans, or an aftermarket shroud and blower.
- Form factor
- PCIe dual-slot
- Cooling
- passive (no fans)
- Power connectors
- 1 × 8-pin EPS (CPU-style — not a PCIe 8-pin)
- Board power
- 250 W
- Suggested PSU
- 650 W or better
- Interface
- PCIe Gen 3
PSU figure assumes one card plus a mainstream CPU and drives, with headroom for transient spikes — modern cards can draw well above their rated TDP for milliseconds, which is what trips an undersized supply.
Supported formats & features
What the Tesla M40 does and does not support in hardware.
Blackwell-generation feature — B200 has it
Predates hardware FP8; use INT8 or BF16 instead — H100 has it
FP16 only, so training recipes may need loss scaling
Not available on this architecture
Not supported
Not supported on this generation
Precision must be managed manually
Multi-GPU traffic goes over PCIe — a real limit for distributed training
Compute-only die — no ray tracing hardware
Corrects single-bit errors — expected for long training runs
What fits in memory
Largest model that fits on one Tesla M40, assuming ~20% of the 24 GB is reserved for KV cache and activations.
| Model |
|---|
| Llama 8B |
| Llama 70B |
| Mixtral 8x22B |
| Llama 405B |
Weights only. Long contexts, large batch sizes and optimiser state during training all need substantially more — full fine-tuning typically needs 3–4× the weight memory.
Cost to run
Electricity for one card at 100% duty, including cooling and PSU overhead (3,066 kWh/year).
Where it sits in the line
A newer part existing does not make this one a bad buy — it makes it cheaper. What matters is price per unit of the throughput you actually need.
Availability & market
Very cheap used and genuinely 24 GB, unlike the K80. Passive: it needs a shrouded server chassis or a 3D-printed fan duct, and it will still be slow.
Discontinued around 2019. Expect secondary-market stock only, with no manufacturer warranty and limited driver support ahead.
Memory
- Capacity
- 24 GB
- Type
- GDDR5
- Bandwidth
- 288 GB/s
- Bus width
- 384-bit
Compute
- FP64
- 0.2 TFLOPS
- FP32
- 6.8 TFLOPS
- TF32 dense
- —
- FP16 dense
- —
- FP16 sparseRequires structured sparsity; rarely reached in practice
- —
- FP8 dense
- —
- INT8 dense
- —
Silicon
- Codename
- GM200
- Process node
- TSMC 28nm
- Transistors
- 8B
- Die size
- 601 mm²
- CUDA cores
- 3,072
- Tensor cores
- —
- SM count
- —
- Boost clock
- 1,114 MHz
Platform & power
- TDP
- 250 W
- Form factor
- PCIe dual-slot
- Cooling
- passive
- Interconnect
- None
- Interconnect speed
- —
- PCIe generation
- Gen 3
- MIG
- No
- Launch
- 2015-11
- MSRP at launch
- —
Tesla M40 — common questions
Answered from the specifications above. Questions this card's data cannot answer with confidence are left out rather than guessed.
- How much VRAM does the Tesla M40 have?
- The Tesla M40 has 24 GB of GDDR5 memory with 288 GB/s of bandwidth. In practice plan on roughly 19 GB for weights: KV cache, activations and fragmentation take the rest, and long contexts or large batches take considerably more.
- What size model can the Tesla M40 run?
- On a single Tesla M40, about 9B parameters at FP16. Anything larger has to be split across several GPUs, which is slow on this card because it has no NVLink. These are weight-only figures — a long context window can consume tens of gigabytes on its own.
- Can you put the Tesla M40 in a desktop PC?
- Only with added cooling. The Tesla M40 is a passively cooled card — it has no fans at all and depends on a rack chassis forcing air through its heatsink. Dropped into an ordinary desktop it will throttle within minutes and can overheat outright. It needs either a rack server with high-static-pressure fans or an aftermarket shroud and blower.
- How much power does the Tesla M40 use?
- The Tesla M40 is rated at 250 W board power. It is fed through 1 × 8-pin EPS (CPU-style — not a PCIe 8-pin). For a single-card system, a 650 W supply or better leaves headroom for the CPU, drives and the transient spikes that trip undersized units.
- How much does it cost to run the Tesla M40?
- At the US commercial average of $0.12/kWh, running one Tesla M40 continuously costs about $368 a year in electricity. That figure includes cooling and power-supply overhead at a factor of 1.4 over board power.
- Does the Tesla M40 support FP8?
- No. The Tesla M40 has no hardware FP8 path. FP8-quantised checkpoints will still load, but the values are upcast before they reach the tensor cores, so you get the memory saving without the speedup.
- Does the Tesla M40 support FP4?
- No. The Tesla M40 predates hardware FP4. You can run 4-bit quantised weights on it and the memory saving is real, but they are dequantised before compute, so there is no arithmetic speedup.
- Does the Tesla M40 support INT8?
- No. The Tesla M40 has no INT8 tensor path, so quantised inference gives you a smaller memory footprint but no arithmetic speedup.
- Does the Tesla M40 support BF16?
- No. The Tesla M40 predates bfloat16 support and can only use FP16 for half-precision work. FP16 training on it usually needs loss scaling to stay numerically stable.
- Does the Tesla M40 have NVLink?
- No. The Tesla M40 has no NVLink. Multi-GPU work goes over PCIe Gen 3, which is an order of magnitude slower and makes tensor parallelism across cards expensive.
- Does the Tesla M40 have RT cores?
- No. The Tesla M40 is a compute-only part with no ray-tracing hardware. For rendering or virtual workstations, look at the L40S or an RTX workstation card instead.
- Does the Tesla M40 have ECC memory?
- Yes. The Tesla M40 has ECC, so single-bit memory errors are corrected rather than silently corrupting a long run.
- What replaced the Tesla M40?
- The Tesla P100 SXM2 (2016) is its successor, with 16 GB of HBM2 at 732 GB/s.. On the used market that gap is what sets a fair price for the Tesla M40.
- Is the Tesla M40 worth buying?
- Buy it for: Cheap 24 GB of contiguous VRAM for experiments where speed does not matter — loading a large model to inspect it, or coursework. Look elsewhere if: You want to train or serve anything. Maxwell has no tensor cores and no fast FP16, so it runs modern workloads in FP32 at a fraction of the throughput of a current card.