Consumer cards only have PCIe 4.0, at most 24GB VRAM and the only recent model w... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Tepix on May 31, 2023 \| parent \| context \| favorite \| on: Nvidia DGX GH200: 100 Terabyte GPU Memory System Consumer cards only have PCIe 4.0, at most 24GB VRAM and the only recent model with NVLink, the RTX 3090, can only be connected to exactly one other card. It doesn't scale beyond that. So you are limited to PCIe 4.0 x16 speeds.

SirFlamenco on June 3, 2023 [–]

Technically the A6000 has 48 Gb of VRAM and works in 2-way NVLink.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact