TOPS - Trillions of Operations Per Second, used as a benchmark to figure out the... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		capableweb on Jan 10, 2023 \| parent \| context \| favorite \| on: AMD Alveo V70 AI inference accelerator card TOPS - Trillions of Operations Per Second, used as a benchmark to figure out the performance of the accelerator. In my experience, mostly a marketing number, higher TOPS doesn't actually mean it'll be faster than something with a lower TOPS. As always, you need to do your own benchmarks with your use case in mind.

novaRom on Jan 10, 2023 [–]

What kind of operations is not clear. Wether it's a simple logic operation or a FMA is big difference.

calaphos on Jan 10, 2023 | [–]

I assume it's int8 operations (FMA would count as 2). At least that's the case with FLOPs, TOPs for AI accelerators is basically the same measure, with the changed acronym reflecting the non float data format.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact