Can you run LLAMA on Google's TPUs? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ArtTimeInvestor 11 months ago \| parent \| context \| favorite \| on: Nvidia Shares Resume Fall Can you run LLAMA on Google's TPUs?

xnx 11 months ago [–]

Yes. You can serve Llama on TPU: https://cloud.google.com/vertex-ai/docs/predictions/serve-ll...

You can also train Llama on TPU: https://cloud.google.com/tpu/docs/v5p-training

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact