Iron and fiber are durable and last for decades. Data centers (where the current flows for inference) consist of hardware that becomes obsolete within 5 to 10 years.

The question is can improvements in the hardware both in cost and performance outpace the increased demands on the LLMs and their future derivatives.