1 year of data is indeed too little if you are trying to forecast one year ahead. Also the pricing is set by OpenAI. We don't know their actual costs decreased by that factor. Only that they cut their prices.
The retail price, or the actual cost to deliver? Those are not the same thing. Cost to deliver could actually mean something. Retail pricing is approximately meaningless.
In context, retail pricing is very meaningful. The next sentence is "lower prices lead to much more use". That is, price elasticity of demand is large, and here price is retail price.
Cost and price are two different things. Sam said cost, but really he meant price, because even by his own admission, ChatGPT's services are running at a loss
I know this is subjective but he is comparing GPT-4 to 4o. The new model definitely felt lighter and faster, so probably cheaper for them to maintain, but at the same time very often gave worse answers than GPT-4.
