I never said I thought increase in ability was linear either. We're encroaching on phenomena that's genuinely hard to describe/put a number on but GPT-3 is worlds apart of 2 and it feels like 4 is easily ten times better than the OG 3.
I can say Improvement lags behind compute somewhat but that’s really it.
That said, it's ultimately up to the people footing the bill isn't it ?
That said, it's ultimately up to the people footing the bill isn't it ?