So what is the sample size at which this can be useful. A notes vault doesn't seem large enough.

Obsidian/Logseq are already great for thinking by way of their "show a random note" feature. Usually pulling up unfinished thoughts from past days will give me an idea for extending it.