When I was doing AI lyrics, I just ensured that the same seed generates the same text. So server just pregenerated several thousand texts into a queue, which you drain from instantly upon a click to get random.
The generated texts are then cached, and if not visited for a while - expire. But thanks to the ability to regenerate the same text from seed are still accessible from URL.
The generated texts are then cached, and if not visited for a while - expire. But thanks to the ability to regenerate the same text from seed are still accessible from URL.
https://github.com/losttech/BillionSongs