> Then I asked it for some problems for the students to solve and it wrote those too.

And your students will use it to solve the problems! In the end no one will learn anything and nothing of value was created. Rinse and repeat.

I guess this is my concern - if everyone starts using LLMs for stuff like this, then what's the point of anything?