I'm not sure how you regulate chatbots to NOT encourage this kind of behavior, it's not like the principle labs aren't trying to prevent this - see the unpopular reigning in of GPT-4o.
They are absolutely not trying to prevent this. They made 5 more sycophantic because of user backlash. It became less useful for certain tasks because they needed to keep their stranglehold on the crazy user base who they hope to milk as whales later.
I'm not sure how you regulate chatbots to NOT encourage this kind of behavior, it's not like the principle labs aren't trying to prevent this - see the unpopular reigning in of GPT-4o.