Heres one for you. A benevolent and all knowing AGI runs a tamper proof social credit system that penalises things that are "bad" in the eyes of a strict majority and rewards things that are "good", reducing the rights of people with poor scores to limit potential harm they can do and giving people with good scores more leeway.
What are the ethical considerations here? Is it just a perfect democracy + judicial system? Does it impact growth as a society? Im remembering the quote "All progress depends on the unreasonable man". Would it be a very conservative society that resulted?
PS should go without saying, but this is just thought exercise, obviously..
This just sounds like a (fairly unexceptional) tyranny of the majority. Our society may already be heading in this direction, albeit in a softer sense, with the rise of filter bubbles and highly polarized outrage culture
A perfect democracy includes the right to vote to allow people to do things that you think are bad though, and to vote to change the rules of the system together (such as to vote in a system where crimes/punishments must be defined beforehand, like they currently must be in the real world america).
"Republics decline into democracies and democracies degenerate into despotisms."
My expectation for such a system is that a majority group who have a specific lifestyle would penalize anyone who does not strictly adhere to that specific lifestyle. The group would change over time (likely liberal, then conservative, then back again) and each group would become more and more dogmatic about those views. Eventually the group will resemble something like the Nazis or the Soviets and violent revolution or war would end the experiment.
Source: the past two thousand years of human civilization
What are the ethical considerations here? Is it just a perfect democracy + judicial system? Does it impact growth as a society? Im remembering the quote "All progress depends on the unreasonable man". Would it be a very conservative society that resulted?
PS should go without saying, but this is just thought exercise, obviously..