Personally, I can see several significant downsides (being manipulated by targeted propaganda, punished for socially unpopular behavior, taken advantage of, etc.) and virtually no meaningful upsides.
Personally I think the main issue sociologically is that the implementations are "half-mirror" society instead of fully transparent. The half mirror is inherently abusable.
Imagine a sci-fi world where anyone can view anywhere in the past at any time and any depth. It would be disconcerting but it would put people on equal footings and prevent many forms of deception and abuse as well as making criminal trials binary but fair. Corruption would be harder to get away with when every backroom meeting could be audited and verified by everyone. It would force some very uncomfortable questions about social norms and laws as a society in withdrawl from expected hypocrisy.
Compare that to one with it just in the hands of authorities to abuse.
Obviously not the same but the analogy should be clear how even if both are disliked they are quite different and one is worse.
