Why would you compare the limits on intelligence of an AI to the abilities of just one human?
Why not compare it to 1000 people, all communicating and problem solving together?
We know that this is possible because it happens all the time, and enables such groups to make lots of money in digital markets, and invest it in things like marketing, robotics, and policy.
The intelligence of an AI is lower bounded by that of the most intelligent possible corporation.
Potential corollary: Assuming one can make a human level AI, then if it is not sufficiently resource constrained (hard?) or somehow encoded with "human values" (very very hard), then it will be at least as dangerous as the most sociopathic human corporation.
Why not compare it to 1000 people, all communicating and problem solving together?
We know that this is possible because it happens all the time, and enables such groups to make lots of money in digital markets, and invest it in things like marketing, robotics, and policy.
The intelligence of an AI is lower bounded by that of the most intelligent possible corporation.
Potential corollary: Assuming one can make a human level AI, then if it is not sufficiently resource constrained (hard?) or somehow encoded with "human values" (very very hard), then it will be at least as dangerous as the most sociopathic human corporation.