That would be beautiful, and hopefully realizable with a browser extension, which would get glommed into the browser core (a la Brave and Firefox) once the technology is proven.

But how do you solve NAT? Most end-user devices can't expose ports, and IPs are increasingly shared. Skype was uniquely successful there, but I doubt IPFS in its current form could make use of those tricks.