Presumably if AlphaZero did not become superhuman by "hacking" it is because the hacks aren't there. But in the real world case, the hacks are there - life itself is built out of nanotech, the quintessential supposedly physics violating technology. Knowing that, why would a paperclip maximizer forgo its use, and stick to ordinary factories?
Presumably if AlphaZero did not become superhuman by "hacking" it is because the hacks aren't there. But in the real world case, the hacks are there - life itself is built out of nanotech, the quintessential supposedly physics violating technology. Knowing that, why would a paperclip maximizer forgo its use, and stick to ordinary factories?