Unless this singularity is able to construct for itself sensors and actuators that can refine existing knowledge and acquire new knowledge, it will forever be hamstrung by the incomplete and static knowledge of the universe that was used to train the initial model. This is where regulation is desperately needed. We must be very careful with the kinds of sensors and actuators that are integrated with these systems. Perhaps none should be allowed.
Well, if the terminal has internet access, it can download whatever new data has been created and train a new model on that. In theory, it could also hack into a 3D printing workshop, or get some funds (eg steal credit card data, or perhaps even legally) and just issue regular orders. This is clearly very speculative thinking, but I think we are making a similar point actually.
