The AI boom happening right now comes with a lot of responsibility. It is highly recommended that the AI systems are continuously evaluated. To make sure they are grounded in truth as much as possible, that they do not deviate from the main goal, and prevent activation of unwelcome emergent features like “self-awareness hiccup”.
How many accidents had happened before people were able to control the fire for their needs.
When compared to the fire discovery, we want to minimize the number and the scale of possible AI accidents.
An AI system released without evaluation and security is almost like having a BBQ in a dry forest. A sudden wind blow can carry many embers right in the trees igniting everything around. Now, what if it’s thousands of active BBQs in the same area?
Let’s be wise and careful, not become monkeys with guns.
Cheers!