Agreed. In parallel to this thought is that we need to ask, "What are people for?" If we don't do some serious evaluation of what we want to emerge from humanity (besides more pampered greedy humans), we will have no control of what will emerge from AGI. The Invisible Hand Job has been a disaster for the planet, and allowing blind technology advancement at this level without knowing which reinforcements (emotions) to combine and moderate is folly. Not because some SkyNet will choose to destroy humanity, but because some rich drunk will tell it to, and if its people-pleasing emotion is dominant...