Christine Peterson is Vice President of Foresight Nanotech Institute and she talked about how we can prepare for the advent of AGI (what she called “preparing for bizarreness”), with a focus on upcoming risks.

According to Peterson, risks, and their potential solutions, can be approached in a top-down monolithic way, or a bottom-up way, in which solutions are decentralized, voluntary, experimental, collaborative, open, and transparent.

Peterson suggested automated or semiautomated systems designed to protect us without threatening us at the same time are an appropriate long-term security goal. Perhaps the group best qualified to debate these concerns are the open source programming community.