Orthogonality Thesis

A system’s level of intelligence is independent of its goals.

• Intelligence and final goals are orthogonal
• Then, it is possible for AI’s to not have specific goals Smarter systems are better optimizers, not better value learners