A book about the risks of AI that is Grown Rather Than Crafted. By Eliezer Yudkowsky and Nate Soares

Notes

  • Predicting AI destruction is an easy call
  • Modern AI defects you see now are the worst AI is going to get
  • AI improvement can taper out, but that doesn’t mean the end point will keep us safe. A supernova still becomes hot enough to vaporize planets nearby
  • We protect other harmful species like chimpanzees that kill people because we have power, we have guns, we can defend ourselves and are powerful
  • If you want to know if your baby will grow up kind, you have to DNA Sequencing

Concepts