September 17th, 2015

U R finish'd...
  • mahnmut

Cylon death menace has everyone worried


"Success in creating AI would be the biggest event in human history. Unfortunately, it might also be the last, unless we learn how to avoid the risks, says a group of leading scientists". (link)

Just a few musings on this rather fascinating issue. First off, I expect AI, once it's launched on its own path, would soon become alien-like to us - so in a sense it'd be "Teh Aliens". If we assume an AI would be much more intelligent than any human, given enough time, and given its tendency to grow and develop exponentially, at some point it'd be able to outsmart any controls on its development that might've been initially put there. That said, as a consequence its interests would also become alien and incomprehensible to humans, and that would render any possible relationship between the two "species" that might've initially existed, impossible to sustain in a way that's meaningful from a human POV.

Collapse )