MEPX
Chapter 8 of 10All chapters
  1. 1Two conversations
  2. 2Bias and fairness
  3. 3Transparency and explanation
  4. 4Accountability
  5. 5Harms happening now
  6. 6The alignment problem
  7. 7Misuse
  8. 8Long-term risk
  9. 9Regulation
  10. 10Working responsibly

Chapter 8 of 10

Long-term risk

The honest state of the argument.

The concern

Some researchers argue that systems substantially more capable than people would be difficult to control or correct, and that the time to prepare is before rather than after.

  • Others consider current systems far from that and the concern speculative.
  • Both camps include people with strong technical records.

What follows either way

Evaluation before deployment, incident reporting, staged release and independent scrutiny are supported across most of the disagreement, because they help with present harms too.