What Is So Worrying About Recursive Self-Improvement?
Recursive self-improvement, or RSI, sounds like science fiction. RSI is when AI improves itself, then the improved AI improves itself again, and the loop speeds up. But it is not science fiction; it is here and beginning to reshape what AI is and how quickly it develops. In this post, I will spell out what it is and why so many experts want to treat it with caution.