No one assumes that AI systems won't be improved upon. What people don't assume is that progress will be infinite in every domain cheaply forever.