Fix autosave recovery dialog crash

Given that we want to access the dialog after it has been executed and
closed, don't delete when closing, but do it manually at the right time.