In the "delete page" flow we could suggest that the user merges into another page, to create a redirect. Merge pages Alternative titles
There could also be a "delete and redirect" flow which only redirects the title, without appending the content, which is what "merge" functionality will do.
Perhaps in the delete flow it could say "this page links to 5 other pages, want to redirect to another page?" this can reduce Link rot