Is it possible to add some sort of way of knowing which posts were affected by the user's removal?
I've described a procedure for this on Meta Stack Exchange. It uses the Stack Exchange API but does not require programming.
Go to this page
Change the site with the  link (default is Stack Overflow)
Click the 'Get Token' button so that the API knows it'...