Yes, dissolving in IPA and letting it evaporate will definitely give it more time to evaporate you`re right.
I´m just being exageratingly careful and doing the most steps to make sure to remove as much as possible but its probably not necessary.
When you redissolve in vinegar and filter it, any bit of xylene will be floating on top of the vinegar. When you filter that, some of the xylene gets trapped in the filter, so it helps removing it more. When you reduce the vinegar you can use a bit of heat, which makes any left over xylene even more probably evaporate away. Then when you pull the basified vinegar with your IPA and you evaporate that, again, more time for the xylene to evaporate.
So you don´t have to do all of that, you can probably just do the IPA thing and smell to see if there´s any xylene left, but if you want to be anal about the whole thing like I sometiems am, you can go that whole way
Whatever you choose, im sure will be good. Be well!