SWIM doesn't think there's anything wrong with your fumarates, but when he dries his, he does it in the oven and gets hard rocks, powder and a minor stickiness (like sugar or ascorbic acid, probably due to excess fumaric acid). A water wash as suggested by bufoman:
https://wiki.dmt-nexus.me/FASA_Alteration_of_Final_Purification should get your crystals plenty pure. SWIM doesn't know for sure whether an acetone wash beforehand is at all necessary, but he happened to have done that prior to using the method above, successfully.... SWIM would guess that's it's entirely unnecessary, though.