A small flathead screwdriver is the key to removing the spacers. A little patience and a lot of gentle prying will get the job done. Then you can just clean the bearing as usual.
I don’t remember where I got this one, but it works well.
Edit: It took me like 5 minutes to get that spacer off and the only reason I put it on was to take a picture for this response! 