What were you doing to remove the bearing? Pliers? Why did you need to remove the bearing?
I really recommend a bearing puller. The YYF multi-tool one is fine for most bearings, but when they are really stuck, there are better bearing pullers, such as:
Also, I’m hearing too many stores of the bearings being way too tight to the seat. Tolerances and performance claims aside, I don’t see the need for that kind of tightness. I have some yoyos that are smooth as glass, yet take them apart and the bearing falls out. Pop a bearing back in, screw back together, same “smooth as glass” play and performance.