Yes you can. What you want to do is to have your bearing totally clean, DRY and free of lube and debris.
After that, you can keep your bearing lube free or use a super tiny amount of thin lube (take some lube with a needle and apply whatever comes out of it) to protect your bearing a little bit more from rusting conditions.
Always be careful handling solvents. Fumes are not the best for your lungs!