If you have any silicone in the side that continues to fall out now, remove it.
Once any silicone response is removed, take a good look in there to see if there is any debris stuck in the recess. Remove any obvious debris and grab the following supplies:
A cotton swab (q-tip)
Any very mild solvent such as dish or hand soap
Toothpick or other disposable and slender shaft
When you have these items, wet one end of the cotton swap, and apply some of the solvent. Force the damp cotton swab into the recess and rub it around for a few rotations. Next, do the same with the dry half. If the cotton swab brings up any dirt, repeat this process with a new one until the cotton swab is completely clean after rubbing the inside of the recess.
After you are sure that the recess is completely clean, apply some silicone to the inside of the recess using the toothpick and let it dry for a few hours. Using a clean toothpick, poke at the silicone that was applied gently to see if it comes off (this is to check and see if the silicone will stick to the celcon in the recess).
If the silicone isn’t coming off with just a gentle scrape, this means that the silicone is sticking to the celcon and you can finish the silicone job; Hurray!
If it does come off, then let it sit for 12 hours and try again. If the silicone is still super easy to remove, then I am out of advice.