NO, don't glue it. These are made purposely. Just realign it, use a block wood on the table, bring down the arbor, (just like you're drilling). This will press the chuck back into place. Make sure there's no burs, if needed, clean the chuck before pressing back into place.
It's difficult to find them but, they are out there on the market... there are drill bits specifically designed to just fit into the very space that your chuck does. They are only pressed into place. It's why, you have that little wedge type tool.
***Please fill in your profile, at least your location. As this will help us help you better.***
"Whether active duty, retired, national guard or reserve - is someone who, at one point in their life, wrote a blank check made payable to "The United States of America", for an amount of "up to and including my life". That is HONOR, and there are way too many people in this country who no longer understand it." -Author Unknown