Welcome to the Router Forums. Please fill out your profile, it helps when answering questions for us to know what tools you have available and also where you are located dictates where we might point you if you need parts, tools or other supplies for projects.
Sounds like you are not tightening the retainer ring for the bushing enough. I always use a wrench to tighten the ring then center the base of the router using the bushing to bit offset.
Your BRAIN Is The Most Important Power Tool In Your Shop. Turn It On Before You Turn On Any Other Power Tool.
A Disability Is Only A Disability If You Let It Be One