It sounds to me like your guide bushing might not be centered well enough. Also, from what I have seen of inlay work done with those bushings, I'm not very impressed with the fit I see in the photos. None of the ones I've seen thus far look like a tight fit, even in the ads for the guide bushing sets to make them with. I have no personal experience with them, so maybe some more experienced folks will be of more help.
Mike, an American living in Norway
Theory is when one knows everything, but nothing comes out right.
Experience is when everything comes out right, but no one knows why
In my shop theory and practice are united. Nothing comes out right and nobody knows why.