I agree with a lot of the above comments. I have done plane totes in walnut before. I found that if I start the route in the long grain ,then go around the corner into the end grain then come out of the cut in the long grain,if possible.
When I start the cut, I don't start right on a corner but enough in so the bit will not grab the end grain at the corner. On the radius I take a very shallow cut all the way around on the first cut, then raise the bit 1/16" for the next cut,and so on 1/16' til I have it making the full cut. Sometimes I start with a smaller radius bit and after the whole thing is rounded to depth,go to a larger radius bit, when cutting the radius, Or do the flush cutting with the panel bit and then I set up a couple of trim routers with the radius bits and do the round over on the bench, depends on what I am working on.
Like Semipro ,John says above on the pattern bit, use a bearing that only cuts a small amount and change bearings to a smaller bearing to deepen the cut the next time around. But precutting as mentioned above as close as possible will improve the router experience.