James, I have three routers, with the plates screwed down (but with grub screws for leveling - needs a bit of give and take between the grub screws and the retaining screws when leveling). It is not that big a deal to change bits in the table - two of my routers have a shaft lock, the other needs two wrenches.
Especially with your router lift, remove the insert ring, raise the router so you can get to the collet, and you are good to go. Worst case, you might need one of those goose-necked collet wrenches. You will be re-setting the bit height anyway, unless you are using matched bits (like Desert Rat Tom recommends).
I bow to the greater experience of almost everybody here on the forum over my own, but I had a 3 1/4 hp router with a panel-raising bit strike a hard hidden knot, and dislodge the plate from the table-top, bending a substantial aluminium angle fence in the process. Since then, I have screwed the plates down.
The only real downside is if you decide to enclose the router for dust-catching purposes - there has been much debate on the merits thereof in the Forum. I am still a fence-sitter (pun unintentional).