I too was afraid to remove any of those trim pieces on my wife's new 2010 Traverse when I wanted to do the by-pass for the factory nav and had to splice into a wire at the back of the radio. Well, since it wasn't my car

I went ahead and did it! I was surprised at how easily the piece did pull off, and didn't break anything at all!
The only screw up I almost had was when I put it back together. I didn't realize at first that on the left side piece, there was a tab on the removed trim piece which had to go under the piece still in place before setting the snaps back in. I don't recall if the same is true on the right hand piece. I would go look right now, except my wife has locked her car and hidden the cars from me!

hno:
I would remove that side and see if I could get it to fit properly. There might be a little bit of play in the clips on the back of the trim piece to adjust the fit. I really think this is something you can adjust yourself. Good luck.
As for the nav by-pass, it works great! I installed the switch under the driver's side dash out of sight but easy enough to reach and flip when needed.