Replaceing Ignition Switch, 2008 ProStar...

[Waterloo]

My ignition switch is going bad, so I got me a new one... I pulled off the front dash panel and had a quick look. There is a metal plate that the switch mounts in to... This metal plate is pop riveted into the dash structure, and from what I could feel in the dash, there is not much room back there to pull the old switch out from behind. Any of you guys ever replace this switch, and what was your method of attack? Drill out the pop rivets and rivet the plate back into place, or will the switch slide out from the back after loosening the collar nut?