Aha.
The bearings (92116) in the swing arm are two-part tapered roller bearings. There's a race which is pressed into the swing arm and probably has stayed in there. If the race is coming out easily, you have a problem.
Then there's the part with the rollers, which should easily come out and go back in, to contact the race.
Once it's in place, it's held by the preload when you torque the RHS swingarm shaft.
Plenty of snow here in Ottawa, too. Managed to get final season rides in on Dec. 24, 25 and 26. Now working on projects like you to get through the winter. Carbon fender extender and rearset plates on the SV650S, other stuff for the Concours.