I do consider the ammo sharing for sure. My AR9/Glock, .22lr SAAs/Henry lever action and the several .38/357 revolvers and the lever action. If only there were practical 12 gauge pistols then I would have perfect matches all around outside of the rifle calibers I have.. although there is a .30 carbine SAA so maybe I should put that on my Christmas list.44 is stupid soft shooting out of a long gun. Not a whole lot of trigger time on the revolvers, but anything carryable is gonna be a handful.
It really comes down to how absolutely married you are to primary/secondary ammo sharing. I only went 45LC because I wanted to be a walkin talkin rootin tootin cowboy shootin meme human. Outside of that, I think it's mostly dumb to obsess over. Get a rifle in a rifle caliber, if you're gonna carry one around, not a jumped up pistol cartridge that drops like a rock.
Although, within Indiana's public land restrictions, .44 mag would be my long gun choice for deer.