My fallout 4 on Xbox one has issues with the mods being deleted and not being able to re-download. I tried turning off and turning on the network and hard resetting. I also uninstalled and reinstalled to no avail. Now my game won't load due to the mods.
When you uninstalled, did you delete your game saves? Parts saved with mods may no longer be compatible with the game as it is without mods. I don't know a lot about fallout, or xbox, but that's what strikes me as a possibility as you describe it.