Borderlands 2 online connection issues xbox one

No matter what we do I cannot connect online to anyone while using the xbox one online.

Me and a buddy just bought the handsome edition to play and neither of us can join each other or any games with a new fresh clean install. every other portion of XBL works and we are in a party while this is occurring. Is there any fix for this? a few VERY rare times it said he was added to my game but on his screen it timed out after 30 seconds. in most cases we were notified that there was not enough room in the gameā€¦ OR that we had a network problema nd to check our cables.