Crossplay Steam Epic lags

Me and a friend tried to play Broderlands 3 via the Online Mode. He uses the Steam version and i use the EpicGamesStore version. We can join each others lobbys and play, but there are constant lags for the one who doesnt host the lobby. When i played with a friend who bought the game on the EpicGamesStore, there were no such lags. Is there any solution to this?