Why TF are mayhem mods changing when someone joins party?

Makes no sense to me why the Mayhem Modifiers are changing just because someone joins a game! Kinda defeats the purpose of not having to change your modifiers when that happens everytime!