Really bad lag when browsing the inventory

Anytime I open the inventory for the first time in a while, especially after having looted a lot of new guns, the inventory will lag REALLLLY bad making it almost unusable for a few seconds.

Anybody else got that issue and found a fix?