Huge FPS drops when using an Xbox One Bluetooth controller

Every so often my FPS will just die. In-game stats say it goes from 120fps to 3. Turning off the controller causes the FPS to shoot back to normal.

Anyone else having this problem? Any known fixes?

Found a temporary solution: Replace the dang batteries!

This only seems to happen when the controller’s battery is low/critical. No idea why low batteries causes the game itself to spasm out of control, but this workaround helps.