I’ve actually figured out that it’s caused by having the in game vsync turned on. When disabled it’s fine, but I’m not sure why it’s causing an issue as I’m also using freesync.

Do you also have the issue with D4 where the in game menus are laggy when opened? For me the GPU hits 100% usage and the fps drops. Once I close the menus/inventory it’s fine.