Electrical Buzzing from new GPU

I just got a new XFX RX 470 and it runs great other than an annoying electrical buzzing that sounds when my system is under load. As soon as I Alt + Tab out of a demanding application the noise stops. Is it possible that my 400 watt EVGA PSU is causing the GPU to sound off this way? Or did I get a defected graphics card?
 
Back