USB ground lift

A better way to do that would be to have an isolated supply for the usb device, and introduce it into the usb cable. I have done that on a usb input to a DAC, and it was a huge upgrade from the computer supplied 5V.

I would not remove a ground and leave the power.
 
Yep, what he said ^, I should also mention that it really didn’t take a whole lot to vastly improve my setup vs using the computer usb power.
The 5V supply I’m using is just a simple second hand wall-wart, using a small transformer, rectifying diodes (w/snubber added), filter cap, regulator, capacitor.
Nothing fancy or close to being expensive.