Stop using your computer and turn it off. There is definitely a hardware fault in your computer.
If these are USBv2 ports, then it definitely sounds like 12 or more volts is being sent through the USB power lines. This is what is frying your devices. It could be a short somewhere in the motherboard, the internal USB hub, or in the USB controller itself.
If it's USBv3... Well, J'ain't heard of a USBv3 controller sending more power to something that has not negotiated for more. Cependant, it's still probably a short.
First thing to do is contact the manufacturer and talk to their support. If it's under warranty, get the motherboard replaced.
If it is not under warranty, vous pouvez take it to a reputable computer repair shop. Depending on the issue, they might be able to repair it, but this is not likely. They will probably recommend a new motherboard or the advice in the following paragraph.
Another possibility is if it's just the USB bus that's the issue, stop using it and get a PCI/PCIe USB add-on card and only use its ports.