Just rearrange the plug wiring. The signal levels on RADDS are 3.3V AFAIK, but in any case Panel Due is 5V tolerant on the data pins.