You can try unplugging the paneldue as well when using just USB power just in case the extra power draw from the panel is causing issues.
The results of M122 would be helpful.
Can you also provide the results of sending
M552
M552 S-1
M552 S0
M552 S1
M587