Virtual Boy Dpad Issue

While playing teleroboxer, it is impossible to use the left dpad as the left arm and the right buttons as the right arm. when pressing each arm and trying to throw a punch with the triggers, seems like not alot registers and that presses are dropped because there seems like a press limit. Whatever it is, it doesnt feel like the real Vboy controls for that game.