Using a two-handed weapon single-handedly usually incurs a 50% accuracy penalty (33% for melee weapons).
However, some weapons (indicated by the red 2-handedness marker) are either too heavy, too intricate or otherwise impossible to use when your off-hand is full.