By stability you must mean control. Control exists about 3 axes and You might consider the effects that these control surfaces have in several configurations. For instance, the horizontal stabilizer has been employed to either provide a upward lift (Bleriot) as a wing, or a downward force (see T tail as a variant), or possibly configured as a canard (Long EZ), and a version known to me as a V tail (Bonanza). The vertical stabilizer may actually provide instability during a short period on takeoff due to slip stream from the propeller. The vertical stab is usually angled a bit (to the left for a right hand turning propeller) to counter this moment. The rudder is for adverse yaw.