cutting force measurement for vibration signal

Better use strain gages on the cutting tool support and calibrate it as a 6 Components sensor this way you will get forces and torques so that you can define the right position and the magnitude and angles of same force.

From vibrations only it is not impossible but very very difficult since you do not know the dynamic impedances of support.