A voltmeter does not measure frequency.
One way to find an approximate voltage is to put an RC low pass filter to smooth out the PWM pulses (or hook up an oscilloscope).
Otherwise, your voltmeter will not register the actual pulse width modulation.
Only other way is to KNOW your PWM is...