It depends on whether you want to sample the temperature at a specific part of the resistor, want an average temperature, etc. I suggest you perform an infrared survey to determine the temperature profile, and then instrument the resistor with a thermocouple at the hottest location (which is often at the center of the resistor).
Infrared pyrometers can be found in handheld (gun) format or permanently installed.
Check Omega Engineering for examples. There are many other good suppliers.
As mentioned above, these take the average of a surface that grows as you increase the distance from the target. Some model have a narrower cone than others. Anyway, at 2000V, you shouldn't need more than a few centimeters which will shrink the zone to mere centimeters across.
Good hunt.
__________________
Experienced is earned, common sense is taught, both are rare essentials of life.
The more expensive portable multi-meters come with a thermocouple range and often a thermocouple. These are available from many sources.
You are not clear if you want a type-test measurement to prove resistor runs within temperature limit or what?
A digital meter with laboratory clamp holding thermocouple against resistor, all on a plastic stool or wood frame - with you at a safe distance, maybe with telescope - may work.
What does resistor maker say about measuring temperature according to his rating?
"Almost" Good Answers: