
EX505 V6.1 11/07
13
Function Range Resolution Accuracy
400Ω 0.1Ω ±(1.2% reading + 4 digits)
4kΩ 0.001kΩ ±(1.0% reading + 2 digits)
40kΩ 0.01kΩ
400kΩ 0.1kΩ
4MΩ 0.001MΩ
±(1.2% reading + 2 digits)
Resistance
40MΩ 0.01MΩ ±(2.0% reading + 3 digits)
40nF 0.01nF
±(5.0% reading + 7 digits)
400nF 0.1nF
4μF 0.001μF
40μF 0.01μF
±(3.0% reading + 5 digits)
Capacitance
100μF 0.1μF ±(5% reading + 5 digits)
5.999Hz 0.001Hz
59.99Hz 0.01Hz
±(1.5% reading + 1 digits)
599.9Hz 0.1Hz
5.999kHz 0.001kHz
59.99kHz 0.01kHz
599.9kHz 0.1kHz
±(1.2% reading + 3 digits)
5.999MHz 0.001MHz
9.999MHz 0.001MHz
±(1.5% reading + 4 digits)
Frequency
Sensitivity: 0.5V rms <500kHz; 3V rms >500kHz
0.1 to 99.9% 0.1%
±(1.2% reading + 2 digits)
Duty Cycle
Pulse width: 100µs to 100ms, Frequency: 5Hz to 150kHz
-4 to 1382°F
Temp
(type-K)
-20 to 750°C
0.1°<400°
1° ≥ 400°
±(3.0% reading + 5°C /9°F)
(probe accuracy not included)
Note: Accuracy specifications consist of two elements:
• (% reading) – This is the accuracy of the measurement circuit.
• (+ digits) – This is the accuracy of the analog to digital converter.