Micrometer accuracy vs resolution

Started by flew-da-coup, 06-23-2023 -- 14:26:35

Previous topic - Next topic

flew-da-coup

So one of my technicans came to me with a Mitutoyo 0-1 micrometer ( not digital). The resolution of the micrometer is 0.001 inch. The stated accuracy from Mitutoyo is +/- 0.0002 inch. Does anyone know how in the hell Mitutoyo can claim an accuracy 5 times more accurate than the resolution? After researching there are other companies that do the same. Have any of you called on this and what was there BS excuse?
You shall do no injustice in judgment, in measurement of length, weight, or volume.Leviticus 19:35

LS_Larry

There are several models look identical, one res = 0.001" the other 0.0001.  Model number 103-259 (.001), model 103-260 (.0001).  Perhaps you're looking at the wrong specs?

scarface

They do say its' .0002" without a vernier scale. Ask the engineer from Mitutoyo.

Current catalog says .0001" accuracy with .001 graduations.  Guess-u-mation theroy I guess.
NAVAIR AND 33K6- Procedures would degrade that to .001 or .0005. Half of the smallest division.
 
R. Francis