Previous in Forum: Active sensor Vs Passive Sensor   Next in Forum: Breaker Failure
Close
Close
Close
16 comments
Rate Comments: Nested
Guru

Join Date: Jul 2007
Posts: 4448
Good Answers: 143

Another uncertainty/error question

03/13/2010 4:29 PM

OK, I'm still puzzled about this stuff. Perhaps somebody can yell at me loud enough that I'll get it??? Please?

I took a dc voltage source that I knew to be 1.525 V +/- 0.004 V by using a good, calibrated meter. I checked this three different ways, so I believe it pretty much.

I then measured the same source with a (deliberately) cheap, crappy meter. I got 1.517 V. This meter has a manufacturer's standard error of +/- 1% (the measuring circuit) + 2 digits (the ADC). OK, I can believe that. The "worst case" error would then be +/- 0.017 V.

So, I could write this as 1.517 V +/- 0.017 V, and that range would be coincidental with the "true" range. So, this isn't wrong, but it does sorta imply I have a better meter than I really do.So, I could write it as 1.52 V +/- 0.02 V and that actually seems the best way to me.

If I just write it as 1.52 V and depend on significant digits, I think most people would assume the range went from 1.515 V to 1.525 V?? Is that right? Or, would they think it went from 1.51 V to 1.53 V?

Now, I then measured the same source, in the same way, using the same meter, 28 more times (I meant to do 30 but miscounted). Every reading was 1.517 V. No surprise there. Now, if I plug this into a statistics analysis package, I get a mean of 1.517 V (OK) and a standard error of essentially 0. I have made a silk purse out of a sow's ear.

How do I explain to someone else why I can't do that little trick with statistics? I know not to do it, I just can't explain it.

__________________
"Well, I've wrestled with reality for 35 years, Doctor, and I'm happy to state I finally won out over it." Elwood P. Dowd
Register to Reply
Interested in this topic? By joining CR4 you can "subscribe" to
this discussion and receive notification when new comments are added.

"Almost" Good Answers:

Check out these comments that don't yet have enough votes to be "official" good answers and, if you agree with them, vote them!
Guru
Engineering Fields - Electrical Engineering - Been there, done that. Engineering Fields - Control Engineering - New Member

Join Date: Dec 2008
Location: Long Island NY
Posts: 15600
Good Answers: 981
#1

Re: Another uncertainty/error question

03/13/2010 5:51 PM

Ok let me give this a try.

The reading you did with two different instruments demonstrated the resolution and tolerance of these to instruments. You measured the exact same parameter with similar instruments and ended up with an overlapping uncertainty region. As you implied this is what one would expect, the cheaper lower quality instrument produced a larger uncertainty region +/- 0.017 V than the higher quality instrument of +/- 0.004 V. Also the entire high quality instrument's uncertainty reading lies inside the uncertainty region of the less precise instrument.

Now if you don't include your tolerance value in your recorded data you should record your data so that 1/2 of your least significant digit is larger than the actual tolerance of your reading. So to maintain all of the accuracy of your precise reading you should record 1.525 +/- 0.004 V. But you can record this as 1.53 V for the implied +/- 0.005 tolerance is larger than your measurement tolerance. This does mean that your recorded data is less accurate than your instrument, but one is permitted to record less accurate data. Your other meter though has a tolerance of +/- 0.017 so the next largest half digit above this is +/- 0.05. This means that if you don't wish to include any tolerance value you should record this as 1.5 V. But you are entitled to choose 1.52 +/- 0.02 V for 0.02>0.017.

Now for the statistical analysis, one must remember that the analysis program does not know the origin of the numbers entered. Your fractional number entries maybe in reality integer numbers times an absolutely known fraction, the software does not know. So your identical set of 28 readings does have a zero standard deviation. But each of your readings has a tolerance of +/- 0.017 V. That precision limit does not disappear.

Measurements, tolerances and statistical analysis are a confusing subjects. We have all misused them in our work. By understanding this though and by being creative with circuit topology you can apparently exceed the resolution limitations of your instrumentation by including dithering. But that's another even longer story.

I wish I could cite my source written by D.C. Baird on measurement and precision but that old text is at work.

__________________
"Don't disturb my circles." translation of Archimedes last words
Register to Reply Score 1 for Good Answer
Guru

Join Date: Jul 2007
Posts: 4448
Good Answers: 143
#2
In reply to #1

Re: Another uncertainty/error question

03/13/2010 6:23 PM

OK, I got part of it. A GA for that and thanks. I wasn't picking up on that idea of moving up to the next half digit point.

Who and what is D.C. Baird? I don't know about that. All I have is John Taylor and that's about useless for stuff like this.

I got to check on this dithering. I've used dithering in gas flow, but in electrical work? Thanks again for something new to check out.

__________________
"Well, I've wrestled with reality for 35 years, Doctor, and I'm happy to state I finally won out over it." Elwood P. Dowd
Register to Reply
Guru
Engineering Fields - Electrical Engineering - Been there, done that. Engineering Fields - Control Engineering - New Member

Join Date: Dec 2008
Location: Long Island NY
Posts: 15600
Good Answers: 981
#3
In reply to #2

Re: Another uncertainty/error question

03/13/2010 8:16 PM

D. C. Baird was the author of "Experimentation: An Introduction to Measurement Theory and Experiment Design" This concise little 200 page text covered literally everything one needs to know about measurements. Well at least its always contained my needs.

__________________
"Don't disturb my circles." translation of Archimedes last words
Register to Reply
Guru

Join Date: Jul 2007
Posts: 4448
Good Answers: 143
#8
In reply to #3

Re: Another uncertainty/error question

03/14/2010 8:40 AM

Yep. Found it on ABE. Maybe that'll make me a little smarter? Well, there's always hope.

Thanks for all your help. I know I'm asking some dumb questions, but I always thought I understood some of this stuff and maybe I was just too dumb to know I didn't.

Anyway, if I take 29 readings and they're all the same (or close), and I run a standard deviation (or can I use standard error - not sure), that tells me the distribution of the repeatability of that meter. Is that right?

__________________
"Well, I've wrestled with reality for 35 years, Doctor, and I'm happy to state I finally won out over it." Elwood P. Dowd
Register to Reply
Guru
Engineering Fields - Electrical Engineering - Been there, done that. Engineering Fields - Control Engineering - New Member

Join Date: Dec 2008
Location: Long Island NY
Posts: 15600
Good Answers: 981
#11
In reply to #8

Re: Another uncertainty/error question

03/14/2010 10:39 AM

Yep, in your statistical analysis you've found the repeatability of that particular instrument being used by you on that object.

But this is anything but a dumb question. In contrast I would call this a very astute question. Many people never question measurement errors, neither their origin or meaning. Because of this many work for a long time not knowing how accurately they do know a measurement and how accurately they know an indirect measurement.

Because many people don't know that there really is a legitimized formal methodology to making uncertainty measurements and calculations, one should always refer to a reference when using this confusing subject. I have often cited this text book at work to bolster my data and to be certain that I'm using the correct terms.

This leads me to your question about standard error or deviation. I had to review the Wikipedia site to see if my memory was correct on the subtle difference between these two numbers, it wasn't. The difference in these two terms hinges on knowing the population size that you are taking samples from. How that applies to an electronics voltage measurement that doesn't have an obvious population size, I haven't thought through yet. But since standard error does not require knowledge of the population size, using that term will be accurate.

__________________
"Don't disturb my circles." translation of Archimedes last words
Register to Reply
Anonymous Poster
#12
In reply to #8

Re: Another uncertainty/error question

03/15/2010 8:30 AM

There are two different entities

Standard Error and Standard Error of Measurement (SEM)

The standard deviation (or call it the variability) may point to either depending on the way you are conduction your experiment.

However that is likely to complicate the issue just a bit more than we may need here. And we will be entering into the depth of measurement reliability and so on.

And yes, here you are only calculating the repeatability of the instrument.

Register to Reply
Guru

Join Date: Aug 2009
Location: Glen Mills, PA.
Posts: 2385
Good Answers: 114
#4

Re: Another uncertainty/error question

03/13/2010 9:46 PM

You are mixing up two different things. One is the design of the meter, each meter is expected to be within the stated range, +/- 1%, but each reading of the same measure by the same meter will not vary.

Your zero error is an experimental result that has nothing to do with the above.

__________________
In a time of universal deceit, telling the truth is a revolutionary act. George Orwell
Register to Reply
Guru
Popular Science - Weaponology - New Member United Kingdom - Member - New Member

Join Date: May 2007
Location: Harlow England
Posts: 16512
Good Answers: 670
#5

Re: Another uncertainty/error question

03/14/2010 4:30 AM

Hmmmm, this is one of those great Qs...real simple, until you start thinking about it.
I think one part comes into the 'use and abuse of statistic' category.
There is self evidently no point in doing a mean and standard deviation etc on a bunch of identical readings so it's just a red herring...the problem is explaining why.
Intuitively it's just because there is nothing to average so you are not gaining anything, effectively the stats are a way of consolidating a bunch of information into one figure.
The stats show the standard deviation of you measurements but only relative to their resolution in the first instance.
If you repeat the stats just using the 1.5 figure (pretending you meter only read to 1dp) you get a mean of 1.5 and the error of zero...relative to the resolution and accuracy you plugged in.

If you had some figure 1.5, 1.5, 1.4 etc then the Q is how many places of decimals can you legitimately use in your answer... this links in with sample size etc...
Argghhh brevquot error must nap...<flump thud>

Del
(Here's one I prepared earlier....)

__________________
health warning: These posts may contain traces of nut.
Register to Reply Score 1 for Good Answer
Guru

Join Date: Jul 2007
Posts: 4448
Good Answers: 143
#10
In reply to #5

Re: Another uncertainty/error question

03/14/2010 8:54 AM

Yeah, the trouble is that I'm not the world's sharpest cookie when it comes to stats, so I tend to believe folks who seem to be smarter. Then later, I start to wonder if I was following a wild goose. That's why I asked on here. I'm a little chagrinned to have you guys see how little I really know, but I'm grateful for the chance to finally get some of this squared away.

__________________
"Well, I've wrestled with reality for 35 years, Doctor, and I'm happy to state I finally won out over it." Elwood P. Dowd
Register to Reply
Guru
Popular Science - Weaponology - New Member United Kingdom - Member - New Member

Join Date: May 2007
Location: Harlow England
Posts: 16512
Good Answers: 670
#6

URGENT NOTICE

03/14/2010 4:34 AM

Please ignore all my replies.
I am pants at maths...and wish I'd never laid eyes on your thread...as I can't sleep now.
Hopefully someone erudite will rescue you from your quandry.
Del

__________________
health warning: These posts may contain traces of nut.
Register to Reply Off Topic (Score 5)
Anonymous Poster
#7

Re: Another uncertainty/error question

03/14/2010 4:40 AM

In a measurement system many sources of error exist. The five main sources are

Stability : Producing same value over time when same measurement is being done, eg your voltmeter reads 1.527 today as well as the next week.

Bias - The difference between the actual value and the known true value (1.525-1.517 = 0.008V)

Linearity - The linear relation between the actual and the read value, eg 1.525 reads 1.517 , 15 reads 15.005 then 10 should not read 9.80

Repeatability - same operator, same instrument, (ie the process and the instrument is same) how the readings vary.

Reproduceability - Different operator, same documented process, variations in readings.

Here in your case you have studied the repeatability only (and upto certain extent bias)

You can have a look at this from Chat-3 at least and get some Idea about measurement uncertainties. GRR is a part of this. or have a look at NIST or another

Register to Reply
Guru

Join Date: Jul 2007
Posts: 4448
Good Answers: 143
#9
In reply to #7

Re: Another uncertainty/error question

03/14/2010 8:50 AM

Hey, thanks for that Chat-3 link. I glanced through and saw, for the second time this weekend, the recommendation to set up an error model BEFORE measuring. I never knew to do that. Durn! I may be even dumber than my family thinks.

I am familiar with a little of this, but I'm trying to question everything I think I know so I can figure out what I really know and what I just think I know. I appreciate all your help and patience.

The NIST stuff is great, but I'm pretty much a kinesthetic learner. I have to actually take a meter in my hands and measure something and then say to myself, "Self, what do you know about what you just did?"

__________________
"Well, I've wrestled with reality for 35 years, Doctor, and I'm happy to state I finally won out over it." Elwood P. Dowd
Register to Reply
Guru

Join Date: Jul 2007
Posts: 4448
Good Answers: 143
#13

Re: Another uncertainty/error question

03/21/2010 1:56 PM

OK, I'm starting to get some of this sorted out. Turns out I've been getting by through overestimating my uncertainty over the years. I was never wrong, but sometimes I wasn't right either. I figure I actually knew about 10% of what I thought I did. Thanks to RedFred and Fyz and others who have helped so far.

I think I'm close to clear on the difference between error and uncertainty. Probability Distribution Functions seem OK. Type A uncertainties seem OK for N > 25. I think I've got the rules for propagation.

But, I'm not clear on how to calculate calibration uncertainty. I think I know how to calibrate, but how do I calculate that?

By the way, Fyz, I'm pretty PO'd that you didn't mentional the National Physical Labs. What a treasure! Were you keeping that all to yourself?

__________________
"Well, I've wrestled with reality for 35 years, Doctor, and I'm happy to state I finally won out over it." Elwood P. Dowd
Register to Reply
Guru
Popular Science - Weaponology - New Member United Kingdom - Member - New Member

Join Date: May 2007
Location: Harlow England
Posts: 16512
Good Answers: 670
#14
In reply to #13

Re: Another uncertainty/error question

03/21/2010 3:33 PM

By the way, Fyz, I'm pretty PO'd that you didn't mentional the National Physical Labs. What a treasure! Were you keeping that all to yourself?

That's because he couldn't be certain he was working for the NPL due to the possible accumulated measurment error associated with getting there every day
Del

__________________
health warning: These posts may contain traces of nut.
Register to Reply Off Topic (Score 5)
Guru

Join Date: Jul 2007
Posts: 4448
Good Answers: 143
#15
In reply to #14

Re: Another uncertainty/error question

03/21/2010 3:54 PM

That's OK. I have a lot of tolerance for him.

__________________
"Well, I've wrestled with reality for 35 years, Doctor, and I'm happy to state I finally won out over it." Elwood P. Dowd
Register to Reply Off Topic (Score 5)
Guru
Popular Science - Weaponology - New Member United Kingdom - Member - New Member

Join Date: May 2007
Location: Harlow England
Posts: 16512
Good Answers: 670
#16
In reply to #15

Re: Another uncertainty/error question

03/21/2010 4:41 PM
__________________
health warning: These posts may contain traces of nut.
Register to Reply Off Topic (Score 5)
Register to Reply 16 comments

"Almost" Good Answers:

Check out these comments that don't yet have enough votes to be "official" good answers and, if you agree with them, vote them!
Copy to Clipboard

Users who posted comments:

Anonymous Poster (2); passingtongreen (1); redfred (3); TVP45 (6); user-deleted-1105 (4)

Previous in Forum: Active sensor Vs Passive Sensor   Next in Forum: Breaker Failure

Advertisement