Determining the fairness of a penny

  • Thread starter caffeine
  • Start date
I notice that instead of listing all possibilities the problem focuses on a single possibility--heads. So I ask myself why, and I realize that IF the coin is two-headed then it still does not show tails. So it’s like you are throwing a coin and not counting any tails at all. The probability of throwing a coin and not counting tails is the same as throwing a fair coin and not counting Tails. I’m guessing you caught this from your comment “our entire sample space consists of events where the coin shows heads”.
  • #1
caffeine
I've been reviewing probability and came across this problem:


A penny may be fair or it may have two heads. It's tossed n times and it comes up heads on each occaision. If our initial judgement was that both options for the coin ("fair" or "both sides heads") were equally probable, what is our revised judgement in light of the data?

The book's answer is P(fair)[itex]= \frac{1}{1+2^n}[/itex], but I don't understand this. Certainly, the book's answer makes sense for n=0 (before we toss the coin).

Suppose we toss the coin once and it comes up heads. The probability for this outcome is 1/2. According to the book's answer, P(fair)=1/3.

I guess what I'm having trouble with is connecting the probability for an event to happen (say, tossing n heads) with the probability that the coin is fair.

What is the connection between these two probabilities? How is the book's answer justified?

Thanks!
 
Physics news on Phys.org
  • #2
After stating that "our initial judgement was that both options for the coin ("fair" or "both sides heads") were equally probable" why do you say "the book's answer makes sense for n=0 (before we toss the coin)"? It makes perfect sense -- the prior probability of having a fair coin is 1/2 and that's what the formula equals when n = 0.

Does this help?

Anyway, is this homework?
 
  • #3
EnumaElish said:
why do you say "the book's answer makes sense for n=0 (before we toss the coin)"?

It makes perfect sense -- the prior probability of having a fair coin is 1/2 and that's what the formula equals when n = 0.
I think you may have missed the point of his question.
His statement you quoted and questioned agrees completely with your explanation.

Caffine try this.
What are the odds of the fair coin NOT showing Tails ---- and the same for the the unfair coin.
Now total the odds for NOT showing Tails and divide that into the odds for just the fair coin.

Do the same for two flips.
How does it compare to what the book said?
RB
 
  • #4
EnumaElish said:
After stating that "our initial judgement was that both options for the coin ("fair" or "both sides heads") were equally probable" why do you say "the book's answer makes sense for n=0 (before we toss the coin)"?

Because it DOES make sense. For n=0, the book's answer gives P(fair)=.5 and P(unfair)=.5. That's what we mean by "equally likely". So, as I stated, the book's answer makes sense for n=0.

EnumaElish said:
It makes perfect sense -- the prior probability of having a fair coin is 1/2 and that's what the formula equals when n = 0.
Does this help?

Unfortunately not because you've stated what I have already stated:

I said: The book's answer makes sense for n=0.

You said: It makes perfect sense for n=0..

Are we not saying the same thing? My question was: How to relate the probability between the event of tossing n heads with the probability that the coin is fair. Since I already said the book's answer makes sense for n=0, I was actually interested in n>0.

Anyway, is this homework?

Did I not say that I'm reviewing probability?

But to answer your question explicitly, no. It's not a homework question. I've finished my degree. I'm not even in school any longer. We didn't even *have* homework past the 2nd year of grad school.

Also, the rules specifically say to NOT post homework questions on the forum, so why would I do so?

Probability has always been a weak point for me, and it shouldn't be. So, as I stated in my post, I'm reviewing it.
 
Last edited by a moderator:
  • #5
RandallB said:
I think you may have missed the point of his question.
His statement you quoted and questioned agrees completely with your explanation.
Caffine try this.
What are the odds of the fair coin NOT showing Tails ---- and the same for the the unfair coin.
Now total the odds for NOT showing Tails and divide that into the odds for just the fair coin.
Do the same for two flips.
How does it compare to what the book said?
RB


Wow. OK, so the sample space you're using is:

A: Fair coin shows heads
B: Unfair coin shows heads

and then, the next logical step would be:

P(fair coin) = P(A) / ( P(A) + P(B) )

and you can do this because our entire sample space consists of events where the coin shows heads. That's very nice.

Now I have to figure out why that stymied me in the first place. How did you think of this problem? Can you tell me anything about the thought process that lead you to the answer? Did you think about partitioning the sample space? How did you approach it?

I know that's a hard question, but even more than learning probability, this is exactly the kind of thing I need to get better at when approaching probability problems.

Thanks!
 
  • #6
caffeine said:
Wow. OK, so the sample space you're using is:
A: Fair coin shows heads
B: Unfair coin shows heads

because our entire sample space consists of events where the coin shows heads.

Now I have to figure out why that stymied me in the first place.
How did you think of this problem?
Not like I thought of it, first time I’ve ever seen it.
The key of course is understanding the problem and both you’re A: B: statement and your ‘because’ statement do that.

Getting there for me, I need to visualize a problem which I find you generally cannot do satisfactorily until you understand it. And understanding correctly is more than half the solution in most cases.
Cranking down though formulas seems so unsatisfying (did I reach the answer by accident) without visualizing what they mean somehow.
Even more so when I cannot “see” how an answer or theory is reached.
I suppose that’s why I’m so uncomfortable with QM which no one claims to really “see”.

Anyway for me the key here was “Not Tails”. Just to focus the visualization on what the real sample space was.
RB
 
  • #7
This problem is a simple application of Bayes' Theorem:

[tex]P(H_i|E) = \frac{P(E|H_i)P(H_i)}{\sum_j P(E|H_j)P(H_j)}[/tex]

where

[itex]H_i[/itex] is the [itex]i^{th}[/itex] hypothesis explaining some event [itex]E[/itex].
[itex]E[/itex] is the observed event (e.g., flipping [itex]n[/itex] heads in a row).
[itex]P(H_i|E)[/itex] is the posterior probability of [itex]i^{th}[/itex] hypothesis.
[itex]P(H_i)[/itex] is the prior probability of [itex]i^{th}[/itex] hypothesis.
[itex]P(E|H_i)[/itex] is the probability of observing event [itex]E[/itex] assuming the [itex]i^{th}[/itex] hypothesis is true.

The sum is taken over all hypotheses. There are two hypotheses in this problem: [itex]H_1[/itex]: coin is fair and [itex]H_2[/itex]coin has two heads.

Four items are needed to evaluate the probability a coin is fair after flipping $n$ heads in a row: the two prior probabilities [itex]P(H_i)[/itex] and the probabilities of observing the event given each of the two hypotheses. The prior probabilities are based on the principle of ignorance: all explanations are equally likely, so [itex]P(H_1)=P(H_2)=1/2[/itex].

What are [itex]P(E|H_i)[/itex]? These are the probabilities of getting [itex]n[/itex] heads in a row with a fair coin and a two-headed coin, which are [itex]\frac{1}{2^n}[/itex] and [itex]1[/itex] respectively.

Applying Bayes' Theorem to compute the probability that the coin is fair after flipping [itex]n[/itex] heads in a row,
[tex]\begin{align*}
P(H_1|E) &=
\frac{\frac{1}{2^n}\frac 1 2}
{\frac{1}{2^n}\frac 1 2 + 1 \frac 1 2} \\
&=
\frac{1}{1+2^n}
\end{align*}[/tex]
 
Last edited:
  • #8
Believe it or not, I read "Certainly, the book's answer makes sense for n=0" as "the book's answer makes no sense for n=0".
 
  • #9
I'm going to be rather bold, and claim that every "real-life" probability question is conditional.

Whether or not that's true, it's often the piece people are missing when they're confused by a question like this!


What you have originally is:

P(fair coin | my initial judgement) = 0.5

and you're eventually interested in calculating

P(fair coin | my initial judgement and the result of the experiment)

and to do that, you'll probably want to use

P(this experimental outcome | fair coin)

and

P(this experimental outcome | double-headed coin)

(and the fact that these probabilities are independent of your judgement)
 
  • #10
Hurkyl said:
I'm going to be rather bold, and claim that every "real-life" probability question is conditional.

That claim makes you a strict Bayesianist, a position against which frequentists strongly disagree.
 
  • #11
All of the solutions to the "is the penny fair" problem (including mine) have been Bayesian in nature. A frequentist solution to this problem that avoids the prior probabilities also exists.

There are [itex]2^n[/itex] possible outcomes from a sequence of [itex]n[/itex] coin tosses of a fair coin. Of these, only one has all heads. Now think of marking our two-headed coin in some way to distinguish the two sides. There are similarly [itex]2^n[/itex] possible outcomes from a sequence of [itex]n[/itex] coin tosses of this marked two-headed coin, but all of the outcomes are all heads.

Thus the universe consisting of a sequence of [itex]n[/itex] successive heads in a coin-tossing experiment comprises [itex]2^n+1[/itex] events: [itex]2^n[/itex] from the two-headed coin and [itex]1[/itex] from the fair coin. Proceeding from the principle of ignorance, all of these events are equally likely, and thus the odds the coin is fair is [itex]1/(2^n+1)[/itex].
 
  • #12
Proceeding from the principle of ignorance, all of these events are equally likely
The thing is, I consider this to be a specification of prior probabilities, so I'm unconvinced that this is avoids using such things. :smile:

(I take this approach because thinking in this way solved some interpretational issues for me, and makes it easier for me to set up a problem!)


Of course, the original problem specified that there were prior probabilities to use.
 
  • #13
I was playing devil's advocate. I use whatever works, and often, a Bayesian approach works quite nicely. Maximum likelihood (a frequentist method of choice) is a poor cousin to Bayes' Law in my view.

An added plus is that Bayes' Law is so ammenable to variations. Suppose the original problem was phrased as "a coin stamping machine on occasion produces double-headed coins. How many successive tosses of heads would lead you to believe a coin produced by this machine has two heads?" Answering that is a snap with Bayes' Law.
 
  • #14
There is usually something counterintuitive in a Bayesian formula. When I try to write D H's explanation as P(H|E) = P(H and E)/P(E), it leads to the conclusion that P(E) = 1 + 1/2n > 1.

That's because we know P(H|E) = 1/(2n+1) and P(H and E) = 1/2n.

I have got to be missing something, what?
 
  • #15
That's because we know ... P(H and E) = 1/2n.
Why do we know that?

(I suspect that you mistakenly interpreted P(H and E) to mean P(E|H). At least, that's a mistake I make every now and then)
 

FAQ: Determining the fairness of a penny

How do you determine the fairness of a penny?

The fairness of a penny can be determined by conducting a statistical analysis of its weight, size, and composition. This involves testing a sample of pennies and comparing the results to the standard weight and size set by the U.S. Mint.

What is the standard weight and size of a penny?

The standard weight of a penny is 2.5 grams and the standard diameter is 19.05 millimeters. These measurements were set by the U.S. Mint in the 19th century and have remained consistent since then.

How many pennies are typically tested in a fairness analysis?

In a statistical analysis, a minimum of 50 pennies is recommended to ensure accurate results. However, a larger sample size may be used for more precise measurements.

What factors can affect the fairness of a penny?

The composition and wear of a penny can affect its fairness. Over time, pennies may become worn or corroded, causing them to deviate from the standard weight and size. Other factors such as temperature and air pressure can also have a slight impact on the weight of a penny.

Why is it important to determine the fairness of a penny?

Determining the fairness of a penny is important to maintain the integrity of our currency and ensure that all coins are of equal value. It also helps to prevent fraud and counterfeiting, as well as protect consumers from receiving counterfeit or altered coins.

Similar threads

Replies
57
Views
5K
Replies
6
Views
2K
Replies
5
Views
1K
Replies
4
Views
2K
Replies
41
Views
5K
Replies
45
Views
4K
Replies
11
Views
2K
Replies
29
Views
4K
Replies
14
Views
4K
Back
Top