Looking For Help Understanding Bell's Theorem, Hidden Variables & QM

[DrChinese]

@DrChinese, just to try and clarify further.

My understanding of your statement that we don't know how often cases [1] & [8] occur either implies or allows for the possibility that they occur infrequently, which is why I am thinking we can discount them when calculating the minimum probability, but not exclude them from the possibility space.

What I mean by that is, it's always a possibility that cases [1] & [8] occur, so we have to include them in our space of possible outcomes. However, because they are not as likely to occur as the other cases (with a possibility they don't occur in a given statistical sample), we don't count them when calculating the minimum expectation value (of matching outcomes).

Where they occur, they could give us a value ≥0.25.

Here are some relevant rules for calculating any statistical situations:

a) If you include the cases in the denominator, you must also include the associated data in the numerator.
b) You are free to change the weighting of the cases according to your own viewpoint or rationale. For example, while I might suggest all 8 cases are equally likely, you might reasonably argue that cases [1] and [8] are rare - so you weight them as 0%. You might even say case [2] is twice as likely as case [3]. Fine. However, that still leads us to exactly the same minimum of .333 - and not .250. There are no cases with a match % less than .333.

Next, consider this: you can even make up your own results for as many trials as you like, picking whatever cases you like. And unless you pick those cases knowing in advance which 2 measurement settings (of 3) you plan to use, you will never have an average less than .333.

 

[PeterDonis]

I can see where the average of 0.333 comes from, but it doesn't come from the average of the entire possibility space.

The average if you include rows 1 and 8 is even higher.

What I mean by that is, it's always a possibility that cases [1] & [8] occur, so we have to include them in our space of possible outcomes.

Ok.

However, because they are not as likely to occur as the other cases (with a possibility they don't occur in a given statistical sample), we don't count them when calculating the minimum expectation value (of matching outcomes).

Nonsense. Doing statistics doesn't mean ignoring things that are less likely. At most, it means weighting the different possibilities by likelihood. You can't just make up your own statistical methods.

Even leaving all that aside, as noted above, the average if you include rows 1 and 8, at any statistical weight whatever, is even higher than 0.333. So there is still no way to get an average of 0.25. So even if your objective is to calculate the minimum expectation value for the table, that would not imply ignoring rows 1 and 8 because they are less likely. It would at most imply ignoring rows 1 and 8 because they would just increase the average.

 

[Lynch101]

Here are some relevant rules for calculating any statistical situations:

a) If you include the cases in the denominator, you must also include the associated data in the numerator.
b) You are free to change the weighting of the cases according to your own viewpoint or rationale. For example, while I might suggest all 8 cases are equally likely, you might reasonably argue that cases [1] and [8] are rare - so you weight them as 0%. You might even say case [2] is twice as likely as case [3]. Fine. However, that still leads us to exactly the same minimum of .333 - and not .250. There are no cases with a match % less than .333.

Next, consider this: you can even make up your own results for as many trials as you like, picking whatever cases you like. And unless you pick those cases knowing in advance which 2 measurement settings (of 3) you plan to use, you will never have an average less than .333.

Cheers for this clarification. I was toying with the idea of weighting, but didn't have time to work through permutations.

I misinterpreted what you said in the explanation on your website, when you said about cases [1] and [8] that we don't know how often they occur which gave rise to the line of thinking of the past few posts.

Thinking through it further, obviously the ratio of matches to mismatches (without cases [1] & [8]) is 1:2 and given there must be some outcome of each trial, if cases [1] & [8] never occur the ratio of matches to mismatches for the statistical sample will have to be 1:2 (minimum number of matches being 1/3).Presumably it's not possible that instead of cases [1] & [8] being the case:
Photon 1: A+B+C+
Photon 2: A+B+C+

It was
Photon 1: A+B+C+
Photon 2: A-B-C-

Presumably there's either some experiment which has ruled this out, or it would it make any difference?

I've tried working it out on a spreadsheet, but as you may understand, I'm slow to trust my own analysis when it comes to statistics.

 

[Lynch101]

The average if you include rows 1 and 8 is even higher.

Yes, I was misinterpreting DrC's statement about not knowing how often cases [1] and [8] occur, but I've played around with it. I tried imagining a roulette wheel and weighting the different outcomes.

Nonsense. Doing statistics doesn't mean ignoring things that are less likely. At most, it means weighting the different possibilities by likelihood. You can't just make up your own statistical methods.

Hahaha, I wouldn't dream of it. Toying around with weighting helped me to grasp it.

Even leaving all that aside, as noted above, the average if you include rows 1 and 8, at any statistical weight whatever, is even higher than 0.333. So there is still no way to get an average of 0.25. So even if your objective is to calculate the minimum expectation value for the table, that would not imply ignoring rows 1 and 8 because they are less likely. It would at most imply ignoring rows 1 and 8 because they would just increase the average.

Thanks for taking the time to explain it.

 

[PeterDonis]

Presumably it's not possible that instead of cases [1] & [8] being the case:
Photon 1: A+B+C+
Photon 2: A+B+C+

It was
Photon 1: A+B+C+
Photon 2: A-B-C-

There is no "Photon 2" in the scenario @DrChinese described.

 

[Lynch101]

There is no "Photon 2" in the scenario @DrChinese described.

 

[Lynch101]

Ah, that would explain a lot.

I was thinking in terms of pairs of photons being sent to separate detectors . I thought there was an assumption that each photon has the same properties.

 

[PeterDonis]

I was thinking in terms of pairs of photons being sent to separate detectors . I thought there was an assumption that each photon has the same properties.

In the scenario @DrChinese described, a local hidden variable model is being tested. In that model, each individual photon has pre-determined values for all three measurements, A, B, and C. The model is tested by making measurements on a large number of identically prepared photons. But in each individual measurement, only one photon is measured.

 

[Lynch101]

In the scenario @DrChinese described, a local hidden variable model is being tested. In that model, each individual photon has pre-determined values for all three measurements, A, B, and C. The model is tested by making measurements on a large number of identically prepared photons. But in each individual measurement, only one photon is measured.

Thanks PD. I re-visited the statistics without re-reading the whole thing and had it in my head that it was photon pairs.

Thanks for taking the time to address my confused posts in this thread!

 

[Lynch101]

In the scenario @DrChinese described, a local hidden variable model is being tested. In that model, each individual photon has pre-determined values for all three measurements, A, B, and C. The model is tested by making measurements on a large number of identically prepared photons. But in each individual measurement, only one photon is measured.

Can that experimental set-up be used to test Bell's inequality?

I may again have misinterpreted DrC's explanation when he said

d. Bell anticipated that this result sounded good in theory, but needed more to make sense - because the above conclusion could not be tested......Using [...] entangled particles, it would be possible to measure 2 of the 3 settings mentioned above simultaneously, thus providing a way to differentiate between QM and Hidden Variables experimentally using Bell's Inequality

I may have been confusing it with this explanation, which is where the assumption of photon pairs may have come from:
DrPhysicsA - Bell's Inequality

 

[PeterDonis]

Can that experimental set-up be used to test Bell's inequality?

Not directly since only one photon is involved, not an entangled pair. But it can serve as a test of the QM prediction, which is for an average correlation of 0.25, and which, if enough runs are done, can be distinguished from the prediction of a local hidden variable model.

 

[Lynch101]

Not directly since only one photon is involved, not an entangled pair. But it can serve as a test of the QM prediction, which is for an average correlation of 0.25, and which, if enough runs are done, can be distinguished from the prediction of a local hidden variable model.

Ah cool. I was thinking that.

Cheers for the clarification.

 

[Lynch101]

There is no "Photon 2" in the scenario @DrChinese described.

Sorry, just going back to this. In tests of Bell's inequality, where entangled pairs of photons are used, would it be be possible that in cases [1] & [8] the two photons would have the following HVs:

Photon 1: A+B+C+
Photon 2: A-B-C-

or vice versa?

 

[PeterDonis]

In tests of Bell's inequality...

The table of possible values would be different, since there are two photons, not one. There would be 64 possible cases, not 8.

 

[Lynch101]

The table of possible values would be different, since there are two photons, not one. There would be 64 possible cases, not 8.

Would that be the case even if the photons were always identical except in cases [1] & [8]?

 

[PeterDonis]

Would that be the case even if the photons were always identical except in cases [1] & [8]?

What does this even mean?

 

[PeterDonis]

The table of possible values would be different, since there are two photons, not one. There would be 64 possible cases, not 8.

Apparently you didn't grasp what this means. The table is not QM; it is a proposed local hidden variable model in which each photon carries with it a set of predetermined results for all three of the possible measurements, A, B, and C. The 8 rows in the table for the one-photon case are the 8 possible sets of predetermined results. For two photons, there are 64 possible sets of predetermined results (8 for each photon, so 8 x 8 = 64 total).

 

[Nugatory]

Sorry, just going back to this. In tests of Bell's inequality, where entangled pairs of photons are used, would it be be possible that in cases [1] & [8] the two photons would have the following HVs:

Photon 1: A+B+C+
Photon 2: A-B-C-

or vice versa?

Possible in some hypothetical hidden variable theory? Yes, but do remember that we can't measure these hypothetical hidden variables (if we could they wouldn't be "hidden"). All we have is that the measurements that we can make, and these say that:
1) When the detectors at both sides are set at the same angle we get the opposite results (+ at one detector, - at the other) every single time, probability 100%, no exceptions.
2) When the detectors are set at different angles, we get opposite results with probability $\cos^2\theta$, where $\theta$ is the angle between the detector settings (you will see different formulations of this depending on whether we're working with photons polarized on the same or different axes or spin-1/2 particles in the singlet state, and whether the entanglement is such that opposite results are found on the same axis or perpendicular axes).

So if these A+B+C+/A-B-C- pairs are happening, then other pairs must also generated more or less often so that after we've measured many pairs randomly distributed across all the possible configurations of the hidden variables we end up with results agreeing with #1 and #2 above. Bell’s theorem says that you won’t be able to construct such a distribution.

You may find thus old Scientific American article helpful: https://static.scientificamerican.com/sciam/assets/media/pdf/197911_0158.pdf as it directly addresses the behavior of hypothetical hidden variables of the form $A\pm{B}\pm{C}\pm$.

 

[Lynch101]

Apparently you didn't grasp what this means. The table is not QM; it is a proposed local hidden variable model in which each photon carries with it a set of predetermined results for all three of the possible measurements, A, B, and C. The 8 rows in the table for the one-photon case are the 8 possible sets of predetermined results. For two photons, there are 64 possible sets of predetermined results (8 for each photon, so 8 x 8 = 64 total).

I know it's a proposed local HV model, but to test it in the lab pairs of photons are required, no?

If both photons always have the same HVs there will only be 8 cases, not 64.

I was wondering if those two "special" cases - where both photons have the "pass all 3 filters" HVs or the "do not pass all 3" HVs - could instead have one photon with the "pass all 3 filters" HVs while the other one would have the "do not pass all 3".

 

[Nugatory]

If both photons always have the same HVs there will only be 8 cases, not 64.

The hidden variables carry enough information to calculate the outcome for each of six (two sides, three possible measurements at each side) possible +/- measurements. That is, the hidden variables carry enough information to answer 64 questions of the form "If this photon arrives at detector X when it is set to angle Y will the result be Z?" where X is left or right, Y is one of the three angles and Z is plus or minus. Whether the hidden variables are the same at both sides (that is, the answer to any two questions that differ only in the choice of X will be the same) doesn't reduce the number of questions, it just changes how we've encoded the hidden variables that we use to calculate the answer.

 

[PeterDonis]

If both photons always have the same HVs

Why would you think that?

 

[Lynch101]

Possible in some hypothetical hidden variable theory? Yes, but do remember that we can't measure these hypothetical hidden variables (if we could they wouldn't be "hidden"). All we have is that the measurements that we can make, and these say that:
1) When the detectors at both sides are set at the same angle we get the opposite results (+ at one detector, - at the other) every single time, probability 100%, no exceptions.

Ah yes. I was confusing myself on this. I had it in mind that it was the opposite case with photons, that when measured at the same angle they would be perfectly correlated (as opposed to anti-correlated). I was confusing that with the idea that once a photon passes through a filter at a given polarisation, it remains polarised at that angle.

2) When the detectors are set at different angles, we get opposite results with probability $\cos^2\theta$, where $\theta$ is the angle between the detector settings (you will see different formulations of this depending on whether we're working with photons polarized on the same or different axes or spin-1/2 particles in the singlet state, and whether the entanglement is such that opposite results are found on the same axis or perpendicular axes).

That part I remember.

So if these A+B+C+/A-B-C- pairs are happening, then other pairs must also generated more or less often so that after we've measured many pairs randomly distributed across all the possible configurations of the hidden variables we end up with results agreeing with #1 and #2 above. Bell’s theorem says that you won’t be able to construct such a distribution.

You may find thus old Scientific American article helpful: https://static.scientificamerican.com/sciam/assets/media/pdf/197911_0158.pdf as it directly addresses the behavior of hypothetical hidden variables of the form $A\pm{B}\pm{C}\pm$.

Thanks for the explanation and the article. Both have been very helpful.

 

[Lynch101]

The hidden variables carry enough information to calculate the outcome for each of six (two sides, three possible measurements at each side) possible +/- measurements. That is, the hidden variables carry enough information to answer 64 questions of the form "If this photon arrives at detector X when it is set to angle Y will the result be Z?" where X is left or right, Y is one of the three angles and Z is plus or minus. Whether the hidden variables are the same at both sides (that is, the answer to any two questions that differ only in the choice of X will be the same) doesn't reduce the number of questions, it just changes how we've encoded the hidden variables that we use to calculate the answer.

Apologies, I misread what PD meant by that, I thought he meant 64 combinations of particle pairs, as opposed to possible outcomes.

I was ignoring the 3 combinations where the filter settings were the same - is that the case when it comes to Bell tests? Also with my confusion about both photons having the same HVs, I was ignoring the opposite filter pairings i.e. I was only looking at AB and not BA (because I thought it wouldn't make a difference to the probability).

I don't suppose you can see at a glance, where I've gone wrong with the table below?

It only has 48 possible outcomes (excluding combinations where both filters are the same e.g. AA). It also has a 50% match rate, so I must be doing something wrong

Including the cases where both filters are the same would bring it down to 33.33% but it would have 62 possible outcomes, instead of 64.

 

[Lynch101]

Why would you think that?

The standard reason, I was confusing myself!

I had it in mind that there was perfect correlations with photons when the filters were set to the same orientation on both sides of the experiment. I think I had conflated that with the idea that once a photon passes through a filter at a given polarisation, it remains polarised at that angle.

 

[Nugatory]

I had it in mind that there was perfect correlations with photons when the filters were set to the same orientation on both sides of the experiment.

There could be, it depends on how we generate our entangled pairs (google for "spontaneous parametric down-conversion" ). Some processes will produce two entangled photons that will both pass filters oriented in the same direction; others will produce entangled photons that will both pass filters perpendicular to one another.

And do note that I worded it as "will both pass filters", not "are both polarized in the same/orthogonal direction". The difference matters.

 

[Lynch101]

There could be, it depends on how we generate our entangled pairs (google for "spontaneous parametric down-conversion" ). Some processes will produce two entangled photons that will both pass filters oriented in the same direction; others will produce entangled photons that will both pass filters perpendicular to one another.

And do note that I worded it as "will both pass filters", not "are both polarized in the same/orthogonal direction". The difference matters.

Ah! I've probably been piecing together different things I've read in a completely garbled manner.

Thanks for the clarification and for the suggestion. I'll have read up about spontaneous parametric down-conversion.

Would the individual photon pairs I posted in the most recent attempt at a table represent a hypothetically possible HV "model"?

I know it wouldn't match the observed correlations but in terms of adhering to passing and not passing filters; or is it way off?

 

[Lynch101]

Sorry, I know ye must be sick of seeing my confused tables at this stage, but I'm hoping it makes it easier to see the mistakes I'm making, compared to my attempts to put it in writing.

In this table I was assuming photon pairs which are anti-correlated at each angle. I weighted cases [1] & [8] such that they occur much more frequently than the others - as opposed to less frequently in my previous thinking. For ease of editing and reading, I put cases [1] & [8] together on the table.

Would those photon pairings be possible or am I (again) overlooking something*?

*This is more of a rhetorical question.

 

[Lynch101]

I still can't see where I'm going wrong in the above, with photons and filters, but I tried it out with electron spins and I think it's a bit clearer to me now - assuming the below is right.

D = Different outcomes e.g. Up/Down.

 

[PeterDonis]

I weighted cases [1] & [8] such that they occur much more frequently than the others

Why would you do that?

 

[PeterDonis]

I tried it out with electron spins

Which is exactly the same in terms of the scenario under discussion--in both cases you are looking at measurements on two qubits. Your two tables are identical except for you changing some letters around and putting more copies of rows [1] and [8] in your photon table in post #62. But if doing that is not justified with electron spins (which you appear to think it isn't since you didn't do it in post #63), then it's not justified with photon polarizations either.

 

[Lynch101]

Why would you do that?

Just to see if it were, in any way, possible to reproduce the predictions of quantum theory using hidden variables. It could also have prompted a clarification from someone that such a thing is ruled out in principle, which would help to give me a better understanding.

 

[Lynch101]

Which is exactly the same in terms of the scenario under discussion--in both cases you are looking at measurements on two qubits. Your two tables are identical except for you changing some letters around and putting more copies of rows [1] and [8] in your photon table in post #62. But if doing that is not justified with electron spins (which you appear to think it isn't since you didn't do it in post #63), then it's not justified with photon polarizations either.

The changes in letter are to represent the differences in measurement performed (U and D represent spin Up and Down).

Isn't there a slight difference in insofar as with the electron spins, there is always something detected by the measurement device, whereas with the photons, not every photon passes through the filter to the detector.

I didn't weight the cases [1] and [8] in this table because I could see it wouldn't make a difference to the outcomes, whereas it would appear to make a difference in the case of the photon polarisations. In post #36 DrChinese said we are free to change the weighting of the cases, which would suggest that it isn't ruled out in principle.

 

[PeterDonis]

I didn't weight the cases [1] and [8] in this table because I could see it wouldn't make a difference to the outcomes, whereas it would appear to make a difference in the case of the photon polarisations.

Go back and look at your tables again. As I said before, they are identical except for changes in labeling. So if weighting can make a difference for the photon table, it can also make a difference for the electron table.

 

[PeterDonis]

In post #36 DrChinese said we are free to change the weighting of the cases

Yes, and doing so will change the predicted average outcome. It has to: that's just math.

What changing the weighting won't do is give you an average that violates the Bell inequalities or their equivalents; that's impossible on any weighting. In the original table that @DrChinese was commenting on in post #36, every line in the table would contribute at least 0.333 to the average, so it is mathematically impossible to get an average less than 0.333 no matter how you weight the lines. And 0.333 does not violate the relevant inequality for that case. But the QM prediction for that case is 0.25, which does violate the inequality.

In your tables in posts #62 and #63, you've reversed the signs, so to speak, from the original table that @DrChinese was commenting on, so 0.25 or less does not violate the relevant inequality; so the fact that you can get averages of 0.25 or less by changing the weightings, while true, is pointless. You need to compute the correct inequality for that case and then look at what range of averages you are able to obtain by varying the weightings in your table; then you will see that no matter how you vary the weightings, you cannot get an average that violates the correct inequality for that case. And if you compute the correct QM pprediction for that case, you will see that it does violate the inequality.

 

[Lynch101]

Go back and look at your tables again. As I said before, they are identical except for changes in labeling. So if weighting can make a difference for the photon table, it can also make a difference for the electron table.

Is there not a difference in what is being measured and the specific measurement outcomes?

To clarify, am I incorrect in understanding that in tests of Bell's inequality, involving photon pairs where

when the detectors at both sides are set at the same angle we get the opposite results (+ at one detector, - at the other) every single time, probability 100%, no exceptions.

the ["minus"] at a detector means that the detector does not register a photon, because the photon does not pass through a given filter to the detector?

Whereas, in tests involving electron spins, when the stern gerlach magnets are aligned at the same angle, the outcomes are always opposite, but, unlike tests involving photons, the detector always registers a measurement - either "up" or "down" (allowing for detector inefficiencies)?