The socks of Mr. Bertlmann

It seems that I created quite a stir with my prior post and despite knee jerk emotional rants to the contrary which were mostly absurd misunderstandings like I am secretly a believer in classical physics, what I said there is still completely correct (up to grammatical mistakes and typos). One point of genuine disagreement however were about the well known paper of Bell: "Bertlmann's socks and the nature of reality" which I discovered it is greatly misinterpreted and misunderstood. There were other genuine disagreements which I will get to in future posts but I can only address one issue at a time. Today I will try to explain the Bertlmann's socks paper in the larger context of Bell's results.

Let me first set the stage. From its discovery, quantum mechanics was a constant source of debates and disagreements. Einstein had a great dispute with Bohr, Schrodinger did not like quantum mechanics implications and he concocted his famous cat in the box example. Less known is the position of Karl Popper, the discoverer of the falsifiability criterion. In 1959 Popper was trashing Heisenberg's uncertainly relations. His point was that the uncertainty relations correspond to physical characteristics after measurement and in principle there is no precision limitation to defining the position and momenta of a particle and so in his opinion Mr. Heisenberg was unnecessarily jumping to conclusions in his positivist approach. Then he said the following (this is a translation from English to Romanian and back to English so the original quote may be sightly different, but the meaning is clear enough):

"Because any proof of this kind must use quantum theory considerations applied to individual particles, hence formal probability statements, this must be translated word for word in statistical language. If we do that, we'll see that there is no contradiction between the particular measurements assumed to be precise and quantum theory in its statistical interpretation."

Why is this important? After all Popper is not know today to be a quantum guy. However back in 59 he was quite influential developing his own interpretation of quantum mechanics and the fact that he is not known today is because he was wrong and naturally got forgotten. But people today sometimes state that Bell's inequalities were already old news and Bell did not do much. My point is simply that around that time people were not aware of of those inequalities and Bell's results came as a shock.

So Bell put Popper's nonsense to rest with his result and showed that there is a contradiction in statistical terms between any local realistic theory and quantum mechanics. How? By the use of his correlation inequality. Bell had several motivations and today I will present his ideas from one particular point of view skipping the usual discussion with von Neumann. Bell started the analysis with the Bohm and Aharonov variant of the EPR gedankenexperiment in which a source of electrons emits pairs of electrons in a total spin zero state:

$$|\Psi\rangle = \frac{1}{\sqrt{2}}( |up \rangle_{left} |down \rangle_{right} - |down \rangle_{left} |up \rangle_{right} )$$

Measuring the spins for the left particle on direction a and for the right particle on direction b yields the correlation $$-a \cdot b$$ or minus the cosine of the angle between the two measuring directions. Can this be explained if the spins had pre-existing values before measurement? If the measurement directions are perfectly aligned, anti-aligned, or orthogonal, from total spin conservation it is easy to predict that the measurement correlations would be -1, 1, and 0 no matter what. And what would happen if the two electrons would have the spins on opposite directions to preserve the total spin zero state, but their spins would be randomly distributed in space? After about a page of an integration exercise you can convince yourself that the correlation would be in this case $$-\frac{1}{3}a \cdot b$$, so case close, right? Bell arrived at this -1/3 result too but he did not like it enough to ask to be put to an experimental test and he looked further. He noticed that the slope of the correlation curve is zero when the directions are parallel and that looked strange.

Can he arrive at this kind of correlation curve $$P(a, b)$$ while assuming that the outcomes A for Alice and B for Bob depend only on the local measurement direction (no superluminal signaling), on some hidden variable $$\lambda$$ and (very important) respecting the factorization condition below?

$$P(a,b) = <A(a, \lambda) B(b, \lambda) >$$

where the angle brackets mean average over $$\lambda$$. This factorization is the famous Bell locality condition in which the outcomes depend only on the local physics (the directions a and b in the local laboratories) and on a shared randomness "hidden variable" $$\lambda$$ assumed to be generated at the moment of the emission of the two electrons.

So Mr. Bell discovered that for any theory obeying the factorization condition from above he would not get a zero slope correlation curve but a "kink". See the picture below from another Bell paper entitled: "Einstein-Podolsky-Rosen experiments"

Also from the factorization (Bell's locality) condition from above it is not hard to obtain Bell's original inequality:

$$1+ P(b, c) \geq |P(a, b) - P(a,c)|$$

But what does this mean and why is the correlation slope flat for quantum mechanics and is a straight line for classical physics (which does obey Bell's locality condition). The key is in the factorization or lack of. Take a look at the singlet state wavefunction from above. You cannot factorize it between the left and right particles and you do not get the straight line correlation curve. The existence of the flat curve of quantum mechanics requires a different explanation. Enter the Bertlmann's socks paper now.

There are several Bell inequalities, and quantum mechanics and Nature does violate them. But why? The key pedagogical simplification came from Bernard d'Espagnat which came with this silly but true statement:

"The number of young women is less then or equal to the number of women smokers plus the number of young non-smokers"

Let's explain this better with Venn diagrams:

and let us call Women the set A, Non-smokers the set B, and Old the set C. Then the statement reads:

A and not C <= A and not B + B and not C

Is this true? Let's check:

A and not C = areas 1+6
A and not B = areas 1+2
B and not C = areas 5+6

A and not B B and not C = areas 1,6,2, 5 which is larger or equal with the areas 1 + 6 (equal when the areas 2 and 5 contain no elements).

So far so good, but what does this have to do with quantum mechanics and Nature? Mr.Berltmann enters now the stage:

Dr. Bertlmann was an eccentric person who was always wearing socks of different colors. As soon as you see the color of one of his sock you know the other one is not the same. Now in this case the socks have definite colors before you look at them which is different than the spin direction in the electron case which does not exist before measurement and this is the key difference. Can we put this in an exact mathematical statement and more important, can we test this in an actual experiment to show electrons are not like the socks of Dr. Bertlmann?

Now back to d'Espagnat, thank you Dr. Bertlmann for providing humor to a serious physics, mathematical, and philosophical problem.

When a characteristic (be it color of socks, gender, smoker status, color of eyes, etc) exists independent of measurement then the natural way to describe it is using the concept of a set because you can perform the simple test of belonging to your set or not and the result in unambiguous: you are either inside the set, or you are outside. You are either a smoker or you are not, you are male or a female, etc.

Sticking with socks for now, Mr. Bell considered 3 sets, A, B, and C as follows:

A=the number of socks which survive 1000 washes at 0 degrees Celsius
B=the number of socks which survive 1000 washes at 45 degrees Celsius
C=the number of socks which survive 1000 washes at 90 degrees Celsius

Then following the Venn diagram from above he considered if :

A and not B + B and not C >= A and not C

which would be true. But does this inequality hold for electrons as well? You cannot "wash 1000 times an electron at 45 degrees Celsius", but you can detect if the spin records up when measuring it with a Stern-Gerlach device oriented at 45 degree angle. So if the spin orientation of the electron exists independent of measurement we can have the following 3 sets:

A=the electron records spin up when passing through a Stern-Gerlach device oriented at 0 degrees
B=the electron records spin up when passing through a Stern-Gerlach device oriented at 45 degrees
C=the electron records spin up when passing through a Stern-Gerlach device oriented at 90 degrees

Sure, but what to do about this business of "A and not B". You cannot pass at the same time through two detectors! But here is the trick: you have two electrons in the singlet state. Moreover you know that no matter what direction you chose for the left detector, if the right detector is opposite aligned, both detectors will record the same answer because of the total spin conservation. Therefore "A and not B" means now that the left particle clicks up when measured at 0 degrees, and the right particle clicks up (which from spin conservation is equivalent with the left particle clicking down or the left particle not clicking up) when measured at 45 degrees. Sure, there is a bit of counterfactual reasoning, but it works.

So now we have another genuine Bell inequality:

the number of [left electrons clicking up when measured on 0 degrees and right electrons clicking up when measured on 45 degrees]
+
the number of [left electrons clicking up when measured on 45 degrees and right electrons clicking up when measured on 90 degrees]
>=
the number of [left electrons clicking up when measured on 0 degrees and right electrons clicking up when measured on 90 degrees]

And those 3 numbers can be easily computed using quantum mechanics and the answer is...

$$\frac{1}{2} \sin^2(22.5) + \frac{1}{2} \sin^2 (22.5) \geq \frac{1}{2} \sin^2(45)$$

or

0.1464 >= 0.2500 !!!!!!!!!!

And guess what? Not only quantum mechanics violates this inequality, Nature does it too just as quantum mechanics predicts it does.

So what happened? How can this be true? In quantum mechanics sets and Boolean logic do not apply. When you measure something in quantum mechanics you project to a subspace of the Hilbert space and the Boolean logic changes to the logic of projections. When a system has a property like say spin this is not representable as a point in a set. The Venn diagrams have to be generalized from flat circles in a plane to subspaces and their intersection is not as naive as in the picture above. Quantum OR and Quantum NOT are very different than classical OR and classical NOT. All this is because of the novel property of superposition which does not exist in classical physics. Superposition is what makes the Hilbert space a relevant mathematical description to what is going on.

And this is the business of Bertlmann's socks paper.

Now back to the misuse and misunderstandings of this paper. Last time I stated:

"[I cannot take Schack's Bertlmann comment at face value as this would imply he disagrees with Bell's mathematical statements from his famous Bertlmann's socks paper and that would be wrong]."

to which Lubos Motl objected. When you state that "quantum correlations are like Bertlmann socks" at face value you state that there are no differences between classical and quantum correlations and that the difference between the kink vs flat curve of correlations is not there. The big point of Bertlmann's socks paper is that quantum and classical correlations are fundamentally different. And this is not me stating it, it does not come from a faulty understanding of the paper, but it is stated by Bell himself in the very first sentences of the paper and you cannot get more explicit than that:

"The philosopher in the street, who has not suffered a course in quantum mechanics, is quite unimpressed by Einstein-Podolsky-Rosen correlations. He can point to many examples of similar correlations in everyday life. The case of Bertlmann's socks is often cited."

If the correlation curves are not fundamentally different, then you can create classical models of quantum effects, which in turn means that the spin has a definite orientation before measurement. But I know Schack does not believe that because he always emphasizes the importance of Kochen-Specker theorem. The right way to understand his statement was as I stated before:  quantum correlations are just correlations and no explanations are needed in general and I agree with this point of view because there is no way to explain them by reduction to hidden variables which is the content of Bell's theorem. [My position is a bit stronger than what QBism advocates. QBism appeals to the trip between Alice and Bob needed to be able to compute the correlations and this makes perfect sense in their approach. I however say respect nature for what it is and just stop whining about the lack of an explanation to appease your classical intuition which is the result of biological evolutionary pressures.]

But stating it like this: "quantum correlations are like Bertlmann's socks" invites protests and follow up clarification questions from the people who do understand very well the Bertlmann's socks paper. In other words, it adds spice to conversation and it is a provocation for reaction, a friendly poke aimed at the Bell experts who may also (but not always-I am a counterexample and I am not alone) believe in something more: beables. But beables, the unfinished research project of Bell, are a topic for another time.

Also, back to Bell's factorization condition. This is called Bell locality and next time I'll dig into it some more. Nature violates Bell locality precisely because nature is quantum mechanical and not classical mechanical. It does not mean you can send signals faster than the speed of light and violate relativity. If you have a problem with the name you are not alone, but you are in a minority, tough luck, this is a standard term now. If you want to change it, do something really important in the foundations of quantum mechanics on par with what Bell did and then rename it to whatever you like. Calling the foundations community idiots leads nowhere.

Side announcement: I will be going on vacation for a week tomorrow and I will not have internet access. Therefore I will not be able to read or reply to reactions about this post. My next post will also be a bit delayed.

Update: I just came back from a trip to Alaska and I'll need a couple of days to get up to speed and write the next post. You can expect it at the end of Monday.

Is Nature is Local or Nonlocal?

In quantum mechanics there are two strong points of view. On one hand the philosophers of physics insist that Bell showed us that nature is nonlocal: "What Bell Did", and on the other hand qubists and practitioners of high energy physics stress that nature is purely local and there is no "tickle at a distance". Now  last time I called this debate sterile because both sides are right as they talk about different things. Also I have yet to meet supporters of a camp not agreeing with the mathematical points of the other camp, and so it is all purely a matter of perspective. Hidden behind this seeming disagreement are the epistemic and ontic points of view.

Let's try to disentangle the arguments and explain this local-nonlocal divide. Let's start with the case for nonlocality. This point of view starts with quantum correlations. In the words of Bell: "correlations cry out for explanations". Now only two kinds of explanations for correlations were ever found:
1. common causes from the past
2. an event causing the other one
and neither of them are valid explanations for quantum mechanics correlations. The first kind of explanation falls under local hidden variable approach and this was disproved by Bell, while the second kind is forbidden by the special theory of relativity because spatial separated experiments were performed where there was not enough time for the signal to propagate from Alice to Bob side. The absence of a third explanation is typically stated as nonlocality. Mathematically this is expressed as violation of Bell's locality condition:

$$p(s, t | a, b) = p^1 (s|a) p^2 (t|b)$$

which is equivalent with parameter and outcome independence.

Now no qbist is denying that quantum mechanics violates parameter and outcome independence because this is a solid mathematical and experimental fact. But the local point of view starts with no-signaling, or the inability of Alice to influence the outcomes for Bob (and unsurprisingly no nonlocality supporter is denying this either). In the QBist point of view, each measurement is local and quantum mechanics is a tool which updates my personal degree of belief in order to make sense of what I observe. The Alice-Bob correlations can only be determined when the two sides come in contact and for this to happen travel at speeds lower than the speed of light is required.

To better understand this debate I encourage you to watch this meeting moderated by Brian Greene.

At 1:22:00 Rudiger Schack makes a provocative statement: quantum correlations are like Bertlmann socks. I think this is just an extravagant way of saying that quantum correlations are just correlations and no explanations are needed in general. [I cannot take Schack's Bertlmann comment at face value as this would imply he disagrees with Bell's mathematical statements from his famous Bertlmann's socks paper and that would be wrong].

Now since both sides agree on the mathematics and on experiments, but disagree on interpretation maybe there is a middle ground. Abner Shimony introduced the expression: "passion at a distance" but in the charged atmosphere of today in quantum foundations this is not a popular point of view.

Behind the local-nonlocal debate there is a fracture of interpretation: is quantum mechanics ontic or epistemic? Jean Bricmont expresses best the ontic point of view around 4: 35 in the interview below:

"you need a theory about the world whose fundamental concepts are not expressed, the meaning is not expressed in terms of measurment".

The opposing epistemic point of view was best expressed by late Asher Peres: "quantum mechanics while correct it is not universal, some things must remain unanalyzed".

For now the supporters of each camp do not agree at all with the opposite point of view and seems that nothing can change their minds as each position is perfectly self-consistent. But what is my position because I am neither in the epistemic nor in the ontic camp?

First, Asher Peres position is wrong because his argument is pure handwaving inspired by Godel's incompletness theorem. In Godel's proof there is this key step of arithmetization of syntax without which the proof falls apart, and this is missing from Peres' musings. More important, quantum mechanics can be reconstructed from the assumption of its universality. I believe the epistemic point of view is essentially correct, but I disagree that the Bayesian point of view gives you the complete story. In fact I predict that quantum collapse happens in nature by itself (similar with spontaneous symmetry breaking) and that there is a boundary between quantum and classical due to dynamically generated superselection rules. This implies a testable extension of the quantum formalism and I'll talk about this in future posts. The same approach which allowed me to reconstruct quantum mechanics from physical principles predicts a unique extension of quantum formalism using Grothendieck group construction. Let experiments decide if I am right or wrong.

I also think the basic demand expressed by Jean Bricmont is perfectly valid, but I disagree that the Bohmian interpretation is the way to go. The main fault of Bohmian's approach is distinguishing the complex number formalism of quantum mechanics and splitting the wavefunction into the real and imaginary parts. The quantum harmonic oscillator can be successfully solved in phase space or in the quaternionic formalisms and one obtains the same predictions. However the actual representations are very different in mathematical terms, and who says complex wavefunctions deserves ontic status and quaternionic wavefunctions do not?

Finally, is nature local or nonlocal? Local or nonlocal are bad words lacking a precise enough meaning. Nature is pure quantum mechanical, quantum mechanics is universal, locality-independent and no-signaling.

Impressions from Vaxjo

I just came back from the QTFT conference in Vaxjo which was excellently organized by Professor Andrei Khrennikov.

I have a ton of interesting information to report from there but for today, still suffering the jet lag and organizing my notes, I will only paint an impressionistic view of the conference experience.

I have never been to Sweden before and I was pleasantly surprised to see how well Sweden is connected to the world. Everyone I met spoke English without any accent, the small Vaxjo town was cozy, and the hotel had excellent service on par with three times as expensive hotels in US. A strange experience was the short dark hours, due to the Nordic latitude, and I can only imagine how winter would look like. Also it was rather cold, like a nice November day but it got warm as the week progressed. If you walk from town to the university you go around two beautiful lakes and the surroundings provided a very nice setting for quantum mechanics private discussions.

The conference featured a lecture from Theodor Hänsch, the recipient of the 2005 Physics Nobel Prize. Then the conference placed the focused on several interesting and essential in my opinion areas: experiment and interpretation, qubism, categorical quantum mechanics, quantum-like models outside physics.

I was able to learn that we may be about two years away from experimental confirmation or rejection of the current GRW-type collapse models, I understood the finer points of distinction between Copenhagen and qbism interpretation, I experienced the amazing depth of the category theory usage in quantum mechanics (and I think the time to launch a journal dedicated to this is fast approaching), and I got delighted by quantum-like effects in psychology.

The discussions happened on four levels: during the formal presentations, during the coffee breaks, during walks around the lakes on the trips back to town, and in the welcoming arms of the Bishop: the local pub where many fine points of quantum interpretations were very seriously debated until the closing hours.

I found it surprising to see the passion that Bell's theorem still elicits as well as the debate between locality vs. nonlocality in quantum mechanics. The funny part is that both sides agree that quantum mechanics violates Bell's locality condition which is the essential part, and as a neutral observer (since I have my own interpretation) the fight looks to me completely sterile and useless.

I also discovered that I am not the only one bitten by the hope to solve Hilbert's sixth problem one day.

Overall, it was a very pleasant and extremely productive time for me and I wish I will be able to return to this conference every year.

A modern take on the old measurement problem

The measurement problem in quantum mechanics is the key to understand various interpretations. There are many approaches to it: some say it is not a real problem, or that parts of it are not real but pseudo-problems, some claim that Bohr had figured it out already, some state that since there are so many solutions to it is not really interesting anymore, or some think that if only they would have enough time (perhaps an afternoon) to think about it they will solve it.

Now the best way to explain it was done by Tim Maudlin in http://web.mit.edu/bskow/www/111-S11/maudlin_measurement.pdf

In particular I like his quote from Feynman:

"[We] always have had (secret, secret, close the doors!) we always have had a great deal of difficulty in understanding the world view that quantum mechanics represents. At least I do, because I'm an old enough man that haven't got to the point that this stuff is obvious to me. Okay, I still get nervous with it... you know how it always is, every new idea, it takes a generation or two until it becomes obvious that there's no real problem. I cannot define the real problem, therefore I suspect there's no real problem, but I'm not sure there's no real problem."

Without expanding on all generality of Tim's well known paper, here is the basic "trilemma":
1. The wavefunction specifies completely the physical properties of a physical system
2. The wavefunction evolves linearly according to Schrodinger's equation
3. Experiments have definite outcomes

Now any two statements from above contradict the third one. Denying number one corresponds to adding "hidden variables" and Bohmian's approach falls in here. Denying number two is the approach taken by collapse theories like GRW, and denying number three is the approach of MWI.

QBism stands apart from the three approaches above in that it denies the measurement problem altogether: http://arxiv.org/pdf/1311.5253v1.pdf and tries to convince us that "there is no real problem" as Feynman would put it.

Now to this "classical" approach to the measurement problem, efforts in quantum mechanics reconstruction point to a basic mathematical inconsistency which place the measurement problem in a new light. So there is a "real problem". One can obtain quantum mechanics from invariance of the laws of nature under composition and Leibniz identity: http://arxiv.org/abs/1505.05577 . In the algebraic approach to quantum mechanics it is well known that Leibniz identity corresponds to unitarity and hence any unitary violation renders the entire quantum formalism mathematically inconsistent: quantum formalism+collapse = contradiction.

So how can we solve this? Here are the existing quantum mechanics interpretation solutions:
1. Extend the formalism: GRW
2. Remove the collapse: Bohmian
3. Provide contextual protection: MWI and QBism
For MWI the context is the world branch which results after the split, for QBism the context is the subjective experience of the experimenter in the sense of De Finetti: collapse is a mere update of information happening inside your mind.

There is another variant on extending the formalism. In spontaneous collapse theories the evolution is stochastic and outside quantum formalism. However the quantum formalism can be extended to include collapse and there is a unique mathematical way to do it. I will talk about this next week at the QTFT conference in Vaxjo and then I'll expand it here at this blog.

This predicts new physics and quantum mechanics interpretation will be put to an experimental test.

My next post will be delayed a bit due to travel, but it will contain fresh insights from the conference. Please stay tuned.