What Probability book suits me better?

In summary, the conversation focused on finding the best books for learning rigorous probability and applying it to statistical mechanics. The person asking for help mentioned their previous knowledge in calculus, introductory statistics, and combinatorics. Several books were recommended, including Probability Theory: The Logic of Science by E.T. Jaynes and Introduction to Probability by Charles M. Grinstead and J. Laurie Snell. The topic of using the information-theoretic approach was also discussed, with a suggestion for the book Principles of Statistical Mechanics by Amnon Katz. The conversation also touched on the importance of understanding non-measure theoretic probability before delving into rigorous probability, and the potential usefulness of taking a real analysis course. Ultimately, the recommendation was made to start with
  • #1
Pallatinus
19
1
I found those books in my library and I want to know which suits better for me. (Want to learn rigorous Probability AND applies it to statistical mechanics) Previous knowledge: Calculus 1 and 2, Introductory Statistics and Combinatorics.

Books:
Probability Theory: The Logic of Science - E.T. Jaynes
Introduction to Probability - Charles M. Grinstead and J. Laurie Snell
Probability with a View Toward Statistics - Volume I and II - J. Hoffmann-Jorgensen
Probability for Applications - Paul E. Pfeiffer
Probability - Jim Pitman
Probability and Measure - Patrick Billingsley
Any other book...
 
Physics news on Phys.org
  • #2
You should, perhaps, just read a statistics textbooks. Since you seem to be more on the mathematical side, maybe one using the infromation-theoretic approach is good (I favorize this approach very much compared to the more oldfashioned handwavy way to introduce entropy, and it's by far the most comprehensive way to introduce this key issue). My favorite book for both classical and quantum statistical physics using the information-theoretical approach is

Katz, Amnon: Principles of Statistical Mechanics, W. H. Freeman and Company, 1967
 
  • Like
Likes Demystifier
  • #3
vanhees71 said:
You should, perhaps, just read a statistics textbooks. Since you seem to be more on the mathematical side, maybe one using the infromation-theoretic approach is good (I favorize this approach very much compared to the more oldfashioned handwavy way to introduce entropy, and it's by far the most comprehensive way to introduce this key issue). My favorite book for both classical and quantum statistical physics using the information-theoretical approach is

Katz, Amnon: Principles of Statistical Mechanics, W. H. Freeman and Company, 1967
Thanks for the help! Information-theoretical approach is exactly what I'm looking for, but do you know if any of these books I mentioned will be a good complement? or I just don't need any?
 
  • #4
I don't know any of these books. So I can't say anything about them.
 
  • #5
I'm familiar with two of the books:

Billingsley is a measure-theoretic book aimed at graduate students in math or statistics. With only two calculus courses under your belt it is likely much too advanced.

Jaynes is book different from any other I have seen. He treats probability as an extension of logic. I don't recommend learning the basics from it at all, but after you are comfortable with probability and statistics it is worth borrowing from your library to see if it is your cup of tea. Jaynes was a physicist that did a lot of work in statistical physics, information theory, probabilility and statistics. He strongly favors bayesian and entropy based approaches, and wrote a couple of well-known papers in the 1950s on information theory and statistical mechanics. You can find them linked int he references here:
https://en.wikipedia.org/wiki/Maximum_entropy_thermodynamics

I find his book to be fascinating, but it rambles and has a bunch of passages that read almost like he is replaying old arguments he has had with colleagues.

Good luck,

Jason

EDIT: I should have let you know that Jaynes' book does not really spend any time on statistical physics, it is almost all on probability and statistical inference. His papers are the place to look for that treatment. He does have one chapter on repeatable experiments like coin flipping, where he discusses the relationship between the deterministic laws of physics and the "random" nature of coins, dice, etc.
 
Last edited:
  • Like
Likes Pallatinus
  • #6
A very nice book https://www.amazon.com/dp/052100618X/?tag=pfamazon01-20
It's choice of topics is really impressive. Its treatment is not that rigorous that it requires very advanced mathematics, but it's not handwaving either. It's one of the best books I've seen, I wish I could have used this when I learned probability. (I learned it from Billingsley which is still my favorite book on probability and one of my favorite books of all time, but I wish I started with something easier).
 
Last edited by a moderator:
  • Like
Likes Pallatinus
  • #7
If you want to learn "rigorous" probability, you will need to know measure theory (real analysis) first...then you can read Paul Halmos' measure theory book.
 
  • Like
Likes Pallatinus
  • #8
Hercuflea said:
If you want to learn "rigorous" probability, you will need to know measure theory (real analysis) first...then you can read Paul Halmos' measure theory book.

Correct, but I do not recommend learning rigorous probability without a good knowledge of how non-measure theoretic probability works. And perhaps measure theory is not needed for the OP, he should look into in what extend it is useful for him.
 
  • #9
He said he wants to learn rigorous probability and how it applies to statistical mechanics. I agree he should take an undergrad probability and statistics course first, but statistical mechanics is still an active area of research in probability and if he is interested in that in the future maybe he should move towards that by starting with real analysis.

edit* he has had an undergrad statistics course already.
 
  • #10
Hercuflea said:
He said he wants to learn rigorous probability and how it applies to statistical mechanics. I agree he should take an undergrad probability and statistics course first, but statistical mechanics is still an active area of research in probability and if he is interested in that in the future maybe he should move towards that by starting with real analysis.

edit* he has had an undergrad statistics course already.

Sure he says he wants to learn rigorous probability. But perhaps he doesn't know what rigorous probability entails precisely and whether it would be useful. The measure theoretic approach is not useful for most.
 
  • #11
I appreciate for all the help, I reach the conclusion that I should first use Weighing and Odds, It seems that is well fit for me in the moment and use Jaynes as supplement. I pretend to take a real analysis course next year and maybe use a measure theory book.
 
  • #12
micromass said:
A very nice book https://www.amazon.com/dp/052100618X/?tag=pfamazon01-20
It's choice of topics is really impressive. Its treatment is not that rigorous that it requires very advanced mathematics, but it's not handwaving either. It's one of the best books I've seen, I wish I could have used this when I learned probability. (I learned it from Billingsley which is still my favorite book on probability and one of my favorite books of all time, but I wish I started with something easier).

Looking to get into probability. The goal is to atleast be able to get through and understand Kolmogorov's book on probability.

Is this at the same level of Ross: A first Course Of Probability?
 
  • #13
MidgetDwarf said:
Looking to get into probability. The goal is to atleast be able to get through and understand Kolmogorov's book on probability.

Is this at the same level of Ross: A first Course Of Probability?

Yes, it is at the same level of Ross. But I think the book I quoted contains much more exciting material. A downside is that it really really lacks problems. Ross does have a lot of problems, but very few seem really mathematically interesting in the sense that most are applications of the theory and are plug and chug. Such problems are important, but I since you're into math, you should also want more theoretical problems.
Did Morin's book come out yet? He will likely have very nice problems.
 
  • #14
micromass said:
Yes, it is at the same level of Ross. But I think the book I quoted contains much more exciting material. A downside is that it really really lacks problems. Ross does have a lot of problems, but very few seem really mathematically interesting in the sense that most are applications of the theory and are plug and chug. Such problems are important, but I since you're into math, you should also want more theoretical problems.
Did Morin's book come out yet? He will likely have very nice problems.

I believe Morin's book came out yet. Here is the link https://www.amazon.com/dp/1523318678/?tag=pfamazon01-20
not sure if this is the book you are referring to.

Hmm. I may order both since they are inexpensive. I never got a stinker book recommendation from you.

Do you know of any good problem books for Geometry, Calculus, and probability?
 
Last edited by a moderator:
  • #15
MidgetDwarf said:
I believe Morin's book came out yet. Here is the link https://www.amazon.com/dp/1523318678/?tag=pfamazon01-20
not sure if this is the book you are referring to.

Hmm. I may order both since they are inexpensive. I never got a stinker book recommendation from you.

Oh wow, the Morin book looks really nice. Too bad I couldn't see any of the problems in the book, but knowing Morin I think they'll be rather challenging. Seriously thinking of buying the book even though I know everything in there.

Do you know of any good problem books for Geometry, Calculus, and probability?

You mean books with only problems? No, sorry, I don't really look at such books.
 
Last edited by a moderator:
  • #16
micromass said:
Oh wow, the Morin book looks really nice. Too bad I couldn't see any of the problems in the book, but knowing Morin I think they'll be rather challenging. Seriously thinking of buying the book even though I know everything in there.
You mean books with only problems? No, sorry, I don't really look at such books.
Thank you. I went ahead and ordered both books. I won't be able to go through them until 2 months from now. Have to review some older math topics for work.
I read the pages on available on Amazon, and the writing for Morin's book seems crystal clear, fun, and engaging.
 

FAQ: What Probability book suits me better?

1. What is the difference between a beginner's probability book and an advanced one?

A beginner's probability book typically covers the basics of probability, including concepts like probability rules, conditional probability, and Bayes' theorem. An advanced probability book may cover more complex topics such as Bayesian networks, Markov chains, and stochastic processes. It may also assume prior knowledge of mathematical concepts like calculus and linear algebra.

2. Are there any recommended probability books for self-study?

Yes, there are several recommended probability books for self-study, such as "Introduction to Probability" by Joseph K. Blitzstein and Jessica Hwang, "A First Course in Probability" by Sheldon Ross, and "Probability: For the Enthusiastic Beginner" by David Morin. These books are well-structured, include ample practice problems, and provide clear explanations of key concepts.

3. Can you recommend a probability book for someone with a strong background in mathematics?

For someone with a strong background in mathematics, "Probability Theory: The Logic of Science" by E.T. Jaynes is a highly recommended book. It delves into the mathematical foundations of probability theory, including measure theory and axiomatic probability. It also covers advanced topics like decision theory and maximum entropy.

4. What probability book is best for someone looking to apply probability in real-world scenarios?

"Think Bayes: Bayesian Statistics in Python" by Allen B. Downey is a great choice for those looking to apply probability in real-world scenarios. It uses a hands-on approach, teaching readers how to use the Python programming language to solve probability problems. It also covers topics like hypothesis testing and Bayesian inference, which are commonly used in real-world applications.

5. Is there a probability book that is suitable for both beginners and advanced readers?

"Introduction to Probability" by Dimitri P. Bertsekas and John N. Tsitsiklis is a highly recommended book for both beginners and advanced readers. It covers the fundamentals of probability, but also includes more advanced topics like random processes and Martingales. It is well-written and includes plenty of examples and exercises for all levels of readers.

Back
Top