Why do 0.1 and 1/10 work but 0.3-0.2 doesn't?

  • Python
  • Thread starter SamRoss
  • Start date
  • Tags
    Work
In summary: It is worse than I thought:>>> print(0.3-0.2)0.09999999999999998What is this awful precision?What do you expect ##0.1 - 2^{-55}## to look like?If you want to reduce precision you can do that yourself using either Math.round or sigfig.round as appropriate.
  • #106
anorlunda said:
Haven't we flogged this topic to death yet?
I think it's machine esilon away from death and, due to finite precision arithmetic, it always will be...
 
  • Like
  • Haha
Likes vela and jbriggs444
Technology news on Phys.org
  • #108
After moderator review, the thread will remain closed as the topic has been sufficiently discussed and the OP is long gone. Thanks to all who participated!
 
  • Like
Likes scottdave

Similar threads

Python How do for loops work in python?
Replies
5
Views
1K
Python finchessboardcorners function doesn't work properly on my images
Replies
2
Views
676
Python Query runs fine in MySQL, but returns empty list in Python
Replies
7
Views
2K
Python What is the Winning Probability in Monte Carlo Spinner Game?
Replies
3
Views
1K
Python UnimplementedError: Cast string to float is not supported
Replies
5
Views
3K
Finding the "Runner Up" (Second Highest Value)
Replies
29
Views
2K
Python Python: Semidefinite program with CVXPy 'Error parsing inputs'
Replies
2
Views
1K
Python Re: Python’s Sympy Module and the Cayley-Hamilton Theorem
Replies
3
Views
693
Python Why Order Matters in an 'and' Statement
Replies
5
Views
2K
Solving Fourier's Law w/ Splines & Derivatives
Replies
2
Views
1K

Hot Threads

Recent Insights

Back
Top