Skip to content Skip to sidebar Skip to footer
Showing posts with the label Floating Accuracy
Python Representation Of Floating Point Numbers

Python Representation Of Floating Point Numbers

Post a Comment
I spent an hour today trying to figure out why return abs(val-desired) Solution 1: Yes, this can b… Read more Python Representation Of Floating Point Numbers
Is There A Way To Return A Fully Reduced Ratio When Calling .as_integer_ratio()?

Is There A Way To Return A Fully Reduced Ratio When Calling .as_integer_ratio()?

Post a Comment
I noticed something strange when calling .as_integer_ratio() on some floats. for example: (2.2).as_… Read more Is There A Way To Return A Fully Reduced Ratio When Calling .as_integer_ratio()?
Why Is Rounding 0.5 (decimal) Not Exact?

Why Is Rounding 0.5 (decimal) Not Exact?

Post a Comment
One half, i.e. 0.5 in decimal, has an exact binary representation: 0.1 Nevertheless, if I round it … Read more Why Is Rounding 0.5 (decimal) Not Exact?