AgreeableLandscapeM to Programmer Humor · 4 years ago0.1 + 0.2imagemessage-square2fedilinkarrow-up137arrow-down10
arrow-up137arrow-down1image0.1 + 0.2AgreeableLandscapeM to Programmer Humor · 4 years agomessage-square2fedilink
minus-squareMsFlammkuchen@lemmy.blahaj.zonelinkfedilinkarrow-up3·1 year agoFloating point arithmetic Basically, every floating point number represents a range of numbers. Which can lead to small errors like this. It has also to do with trying to represent a decimal number in binary, which works fine for integers but not for rational numbers.
Floating point arithmetic
Basically, every floating point number represents a range of numbers. Which can lead to small errors like this. It has also to do with trying to represent a decimal number in binary, which works fine for integers but not for rational numbers.