Comparing floating-point numbers

[DrMasik]

I'm down crazy (angry) with lua tonight:

1 2 3 4 5 6 7 8 9 10 11 12 13

function func1() LOG(var1); LOG(var2); LOG("type var1 is ".. type(var1)); LOG("type var2 is ".. type(var2));   LOG("var1 - var2 = ".. (var1 - var2));   if var1 == var2 then   LOG("EQ"); else   LOG("NEQ"); end

Output:

Code:

Log: [02:05:47] 0.8
Log: [02:05:47] 0.8
Log: [02:05:47] type var1 is number
Log: [02:05:47] type var2 is number
Log: [02:05:47] var1 - var2 = -1.1102230246252e-16
Log: [02:05:47] NEQ

[worktycho]

Thats just IEEE floating point. Which is why for the server we use "var1 - var2 < x" where x is something like 0.0001 for equality.

---

http://floating-point-gui.de/errors/comparison/

[DrMasik]

I'm fix the error

1 2 3 4 5 6 7

var1 = tostring(var1); var2 = tostring(var2);   LOG(var1); LOG(var2);   ...

[jan64]

That's a bit inefficient, worktycho's way with epsilon is better, imo.

[DrMasik]

That's a bit inefficient, worktycho's way with epsilon is better, imo.

I'm do not understand how does it work in worktycho's way.

[jan64]

something like this:

Code:

if math.abs( var1 - var2 ) < 1e-3 then
   -- equal
else
    -- not equal
end