What’s 1000.2 minus 1000? It’s not a trick question, but you might find your computer tells you the answer is 0.200012, and not the 0.2 you might expect. It’s a perfect example of the difference between precision and accuracy: the computer’s got it wrong to six decimal places. Tim Mattson and Ken Strandberg have written [...]
Filed under: Multicore, Parallelism, Programming | Tagged: maths | Leave a Comment »





