tedlarson
Joined: 03 Oct 2003 Posts: 13
|
Floating point precision |
Posted: Fri Mar 25, 2005 11:35 pm |
|
|
I have an application that needs to do alot of floating point calculations, and the round-off and truncation error is killing it. By the time the calcs are done I get the wrong answer completely.
Everyone on this forum suggests using fixed point arithmetic. Does anyone know where I can get a fixed point library that is CCS compatible, that will give me 3.8 capable math, with sin, cos, tan, asin, atan, and sqrt capability?
Seems like it would be a huge undertaking to write such a library from scratch.
Thanks,
-Ted |
|