watch window double precision vars shown as single precision LPC1768
When debugging my GPS application, the watch window is only showing what appears to be single precision for my doubles.
The only way to view the doubles is to create another variable carrying only the fractional part of my double and multiplying that by 1000
eg
double value longitude = 147.2465233333 degrees
Watch value displayed = 147.247 (Very low precision)
To see the precision level I require I have to create a second var and initially strip the integer part and multiply the result by 1000
double fraction = (longitude - 147.0) * 1000.0 = 2465.23
I then then manually divide the result on paper by 1000 to get 0.246523 then add it to the integer part to get 147.246523
surely there is a way to show double precision numbers in the watch window using the decimal setting?
Mark
Please sign in to leave a comment.
Comments
2 comments