comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Most significant digit and formatting floating point output
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Return to the default flat view Create a new topic Submit Reply
Most significant digit and formatting floating point output [message #81095] Tue, 07 August 2012 06:33
Helder Marchetto is currently offline  Helder Marchetto
Messages: 520
Registered: November 2011
Senior Member
Dear all,
well, I'm tangled up with something quite stupid, but I don't want to reinvent the wheel (for the 10th time today...).
Here are two versions of the same question:
1) Short version: given a number such as 0.003456789 how do I get the most significant digit position? I need this number to produce formatted output that would convert the number to simply 0.003. In general I can figure this out with some IFs and stuff like that, but I'm hoping there is a more "elegant" way for this.

2) Long version: I'm analyzing some images and I get results with errors. These numbers are floating point and I would like to format the output so that it looks something like this: 'My results are (0.123 +/- 0.003) units' and the source data is:
Result = 0.123456789
Error = 0.003456789
The point is that I need to find the first non-zero element in Error. Then I would use this number in the FORMAT parameter like this: MyFormat = '(f0'+STRTRIM(FirstNonZeroElement+2,2)+'.'+STRTRIM(FirstNonZ eroElement,2)+')'
and use "MyFormat" as formatting for the string conversion of both.
(in the above example FirstNonZeroElement should be 3 and MyFormat would be '(f05.3)'.

Thanks in advance for any help.

Cheers,
Helder
[Message index]
 
Read Message
Previous Topic: Comparing two arrays or different lengths and looking for values within a given range
Next Topic: How to choose the best rendering system ?

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 18:52:37 PDT 2025

Total time taken to generate the page: 0.00384 seconds