comp.lang.idl-pvwave archive: archive » READ

Home » Public Forums » archive » READ_CSV() gotcha

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

READ_CSV() gotcha [message #90721]

Fri, 03 April 2015 10:44

wlandsman
Messages: 743
Registered: June 2000

Senior Member

The documentation for READ_CSV() describes how a column is stored as Double, rather than an integer type, if it has a decimal point or an exponent.

What it doesn't say is that READ_CSV() only looks at the first 100 rows, so that if these first 100 numbers are compatible with an integer (no decimal points or exponents) then the entire column is read as an integer. In my case, the data becomes floating point after about 2000 rows (with values between 0 and 1), so these are all truncated to zero.

There doesn't seem to be an easy fix, e.g. a way to force a column to be read as Double, so I ended up writing a specialized reader. --Wayne

Report message to a moderator

[Message index]

		READ_CSV() gotcha By: wlandsman on Fri, 03 April 2015 10:44
		Re: READ_CSV() gotcha By: penteado on Wed, 08 April 2015 16:36

Previous Topic:	FIT_ELLIPSE
Next Topic:	CXFORM on WinXP

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 11:55:22 PDT 2025

Total time taken to generate the page: 0.00256 seconds