comp.lang.idl-pvwave archive: archive » Re: writing large 3D data file fails

Home » Public Forums » archive » Re: writing large 3D data file fails

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: writing large 3D data file fails [message #68235]

Thu, 08 October 2009 07:26

penteado
Messages: 866
Registered: February 2018

Senior Member
Administrator

On Oct 8, 8:32 am, Nigel Wade <n...@ion.le.ac.uk> wrote:
> I can't test your exact array because I don't have sufficient RAM, that
> array is over 50GB and I only have 32GB.
>
> However, attempting to write a smaller array (fltarr(4008,4008,200),
> which by my reckoning is about 12GB) causes a segmentation violation. The
> resulting file in my case is actually empty.
>
> IDL> volume=fltarr(4008,4008,200)
> IDL> help,/memory
> heap memory used: 12852030500, max: 12916286829, gets: 459,
> frees: 142
> IDL> GET_LUN, lun
> IDL> OPENW, lun,'bigfile'
> IDL> WRITEU, lun, volume
> Segmentation fault
>
> # ls -l bigfile
> -rw-r--r-- 1 root root 0 Oct 8 12:25 bigfile
>
> I don't think WRITEU likes very big files. Maybe it's not built with
> largefile support, and internally uses a 32bit file pointer. I can't see
> why it would be being a 64bit application, but what else might cause the
> error?
>
> --
> Nigel Wade

I do not know if it will be relevant to this case, but there is a page
in the IDL help that specifically talks about some issues that may
occur with large files. It is at

IDL Programmers' Guides > Application Programming > Part II:
Components of the IDL Language > Files and Input/Output > Reading and
Writing Very Large Files

Report message to a moderator

[Message index]

		Re: writing large 3D data file fails By: penteado on Thu, 08 October 2009 07:26
		Re: writing large 3D data file fails By: Nigel Wade on Thu, 08 October 2009 04:32
		Re: writing large 3D data file fails By: dorthe on Thu, 08 October 2009 02:13
		Re: writing large 3D data file fails By: Nigel Wade on Thu, 08 October 2009 01:32
		Re: writing large 3D data file fails By: dorthe on Thu, 08 October 2009 01:10
		Re: writing large 3D data file fails By: JohnSmith on Wed, 07 October 2009 11:01
		Re: writing large 3D data file fails By: David Fanning on Wed, 07 October 2009 09:05
		Re: writing large 3D data file fails By: dorthe on Tue, 13 October 2009 02:58

Previous Topic:	Re: Browse for Cloud-Free MODIS Images
Next Topic:	Re: is there a 3D equivalent of CONTOUR?

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Thu Oct 09 20:09:15 PDT 2025

Total time taken to generate the page: 0.24225 seconds