| Re: writing large 3D data file fails [message #68566 is a reply to message #68291] |
Mon, 02 November 2009 14:17   |
A.R.
Messages: 3
Registered: September 2009
|
Junior Member |
|
|
On Oct 14, 1:57 pm, Mark <mark.h...@gmail.com> wrote:
> On Oct 13, 10:58 pm, Dorthe Wildenschild
>
>> Thanks for trying to help, - I really don't know what's wrong, but
>> instead of working out the kinks of IDL, I may just write the volume
>> as 3 or 4 smaller sections... - a bit sad though.
>> Cheers,
>> Dorthe
>
> If that's enough to make you sad, you must be new around these parts.
> My word, I could tell you stories that could make you weep. I'm green
> with envy that you have a system on which you could even consider
> writing a 50 GiB file in one go!
>
> WRITEU doesn't add any leading or trailing bytes by default, so you
> can write it in as many chunks as you like, as long as you get the
> order right. Just loop over the outer (final) dimension.
Hello,
I had a similar problem that I posted to an earlier discussion:
http://groups.google.com/group/comp.lang.idl-pvwave/browse_t hread/thread/c236bbf7a54085ee/0952d20b84caae00?lnk=gst&q =segmentation+fault#0952d20b84caae00
I was also trying to writeu to a volume with larger than 2^31
elements, during which IDL quit due to a segmentation fault. The best
answer I got was that it's just something finnicky with IDL, and that
I should write a bug report to ITTVIS. As a workaround, I wrote a
small piece of code which writes my volume in individual slices to one
large file:
pro write_bindatxl,fname,volume, nz
close,10
openw,10,fname
for i = 0,(nz-1) do writeu,10,volume[*,*,i]
close,10
end
So, this will work to write your data to one file, but the next issue
crops up if you want to re-open it and work with it again. Trying to
'readu' a volume with more than 2^31 elements also crashes IDL due to
a segmentation fault.
If you can figure out how to re-open it, then you'll really make my
day! Still can't figure that one out . . .
|
|
|
|
comp.lang.idl-pvwave archive
Members
Search
Help
Login
Home
