comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Problem making large (~3GB) .sav files over NFS
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Return to the default flat view Create a new topic Submit Reply
Problem making large (~3GB) .sav files over NFS [message #69680] Wed, 03 February 2010 10:13
JJ is currently offline  JJ
Messages: 36
Registered: January 2007
Member
I seem unable to generate a very large save file in IDL that is not
corrupted when writing to an NFS mounted disk.

In this case, both machines are running fedora 9, running IDL V7.0.
The size of the .sav file is ~3GB. If I save to a disk on the local
machine, everything seems to work fine. I can restore a correctly-
saved file either from a local disk or nfs mounted disk with no
problems. However, when I save to an nfs mounted disk, I seem to get
one of two problems.

a)
IDL> save,filename='test.sav'
% SAVE: Error closing file. Unit: 100, File: test.sav
Input/output error

b)
IDL>save,filename='test.sav'
IDL> .reset
IDL> restore,'test.sav'
% RESTORE: Unexpected item code found in save file.
% RESTORE: Error changing file pointer. Position: 4512370557230081036,
Unit: 100, File: test.sav
Invalid argument
% Execution halted at: $MAIN$

In the first case, it is clear that the file was not correctly saved.
In the second case, IDL thinks the file was correctly saved, but
trying to restore it (either across NFS or locally) shows the file to
be corrupt.

Both machines appear to be speaking to each other using NFS protocol
version 3, which should not have any trouble with large files.

The workaround is to save to a local disk and copy the file later to
where it should be. But I'm trying to work out if there is any
corrective solution. If this is a known problem with an impatient IDL
(and not fixed in the latest release), I guess there's nothing I can
do. On the other hand, maybe it's something I can fix in my NFS.

I did find one very old thread (2001) in this forum about a similar
problem with truncated .sav files in which Reimar Bauer responded "I
know this problem too. ... I got this failure often if my server has
to much NFS traffic. "

Any info/advice appreciated. Thanks.

-Jonathan
[Message index]
 
Read Message
Previous Topic: Extract / interpolate in 3d atmospheric field
Next Topic: overlaying two plots

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Thu Oct 09 23:20:05 PDT 2025

Total time taken to generate the page: 0.55441 seconds