| Re: Random NetCDF I/O error [message #74181] |
Mon, 03 January 2011 14:40 |
Kenneth P. Bowman
Messages: 585
Registered: May 2000
|
Senior Member |
|
|
In article <8oeqofFed0U1@mid.dfncis.de>,
Fabzou <fabien.maussion@tu-berlin.de> wrote:
> Dear IDLers,
>
> I am using IDL to post-process a large amount of NCDF files, e.g.
> creating new NCDF files by copying parts of many original files.
>
> I am using IDL Version 7.1.1 (linux x86_64 m64) WITH the ITT "NCDF Large
> File support" patch for linux.
>
> I noticed that a very annoying unpredictable error occurs once in a
> while, e.g:
>
> NCDF_VARPUT: Operation Failed, bad file (7208960) or variable (6) id ?
> (NC_ERROR=-101)
>
> Again, the error occurs randomly, but after many experiments I came to
> these conclusions:
> - this happens very often when working on files stored on network drives
> - this happens often when working on files stored on external USB drives
> - this happens often when other processes are running parallel to IDL
> - this happens less often when using IDL in command line (without
> workbench)
>
> Are other IDL users experiencing similar problems? Is it platform
> specific or Version specific?
>
> I'd be grateful for any tip! Thanks in advance,
>
> Fab
This could be unrelated to IDL or netCDF. We had similar problems
reading/writing large files on Linux systems (with IDL). The problem
turned out to be the SCSI controller for our RAID. Switching
from the SCSI controller on the motherboard to a controller
in a card slot solved the problem. It could have been drivers or
the controller hardware on the motherboard that caused the problem.
Ken Bowman
|
|
|
|
| Re: Random NetCDF I/O error [message #74183 is a reply to message #74181] |
Mon, 03 January 2011 13:01  |
penteado
Messages: 866
Registered: February 2018
|
Senior Member
Administrator |
|
|
On Jan 3, 6:59 pm, Paulo Penteado <pp.pente...@gmail.com> wrote:
> On Jan 3, 6:43 pm, Fabzou <fabien.mauss...@tu-berlin.de> wrote:
>
>> Are other IDL users experiencing similar problems? Is it platform
>> specific or Version specific?
>
> I never saw this, even when I had several IDL processes running at the
> same time, each going through tens of thousands of NCDF files. The
> files were always small (at most a few MB), and only a few (2 or 3)
> would be open simultaneously in the same session. That was in the days
> of 7.0, with no patches, always on local hard drives, usually with
> batch jobs executed from the terminal (they were running remotely
> through screen, thus without the Workbench).
Forgot to say that it was always in 64-bit Linux.
|
|
|
|
| Re: Random NetCDF I/O error [message #74184 is a reply to message #74183] |
Mon, 03 January 2011 12:59 |
penteado
Messages: 866
Registered: February 2018
|
Senior Member
Administrator |
|
|
On Jan 3, 6:43 pm, Fabzou <fabien.mauss...@tu-berlin.de> wrote:
> Are other IDL users experiencing similar problems? Is it platform
> specific or Version specific?
I never saw this, even when I had several IDL processes running at the
same time, each going through tens of thousands of NCDF files. The
files were always small (at most a few MB), and only a few (2 or 3)
would be open simultaneously in the same session. That was in the days
of 7.0, with no patches, always on local hard drives, usually with
batch jobs executed from the terminal (they were running remotely
through screen, thus without the Workbench).
|
|
|
|
comp.lang.idl-pvwave archive
Members
Search
Help
Login
Home
