Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado
Re: How can I export a few million geocoded points from IDL to ArcMap?
On Tuesday, April 16, 2013 2:01:53 PM UTC+2, Tom Grydeland wrote: > Hi all, > > > > I'm working on a geospatial application where the end product is a few million points worth of timeseries. At the moment, we're producing as much as 20 million points, with as many as 50 points in the time series in every point, plus ~10 other attributes per point. > > > > The user imports the processed results into ArcMap for visualization and analysis. For smaller data sets, I've exported ESRI Shapefiles (IDLffShape), which has worked well, but I'm bumping against the 2 GB file size limit now. IDL appears to write files up to 4 GB that ArcMap can read (both programs disregarding the spec in the same way), but 4 GB appears to be the final limit. > > > > Does anyone know of other alternatives equally accessible from IDL and ArcMap alike? > > > > ESRI file geodatabase appears to be a good fit, with API available. Has anyone made an IDL API for it? > > > > Other suggestions? > > > > --T (Tom.Grydeland@norut.no) What About CSV files. If you write it in CSV, you could import it to ArcMap directly. Cheers, Dave
CSV files of more than 4 Gb size is an absolute nogo to me... Usually and for almost all purposes I could think of, NCDF files is the best format I know for geolocalized data. Especially since version 4, with large files support and compression option. I don't know how does ArcMap handle those, though... Fab On 04/16/2013 02:49 PM, dave poreh wrote: > On Tuesday, April 16, 2013 2:01:53 PM UTC+2, Tom Grydeland wrote:
On Tuesday, April 16, 2013 1:13:21 PM UTC, Fabien wrote: > CSV files of more than 4 Gb size is an absolute nogo to me... Agreed. > Usually and for almost all purposes I could think of, NCDF files is the > best format I know for geolocalized data. Especially since version 4, > with large files support and compression option. I don't know how does > ArcMap handle those, though... Looks like it can be handled in a useful way: http://resources.arcgis.com/en/help/main/10.1/index.html#/as _a_point_feature_layer/004600000012000000/ We will try this route. Thanks! > Fab --T
On 04/18/2013 12:54 PM, Tom Grydeland wrote: > > We will try this route. Thanks! > > --T > Cool. But then, don't forget to use David's NCDF_FILE tool: http://www.idlcoyote.com/programs/ncdf_file__define.pro And don't forget to set /NETCDF4_FORMAT at the initialization of new files if you want to generate files greater then 2Gb Cheers, Fab