comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Re: How can I export a few million geocoded points from IDL to ArcMap?
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Switch to threaded view of this topic Create a new topic Submit Reply
Re: How can I export a few million geocoded points from IDL to ArcMap? [message #83935] Thu, 18 April 2013 04:11
Fabzi is currently offline  Fabzi
Messages: 305
Registered: July 2010
Senior Member
On 04/18/2013 12:54 PM, Tom Grydeland wrote:
>
> We will try this route. Thanks!
>
> --T
>

Cool. But then, don't forget to use David's NCDF_FILE tool:

http://www.idlcoyote.com/programs/ncdf_file__define.pro

And don't forget to set /NETCDF4_FORMAT at the initialization of new
files if you want to generate files greater then 2Gb

Cheers,

Fab
Re: How can I export a few million geocoded points from IDL to ArcMap? [message #83936 is a reply to message #83935] Thu, 18 April 2013 03:54 Go to previous message
tom.grydeland is currently offline  tom.grydeland
Messages: 51
Registered: September 2012
Member
On Tuesday, April 16, 2013 1:13:21 PM UTC, Fabien wrote:
> CSV files of more than 4 Gb size is an absolute nogo to me...

Agreed.

> Usually and for almost all purposes I could think of, NCDF files is the
> best format I know for geolocalized data. Especially since version 4,
> with large files support and compression option. I don't know how does
> ArcMap handle those, though...

Looks like it can be handled in a useful way:

http://resources.arcgis.com/en/help/main/10.1/index.html#/as _a_point_feature_layer/004600000012000000/

We will try this route. Thanks!

> Fab

--T
Re: How can I export a few million geocoded points from IDL to ArcMap? [message #83968 is a reply to message #83936] Tue, 16 April 2013 06:13 Go to previous message
Fabzi is currently offline  Fabzi
Messages: 305
Registered: July 2010
Senior Member
CSV files of more than 4 Gb size is an absolute nogo to me...

Usually and for almost all purposes I could think of, NCDF files is the
best format I know for geolocalized data. Especially since version 4,
with large files support and compression option. I don't know how does
ArcMap handle those, though...

Fab


On 04/16/2013 02:49 PM, dave poreh wrote:
> On Tuesday, April 16, 2013 2:01:53 PM UTC+2, Tom Grydeland wrote:
Re: How can I export a few million geocoded points from IDL to ArcMap? [message #83969 is a reply to message #83968] Tue, 16 April 2013 05:49 Go to previous message
d.poreh is currently offline  d.poreh
Messages: 406
Registered: October 2007
Senior Member
On Tuesday, April 16, 2013 2:01:53 PM UTC+2, Tom Grydeland wrote:
> Hi all,
>
>
>
> I'm working on a geospatial application where the end product is a few million points worth of timeseries. At the moment, we're producing as much as 20 million points, with as many as 50 points in the time series in every point, plus ~10 other attributes per point.
>
>
>
> The user imports the processed results into ArcMap for visualization and analysis. For smaller data sets, I've exported ESRI Shapefiles (IDLffShape), which has worked well, but I'm bumping against the 2 GB file size limit now. IDL appears to write files up to 4 GB that ArcMap can read (both programs disregarding the spec in the same way), but 4 GB appears to be the final limit.
>
>
>
> Does anyone know of other alternatives equally accessible from IDL and ArcMap alike?
>
>
>
> ESRI file geodatabase appears to be a good fit, with API available. Has anyone made an IDL API for it?
>
>
>
> Other suggestions?
>
>
>
> --T (Tom.Grydeland@norut.no)

What About CSV files. If you write it in CSV, you could import it to ArcMap directly.
Cheers,
Dave
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: Re: The limits of !NULL
Next Topic: cgArrow Solid keyword with a cgWindow

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 15:49:32 PDT 2025

Total time taken to generate the page: 0.00556 seconds