comp.lang.idl-pvwave archive: archive » Merits of different ways of 'extending' arrays

Home » Public Forums » archive » Merits of different ways of 'extending' arrays

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Merits of different ways of 'extending' arrays [message #85728 is a reply to message #85726]

Thu, 29 August 2013 09:29

David Fanning
Messages: 11724
Registered: August 2001

Senior Member

AMS writes:

> This has the drawback that I have to know in advance the maximum number of data points I could have (but I can set max_points to some arbitrary high number to be safe). Does anyone know whether any one method is better/less memory-intensive than the other, when it comes to largeish data volumes (tens of millions of points)? I only have a few percent of the final data so far, so am interested in the likely merits of each method. Google didn't help but perhaps I was using
the wrong search keywords.

You are MUCH better off to allocate memory in large chucks and then trim
or add to your arrays (in more large chunks) as necessary. This will
keep you from fragmenting your memory space, which is the single biggest
problem when working with large arrays.

Cheers,

David

--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.idlcoyote.com/
Sepore ma de ni thue. ("Perhaps thou speakest truth.")

Report message to a moderator

[Message index]

		Merits of different ways of 'extending' arrays By: Andy Sayer on Thu, 29 August 2013 08:44
		Re: Merits of different ways of 'extending' arrays By: Andy Sayer on Thu, 29 August 2013 08:57
		Re: Merits of different ways of 'extending' arrays By: David Fanning on Thu, 29 August 2013 09:29
		Re: Merits of different ways of 'extending' arrays By: Andy Sayer on Thu, 29 August 2013 09:59
		Re: Merits of different ways of 'extending' arrays By: chris_torrence@NOSPAM on Thu, 29 August 2013 10:11
		Re: Merits of different ways of 'extending' arrays By: Andy Sayer on Thu, 29 August 2013 10:13
		Re: Merits of different ways of 'extending' arrays By: Fabzi on Fri, 30 August 2013 02:54
		Re: Merits of different ways of 'extending' arrays By: Michael Galloy on Fri, 30 August 2013 14:08
		Re: Merits of different ways of 'extending' arrays By: suicidaleggroll on Mon, 09 September 2013 15:41
		Re: Merits of different ways of 'extending' arrays By: suicidaleggroll on Tue, 10 September 2013 13:08
		Re: Merits of different ways of 'extending' arrays By: Andy Sayer on Sat, 14 September 2013 18:11
		Re: Merits of different ways of 'extending' arrays By: suicidaleggroll on Mon, 16 September 2013 07:47
		Re: Merits of different ways of 'extending' arrays By: Andy Sayer on Tue, 17 September 2013 10:40
		Re: Merits of different ways of 'extending' arrays By: Yngvar Larsen on Tue, 17 September 2013 12:34
		Re: Merits of different ways of 'extending' arrays By: Michael Galloy on Tue, 17 September 2013 14:47

Previous Topic:	IDL X11 forwarding segmentation fault
Next Topic:	defining structure after ascii template

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 04:48:43 PDT 2025

Total time taken to generate the page: 0.32205 seconds