comp.lang.idl-pvwave archive: archive » Faster way to search/split a string?

Home » Public Forums » archive » Faster way to search/split a string?

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Faster way to search/split a string? [message #78484]

Wed, 23 November 2011 04:13

rjp23
Messages: 97
Registered: June 2010

Member

I was hoping that someone might have a cleverer way of approaching
this problem.

The following command is the bootleneck in my code:

row_of_data=strsplit(all_rows[(where(stregex(all_rows, id, /boolean)
eq 1))[0]],' ', /extract)

I have a large text file with lots of columns of data (which I don't
know exactly what the columns are until I've read them in). There are
then say 10000 rows of this data.

This is all read into one large string array (all_rows) which contains
each row as a single very long string.
The first 20 characters of the row contain a unique id which I need to
search the rows for and then extract the entire matching row. This row
then needs to be split up into it's columns (space delimited).

Hopefully that all makes sense.

The problem is having to do this 10000 times, (once for for each id)
is very slow and the time to do all of the other stuff done in the
code, reading, writing, some maths, etc is being dominated by this one
line.

Any thoughts or suggestions?

Cheers

Rob

p.s. This needs to be GDL compatible as well which I think most
solutions would be anyway.

Report message to a moderator

[Message index]

		Faster way to search/split a string? By: rjp23 on Wed, 23 November 2011 04:13
		Re: Faster way to search/split a string? By: Vincent Sarago on Wed, 23 November 2011 10:15

Previous Topic:	IDL QUESTIONS (INTERPOLATION)
Next Topic:	Re: Faster way to search/split a string?

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 17:11:50 PDT 2025

Total time taken to generate the page: 0.00448 seconds