comp.lang.idl-pvwave archive: archive » Re: comparing and concatenating arrays...please help!!

Home » Public Forums » archive » Re: comparing and concatenating arrays...please help!!

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: comparing and concatenating arrays...please help!! [message #37576 is a reply to message #37573]

Fri, 09 January 2004 01:50

wmconnolley
Messages: 106
Registered: November 2000

Senior Member

Martin Doyle <m.doyle@uea.ac.uk> wrote:
> My files are _huge_. File 1 is about 250000 lines and file2 about half
> that. which is why my code was taking about 4 days!

Here is my initial entry in the obfusticated solution using perl.
However, I think I misread you because in whats below I've assumed
that dates for each ob exist in each file. If you only want output
when both match, and throw away what doesn't have equiv's in both files,
then use the alternative last line.

#!/bin/perl

@f1=split("\n",`cat f1`);
@f2=split("\n",`cat f2`);

for (@f1) { ($y,$m,$d,$h,$r)=(/(....) (..) (..) (..) (.*)/); $f1{"$y $m $d $h"}=$r };
for (@f2) { ($y,$m,$d,$h,$r)=(/(....) (..) (..) (..) (.*)/); $f2{"$y $m $d $h"}=$r };

for $k (sort keys %f1) { print "$k $f1{$k} $f2{$k}\n" };

# Alternative output line
# for $k (sort keys %f1) { if ($f1{$k} and $f2{$k} ) { print "$k $f1{$k} $f2{$k}\n" } };

This should be fast (a few mins at most) if all the data fits into your memory at
once, as it ought to. You can write "reverse" in front of sort if you want it
backwards.

-W.

--
William M Connolley | wmc@bas.ac.uk | http://www.antarctica.ac.uk/met/wmc/
Climate Modeller, British Antarctic Survey | Disclaimer: I speak for myself
I'm a .signature virus! copy me into your .signature file & help me spread!

Report message to a moderator

[Message index]

		Re: comparing and concatenating arrays...please help!! By: R.Bauer on Fri, 09 January 2004 09:55
		Re: comparing and concatenating arrays...please help!! By: btt on Fri, 09 January 2004 07:30
		Re: comparing and concatenating arrays...please help!! By: wmconnolley on Fri, 09 January 2004 01:50
		Re: comparing and concatenating arrays...please help!! By: Michael Wallace on Thu, 08 January 2004 15:36
		Re: comparing and concatenating arrays...please help!! By: Pepijn Kenter on Thu, 08 January 2004 14:57
		Re: comparing and concatenating arrays...please help!! By: Michael Wallace on Thu, 08 January 2004 13:22
		Re: comparing and concatenating arrays...please help!! By: m.doyle on Thu, 08 January 2004 12:26
		Re: comparing and concatenating arrays...please help!! By: Pepijn Kenter on Thu, 08 January 2004 05:25

Previous Topic:	Passing from from IDL to external lib (DLM)
Next Topic:	Re: Problem masking multiple regions.

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sun Oct 12 04:21:22 PDT 2025

Total time taken to generate the page: 0.79521 seconds