| Determining number of good data points over certain dimensions of an array [message #93429] |
Wed, 13 July 2016 07:37  |
cb16
Messages: 3
Registered: July 2016
|
Junior Member |
|
|
Hello!
I have a four dimensional array in IDL. The dimensions are as follows:
(longitude, latitude, time, parameter type)
There are a lot of missing values over space in my data, so I'm trying to to get the number of good values in a lon-lat area. To do this, I'm finding missing values and setting them to NaNs, then using knowledge about the total number of missing values, the total number of good values, and the sizes of my dimensions to get what I want.
In doing this - more for my own peace of mind than anything else - I also check that there are no missing values over the time dimension (there shouldn't be since I'm working with climatological data, but the dataset documentation doesn't explicitly say this) or between the parameters I'm working with (the nature of the data implies that there also shouldn't be, but again, I want to double check because documentation is not explicit).
Anyways, I believe my code does all of the above, but I'm not sure. I'd very much appreciate some confirmation and/or help.
Code below:
;Find missing values and set them to NaNs
bad = WHERE(data EQ -9999.0, count, COMPLEMENT = good, NCOMPLEMENT = count_g)
IF (count GT 0) THEN data[bad] = !Values.F_NaN
;Check that there are only missing values over space, not time or between BRDF params
IF ((count MOD ntime) NE 0) OR ((count MOD 3) NE 0) THEN MESSAGE, 'There are time series values missing, or missing values between BRDF params. Check data.'
;Get number of good values in a lat-lon area
count_g = (count_g/3)/ntime
(To clarify, the 3 corresponds to the size of the fourth dimension, the parameter type.)
I use MOD because I figure that if missing values are only over lon and lat dimensions, then the total number of missing values is the number of missing values in a lon-lat area multiplied by the sizes of the other dimensions. So, the total number of missing values should divide evenly into the time and parameter type dimensions. If this is true, then the number of good values in a lon-lat area is just the total number of good values divided by the time and parameter type dimensions.
Many thanks in advance.
|
|
|
|
comp.lang.idl-pvwave archive
Members
Search
Help
Login
Home
