Next: , Up: Statistics


26.1 Descriptive Statistics

One principal goal of descriptive statistics is to represent the essence of a large data set concisely. Octave provides the mean, median, and mode functions which all summarize a data set with just a single number corresponding to the central tendency of the data.

— Function File: mean (x)
— Function File: mean (x, dim)
— Function File: mean (x, opt)
— Function File: mean (x, dim, opt)

Compute the mean of the elements of the vector x.

          mean (x) = SUM_i x(i) / N

If x is a matrix, compute the mean for each column and return them in a row vector.

The optional argument opt selects the type of mean to compute. The following options are recognized:

"a"
Compute the (ordinary) arithmetic mean. [default]
"g"
Compute the geometric mean.
"h"
Compute the harmonic mean.

If the optional argument dim is given, operate along this dimension.

Both dim and opt are optional. If both are supplied, either may appear first.

See also: median, mode.

— Function File: median (x)
— Function File: median (x, dim)

Compute the median value of the elements of the vector x. If the elements of x are sorted, the median is defined as

                      x(ceil(N/2)),             N odd
          median(x) =
                      (x(N/2) + x((N/2)+1))/2,  N even

If x is a matrix, compute the median value for each column and return them in a row vector. If the optional dim argument is given, operate along this dimension.

See also: mean, mode.

— Function File: mode (x)
— Function File: mode (x, dim)
— Function File: [m, f, c] = mode (...)

Compute the most frequently occurring value in a dataset (mode). mode determines the frequency of values along the first non-singleton dimension and returns the value with the highest frequency. If two, or more, values have the same frequency mode returns the smallest.

If the optional argument dim is given, operate along this dimension.

The return variable f is the number of occurrences of the mode in in the dataset. The cell array c contains all of the elements with the maximum frequency.

See also: mean, median.

Using just one number, such as the mean, to represent an entire data set may not give an accurate picture of the data. One way to characterize the fit is to measure the dispersion of the data. Octave provides several functions for measuring dispersion.

— Function File: range (x)
— Function File: range (x, dim)

Return the range, i.e., the difference between the maximum and the minimum of the input data. If x is a vector, the range is calculated over the elements of x. If x is a matrix, the range is calculated over each column of x.

If the optional argument dim is given, operate along this dimension.

The range is a quickly computed measure of the dispersion of a data set, but is less accurate than iqr if there are outlying data points.

See also: iqr, std.

— Function File: iqr (x)
— Function File: iqr (x, dim)

Return the interquartile range, i.e., the difference between the upper and lower quartile of the input data. If x is a matrix, do the above for first non-singleton dimension of x.

If the optional argument dim is given, operate along this dimension.

As a measure of dispersion, the interquartile range is less affected by outliers than either range or std.

See also: range, std.

— Function File: meansq (x)
— Function File: meansq (x, dim)

Compute the mean square of the elements of the vector x.

          std (x) = 1/N SUM_i x(i)^2

For matrix arguments, return a row vector containing the mean square of each column.

If the optional argument dim is given, operate along this dimension.

See also: var, std, moment.

— Function File: std (x)
— Function File: std (x, opt)
— Function File: std (x, opt, dim)

Compute the standard deviation of the elements of the vector x.

          std (x) = sqrt ( 1/(N-1) SUM_i (x(i) - mean(x))^2 )

where N is the number of elements.

If x is a matrix, compute the standard deviation for each column and return them in a row vector.

The argument opt determines the type of normalization to use. Valid values are

0:
normalize with N-1, provides the square root of the best unbiased estimator of the variance [default]
1:
normalize with N, this provides the square root of the second moment around the mean

If the optional argument dim is given, operate along this dimension.

See also: var, range, iqr, mean, median.

In addition to knowing the size of a dispersion it is useful to know the shape of the data set. For example, are data points massed to the left or right of the mean? Octave provides several common measures to describe the shape of the data set. Octave can also calculate moments allowing arbitrary shape measures to be developed.

— Function File: var (x)
— Function File: var (x, opt)
— Function File: var (x, opt, dim)

Compute the variance of the elements of the vector x.

          var (x) = 1/(N-1) SUM_i (x(i) - mean(x))^2

If x is a matrix, compute the variance for each column and return them in a row vector.

The argument opt determines the type of normalization to use. Valid values are

0:
normalize with N-1, provides the best unbiased estimator of the variance [default]
1:
normalizes with N, this provides the second moment around the mean

If the optional argument dim is given, operate along this dimension.

See also: cov, std, skewness, kurtosis, moment.

— Function File: skewness (x)
— Function File: skewness (x, dim)

Compute the skewness of the elements of the vector x.

          skewness (x) = N^(-1) std(x)^(-3) sum ((x - mean(x)).^3)

If x is a matrix, return the skewness along the first non-singleton dimension of the matrix. If the optional dim argument is given, operate along this dimension.

See also: var, kurtosis, moment.

— Function File: kurtosis (x)
— Function File: kurtosis (x, dim)

Compute the kurtosis of the elements of the vector x.

          kurtosis (x) = N^(-1) std(x)^(-4) sum ((x - mean(x)).^4) - 3

If x is a matrix, return the kurtosis over the first non-singleton dimension of the matrix. If the optional dim argument is given, operate along this dimension.

Note: The definition of kurtosis above yields a kurtosis of zero for the stdnormal distribution and is sometimes referred to as "excess kurtosis". To calculate kurtosis without the normalization factor of -3 use moment (x, 4, 'c') / std (x)^4.

See also: var, skewness, moment.

— Function File: moment (x, p)
— Function File: moment (x, p, type)
— Function File: moment (x, p, dim)
— Function File: moment (x, p, type, dim)
— Function File: moment (x, p, dim, type)

Compute the p-th moment of the vector x about zero.

          moment (x) = 1/N SUM_i x(i)^p

If x is a matrix, return the row vector containing the p-th moment of each column.

The optional string type specifies the type of moment to be computed. Valid options are:

"c"
Central Moment. The moment about the mean defined as
               1/N SUM_i (x(i) - mean(x))^p

"a"
Absolute Moment. The moment about zero ignoring sign defined as
               1/N SUM_i ( abs(x(i)) )^p

"ac"
Absolute Central Moment. Defined as
               1/N SUM_i ( abs(x(i) - mean(x)) )^p

If the optional argument dim is given, operate along this dimension.

If both type and dim are given they may appear in any order.

See also: var, skewness, kurtosis.

— Function File: q = quantile (x, p)
— Function File: q = quantile (x, p, dim)
— Function File: q = quantile (x, p, dim, method)

For a sample, x, calculate the quantiles, q, corresponding to the cumulative probability values in p. All non-numeric values (NaNs) of x are ignored.

If x is a matrix, compute the quantiles for each column and return them in a matrix, such that the i-th row of q contains the p(i)th quantiles of each column of x.

The optional argument dim determines the dimension along which the quantiles are calculated. If dim is omitted, and x is a vector or matrix, it defaults to 1 (column-wise quantiles). If x is an N-D array, dim defaults to the first non-singleton dimension.

The methods available to calculate sample quantiles are the nine methods used by R (http://www.r-project.org/). The default value is METHOD = 5.

Discontinuous sample quantile methods 1, 2, and 3

  1. Method 1: Inverse of empirical distribution function.
  2. Method 2: Similar to method 1 but with averaging at discontinuities.
  3. Method 3: SAS definition: nearest even order statistic.

Continuous sample quantile methods 4 through 9, where p(k) is the linear interpolation function respecting each methods' representative cdf.

  1. Method 4: p(k) = k / n. That is, linear interpolation of the empirical cdf.
  2. Method 5: p(k) = (k - 0.5) / n. That is a piecewise linear function where the knots are the values midway through the steps of the empirical cdf.
  3. Method 6: p(k) = k / (n + 1).
  4. Method 7: p(k) = (k - 1) / (n - 1).
  5. Method 8: p(k) = (k - 1/3) / (n + 1/3). The resulting quantile estimates are approximately median-unbiased regardless of the distribution of x.
  6. Method 9: p(k) = (k - 3/8) / (n + 1/4). The resulting quantile estimates are approximately unbiased for the expected order statistics if x is normally distributed.

Hyndman and Fan (1996) recommend method 8. Maxima, S, and R (versions prior to 2.0.0) use 7 as their default. Minitab and SPSS use method 6. matlab uses method 5.

References:

Examples:

          x = randi (1000, [10, 1]);  # Create empirical data in range 1-1000
          q = quantile (x, [0, 1]);   # Return minimum, maximum of distribution
          q = quantile (x, [0.25 0.5 0.75]); # Return quartiles of distribution

See also: prctile.

— Function File: q = prctile (x)
— Function File: q = prctile (x, p)
— Function File: q = prctile (x, p, dim)

For a sample x, compute the quantiles, q, corresponding to the cumulative probability values, p, in percent. All non-numeric values (NaNs) of x are ignored.

If x is a matrix, compute the percentiles for each column and return them in a matrix, such that the i-th row of y contains the p(i)th percentiles of each column of x.

If p is unspecified, return the quantiles for [0 25 50 75 100]. The optional argument dim determines the dimension along which the percentiles are calculated. If dim is omitted, and x is a vector or matrix, it defaults to 1 (column-wise quantiles). When x is an N-D array, dim defaults to the first non-singleton dimension.

See also: quantile.

A summary view of a data set can be generated quickly with the statistics function.

— Function File: statistics (x)
— Function File: statistics (x, dim)

Return a vector with the minimum, first quartile, median, third quartile, maximum, mean, standard deviation, skewness, and kurtosis of the elements of the vector x.

If x is a matrix, calculate statistics over the first non-singleton dimension. If the optional argument dim is given, operate along this dimension.

See also: min, max, median, mean, std, skewness, kurtosis.