Continuous uniform distribution

In probability theory and statistics, the continuous uniform distributions or rectangular distributions are a family of symmetric probability distributions. Such a distribution describes an experiment where there is an arbitrary outcome that lies between certain bounds.^[1] The bounds are defined by the parameters, ${\displaystyle a}$ and ${\displaystyle b,}$ which are the minimum and maximum values. The interval can either be closed (i.e. ${\displaystyle [a,b]}$) or open (i.e. ${\displaystyle (a,b)}$).^[2] Therefore, the distribution is often abbreviated ${\displaystyle U(a,b),}$ where ${\displaystyle U}$ stands for uniform distribution.^[1] The difference between the bounds defines the interval length; all intervals of the same length on the distribution's support are equally probable. It is the maximum entropy probability distribution for a random variable ${\displaystyle X}$ under no constraint other than that it is contained in the distribution's support.^[3]

${\displaystyle {\mathbf {\text{Continuous uniform distribution}}}}$${\displaystyle {\mathbf {{\text{with parameters }}{\mathcal {a}}{\text{ and }}{\mathcal {b}}}}}$

Probability density function Using maximum convention
Cumulative distribution function
Notation	${\displaystyle {\mathcal {U}}_{[a,b]}}$
Parameters	${\displaystyle -\infty <a<b<\infty }$
Support	${\displaystyle [a,b]}$
PDF	${\displaystyle {\begin{cases}{\frac {1}{b-a}}&{\text{for }}x\in [a,b]\\0&{\text{otherwise}}\end{cases}}}$
CDF	${\displaystyle {\begin{cases}0&{\text{for }}x<a\\{\frac {x-a}{b-a}}&{\text{for }}x\in [a,b]\\1&{\text{for }}x>b\end{cases}}}$
Mean	${\displaystyle {\tfrac {1}{2}}(a+b)}$
Median	${\displaystyle {\tfrac {1}{2}}(a+b)}$
Mode	${\displaystyle {\text{any value in }}(a,b)}$
Variance	${\displaystyle {\tfrac {1}{12}}(b-a)^{2}}$
MAD	${\displaystyle {\tfrac {1}{4}}(b-a)}$
Skewness	${\displaystyle 0}$
Ex. kurtosis	${\displaystyle -{\tfrac {6}{5}}}$
Entropy	${\displaystyle \ln(b-a)}$
MGF	${\displaystyle {\begin{cases}{\frac {\mathrm {e} ^{tb}-\mathrm {e} ^{ta}}{t(b-a)}}&{\text{for }}t\neq 0\\1&{\text{for }}t=0\end{cases}}}$
CF	${\displaystyle {\begin{cases}{\frac {\mathrm {e} ^{\mathrm {i} tb}-\mathrm {e} ^{\mathrm {i} ta}}{\mathrm {i} t(b-a)}}&{\text{for }}t\neq 0\\1&{\text{for }}t=0\end{cases}}}$

Definitions

Probability density function

The probability density function of the continuous uniform distribution is:

${\displaystyle f(x)={\begin{cases}{\frac {1}{b-a}}&{\text{for }}a\leq x\leq b,\\[8pt]0&{\text{for }}x<a\ {\text{ or }}\ x>b.\end{cases}}}$ 

The values of ${\displaystyle f(x)}$  at the two boundaries ${\displaystyle a}$  and ${\displaystyle b}$  are usually unimportant, because they do not alter the value of ${\textstyle \int _{c}^{d}f(x)dx}$  over any interval ${\displaystyle [c,d],}$  nor of ${\textstyle \int _{a}^{b}xf(x)dx,}$  nor of any higher moment. Sometimes they are chosen to be zero, and sometimes chosen to be ${\displaystyle {\tfrac {1}{b-a}}.}$  The latter is appropriate in the context of estimation by the method of maximum likelihood. In the context of Fourier analysis, one may take the value of ${\displaystyle f(a)}$  or ${\displaystyle f(b)}$  to be ${\displaystyle {\tfrac {1}{2(b-a)}},}$  because then the inverse transform of many integral transforms of this uniform function will yield back the function itself, rather than a function which is equal "almost everywhere", i.e. except on a set of points with zero measure. Also, it is consistent with the sign function, which has no such ambiguity.

Any probability density function integrates to ${\displaystyle 1,}$  so the probability density function of the continuous uniform distribution is graphically portrayed as a rectangle where ${\displaystyle b-a}$  is the base length and ${\displaystyle {\tfrac {1}{b-a}}}$  is the height. As the base length increases, the height (the density at any particular value within the distribution boundaries) decreases.^[4]

In terms of mean ${\displaystyle \mu }$  and variance ${\displaystyle \sigma ^{2},}$  the probability density function of the continuous uniform distribution is:

${\displaystyle f(x)={\begin{cases}{\frac {1}{2\sigma {\sqrt {3}}}}&{\text{for }}-\sigma {\sqrt {3}}\leq x-\mu \leq \sigma {\sqrt {3}},\\0&{\text{otherwise}}.\end{cases}}}$ 

Cumulative distribution function

The cumulative distribution function of the continuous uniform distribution is:

${\displaystyle F(x)={\begin{cases}0&{\text{for }}x<a,\\[8pt]{\frac {x-a}{b-a}}&{\text{for }}a\leq x\leq b,\\[8pt]1&{\text{for }}x>b.\end{cases}}}$ 

Its inverse is:

${\displaystyle F^{-1}(p)=a+p(b-a)\quad {\text{ for }}0<p<1.}$ 

In terms of mean ${\displaystyle \mu }$  and variance ${\displaystyle \sigma ^{2},}$  the cumulative distribution function of the continuous uniform distribution is:

${\displaystyle F(x)={\begin{cases}0&{\text{for }}x-\mu <-\sigma {\sqrt {3}},\\{\frac {1}{2}}\left({\frac {x-\mu }{\sigma {\sqrt {3}}}}+1\right)&{\text{for }}-\sigma {\sqrt {3}}\leq x-\mu <\sigma {\sqrt {3}},\\1&{\text{for }}x-\mu \geq \sigma {\sqrt {3}};\end{cases}}}$ 

its inverse is:

${\displaystyle F^{-1}(p)=\sigma {\sqrt {3}}(2p-1)+\mu \quad {\text{ for }}0\leq p\leq 1.}$ 

Example 1. Using the continuous uniform distribution function

For a random variable ${\displaystyle X\sim U(0,23),}$  find ${\displaystyle P(2<X<18):}$ 

${\displaystyle P(2<X<18)=(18-2)\cdot {\frac {1}{23-0}}={\frac {16}{23}}.}$ 

In a graphical representation of the continuous uniform distribution function ${\displaystyle [f(x){\text{ vs }}x],}$  the area under the curve within the specified bounds, displaying the probability, is a rectangle. For the specific example above, the base would be ${\displaystyle 16,}$  and the height would be ${\displaystyle {\tfrac {1}{23}}.}$ ^[5]

Example 2. Using the continuous uniform distribution function (conditional)

For a random variable ${\displaystyle X\sim U(0,23),}$  find ${\displaystyle P(X>12\ |\ X>8):}$ 

${\displaystyle P(X>12\ |\ X>8)=(23-12)\cdot {\frac {1}{23-8}}={\frac {11}{15}}.}$ 

The example above is a conditional probability case for the continuous uniform distribution: given that ${\displaystyle X>8}$  is true, what is the probability that ${\displaystyle X>12?}$  Conditional probability changes the sample space, so a new interval length ${\displaystyle b-a'}$  has to be calculated, where ${\displaystyle b=23}$  and ${\displaystyle a'=8.}$ ^[5] The graphical representation would still follow Example 1, where the area under the curve within the specified bounds displays the probability; the base of the rectangle would be ${\displaystyle 11,}$  and the height would be ${\displaystyle {\tfrac {1}{15}}.}$ ^[5]

Generating functions

Moment-generating function

The moment-generating function of the continuous uniform distribution is:^[6]

${\displaystyle M_{X}=\mathrm {E} (\mathrm {e} ^{tX})=\int _{a}^{b}\mathrm {e} ^{tx}{\frac {dx}{b-a}}={\frac {\mathrm {e} ^{tb}-\mathrm {e} ^{ta}}{t(b-a)}}={\frac {B^{t}-A^{t}}{t(b-a)}},}$ ^[7]

from which we may calculate the raw moments ${\displaystyle m_{k}:}$ 

${\displaystyle m_{1}={\frac {a+b}{2}},}$ 

${\displaystyle m_{2}={\frac {a^{2}+ab+b^{2}}{3}},}$ 

${\displaystyle m_{k}={\frac {\sum _{i=0}^{k}a^{i}b^{k-i}}{k+1}}.}$ 

For a random variable following the continuous uniform distribution, the expected value is ${\displaystyle m_{1}={\tfrac {a+b}{2}},}$  and the variance is ${\displaystyle m_{2}-m_{1}^{2}={\tfrac {(b-a)^{2}}{12}}.}$ 

For the special case ${\displaystyle a=-b,}$  the probability density function of the continuous uniform distribution is:

${\displaystyle f(x)={\begin{cases}{\frac {1}{2b}}&{\text{for }}-b\leq x\leq b,\\[8pt]0&{\text{otherwise}};\end{cases}}}$ 

the moment-generating function reduces to the simple form:

${\displaystyle M_{X}={\frac {\sinh bt}{bt}}.}$ 

Cumulant-generating function

For ${\displaystyle n\geq 2,}$  the ${\displaystyle n}$ -th cumulant of the continuous uniform distribution on the interval ${\displaystyle [-{\tfrac {1}{2}},{\tfrac {1}{2}}]}$  is ${\displaystyle {\tfrac {B_{n}}{n}},}$  where ${\displaystyle B_{n}}$  is the ${\displaystyle n}$ -th Bernoulli number.^[8]

Standard uniform distribution

The continuous uniform distribution with parameters ${\displaystyle a=0}$  and ${\displaystyle b=1,}$  i.e. ${\displaystyle U(0,1),}$  is called the standard uniform distribution.

One interesting property of the standard uniform distribution is that if ${\displaystyle u_{1}}$  has a standard uniform distribution, then so does ${\displaystyle 1-u_{1}.}$  This property can be used for generating antithetic variates, among other things. In other words, this property is known as the inversion method where the continuous standard uniform distribution can be used to generate random numbers for any other continuous distribution.^[4] If ${\displaystyle u_{1}}$  is a uniform random number with standard uniform distribution, i.e. with ${\displaystyle U(0,1),}$  then ${\displaystyle x=F^{-1}(u_{1})}$  generates a random number ${\displaystyle x}$  from any continuous distribution with the specified cumulative distribution function ${\displaystyle F.}$ ^[4]

Relationship to other functions

As long as the same conventions are followed at the transition points, the probability density function of the continuous uniform distribution may also be expressed in terms of the Heaviside step function as:

${\displaystyle f(x)={\frac {\operatorname {H} (x-a)-\operatorname {H} (x-b)}{b-a}},}$ 

or in terms of the rectangle function as:

${\displaystyle f(x)={\frac {1}{b-a}}\ \operatorname {rect} \left({\frac {x-{\frac {a+b}{2}}}{b-a}}\right).}$ 

There is no ambiguity at the transition point of the sign function. Using the half-maximum convention at the transition points, the continuous uniform distribution may be expressed in terms of the sign function as:

${\displaystyle f(x)={\frac {\operatorname {sgn} {(x-a)}-\operatorname {sgn} {(x-b)}}{2(b-a)}}.}$ 

Properties

Moments

The mean (first raw moment) of the continuous uniform distribution is:

${\displaystyle E(X)=\int _{a}^{b}x{\frac {dx}{b-a}}={\frac {b^{2}-a^{2}}{2(b-a)}}.}$ 

The second raw moment of this distribution is:

${\displaystyle E(X^{2})=\int _{a}^{b}x^{2}{\frac {dx}{b-a}}={\frac {b^{3}-a^{3}}{3(b-a)}}.}$ 

In general, the ${\displaystyle n}$ -th raw moment of this distribution is:

${\displaystyle E(X^{n})=\int _{a}^{b}x^{n}{\frac {dx}{b-a}}={\frac {b^{n+1}-a^{n+1}}{(n+1)(b-a)}}.}$ 

The variance (second central moment) of this distribution is:

${\displaystyle V(X)=E\left({\big (}X-E(X){\big )}^{2}\right)=\int _{a}^{b}\left(x-{\frac {a+b}{2}}\right)^{2}{\frac {dx}{b-a}}={\frac {(b-a)^{2}}{12}}.}$ 

Order statistics

Let ${\displaystyle X_{1},...,X_{n}}$  be an i.i.d. sample from ${\displaystyle U(0,1),}$  and let ${\displaystyle X_{(k)}}$  be the ${\displaystyle k}$ -th order statistic from this sample.

${\displaystyle X_{(k)}}$  has a beta distribution, with parameters ${\displaystyle k}$  and ${\displaystyle n-k+1.}$ 

The expected value is:

${\displaystyle \operatorname {E} (X_{(k)})={k \over n+1}.}$ 

This fact is useful when making Q–Q plots.

The variance is:

${\displaystyle \operatorname {V} (X_{(k)})={k(n-k+1) \over (n+1)^{2}(n+2)}.}$ 

See also: Order statistic § Probability distributions of order statistics

Uniformity

The probability that a continuously uniformly distributed random variable falls within any interval of fixed length is independent of the location of the interval itself (but it is dependent on the interval size ${\displaystyle (\ell )}$ ), so long as the interval is contained in the distribution's support.

Indeed, if ${\displaystyle X\sim U(a,b)}$  and if ${\displaystyle [x,x+\ell ]}$  is a subinterval of ${\displaystyle [a,b]}$  with fixed ${\displaystyle \ell >0,}$  then:

${\displaystyle P{\big (}X\in [x,x+\ell ]{\big )}=\int _{x}^{x+\ell }{\frac {dy}{b-a}}={\frac {\ell }{b-a}},}$ 

which is independent of ${\displaystyle x.}$  This fact motivates the distribution's name.

Generalization to Borel sets

This distribution can be generalized to more complicated sets than intervals. Let ${\displaystyle S}$  be a Borel set of positive, finite Lebesgue measure ${\displaystyle \lambda (S),}$  i.e. ${\displaystyle 0<\lambda (S)<+\infty .}$  The uniform distribution on ${\displaystyle S}$  can be specified by defining the probability density function to be zero outside ${\displaystyle S}$  and constantly equal to ${\displaystyle {\tfrac {1}{\lambda (S)}}}$  on ${\displaystyle S.}$ 

Related distributions

• If X has a standard uniform distribution, then by the inverse transform sampling method, Y = − λ⁻¹ ln(X) has an exponential distribution with (rate) parameter λ.
• If X has a standard uniform distribution, then Y = Xⁿ has a beta distribution with parameters (1/n,1). As such,
• The standard uniform distribution is a special case of the beta distribution, with parameters (1,1).
• The Irwin–Hall distribution is the sum of n i.i.d. U(0,1) distributions.
• The sum of two independent, equally distributed, uniform distributions yields a symmetric triangular distribution.
• The distance between two i.i.d. uniform random variables also has a triangular distribution, although not symmetric.

Statistical inference

Estimation of parameters

Estimation of maximum

Minimum-variance unbiased estimator

Main article: German tank problem

Given a uniform distribution on ${\displaystyle [0,b]}$  with unknown ${\displaystyle b,}$  the minimum-variance unbiased estimator (UMVUE) for the maximum is:

${\displaystyle {\hat {b}}_{\text{UMVU}}={\frac {k+1}{k}}m=m+{\frac {m}{k}},}$ 

where ${\displaystyle m}$  is the sample maximum and ${\displaystyle k}$  is the sample size, sampling without replacement (though this distinction almost surely makes no difference for a continuous distribution). This follows for the same reasons as estimation for the discrete distribution, and can be seen as a very simple case of maximum spacing estimation. This problem is commonly known as the German tank problem, due to application of maximum estimation to estimates of German tank production during World War II.

Maximum likelihood estimator

The maximum likelihood estimator is:

${\displaystyle {\hat {b}}_{ML}=m,}$ 

where ${\displaystyle m}$  is the sample maximum, also denoted as ${\displaystyle m=X_{(n)},}$  the maximum order statistic of the sample.

Method of moment estimator

The method of moments estimator is:

${\displaystyle {\hat {b}}_{MM}=2{\bar {X}},}$ 

where ${\displaystyle {\bar {X}}}$  is the sample mean.

Estimation of midpoint

The midpoint of the distribution, ${\displaystyle {\tfrac {a+b}{2}},}$  is both the mean and the median of the uniform distribution. Although both the sample mean and the sample median are unbiased estimators of the midpoint, neither is as efficient as the sample mid-range, i.e. the arithmetic mean of the sample maximum and the sample minimum, which is the UMVU estimator of the midpoint (and also the maximum likelihood estimate).

Confidence interval

For the maximum

Let ${\displaystyle X_{1},X_{2},X_{3},...,X_{n}}$  be a sample from ${\displaystyle U_{[0,L]},}$  where ${\displaystyle L}$  is the maximum value in the population. Then ${\displaystyle X_{(n)}=\max(X_{1},X_{2},X_{3},...,X_{n})}$  has the Lebesgue-Borel-density ${\displaystyle f={\frac {d\Pr _{X_{(n)}}}{d\lambda }}:}$ ^[9]

${\displaystyle f(t)=n{\frac {1}{L}}\left({\frac {t}{L}}\right)^{n-1}\!=n{\frac {t^{n-1}}{L^{n}}}1\!\!1_{[0,L]}(t),}$  where ${\displaystyle 1\!\!1_{[0,L]}}$  is the indicator function of ${\displaystyle [0,L].}$ 

The confidence interval given before is mathematically incorrect, as

${\displaystyle \Pr {\big (}[{\hat {\theta }},{\hat {\theta }}+\varepsilon ]\ni \theta {\big )}\geq 1-\alpha }$ 

cannot be solved for ${\displaystyle \varepsilon }$  without knowledge of ${\displaystyle \theta }$ . However, one can solve

${\displaystyle \Pr {\big (}[{\hat {\theta }},{\hat {\theta }}(1+\varepsilon )]\ni \theta {\big )}\geq 1-\alpha }$  for ${\displaystyle \varepsilon \geq (1-\alpha )^{-1/n}-1}$  for any unknown but valid ${\displaystyle \theta ;}$ 

one then chooses the smallest ${\displaystyle \varepsilon }$  possible satisfying the condition above. Note that the interval length depends upon the random variable ${\displaystyle {\hat {\theta }}.}$ 

Occurrence and applications

The probabilities for uniform distribution function are simple to calculate due to the simplicity of the function form.^[2] Therefore, there are various applications that this distribution can be used for as shown below: hypothesis testing situations, random sampling cases, finance, etc. Furthermore, generally, experiments of physical origin follow a uniform distribution (e.g. emission of radioactive particles).^[1] However, it is important to note that in any application, there is the unchanging assumption that the probability of falling in an interval of fixed length is constant.^[2]

Economics example for uniform distribution

In the field of economics, usually demand and replenishment may not follow the expected normal distribution. As a result, other distribution models are used to better predict probabilities and trends such as Bernoulli process.^[10] But according to Wanke (2008), in the particular case of investigating lead-time for inventory management at the beginning of the life cycle when a completely new product is being analyzed, the uniform distribution proves to be more useful.^[10] In this situation, other distribution may not be viable since there is no existing data on the new product or that the demand history is unavailable so there isn't really an appropriate or known distribution.^[10] The uniform distribution would be ideal in this situation since the random variable of lead-time (related to demand) is unknown for the new product but the results are likely to range between a plausible range of two values.^[10] The lead-time would thus represent the random variable. From the uniform distribution model, other factors related to lead-time were able to be calculated such as cycle service level and shortage per cycle. It was also noted that the uniform distribution was also used due to the simplicity of the calculations.^[10]

Sampling from an arbitrary distribution

Main article: Inverse transform sampling

The uniform distribution is useful for sampling from arbitrary distributions. A general method is the inverse transform sampling method, which uses the cumulative distribution function (CDF) of the target random variable. This method is very useful in theoretical work. Since simulations using this method require inverting the CDF of the target variable, alternative methods have been devised for the cases where the CDF is not known in closed form. One such method is rejection sampling.

The normal distribution is an important example where the inverse transform method is not efficient. However, there is an exact method, the Box–Muller transformation, which uses the inverse transform to convert two independent uniform random variables into two independent normally distributed random variables.

Quantization error

Main article: Quantization error

In analog-to-digital conversion, a quantization error occurs. This error is either due to rounding or truncation. When the original signal is much larger than one least significant bit (LSB), the quantization error is not significantly correlated with the signal, and has an approximately uniform distribution. The RMS error therefore follows from the variance of this distribution.

Random variate generation

There are many applications in which it is useful to run simulation experiments. Many programming languages come with implementations to generate pseudo-random numbers which are effectively distributed according to the standard uniform distribution.

On the other hand, the uniformly distributed numbers are often used as the basis for non-uniform random variate generation.

If ${\displaystyle u}$  is a value sampled from the standard uniform distribution, then the value ${\displaystyle a+(b-a)u}$  follows the uniform distribution parameterized by ${\displaystyle a}$  and ${\displaystyle b,}$  as described above.

History

While the historical origins in the conception of uniform distribution are inconclusive, it is speculated that the term "uniform" arose from the concept of equiprobability in dice games (note that the dice games would have discrete and not continuous uniform sample space). Equiprobability was mentioned in Gerolamo Cardano's Liber de Ludo Aleae, a manual written in 16th century and detailed on advanced probability calculus in relation to dice.^[11]

See also

• Discrete uniform distribution
• Beta distribution
• Box–Muller transform
• Probability plot
• Q–Q plot
• Rectangular function
• Irwin–Hall distribution — In the degenerate case where n=1, the Irwin-Hall distribution generates a uniform distribution between 0 and 1.
• Bates distribution — Similar to the Irwin-Hall distribution, but rescaled for n. Like the Irwin-Hall distribution, in the degenerate case where n=1, the Bates distribution generates a uniform distribution between 0 and 1.

References

1. Dekking, Michel (2005). A modern introduction to probability and statistics : understanding why and how. London, UK: Springer. pp. 60–61. ISBN 978-1-85233-896-1.
2. Walpole, Ronald; et al. (2012). Probability & Statistics for Engineers and Scientists. Boston, USA: Prentice Hall. pp. 171–172. ISBN 978-0-321-62911-1.
3. Park, Sung Y.; Bera, Anil K. (2009). "Maximum entropy autoregressive conditional heteroskedasticity model". Journal of Econometrics. 150 (2): 219–230. CiteSeerX 10.1.1.511.9750. doi:10.1016/j.jeconom.2008.12.014.
4. "Uniform Distribution (Continuous)". MathWorks. 2019. Retrieved November 22, 2019.
5. Illowsky, Barbara; et al. (2013). Introductory Statistics. Rice University, Houston, Texas, USA: OpenStax College. pp. 296–304. ISBN 978-1-938168-20-8.
6. Casella & Berger 2001, p. 626
7. https://www.stat.washington.edu/~nehemyl/files/UW_MATH-STAT395_moment-functions.pdf^{[bare URL PDF]}
8. https://galton.uchicago.edu/~wichura/Stat304/Handouts/L18.cumulants.pdf^{[bare URL PDF]}
9. Nechval KN, Nechval NA, Vasermanis EK, Makeev VY (2002) Constructing shortest-length confidence intervals. Transport and Telecommunication 3 (1) 95-103
10. Wanke, Peter (2008). "The uniform distribution as a first practical approach to new product inventory management". International Journal of Production Economics. 114 (2): 811–819. doi:10.1016/j.ijpe.2008.04.004 – via Research Gate.
11. Bellhouse, David (May 2005). "Decoding Cardano's Liber de Ludo". Historia Mathematica. 32: 180–202. doi:10.1016/j.hm.2004.04.001.

Further reading

• Casella, George; Roger L. Berger (2001), Statistical Inference (2nd ed.), ISBN 978-0-534-24312-8, LCCN 2001025794

External links

• Online calculator of Uniform distribution (continuous)