logo

Exponential Distribution 📂Probability Distribution

Exponential Distribution

Definition 1

pdf.gif

The continuous probability distribution exp(λ)\exp ( \lambda) with the following probability density function, for λ>0\lambda > 0, is called an Exponential Distribution. f(x)=λeλx,x0 f(x) = \lambda e^{-\lambda x} \qquad , x \ge 0


  • Depending on the book, the parameter might be its reciprocal, θ=1λ\displaystyle \theta = {{ 1 } \over { \lambda }}.

Basic Properties

Moment Generating Function

  • [1]: m(t)=λλt,t<λm(t) = {{ \lambda } \over { \lambda - t }} \qquad , t < \lambda

Mean and Variance

  • [2]: If Xexp(λ)X \sim \exp ( \lambda), then E(X)=1λVar(X)=1λ2 \begin{align*} E(X) =& {{ 1 } \over { \lambda }} \\ \operatorname{Var} (X) =& {{ 1 } \over { \lambda^{2} }} \end{align*}

Sufficient Statistic and Maximum Likelihood Estimator

  • [3]: Let X:=(X1,,Xn)exp(λ)\mathbf{X} := \left( X_{1} , \cdots , X_{n} \right) \sim \exp \left( \lambda \right) be a given random sample.

The sufficient statistic TT and maximum likelihood estimator λ^\hat{\lambda} for λ\lambda are as follows. T=k=1nXkλ^=nk=1nXk \begin{align*} T =& \sum_{k=1}^{n} X_{k} \\ \hat{\lambda} =& {{ n } \over { \sum_{k=1}^{n} X_{k} }} \end{align*}

Theorems

Memorylessness

  • [a]: If Xexp(λ)X \sim \exp ( \lambda ) , then P(Xs+tXs)=P(Xt) P ( X \ge s + t \mid X \ge s ) = P (X \ge t)

Relationship with Gamma Distribution

  • [b]: Γ(1,1λ)    exp(λ)\Gamma \left(1, { 1 \over \lambda } \right) \iff \text{exp} (\lambda)

Generalization to Weibull Distribution

  • [c]: The exponential distribution is the distribution for k=1k=1 in the Weibull distribution. f(x)=kθ(xθ)k1e(x/θ)k,x0 f(x) = {{ k } \over { \theta }} \left( {{ x } \over { \theta }} \right)^{k-1} e^{-(x/\theta)^{k}} \qquad , x \ge 0

Explanation

Relationship with Geometric Distribution

The exponential distribution is the distribution that follows the time until an event of interest occurs, and can also be seen as a continuous version of the geometric distribution. Thinking of the geometric distribution as a generalization for the number of occurrences, the generalization of the number of occurrences for the exponential distribution might be considered to be the gamma distribution.

Relationship with Poisson Distribution

On the other hand, while the Poisson distribution and the exponential distribution both focus on similar phenomena, they differ in that one is concerned with the number of events per unit time, and the other with the time until an event occurs. This relationship between the two distributions is why some books use the same Greek letter λ\lambda for both. Especially considering the mean of the Poisson distribution is λ\lambda and the mean of the exponential distribution is 1λ\displaystyle {{ 1 } \over { \lambda }}, the relationship between the two distributions could be perceived as a kind of ‘inverse’.

Proof

[1]

Only when t<λt < \lambda m(t)=0etxf(x)dx=0etxλeλxdx=λ0e(tλ)xdx=λ1tλ[01]=λλt \begin{align*} m(t) =& \int_{0}^{\infty} e^{tx} f(x) dx \\ =& \int_{0}^{\infty} e^{tx} \lambda e^{-\lambda x} dx \\ =& \lambda \int_{0}^{\infty} e^{(t - \lambda ) x} dx \\ =& \lambda {{ 1 } \over { t - \lambda }} [ 0 - 1 ] \\ =& {{ \lambda } \over { \lambda - t }} \end{align*}

[2]

By direct derivation.

[3]

By direct derivation.

[a]

Derived using conditional probability.

[b]

Shown by the moment generating function.

[c]

It’s self-evident from the probability density function.

Visualization

The following is Julia code showcasing the probability density function of the exponential distribution via an animated gif.

@time using LaTeXStrings
@time using Distributions
@time using Plots

cd(@__DIR__)

x = 0:0.1:10
Λ = collect(0.1:0.1:5.0); append!(Λ, reverse(Λ))

animation = @animate for λ ∈ Λ
    plot(x, pdf.(Exponential(λ), x),
     color = :black,
     label = "λ = $(round(λ, digits = 2))", size = (400,300))
    xlims!(0,10); ylims!(0,0.5); title!(L"\mathrm{pdf\,of\,} \exp(\lambda)")
end
gif(animation, "pdf.gif")

  1. Hogg et al. (2013). Introduction to Mathematical Statistics(7th Edition): p159. ↩︎