From Surf Wiki (app.surf) — the open knowledge base
Pareto distribution
Probability distribution
Probability distribution
| Field | Value | ||
|---|---|---|---|
| name | Pareto Type I | ||
| type | density | ||
| pdf_image | [[File:Probability density function of Pareto distribution.svg | 325px | Pareto Type I probability density functions for various α]] |
| Pareto Type I probability density functions for various \alpha with x_\mathrm{m} = 1. As \alpha \rightarrow \infty, the distribution approaches \delta(x - x_\mathrm{m}), where \delta is the Dirac delta function. | |||
| cdf_image | [[File:Cumulative distribution function of Pareto distribution.svg | 325px | Pareto Type I cumulative distribution functions for various α]] |
| Pareto Type I cumulative distribution functions for various \alpha with x_\mathrm{m} = 1. | |||
| parameters | x_\mathrm{m} 0 scale (real) | ||
| \alpha 0 shape (real) | |||
| support | x \in x_\mathrm{m}, \infty) | ||
| \frac{\alpha x_\mathrm{m}^\alpha}{x^{\alpha+1 |
Pareto Type I probability density functions for various \alpha with x_\mathrm{m} = 1. As \alpha \rightarrow \infty, the distribution approaches \delta(x - x_\mathrm{m}), where \delta is the [Dirac delta function. Pareto Type I cumulative distribution functions for various \alpha with x_\mathrm{m} = 1. \alpha 0 shape (real) \infty & \text{for }\alpha\le 1 \ \dfrac{\alpha x_\mathrm{m}}{\alpha-1} & \text{for }\alpha1 \end{cases} \infty & \text{for }\alpha\le 2 \ \dfrac{x_\mathrm{m}^2\alpha}{(\alpha- 1)^2(\alpha-2)} & \text{for }\alpha2 \end{cases} \dfrac{\alpha^2}{x_\mathrm{m}^2} & 0 \ 0 & \dfrac{1}{\alpha^2} \end{bmatrix}
The Pareto distribution, named after the Italian civil engineer, economist, and sociologist Vilfredo Pareto, is a power-law probability distribution that is used in description of social, quality control, scientific, geophysical, actuarial, and many other types of observable phenomena; the principle originally applied to describing the distribution of wealth in a society, fitting the trend that a large portion of wealth is held by a small fraction of the population.
The Pareto principle or "80:20 rule" stating that 80% of outcomes are due to 20% of causes was named in honour of Pareto, but the concepts are distinct, and only Pareto distributions with shape value (α) precisely reflect it. Empirical observation has shown that this 80:20 distribution fits a wide range of cases, including natural phenomena and human activities.
Definitions
If X is a random variable with a Pareto (Type I) distribution, then the probability that X is greater than some number x, i.e., the survival function (also called tail function), is given by
\overline{F}(x) = \Pr(Xx) = \begin{cases} \left(\frac{x_\mathrm{m}}{x}\right)^\alpha & x\ge x_\mathrm{m}, \ 1 & x \end{cases}
where xm is the (necessarily positive) minimum possible value of X, and α is a positive parameter. The type I Pareto distribution is characterized by a scale parameter xm and a shape parameter α, which is known as the tail index. If this distribution is used to model the distribution of wealth, then the parameter α is called the Pareto index.
Cumulative distribution function
From the definition, the cumulative distribution function of a Pareto random variable with parameters α and xm is
F_X(x) = \begin{cases} 1-\left(\frac{x_\mathrm{m}}{x}\right)^\alpha & x \ge x_\mathrm{m}, \ 0 & x \end{cases}
Probability density function
It follows (by differentiation) that the probability density function is
f_X(x)= \begin{cases} \frac{\alpha x_\mathrm{m}^\alpha}{x^{\alpha+1}} & x \ge x_\mathrm{m}, \ 0 & x
When plotted on linear axes, the distribution assumes the familiar J-shaped curve which approaches each of the orthogonal axes asymptotically. All segments of the curve are self-similar (subject to appropriate scaling factors). When plotted in a log–log plot, the distribution is represented by a straight line.
Properties
Moments and characteristic function
- The expected value of a random variable following a Pareto distribution is \operatorname{E}(X) = \begin{cases} \infty & \alpha\le 1, \ \frac{\alpha x_{\mathrm{m}}}{\alpha-1} & \alpha1. \end{cases}
- The variance of a random variable following a Pareto distribution is \operatorname{Var}(X)= \begin{cases} \infty & \alpha\in(1,2], \ \left(\frac{x_\mathrm{m}}{\alpha-1}\right)^2 \frac{\alpha}{\alpha-2} & \alpha2. \end{cases} (If α ≤ 1, the variance does not exist.)
- The raw moments are \mu_n'= \begin{cases} \infty & \alpha\le n, \ \frac{\alpha x_\mathrm{m}^n}{\alpha-n} & \alphan. \end{cases}
- The moment generating function is only defined for non-positive values t ≤ 0 as M\left(t;\alpha,x_\mathrm{m}\right) = \operatorname{E} \left [e^{tX} \right ] = \alpha(-x_\mathrm{m} t)^\alpha\Gamma(-\alpha,-x_\mathrm{m} t) M\left(0,\alpha,x_\mathrm{m}\right)=1. Thus, since the expectation does not converge on an open interval containing t=0 we say that the moment generating function does not exist.
- The characteristic function is given by \varphi(t;\alpha,x_\mathrm{m})=\alpha(-ix_\mathrm{m} t)^\alpha\Gamma(-\alpha,-ix_\mathrm{m} t), where Γ(a, x) is the incomplete gamma function.
The parameters may be solved for using the method of moments.S. Hussain, S.H. Bhatti (2018). Parameter estimation of Pareto distribution: Some modified moment estimators. Maejo International Journal of Science and Technology 12(1):11-27.
Conditional distributions
The conditional probability distribution of a Pareto-distributed random variable, given the event that it is greater than or equal to a particular number x_1 exceeding x_\text{m}, is a Pareto distribution with the same Pareto index \alpha but with minimum x_1 instead of x_\text{m}:
\text{Pr}(X \geq x | X \geq x_1) = \begin{cases} \left(\frac{x_1}{x}\right)^\alpha & x \geq x_1, \ 1 & x \end{cases}
This implies that the conditional expected value (if it is finite, i.e. \alpha1) is proportional to x_1:
\text{E}(X | X \geq x_1) \propto x_1.
In case of random variables that describe the lifetime of an object, this means that life expectancy is proportional to age, and is called the Lindy effect or Lindy's Law.
A characterization theorem
Suppose X_1, X_2, X_3, \dotsc are independent identically distributed random variables whose probability distribution is supported on the interval x_\text{m},\infty) for some x_\text{m}0. Suppose that for all n, the two random variables \min{X_1,\dotsc,X_n} and (X_1+\dotsb+X_n)/\min{X_1,\dotsc,X_n} are independent. Then the common distribution is a Pareto distribution.
Geometric mean
The [geometric mean (G) is
G = x_\text{m} \exp \left( \frac{1}{\alpha} \right).
Harmonic mean
The harmonic mean (H) is
H = x_\text{m} \left( 1 + \frac{ 1 }{ \alpha } \right).
Graphical representation
The characteristic curved 'long tail' distribution, when plotted on a linear scale, masks the underlying simplicity of the function when plotted on a log-log graph, which then takes the form of a straight line with negative gradient: It follows from the formula for the probability density function that for x ≥ xm,
\log f_X(x)= \log \left(\alpha\frac{x_\mathrm{m}^\alpha}{x^{\alpha+1}}\right) = \log (\alpha x_\mathrm{m}^\alpha) - (\alpha+1) \log x.
Since α is positive, the gradient −(α + 1) is negative.
Statistical inference
Estimation of parameters
The likelihood function for the Pareto distribution parameters α and xm, given an independent sample x = (x1, x2, ..., xn), is
L(\alpha, x_\mathrm{m}) = \prod_{i=1}^n \alpha \frac {x_\mathrm{m}^\alpha} {x_i^{\alpha+1}} = \alpha^n x_\mathrm{m}^{n\alpha} \prod_{i=1}^n \frac {1}{x_i^{\alpha+1}}.
Therefore, the logarithmic likelihood function is
\ell(\alpha, x_\mathrm{m}) = n \ln \alpha + n\alpha \ln x_\mathrm{m} - (\alpha + 1) \sum_{i=1} ^n \ln x_i.
It can be seen that \ell(\alpha, x_\mathrm{m}) is monotonically increasing with xm, that is, the greater the value of xm, the greater the value of the likelihood function. Hence, since x ≥ xm, we conclude that
\widehat x_\mathrm{m} = \min_i {x_i}.
To find the estimator for α, we compute the corresponding partial derivative and determine where it is zero:
\frac{\partial \ell}{\partial \alpha} = \frac{n}{\alpha} + n \ln x_\mathrm{m} - \sum _{i=1}^n \ln x_i = 0.
Thus the maximum likelihood estimator for α is:
\widehat \alpha = \frac{n}{\sum i \ln (x_i/\widehat x\mathrm{m}) }.
The expected statistical error is:
\sigma = \frac {\widehat \alpha} {\sqrt n}.
Malik (1970) gives the exact joint distribution of (\hat{x}\mathrm{m},\hat\alpha). In particular, \hat{x}\mathrm{m} and \hat\alpha are independent and \hat{x}_\mathrm{m} is Pareto with scale parameter xm and shape parameter nα, whereas \hat\alpha has an inverse-gamma distribution with shape and scale parameters n − 1 and nα, respectively.
Occurrence and applications
General
Vilfredo Pareto originally used this distribution to describe the allocation of wealth among individuals since it seemed to show rather well the way that a larger portion of the wealth of any society is owned by a smaller percentage of the people in that society. He also used it to describe distribution of income. This idea is sometimes expressed more simply as the Pareto principle or the "80-20 rule" which says that 20% of the population controls 80% of the wealth. As Michael Hudson points out in The Collapse of Antiquity, "a mathematical corollary [is] that 10% would have 65% of the wealth, and 5% would have half the national wealth." However, the 80-20 rule corresponds to a particular value of α, and in fact, Pareto's data on British income taxes in his Cours d'économie politique indicates that about 30% of the population had about 70% of the income. The probability density function (PDF) graph at the beginning of this article shows that the "probability" or fraction of the population that owns a small amount of wealth per person is rather high, and then decreases steadily as wealth increases. (The Pareto distribution is not realistic for wealth for the lower end, however. In fact, net worth may even be negative.) This distribution is not limited to describing wealth or income, but to many situations in which an equilibrium is found in the distribution of size or magnitude. The following examples are sometimes seen as approximately Pareto-distributed:
- Frequencies of words in longer texts (a few words are used often, lots of words are used infrequently)
- Frequencies of given names --
- All four variables of household budget constraints: consumption, labor income, capital income, and wealth.
- The sizes of human settlements (a few large cities, many hamlets/villages)
- File size distribution of Internet traffic which uses the TCP protocol (many smaller files, few larger ones)
- Hard disk drive error rates
- Clusters of Bose–Einstein condensate near absolute zero
- The values of oil reserves in oil fields (a few large fields, many small fields)
- The length distribution in jobs assigned to supercomputers (a few large ones, many small ones)
- The standardized price returns on individual stocks
- The sizes of sand particles
- The sizes of meteorites
- The severity of large casualty insurance losses for certain lines of business such as general liability, commercial auto, and workers' compensation
- In hydrology the Pareto distribution is applied to extreme events such as annually maximum one-day rainfalls and river discharges. The blue picture illustrates an example of fitting the Pareto distribution to ranked annually maximum one-day rainfalls showing also the 90% confidence belt based on the binomial distribution. The rainfall data are represented by plotting positions as part of the cumulative frequency analysis.
- Electric utility distribution reliability (80% of customer minutes interrupted occur on approximately 20% of the days in a given year)
Relation to Zipf's law
The Pareto distribution is a continuous probability distribution. Zipf's law, also sometimes called the zeta distribution, is a discrete distribution, separating the values into a simple ranking. Both are a simple power law with a negative exponent, scaled so that their cumulative distributions equal 1. Zipf's can be derived from the Pareto distribution if the x values (incomes) are binned into N ranks so that the number of people in each bin follows a 1/rank pattern. The distribution is normalized by defining x_m so that \alpha x_\mathrm{m}^\alpha = \frac{1}{H(N,\alpha-1)} where H(N,\alpha-1) is the generalized harmonic number. This makes Zipf's probability density function derivable from Pareto's.
f(x) = \frac{\alpha x_\mathrm{m}^\alpha}{x^{\alpha+1}} = \frac{1}{x^s H(N,s)}
where s = \alpha-1 and x is an integer representing rank from 1 to N where N is the highest income bracket. So a randomly selected person (or word, website link, or city) from a population (or language, internet, or country) has f(x) probability of ranking x.
Relation to the "Pareto principle"
The "80/20 law", according to which 20% of all people receive 80% of all income, and 20% of the most affluent 20% receive 80% of that 80%, and so on, holds precisely when the Pareto index is \alpha = \log_4 5 = \cfrac{\log_{10} 5}{\log_{10} 4} \approx 1.161. This result can be derived from the Lorenz curve formula given below. Moreover, the following have been shown to be mathematically equivalent:
- Income is distributed according to a Pareto distribution with index α 1.
- There is some number 0 ≤ p ≤ 1/2 such that 100p % of all people receive 100(1 − p)% of all income, and similarly for every real (not necessarily integer) n 0, 100pn % of all people receive 100(1 − p)n percentage of all income. α and p are related by 1-\frac{1}{\alpha}=\frac{\ln(1-p)}{\ln(p)}=\frac{\ln((1-p)^n)}{\ln(p^n)}
This does not apply only to income, but also to wealth, or to anything else that can be modeled by this distribution.
This excludes Pareto distributions in which 0
Relation to Price's law
Price's law is sometimes offered as a property of or as similar to the Pareto distribution. However, the law only holds in the case that \alpha=1. Note that in this case, the total and expected amount of wealth are not defined, and the rule only applies asymptotically to random samples. The extended Pareto Principle mentioned above is a far more general rule.
Lorenz curve and Gini coefficient
The Lorenz curve is often used to characterize income and wealth distributions. For any distribution, the Lorenz curve L(F) is written in terms of the PDF f or the CDF F as
L(F) = \frac{\int_{x_\mathrm{m}}^{x(F)}xf(x),dx}{\int_{x_\mathrm{m}}^\infty xf(x),dx} =\frac{\int_0^F x(F'),dF'}{\int_0^1 x(F'),dF'}
where x(F) is the inverse of the CDF. For the Pareto distribution,
x(F) = \frac{x_\mathrm{m}}{(1-F)^{\frac{1}{\alpha}}}
and the Lorenz curve is calculated to be
L(F) = 1-(1-F)^{1-\frac{1}{\alpha}},
For 0 the denominator is infinite, yielding L=0. Examples of the Lorenz curve for a number of Pareto distributions are shown in the graph on the right.
According to Oxfam (2016) the richest 62 people have as much wealth as the poorest half of the world's population. We can estimate the Pareto index that would apply to this situation. Letting ε equal 62/(7\times 10^9) we have: L(1/2)=1-L(1-\varepsilon) or 1-(1/2)^{1-\frac{1}{\alpha}}=\varepsilon^{1-\frac{1}{\alpha}} \ln(1-(1/2)^{1-\frac{1}{\alpha}})=(1-\frac{1}{\alpha})\ln\varepsilon \ln(1-(1/2)^{1-\frac{1}{\alpha}})=(\ln\varepsilon/\ln 2)(1-\frac{1}{\alpha})\ln 2 \ln(1-(1/2)^{1-\frac{1}{\alpha}})=-(\ln\varepsilon/\ln 2)\ln((1/2)^{1-\frac{1}{\alpha}}) \ln(1-(1/2)^{1-\frac{1}{\alpha}})\approx(\ln\varepsilon/\ln 2)(1-(1/2)^{1-\frac{1}{\alpha}}) -\ln(1-(1/2)^{1-\frac{1}{\alpha}})\exp(-\ln(1-(1/2)^{1-\frac{1}{\alpha}}))\approx -\ln\varepsilon/\ln 2 -\ln(1-(1/2)^{1-\frac{1}{\alpha}})\approx W(-\ln\varepsilon/\ln 2) where W is the Lambert W function. So (1/2)^{1-\frac{1}{\alpha}}\approx 1-\exp(-W(-\ln\varepsilon/\ln 2)) {1-\frac{1}{\alpha}}\approx -\ln(1-\exp(-W(-\ln\varepsilon/\ln 2)))/\ln 2 \alpha\approx 1/(1+\ln(1-\exp(-W(-\ln\varepsilon/\ln 2)))/\ln 2) --The solution is that α equals about 1.15, and about 9% of the wealth is owned by each of the two groups. But actually the poorest 69% of the world adult population owns only about 3% of the wealth.
The Gini coefficient is a measure of the deviation of the Lorenz curve from the equidistribution line which is a line connecting [0, 0] and [1, 1], which is shown in black (α = ∞) in the Lorenz plot on the right. Specifically, the Gini coefficient is twice the area between the Lorenz curve and the equidistribution line. The Gini coefficient for the Pareto distribution is then calculated (for \alpha\ge 1) to be
G = 1-2 \left (\int_0^1L(F) , dF \right ) = \frac{1}{2\alpha-1}
(see Aaberge 2005).
Random variate generation
Random samples can be generated using inverse transform sampling. Given a random variate U drawn from the uniform distribution on the unit interval [0, 1], the variate T given by
T=\frac{x_\mathrm{m}}{U^{1/\alpha}}
is Pareto-distributed.
References
Notes
- {{cite book
- {{cite book
References
- (2019). "Calculating CVaR and bPOE for common probability distributions with application to portfolio optimization and density estimation". Springer.
- Amoroso, Luigi. (January 1938). "Vilfredo Pareto". Econometrica (Pre-1986).
- Pareto, Vilfredo. (1898). "Cours d'economie politique". Journal of Political Economy.
- van Montfort, M.A.J.. (1986). "The generalized Pareto distribution applied to rainfall depths". Hydrological Sciences Journal.
- Oancea, Bogdan. (2017). "Income inequality in Romania: The exponential-Pareto distribution". Physica A: Statistical Mechanics and Its Applications.
- Morella, Matteo. "Pareto distribution".
- Arnold, Barry C.. (1983). "Pareto Distributions". International Co-operative Publishing House.
- (November 2017). "Lindy's Law". Physica A: Statistical Mechanics and Its Applications.
- Johnson NL, Kotz S, Balakrishnan N (1994) Continuous univariate distributions Vol 1. Wiley Series in Probability and Statistics.
- Johnson, Kotz, and Balakrishnan (1994), (20.4).
- Feller, W.. (1971). "An Introduction to Probability Theory and its Applications". Wiley.
- (1954). "Business failures. Another example of the analysis of failure data". Journal of the American Statistical Association.
- Chotikapanich, Duangkamon. (16 September 2008). "Modeling Income Distributions and Lorenz Curves". Springer.
- Dallas, A. C.. (1976). "Characterizing the Pareto and power distributions". Annals of the Institute of Statistical Mathematics.
- White, Gentry. (2006). "Bayesian semiparametric spatial and joint spatio-temporal modeling". University of Missouri–Columbia.
- "Inverse Transform Method".
- Huang, Xiao-dong. (2004). "A Multiscale Model for MPEG-4 Varied Bit Rate Video Traffic". IEEE Transactions on Broadcasting.
- M. E. J. Newman. (2005). "Power laws, Pareto distributions and Zipf's law". [[Contemporary Physics]].
- H. J. Malik. (1970). "Estimation of the Parameters of the Pareto Distribution". Metrika.
- Pareto, Vilfredo, ''Cours d'Économie Politique: Nouvelle édition par G.-H. Bousquet et G. Busino'', Librairie Droz, Geneva, 1964, pp. 299–345. [https://web.archive.org/web/20130531151249/http://www.institutcoppet.org/wp-content/uploads/2012/05/Cours-d%C3%A9conomie-politique-Tome-II-Vilfredo-Pareto.pdf Original book archived]
- For a two-quantile population, where approximately 18% of the population owns 82% of the wealth, the [[Theil index]] takes the value 1.
- Hudson, Michael. (2023). "The Collapse of Antiquity".
- (2023). "Consumption, Wealth, and Income Inequality: A Tale of Tails".
- Reed, William J.. (2004). "The Double Pareto-Lognormal Distribution – A New Parametric Model for Size Distributions". Communications in Statistics – Theory and Methods.
- Reed, William J.. (2002). "On the rank-size distribution for human settlements". Journal of Regional Science.
- (2010-02-24). "Understanding latent sector error and how to protect against them". 8th Usenix Conference on File and Storage Technologies (FAST 2010).
- Yuji Ijiri. (May 1975). "Some Distributions Associated with Bose–Einstein Statistics". Proc. Natl. Acad. Sci. USA.
- (August 1997). "Exploiting Process Lifetime Distributions for Dynamic Load Balancing". ACM Transactions on Computer Systems.
- Kleiber and Kotz (2003): p. 94.
- (1980). "Survival probabilities based on Pareto claim distributions". ASTIN Bulletin.
- (2010). "Pareto's Law". [[Mathematical Intelligencer]].
- (Jan 2016). "62 people own the same as half the world, reveals Oxfam Davos report". Oxfam.
- (Oct 2013). "Global Wealth Report 2013". Credit Suisse.
- Tanizaki, Hisashi. (2004). "Computational Methods in Statistics and Econometrics". CRC Press.
This article was imported from Wikipedia and is available under the Creative Commons Attribution-ShareAlike 4.0 License. Content has been adapted to SurfDoc format. Original contributors can be found on the article history page.
Ask Mako anything about Pareto distribution — get instant answers, deeper analysis, and related topics.
Research with MakoFree with your Surf account
Create a free account to save articles, ask Mako questions, and organize your research.
Sign up freeThis content may have been generated or modified by AI. CloudSurf Software LLC is not responsible for the accuracy, completeness, or reliability of AI-generated content. Always verify important information from primary sources.
Report