Probability generating functions · Subtopic 1 of 1
Probability Generating Functions
GX(t)=E(tX)=∑P(X=x)tx packs a whole distribution into one function. G(1)=1, E(X)=G′(1) and Var(X)=G′′(1)+G′(1)−[G′(1)]2. For independent X and Y, GX+Y=GXGY.
Write the PGF of a discrete distribution and read probabilities from it.
Find mean and variance from derivatives.
Find the PGF of a sum of independent variables.
Pause and think
The coefficient of t2 in (0.5+0.5t)3 is 0.375. What could that be?
Section 2 of 14
Core idea
Start hereA distribution in one formula
A probability table can be long. Multiply each probability by t to the power of its value, add them up, and you get one function that stores everything: every probability, the mean and the variance, all recoverable with algebra and calculus.
The big idea
G(t)=E(tX). Coefficients give probabilities, G′(1) gives the mean, G′′(1) gives E(X(X−1)), and independent sums multiply PGFs.
1. Moments from derivatives
Mean and variance
G(t)=∑pxtx
Definition.
G′(t)=∑xpxtx−1⇒G′(1)=∑xpx=E(X)
Differentiate term by term; set t=1.
G′′(1)=∑x(x−1)px=E(X2)−E(X)
Differentiate again.
Var(X)=G′′(1)+G′(1)−[G′(1)]2
E(X2)−[E(X)]2.
Worked exampleA small PGF
G(t)=41(1+2t+t2). Find E(X) and Var(X).
Goal
Mean and variance.
Strategy
Differentiate.
1
G′(t)=41(2+2t),G′(1)=1
Mean.
2
G′′(t)=21
Second derivative.
3
Var=21+1−1=21
Formula.
AnswerE(X)=1, Var(X)=21.
✓ CheckThis is B(2,21): np=1, npq=21 ✓.
2. Sums of independent variables
Why PGFs multiply
GX+Y(t)=E(tX+Y)
Definition.
=E(tXtY)
Index law.
=E(tX)E(tY)
Independence.
GX+Y=GXGY.
Worked examplePoisson sum
X∼Po(2), Y∼Po(3) independent. Identify X+Y.
Goal
Distribution.
Strategy
Multiply PGFs.
1
e2(t−1)e3(t−1)
Product.
2
=e5(t−1)
Add exponents.
AnswerX+Y∼Po(5) (a PGF determines its distribution).
✓ CheckMeans add: 2+3=5 ✓.
What a PGF gives you
Drawing diagram…
Everything comes from G.
⚠️ Common misconceptionNot G″(1) aloneG′′(1)=E(X2)−E(X), so add G′(1) back before subtracting the square.
🪄 TrickFind constantsG(1)=1 always: use it to find an unknown coefficient.
Pause and think
What is G(0)?
Summary
G(t)=E(tX), G(1)=1.
E(X)=G′(1).
Var=G′′(1)+G′(1)−G′(1)2.
Independent sums multiply.
Key words
PGF
E(tX) for a discrete variable taking non-negative integer values.
Factorial moment
E(X(X−1)), from G′′(1).
📜 HistoryDe Moivre and Laplace.De Moivre used generating functions for dice problems in 1730; Laplace developed them into a general tool in his 1812 "Théorie analytique des probabilités".
🤯 Fun factTwo dice.The PGF of the total of two dice is (6t+t2+⋯+t6)2. Expanding gives the famous 1,2,3,4,5,6,5,4,3,2,1 pattern.
Salam Academy original content · Content status: reviewed and published. Syllabus mapping: Cambridge International 9231, Current syllabus (official specification).