Linear regression

The least squares regression line

The regression line of $y$ on $x$, $y=a+bx$, is the straight line that makes the squared vertical distances from the points as small as possible. Its gradient is $b=\dfrac{S_{xy}}{S_{xx}}$ and it always passes through $(\bar x,\bar y)$, so $a=\bar y-b\bar x$.