Least squares estimates

Gist

Suppose that $Ax=b$ does not have a solution. What is the best approximate solution?

Linear algebra- derived

If we look at the linear regression in matrix form

Calculus-derived

References

1. https://thepalindrome.org/p/the-anatomy-of-the-least-squares