What does a residual ei=yi−y^ie_i = y_i - \hat{y}_iei=yi−y^i represent geometrically?
The horizontal distance from the point to the regression line
The vertical distance from the point to the regression line
The perpendicular distance from the point to the regression line
The slope of the line segment connecting the point to the origin