Regression Analysis: Simple Regression, Equations and Uses

Overview

Regression analysis studies the functional relationship between two variables and helps predict one variable from another. For example, a business may predict sales from advertising expenditure, demand from price, or profit from production volume. Unlike correlation, regression gives a predictive equation. This topic covers simple linear regression, regression lines and business uses with an exam-style worked example.

Regression: meaning

Regression is a statistical technique that estimates the relationship between a dependent variable and one or more independent variables, mainly for prediction and explanation.

Regression vs correlation (difference table)

Simple linear regression model

The simplest form: $Y = a + bX$ Where:

• $Y$ = dependent variable
• $X$ = independent variable
• $a$ = intercept (value of Y when X = 0)
• $b$ = slope (change in Y per unit change in X)

Regression line of Y on X

Used to predict Y given X: $Y - \\bar{Y} = b_{yx}(X - \\bar{X})$

Regression line of X on Y

Used to predict X given Y: $X - \\bar{X} = b_{xy}(Y - \\bar{Y})$

Regression coefficients (meaning)

• $b_{yx}$: regression coefficient of Y on X (slope when predicting Y)
• $b_{xy}$: regression coefficient of X on Y

Relationship with correlation: $r = \\pm \\sqrt{b_{xy} \\cdot b_{yx}}$

Least squares method (basic idea)

Least squares fits the “best” line by minimizing the sum of squared vertical deviations of actual Y values from predicted Y values.

Steps to fit regression line (flow)

Worked mini example (exam style)

Suppose regression equation is $Y = 20 + 3X$.
If $X = 10$, predicted $Y = 20 + 3(10) = 50$.

Interpretation:

• intercept 20: base level of Y when X is zero
• slope 3: Y increases by 3 units for each 1 unit rise in X

Uses of regression in business

• sales forecasting based on advertising
• demand forecasting based on price and income
• cost estimation based on output
• quality prediction based on process variables

Limitations/precautions

• relationship may change over time (unstable)
• regression is reliable within observed data range; extrapolation can mislead
• correlation does not imply causation; wrong model leads to wrong predictions
• outliers can distort regression line

Common exam mistakes

• mixing correlation and regression definitions
• not identifying dependent vs independent variable
• interpreting intercept wrongly without context

Exam tips (how to write 3/5 marks)

• For 3 marks: definition + equation + 2 uses.
• For 5 marks: regression vs correlation table + steps flowchart + mini example + conclusion.

Key Terms

• Regression — prediction relationship between variables.
• Dependent variable (Y) — variable to be predicted.
• Independent variable (X) — predictor variable.
• Slope (b) — change in Y per unit change in X.
• Intercept (a) — value of Y when X = 0.

Quick Recap (1-minute revision)

• Regression gives equation $Y = a + bX$ for prediction.
• Correlation measures association; regression predicts.
• Use regression carefully; avoid extrapolation and causation mistakes.