Table of Contents
- 1 Can your dependent variable be binary?
- 2 Why does binary logistic regression not use the ordinary least squares method of estimation?
- 3 How logistic regression is related to linear regression?
- 4 Why is ordinary least squares regression called ordinary least squares?
- 5 What’s wrong with using linear regression for binary dependent variables?
- 6 What if my dependent variable is outside the range of training?
Can your dependent variable be binary?
Binary Logistic Regression This type of model requires a binary dependent variable. A binary variable has only two possible values, such as pass and fail. Example: Political scientists assess the odds of the incumbent U.S. President winning reelection based on stock market performance.
Why does binary logistic regression not use the ordinary least squares method of estimation?
The structure of the logistic regression model is designed for binary outcomes. Least Square regression is not built for binary classification, as logistic regression performs a better job at classifying data points and has a better logarithmic loss function as opposed to least squares regression.
When it is appropriate to use a binary logistic regression?
Binary Logistic Regression is useful in the analysis of multiple factors influencing a negative/positive outcome, or any other classification where there are only two possible outcomes.
Is the dependent variable binary in logistic regression?
Logistic regression is the statistical technique used to predict the relationship between predictors (our independent variables) and a predicted variable (the dependent variable) where the dependent variable is binary (e.g., sex , response , score , etc…).
Linear regression is used to predict the continuous dependent variable using a given set of independent variables. Logistic Regression is used to predict the categorical dependent variable using a given set of independent variables. The output for Linear Regression must be a continuous value, such as price, age, etc.
Why is ordinary least squares regression called ordinary least squares?
Ordinary least squares regression is a statistical method that produces the one straight line that minimizes the total squared error. These values of a and b are known as least squares coefficients, or sometimes as ordinary least squares coefficients or OLS coefficients.
What is a discrete binary dependent variable?
Binary Dependent Variables In some cases the outcome of interest – rather than one of the right hand side variables – is discrete rather than continuous Binary Dependent Variables In some cases the outcome of interest – rather than one of the right hand side
Is it possible to use OLS with binary DV?
In addition to @JQ Veenstra’s excellent answer, yes, you can use OLS with a binary DV, if instead of 0s and 1s you use probability estimates of a 1. Then you do the logistic transformation (get log-odds from probabilities), and fit OLS.
What’s wrong with using linear regression for binary dependent variables?
Your dependent variable Y is 0 or 1. Now think about this: for a data point outside the range of the X i ‘s of the training set, you may end up with a predicted value of Y less than 0 or greater than 1! This is but the most basic flaw in using linear regression for a binary dependent variable.
What if my dependent variable is outside the range of training?
Let us say that your independent variables X i fall within a certain range in your training set. Your dependent variable Y is 0 or 1. Now think about this: for a data point outside the range of the X i ‘s of the training set, you may end up with a predicted value of Y less than 0 or greater than 1!