SlideShare a Scribd company logo
1 of 6
Expected Values and Variances of OLS Estimators:

We defined the population model                   , and we claimed that the
key assumption for simple regression analysis to be useful is that the
expected value of u given any value of x is zero.

We discussed the algebraic properties of OLS estimation. We now return to
the population model and study the statistical properties of OLS.

In other words, we now view              as estimators for the parameters
���         that appear in the population model.

Assumptions for unbiased OLS:

SLR 1.

Liner in parameters:



SLR 2.

We use random sample size for the population model

                                             i= 1,2,3……….n.

where, is the error or disturbance for observation i(for example, person i,
firm i, city i, etc.).

Thus     , contains the unobservables for observation affects the      .

The      should not be confused with the   that was defined earlier.

Discussion between the errors and residuals will be covered later.

SLR 3.

Zero Conditional Mean:



For a random sample this assumption implies:
SLR 4.

The sample variation in the independent variable:




This means if = wage and = education then SLR. 4 fail only if every one in
the sample has the same amount of education. This is hardly true!

USING SLR1.- SLR4,



for any values of          In other words            are unbiased estimates for


Variance in OLS estimators:

Once we know that        are unbiased estimates for               we must also
know how far do we expect to be from on an average.

Among other things this allows us to choose the best estimator among all, or at
least a broad class of unbiased estimators.

SLR 5.



This is the homoskedasity Assumption.

This assumption plays no role in showing              are unbiased estimators
of���

  is often called the error variance or disturbance variance.
** Note

Under Assumption SLR.1 through SLR.5




Where these are conditional on the sample values



Note: All the quantities of entering in the preceding equations except   can
be estimated from the data.
But variance can be estimated using the following formula (IF YOU WANT
REFER TO APPENDIX 3.A)




Estimating the Error in Variance:

So far we know that:

                               And

                           .

Difference between errors (or disturbance)and residuals is crucial for
constructing .

Population model in terms of randomly observed sample can be written as:



and     is the ERROR for observation

 in terms of fitted value can be expressed as:



and     is the RESIDUAL for observation

Thus:

We saw previously that for OLS to be unbiased                      .

But                            .

The difference between them does not have a zero expected value.

Now returning to    :
Thus the unbiased “estimator” for       is:

But since we do not observer          and observe only the OLS residual of
                  .

This is the true estimator, because it gives a complete rule for any sample data
on on

One slight drawback to this estimator is that it turns out to be biased
(although for large the bias is small).

The         is biased only because it does not account for two restrictions that
OLS satisfies:




Since there are only n-2 degrees of freedom in OLS residuals (as opposed to
degrees of freedom in errors)

If we apply the restrictions in are replace     with    the above restrictions
would no longer hold.

The unbiased estimator of            we will use makes degrees-of-freedom
adjustment:




*This estimator is also denoted as

Properties of OLS Estimators:

If assumption 1 through 4 hold then the estimators              determined by
OLS are known as Best Liner Unbiased Estimates (BLUE).



What does BLUE stand for?
"Estimator" -   is an estimator of true value of .

"Linear"-   is linear in parameter.

"Unbiased" – On average, the actual value of the        will represent the
true values.

"Best" – Means of OLS estimator has minimum variance among the class of
linear unbiased estimators. The Gauss – Markov theorem provides of that of
OLS estimator is best.

**Note

More Related Content

What's hot

Multicolinearity
MulticolinearityMulticolinearity
MulticolinearityPawan Kawan
 
Multicollinearity1
Multicollinearity1Multicollinearity1
Multicollinearity1Muhammad Ali
 
Multivariate reg analysis
Multivariate reg analysisMultivariate reg analysis
Multivariate reg analysisIrfan Hussain
 
Multivariate analysis - Multiple regression analysis
Multivariate analysis -  Multiple regression analysisMultivariate analysis -  Multiple regression analysis
Multivariate analysis - Multiple regression analysisRaihanathusSahdhiyya
 
Auto Correlation Presentation
Auto Correlation PresentationAuto Correlation Presentation
Auto Correlation PresentationIrfan Hussain
 
Business Quantitative Lecture 3
Business Quantitative Lecture 3Business Quantitative Lecture 3
Business Quantitative Lecture 3saark
 
Dependance Technique, Regression & Correlation
Dependance Technique, Regression & Correlation Dependance Technique, Regression & Correlation
Dependance Technique, Regression & Correlation Qasim Raza
 
Introduction to regression analysis 2
Introduction to regression analysis 2Introduction to regression analysis 2
Introduction to regression analysis 2Sibashis Chakraborty
 
Regression analysis made easy
Regression analysis made easyRegression analysis made easy
Regression analysis made easyWeam Banjar
 
Data Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVAData Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVADerek Kane
 
Linear regression
Linear regressionLinear regression
Linear regressionDepEd
 
Business Quantitative - Lecture 2
Business Quantitative - Lecture 2Business Quantitative - Lecture 2
Business Quantitative - Lecture 2saark
 
Dependence Techniques
Dependence Techniques Dependence Techniques
Dependence Techniques Hasnain Khan
 

What's hot (19)

Multicolinearity
MulticolinearityMulticolinearity
Multicolinearity
 
Multicollinearity
MulticollinearityMulticollinearity
Multicollinearity
 
Multicollinearity1
Multicollinearity1Multicollinearity1
Multicollinearity1
 
Multicollinearity PPT
Multicollinearity PPTMulticollinearity PPT
Multicollinearity PPT
 
Autocorrelation
AutocorrelationAutocorrelation
Autocorrelation
 
Multivariate reg analysis
Multivariate reg analysisMultivariate reg analysis
Multivariate reg analysis
 
Multivariate analysis - Multiple regression analysis
Multivariate analysis -  Multiple regression analysisMultivariate analysis -  Multiple regression analysis
Multivariate analysis - Multiple regression analysis
 
Auto Correlation Presentation
Auto Correlation PresentationAuto Correlation Presentation
Auto Correlation Presentation
 
Business Quantitative Lecture 3
Business Quantitative Lecture 3Business Quantitative Lecture 3
Business Quantitative Lecture 3
 
Econometrics chapter 8
Econometrics chapter 8Econometrics chapter 8
Econometrics chapter 8
 
Regression presentation
Regression presentationRegression presentation
Regression presentation
 
Dependance Technique, Regression & Correlation
Dependance Technique, Regression & Correlation Dependance Technique, Regression & Correlation
Dependance Technique, Regression & Correlation
 
Introduction to regression analysis 2
Introduction to regression analysis 2Introduction to regression analysis 2
Introduction to regression analysis 2
 
Regression analysis made easy
Regression analysis made easyRegression analysis made easy
Regression analysis made easy
 
Regression
RegressionRegression
Regression
 
Data Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVAData Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVA
 
Linear regression
Linear regressionLinear regression
Linear regression
 
Business Quantitative - Lecture 2
Business Quantitative - Lecture 2Business Quantitative - Lecture 2
Business Quantitative - Lecture 2
 
Dependence Techniques
Dependence Techniques Dependence Techniques
Dependence Techniques
 

Similar to 2.3 the simple regression model

Data Science - Part XII - Ridge Regression, LASSO, and Elastic Nets
Data Science - Part XII - Ridge Regression, LASSO, and Elastic NetsData Science - Part XII - Ridge Regression, LASSO, and Elastic Nets
Data Science - Part XII - Ridge Regression, LASSO, and Elastic NetsDerek Kane
 
ders 8 Quantile-Regression.ppt
ders 8 Quantile-Regression.pptders 8 Quantile-Regression.ppt
ders 8 Quantile-Regression.pptErgin Akalpler
 
Interpreting Regression Results - Machine Learning
Interpreting Regression Results - Machine LearningInterpreting Regression Results - Machine Learning
Interpreting Regression Results - Machine LearningKush Kulshrestha
 
Regression and Classification Analysis
Regression and Classification AnalysisRegression and Classification Analysis
Regression and Classification AnalysisYashIyengar
 
Dem 7263 fall 2015 spatially autoregressive models 1
Dem 7263 fall 2015   spatially autoregressive models 1Dem 7263 fall 2015   spatially autoregressive models 1
Dem 7263 fall 2015 spatially autoregressive models 1Corey Sparks
 
chapter_7.pptx
chapter_7.pptxchapter_7.pptx
chapter_7.pptxABDULAI3
 
Stats ca report_18180485
Stats ca report_18180485Stats ca report_18180485
Stats ca report_18180485sarthakkhare3
 
Multivariate Regression Analysis.pptx
Multivariate Regression Analysis.pptxMultivariate Regression Analysis.pptx
Multivariate Regression Analysis.pptxdeepakyadav704
 
Binary OR Binomial logistic regression
Binary OR Binomial logistic regression Binary OR Binomial logistic regression
Binary OR Binomial logistic regression Dr Athar Khan
 
linear model multiple predictors.pdf
linear model multiple predictors.pdflinear model multiple predictors.pdf
linear model multiple predictors.pdfssuser7d5314
 
Introduction to Limited Dependent variable
Introduction to Limited Dependent variableIntroduction to Limited Dependent variable
Introduction to Limited Dependent variableAshok Dsouza
 

Similar to 2.3 the simple regression model (20)

Data Science - Part XII - Ridge Regression, LASSO, and Elastic Nets
Data Science - Part XII - Ridge Regression, LASSO, and Elastic NetsData Science - Part XII - Ridge Regression, LASSO, and Elastic Nets
Data Science - Part XII - Ridge Regression, LASSO, and Elastic Nets
 
CH3.pdf
CH3.pdfCH3.pdf
CH3.pdf
 
Eviews forecasting
Eviews forecastingEviews forecasting
Eviews forecasting
 
ders 8 Quantile-Regression.ppt
ders 8 Quantile-Regression.pptders 8 Quantile-Regression.ppt
ders 8 Quantile-Regression.ppt
 
MF Presentation.pptx
MF Presentation.pptxMF Presentation.pptx
MF Presentation.pptx
 
Bus 173_6.pptx
Bus 173_6.pptxBus 173_6.pptx
Bus 173_6.pptx
 
Interpreting Regression Results - Machine Learning
Interpreting Regression Results - Machine LearningInterpreting Regression Results - Machine Learning
Interpreting Regression Results - Machine Learning
 
Unit 05 - Consolidated.pptx
Unit 05 - Consolidated.pptxUnit 05 - Consolidated.pptx
Unit 05 - Consolidated.pptx
 
Multiple regression
Multiple regressionMultiple regression
Multiple regression
 
Regression and Classification Analysis
Regression and Classification AnalysisRegression and Classification Analysis
Regression and Classification Analysis
 
Dem 7263 fall 2015 spatially autoregressive models 1
Dem 7263 fall 2015   spatially autoregressive models 1Dem 7263 fall 2015   spatially autoregressive models 1
Dem 7263 fall 2015 spatially autoregressive models 1
 
chapter_7.pptx
chapter_7.pptxchapter_7.pptx
chapter_7.pptx
 
Stats ca report_18180485
Stats ca report_18180485Stats ca report_18180485
Stats ca report_18180485
 
pdf (9).pdf
pdf (9).pdfpdf (9).pdf
pdf (9).pdf
 
Ch5_OLSasymptotic.pdf
Ch5_OLSasymptotic.pdfCh5_OLSasymptotic.pdf
Ch5_OLSasymptotic.pdf
 
Multivariate Regression Analysis.pptx
Multivariate Regression Analysis.pptxMultivariate Regression Analysis.pptx
Multivariate Regression Analysis.pptx
 
Binary OR Binomial logistic regression
Binary OR Binomial logistic regression Binary OR Binomial logistic regression
Binary OR Binomial logistic regression
 
Chapter4_Multi_Reg_Estim.pdf.pdf
Chapter4_Multi_Reg_Estim.pdf.pdfChapter4_Multi_Reg_Estim.pdf.pdf
Chapter4_Multi_Reg_Estim.pdf.pdf
 
linear model multiple predictors.pdf
linear model multiple predictors.pdflinear model multiple predictors.pdf
linear model multiple predictors.pdf
 
Introduction to Limited Dependent variable
Introduction to Limited Dependent variableIntroduction to Limited Dependent variable
Introduction to Limited Dependent variable
 

More from Regmi Milan

Work place violence
Work place violenceWork place violence
Work place violenceRegmi Milan
 
(C) Regmi_Public Private Partnership
(C) Regmi_Public Private Partnership(C) Regmi_Public Private Partnership
(C) Regmi_Public Private PartnershipRegmi Milan
 
Prespective On Chinese Financial System and policy-reforms-
Prespective On Chinese Financial System and policy-reforms-Prespective On Chinese Financial System and policy-reforms-
Prespective On Chinese Financial System and policy-reforms-Regmi Milan
 
E-Commerce-Chapter-4_MR
E-Commerce-Chapter-4_MRE-Commerce-Chapter-4_MR
E-Commerce-Chapter-4_MRRegmi Milan
 
Project M&E (unit 1-4)
Project M&E (unit 1-4)Project M&E (unit 1-4)
Project M&E (unit 1-4)Regmi Milan
 
E-Commerce -Note -2
E-Commerce -Note -2E-Commerce -Note -2
E-Commerce -Note -2Regmi Milan
 
E-Commerce-Note-1_MR
E-Commerce-Note-1_MRE-Commerce-Note-1_MR
E-Commerce-Note-1_MRRegmi Milan
 
Micro Hydro Schemes : Case of Ghandruk VDC, Nepal
Micro Hydro Schemes : Case of Ghandruk VDC, Nepal Micro Hydro Schemes : Case of Ghandruk VDC, Nepal
Micro Hydro Schemes : Case of Ghandruk VDC, Nepal Regmi Milan
 
Insights in Economic Development Of Nepal & Early United States Assistance to...
Insights in Economic Development Of Nepal & Early United States Assistance to...Insights in Economic Development Of Nepal & Early United States Assistance to...
Insights in Economic Development Of Nepal & Early United States Assistance to...Regmi Milan
 
GATT & WTO : History and Prospective of Nepal.
GATT & WTO : History and  Prospective of Nepal.GATT & WTO : History and  Prospective of Nepal.
GATT & WTO : History and Prospective of Nepal.Regmi Milan
 
Nepal japan project_2013
Nepal japan project_2013Nepal japan project_2013
Nepal japan project_2013Regmi Milan
 
Chitwan overview
Chitwan overviewChitwan overview
Chitwan overviewRegmi Milan
 
Pokhara- Field Presentation On Thematic Areas
Pokhara-  Field Presentation On Thematic AreasPokhara-  Field Presentation On Thematic Areas
Pokhara- Field Presentation On Thematic AreasRegmi Milan
 
Principle of abiity to pay
Principle of  abiity to payPrinciple of  abiity to pay
Principle of abiity to payRegmi Milan
 
Lecture on public finance ( abridged version)
Lecture on public finance ( abridged version)Lecture on public finance ( abridged version)
Lecture on public finance ( abridged version)Regmi Milan
 
Final study report for publication december 17, 2009
Final study report for publication december 17, 2009Final study report for publication december 17, 2009
Final study report for publication december 17, 2009Regmi Milan
 
Annex 2 national micro finance policy
Annex 2 national micro finance policyAnnex 2 national micro finance policy
Annex 2 national micro finance policyRegmi Milan
 

More from Regmi Milan (20)

Work place violence
Work place violenceWork place violence
Work place violence
 
(C) Regmi_Public Private Partnership
(C) Regmi_Public Private Partnership(C) Regmi_Public Private Partnership
(C) Regmi_Public Private Partnership
 
Prespective On Chinese Financial System and policy-reforms-
Prespective On Chinese Financial System and policy-reforms-Prespective On Chinese Financial System and policy-reforms-
Prespective On Chinese Financial System and policy-reforms-
 
E-Commerce-Chapter-4_MR
E-Commerce-Chapter-4_MRE-Commerce-Chapter-4_MR
E-Commerce-Chapter-4_MR
 
Project M&E (unit 1-4)
Project M&E (unit 1-4)Project M&E (unit 1-4)
Project M&E (unit 1-4)
 
E-Commerce -Note -2
E-Commerce -Note -2E-Commerce -Note -2
E-Commerce -Note -2
 
E-Commerce-Note-1_MR
E-Commerce-Note-1_MRE-Commerce-Note-1_MR
E-Commerce-Note-1_MR
 
Micro Hydro Schemes : Case of Ghandruk VDC, Nepal
Micro Hydro Schemes : Case of Ghandruk VDC, Nepal Micro Hydro Schemes : Case of Ghandruk VDC, Nepal
Micro Hydro Schemes : Case of Ghandruk VDC, Nepal
 
Ghandruk
GhandrukGhandruk
Ghandruk
 
Insights in Economic Development Of Nepal & Early United States Assistance to...
Insights in Economic Development Of Nepal & Early United States Assistance to...Insights in Economic Development Of Nepal & Early United States Assistance to...
Insights in Economic Development Of Nepal & Early United States Assistance to...
 
GATT & WTO : History and Prospective of Nepal.
GATT & WTO : History and  Prospective of Nepal.GATT & WTO : History and  Prospective of Nepal.
GATT & WTO : History and Prospective of Nepal.
 
HDI
HDIHDI
HDI
 
Nepal japan project_2013
Nepal japan project_2013Nepal japan project_2013
Nepal japan project_2013
 
Chitwan overview
Chitwan overviewChitwan overview
Chitwan overview
 
Optical fibers
Optical fibersOptical fibers
Optical fibers
 
Pokhara- Field Presentation On Thematic Areas
Pokhara-  Field Presentation On Thematic AreasPokhara-  Field Presentation On Thematic Areas
Pokhara- Field Presentation On Thematic Areas
 
Principle of abiity to pay
Principle of  abiity to payPrinciple of  abiity to pay
Principle of abiity to pay
 
Lecture on public finance ( abridged version)
Lecture on public finance ( abridged version)Lecture on public finance ( abridged version)
Lecture on public finance ( abridged version)
 
Final study report for publication december 17, 2009
Final study report for publication december 17, 2009Final study report for publication december 17, 2009
Final study report for publication december 17, 2009
 
Annex 2 national micro finance policy
Annex 2 national micro finance policyAnnex 2 national micro finance policy
Annex 2 national micro finance policy
 

Recently uploaded

Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 

Recently uploaded (20)

Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 

2.3 the simple regression model

  • 1. Expected Values and Variances of OLS Estimators: We defined the population model , and we claimed that the key assumption for simple regression analysis to be useful is that the expected value of u given any value of x is zero. We discussed the algebraic properties of OLS estimation. We now return to the population model and study the statistical properties of OLS. In other words, we now view as estimators for the parameters ��� that appear in the population model. Assumptions for unbiased OLS: SLR 1. Liner in parameters: SLR 2. We use random sample size for the population model i= 1,2,3……….n. where, is the error or disturbance for observation i(for example, person i, firm i, city i, etc.). Thus , contains the unobservables for observation affects the . The should not be confused with the that was defined earlier. Discussion between the errors and residuals will be covered later. SLR 3. Zero Conditional Mean: For a random sample this assumption implies:
  • 2. SLR 4. The sample variation in the independent variable: This means if = wage and = education then SLR. 4 fail only if every one in the sample has the same amount of education. This is hardly true! USING SLR1.- SLR4, for any values of In other words are unbiased estimates for Variance in OLS estimators: Once we know that are unbiased estimates for we must also know how far do we expect to be from on an average. Among other things this allows us to choose the best estimator among all, or at least a broad class of unbiased estimators. SLR 5. This is the homoskedasity Assumption. This assumption plays no role in showing are unbiased estimators of��� is often called the error variance or disturbance variance.
  • 3. ** Note Under Assumption SLR.1 through SLR.5 Where these are conditional on the sample values Note: All the quantities of entering in the preceding equations except can be estimated from the data.
  • 4. But variance can be estimated using the following formula (IF YOU WANT REFER TO APPENDIX 3.A) Estimating the Error in Variance: So far we know that: And . Difference between errors (or disturbance)and residuals is crucial for constructing . Population model in terms of randomly observed sample can be written as: and is the ERROR for observation in terms of fitted value can be expressed as: and is the RESIDUAL for observation Thus: We saw previously that for OLS to be unbiased . But . The difference between them does not have a zero expected value. Now returning to :
  • 5. Thus the unbiased “estimator” for is: But since we do not observer and observe only the OLS residual of . This is the true estimator, because it gives a complete rule for any sample data on on One slight drawback to this estimator is that it turns out to be biased (although for large the bias is small). The is biased only because it does not account for two restrictions that OLS satisfies: Since there are only n-2 degrees of freedom in OLS residuals (as opposed to degrees of freedom in errors) If we apply the restrictions in are replace with the above restrictions would no longer hold. The unbiased estimator of we will use makes degrees-of-freedom adjustment: *This estimator is also denoted as Properties of OLS Estimators: If assumption 1 through 4 hold then the estimators determined by OLS are known as Best Liner Unbiased Estimates (BLUE). What does BLUE stand for?
  • 6. "Estimator" - is an estimator of true value of . "Linear"- is linear in parameter. "Unbiased" – On average, the actual value of the will represent the true values. "Best" – Means of OLS estimator has minimum variance among the class of linear unbiased estimators. The Gauss – Markov theorem provides of that of OLS estimator is best. **Note