On solving bias-corrected non-linear estimation equations with an application to the dynamic linear model

Munir Mahmood, Maxwell L. King

Research output: Contribution to journalArticleResearchpeer-review

Abstract

In a seminal paper, Mak, Journal of the Royal Statistical Society B, 55, 1993, 945, derived an efficient algorithm for solving non-linear unbiased estimation equations. In this paper, we show that when Mak's algorithm is applied to biased estimation equations, it results in the estimates that would come from solving a bias-corrected estimation equation, making it a consistent estimator if regularity conditions hold. In addition, the properties that Mak established for his algorithm also apply in the case of biased estimation equations but for estimates from the bias-corrected equations. The marginal likelihood estimator is obtained when the approach is applied to both maximum likelihood and least squares estimation of the covariance matrix parameters in the general linear regression model. The new approach results in two new estimators when applied to the profile and marginal likelihood functions for estimating the lagged dependent variable coefficient in the dynamic linear regression model. Monte Carlo simulation results show the new approach leads to a better estimator when applied to the standard profile likelihood. It is therefore recommended for situations in which standard estimators are known to be biased.

Original languageEnglish
Pages (from-to)332-355
Number of pages24
JournalStatistica Neerlandica
Volume70
Issue number4
DOIs
Publication statusPublished - 1 Nov 2016

Keywords

  • estimating equations
  • Mak's algorithm
  • marginal likelihood
  • profile likelihood

Cite this

@article{bc31c1a9b2b24a69b0cbf0ef648443bb,
title = "On solving bias-corrected non-linear estimation equations with an application to the dynamic linear model",
abstract = "In a seminal paper, Mak, Journal of the Royal Statistical Society B, 55, 1993, 945, derived an efficient algorithm for solving non-linear unbiased estimation equations. In this paper, we show that when Mak's algorithm is applied to biased estimation equations, it results in the estimates that would come from solving a bias-corrected estimation equation, making it a consistent estimator if regularity conditions hold. In addition, the properties that Mak established for his algorithm also apply in the case of biased estimation equations but for estimates from the bias-corrected equations. The marginal likelihood estimator is obtained when the approach is applied to both maximum likelihood and least squares estimation of the covariance matrix parameters in the general linear regression model. The new approach results in two new estimators when applied to the profile and marginal likelihood functions for estimating the lagged dependent variable coefficient in the dynamic linear regression model. Monte Carlo simulation results show the new approach leads to a better estimator when applied to the standard profile likelihood. It is therefore recommended for situations in which standard estimators are known to be biased.",
keywords = "estimating equations, Mak's algorithm, marginal likelihood, profile likelihood",
author = "Munir Mahmood and King, {Maxwell L.}",
year = "2016",
month = "11",
day = "1",
doi = "10.1111/stan.12090",
language = "English",
volume = "70",
pages = "332--355",
journal = "Statistica Neerlandica",
issn = "0039-0402",
publisher = "Wiley-Blackwell",
number = "4",

}

On solving bias-corrected non-linear estimation equations with an application to the dynamic linear model. / Mahmood, Munir; King, Maxwell L.

In: Statistica Neerlandica, Vol. 70, No. 4, 01.11.2016, p. 332-355.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - On solving bias-corrected non-linear estimation equations with an application to the dynamic linear model

AU - Mahmood, Munir

AU - King, Maxwell L.

PY - 2016/11/1

Y1 - 2016/11/1

N2 - In a seminal paper, Mak, Journal of the Royal Statistical Society B, 55, 1993, 945, derived an efficient algorithm for solving non-linear unbiased estimation equations. In this paper, we show that when Mak's algorithm is applied to biased estimation equations, it results in the estimates that would come from solving a bias-corrected estimation equation, making it a consistent estimator if regularity conditions hold. In addition, the properties that Mak established for his algorithm also apply in the case of biased estimation equations but for estimates from the bias-corrected equations. The marginal likelihood estimator is obtained when the approach is applied to both maximum likelihood and least squares estimation of the covariance matrix parameters in the general linear regression model. The new approach results in two new estimators when applied to the profile and marginal likelihood functions for estimating the lagged dependent variable coefficient in the dynamic linear regression model. Monte Carlo simulation results show the new approach leads to a better estimator when applied to the standard profile likelihood. It is therefore recommended for situations in which standard estimators are known to be biased.

AB - In a seminal paper, Mak, Journal of the Royal Statistical Society B, 55, 1993, 945, derived an efficient algorithm for solving non-linear unbiased estimation equations. In this paper, we show that when Mak's algorithm is applied to biased estimation equations, it results in the estimates that would come from solving a bias-corrected estimation equation, making it a consistent estimator if regularity conditions hold. In addition, the properties that Mak established for his algorithm also apply in the case of biased estimation equations but for estimates from the bias-corrected equations. The marginal likelihood estimator is obtained when the approach is applied to both maximum likelihood and least squares estimation of the covariance matrix parameters in the general linear regression model. The new approach results in two new estimators when applied to the profile and marginal likelihood functions for estimating the lagged dependent variable coefficient in the dynamic linear regression model. Monte Carlo simulation results show the new approach leads to a better estimator when applied to the standard profile likelihood. It is therefore recommended for situations in which standard estimators are known to be biased.

KW - estimating equations

KW - Mak's algorithm

KW - marginal likelihood

KW - profile likelihood

UR - http://www.scopus.com/inward/record.url?scp=84990949459&partnerID=8YFLogxK

U2 - 10.1111/stan.12090

DO - 10.1111/stan.12090

M3 - Article

VL - 70

SP - 332

EP - 355

JO - Statistica Neerlandica

JF - Statistica Neerlandica

SN - 0039-0402

IS - 4

ER -