4.4.3 Quadratic Approximations and Inference

The maximum-likelihood parameter estimates \(\hat{\beta}\) satisfy a self-consistency relationship: they are the coefficients of a weighted least squares fit, where responses are (4.29): \[ z_i = x_i^T\hat{\beta} + \cfrac{(y_i - \hat{p}_i)}{\hat{p}_i(1-\hat{p}_i)} \] and the weights are \(w_i=\hat{p}_i(1-\hat{p}_i)\). This connection has more to offer: