Publications:
The Effects of Choice-based Sampling and Small-sample Bias on Past Fair Lending Exams

by Jason Dietrich

Abstract

The Office of the Comptroller of the Currency uses choice-based sampling and limited sample sizes for statistically modeled fair lending exams. Both choice-based sampling and small sample sizes introduce bias into the maximum likelihood logit estimator, the standard estimator used by the OCC. This study applies results from Amemiya (1980) and Scott and Wild (1991) to estimate these biases for 16 recent exams.

The results show that of 29 tests of the null hypothesis of no racial effect conducted during the 16 exams, the outcome of two would change if small sample bias were taken into account, and the outcome of six would change if choice-based sampling bias were taken into account. Overall, the bias from choice-based sampling is generally larger. Although this study does not attempt to establish whether better sampling strategies would have changed examination conclusions based on any of the 29 hypothesis tests, the findings show that such strategies would have prescribed more thorough manual followup reviews for at least five of the 29 tests.

Disclaimer

As with all OCC Working Papers, the opinions expressed in this paper are those of the author alone, and do not necessarily reflect the views of the Office of the Comptroller of the Currency or the Department of the Treasury.

Any whole or partial reproduction of material in this paper should include the following citation: Jason Dietrich " The Effects of Choice-based Sampling and Small-sample Bias on Past Fair Lending Exams, " Office of the Comptroller of the Currency, E&PA Working Paper 2001-2, June 2001.

Availability

The paper is available for viewing in Adobe's PDF format. The PDF viewer is available for download free from Adobe in versions for different platforms.

The complete paper is available in hard copy from the OCC's Communications Division. If you would like to receive a copy of a paper through the U.S. Postal Service:

• Write to the Communications Division, Mail Stop 3-3, Office of the Comptroller of the Currency, Washington, DC 20219, or
• Send an e-mail request to the Communications Division at foia-pa@occ.treas.gov.