This is the accessible text file for GAO report number GAO-04-19 
entitled 'Public Housing: Small and Larger Agencies Have Similar Views 
on Many Recent Housing Reforms' which was released on December 01, 
2003.

This text file was formatted by the U.S. General Accounting Office 
(GAO) to be accessible to users with visual impairments, as part of a 
longer term project to improve GAO products' accessibility. Every 
attempt has been made to maintain the structural and data integrity of 
the original printed product. Accessibility features, such as text 
descriptions of tables, consecutively numbered footnotes placed at the 
end of the file, and the text of agency comment letters, are provided 
but may not exactly duplicate the presentation or format of the printed 
version. The portable document format (PDF) file is an exact electronic 
replica of the printed version. We welcome your feedback. Please E-mail 
your comments regarding the contents or accessibility features of this 
document to Webmaster@gao.gov.

This is a work of the U.S. government and is not subject to copyright 
protection in the United States. It may be reproduced and distributed 
in its entirety without further permission from GAO. Because this work 
may contain copyrighted images or other material, permission from the 
copyright holder may be necessary if you wish to reproduce this 
material separately.

Report to the Ranking Minority Member, Subcommittee on Housing and 
Transportation, Committee on Banking, Housing, and Urban Affairs, U.S. 
Senate:

October 2003:

PUBLIC HOUSING:

Small and Larger Agencies Have Similar Views on Many Recent Housing 
Reforms:

[Hyperlink, http://www.gao.gov/cgi-bin/getrpt?GAO-04-19] GAO-04-19:

GAO Highlights:

Highlights of GAO-04-19, a report to the Ranking Minority Member, 
Subcommittee on Housing and Transportation, Committee on Banking, 
Housing and Urban Affairs, U.S. Senate 

Why GAO Did This Study:

In response to long-standing concerns, HUD initiated efforts to 
improve the administration of its programs in 1997, and Congress 
passed the Quality Housing and Work Responsibility Act (QHWRA) in 
1998. The act contains over 80 reforms that affect two key rental 
housing assistance programs: the low-rent housing program (also 
referred to as public housing) and the Housing Choice Voucher program 
(formerly Section 8). According to many housing agencies, implementing 
these reforms challenged their ability to address their core mission 
of providing safe, decent, and sanitary rental units for low-income 
residents. In particular, some small agencies that manage properties 
with relatively few rental units have contended that some reforms have 
little relevance to their operations and pose a significant burden 
because of the agencies’ limited staff and financial resources.
In response to the request of the Ranking Minority Member of the 
Subcommittee, GAO compared housing agencies by size in terms of (1) 
the impact of recent housing reforms on their ability to administer 
HUD programs, (2) the agencies’ performance as measured by HUD, and 
(3) the differences in the technical assistance that the agencies 
require. To carry out its work, GAO surveyed a statistical sample of 
small and larger public housing agencies nationwide on the impact of 
QHWRA reforms. The response rate to the survey was about 69 percent.

What GAO Found:

Of the 18 QHWRA reforms GAO asked about in its national survey, 
housing agencies of all sizes had similar views on 11 of them. 
However, when asked to what extent these reforms affected their 
operations, agencies’ responses sometimes differed by size category. 
For example, the largest percentages of agencies in all size 
categories viewed the annual plan reform—which requires agencies to 
provide certain information pertaining to their upcoming fiscal year—
as helpful to them in managing and operating their agencies. But small 
agencies indicated that this reform helped to a lesser extent than 
larger agencies.

Other results of our survey:

* All agencies reported spending more time on administering HUD 
programs since QHWRA was implemented. 

* Most agencies said they contracted out about the same amount of 
property management and services as before QHWRA.

* About 75 percent of small agencies reported they believe the 
regulatory changes HUD has issued to reduce administrative burden will 
help.

Performance ratings varied between small and larger housing agencies, 
according to HUD assessment data. The ratings, which assess the 
agencies’ management of HUD housing programs, showed small agencies 
scoring better than larger ones in managing low-rent units. However, 
smaller agencies received lower scores than larger agencies for 
managing Housing Choice Voucher units, but this result may be due 
partly to HUD scoring method. 

HUD uses its risk assessment and management performance assessment 
systems to target assistance based on its determination of those that 
need it most. In addition, housing agencies also contact HUD directly 
to request assistance. However, according to HUD field office 
officials, small agencies are more likely to need assistance with day-
to-day management issues than large agencies because small agencies 
tend to have few staff that specialize in key areas that are important 
to managing HUD’s programs.


www.gao.gov/cgi-bin/getrpt?GAO-04-19.

To view the full product, including the scope and methodology, click 
on the link above. For more information, contact David G. Wood, (202) 
512-8678, or woodd@gao.gov.

[End of section]

Contents:

Letter: 

Background: 

Results in Brief: 

With Some Exceptions, Small Agencies' Views of QHWRA Reforms Were 
Similar to Those of Larger Agencies: 

Scores from HUD's Performance Measurement and Risk Assessment Systems 
Show That Small and Larger Agencies' Performance Varies: 

HUD's Technical Assistance Is Based on Agency Needs, Which Sometimes 
Vary by Agency Size: 

Agency Comments: 

Appendixes:

Appendix I: Scope and Methodology: 

Appendix II: Methodology for GAO's Survey of Local Housing Agencies on 
QHWRA Housing Reforms and Initiatives: 

The Study Population: 

The Sample Design: 

Developing the Survey: 

Administering the Survey: 

Nonsampling Error and Data Quality: 

Response Rates: 

Estimates: 

Sampling Error: 

Appendix III: Survey Results of Housing Agencies: 

Appendix IV: Summary of 18 Reforms Contained in GAO's Survey of Public 
Housing Agencies: 

Appendix V: GAO Contacts and Staff Acknowledgments: 

GAO Contacts: 

Staff Acknowledgments: 

Tables: 

Table 1: Small, Medium, and Large Public Housing Agencies and Their 
Inventory, Based on GAO's Definition for Size, Fiscal Year 2002: 

Table 2: Average SEMAP Scores for Seven Indicators for Which All 
Agencies Are Scored, by Agency Size (Fiscal Year 2002): 

Table 3: Survey Sample Size and Disposition: 

Figures: 

Figure 1: Survey Estimates on Effects of Seven QHWRA Reforms That 
Primarily Helped Agencies to Operate and Manage HUD Programs: 

Figure 2: Survey Estimates on Four QHWRA Reforms That Primarily Neither 
Helped Nor Hindered Agencies to Operate and Manage HUD Programs: 

Figure 3: Survey Estimates on Seven Reforms with Varied Impacts on 
Agency Ability to Operate and Manage HUD Programs: 

Figure 4: Survey Estimates of Time Agencies Spend Administering HUD 
Programs Since QHWRA Reforms: 

Figure 5: Survey Estimates of Extent to Which Agencies Reported 
Increased Reporting Requirements and Changes in Existing Requirements 
Contributed to Increased Time Spent on HUD Programs: 

Figure 6: Survey Estimates of Extent to Which Difficulty in Submitting 
Data on the Low-Rent Program and Accessing HUD's Computer Systems 
Contributed to Increased Time Spent on HUD Programs: 

Figure 7: Survey Estimates of Extent to Which Late and Unclear Guidance 
and Changes in Regulations Contributed to Increased Time Spent on HUD 
Programs: 

Figure 8: Survey Estimates of Extent to Which Lack of Resources for 
Hiring and Training New Staff and the Need to Train Staff Contributed 
to Increased Time Spent on HUD Programs: 

Figure 9: Survey Estimates of Extent to Which Agencies Report 
Contracting Out for Property Management and Services Since QHWRA: 

[See PDF for image]

[End of figure]

Figure 10: Survey Estimates of Extent to Which Agencies Believe HUD's 
Regulatory Relief Will Help: 

[See PDF for image]

[End of figure]

Figure 11: Overall PHAS Scores, by Agency Size (Fiscal Year 2002): 

[See PDF for image]

[End of figure]

Figure 12: Overall SEMAP Scores, by Agency Size (Fiscal Year 2002): 

[See PDF for image]

[End of figure]

Figure 13: Overall PIC Risk Assessment Scores, by Agency Size (Fiscal 
Year 2002): 

Abbreviations:

HUD: Department of Housing and Urban Development:

NAHRO: National Association of Housing and Redevelopment Officials:

PHADA: Public Housing Authorities Directors Association:

PHA: public housing agency:

PHAS: Public Housing Assessment System:

PIC: Public and Indian Housing Information Center:

QHWRA: Quality Housing and Work Responsibility Act:

REAC: Real Estate Assessment Center:

SEMAP: Section Eight Management Assessment Program:

TARC: Troubled Agency Recovery Center:

Letter October 30, 2003:

The Honorable Jack Reed: 
Ranking Minority Member: 
Subcommittee on Housing and Transportation: 
Committee on Banking, Housing, and Urban Affairs: 
United States Senate:

Dear Senator Reed:

Over 4,100 state, county, and municipal housing agencies administer 
federal housing programs--which were funded at nearly $24 billion in 
fiscal year 2003--on behalf of the Department of Housing and Urban 
Development (HUD). In response to long-standing concerns, HUD initiated 
efforts to improve the administration of its programs in 1997, and 
Congress passed the Quality Housing and Work Responsibility Act (QHWRA) 
[Footnote 1] in 1998. QHWRA contains over 80 reforms that affect two 
key rental housing assistance programs: the Low-Rent Public Housing 
Assistance Program (also referred to as low-rent or public housing) and 
the Housing Choice Voucher program (formerly referred to as Section 
8).[Footnote 2] According to many housing agencies, implementing these 
reforms has challenged their ability to address their core mission of 
providing safe, decent, and sanitary rental units for low-income 
residents. In particular, some small agencies that manage properties 
with relatively few rental units have contended that some reforms have 
little relevance to their operations and pose a significant burden 
because of the agencies' limited staff and financial resources.

HUD annually assesses the operating performance of the housing agencies 
that administer the two programs, using performance measurement systems 
that assign agencies a score for each program. HUD uses these scores 
and ratings from its risk assessment system to identify housing 
agencies that may be in need of monitoring and technical assistance. 
HUD's technical assistance--sometimes called capacity building--
involves activities such as training staff at local housing agencies on 
how to use HUD systems or comply with HUD's reporting requirements.

As agreed with your office, we (1) compared how small and larger 
housing agencies view the impact of recent housing reforms on their 
ability to administer HUD programs, (2) compared small and larger 
agencies' performance, as measured by HUD, in administering the low-
rent housing and Housing Choice Voucher programs, and (3) described the 
differences in the technical assistance that small and larger public 
housing agencies require.

For the purposes of this report, we classified agencies based on the 
number of low-rent and Housing Choice Voucher units they administered. 
Small agencies administered fewer than 250 units; medium agencies 
administered between 250 and 1,249 units; and large agencies 
administered 1,250 units or more. To compare how small and larger 
housing agencies view the impact of recent housing reforms on their 
ability to administer HUD programs, we developed a survey that we 
mailed to a statistical sample of public housing agencies nationwide. 
Of the more than 80 QHWRA reforms, our survey focused on the 18 reforms 
that public housing industry associations consider to have had the most 
impact on agencies' operations. Based on the sample, we produced 
national estimates of housing agency directors' perceptions about the 
impact of QHWRA reforms and related issues and tested for size-response 
differences. [Footnote 3] We analyzed respondents' most frequently 
occurring answers to our survey questions to identify similarities and 
differences between small, medium, and large agencies. To compare small 
and larger agencies' performance in managing HUD's low-income housing 
programs, we analyzed data from HUD's performance measurement 
assessment systems. To determine differences in the technical 
assistance that small and larger agencies require, we analyzed data 
from HUD's performance measurement and risk assessment systems and 
interviewed HUD headquarters and field office officials. Appendix I 
contains additional information on our scope and methodology. Appendix 
II contains details on our survey methodology, and appendix III 
contains our survey results.

Background:

Under the United States Housing Act of 1937, as amended, Congress 
created the federal public housing program to assist communities in 
providing decent, safe, and sanitary dwellings for low-income families. 
Today, more than 4,100 public housing agencies, typically local 
agencies created under state law, develop and manage public housing 
units for low-income families. Over 3,100 agencies operate low-rent or 
a combination of low-rent and Housing Choice Voucher programs, and 
about 1,000 provide housing through the voucher program only. Agencies 
that participate in the low-rent program contract with HUD to provide 
housing to eligible low-income households; in return, the agencies 
receive both capital and operating fund grants. Under the Housing 
Choice Voucher program, eligible households live in rental units they 
locate in the private housing market. Participating housing agencies 
that administer such units contract with HUD to receive funds for rent 
subsidies for the participating households.

Congress and HUD Have Initiated Public Housing Reforms:

During the 1990s, the nation's public housing agencies gained broader 
latitude from HUD and Congress to establish their own policies in areas 
such as selecting tenants and setting rent levels. In 1996, Congress 
enacted legislative reforms that allowed public housing agencies to set 
minimum rents and to drop all mandatory federal preferences for 
admission on the basis of hardships such as homelessness. These reforms 
gave housing agencies greater control over their social and fiscal 
environment, enabling them to tailor their policies to local needs and 
conditions. In 1998, Congress enacted the Quality Housing and Work 
Responsibility Act of 1998 (QHWRA).[Footnote 4] This act, which 
extensively amended the United States Housing Act of 1937, embodied 
many of the 1996 reforms, allowing public housing agencies to exercise 
still more discretion over rents and admissions. For example, QHWRA 
increased managerial flexibility by, among other things, making HUD-
provided capital and operating funds more fungible; allowing housing 
authorities to sell some units to residents; converting some public 
housing buildings to the voucher system; and developing mixed-income 
housing units in order to bring more working and upwardly mobile 
families into public housing. QHWRA also imposed new requirements on 
housing agencies, including, for example, mandatory reporting 
requirements in the form of a 5-year plan and annual operating plans.

This report focuses on the 18 QHWRA reforms public housing industry 
groups believe have had the greatest impact on housing agencies' 
operations. These reforms are described more fully in appendix IV.

Reforms concerning agencies' operations:

* Fungibility of capital and operating funds: gives agencies greater 
flexibility to use HUD-provided capital and operating grants 
interchangeably, within certain limits.

* Certificate/voucher merger: requires agencies to adjust 
administrative operations, where needed, in response to the merger of 
two former federal housing assistance programs.

* Five-year plans: requires agencies to prepare comprehensive 5-year 
plans with goals and objectives that serve needs of low-income 
households.

* Annual plans: requires agencies to prepare 1-year plans that include 
information on the agency's low-rent and Housing Choice Voucher 
programs and policies.

* Physical inspections: requires agencies to annually inspect their 
low-rent housing units.

Reforms concerning rent setting:

* Minimum rents: allows agencies to charge public housing residents a 
monthly minimum rent of not more than $50.

* Flat rents: allows households to choose to pay either a flat rent 
based on market rates or rent based on a percentage of their household 
income.

* Rent burden limitation: requires agencies to subsidize initial 
voucher recipients so that their rent does not exceed 40 percent of 
household income.

Reforms concerning resident selection/admission:

* Federal tenant preferences: repeals mandate that agencies give 
admissions preference to certain categories of prospective tenants and 
permits agencies to establish their own preferences within certain 
limits.

* Deconcentration: prohibits agencies from concentrating very low-
income households in public housing projects or buildings within 
projects.

* Income targeting: requires agencies to have a mix of household income 
levels in both low-rent housing and Housing Choice Voucher units.

* Income disregard: requires agencies to exclude certain types of 
income when determining household eligibility for assistance.

* Site-based waiting lists: permits agencies to allow public housing 
applicants to designate specific projects in which they wish to reside, 
subject to certain limits.

Reforms concerning residents:

* Pet policy: requires agencies to allow residents one or more common 
household pets.

* Community service: requires agencies to ensure that most adult public 
housing residents perform monthly community service.

* Resident board member: requires most agencies to have on their board 
of directors at least one member who is directly assisted by the 
agency.

* Resident advisory board: requires agencies to consult with the board 
of residents in preparing annual and 5-year plans.

* Resident surveys: requires HUD to obtain information on the 
involvement of public housing residents in the administration of public 
housing, including residents' satisfaction with their living conditions 
and services.

In response to concerns that some QHWRA reforms are placing an undue 
burden on small housing agencies, HUD recently issued regulations 
designed to lessen their regulatory burden.[Footnote 5] The rule is 
designed to relieve eligible small agencies from administrative burden 
in two areas--the annual plan requirement and annual Public Housing 
Assessment System (PHAS) and Section Eight Management Assessment 
Program (SEMAP) assessments. For example, under the rule, agencies who 
operate fewer than 250 low-rent units are allowed to submit streamlined 
annual plans for their low-rent units. In addition, for small agencies 
that are assessed under PHAS and SEMAP, the rule reduces the frequency 
of these assessments from an annual basis to every other year.

HUD Assists Public Housing Agencies and Evaluates Their Performance:

To improve the administration of its low-income housing programs, HUD 
provides technical assistance either directly or indirectly to housing 
agencies that request assistance or have been identified by HUD as 
needing it. HUD sometimes uses the terms "technical assistance" and 
"capacity building" interchangeably, and the definitions 
overlap.[Footnote 6] Technical assistance programs can generally be 
defined as training designed to improve the performance or management 
of program recipients, such as one-on-one training in the use and 
implementation of HUD's management assessment systems. Capacity 
building can generally be defined as funding to strengthen the capacity 
or capability of program recipients or providers--typically housing or 
community development organizations. The overall goal of both technical 
assistance and capacity building is to enhance the delivery of HUD's 
housing and community development programs, and some assistance efforts 
incorporate elements of each. The technical assistance is delivered by 
staff from HUD's headquarters or one of its 43 field offices or by 
contractors. According to HUD officials, most technical assistance is 
delivered to agencies that request it directly from one of HUD's field 
offices. HUD also provides technical assistance through several 
programs that are administered primarily by headquarters, such as Hope 
VI and the Capital Fund.[Footnote 7]

HUD assesses the performance of public housing agencies so that the 
Secretary of Housing can evaluate agencies' performance in all major 
areas of management operations. To this end, HUD uses two systems to 
assess the management performance of public housing agencies:

* PHAS is designed to obtain an independent evaluation of housing 
agencies' overall performance in managing low-rent units, including the 
physical condition of the units, the soundness of agencies' financial 
operations, the effectiveness of their management operations, and the 
level of resident satisfaction with the services and living conditions. 
HUD's Real Estate Assessment Center (REAC) arranges independent 
physical inspections of HUD's low-rent properties, collects and 
analyzes data on the financial and physical condition of the agencies, 
and evaluates information from resident satisfaction surveys.[Footnote 
8]

* SEMAP measures the performance of the housing authorities that 
administer Housing Choice Voucher units. SEMAP uses 14 indicators that 
measure factors such as procedures for selecting tenants, income 
determinations, and inspections.

HUD uses the Public and Indian Housing Information Center (PIC) system 
to generate a risk assessment of housing agencies. PIC risk assessment 
scores take into account PHAS and SEMAP scores as well as funding and 
compliance information and a number of qualitative factors--for 
example, audit findings, court actions, and tenant claims against 
agencies.

HUD uses PHAS, SEMAP, and PIC scores to identify agencies that are 
having performance problems and determine the kind of technical 
assistance needed to correct deficiencies. As a result of these 
assessments, HUD may determine that a housing authority is "troubled"-
-that is, experiencing especially severe difficulties in managing its 
housing programs. HUD's Troubled Agency Recovery Centers (TARC), 
located in Cleveland, Ohio, and Memphis, Tennessee, provide technical 
assistance to troubled housing agencies.[Footnote 9]

HUD Has Various Ways of Defining the Size of a Small Agency:

HUD has several ways of defining the size of small agencies. For 
example, in its recent small agency deregulation rule, HUD provided two 
definitions for a small agency: one for submitting streamlined annual 
plans and less frequent PHAS assessments, and another for receiving 
less frequent SEMAP assessments. In a 1999 report by the Office of 
Policy Development and Research, HUD defined a small housing agency as 
one with fewer than 500 low-rent units.[Footnote 10] And in another 
report, HUD defined a small agency as one with fewer than 1,000 Housing 
Choice Voucher units.[Footnote 11] However, when HUD's REAC assesses 
the financial performance of housing agencies it classifies small 
agencies as those with less than 250 combined low-rent and Housing 
Choice Voucher units. In carrying out our work, we classified agencies 
by size based on the total number of low-rent and Housing Choice 
Voucher units they administered.

Regardless of the criteria used to define a small agency, most housing 
agencies are considered small. Table 1 shows the number and percentage 
of small, medium, and large agencies according to the definition of 
size that we used in this report. This table also indicates that while 
most agencies are small, they operate a relatively small proportion of 
all units.

Table 1: Small, Medium, and Large Public Housing Agencies and Their 
Inventory, Based on GAO's Definition for Size, Fiscal Year 2002:

Size: Small; Number of agencies: 2,438; Percentage of agencies: 58.2; 
Low-rent units: 136,023; Housing Choice Voucher units: 86,271; Number 
of units: 222,294; Percentage of units: 6.8.

Size: Medium; Number of agencies: 1,269; Percentage of agencies: 30.3; 
Low-rent units: 255,749; Housing Choice Voucher units: 442,945; Number 
of units: 698,694; Percentage of units: 21.3.

Size: Large; Number of agencies: 482; Percentage of agencies: 11.5; 
Low-rent units: 858,528; Housing Choice Voucher units: 1,499,580; 
Number of units: 2,358,108; Percentage of units: 71.9.

Size: Total; Number of agencies: 4,189; Percentage of agencies: 100.0; 
Low-rent units: 1,250,300; Housing Choice Voucher units: 2,028,796; 
Number of units: 3,279,096; Percentage of units: 100.0.

Source: GAO analysis of HUD data.

[End of table]

Results in Brief:

With some exceptions, small agencies' views on the impact of QHWRA 
reforms on their ability to administer HUD programs were similar to 
those of their larger counterparts. Agencies in all size categories 
shared similar views on 11 of the 18 reforms. For example, the largest 
percentages of agencies in all size categories viewed the annual plan 
requirement as helpful to them in managing and operating their 
agencies. But the percentage of small agencies sharing this view was 
smaller than the percentages of medium and large agencies. For the 
remaining seven QHWRA reforms, small, medium, and large agencies' views 
varied. For example, small and medium agencies viewed the requirement 
that each housing agency have a resident member on the board of 
directors as neither a help nor a hindrance to them in managing and 
operating their agencies, while large agencies viewed the requirement 
as a help. Also, agencies of all sizes had similar views on factors 
that account for additional time spent working on HUD programs since 
the implementation of QHWRA. For example, the largest percentage of 
agencies in all size categories reported spending more time on HUD-
subsidized programs after QHWRA than before the reforms were enacted, 
in part because of increased reporting requirements and difficulties in 
submitting data to HUD. Also, the largest percentage of agencies in all 
size categories reported contracting out about the same amount of 
property management and services as before QHWRA was implemented. HUD 
has recently issued rules to simplify and streamline regulatory 
requirement for small agencies. About 75 percent of small agencies 
reported that they believe HUD's efforts will help their operations.

HUD measurement systems show mixed results for small and larger housing 
agencies. Fiscal year 2002 data from the Public Housing Assessment 
System (PHAS), HUD's system for measuring the performance of public 
housing agencies that manage low-rent units, show that small agencies 
performed slightly better than their larger counterparts. But scores 
for the same period from the Section Eight Management Assessment 
Program (SEMAP), which measures how well agencies administer Housing 
Choice Voucher units, indicate that small agencies did not perform as 
well as larger agencies. Small agencies may have lower SEMAP scores 
both because of the method that HUD uses to calculate scores and 
because small agencies generally have less experience administering 
these units. Fiscal year 2002 scores from HUD's risk assessment system-
-the Public and Indian Housing Information Center (PIC)--show that a 
larger proportion of small agencies were designated as low risk than 
larger agencies. According to HUD officials, small agencies are more 
likely to be considered low risk because these agencies typically have 
a less complicated funding structure than larger agencies and operate 
less complex programs.

According to HUD officials, public housing agencies receive technical 
assistance based on HUD's determination of their individual needs and 
agencies' requests for specific types of assistance. HUD uses its 
performance measurement and risk assessment systems--PHAS, SEMAP, and 
PIC--to determine housing agencies' need for technical assistance. 
These systems indicate that small agencies may need more assistance 
than their larger counterparts in administering Housing Choice Voucher 
units. HUD field office officials told us that the needs of small 
housing agencies sometimes differ from those of larger agencies. They 
stated, for example, that small agencies are more likely to require 
assistance with the day-to-day management of HUD programs because small 
agencies often have few staff who specialize in finance, accounting, 
management information systems, or other areas that are important to 
managing these programs. Currently, HUD does not maintain centralized, 
detailed information on the types of assistance housing agencies 
require or request from them. According to HUD, the agency is 
developing a tracking system that will allow it to collect such 
information in the future.

The Acting Director of HUD's Office of Policy, Program, and Legislative 
Initiatives provided us with technical comments on our report, which we 
have incorporated as appropriate.

With Some Exceptions, Small Agencies' Views of QHWRA Reforms Were 
Similar to Those of Larger Agencies:

Our national survey of directors of public housing agencies showed that 
respondents from agencies in all size categories shared similar views 
on the effects of many QHWRA reforms on their ability to administer HUD 
programs and rental units.[Footnote 12] For example, we asked whether 
individual reforms had helped or hindered directors' ability to operate 
and manage their agencies. In response, directors of small, medium, and 
large housing agencies cited many of the same reforms as having helped 
them, although for some reforms the proportions of those agreeing 
differed by size category. Further, a large proportion of agency 
directors in each size category said that their staffs spent more time 
on HUD-subsidized programs as a result of the QHWRA reforms. Regardless 
of size, agencies in all size categories had similar views on the 
extent to which 13 factors had contributed to this increase in 
administrative time. These factors relate to new reporting 
requirements, difficulty with HUD's data systems, lack of clear 
guidance from HUD, and lack of resources for hiring and training staff. 
Small agencies noted that proposed regulatory relief would relieve some 
of their burden.

Agency Directors in All Size Categories Saw Many of the Same QHWRA 
Reforms as Helping or Neither Helping Nor Hindering:

Regardless of their agencies' size, the largest proportion of directors 
tended to agree on the effects of 11 of the 18 QHWRA provisions we 
included in our survey. We asked whether the 18 reforms had helped, 
hindered, or neither helped nor hindered the agencies in operating and 
managing their HUD programs. Overall, 7 reforms were generally seen as 
helping agencies to operate and manage their HUD programs, and 4 
reforms were seen as neither helping nor hindering.

The Most Frequent Responses for All Agencies Viewed Seven Reforms as 
Helping:

As shown in figure 1, agencies indicated that 7 of the 18 reforms had 
helped them. Two reforms were viewed as helpful by large percentages of 
agencies in all size categories. Fungibility of capital and operating 
funds, which allows agencies to use up to 20 percent of their capital 
funds for operating purposes, was seen as helping almost 70 percent of 
small, 82 percent of medium, and 84 percent of large agencies, 
respectively. The repeal of federal preferences, which gives agencies 
more flexibility to decide who will be admitted to their public housing 
units, was viewed as helpful by 44, 63, and 69 percent, respectively, 
of small, medium, and large agencies.

Figure 1: Survey Estimates on Effects of Seven QHWRA Reforms That 
Primarily Helped Agencies to Operate and Manage HUD Programs:

[See PDF for image]

Note: All percentage estimates in this table have 95% confidence 
intervals ±5.8 percentage points or better.

[End of figure]

The popularity of these two reforms--the fungibility of capital and 
operating funds and the repeal of federal preferences--may be directly 
related to the funding shortfalls that have historically affected 
public housing agencies. As we noted in our 1998 report on HUD's 
Performance Funding System,[Footnote 13] the operating subsidies that 
HUD has traditionally provided to public housing agencies have not 
covered all operating expenses. However, the reforms appear to have 
helped greater proportions of medium and especially large agencies, 
which tend to manage more programs and to have more funding sources and 
a larger pool of potential tenants.

More than a third of agencies may see QHWRA's flat rent reform, which 
allows housing agencies to charge rents based on the market value of 
the unit, as an important opportunity to increase their revenues and 
counter some shortfalls. Approximately 40 percent of agencies saw the 
flat rent reform as helpful. This reform may appeal more to small 
agencies with limited revenue sources--which may explain the slightly 
higher percentage of small agencies reporting this reform as helpful. 
Similarly, as shown in figure 1, the largest proportion of agencies of 
all sizes--about a third or more--saw the 5-year and annual plan 
reforms as helpful. However, the larger the agency, the greater the 
percentage that reported being helped, and nearly a third of 
respondents from small agencies saw these plans as a hindrance. This 
response is consistent with comments we received from HUD field staff 
we interviewed, who generally agreed that housing agencies needed some 
type of planning process but pointed out that small agencies did not 
have staff to undertake the level of effort involved in developing 
annual and 5-year plans.

Small agencies were much less likely to view the Housing Choice Voucher 
program merger reform as helpful than were large agencies (45 percent 
compared with 82 percent, respectively.) These responses are consistent 
with other information from our survey, which indicated that 
approximately 58 percent of small agencies do not have Housing Choice 
Voucher units, while an estimated 90 percent of medium and large 
agencies do.

The Most Frequent Responses for All Agencies Viewed Four Reforms as 
Neither Helping Nor Hindering:

Based on the most frequent responses in each size category, the largest 
proportions of housing agencies in all size categories viewed the 
deconcentration, income targeting, site-based waiting list, and rent 
burden limits for the voucher program reforms as generally neither 
helping nor hindering their ability to manage and operate their 
agencies (fig. 2).

Figure 2: Survey Estimates on Four QHWRA Reforms That Primarily Neither 
Helped Nor Hindered Agencies to Operate and Manage HUD Programs:

[See PDF for image]

Note: All percentage estimates in this table have 95% confidence 
intervals ±5.9 percentage points or less.

[End of figure]

Of these four reforms, the predominate percentage of agencies in each 
size category viewed deconcentration and income targeting as neither a 
help nor a hindrance. However, a smaller percentage of small agencies 
viewed deconcentration as neither a help nor a hindrance than medium 
and large agencies. Also, about 29 percent of medium and large agencies 
view income targeting as a hindrance, whereas only 13 percent of small 
agencies see it as a hindrance.

Agencies in Each Size Category Varied Somewhat in Their Views on Seven 
QHWRA Reforms:

As shown in figure 3, for the remaining seven QHWRA reforms that we 
asked about--the pet policy, community service requirement, income 
disregard, resident surveys, resident advisory board, resident member 
on agency board, and minimum rents--views varied among agencies of 
different sizes. For example, a larger percentage of medium and large 
agencies viewed the pet policy rule as a hindrance, while the largest 
percentage of small agencies viewed it as neither a help nor a 
hindrance.

Figure 3: Survey Estimates on Seven Reforms with Varied Impacts on 
Agency Ability to Operate and Manage HUD Programs:

[See PDF for image]

Note: All percentage estimates in this table have 95% confidence 
intervals ±5.8 percentage points or less.

[End of figure]

In contrast, small and medium agencies most frequently viewed the 
resident advisory board, the resident member of agency board, and the 
resident survey reforms as neither helping nor hindering, while large 
agencies most frequently responded that these reforms were helpful. 
This response is consistent with earlier GAO findings. As reported in 
our May 2002 report on housing agencies' experiences preparing their 
fiscal year 2000 plans,[Footnote 14] HUD officials told us that 
agencies overall often had difficulty encouraging resident 
participation, even when it was actively solicited. Further, the 
officials pointed out that smaller agencies do not have the same pool 
of potential residents to draw on that large agencies have, making it 
more difficult to establish resident advisory boards and find residents 
willing to serve as member representatives on agencies' boards.

Agencies of All Sizes Reported Spending More Time on HUD-Subsidized 
Programs:

We asked agencies to compare the amount of time they were spending on 
HUD-subsidized programs following the implementation of the reforms 
with the amount of time they devoted to these programs before the 
implementation of QHWRA. At least 60 percent or more of all agencies, 
regardless of size, believed that they were spending more or much more 
time on HUD programs since the implementation of QHWRA. However, as 
shown in figure 4, a smaller percentage of small agencies (63 percent) 
than of large agencies (79 percent) reported spending more time 
administering their HUD programs.

Figure 4: Survey Estimates of Time Agencies Spend Administering HUD 
Programs Since QHWRA Reforms:

[See PDF for image]

Note: All percentage estimates in this table have 95% confidence 
intervals ±4.8 percentage points or less.

[End of figure]

These responses may reflect the fact that medium and large agencies 
generally have more HUD programs and thus more complex administrative 
responsibilities. Based on our survey, we estimate that only 10 percent 
of small agencies--compared with 19 percent of medium agencies and 58 
percent of large agencies--had HUD programs other than the low-rent and 
voucher programs.

We asked agencies that reported spending more time on HUD programs 
following QHWRA to indicate the extent to which each of 17 factors 
added to their administrative time. In general, we found more 
similarities than differences in the responses of agencies in all size 
categories. The factors most frequently cited as accounting for the 
increased time on HUD programs were increased reporting requirements, 
problems submitting data to HUD, and insufficient guidance from HUD. 
Smaller proportions of agencies of all sizes noted that other factors 
added to their administrative time, though the proportions differed 
somewhat.

New Reporting Requirements and Changes in Existing Requirements:

While agencies in all size categories cited increased reporting 
requirements and changes in reporting requirements as adding to the 
time they spent administering HUD programs, the proportions differed 
according to the type of program (see fig. 5). The largest proportions 
of agencies indicated that these items had increased the time spent 
administering the low-rent program to some or a great extent. However, 
small agencies cited these factors in larger proportions than medium or 
large agencies.

Figure 5: Survey Estimates of Extent to Which Agencies Reported 
Increased Reporting Requirements and Changes in Existing Requirements 
Contributed to Increased Time Spent on HUD Programs:

[See PDF for image]

Note: All percentage estimates in this table have 95% confidence 
intervals ±6.6 percentage points or less.

[End of figure]

However, questions about time spent administering the Housing Choice 
Voucher program elicited the opposite pattern of responses, with over 
40 percent of all large agencies but only 15-20 percent of small 
agencies citing the requirements as increasing administrative time to a 
great or very great extent. About 60 percent of small agencies 
indicated that these questions were not applicable to them, reflecting 
the fact that most small agencies operate primarily low-rent housing 
programs, while larger agencies tend to operate both.

Most agency directors whom we interviewed while preparing our 
questionnaire said that the increased reporting requirements associated 
with QHWRA were causing them to spend more time on paperwork than on 
their primary mission of providing safe, decent, and affordable housing 
to low-income residents. One respondent noted, "It takes more man-hours 
for processing and compiling statistical data for reporting and 
tracking purposes," taking up time the agency needed to address other 
functions. Housing agency directors we spoke with early in our review 
acknowledged the need for reporting to ensure accountability, but they 
reiterated that the level of reporting HUD requires is burdensome to 
performing their core mission.

Difficulty Submitting Data and Accessing HUD's Computer System:

Almost half or more of respondents, regardless of size, responded that 
accessing HUD's computer systems and submitting data to HUD on the low-
rent program accounted for increased administrative time to a great or 
very great extent.[Footnote 15] As shown in figure 6, higher 
percentages of large agencies reported having difficulty accessing 
HUD's computer system (59 percent) than small agencies (49 percent), 
but the difference in percentages was more modest on the issue of 
submitting data on the low-rent program.

Figure 6: Survey Estimates of Extent to Which Difficulty in Submitting 
Data on the Low-Rent Program and Accessing HUD's Computer Systems 
Contributed to Increased Time Spent on HUD Programs:

[See PDF for image]

Note: All percentage estimates in this table have 95% confidence 
intervals ±6.5 percentage points or less.

[End of figure]

These responses are consistent with prior GAO and other reports, which 
have identified weaknesses in HUD's information systems. For example, 
both GAO and HUD's Inspector General have cited the public housing and 
Housing Choice Voucher information systems as management 
challenges.[Footnote 16] Also, during our review of HUD and housing 
agency experiences in preparing the fiscal year 2000 plans required by 
QHWRA,[Footnote 17] over 50 percent of HUD field location respondents 
said that the electronic submission of plans and the conversion of 
plans into a readable format at HUD had a negative effect on their 
ability to review and approve plans. HUD officials added that some 
housing agencies were required to make multiple submissions and that 
the agencies sometimes submitted hard copies to HUD field locations as 
a backup to submitting the plans electronically to HUD.

Late or Unclear HUD Guidance and Changes in Policies:

As shown in figure 7, between 45 and 53 percent of agencies, regardless 
of size, responded that late and unclear guidance or changes in HUD 
policies and regulations added to the time they spent administering HUD 
programs to a great or very great extent. These responses are 
consistent with the results of our earlier review of HUD and its 
housing agency experiences in preparing the fiscal year 2000 plans the 
QHWRA reforms require.[Footnote 18] In our prior review, more than 70 
percent of respondents said that the guidance HUD provided on the 
process of developing agency plans was less than adequate. At that 
time, HUD field office directors told us that because of late and 
unclear guidance, they were unable to tell housing agencies how to 
complete agency plans. One official commented that guidance from HUD 
headquarters at the beginning of the planning process had not been very 
good and was late in getting to field locations. Another official 
reported at that same time that changing rules made it difficult to 
know what housing agencies should do in preparing the plans and what 
field offices should look for in reviewing them.

Figure 7: Survey Estimates of Extent to Which Late and Unclear Guidance 
and Changes in Regulations Contributed to Increased Time Spent on HUD 
Programs:

[See PDF for image]

Note: All percentage estimates in this table have 95% confidence 
intervals ±6.5 percentage points or less.

[End of figure]

Lack of Resources to Hire and Train Staff:

In addition, the largest percentage of agencies, regardless of size, 
reported that the lack of resources for hiring and training staff and 
the need to train staff have contributed to the increased time spent on 
HUD programs to some extent or a great extent (see fig. 8).

Figure 8: Survey Estimates of Extent to Which Lack of Resources for 
Hiring and Training New Staff and the Need to Train Staff Contributed 
to Increased Time Spent on HUD Programs:

[See PDF for image]

Note: All percentage estimates in this table have 95% confidence 
intervals ±6.5 percentage points or less.

[End of figure]

However, when we asked housing agency directors whether they were 
contracting out more, less, or about the same share of property 
management activities after the QHWRA reforms than before, the largest 
proportions said that either they were contracting out about the same 
amount or the question did not apply to them (fig. 9).

Figure 9: Survey Estimates of Extent to Which Agencies Report 
Contracting Out for Property Management and Services Since QHWRA:

[See PDF for image]

Note: All percentage estimates in this table have 95% confidence 
intervals ±5.6 percentage points or less.

[End of figure]

Small Agencies Believe Regulatory Relief Will Help:

HUD has recognized the burden QHWRA reforms have placed on small 
agencies and in August 2002 issued a proposed rule to simplify and 
streamline regulatory requirements for small housing agencies that 
administer the low-rent and voucher assistance programs. The rule was 
issued in final form in June 2003, after our survey was completed. 
According to HUD, the rule changes--including reducing the scope of 
annual plans and reducing the frequency of assessing the performance of 
small housing agencies under PHAS and SEMAP--will alleviate some of the 
administrative burden these agencies face. The rule indicates that to 
be eligible for the annual assessment relief, agencies need to be non-
troubled and operate less than 250 low-rent units to receive reduced 
PHAS assessments, or operate less than 250 housing choice voucher units 
to receive reduced SEMAP assessments. Because the regulatory changes 
were in proposal form when we administered our survey, we asked 
respondents their views on the proposed relief. About three-quarters of 
the small agencies responding to our survey believed the proposed 
regulatory relief would help their operations to a moderate or great 
extent (see fig. 10). We noted that the majority of medium and large 
agencies responded that the question was not applicable.

Figure 10: Survey Estimates of Extent to Which Agencies Believe HUD's 
Regulatory Relief Will Help:

[See PDF for image]

Note: All percentage estimates in this table have 95% confidence 
intervals ±3.8 percentage points or less.

[End of figure]

Scores from HUD's Performance Measurement and Risk Assessment Systems 
Show That Small and Larger Agencies' Performance Varies:

We analyzed fiscal year 2002 scores from HUD's performance measurement 
systems and found that small agencies received higher scores than large 
agencies for administering low-rent units but lower scores for 
administering Housing Choice Voucher units. However, we also found that 
under SEMAP, which measures performance administering Housing Choice 
Voucher units, small agencies may have lower scores because of the way 
HUD calculates the scores and because small agencies generally have 
less experience managing these units. Further, data for the same year 
show that HUD's risk assessment system, PIC, which the agency uses to 
help target its monitoring and assistance efforts, typically assigns 
lower risk ratings to small agencies than to larger agencies. HUD 
officials stated that smaller agencies are more likely to receive lower 
risk ratings in part because these agencies generally operate less 
complex housing programs and have less complicated funding systems.

Fiscal Year 2002 PHAS Scores Show That Many Small Agencies Performed 
Slightly Better Than Large Agencies in Operating Low-Rent Units:

PHAS assesses housing agencies' performance in managing low-rent units 
using four indicators: (1) the physical condition of the properties, 
(2) the soundness of agencies' financial condition, (3) the 
effectiveness of management operations, and (4) the extent to which 
residents are satisfied with their services and living conditions. Each 
of the four PHAS indicators is scored individually. Public housing 
agencies can receive a total of 100 points: 30 each for the physical, 
financial, and management indicators and 10 for the resident 
satisfaction indicator. In assigning performance ratings, HUD uses a 
variety of weights:

* High performers must have an overall score of more than 90 points and 
scores for individual indicators of at least 60 percent of the possible 
points for each of the four indicators.

* Standard performers must have an overall score of 60 to 90 points and 
scores of at least 60 percent of the points for each of the physical, 
financial, and management indicators.

* Troubled agencies have scores of less than 60 points overall or less 
than 60 percent of the points for more than one of the three 
indicators.

PHAS data for fiscal year 2002 showed that small and medium agencies 
slightly outperformed large agencies in managing their low-rent units-
-that is, larger percentages of small and medium agencies were high 
performers under the PHAS scoring system (fig. 11).

Figure 11: Overall PHAS Scores, by Agency Size (Fiscal Year 2002):

[See PDF for image]

[End of figure]

To identify potential differences based on size, we examined the scores 
for the individual indicators. We found that the better performance of 
small and medium agencies was largely attributable to slightly higher 
scores for the physical condition of their units. For example, 62 
percent of small and 56 percent of medium agencies were rated as high 
performers on the physical condition indicator, compared with 45 
percent of large agencies. According to HUD officials, small and medium 
agencies tend to score slightly higher on this indicator for two 
reasons. First, small agencies have fewer properties with features such 
as elevators and complicated heating and cooling systems that are 
difficult to maintain. Second, small housing agencies can more often 
provide on-site property management and maintenance than large 
agencies. HUD data show only slight differences among agencies of 
different sizes in scores for management, financial soundness, or 
resident satisfaction.

Fiscal Year 2002 SEMAP Scores for Operating Housing Choice Voucher 
Units Were Lowest for Small Agencies:

SEMAP is intended to help HUD measure public housing agencies' ability 
to operate Housing Choice Voucher units effectively and in compliance 
with regulations. Like PHAS, SEMAP scores agencies as high, standard, 
or troubled performers. High performers must earn at least 90 percent 
of the 150 possible points, and standard performers must earn between 
60 and 89 percent of the points. Agencies with scores of less than 60 
percent of the possible points are considered troubled. Scores are 
based on 14 performance areas, plus a deconcentration "bonus" 
indicator. The 14 SEMAP indicators measure how well agencies with 
Housing Choice Voucher units are monitoring the processes, reporting 
the data, inspecting the units, determining the rents, and using 
allocated vouchers. The additional deconcentration bonus indicator can 
provide 5 of the total 150 possible points for agencies in metropolitan 
areas where at least half of all Housing Choice Voucher units are in 
low poverty areas.

As figure 12 shows, small housing agencies did not score as well, on 
average, as larger ones. Compared with their larger counterparts, a 
higher proportion of small agencies were considered troubled, and fewer 
were high performers.

Figure 12: Overall SEMAP Scores, by Agency Size (Fiscal Year 2002):

[See PDF for image]

[End of figure]

According to HUD officials, small agencies tend to receive lower SEMAP 
scores in part because these agencies lack economies of scale and may 
have difficulty coping with the increasingly complex program rules and 
data systems related to the Housing Choice Voucher program. However, 
HUD officials also told us that small agencies' scores may be lower 
because HUD calculates scores for small and larger agencies 
differently. Small housing agencies receiving less than $300,000 in 
federal funds are not rated on 7 of the 14 indicators that together 
account for approximately 55 percent of the total SEMAP score. As a 
result, small agencies that receive low scores on one indicator on 
which they are scored may find that their scores are lowered 
precipitously, resulting in a troubled rating.

HUD officials have stated that the current method of SEMAP scoring 
makes small agencies more susceptible to a troubled rating. Using HUD's 
fiscal year 2002 SEMAP data, we estimated that 62 percent of small 
agencies were not rated on at least 1 of 7 indicators. Accordingly, we 
compared the scores for small, medium, and large agencies for the 7 
indicators that all agencies were scored for. We found that small 
agencies did not perform as well as medium and large agencies on these 
indicators (table 2).

Table 2: Average SEMAP Scores for Seven Indicators for Which All 
Agencies Are Scored, by Agency Size (Fiscal Year 2002):

Indicator: Payment standards; Possible points[A]: 5; Average score: 
Small: 3.6; Average score: Medium: 4.1; Average score: Large: 4.4.

Indicator: Annual reexaminations; Possible points[A]: 10; Average 
score: Small: 4.7; Average score: Medium: 5.8; Average score: Large: 
5.7.

Indicator: Correct tenant rents; Possible points[A]: 5; Average score: 
Small: 2.1; Average score: Medium: 2.7; Average score: Large: 2.5.

Indicator: Precontract HQS inspections[B]; Possible points[A]: 5; 
Average score: Small: 1.9; Average score: Medium: 2.5; Average score: 
Large: 2.7.

Indicator: Annual HQS inspections[C]; Possible points[A]: 10; Average 
score: Small: 0; Average score: Medium: 0; Average score: Large: 0.

Indicator: Lease-up; Possible points[A]: 20; Average score: Small: 5.8; 
Average score: Medium: 6.6; Average score: Large: 8.6.

Indicator: Family self-sufficiency; Possible points[A]: 10; Average 
score: Small: 1.1; Average score: Medium: 3.0; Average score: Large: 
3.8.

Indicator: Total; Possible points[A]: 65; Average score: Small: 19.2; 
Average score: Medium: 24.8; Average score: Large: 27.7.

Source: GAO analysis of HUD's data.

[A] In some cases, not all indicators may apply to agencies. For 
example, not all public housing agencies participate in the Family Self 
Sufficiency program and thus may not be scored on that particular 
indicator.

[B] HUD stopped scoring this indicator as of March 31, 2002.

[C] Presently, HUD is not scoring this indicator.

[End of table]

Of these 7 indicators, the most heavily weighted is the lease-up 
indicator, which measures how well each agency does in meeting HUD's 
goal of using 95 percent of all allocated vouchers. For small public 
housing agencies receiving less than $300,000 in federal funds, the 
lease-up indicator constitutes 20 out of the possible 65 points, or 
about 30 percent of the score. According to housing industry groups, 
most public housing agencies face barriers to making full use of 
Housing Choice Vouchers and thus to maintaining a 95-percent leasing 
rate. According to industry groups, these barriers may be financial 
(for example, cost of transportation, credit checks, and security 
deposits) or may involve a lack of experience in the private rental 
market. According to HUD officials, small housing agencies face 
additional burdens in attempting to achieve a 95-percent leasing rate 
because of the complexities of the program's rules and regulations for 
monitoring, reporting, inspecting, and leasing units in the private 
rental market.

Fiscal Year 2002 PIC Risk Assessment Scores Show That Small Agencies 
Were the Most Likely to Receive Low-Risk Ratings:

HUD developed the PIC risk assessment system during the mid-1990s to 
measure housing agencies' operating risk. PIC scores are based on three 
factors: performance (PHAS or SEMAP scores), funding, and compliance 
issues. Agencies' scores on each of these factors determine their risk 
levels. Of 100 possible points, agencies must have fewer than 44 points 
to be considered low risk, while those with 45 to 64 points are 
considered moderate risk and those with 65 to 100 points are considered 
high risk. The performance factor is based on the overall PHAS or SEMAP 
score, whichever is lower. The funding factor measures total authorized 
and disbursed funds and the percentage of disbursed funds already 
expended. The compliance factor measures open findings and audits from 
independent public accountants and HUD's Inspector General. As shown by 
figure 13, a greater percentage of small agencies were considered to be 
low risk, compared to medium and large agencies.

Figure 13: Overall PIC Risk Assessment Scores, by Agency Size (Fiscal 
Year 2002):

[See PDF for image]

[End of figure]

According to HUD officials, more small agencies are rated as low risk 
because they operate less complex programs, have a less complicated 
financial structure, and account for a smaller percentage of HUD 
funding.

HUD's Technical Assistance Is Based on Agency Needs, Which Sometimes 
Vary by Agency Size:

According to HUD officials, public housing agencies receive technical 
assistance based on HUD's determination of their needs and agencies' 
requests for specific types of assistance. HUD has two ways of 
determining the technical assistance needs of housing agencies: its 
risk assessment and performance measurement systems--PIC, SEMAP, and 
PHAS--and direct requests from agencies for specific types of 
assistance. Several HUD officials told us that small housing agencies 
frequently need different kinds of assistance than larger agencies. For 
example, they stated that small agencies typically need more assistance 
with day-to-day management issues than large agencies because small 
agencies tend to have few staff that specialize in finance, management 
information systems, and other areas that are important to managing 
HUD's programs. Currently, HUD does not maintain centralized, detailed 
information on the types of assistance housing agencies require or the 
kinds of assistance they request. However, a HUD official told us that 
the agency is developing a system that will allow it to collect such 
information in the future.

HUD Uses Its Risk Assessment and Performance Measurement Systems to 
Determine Agencies' Technical Assistance Needs:

HUD uses PIC, SEMAP, and PHAS scores to target technical assistance to 
the agencies that, according to these systems, need it most. PIC scores 
allow HUD to identify housing agencies that are having serious 
performance, funding, and compliance problems and to devise monitoring 
and technical assistance strategies to address such problems. For 
agencies designated as high-risk based on their PIC scores, HUD 
generally provides on-site monitoring to gain further information on 
their technical assistance needs. Agencies that are at moderate risk 
receive remote assistance mostly by telephone and e-mail. Agencies 
designated as low risk receive routine assistance.

HUD field offices supplement their PIC analyses by assessing agencies 
on 15 "qualitative" factors--to help identify specific situations, 
events, and conditions that are not reflected in the quantitative 
factor score. These additional pieces of information help indicate 
problems as they emerge or instances of deteriorating performance. 
Field office staff use their "professional judgment" in applying the 
quality factors. For example, in assessing agencies on the "local crime 
rate" (one of the factors), field office staff may examine information 
from the local police and compare local crime rates with those of 
similar communities. If the crime rate where the agency is located is 
higher than the rates in similar communities, the agency may be rated 
as having a risk factor associated with crime. According to our 
analysis of fiscal year 2002 HUD data on the quality factors, a larger 
percentage of small agencies than medium and large agencies exhibited 
risk factors in several areas: staff turnover and training, timeliness 
(for example, in submitting HUD reports) and board and management 
issues (such as inadequate training for board members). A higher 
percentage of large agencies than small or medium agencies exhibited 
risk factors associated with operating major new programs, problems 
identified in audits, unfavorable media reports, and litigation issues 
(such as disputes with contractors).

SEMAP scores for fiscal year 2002 were lowest for small agencies and, 
since SEMAP measures performance managing Housing Choice Voucher units, 
suggest that these agencies may need more technical assistance than 
others in this area. As previously discussed, 14.4 percent of small 
agencies were considered to be troubled under SEMAP, compared with 2.4 
percent of medium and 3.8 percent of large agencies. Under SEMAP, 
troubled agencies must develop corrective action plans that address 
deficiencies identified by the assessment. HUD field offices review 
these plans to determine the type of technical assistance that is 
needed to correct the deficiency.

We also found that troubled small and medium agencies did not perform 
as well as troubled large agencies on one of SEMAP's most important 
indicators--the "lease-up" indicator, which reflects agencies' 
performance in leasing available units. Of a maximum of 20 points, 
small and medium troubled agencies had an average score of 2.8 points, 
compared with 4.1 points for troubled large agencies. Most agencies 
that receive a low score on this indicator are likely to need technical 
assistance to develop a program to improve their leasing rate. 
According to a HUD official, although most agencies have difficulty 
leasing Housing Choice Voucher units, small agencies generally have 
greater difficulty than their larger counterparts because they have 
less experience managing such units.

Finally, HUD uses PHAS scores to decide how to target assistance to 
agencies that show weaknesses in administering their low-rent units. 
Agencies designated as troubled under PHAS are referred to one of HUD's 
two Troubled Agency Recovery Centers (TARC) for follow-up. As 
previously indicated, while our analysis of PHAS data showed that small 
agencies were somewhat more likely than larger agencies to be 
considered high performers, it did not show significant differences 
between the percentages of small, medium, and large agencies that were 
designated as troubled. Further, small troubled agencies did not 
perform as well as troubled medium or large agencies on one of PHAS' 
four major indicators--management assessment. Specifically, out of a 
maximum 30 points, small troubled agencies had an average score of 14.8 
compared to 21.4 for medium and 21.7 for large troubled agencies. 
According to HUD officials, these scores suggest troubled small 
agencies may need more assistance than larger agencies with managerial 
tasks such as completing work orders and releasing vacant units.

HUD Also Responds to Requests from Individual Housing Agencies for 
Specific Types of Technical Assistance:

HUD field offices regularly receive telephone, e-mail, or other written 
requests from housing agencies asking for help in a variety of areas, 
such as accessing and submitting data through HUD's computer systems, 
completing various HUD forms, and understanding HUD regulations. HUD 
officials told us that the department also receives a large number of 
calls from housing agencies, contractors, property owners, and others 
requesting assistance regarding PIC and PHAS. Most of these calls are 
made to HUD headquarters, which operates (1) a PIC help desk, which 
receives calls from housing agencies and others requesting assistance 
on matters such as how to log into the PIC system and how to interpret 
PIC requirements, and (2) the REAC technical assistance center, which 
serves as the primary point of contact for PHAS and other matters. 
According to a HUD official, the PIC help desk received 6,932 calls 
between August 2002 and August 2003, and REAC's technical assistance 
center receives between 9,000 and 10,000 calls monthly.

HUD currently does not maintain detailed, centralized information on 
the types of assistance that it has determined housing agencies require 
or that agencies who contact HUD field offices or headquarters request. 
Accordingly, neither we nor HUD were able to determine this information 
on a national basis or by size. However, according to a HUD official, 
HUD is in the process of developing a tracking system that will allow 
it to collect such information in the near future.

According to HUD field office directors we contacted, small agencies 
need more assistance with routine, day-to-day management of HUD housing 
programs than medium and large agencies.[Footnote 19] The officials 
added that small agencies need this assistance largely because they 
lack staff with specialized knowledge of finance, accounting, and other 
disciplines that are important to managing HUD's housing 
programs.[Footnote 20] These officials noted the following:

* Small agencies are more likely than their larger counterparts to need 
assistance with things such as occupancy regulations, lease 
enforcement, rent calculations, and HUD's reporting requirements. Most 
of the calls that field offices receive from housing agencies 
requesting this type of assistance come from small agencies. Larger 
agencies typically do not need such assistance because they generally 
have in-house accountants, financial management specialists, 
information systems specialists, and others with detailed knowledge of 
HUD's programs and policies. Larger agencies often operate more complex 
programs than smaller ones and tend to need assistance with more 
complicated matters, such as leveraging private funds, developing 
partnerships with nonprofits, converting public housing units into 
Housing Choice Voucher units, and using low-income housing tax credits.

* Because small agencies have fewer staff, they rely more heavily than 
larger agencies on contractors to carry out key functions in the 
administration of HUD's programs, such as accounting, finance, and 
procurement. In comparison, larger agencies are likely to have in-house 
staff who specialize in these areas. Public housing agencies require a 
highly specialized type of accounting services that are difficult to 
obtain, so small agencies and their contractors frequently contact HUD 
for technical assistance. Ultimately, small agencies' reliance on 
contractors to carry out functions such as accounting, finance, and the 
preparation of planning documents limits the agencies' own 
understanding of key aspects of their operations and further 
contributes to requests for technical assistance from HUD.

* Small agencies are more likely than larger ones to have problems 
related to using HUD's data systems. Unlike large agencies, most small 
agencies do not have in-house information systems experts and are more 
likely to hire consultants to assist them with HUD's information 
systems. One field office director we spoke with stated that many small 
agencies also need assistance with HUD's information systems because 
either HUD's systems are not compatible with the agencies' systems or 
the agencies do not have staff with the skills needed to operate HUD's 
systems.

We conducted our work between July 2002 and October 2003. Our work was 
conducted in accordance with generally accepted government auditing 
standards.

Agency Comments:

We requested comments on a draft of this report from the Secretary of 
HUD or his designee. On October 22, the Acting Director of HUD's Office 
of Policy, Program, and Legislative Initiatives provided us with 
technical comments on our report, which we have incorporated as 
appropriate.

As agreed with your office, unless you publicly announce the contents 
of this report earlier, we plan no further distribution of this report 
until 30 days from the report date. At that time, we will provide 
copies of this report to the interested congressional committees and 
Members of Congress; the Secretary of Housing and Urban Development; 
the Director of the Office of Management and Budget; and other 
interested parties. In addition, the report will be available at no 
charge on GAO's Web site at [Hyperlink, http://www.gao.gov] http://
www.gao.gov.

If you have any questions regarding this report, please contact me or 
Charles E. Wilson, Jr., Assistant Director, at (202) 512-8678. Key 
contributors to this report are listed in appendix V.

Signed by:

Sincerely yours,

David G. Wood: 
Director, Financial Markets and Community Investment:

[End of section]

Appendixes:

Appendix I: Scope and Methodology:

The objectives of this study were to (1) compare how small and larger 
housing agencies view the impact of recent housing reforms on their 
ability to administer HUD programs, (2) compare small and larger 
agencies' performance, as measured by HUD, in administering the low-
rent housing and Housing Choice Voucher programs, and (3) describe the 
differences in the technical assistance that small and larger public 
housing agencies require.

For this report, we defined size as the number of low-rent units and 
housing voucher units combined as follows: very large, more than 6,599 
units; large, 1,250 units to 6,599 units; medium, 250 units to 1,249 
units; small, 100 units to 249 units; and very small, less than 100 
units. To determine differences based on size and present the results 
of our analyses, throughout the report we collapsed the five categories 
into three: small, medium, and large housing agencies. Small agencies 
include very small and small, and large include large and very large.

To compare how small and larger housing agencies view the impact of 
QHWRA reforms on their ability to manage their agencies, we used a mail 
questionnaire to survey a nationwide statistical sample of public 
housing agencies. Of the more than 80 QHWRA reforms, our survey focuses 
on 18 reforms public housing industry associations consider to have had 
the most impact on agency operations. Based on our sample, we produced 
national estimates of the impact of QHWRA reforms as perceived by 
agency directors. We analyzed respondents' most frequently occurring 
answers to our survey questions to identify similarities and 
differences between small, medium, and large agencies' perceptions 
about the impact of QHWRA reforms on their operations. Estimates based 
on our sample are subject to sampling error. All percentage estimates 
in this report have 95 percent confidence intervals of plus or minus 7 
percentage points or less, unless otherwise noted. See appendix II for 
a more detailed discussion of the development of this survey and the 
sampling frame. A copy of the survey can be found in appendix III.

To compare the assessed performance of small, medium, and large public 
housing agencies, we analyzed fiscal year 2002 PHAS data, fiscal year 
2002 SEMAP data, and fiscal year 2002 PIC data, which we obtained from 
HUD. We used HUD's criteria for designating housing agencies as 
troubled, standard, or high performers under PHAS and SEMAP, and low, 
medium or high risk under PIC. To understand how HUD applies its 
criteria for determining performance and risk levels, we reviewed HUD 
guidance and interviewed HUD officials.

HUD collects data for PHAS, SEMAP, and PIC once a year on a rolling 
quarterly basis. We requested and received the most current data 
available from these systems. We assessed the reliability of these data 
by (1) reviewing existing information about the systems and the data, 
(2) interviewing agency officials knowledgeable about the data, and (3) 
performing electronic testing of the data elements used in the report. 
We determined that the data were reliable enough for purposes of this 
report.

To determine differences in the technical assistance that HUD provides 
to small, medium, and large housing agencies, we interviewed HUD 
headquarters and field office officials within the Office of Public and 
Indian Housing. To obtain information on the technical assistance that 
field offices provide to housing agencies across the country, we 
randomly selected a limited sample of nine field office directors. We 
also analyzed fiscal year 2002 PHAS, SEMAP, and PIC data that HUD uses 
to target technical assistance to those in need.

[End of section]

Appendix II: Methodology for GAO's Survey of Local Housing Agencies on 
QHWRA Housing Reforms and Initiatives:

This study's primary objective was to compare how small and larger 
housing agencies view the impact of recent housing reforms on their 
ability to administer HUD programs. To address this objective, we 
surveyed a stratified random sample of public housing agency directors 
based on size. We developed and administered a survey designed to 
obtain the directors' views on issues associated with QHWRA's effects 
on agency operations, staffing and resources, and management. We 
received 1,119 completed, usable surveys.

The Study Population:

We used end of fiscal year 2002 data from HUD's Office of Public and 
Indian Housing databases to identify the number of agencies 
nationwide[Footnote 21]. Since our primary interest was to compare 
responses based on size, we also requested and received the various 
definitions HUD uses to classify housing agencies by size. We assessed 
the quality of HUD's electronic data by testing for internal 
consistency; validating the data using other sources; and, to the 
extent possible, reviewing the associated documentation. Based on these 
tests, we determined that the data were sufficiently accurate for our 
purposes.

The Sample Design:

We used a single-stage stratified random sample of the directors of 
local housing agencies nationwide. For the original stratification, we 
used HUD's criterion, which is the number of low-rent housing units. We 
separated agencies into five strata: 100 low-rent units or less, 101 to 
249 low-rent units, 250 to 1,250 low-rent units, 1,251 to 6,599 low-
rent rent units, and 6,600 or more low-rent units. We were also able to 
identify a sixth stratum of agencies with an unknown number of low-rent 
units or with voucher units only. Our total sample included 1,611 
agency directors. Of the 1,611 that were in our sample, we received a 
total of 1,119 valid and usable surveys, for an overall response rate 
of 69 percent.

Table 3: Survey Sample Size and Disposition:

Stratum: 100 low-rent units or less; Population size: 1,587; Sample 
size: 413; Respondents: 262; Response rate: 63%.

Stratum: 101 to 249 low-rent units; Population size: 768; Sample size: 
343; Respondents: 253; Response rate: 74%.

Stratum: 250 to 1,250 low-rent units; Population size: 673; Sample 
size: 326; Respondents: 257; Response rate: 79%.

Stratum: 1,251 to 6,599 low-rent units; Population size: 114; Sample 
size: 114; Respondents: 91; Response rate: 80%.

Stratum: 6,600 or more low-rent units; Population size: 44; Sample 
size: 44; Respondents: 32; Response rate: 73%.

Stratum: Other and Voucher Units; Population size: 1,028; Sample size: 
371; Respondents: 224; Response rate: 60%.

Stratum: Total; Population size: 4,214; Sample size: 1,611; 
Respondents: 1,119; Response rate: 69%.

Source: GAO analysis of HUD data.

[End of table]

Developing the Survey:

To identify specific reform issues that were areas of concern, we met 
with officials from the public housing industry and held group 
discussions with 19 directors from small, medium, and large public 
housing agencies throughout the country. We met with directors of 
housing agencies at conferences of the Public Housing Authorities 
Directors Association (PHADA) and the National Association of Housing 
and Redevelopment Officials (NAHRO). During these discussion sessions, 
we explored (1) the challenges directors face, (2) what is being done 
to meet the challenges, and (3) how PHAS and QHWRA have impacted their 
agencies. We used a nominal group technique to prioritize the most 
important challenges directors of small housing agencies face.

We developed our survey, in part based on our meetings with directors 
and officials of the public housing agencies. Specifically, the survey 
asked about 18 reform issues that were identified as concerns in these 
group discussions. About half of the 18 concerns dealt with admissions 
and occupancy issues, such as tenant selection and income limits. The 
other half included reporting requirements and resident-related issues, 
such as having a resident member on the board of directors. We asked 
whether these QHWRA reforms had helped or hindered directors' ability 
to operate and manage their agencies. We also asked about staffing, 
management, and finances.

To verify the clarity, length of time of administration, and 
suitability of the questions, we pretested the questionnaire with the 
directors of local housing agencies. We also sought feedback from NAHRO 
and PHADA staff. A copy of the Survey of Local Housing Agencies on 
Housing Reforms and Initiatives can be found in appendix III.

Administering the Survey:

We conducted the survey between January 2003 and July 2003, using a 
self-administered mail-out form. We sent a second questionnaire on 
March 28, 2003, to all those who did not respond to our first survey in 
order to encourage a higher response rate. We ended data collection on 
July 8, 2003.

We received 1,119 completed, usable surveys, for an overall response 
rate of 69 percent. Two surveys were eliminated because they were 
returned blank or indicated that they do not currently administer low-
rent housing or Housing Choice Voucher programs. We used a contractor 
to create a database of survey responses. All data were double keyed 
during the data entry process, and GAO staff verified a sample of the 
resulting data to ensure accuracy.

Nonsampling Error and Data Quality:

The practical difficulties of conducting any survey can result in 
nonsampling errors. For example, measurement errors can be introduced 
if difficulties exist in interpreting a particular question or in the 
sources of information available to respondents in answering a 
question, keying in completed questionnaires, or preparing data files 
for analysis. We took extensive steps to minimize such errors in 
developing the questionnaire, collecting the data, and editing and 
analyzing the information.

To reduce measurement error, we conducted in-depth pretesting of the 
questionnaire with public housing agency directors, as well as with 
industry officials, to make sure questions and response categories were 
interpreted in a consistent manner. GAO edited all surveys for 
consistency before they were sent for keypunching. All questionnaire 
responses were double key-entered into our database (that is, the 
entries were 100 percent verified), and a random sample of the 
questionnaires was further verified for completeness and accuracy. In 
addition to the steps taken during the development of the survey and 
its administration, we performed computer analyses to identify 
inconsistencies and other indicators of errors. When edit checks 
revealed inconsistent responses or individual question elements did not 
add correctly to the total provided, we established parameters for 
either calling the respondent for clarification or treating the data as 
missing. In addition, all computer syntax was peer reviewed and 
verified by separate programmers to ensure that it was written and 
executed correctly.

Response Rates:

To maximize response rates, we sent one follow-up mailing with copies 
of the survey on March 28, 2003, and one or two e-mail reminders to 
nonrespondents with known e-mail addresses. Overall, 69 percent of the 
sampled agencies responded to our survey, with minimal response 
differentials by size (see table 3 for response rates).

Estimates:

Estimates produced in this report are for a target population defined 
as directors of public housing agencies in our study population. Since 
one of our primary objectives involved comparing small and larger 
agencies, we computed estimates for our three groups of agencies--
small, medium, and large. For the report itself, we collapsed the six 
strata into three, combining small and very small into the small group 
and large and very large into the large group. We then had three groups 
for analysis: (1) small agencies that administered fewer than 250 low-
rent and housing choice voucher units, (2) medium agencies that 
administered between 250 and 1,250 units, and (3) large agencies that 
administered more than 1,250 units. For presentation and statistical 
testing, we also collapsed responses. For example, in question 16, 
which asked about specific reforms, we combined the "greatly helped" 
category into the "helped" category and "greatly hindered" into 
"hindered" in order to derive single response categories. In question 
21, we combined "moderate extent" with "some extent" and "very great 
extent" with "great extent." Also, because of the number of agencies 
answering "not applicable," "no basis to judge," or in some cases 
nothing at all, we chose to use this information in our analysis.

Estimates were formed by weighting the survey responses to account for 
effective sampling rates in each stratum. These weights reflect both 
the initial sampling rate and the response rate for each stratum. As 
with most surveys, our estimation method assumes that nonrespondents 
would have answered like the survey respondents.

We analyzed the response data on selected questions based on the most 
frequently occurring responses in order to identify similarities and 
differences in the responses across categories.

Sampling Error:

The results of random samples like ours are subject to sampling errors 
that reflect the differences between the results obtained from the 
samples and the results that would have been obtained from a survey of 
the entire population under consideration. Because we surveyed a sample 
of directors of public housing agencies, our results are estimates of 
the characteristics of public housing agencies and thus are subject to 
the sampling errors associated with samples of this size and type.

Measurements of sampling errors are stated at a certain level of 
statistical confidence. GAO used the weighted results to make estimates 
about the entire population of local housing agencies. Our confidence 
in the precision of the results from this sample is expressed in 95 
percent confidence intervals. The 95 percent confidence intervals are 
expected to include the actual results for 95 percent of the samples of 
this type. We calculated confidence intervals for our study results 
using methods that are appropriate for a stratified probability sample. 
For the percentages presented in this report, we are 95 percent 
confident that the results we would have obtained had we studied the 
entire study population would have been within +7 or fewer percentage 
points of our results, unless otherwise noted. For example, our survey 
estimates that 63 percent of the small agency directors believed they 
and their staff were spending "more or much more time" on HUD-
subsidized programs after the QHWRA reforms (question 20). The 95 
percent confidence interval for this estimate would be no wider than +7 
percent, or from 56 percent to 70 percent. For estimates other than 
percentages, 95 percent confidence intervals are presented with the 
estimate or otherwise noted. (A modified copy of the questionnaire, 
showing aggregate response percentages by size, is included as appendix 
III.):

[End of section]

Appendix III Survey Results of Housing Agencies:

[See PDF for image]

[End of figure] 

[End of section]

Appendix IV: Summary of 18 Reforms Contained in GAO's Survey of Public 
Housing Agencies:

[See PDF for image]

Source: HUD Directives and QHWRA Notices.

[End of table]

[End of section]

Appendix V: GAO Contacts and Staff Acknowledgments:

GAO Contacts:

David G. Wood (202) 512-8678 Charles E. Wilson, Jr. (202) 512-6891:

Staff Acknowledgments:

In addition to the individuals named above, the following individuals 
made significant contributions to this report: Johnnie Barnes, Mark 
Braza, Emily R. Chalmers, Rudy Chatlos, Mark Egger, Gloria Hernandez-
Saunders, Jamila L. Jones, Beth Koviach, John McGrail, Marc Molino, 
Jobenia Odum, Roberto Piñero, Mark Ramage, Terry Richardson, and 
Caroline Villanueva.

(541022):

FOOTNOTES

[1] Also known as the Public Housing Reform Act.

[2] Throughout this report, we refer to the Low-Rent Public Housing 
Assistance program as the low-rent program. Under the low-rent program, 
local housing agencies own and manage buildings with rental units for 
low-income families. Under the Housing Choice Voucher program, local 
housing authorities make subsidy payments on behalf of assisted 
households living in privately owned rental units. 

[3] Estimates based on our sample are subject to sampling error. Except 
where noted, all percentage estimates have 95 percent confidence 
intervals within +/-7 percentage points. See appendix II for more 
information. 

[4] Some of QHWRA's provisions went into effect when the act was 
enacted on October 21, 1998, while other provisions took effect later. 

[5] 24 CFR, Parts 902, 903, and 985, Final Rule: Deregulation for Small 
Housing Authorities, June 24, 2003.

[6] Throughout this report, we use the term technical assistance to 
encompass both technical assistance and capacity building.

[7] Under the Hope VI program, HUD provides assistance to help housing 
agencies replace and revitalize severely distressed public housing with 
physical, management, and social and community service improvements. 
Under the Capital Fund, HUD provides grants to housing agencies for 
capital improvement and management activities, including modernization 
and development of low-rent housing. 

[8] These surveys are administered by the housing agencies.

[9] During our review, a HUD official told us that effective October 1, 
2003, HUD plans to eliminate the Memphis TARC and rename the Cleveland 
TARC the Recovery and Prevention Corps. The Corps will serve functions 
similar to those of the current TARCs.

[10] U.S. Department of Housing and Urban Development, The Uses of 
Discretionary Authority in the Public Housing Program, July 1999.

[11] U.S. Department of Housing and Urban Development, The Uses of 
Discretionary Authority in the Tenant Based Section 8 Program, November 
2000.

[12] For purposes of presenting results from the survey, we say 
responses are "similar" for a reform if the largest proportion of 
estimates from all three agency size categories was for the same 
response. This definition is for organizing the descriptive results of 
the survey for presentation purposes. We conducted tests to determine 
the statistical significance of responses by agency size. 

[13] U.S. General Accounting Office, Public Housing Subsidies: 
Revisions to HUD's Performance Funding System Could Improve Adequacy of 
Funding, GAO/RCED-98-174 (Washington, D.C.: June 1998).

[14] U.S. General Accounting Office, Public Housing: HUD and Public 
Housing Agency Experiences with Fiscal Year 2000 Plan Requirements, 
GAO-02-572 (Washington, D.C.: May 2002).

[15] Housing agencies are required to submit information to HUD through 
automated systems such as the Public Housing Assessment System, the 
Tenant Rental Assistance Certification System, and the Multifamily 
Tenant Characteristics Tracking System.

[16] See U.S. General Accounting Office, Major Management Challenges 
and Program Risks: Department of Housing and Urban Development, GAO-03-
103 (Washington, D.C.: January 2003).

[17] GAO-02-572, May 2002.

[18] GAO-02-572, May 2002.

[19] We interviewed a total of nine HUD field office directors located 
in Jacksonville, Florida; Chicago, Illinois; Boston, Massachusetts; 
Miami, Florida; Richmond, Virginia; Atlanta, Georgia; New Orleans, 
Louisiana; Little Rock, Arkansas; and Newark, New Jersey. 

[20] Our nationwide survey of public housing agency directors found 
that 48 percent of small housing agencies had full-time staff working 
in financial management, compared to 90 percent for medium agencies and 
99 percent for large agencies; 56 percent of small housing agencies had 
full-time staff working in property management compared to 86 percent 
for medium and 96 percent for large agencies; and 13 percent of small 
agencies had full-time staff working in information technology compared 
to 31 percent for medium and 89 percent for large agencies. (For 
additional information, see appendix III).

[21] We made a minor adjustment to this database by removing two 
records that were no longer PHAs at the time of the survey. This 
resulted in 4,214 agencies in our target population.

GAO's Mission:

The General Accounting Office, the investigative arm of Congress, 
exists to support Congress in meeting its constitutional 
responsibilities and to help improve the performance and accountability 
of the federal government for the American people. GAO examines the use 
of public funds; evaluates federal programs and policies; and provides 
analyses, recommendations, and other assistance to help Congress make 
informed oversight, policy, and funding decisions. GAO's commitment to 
good government is reflected in its core values of accountability, 
integrity, and reliability.

Obtaining Copies of GAO Reports and Testimony:

The fastest and easiest way to obtain copies of GAO documents at no 
cost is through the Internet. GAO's Web site ( www.gao.gov ) contains 
abstracts and full-text files of current reports and testimony and an 
expanding archive of older products. The Web site features a search 
engine to help you locate documents using key words and phrases. You 
can print these documents in their entirety, including charts and other 
graphics.

Each day, GAO issues a list of newly released reports, testimony, and 
correspondence. GAO posts this list, known as "Today's Reports," on its 
Web site daily. The list contains links to the full-text document 
files. To have GAO e-mail this list to you every afternoon, go to 
www.gao.gov and select "Subscribe to e-mail alerts" under the "Order 
GAO Products" heading.

Order by Mail or Phone:

The first copy of each printed report is free. Additional copies are $2 
each. A check or money order should be made out to the Superintendent 
of Documents. GAO also accepts VISA and Mastercard. Orders for 100 or 
more copies mailed to a single address are discounted 25 percent. 
Orders should be sent to:

U.S. General Accounting Office

441 G Street NW,

Room LM Washington,

D.C. 20548:

To order by Phone: 	

	Voice: (202) 512-6000:

	TDD: (202) 512-2537:

	Fax: (202) 512-6061:

To Report Fraud, Waste, and Abuse in Federal Programs:

Contact:

Web site: www.gao.gov/fraudnet/fraudnet.htm E-mail: fraudnet@gao.gov

Automated answering system: (800) 424-5454 or (202) 512-7470:

Public Affairs:

Jeff Nelligan, managing director, NelliganJ@gao.gov (202) 512-4800 U.S.

General Accounting Office, 441 G Street NW, Room 7149 Washington, D.C.

20548: