Public Transportation: FTA's Triennial Review Program Has Improved, But Assessments of Grantees' Performance Could Be Enhanced

GAO-09-603 June 30, 2009
Highlights Page (PDF)   Full Report (PDF, 44 pages)   Accessible Text   Recommendations (HTML)

Summary

The Federal Transit Administration (FTA) oversees about $5.5 billion in federal funds each year to transit agencies serving urban areas (grantee), in part through its triennial review program, which evaluates grantee adherence to federal requirements at least once every 3 years. GAO recommended in a 1998 oversight report that FTA improve the program. The subcommittee requested that GAO review this program. GAO identified (1) the extent to which triennial reviews indicate that grantees met applicable federal requirements from fiscal years 2000 through 2008; (2) the strengths and weaknesses of the triennial review process; and (3) FTA's performance measures for the triennial review and the extent to which they meet key attributes of successful performance measures. GAO addressed these objectives by analyzing oversight data on 424 grantees that had three triennial reviews, reviewing triennial review reports and guidance, assessing FTA's performance measures; and interviewing FTA headquarters and regional officials, contractors who conduct the reviews, and grantees.

GAO's analysis of FTA's triennial review oversight data found that over two-thirds of the 424 grantees analyzed have not consistently improved overall performance in terms of meeting more federal requirements from fiscal years 2000 through 2008. Fifty-one percent of grantees had mixed results in meeting requirements and 17 percent consistently met fewer requirements; while 31 percent consistently met more requirements--one of the goals of the triennial review program. Executives from three grantees that met most requirements attributed their performance to, among other things, having job descriptions that link employee responsibilities to the triennial review--a practice they said contributed to a culture of accountability. During the same time, grantees had the greatest number of findings in 5 of 23 triennial review areas, including the procurement and drug and alcohol testing areas. While FTA helps grantees address findings, additional efforts to identify the underlying causes and the severity of findings could further benefit grantees. FTA's triennial review program uses some strong management practices--having a well-defined process, using an information system to monitor grantees, and issuing reports timely. Still, two areas could be strengthened. First, while FTA is legislatively required to conduct a complete review of grantees' adherence to federal requirements at least once every 3 years, GAO identified a few instances where documentation does not clearly show that FTA reviewed all requirement areas. For example, 10 triennial review reports for 2008 showed that the drug and alcohol program area was "not reviewed." FTA's practice is to review all areas, regardless of documentation, but because FTA's guidance is not clear about how to document the review of areas where FTA has conducted a related special review in the prior two years, a few grantees may not be reviewed for 5 years. FTA plans to revise its guidance to avoid ambiguity. Second, FTA is aware of the burden oversight reviews place on grantees and works to limit this burden. However, in a limited number of cases, FTA did not coordinate its special oversight reviews with the triennial review schedule, which may place undue burden on a few grantees receiving multiple oversight reviews in the same fiscal year. FTA's two timeliness performance measures for assessing the triennial review program--(1) closing 80 percent of grantees' deficient findings within 30 days of their due date and (2) issuing 95 percent of the final triennial review reports within 30 days of completing a review--meet some, but not all key attributes of successful measures. Although both measures link throughout the organization, have measurable targets, are clearly stated, and do not overlap, the "close findings" measure does not meet the objectivity and reliability attribute. For example, data inaccuracies in past "close findings" data raised questions about the reliability of the measure. Also, both measures do not assess the core program activity to evaluate grantees' performance or governmentwide priorities, such as the quality of the triennial review program, and thus, as a whole, are not balanced, making it difficult for managers to not overemphasize one priority at the expense of others.



Recommendations

Our recommendations from this work are listed below with a Contact for more information. Status will change from "In process" to "Open," "Closed - implemented," or "Closed - not implemented" based on our follow up work.

Director:
Team:
Phone:
Phillip R. Herr
Government Accountability Office: Physical Infrastructure
(202) 512-8509


Recommendations for Executive Action


Recommendation: To support the triennial review program's goal of having grantees consistently meet more federal requirements, the Secretary of Transportation should direct the FTA Administrator to further analyze and use Oversight Tracking System (OTRAK) data on the triennial review to help grantees improve and sustain their performance. As part of this analysis, FTA should consider and identify, when necessary: (1) high performing grantees and their management practices, among other things; (2) the areas in which problem findings occur, and the underlying causes of these findings; and (3) the level of severity for each finding.

Agency Affected: Department of Transportation

Status: In process

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: To support the triennial review program's goal of having grantees consistently meet more federal requirements, the Secretary of Transportation should direct the FTA Administrator to help ensure that a complete performance review and evaluation of each grantee is conducted at least once every three years, in accordance with the statutory requirement, revise the contractors' guide to remove the "not reviewed" category, require an updated evaluation of areas reviewed in the prior two years of the triennial review, and describe how contractors should document the triennial review reports with updates to other reviews, such as special oversight reviews conducted in the prior two years.

Agency Affected: Department of Transportation

Status: In process

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: To support the triennial review program's goal of having grantees consistently meet more federal requirements, the Secretary of Transportation should direct the FTA Administrator to strengthen the triennial review process by ensuring that the Oversight Review Council, or another body, carries out the responsibilities specified in FTA Order 5400.1 to be actively involved in coordinating oversight review schedules in order to increase FTA's oversight coverage of grantees while, at the same time, minimizing the undue burden of multiple oversight reviews on grantees.

Agency Affected: Department of Transportation

Status: In process

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: To support the triennial review program's goal of having grantees consistently meet more federal requirements, the Secretary of Transportation should direct the FTA Administrator to improve the objectivity and reliability of the "Close Findings Timely" performance measure by: (1) developing an internal controls process to verify grantees have satisfactorily resolved findings before closing them (2) continuing to emphasize the use of OTRAK across all regions and developing a process to close out triennial reviews in OTRAK upon grantees' completion of corrective actions.

Agency Affected: Department of Transportation

Status: In process

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: To support the triennial review program's goal of having grantees consistently meet more federal requirements, the Secretary of Transportation should direct the FTA Administrator to meet standards set forth in previous GAO work, based on the Government Performance and Results Act of 1993, and develop performance measures to assess: (1) the outcomes of the triennial review program, such as a method for evaluating improvements in grantee performance in meeting more federal requirements over time (2) and the quality of the triennial review through improved contractor oversight, testing, or inspection.

Agency Affected: Department of Transportation

Status: In process

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: To support the triennial review program's goal of having grantees consistently meet more federal requirements, the Secretary of Transportation should direct the FTA to ensure that additional outcome and quality performance measures are balanced with the existing measures for assessing the timeliness of the triennial review program so that one priority is not emphasized at the expense of others.

Agency Affected: Department of Transportation

Status: In process

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.


Related Searches

Related terms: