<DOC>
[DOCID: f:45062.wais]


 
  GOVERNMENT PERFORMANCE AND RESULTS ACT: STATUS AND PROSPECTS OF THE 
                              RESULTS ACT
=======================================================================

                                HEARING

                               before the

                 SUBCOMMITTEE ON GOVERNMENT MANAGEMENT,
                      INFORMATION, AND TECHNOLOGY

                                 of the

                              COMMITTEE ON
                           GOVERNMENT REFORM
                             AND OVERSIGHT
                        HOUSE OF REPRESENTATIVES

                       ONE HUNDRED FIFTH CONGRESS

                             FIRST SESSION

                               __________

                              JUNE 3, 1997

                               __________

                           Serial No. 105-55

                               __________

Printed for the use of the Committee on Government Reform and Oversight






                       U. S. GOVERNMENT PRINTING OFFICE
45-062                          WASHINGTON : 1997
___________________________________________________________________________
For Sale by the Superintendent of Documents, U.S. Government Printing Office
Internet: bookstore.gpr.gov  Phone: toll free (866) 512-1800; (202) 512-1800  
Fax: (202) 512-2250 Mail: Stop SSOP, Washington, DC 20402-0001






              COMMITTEE ON GOVERNMENT REFORM AND OVERSIGHT

                     DAN BURTON, Indiana, Chairman
BENJAMIN A. GILMAN, New York         HENRY A. WAXMAN, California
J. DENNIS HASTERT, Illinois          TOM LANTOS, California
CONSTANCE A. MORELLA, Maryland       ROBERT E. WISE, Jr., West Virginia
CHRISTOPHER SHAYS, Connecticut       MAJOR R. OWENS, New York
STEVEN SCHIFF, New Mexico            EDOLPHUS TOWNS, New York
CHRISTOPHER COX, California          PAUL E. KANJORSKI, Pennsylvania
ILEANA ROS-LEHTINEN, Florida         GARY A. CONDIT, California
JOHN M. McHUGH, New York             CAROLYN B. MALONEY, New York
STEPHEN HORN, California             THOMAS M. BARRETT, Wisconsin
JOHN L. MICA, Florida                ELEANOR HOLMES NORTON, Washington, 
THOMAS M. DAVIS, Virginia                DC
DAVID M. McINTOSH, Indiana           CHAKA FATTAH, Pennsylvania
MARK E. SOUDER, Indiana              ELIJAH E. CUMMINGS, Maryland
JOE SCARBOROUGH, Florida             DENNIS J. KUCINICH, Ohio
JOHN B. SHADEGG, Arizona             ROD R. BLAGOJEVICH, Illinois
STEVEN C. LaTOURETTE, Ohio           DANNY K. DAVIS, Illinois
MARSHALL ``MARK'' SANFORD, South     JOHN F. TIERNEY, Massachusetts
    Carolina                         JIM TURNER, Texas
JOHN E. SUNUNU, New Hampshire        THOMAS H. ALLEN, Maine
PETE SESSIONS, Texas                 HAROLD E. FORD, Jr., Tennessee
MICHAEL PAPPAS, New Jersey                       ------
VINCE SNOWBARGER, Kansas             BERNARD SANDERS, Vermont 
BOB BARR, Georgia                        (Independent)
ROB PORTMAN, Ohio
                      Kevin Binger, Staff Director
                 Daniel R. Moll, Deputy Staff Director
                       Judith McCoy, Chief Clerk
                 Phil Schiliro, Minority Staff Director
                                 ------                                

   Subcommittee on Government Management, Information, and Technology

                   STEPHEN HORN, California, Chairman
PETE SESSIONS, Texas                 CAROLYN B. MALONEY, New York
THOMAS M. DAVIS, Virginia            PAUL E. KANJORSKI, Pennsylvania
JOE SCARBOROUGH, Florida             MAJOR R. OWENS, New York
MARSHALL ``MARK'' SANFORD, South     ROD R. BLAGOJEVICH, Illinois
    Carolina                         DANNY K. DAVIS, Illinois
JOHN E. SUNUNU, New Hampshire
ROB PORTMAN, Ohio

                               Ex Officio

DAN BURTON, Indiana                  HENRY A. WAXMAN, California
          J. Russell George, Staff Director and Chief Counsel
                         Mark Uncapher, Counsel
                          Andrea Miller, Clerk
           David McMillen, Minority Professional Staff Member
          Mark Stephenson, Minority Professional Staff Member






                            C O N T E N T S

                              ----------                              
                                                                   Page
Hearing held on June 3, 1997.....................................     1
Statement of:
    Koskinen, John, Deputy Director for Management, Office of 
      Management and Budget......................................     7
    Stevens, L. Nye, Director, Federal Management and Workforce 
      Issues, General Government Division, U.S. General 
      Accounting Office, accompanied by Chris Mihm, Acting 
      Associate Director for Federal Management Issues...........    20
Letters, statements, etc., submitted for the record by:
    Davis, Hon. Danny K., a Representative in Congress from the 
      State of Illinois, prepared statement of...................     4
    Koskinen, John, Deputy Director for Management, Office of 
      Management and Budget, prepared statement of...............    12
    Radanovich, Hon. George P., a Representative in Congress from 
      the State of California, prepared statement of.............     6
    Stevens, L. Nye, Director, Federal Management and Workforce 
      Issues, General Government Division, U.S. General 
      Accounting Office, prepared statement of...................    24


  GOVERNMENT PERFORMANCE AND RESULTS ACT: STATUS AND PROSPECTS OF THE 
                              RESULTS ACT

                              ----------                              


                         TUESDAY, JUNE 3, 1997

                  House of Representatives,
Subcommittee on Government Management, Information, 
                                    and Technology,
              Committee on Government Reform and Oversight,
                                                    Washington, DC.
    The subcommittee met, pursuant to notice, at 9:30 a.m., in 
room 2154, Rayburn House Office Building, Hon. Stephen Horn 
(chairman of the subcommittee) presiding.
    Present: Representatives Horn, Sessions, Davis of Virginia, 
and Davis of Illinois.
    Also present: Representative Radanovich.
    Staff present: Russell George, staff director/counsel; Jane 
Cobb, full committee professional staff member; Matt Ryan and 
John L. Hynes, professional staff members; Andrea Miller, 
clerk; and Mark Stephenson, minority professional staff member.
    Mr. Horn. A quorum being present, the Subcommittee on 
Government Management, Information, and Technology will come to 
order.
    This is a third in the series of oversight hearings on the 
Government Performance and Results Act of 1993, commonly known 
as the Results Act. Governments around the world are struggling 
to provide services more efficiently, effectively, and at a 
lower cost to their taxpayers.
    Over the past decade, Federal management reform efforts in 
the United States have stressed the need to measure results as 
viewed by the client, the American taxpayer. As we have learned 
in previous hearings, the Government Performance and Results 
Act has enormous potential to focus the energies of the Federal 
Government, making programs more efficient and effective and 
restoring confidence in Government. In essence, the act 
requires Federal agencies to ask and to repeatedly answer some 
very basic questions: What is the agency's mission? What are 
its goals? And how will the agency achieve them? How can the 
agency's performance be measured? How should that information 
be used to make improvements?
    The Results Act envisions a major overhaul of Federal 
activities and it therefore requires vigilant oversight. In 
order to establish one aspect of this oversight, the act 
directed the Office of Management and Budget and the General 
Accounting Office to assess and report on the ability of the 
agencies to implement Results Act requirements.
    The act specifies that the Office of Management and Budget, 
OMB, shall report on the benefits, cost and usefulness of the 
plans, and reports prepared by the pilot agencies. These pilots 
are essential to effective implementation of the act. From them 
we must experiment with and learn about three aspects of 
Federal management reform: performance goals, managerial 
accountability and flexibility, and performance budgeting.
    The law called for a minimum of 10 performance measurement 
pilot agencies. But instead of 10 or another relatively small 
manageable number, we have 72. This is troublesome. It looks 
very much as though the executive branch attention to this law 
is being spread too thin. The pilots were meant to provide 
concrete experiences with success and failure in the 
implementation of this act. I am afraid that in this case 
quantity has become the enemy of quality.
    OMB was also directed to identify significant difficulties 
experienced by pilot agencies in preparing plans and reports 
and to set forth any recommended changes to be made in the 
Results Act. OMB issued its report on May 19th. The General 
Accounting Office issued its comprehensive analysis of the 
pilot agencies yesterday.
    The Results Act provides a unique opportunity to view the 
Federal Government on a comprehensive basis. In this context, 
the executive branch should seek to identify and set the 
priorities for the services that must be provided, the 
activities that must be carried out, and the measurement of the 
results that are achieved.
    Congress considers the statutory requirements and timetable 
of the Results Act extremely important. The act was 
deliberately crafted to allow experimentation before mandating 
requirements. For example, the pilot stage allowed agencies to 
ask for relief from burdensome regulations in return for a 
promise of greater accountability. It is unclear if this stage 
has been implemented.
    Also of concern is the quality and reliability of the 
information provided to Congress in the performance reports. In 
order to succeed, performance reports must be based from 
information derived from accurate data and can be independently 
verified. The data must be comparable not only from year to 
year, but also between agencies performing similar functions. 
Such data must also be consistently accumulated and reported. 
If there are too many goals and objectives, the risk is that 
few of those goals and objectives will be obtained. If there 
are too many performance measures to be tracked, both the 
agencies and the congressional committees will sink under the 
weight of data and the Results Act will have failed.
    There is no shortage of failures in the dust bin of Federal 
management initiatives. From zero based budgeting to managing 
by objectives, these previous efforts have failed because there 
was little commitment to make them work. As chairman of this 
subcommit- tee, I am afraid we are heading down the same road 
with the Re- sults Act. I am surprised and disappointed by 
OMB's scattered re- port. No doubt it follows the letter of the 
law. It is less clear to me that what we are seeing so far 
follows the spirit of the law.
    It is worth recalling what we are about here. The 
leadership in Congress has made an extraordinary commitment to 
this effort. We are serious about changing the management 
culture of the Federal Government. The culture needs to be much 
more service oriented. The highest levels of the legislative 
and executive branches of the Federal Government need to work 
in partnership to identify and to solve the problems involved 
in implementing the Results Act. Only then will we be on the 
way to attaining the goals of the act and only then will the 
public believe the changes are finally taking place in the 
culture of the Federal Government.
    The Results Act presents a unique opportunity to change 
from a compliance-based system of accountability to a results-
based system. If it works well, we will be able to ensure that 
the Federal Government's stewardship over resources and its 
services to the American people are efficient and affordable. 
If we are to be successful, a sample of the customers of 
Federal programs, the taxpayers, will need to be consulted in 
the development and measurement of goals and objectives.
    This morning, we will hear from John Koskinen, who serves 
as Deputy Director for Management at the Office of Management 
and Budget and L. Nye Stevens, who is Director of Federal 
Management and Workforce Issues at the General Accounting 
Office. Each will report on his office's review of pilot agency 
efforts to implement the principles of the Results Act.
    We welcome both of you, but I first want to yield to the 
gentleman from Texas, Mr. Sessions, for any opening that he 
might have.
    Mr. Sessions. Good morning, Mr. Chairman, and thank you so 
much. I also would like to thank Mr. Koskinen, Mr. Stevens, and 
Mr. Mihm for being here this morning. And as you all know, I 
view the Results Act as being critical to the success of 
Government and I am dedicated to that success also of seeing it 
implemented properly.
    We are here today I hope to learn more about the progress 
agencies are making in consultation with Congress and other 
stakeholders in preparing their strategic programs. Both OMB 
and GAO have prepared reports on this status, and I know that 
my staff and many of the committee staff, under the dedicated 
leadership of the majority leader and also our Chairman Horn, 
are working hard to ensure those strategic plans are up to 
snuff. The responsibility for the success of the Results Act 
falls upon a lot of people.
    But I believe that today we are here because we have to 
call on those people who were at the apex of the executive 
branch to point us in the right direction, to give us 
information, and to evaluate the process, and the progress that 
we are making to come to this critical stage. I hope that today 
we will be able to ascertain where we are and how closely we 
are getting to that target, to hit the center of the target. 
And so I am delighted to have each one of you here today.
    Mr. Chairman, as always, I support and concur with the 
words that you have given. This is important and this is 
serious business. Thank you, sir.
    Mr. Horn. Well, I thank you.
    [The prepared statement of Hon. Danny K. Davis and Hon. 
George P. Radanovich follow:]
[GRAPHIC] [TIFF OMITTED] 45062.001

[GRAPHIC] [TIFF OMITTED] 45062.002

[GRAPHIC] [TIFF OMITTED] 45062.003

    Mr. Horn. The gentlemen before us know the usual routine. 
If you would rise, raise your right hands.
    [Witnesses sworn.]
    Mr. Horn. We will just simply go down the agenda and in 
alphabetical order, John Koskinen, Deputy Director for 
Management, Office of Management and Budget, one of our most 
frequent witnesses before this committee. Welcome, John.

  STATEMENT OF JOHN KOSKINEN, DEPUTY DIRECTOR FOR MANAGEMENT, 
                OFFICE OF MANAGEMENT AND BUDGET

    Mr. Koskinen. Thank you, Mr. Chairman. I'm happy to be 
here. I still am looking--is this on?
    Mr. Horn. Is that microphone on?
    Mr. Koskinen. Let me borrow your microphone. Oh, I see.
    Mr. Sessions. You are catching on very early.
    Mr. Koskinen. You can tell I've been here before.
    Mr. Horn. You do know they are part of the legislative 
branch. Their microphones work, but go ahead.
    Mr. Koskinen. We'll talk to you about this in the budget 
process during infrastructure support.
    I'm pleased to appear before the committee this morning to 
discuss implementation of the Government Performance and 
Results Act of 1993 and to provide an assessment of our 
progress to date in meeting its major requirements.
    This committee was one of the leaders in the passage of the 
act, and we look forward to continuing to work with you and the 
entire Congress as implementation proceeds.
    As a Government, we face major challenges. This is a time 
of great fiscal constraint. Tight budget resources demand that 
every dollar is counted. During a period of much public 
skepticism about the Government's ability to do things right, 
the Government must not only work better, but be shown as 
working better, if we are to regain public confidence. GPRA, if 
successfully implemented, will help this effort to improve 
public confidence in the efforts of its Government.
    To be successful, implementation will also have to be a 
bipartisan effort. Recently, the House majority leader and 
other Members of the congressional leadership have facilitated 
the consultation process GPRA requires between Congress and the 
agencies by coordinating meetings between agencies and the 
appropriate congressional staff to discuss the agencies' 
strategic plans. We look forward to continuing this cooperative 
consultive process during the next few weeks.
    Let me now summarize the conclusions of our report on GPRA 
and discuss those aspects of the act and its implementation 
that are our most immediate focus.
    Looking at strategic plans, the act requires that Federal 
agencies submit a strategic plan to Congress and OMB not later 
than September 30, 1997. There is no more important element in 
performance-based management than strategic plans. These plans 
set the agency's strategic course, its overall programmatic and 
policy goals, indicate how these goals will be achieved, and 
are the foundation and framework for implementing all other 
parts of GPRA.
    The act requires agencies, when preparing their strategic 
plan, to consult with Congress and solicit and consider the 
views and suggestions of stakeholders, customers, and other 
potentially interested or affected parties. OMB has issued 
strong guidance supporting congressional consultation.
    The administration is currently undertaking a strategic 
assessment of agency goals and commitments. A focus of that 
assessment is the agencies' implementation of GPRA and the 
preparation of the strategic plans and the annual performance 
plans that are due in September.
    As a general matter, the agency plans reflect a serious 
effort and allow us to conclude that agencies should be able to 
produce useful and informative strategic plans by this fall. 
OMB's reviews of agency efforts have also reviewed several 
challenges.
    Last summer, in our previous review, most agencies were 
only beginning to link the general goals and objectives of 
their plans with the annual performance goals they would be 
including in their annual performance plan. Further interagency 
coordination on programs or activities that are cross-cutting 
in nature is also necessary. The efforts of the Office of 
National Drug Control Policy provide a useful model for how 
such coordination across agencies with overlapping 
responsibilities might be carried out.
    Looking at the annual performance plans, pursuant to the 
statute, the first plans will be sent to OMB this September 
with the specific performance goals that the agency intends to 
achieve in the fiscal year.
    The agencies and OMB gained valuable experience in 
preparing annual performance plans through the pilot project 
phase of GPRA. OMB has initiated a review of the performance 
goals that agencies proposed to include in its annual 
performance plans for fiscal year 1999. And of the joint 
collaboration with the agencies, OMB has prepared guidance on 
the preparation and submission of annual performance plans for 
fiscal year 1999. And we expect agencies to produce useful and 
informative annual performance plans for that year.
    The act requires that a governmentwide performance plan be 
annually prepared by OMB and be made part of the President's 
budget. The governmentwide performance plan is based on the 
agency annual performance plans that are submitted at the same 
time. The first governmentwide plan will be sent to Congress in 
February 1998, and will cover fiscal year 1999. In this regard, 
we would welcome your views on those features that you believe 
would make the plan informative and useful to Congress.
    The agency's program performance report is the annual 
concluding element of GPRA. The first program performance 
reports, for fiscal year 1999, are to be sent to the President 
and Congress by March 31, 2000.
    Some agencies are experimenting with different formats for 
performance reporting in the accountability report pilot 
program authorized by the Government Management and Reform Act 
that this committee played a pivotal role in achieving passage 
of. These variations include various information on the 
agency's performance as well as other statutorily required 
information such as the agency's audited financial statement 
and the Federal Managers' Financial Integrity Act report.
    Turning for a minute to the pilot projects, GPRA required 
that at least 10 departments or agencies be designated as pilot 
projects for performance plans and program performance reports. 
Pilot projects were designated in all 14 cabinet departments 
and an equal number of independent agencies. The 28 
designations included over 70 individual pilots in the 
departments and agencies and covered approximately a quarter of 
the entire Federal civilian work force.
    Historically, the expansion of the pilots from the minimum 
of 10 required by the statute has been viewed as an important 
advance under the act. Therefore, I was disappointed to hear, 
Mr. Chairman, that you think the result of this has been that 
we have spread the process too thin.
    Our experience has shown us that, in fact, one of the 
reasons that as many people are actually using performance 
information in advance of the act--as is demonstrated by the 
GAO report--is because of the fact that more people were 
actually involved in the pilots than the act required. One of 
the major lessons to be learned from the pilots is to expand 
the number of people in the Government who are focused on the 
formulation of performance goals and measures, and the actual 
achievement of those measures. Therefore, we continue to think 
that, in terms of the overall implementation of the act, our 
ability to involve more Federal agencies or more Federal 
employees was a net gain.
    The most important conclusion reached on completion of the 
performance measurement pilot projects is that, without these 
pilots and the time given to agencies by the act across the 
Government to gain experience in performance-based management, 
there would be little prospect for a successful implementation 
of the act governmentwide. In addition, the scope and dimension 
of these pilots confirmed that virtually every activity done by 
government can be measured in some manner, although not 
perfectly.
    The pilot project process also indicates that the first 
years of full-scale implementation of GPRA will be the start of 
the dialog about performance and performance measures, not the 
end of it. Measures will be modified. Better and more 
appropriate goals will be defined. Performance data will 
increase in both volume and quality. Over time, the overall 
quality of agency plans and reports should improve 
significantly.
    The second set of pilot projects called for by the act are 
those for managerial accountability and flexibility. While 
agency nominations for these pilot projects were solicited and 
received, as the chairman noted, no pilot projects were 
designated.
    Two initiatives begun after passage of GPRA reduced the 
universe of waivers. The Work Force Restructuring Act 
effectively prevented OMB from approving any FTE ceiling waiver 
requests at the time when these pilot project nominations were 
solicited and reviewed. Such FTE waivers would have been an 
important component of many proposed pilots.
    At the same time, the administration was eliminating and 
simplifying many requirements affecting the operations of 
Federal agencies. The Federal Personnel Manual was eliminated 
by OPM, and thousands of pages and instructions and 
requirements disappeared. Procurement regulations were 
substantially streamlined. With far fewer requirements in 
place, waiver demand was lessened as well. In this context, we 
concluded that too few waivers would be authorized to designate 
any pilot project, and have that pilot serve as a credible test 
of the managerial accountability and flexibility provisions of 
GPRA.
    While no flexibility pilot projects were designated, 
waivers were given to a range of agencies and the collaboration 
among the four central management agencies, both in defining a 
process for reviewing and deciding on waivers and identifying 
possible waivers, forms a good foundation for governmentwide 
implementation of this aspect of the GPRA.
    GPRA also requires that not less than five departments or 
agencies be designated as performance budgeting pilots for 
fiscal years 1998 and 1999. These pilots are to develop budgets 
that display the varying levels of performance resulting from 
different budgeted amounts. OMB has notified the chairmen of 
the Senate Committee on Governmental Affairs and the House 
Committee on Government Reform and Oversight that we plan to 
defer the start of the performance budgeting pilot projects by 
1 year.
    This deferral does not affect the content requirements for 
agency strategic plans and performance plans, nor the date for 
OMB's report on the pilots to the Congress. It simply reflects 
our judgment that, as the agencies work this summer and this 
fall on providing what we feel need to be informative 
performance plans for fiscal year 1999, it does not serve the 
implementation of the act, or us, or the Congress to have 
several of them at the same time trying to develop performance 
budgeting pilots. Therefore, our strategy is to work with the 
agencies in the spring and designate at least five pilots which 
will start for fiscal year 2000. And, as noted, our report to 
Congress will be well within the statutory deadline. And we 
think we will end up with a better set of pilot projects 
without diverting the attention to the agencies at the time 
we're talking now to these pilots.
    Congress also asked that OMB address a number of specific 
issues in our May report. Section six of the act required us to 
include in our May report any recommended changes in the 
various provisions of the act. The experience to date in 
implementing GPRA has not identified any provisions that 
require change.
    As noted earlier, we expect agencies to provide useful and 
informative, strategic, and annual performance plans within the 
time line specified by the act. Even as performance measures 
become more refined, however, we should always bear in mind 
that using performance measures in the budgeting process will 
never be an exact science.
    For example, an underperforming program may benefit from 
additional resources, not fewer. Comparing results across 
program lines will always require political judgments about the 
relative priorities, for example, of programs for highways and 
education. We should not lose sight of the fact that 
performance information will often be used to adjust the way 
programs are managed rather than to change the resources 
provided.
    Accurate, timely performance information is important in 
all of these situations, and this is why the administration is 
committed to the successful implementation of the act.
    This concludes my statement, Mr. Chairman, and I will be 
pleased to answer any questions you may have after Mr. Stevens' 
testimony.
    Mr. Horn. We thank you very much for that very succinct 
statement.
    [The prepared statement of Mr. Koskinen follows:]
    [GRAPHIC] [TIFF OMITTED] 45062.004
    
    [GRAPHIC] [TIFF OMITTED] 45062.005
    
    [GRAPHIC] [TIFF OMITTED] 45062.006
    
    [GRAPHIC] [TIFF OMITTED] 45062.007
    
    [GRAPHIC] [TIFF OMITTED] 45062.008
    
    [GRAPHIC] [TIFF OMITTED] 45062.009
    
    [GRAPHIC] [TIFF OMITTED] 45062.010
    
    [GRAPHIC] [TIFF OMITTED] 45062.011
    
    Mr. Horn. Our next witness is L. Nye Stevens, Director, 
Federal Management and Workforce Issues, General Government 
Division, U.S. General Accounting Office. Mr. Mihm has been 
before us many times, but I wonder, Mr. Stevens, or Mr. Mihm, 
if you will identify yourself as to title and role in this 
particular project.
    Mr. Stevens. Yes. Mr. Mihm is our Acting Associate Director 
for Federal Management Issues and has been the supervisor of a 
fairly large staff, most of which are sitting behind him, that 
has prepared the report on GPRA that was due this week.
    Mr. Horn. I wondered why we had such a crowd this morning. 
Management did not attract them; does it? Please proceed.
    Mr. Stevens. Yes, sir. Mr. Chairman, I'll try to be equally 
brief and summarize my points and submit the full statement for 
the record, if that's all right with you.
    Mr. Horn. Absolutely.

 STATEMENT OF L. NYE STEVENS, DIRECTOR, FEDERAL MANAGEMENT AND 
  WORKFORCE ISSUES, GENERAL GOVERNMENT DIVISION, U.S. GENERAL 
ACCOUNTING OFFICE, ACCOMPANIED BY CHRIS MIHM, ACTING ASSOCIATE 
             DIRECTOR FOR FEDERAL MANAGEMENT ISSUES

    Mr. Stevens. As required, we were to report to Congress 
this week on implementation of the Results Act and its 
prospects for governmentwide implementation for the future. We 
did release that report yesterday, and it provides an 
assessment of the progress and challenges that agencies face 
and are going to continue to face in implementing the act.
    Our work shows that, to this point, the experience with the 
provisions of the act has been mixed and, as a result, when it 
goes into full governmentwide effect this fall, we can expect 
to see highly uneven implementation in the executive agencies 
as a whole.
    The most positive finding of the report is that the 
experiences of some of the pilot agencies, and some nonpilot 
agencies, show that improvements are possible when an agency 
adopts a disciplined approach to three important management 
practices: First, setting results-oriented goals; second, 
measuring agency performance against those goals; and, third, 
using performance information to improve effectiveness.
    Our report identifies a number of organizations, such as 
the Coast Guard, the Veterans Health Administration, the Social 
Security Administration, that have made tangible and important 
performance improvements by adopting such an approach. And 
these are real improvements. These are improvements in safety, 
environmental conditions, and the Government's responsiveness 
to its customers.
    Nevertheless, despite the existence of a number of positive 
examples, we have not been overwhelmed by great numbers of 
them. As a result, the prospects for effective implementation 
are fairly limited in many agencies when the law comes into 
effect on a governmentwide basis in less than 4 months.
    While the strategic and annual performance plans will be 
submitted, meeting the letter of the law that you referred to, 
Mr. Chairman, in your statement, our work suggests that these 
plans will not be of a consistently high quality or as useful 
to congressional and agency decisionmaking as they could be. 
Although some performance improvements are noteworthy, the 
reported examples of substantial performance improvements were 
relatively few, and many agencies did not appear to be well 
positioned to provide in 1997 a results oriented answer to the 
fundamental Results Act question, which is, What are we 
accomplishing?
    For example, the Department of Housing and Urban 
Development's public housing management assessment program did 
not collect important information that is needed to manage and 
assess its results. It had information on the numbers of 
outstanding work orders at public housing authorities and 
uncollected rents there, but the system they used did not 
measure other factors, such as the quality of the housing 
itself that are essential for assessing the results that 
housing authorities are achieving as well as for comparing or 
determining which housing authorities are performing well and 
which ones are performing poorly.
    In our view, the situation at HUD appears to be typical. 
Our survey of Federal managers, which was a governmentwide 
survey we carried out for this report, showed that many 
agencies do not appear to be well positioned to answer the 
fundamental question of whether or not their programs have 
produced real results.
    And I'll refer here, Mr. Chairman, to a couple of charts 
that are to my left. They're also reprinted on page 6 and 8 of 
the prepared statement.
    The first chart shows only 32 percent of Federal managers 
said that they had the types of performance pressures that 
would demonstrate whether the programs were achieving their 
intended results. And even in similar numbers, about a third 
said they have measures that address customer satisfaction and 
service quality.
    Although percentages are low, significantly more managers 
did report the existence of results oriented and other 
performance measures to a great extent currently than they 
recollected the situation to be 3 years ago. So it's a 
situation in which there's more today than there was then but 
still not a lot by an absolute standard.
    Of course it's not sufficient merely to measure 
performance. If the Results Act is to have a lasting impact in 
contrast to many of the management improvement initiatives that 
you mentioned, Mr. Chairman, in your opening statement such as 
PPBS and MBO and CBB, it's important that performance 
information actually be used to make decisions and to improve 
the management of Federal programs.
    In our survey, we asked Federal managers about the extent 
to which results oriented performance information was actually 
used. And that's reflected in the second chart, the one closest 
to you, Mr. Chairman. As that chart shows, it's on page 8 of 
the statement, managers reported that the use of such 
information was very limited. It's still a very infrequent 
occurrence. Only about a fifth of the managers and supervisors 
we contacted reported that results-oriented performance 
information was used to help save agency budget, and an even 
smaller proportion said it was used to make actual changes in 
legislation, program design, or in funding decisions.
    However, similar to the situation with performance 
measures, Federal managers did report some positive change in 
what they recollected the situation was 3 years ago. There has 
been some progress.
    Our work has shown that agencies are confronting five key 
challenges that have limited the effective implementation of 
the Results Act and its prospects for the future. These 
challenges, which are detailed in our report, really represent 
an unfinished agenda for the Results Act.
    The first challenge is that of establishing clear agency 
missions and strategic goals, especially in the very frequent 
case, where program efforts are overlapping and fragmented. One 
example of this is the Department of Education programs that 
provide loans and grants to students to help finance their 
higher education. We found that although the student loan and 
Pell grant programs provided the majority of Federal financial 
aid to students for post-secondary education, there are another 
22 smaller programs that were targeted to specific segments of 
the population, such as prospective students from disadvantaged 
families.
    These 22 programs were collectively funded at the $1.1 
billion level for fiscal year 1995. We concluded that the 
consolidation of some of these smaller grant programs, either 
with larger grants or with each other, would have no adverse 
impact on students' access to post-secondary education. And the 
Federal Government over a 5-year period could save about 10 
percent in administrative costs, or about $550 million, not an 
inconsequential amount at all.
    The second major unmet challenge is that of limited or 
indirect influence that the Federal Government has in 
determining whether a result is actually achieved. And it 
complicates the difficult task of measuring the discrete 
Federal contribution to a specific result. Measuring the 
Federal contribution is particularly difficult in regulatory 
programs on which we're going to be issuing a separate report 
very shortly in research and development programs and in those 
that are delivered through third parties such as financial 
institutions or State and local governments.
    For example, determining the impact of economic development 
of which, by the way, there are 342 in the catalog of domestic 
Federal assistance and has been a daunting task because of the 
numerous external forces including broad national economic 
trends and assistance that communities may receive from State 
and local government and the private sector that also 
contribute to economic development. Separating out the effects 
of Federal efforts in that area can be extremely difficult as 
we observed in our review last year of development programs 
because it first requires documentation that there's been some 
improvement; second, linkage of the specific program elements 
to the actual economic changes; and third, a measurement of the 
growth stemming from other influences on the economy in order 
to isolate the impact that could be attributed to the economic 
development programs that we're evaluating.
    The third major challenge to the effective implementation 
of the act is the lack of the results-oriented performance 
information in many agencies, as you pointed out in your own 
statement, Mr. Chairman, which hampers efforts to identify 
appropriate goals and confidently assess performance.
    Even when the data exists, we have consistently found that 
the quality of the data is often questionable due to several 
factors, including the need very often to rely on third parties 
to provide it.
    For example, the Department of Veterans Affairs told us 
that some of their results-oriented measures for the loan 
guarantee programs such as simple things as the average time it 
took to process loans, that these measures were new and that 
the base line data just weren't available for them. 
Consequently, they did not have data on past performance to use 
in setting the 1998 targets, and they had to say this is going 
to be provided later.
    The fourth challenge centers on the need to instill within 
the agencies an organizational culture that focuses on results, 
and this I must say still remains a work in progress in the 
Federal Government. For example, when we ask Federal managers 
in our survey about the extent to which they and their 
supervisors had the authority they needed to help the agencies 
accomplish their strategic goals, they did not perceive that 
they had more such authority than they recalled having 3 years 
ago. We reported in April, as Mr. Koskinen mentioned, that the 
managerial accountability and flexibility project did not work 
as had been intended.
    And then finally, Mr. Chairman, there's a fifth challenge 
to the effective implementation of the act and that's the need 
to link agencies' performance plans directly to the budget 
process. Reaching agreement between Congress and the executive 
branch on the changes that are needed in the program activity 
structure is quite likely and is going to be a time-consuming, 
very difficult process to do that and one that, in our view, is 
going to take more than one budget cycle to resolve.
    Just in closing, I would point out that the--solving these 
challenges is going to raise some significant policy issues for 
the administration and Congress to resolve, some of which are 
going to be very difficult. However, we believe that the 
success or failure of the Government Performance and Results 
Act should not be judged on whether contentious policy issues 
are fully resolved; rather, that judgment of its success or 
failure should turn on the extent to which the information 
produced through the required goal-setting and performance 
measurement practices--once these practices are successfully 
implemented--helps inform policy decisions and improve program 
management. That's the ultimate objective.
    Thank you, Mr. Chairman. We'll respond to any questions you 
have.
    Mr. Horn. We thank you, Mr. Stevens.
    [The prepared statement of Mr. Stevens follows:]
    [GRAPHIC] [TIFF OMITTED] 45062.012
    
    [GRAPHIC] [TIFF OMITTED] 45062.013
    
    [GRAPHIC] [TIFF OMITTED] 45062.014
    
    [GRAPHIC] [TIFF OMITTED] 45062.015
    
    [GRAPHIC] [TIFF OMITTED] 45062.016
    
    [GRAPHIC] [TIFF OMITTED] 45062.017
    
    [GRAPHIC] [TIFF OMITTED] 45062.018
    
    [GRAPHIC] [TIFF OMITTED] 45062.019
    
    [GRAPHIC] [TIFF OMITTED] 45062.020
    
    [GRAPHIC] [TIFF OMITTED] 45062.021
    
    [GRAPHIC] [TIFF OMITTED] 45062.022
    
    [GRAPHIC] [TIFF OMITTED] 45062.023
    
    [GRAPHIC] [TIFF OMITTED] 45062.024
    
    [GRAPHIC] [TIFF OMITTED] 45062.025
    
    [GRAPHIC] [TIFF OMITTED] 45062.026
    
    [GRAPHIC] [TIFF OMITTED] 45062.027
    
    [GRAPHIC] [TIFF OMITTED] 45062.028
    
    [GRAPHIC] [TIFF OMITTED] 45062.029
    
    [GRAPHIC] [TIFF OMITTED] 45062.030
    
    [GRAPHIC] [TIFF OMITTED] 45062.031
    
    Mr. Horn. And now I now yield 10 minutes to Mr. Sessions, 
the gentleman from Texas, who spent a lot of time on this 
subject, so we are going to have you lead the questioning.
    Mr. Sessions. Thank you, Mr. Chairman.
    Mr. Koskinen, I would like to first start, if I could, with 
you and have you provide us, if you can, an evaluation of those 
plans that were submitted and talk with me specifically about 
who fell within the criteria that you think are good plans, 
ones that met your expectation, and then on the reverse side, 
some of those which you feel will require some additional work.
    Mr. Koskinen. I think the short answer is they all require 
additional work. The statute didn't contemplate--and we didn't 
either--that they would be done by now. Our goal, in fact, is 
to continue to work with the agencies, as we are this spring, 
and the assessments through the summer, to ensure that we get 
the best possible plans to you and the public in September. 
We've made it clear to the agencies that we support 
congressional consultation, and we expect that those plans will 
evolve to some substantial extent as a result of consultations 
not only with Congress, but other stakeholders and interested 
parties.
    Clearly, some agencies have broader background and 
experience and are farther ahead. An agency like Social 
Security, for instance, has in effect been producing strategic 
plans and performance measures for 6 or 7 years. And if you 
look at their annual accountability report, it also is a model 
of what we're trying to drive toward. Because in one document--
produced in a timely manner--they talk about their mission, 
what they're trying to accomplish, the measures of customer 
service and delivery of the benefits, how they've done against 
those measures, and what their audited financial statements 
show. So they clearly are an agency that is doing very well.
    But I would stress that at this time we don't think any 
agency is complete. And we have been pleased to have the active 
involvement, particularly in the House, of the majority 
leader's teams working with the agencies and us to try to get 
the best plans we can. I think Mr. Stevens and GAO are correct. 
This is a massive undertaking and it's going to take the best 
efforts of all of us to have us succeed.
    Mr. Sessions. OK. So you would probably describe this as 
maybe a scrubbing process. They get them to you, their first 
view, you try and scrub it, you go back and work with them.
    You talked about stakeholders. Is that GAO? Are they one of 
the stakeholders that you work with?
    Mr. Koskinen. No, actually the stakeholders, the agencies 
we're working with are, in fact, the interested constituents 
and parties in--affected by their programs or interested in 
them. The stakeholder they all have, obviously, is the 
Congress. The statute provides for that. Our guidance requires 
that there be an active consultation by every agency with its 
oversight committees, authorizers, and appropriators. We have 
worked for the last 2 or 3 years with GAO in terms of jointly 
sharing information. But obviously we understand that GAO is a 
part of the legislative branch, not the executive branch.
    Mr. Sessions. All right. What is your relationship with GAO 
in the scrubbing process, then?
    Mr. Koskinen. In terms of the scrubbing process, as you 
refer to it, I would refer to it as the review and dialog with 
the agencies, we have not been in communication with GAO on an 
agency-by-agency basis. We have utilized the reports GAO has 
issued to help inform the process.
    As I think I testified about a year ago, GAO did a very 
good review of the pilot performance projects that talked about 
the lessons learned. We thought that was a good enough report 
and valuable enough that we actually distributed it to a large 
number of people in the executive branch because we thought the 
lessons GAO discovered were important for all of the agencies 
to undertake. But on an agency-by-agency basis, we're not 
engaged in any communications with GAO.
    Mr. Sessions. OK. How about an engagement with your 
organization, then, inasmuch as you are the one receiving the 
plans and them working with you? I am trying to find out--you 
are here before us.
    Mr. Koskinen. Yes.
    Mr. Sessions. I am trying to determine the honest attempt 
on both sides to get closer to what Congress is after.
    Mr. Koskinen. Right. We started actually over 3 years ago 
but when I, the 3 years I've been here, we've actually been 
working on an almost continuous basis with the agencies. In the 
fall of 1994, in that budget process for the fiscal 1996 
budget, we asked the agencies to provide as much performance 
information as they had to begin to take a look at what 
performance measures would look like.
    We did a review with them in the spring of 1995 of their 
core programs. We said, ``If you looked at your basic programs, 
what would be the right performance measures for those?''
    In the summer of 1996, we did a full-scale review of the 
agencies' strategic planning processes. And, as noted in my 
testimony, we discovered, of course, that they were facing some 
significant challenges.
    We're in the process right now of concluding a spring 
assessment of a range of management initiatives, but the focal 
point is on GPRA as a general matter. Each of our program 
examining divisions has worked and is working with the agencies 
to, in fact, critique, provide guidance on and feedback on each 
specific agency plan. So that, as I say, this has been an over 
a 3-year undertaking, and we continue to believe that we're 
going to have to work up until the end of August to make sure 
that we get you the best plans we can.
    Mr. Sessions. Right. OK. Well, with that in mind, and I do 
understand from your testimony that you have given here that 
there are a lot of changes that are in process.
    Mr. Koskinen. Right.
    Mr. Sessions. That you are trying to take full advantage of 
those, but we did talk about the 3 years. Do you believe that, 
as your responsibility and your testimony that you are giving 
to us today, that you are going to be on target to present 
plans that I think not only meet the law but also the spirit of 
the law, in other words, not just written compliance but also 
an in-depth observation from each one of those agencies about 
their mission?
    Mr. Koskinen. Yes.
    Mr. Sessions. You believe sitting there today that you are 
going to be on target and they will all be?
    Mr. Koskinen. I think GAO is right. We might disagree where 
the bell shaped curve starts in terms of the spread. There are 
going to be some again that reflect years of experience with 
this that will be at one end of the bell shaped curve and will 
be outstanding plans. There are going to be some at the other 
end of the bell shaped curve, a small number, who will be 
agencies who are still struggling, that these will be 
acceptable plans, they will meet the spirit, but the agencies 
will be the first to tell you that they are, in fact, the front 
end of that experience, and they will continue to evolve.
    The bulk of the plans will be, I think, comfortably in the 
middle of that bell shaped distribution curve. They will be in-
depth analyses of missions, of goals, of objectives, will 
indicate performance measures that will be used, and will, in 
fact, start us on down the road.
    But I might just note that our goal in this process is not 
a neat document. If all we accomplish in this process is very 
good strategic planning documents and that's it, we will have 
failed. The goal in this process is in fact to have agencies 
and the Congress use the information generated about the 
results achieved by programs to make management decisions as 
well as budgetary decisions. And I would just say, it takes a 
lot of people to tango, but it takes at least two. And that is, 
it's going to take the Congress as well as the agencies.
    Mr. Stevens noted, I think very appropriately, that one of 
the challenges they have identified is the ability to link 
performance plans to the budget process.
    Mr. Sessions. Yes.
    Mr. Koskinen. Now that's a challenge not just to the 
agencies, that's a challenge to the Congress because our 
present budgetary accounting system clearly does not track in 
many cases program-by-program. There are a lot of line items 
and detailed and disaggregation of budgetary resources that in 
fact make it very confusing, if not impossible, to figure out 
what the costs are and resources are devoted to a particular 
program.
    So we have I think a lot of work to do jointly together if 
this act is actually going to achieve its goal, which is in 
fact to improve the performance of the Federal Government.
    Mr. Sessions. This all gets down to accountability, and I 
can assure you this Congress is going to look very carefully at 
the accountability factor, because in fact we have asked those 
agencies to describe those areas, that methodology, and what 
their plan of action is going to be. So very good.
    Mr. Mihm, if I might direct my question, the same one to 
you perhaps, and that is, from the evaluation that you have had 
as an independent arm for your analysis of the plans you have 
seen, or Mr. Stevens, whichever is most comfortable with 
responding.
    Mr. Mihm. We found, Mr. Sessions, on the whole, the 
agencies that have the most direct relationship between the 
product and service that they provide and the ultimate customer 
are those that have the easiest time doing GPRA, and, as a 
result, they're the furthest along and the furthest down the 
bell shaped curve that Mr. Koskinen talked about.
    So, for example, Social Security Administration where it's 
pretty easy--or relatively, I should be careful--are they 
getting the right check to the right individual on the right 
time? It's easier than it would be for an intergovernmental 
program run by the Department of Education to figure out what's 
our result, what's the relationship that we do and our ultimate 
result.
    So it really turns on the success that the agency is having 
in both its strategic planning and its annual planning. Its 
performance measurement efforts really turn on the degree to 
which there's a direct relationship between what it does and 
the ultimate user of its product or service.
    Mr. Sessions. Good. I have got about 1 minute remaining. 
Let me say this. I hope that both of you go back, Mr. Koskinen, 
that you give a pat on the back to those agencies that have 
gotten their plans in on time, and I hope you will let them 
know in writing that they were close, and those that were not 
close, that you have gone back to them and said it requires 
more work. But I hope that that is in writing to them, because, 
as we go through this appropriation process, not just this 
year, but next year, that will be an important trail marker for 
those agency heads to understand that we really were serious 
about what we are trying to do. And I think it helps your job 
out.
    Mr. Koskinen. That's right.
    Mr. Sessions. Thank you, Mr. Chairman.
    Mr. Horn. I thank you and now recognize for 10 minutes Mr. 
Davis, the Member from Illinois.
    Mr. Davis of Illinois. Thank you very much, Mr. Chairman, 
and with your permission I would like to submit a statement for 
the record.
    Mr. Horn. Without objection. Is that an opening statement?
    Mr. Davis of Illinois. Yes.
    Mr. Horn. It will be put with the other opening statements 
at the beginning of the hearing.
    Mr. Davis of Illinois. Thank you very much.
    Mr. Koskinen, we know that OMB plans to defer the start of 
the pilot projects on performance budgeting for a year. 
According to your report, a major reason for this delay is the 
lack of adequate cost accounting capability in many of the 
Federal agencies.
    My question is: What are the implications of poor cost 
accounting capabilities for the implementation of the GPRA 
generally? And then, does this problem, coupled with the 
absence of baseline data, mean that additional delays in 
performance budgeting pilots are likely? And finally, what do 
you plan to do to address these weaknesses?
    Mr. Koskinen. First, let me state that the absence of cost 
accounting data is a factor, but I think our major reason for 
delaying, as I noted earlier to the chairman, is that we did 
not want to distract the agencies at this timeframe while they 
are working on completing their strategic plans and preparing 
their first performance plans for submission to us in September 
and the Congress in February, to at the same be starting up a 
new set of pilots.
    The cost accounting issue is an important one. We won't 
solve that problem either in the next 12 months. What we are 
talking about in cost accounting is not that we don't, in fact, 
keep track of where the funds are spent, but we are talking 
about costing out the cost of each activity or program. In 
other words, as we have talked to you today and as the act 
talks about, we want to know what the results are of our 
activities. But at the same time, once we know what performance 
we have gotten, we would like to know how much did it cost us 
to achieve that performance? And, again, our present budgetary 
structure disaggregates those costs. We have personnel, salary 
and expenses, a lot of other kind of overhead costs that are 
spread in various ways throughout the budgets, and it is 
important for us to be able to pull all of those costs 
together.
    The Financial Accounting Standards Advisory Board, FASAB, 
has provided a set of now complete accounting standards for the 
Government, and one of the last ones they issued was cost 
accounting. So we are moving in the right direction, but I 
think it will be some time before we get there. But ultimately, 
we need to have that information so that, as I say, we can 
complete the equation; not only knowing what we got for what we 
paid, but actually what did we pay to get that result.
    With regard to your question, then, about will the absence 
of baselines mean we will delay the performance budgeting? The 
answer to that is, no; that we will look at the performance 
budgeting pilots as a way of trying to figure out can we--how 
reasonable is it to ask the agencies to give us, in effect, 
sensitivity analyses not only of different resources, but the 
allocation of existing resources in different ways?
    I would note that the performance budgeting pilots are the 
only pilots that then do not automatically go to full scale 
implementation. The way the statute is designed, we do the 
pilots and then OMB will report to the Congress with our 
recommendations as to whether this is worth the effort. So this 
is really a pilot program in which we will all make judgments 
as to whether this adds anything significant to the dialog, 
which is worth the cost and the effort of doing it.
    With regard to baselines, let me just say, because that 
runs through some of the GAO comments and our own, clearly we 
need to have baselines for our activities so that we can see 
and know how to measure the improvement. But even as a 
fundamental question, it is hard to know what your goal ought 
to be if you don't know where you are.
    But the absence of those baselines shouldn't surprise 
anyone. If we have not been, as a general matter across the 
board, collecting performance information and talking about it, 
then we are not going to have a lot of those baselines. So what 
we have told the agencies is if you wait until you have perfect 
information and wonderful histories of several years, we will 
be at this for a long time.
    So the conclusion we have reached, and the CFO Council, 
which has worked with us, is that the algorithm we are using is 
start wherever you are. Whatever information you have now, 
whatever baseline information you have, whatever judgments you 
can make on the basis of your experience, use them; but don't 
wait until some future day when we have either better cost 
accounting or better baselines. Start where you are and we will 
be building the baselines as we go.
    Mr. Davis of Illinois. I would assume that pilots resulted 
as a result of earlier strategic planning. Would that be 
accurate?
    Mr. Koskinen. I am sorry?
    Mr. Davis of Illinois. That the pilots were developed as a 
result of earlier strategic planning.
    Mr. Koskinen. No, actually, the statute recognized that the 
most difficult part of implementing this act is going to be 
defining performance measures and collecting data and 
determining what is the right data and how hard is it to get? 
So even while agencies were thinking about and beginning to 
work toward the development of strategic plans, we went into 
specific agencies who volunteered to be pilots and that we 
selected as a pilot, and said wherever you are going with the 
strategic plan, what are useful performance measures? And, 
let's do a set of pilots to see how easy it is to collect that 
information and what utility will it be once we have it.
    So to some extent, the performance pilots were ahead of the 
train, which would normally start with a strategic plan.
    Now, the ones that were most effective, and the GAO report 
showed that, were the ones that, in fact, grew out of a broader 
strategic plan and vision for the agencies. And some agencies 
had more experience at that just on their own than others. I 
think that was one of the lessons GAO drew from those pilots 
and we have agreed with that, and that is that the ultimate 
test of performance measures is can you link them to your basic 
goals and objectives?
    Obviously to do that, you have got to know what your goals 
and objectives are. As I noted in my testimony, in our review 
last summer of the strategic planning process, summer of 1996, 
we thought again, as GAO, that one of the great challenges will 
be to take performance information and make sure that it 
actually is performance-related to the achievement of the basic 
goals and objectives that are part of an agency's strategic 
plan.
    Mr. Davis of Illinois. Is it likely that the budget process 
will need to be changed to incorporate the performance 
information generated by the GPRA? And if so, what is OMB's 
position on this issue?
    Mr. Koskinen. I think it is likely and, in fact, it is 
imperative. And our position is that we are anxious to work 
with the Congress and the Budget Committees to take a look at 
the implications of that. Ultimately, we call it connecting 
resources to results, that as we go through the budget process 
we should be continually analyzing budgetary accounts and 
decisions in terms of how they relate to the results that we 
are getting from the allocation and the application of those 
resources. So I think we are going to have to have a more 
transparent budget process.
    Mr. Davis of Illinois. Can you give us any specific 
instances of how the link would take place or shape up?
    Mr. Koskinen. Well, HUD, for instance, has an interesting 
set of matrixes of their programs and the connection of the 
programs to the budgetary accounts. They have, I don't remember 
quite the exact numbers, but for a particular program they 
might have as many as 60 budget accounts that related to that 
program.
    And conversely, they have some programs that themselves are 
spread across a range of other budget accounts. So that the 
issue is can we collect and connect the budget accounts to the 
programs?
    I just had a meeting recently with the State Department, 
which talked about a hard set of strategic discussions. But it 
has been wonderful. The State Department is really working its 
way through it. But as they noted, when they get through 
talking about their goals and objectives, they are still going 
to then have to deal with a budget process that has very 
specific line items in it that are not easily associated with 
their goals, objectives, and performance measures.
    So we talked with them about the need to engage in a dialog 
with their appropriators about how to most meaningfully connect 
the resources to the results.
    Mr. Davis of Illinois. I would think that their goals and 
objectives might sometimes be a little difficult to measure.
    Mr. Koskinen. Yes.
    Mr. Davis of Illinois. Mr. Stevens, the survey GAO 
conducted as part of your report indicates that it will take 
time for agencies to reorient their thinking toward the result-
driven approach required by GPRA. Can you give us any idea of 
how much time it is reasonable to expect, realizing that things 
will vary among different agencies?
    Mr. Stevens. If you are referring, Mr. Davis, specifically 
to the cultural aspects of the need to adapt to results-
oriented management, I don't think it will ever end. The 
governmental system is fundamentally one that has strong 
emphasis on process and securing the confidence of Government 
managers that their programs can be and should be managed by 
results I think will never be as fully implemented as it is in 
the private sector, for example.
    That isn't to say that we aren't making progress. When we 
ask people what the situation was 3 years ago, they say, well, 
it is better than it was then, so we are making progress, but I 
don't think it will ever be done.
    Mr. Davis of Illinois. Are you saying that process is 
oftentimes as important as content or results?
    Mr. Stevens. That has certainly been true of the 
bureaucracy up until now, yes, sir, and I think the Government 
Performance and Results Act is a direct attempt to change that 
culture.
    Mr. Davis of Illinois. In your statement, you say that 
sustained congressional involvement is needed to ensure that 
missions are based in statute and to identify cases where 
statutory requirements need to be modified or clarified. Could 
you give some examples of these instances?
    Mr. Stevens. In the Government Performance and Results Act 
itself or statutory requirements that would reflect the 
requirements on agencies?
    Mr. Davis of Illinois. That's correct, yes.
    Mr. Stevens. Well, I would say, for example, that the 342 
economic development programs that exist in the Government, 
each one of those has a statutory foundation or basis that 
attempts to look for commonalities and compare their results, 
perhaps consolidate some, would certainly take congressional 
authorization in many cases. They are spread among different 
committees. They have different protectors and that could be a 
very complicated job.
    Mr. Davis of Illinois. GAO has commented that pilot 
projects, which OMB is currently conducting to develop broad-
based accountability reports which integrate financial program 
performance and management information, do you need legislation 
in order to do this in this particular area?
    Mr. Mihm. Mr. Davis, those are currently being piloted 
under a separate piece of legislation called the Government 
Management Reform Act--I am sorry for all of these acronyms--
GMRA, which expanded the requirements to the Chief Financial 
Officers Act for audited financial statements for all agencies. 
OMB is working with the agencies to pilot those consolidated 
accountability reports that you mentioned.
    There were a half dozen or so that were piloted the first 
year, more in the second year, and now I understand there is 
going to be plans for a dozen or more in the third year to 
pilot the integration of bringing together for the first time 
the information that you as congressional users really need in 
one format. So you would get audited financial information, 
program performance information and other vital management 
information for the agencies together rather than coming up in 
a semiannual basis or on different calendar times. So it will 
be far more useful to you. So it is already under a statutory 
basis, the piloting of those.
    Mr. Davis of Illinois. And that information is evolving?
    Mr. Mihm. It is evolving, yes, sir.
    Mr. Davis of Illinois. Thank you very much, Mr. Chairman. 
That completes my questioning.
    Mr. Horn. I thank the gentleman. I now yield 10 minutes to 
the gentleman from Virginia, Mr. Davis.
    Mr. Davis of Virginia. Mr. Chairman, thank you very much. I 
think both witnesses testified about really how well they 
believed the Social Security Administration is at developing 
strategic plans, but at this point I don't think--Congress has 
not received their draft plan and we haven't been consulted on 
this. In fact, I've got a list of agencies here, agencies that 
haven't submitted their plans, prospects uncertain, but 
agencies--Social Security is at the lowest, that they haven't 
submitted their plans and they indicate that the consultations 
aren't going to be forthcoming for some time; a risk of 
noncompliance. And I have Social Security under that list the 
staff has assembled.
    Any reaction to that?
    Mr. Koskinen. Yes. As I say, we are working very closely 
with particularly the House leaders in the consultation 
process, and I have advised Social Security that they are in 
the ironic position of having done probably as much or more 
work in strategic planning and performance measures than any 
agency and yet now show up on the bottom of this list.
    Their problem is they are in the middle of a change, 
obviously, in political leadership. They want to ensure that 
when they come with the consultation that they won't be 
consulting about a plan that will be changed. But they 
understand the problem and have committed that this month they 
will begin that consultation process.
    As I discussed with the majority leader's staff actually 
yesterday, I think that of all the agencies they are least 
likely to be a problem because of their history and the quality 
of their information. But I have stressed to them that 
consultation is a real part of this process, that they need to 
be here talking with you about their plans. They need to be 
getting input from you.
    They have already over time gotten that from their 
appropriators where they provide this performance information 
every year, but I have noted to them that there is a broader 
constituency here and they need to get themselves off of the 
bottom of the list.
    Mr. Davis of Virginia. There is probably more interest in 
Congress today than was anticipated when this bill passed in 
terms of how things are going, and agencies, everybody seems to 
be having trouble adjusting. Even OMB was a little bit late 
with its draft statutory report, and I know you have had a lot 
of other things to do over there in the past. Is that also an 
issue of just priorities with a limited staff at this point?
    Mr. Koskinen. Right. I have been very concerned that we not 
be the shoemaker's children and that we be out getting plans 
from everybody else and not have one. We obviously have had a 
few things on our mind with the budget agreement and other 
negotiations, but we do have a draft. We did start the 
consultation process. We do present an interesting challenge, 
as a number of agencies, because we don't create widgets. We 
don't produce necessarily products. We are a staff agency 
providing policy advice analysis and other information both to 
the President and to the agencies in the Congress. So figuring 
out what is measurable in terms of our activities is a 
challenge.
    Our plan addresses that, and we are looking forward to more 
discussion with not only the Congress, but other interested 
parties, because we are open to additional suggestions about 
how you can actually quantify most effectively the performance 
measures other than the fact of policy operation.
    Mr. Davis of Virginia. One of the interesting things is the 
expectations everybody has coming from this act. I mean, some 
of these expectations may be reinterpreted now over what might 
have been intended when the act passes and time changes and 
people read it and look at it in the context of where we are 
today with balanced budget agreements and the like. I wasn't 
even here when the law passed but looking at it, I am 
interested in what the mission statements are going to show in 
terms of what agencies are doing now and what their mission 
statements actually call for.
    It seems to me, to some extent, this can be where the 
rubber can hit the road with some of these agencies that may 
have to revamp their mission statements or change the way they 
are doing things. And I did not hear a lot of testimony on that 
from either of you. I wonder if you have any observations on 
that.
    Mr. Koskinen. As we have said to the agencies over this 
long 3-year consultation process, particularly last summer when 
issues began to surface, you don't find new issues in the 
strategic planning process. What you find is it is a way of 
pulling together all of the issues, so that your point is well 
taken. In the consultation process, in the development of these 
plans and ultimately in the review of them, the plans will be a 
focal point for discussing some fundamental policy issues that 
need to be resolved.
    The favorite example everybody has has been the Forest 
Service that on the one hand is trying to protect the forest 
and on the other hand log them, and what are the differences in 
those competing policy issues?
    Regulatory agencies obviously have a range of issues that 
have been the subject of discussion and debate. Strategic plans 
won't reveal new problems. What they are going to do is, in 
fact, engage people in a focused discussion about what are the 
missions and goals and objectives and more--equally 
importantly, what are we getting as a result of the activities? 
What have been the results?
    My only kibitz a little with GAO's point about the impact 
issue is that it is correct, that ultimately when there is a 
result out there or an outcome as we call it, the hardest 
question will be to figure out what role did we play in 
achieving that? But I think that's a secondary issue. It is a 
great challenge, but if we could just get people focusing on 
the actual outcomes, the results of what happened and then 
worry about what role we had in it, we would be way ahead of 
the present debate, which is primarily focused on inputs.
    If you look at the dialog and debate over the last 2 or 3 
years, contentious as it has been, it has been primarily 
focused on inputs: How much resources? How many people should 
we devote to what issues? And what I think the magic of this 
act, and the potential it has for all of us, is that it will 
move the dialog kind of along that spectrum and have us start 
saying not only what were the inputs and what are the 
appropriate inputs, but what were the results? And then I think 
if we can ever get to the point where we are all arguing about 
what role our programs played in the actual results, what 
impact we had, we will have made great progress.
    Mr. Davis of Virginia. Let me ask if GAO has any comment on 
the mission statements and how these are going to gel as we 
start addressing them and how agencies may have gone way beyond 
their mission statements in some cases.
    Mr. Stevens. Well, the very process of thinking about what 
an agency's mission is is new to some of them, and certainly 
the process of discussing that with their congressional 
overseers is very new and somewhat worrisome to them.
    The Environmental Protection Agency is a good example. They 
have about a dozen statutory mandates, but they don't have any 
overarching legislative mission statement or determination of 
what their real mission is. They are responsible for clean air, 
clean water and solid waste and so forth, but no overarching 
determination of what their environmental responsibilities are.
    The Federal Emergency Management Agency, I think, is one 
that has shown a good approach to this in the recent past, in 
which they examined whether they were really there to provide 
assistance after a disaster takes place, or whether they 
couldn't do more for the ultimate objective of mitigating the 
damage of disasters by taking actions in advance and working 
more closely with State and local governments to mitigate the 
effects of disasters before they take place than having what 
they interpreted their mission to be up until then of coming in 
afterwards and providing money for a clean-up.
    So there have been a number of cases in which this has been 
a very therapeutic process.
    Mr. Koskinen. Let me just comment. FEMA is a very 
interesting example of what the Congressman is driving at. When 
James Lee Witt started, he noted that one of the major missions 
FEMA had was, in fact, preparing for a nuclear attack and the 
results of it. And as he noted, the cold war seemed to have 
ended in the meantime and the wall was down and they had 320 
people working on, in fact, response to nuclear attack. So that 
was a legitimate mission.
    Mr. Davis of Virginia. How do we measure that one today?
    Mr. Koskinen. It is like the guy with the elephants in 
Indiana. We haven't had one for a while so it must have been 
OK.
    The mission was a legitimate one 5 years, 10 years, 15 
years ago, but as the world changed it was appropriate for FEMA 
to take a hard look at what is our basic mission and redeploy 
those resources. So I think that the point you make is a good 
one, and it is not static. We may have an agreement about 
missions today that is appropriate in the present circumstances 
and over the next iteration of the next strategic plan. Life 
may change, and we may all decide that the focus in the 
deployment of resources in an area ought to be adjusted 
accordingly.
    Mr. Davis of Virginia. Mr. Koskinen, business organizations 
are doing this every day. They are examining their mission 
statements every day, every quarter as the bottom line comes 
in, and Government sometimes does it, oftentimes doesn't 
because for a host of reasons. It is just a good policy and 
rhythm to get into once we get started.
    I know it is starting off perhaps more controversial 
because of the cultural shock in some of these agencies that 
haven't had the kind of oversight from Congress that this 
demands and the kind of comparisons that they are forced to 
make, that they have never been accustomed to making. But this 
really, I think, shows great promise over the long-term if we 
can get this off and running and started. It is a little uneven 
right now.
    But I would just say for having worked with you and Mr. 
Kelman and others over at OMB it has really been very 
foresighted in a lot of ways, and if you can help us get 
through this and coordinate with GAO, I think we can leave a 
legacy here that will stand for future administrations and 
relationships that Congress, different parties and on different 
sides of the table, are moving through. But I think this has a 
lot of promise.
    Let me ask you this: In this town I see an entire cottage 
industry of specialized management consultants springing up as 
governmentwide implementation gets closer and closer. To what 
extent are agencies having to turn to outside resources or 
consultants to help them identify meaningful performance goals 
and measures, and develop their strategic plans or otherwise 
work to comply with the Results Act?
    Mr. Koskinen. I don't know if there is an easy way to get 
at that. The statute makes it clear that the mission of an 
agency is not to be designed by consultants, so they are 
prohibited from using outsiders to tell them what their 
missions are. Those have to be generated internally.
    Clearly, a number of them have made effective use of 
outside advisors about the strategic planning process. They 
have gone on the private sector experiences and they are using 
that. But again, one of our concerns, as I have testified in 
the past, has been to make sure that the agencies don't create 
what I call ``GPRA bureaucracies.'' That is, we have somebody 
off on the side producing whatever we and you want them to 
produce in the form of paper, but it doesn't relate to the day-
in and day-out management and operation of the agency.
    So one of our tests of the agency in a strategic planning 
process is: Who is involved in the process? Who is actually 
leading it? What are the uses of outside people? How involved 
are the senior leadership of the agency in the development of 
the plan? And our goal is to ensure, as I say, that these 
become working documents; that, in fact, agencies manage 
against these; even if we don't allocate another dollar in 
resources one way or the other, that they actually manage 
against the information they get about how the programs are 
operating and the effectiveness of them.
    Mr. Davis of Virginia. Thank you very much. I think my time 
is about up.
    Mr. Horn. Thank you.
    We have with us this morning Mr. Radanovich of California, 
a member of the Budget Committee and without objection, I am 
glad to yield you 5 to 10 minutes.
    Mr. Radavonich. Thank you, Mr. Chairman. I am just 
basically here to listen. I appreciate being able to be sat on 
the dais and would just like to listen to the testimony. Thank 
you very much.
    Mr. Horn. That's humility beyond the call of any Member of 
this House.
    Mr. Koskinen. Could you come to a few more of my hearings?
    Mr. Horn. OK. Let me ask a few questions and then we will 
go in for the second round of questions.
    These are directed at all of you, so you can all mix it up 
on this. As we all know, the Department of Defense, the 
Internal Revenue Service, will not be able to give Congress a 
balance sheet that has been mandated by law for a number of 
years, when it comes due this fall. Both have had severe fiscal 
management problems. And I guess my curiosity is this: With 
those two agencies being sort of basket cases at the civilian 
level, and defense with 49 separate accounting systems, IRS 
with a complete lack of management for years, why were not 
various other pilots put in those agencies to see if we can't 
learn something? Because these are the two of the three or four 
largest agencies in the Federal Government, and I believe the 
only one that was a pilot was Defense Logistics. But I just 
wonder what the thinking of OMB was and I wonder what the 
reaction of GAO is?
    Mr. Koskinen. Mr. Chairman, as you know, you and I go round 
and round about this. First, I would like to disagree that the 
two agencies in question are a basket case, and I would 
certainly disagree that there has been a complete lack of 
management at the IRS for a long time. IRS clearly has systems 
problems in tax systems modernization, but it is a leader in a 
number of ways in internal management. So I think it doesn't 
treat them well or fairly to say that they have had an absence 
of management. I would not say that they have not had an 
absence of problems, particularly in the information technology 
area, but I don't think we further the dialog that way.
    Let me now then say also that in the list of pilots, there 
were five other pilots at the Department of Defense, although 
Defense Logistics was one of the most successful, and the 
entire IRS volunteered to be a pilot program agency to take a 
look at what were appropriate measures, how they could measure 
them. And it showed, as I say, 3 years ago, 4 years ago when 
these pilots were designated, their interest. We didn't require 
them to do it. They volunteered and said they wanted to be a 
pilot, they wanted to see if they could begin to develop a 
better performance matrix, which, again, as I say is not quite 
consistent with an agency with no interest in these areas or a 
lack of management.
    Mr. Horn. What have we learned from what the IRS pilot at 
this point? What have you learned?
    Mr. Koskinen. What we have learned from the IRS--again, as 
Mr. Mihm said, it is a lot like GAO. They in some ways are 
closer to a private sector analogue because they have 
measurable outputs and they are focused on things like customer 
service. How long does it take you to get in contact with 
someone? How long does the response come?
    There are difficulties in fact, their abilities to improve 
their customer service have fed back into their development of 
systems. What we have been focusing with them on, and GAO has 
for some time and the Congress has, is that the fundamental 
problem with their systems approach was to try to solve all the 
problems that they knew that were out there all at once in what 
we call the ``big bang theory.'' And the private experience, as 
well as the Government experience, is anybody who tries to 
solve a problem in the IT area with a 5 to 8 year big bang, 
usually ends up with a big failure. But they have been 
increasingly focused on what are the appropriate and most 
important priorities in dealing with the public in terms of 
customer service? How can they get a handle on compliance 
statistics? One of the issues we have with them is, how do you 
collect information to determine what the compliance rate is? 
Do you have to, in fact, go through these systemic analyses of 
individual taxpayers from beginning to end?
    So I think that we did learn a lot there. They are focused 
on, in effect, how they can use performance information to 
better serve the public. But I would be happy to hear GAO's 
views as well.
    Mr. Stevens. Well, IRS, their major problem, Mr. Chairman, 
as I think you have hinted at, is they really don't know what 
the tax gap is and therefore what their goal should be for 
closing it and what annual progress they should be making 
toward it. I would agree with Mr. Koskinen in that they do have 
major customer service objectives. They phrase those in their 
strategic plan. I think one of the things we think is worth 
investigating there is the extent to which this gets down to 
the front line tax examiners and agents. And if IRS has a goal, 
as I think they have, of improving customer service to a world 
class level, if the front line examiner still finds that he is 
being--he or she is being judged on how many taxes get brought 
in, there is a disconnect there.
    So one of GPRA's real challenges is to spread that kind of 
consciousness throughout the organization and not just prepare 
a plan that says this is our goal, but have the working people 
unaware of it.
    Mr. Koskinen. And I might put a pitch in now for the 
Clinger-Cohen Act as it relates to this. One of the issues we 
have been trying to get the agencies to understand, and it is a 
fundamental principle of that act which this committee, again, 
was a strong supporter of, is that as you look at any 
acquisition, any procurement, the fundamental question you 
ought to be asking is, how will this help me in the achievement 
of my mission, of my goals and objectives? That it is not just 
a question of, well, this would be nice to have or it will make 
things run faster. What it really causes you to ask, we hope, 
is OK if I buy this system, if I make this improvement, if I 
make this acquisition, what does that have to do with the 
achievement of my goals and mission? How will that improve my 
agency performance?
    Too often we have looked at IT systems in terms of a major 
challenge of did they come in on time and at cost, which are 
important process performance measures. But we have ignored 
saying, but what did we get for it in the long run in terms of 
improved performance? And getting back to the IRS, one of the 
things that I think they are going to be able to do a much 
better job of, we have disaggregated their IT acquisitions, is 
tying the actual development of an individual IT system to an 
improved performance under one of their goals and one of their 
measures rather than simply in terms of processing.
    Mr. Horn. Since you brought up the IT system at IRS, which 
has gone to the $4 billion mark and apparently been a failure 
from all we read in the newspapers, what sort of management 
oversight does OMB provide here when that type of situation can 
occur?
    I might add, it was also $4 billion with the Federal 
Aviation Administration. Apparently, they can't find out 
anything until they hit the $4 billion mark, and I worry about 
that.
    Mr. Koskinen. And you have to. As we have explained, one of 
the reasons, we actually, with then Senator Cohen, worked very 
hard to develop the legislation that passed, because we were 
concerned as well as you as to what were the lessons we could 
learn. GAO had done a marvelous study of the private sector. 
They had isolated 10 of the best private sector companies in 
using IT. They could also. My own experience is there are a lot 
of companies in the private sector that have large scale 
failures in IT in their history and background as well.
    But what the GAO found, what our analysis of the agencies 
found, that there are a fundamental set of principles that 
agencies needed to understand. The first was that they needed 
to take a look at IT questions not as technical issues, but as 
management issues. They had to understand that the right and 
most important questions about an IT system were managerial, 
not about bits and bites. And therefore, we said they had to 
take a look at, when they were automating a process, why do we 
do the work at all? Couldn't we just stop doing this work 
rather than automating it? The question we wanted them to ask 
is, is there somebody else who does this better than we do, 
either in the private sector or some other agency, so we don't 
have to do it?
    The third thing was, before they even got to this, was, are 
we doing the work in the most efficient way of process? Have we 
changed the way we do the work so we can both buy off the 
shelf, if it is possible, but also get the best benefit from 
it?
    The next thing we learned, and the most fundamentally 
important thing was, you had to buy in modules. The best 
private sector companies designed systems that produced 
deliverables in 12 to 18 months. If it couldn't be a 
freestanding, operating result at the end of 12 to 18 months, 
they didn't go forward.
    The FAA, the tax systems modernization, a number of other 
large Federal systems, as I say, were at the other end of the 
spectrum. Their judgment was, we will design a system and in 
over 6 to 8 years, we will solve all of our problems. We will 
push the button at the end of the 8 years and, magically, we 
will have a new system. Nobody in the private sector has been 
able to make that work either.
    Mr. Horn. But we learned that from the FAA and we knew it 
in 1993 and 1994. I was then on the Aviation Subcommittee of 
what was Transportation and Public Works Committee. If we have 
learned that in Congress and we could walk in and know 
something was screwy the minute we put our heads through the 
door when we went out to see the operation, there was no 
management. It seems to me the institutional memory of the 
President, namely OMB, and its management section in 
particular, should have said, hey, GAO has written on this. FAA 
has been a failure. We knew why. Why did we let IRS get out of 
control to do exactly what FAA did?
    Mr. Koskinen. Well, IRS was up and running at that time. In 
fact, in 1994 we did sit down with--we started this process in 
the fall of 1994 reviewing what were the statutory framework--
what was the statutory framework and the requirements that 
caused us to, in fact, keep reinventing the wheel? Ultimately, 
what we did was blow up the Brooks Act with IMTRA. It was not 
only an administrative process that was driving us. We had a 
statutory system that was a great system in the 1960's and 
1970's, but didn't reflect, again, the changes in time which 
contemplated that we could put all the expertise in one area, 
GSA; have all systems approved by GSA, or through delegated 
procurement authority, and then the budget process would 
operate as a secondary issue.
    What the act says now is each agency is individually 
responsible and the head of the agency is responsible for its 
systems. There is only one level of approval, and it is in the 
budget process. And we now have what we call the ``Raines 
Rules'' we have distributed far and wide saying we are going to 
judge your systems by whether they meet these eight criteria. 
And as the Director has said recently, we are on the hunt for a 
large system out there and we are going to try to kill them 
all, to the extent that we can.
    Mr. Horn. I can appreciate that, but I just still don't 
understand it, where the institutional memory is that we should 
have learned from these experiences?
    Mr. Koskinen. Well, I am not sure, as you say, that there 
was much institutional agreement about what this was about 
before 1993 or 1994. As I say, if you went to the private 
sector, I could show you, today, systems that don't work.
    The last study I saw, in the last year or two, showed that 
over half of all private sector systems come in over budget and 
underperforming. And that's in the private sector.
    Mr. Horn. Well, if it is only half, right now can we make 
that statement that we are at the halfway mark; that only half 
of ours are going bad just like the private sector?
    Mr. Koskinen. Oh, I think we have a large number of systems 
and a large amount of money that's being well spent now. And we 
are, in fact, unwinding and coming to grips with the remaining 
two or three major targets of opportunity, I would call them.
    Mr. Horn. I think with Congress mandating chief information 
officers, that's a help. We have got somebody that knows 
something about technology presumably reporting to the two 
principal operating officers of the Cabinet department.
    Mr. Koskinen. Yes, although, again, that comes out of the 
act. And I would stress one thing because I don't want to go 
the wrong way with that, and that is the CIO is important not 
because they understand technology, but the CIO is important 
and we are selecting them because they understand the process 
by which technology decisions ought to be made.
    Mr. Horn. Well, I think we assume that.
    We are going to have a hearing next week on total quality 
management in the executive branch, various types of programs. 
What role did total quality management play, if any, in the 
pilots that were developed to look and move us toward results-
oriented Government?
    Mr. Koskinen. Well, total quality management is a useful 
concept. It is, in fact, one of those issues a little like 
management by exceptions, or zero-based budgeting. It, in 
effect, is an attempt to try to pull together a concept of 
saying we need to get front line workers understanding and 
dealing with headquarters about the fact that we ought to be 
doing--everything we ought to do ought to have quality, it all 
ought to relate to the mission and the operation of what we are 
trying to achieve. There are various permutations on it.
    The Japanese quality circles that Deming trained the 
Japanese on in the forties or fifties is a kind of a total 
quality management issue. In effect, as I say, GPRA is focused 
on that. It is saying, we ought to be involved with basic 
issues about the operation of an agency. We ought to be looking 
at what it is trying to accomplish. We ought to know what its 
effectiveness is. And ultimately, if we do that, we will, in 
fact, end up with total quality performance if you want.
    There is nothing magic in the words. As we noted, we are, 
in fact, in the pilots and across the board, looking at things 
like customer service. We are looking at things like empowering 
front line workers. There is a lot of these concepts out there. 
The ultimate goal is to--in fact, as GAO was saying earlier, to 
make sure that all of these concepts get out of the concept 
stage and get into the operational stage and not just at 
headquarters, not just among all of us in Washington.
    The real question is: Do we have improved customer service? 
Do we have improved performance out in the front lines, in the 
fields where people come into contact with Federal agencies?
    Mr. Horn. When we looked at the Oregon situation, which is 
probably the best example in the United States of an effective 
results-oriented government, they had met with their 
constituency and their citizens. To what degree do all of these 
pilots relate to a constituency that was not simply the 
bureaucratic constituency, important as that is?
    In other words, was there constituent work? A lot of these 
agencies have advisory committees. That might be one, to 
involve them although often they are captives of the agency or 
in similar fields as opposed to the average citizen. Did we do 
any average citizen relating in these pilots?
    Mr. Koskinen. Yes. The pilots that focused on customer 
service and their service delivery to the citizens, a number of 
them, in fact, have surveyed--either surveyed their citizens 
before that--a number of them do surveys as a regular matter--
in terms of customer satisfaction. We now have over 2,000 
customer service standards across the agencies that we have put 
in place in the last 3 or 4 years.
    I can't take you through the 70 pilots and say which of 
them----
    Mr. Horn. Those were used, you are saying, in some of the 
pilots?
    Mr. Koskinen. Right, and some of the pilots were focused 
on----
    Mr. Horn. You might want to file it for the record. I don't 
want to belabor this. I am just curious to the degree to which 
real people were contacted as part of this results goal 
setting.
    Mr. Koskinen. Good.
    Mr. Horn. So let's just file it at this point in the 
record.
    Mr. Mihm. Mr. Horn, may I add something on that?
    Mr. Horn. Yes.
    Mr. Mihm. In our reviews, I would say it was very uneven. 
In some cases agencies, as Mr. Koskinen mentioned, had customer 
service standards or, as a result of the National Performance 
Review, had a pretty aggressive effort underway to survey the 
results of their customers. In other cases, though, it has been 
somewhat disappointing. The agencies seem to be under the 
impression that the requirement in the Results Act that they 
solicit the views of other interested parties can be satisfied 
just by a notice in the Federal Register, ``Hey, by the way, we 
are issuing a strategic plan, if you have any comments, get 
back to us in 30 days,'' type of approach.
    We have been working with the House teams that have been 
formed or through the House teams trying to encourage the 
agencies that the Results Act is about a different form of 
interaction between not only agencies and Congress, but 
agencies and the American people, and that type of approach to 
soliciting views isn't going to be successful.
    The second thing that we have found where it has been quite 
inconsistent is actually embedding routinely customer views and 
stakeholder views into the daily operations of agencies. So 
even those that have been fairly good, and there are quite a 
few that have been fairly good in going out and asking 
customers about what do you want. However, there still needs, 
in many cases, to be the next step to actually embed those 
views into the daily operations.
    Finally, the third thing that has to happen that we haven't 
seen happen in many cases, if at all, which would get them very 
close to what's being done over in the United Kingdom, is 
actually assign consequences to the failure to meet a customer 
service standard. In the United Kingdom, if the mail doesn't 
get there on time you get a subsidy on first class mail. If the 
train doesn't run on time, you get part of the rebate of your 
train ticket.
    We don't do that routinely in the United States and say if 
we don't meet a customer service standard, a published 
standard, something is going to happen that we are trying to 
make the citizen whole. So there is plenty of room that 
agencies can move on to improve on their focus on customers.
    Mr. Horn. Well, I appreciate that response. You are 
absolutely correct.
    I now am delighted to yield to the gentleman from Illinois, 
Mr. Davis, for 10 minutes.
    Mr. Davis of Illinois. Thank you very much, Mr. Chairman.
    Mr. Stevens, OMB was required by statute to make 
recommendations on changes to the GPRA and I would like to hear 
what the GAO would have to say about that. So based upon your 
monitoring, are there any areas that you think we ought to be 
considering some change in?
    Mr. Stevens. No, Mr. Davis, we don't. I don't think we 
disagree with OMB here. The act still has a long way--it is a 
work in progress and has a long way to go until it is fully 
implemented. We didn't come across any killing defects in the 
law, either in concept or implementation. And in our view, we 
should continue implementing what we have rather than think 
about changes at this point.
    Mr. Davis of Illinois. One of the goals of the GPRA is to 
help Federal agencies address fragmentation and overlap in 
their programs. Could you comment on how well you think this is 
taking place?
    Mr. Stevens. Mr. Mihm can probably say more than I can on 
it, but I would note that there is certainly a congressional 
role in this, too. An individual agency has a very difficult 
time, I think, comparing itself to other agencies. There is a 
role for OMB in doing this, because they cross many functions. 
I think there is a role for Congress, also, in making these 
comparisons.
    Not much has been done yet. The last strategic plans that I 
have seen do spell out what an agency does. They don't spell 
out that other agencies do very much the same thing and what 
the coordinated relationships between them are.
    Would you like to add on that?
    Mr. Mihm. Just to add on that, as you know, Mr. Davis, our 
work has shown in program area after program area, there is 
overlap and duplication. We have talked already about the 
problems in economic development programs. Mr. Stevens, in his 
prepared statement, talked about education programs, employment 
training programs. There appears to be at the Federal level, 
which is replete with it, overlap and duplication.
    What the Results Act allows Congress to do, if you put a 
consistent focus on it and require it from the agencies, is to 
over time compare goals across agencies to see if we have the 
consistency in goals and thereby attempt to identify some of 
this overlap.
    Mr. Koskinen mentioned in his statement about the Office of 
National Drug Control Policy. That shows an example of an 
organization of a statutory basis for trying to pull together 
overlap. It has been there a number of years and has made in 
recent years some substantial progress, issued the President's 
drug control strategic plan and is now working on performance 
measures, which shows how long and how difficult this can be to 
identify and address this overlap even when you have a 
statutory mechanism in place. And for many of these program 
areas we don't have that statutory mechanism in place, so it is 
really going to require the Congress--and the House teams that 
have been formed on the consultations are focusing on this an 
awful lot--to really go after the agencies and ask about who 
they are coordinating with in other agencies, how they are 
ensuring that their goals are consistent with the goals of 
other agencies.
    Mr. Davis of Illinois. Do you think that some of this 
overlap, though, is in reality necessary and essential? I mean, 
can we refine the activity in such a way that we take out--I 
mean, can an agency actually fulfill its mission without 
getting into some of the activity in which another agency would 
in all probability be involved?
    Mr. Stevens. I think the Results Act provides the process 
for making decisions like that. Right now, we are assuming that 
is the case because nobody is really examining these cross-
agency relationships. I am not saying a case can't be made. It 
is just--that in very few cases it has been.
    Mr. Koskinen. Let me chime in, if I might, on that. If you 
take the ONDCP, I think it is a great example of the point you 
are getting to. I think of what the experience ONDCP 
establishes is that you have got as many as 50 agencies 
involved in some form of drug policy, either education or 
eradication enforcement. And the argument isn't as a result of 
that that, well, what we ought to do is put all of those in one 
place. It wouldn't take what the Defense Department is doing 
and HHS is doing and the Treasury is doing and necessarily say 
they ought to be in one place.
    What you would say is that they ought to be coordinating, 
they ought to be collaborating, they ought to be, in fact, 
working together toward a common set of goals. But I think you 
are absolutely right, their effectiveness is, in fact, because 
they are tied to programs in HHS, in Education, in the Defense 
Department, and those are integrated.
    So in some ways, I think Mr. Stevens is right. One of the 
things the statute will do is begin to cause us to, in fact, 
more effectively look at the way agencies are cooperating and 
working together toward a common set of goals, while 
recognizing that those goals are best achieved where the 
programs are. Not in all cases. There are some cases where we 
ought to be consolidating.
    Secretary Reich tried, as everybody recalls, to in fact 
consolidate a lot of training programs to in fact create a more 
efficient training program, and then we ran into a lot of 
congressional difficulties.
    But I think those issues are the ones that will be very 
important for us. I have told the agencies, as we go forward, 
one of the major challenges will be in this area. That is, to 
make sure that we are effectively coordinating, communicating, 
and working together across agency lines where it is 
appropriate for programs to be lodged where they are, but it is 
important for them to be working in concert with other agencies 
who are engaged in the same activities.
    Mr. Davis of Illinois. And finally, Mr. Chairman, and 
either one or all, as we continue to refine our systems, really 
analyze what we are doing, look at it as well as we possibly 
can, really understand the capacity that we have to produce in 
certain instances, do we have any outside targets in terms of 
what increased efficiencies and effectiveness we might think is 
out there? I am saying like an athlete might say, if I train 20 
more hours a week, if I shoot another 100 jump shots, maybe I 
will increase my effectiveness by four more points a game, or 
whatever.
    Mr. Stevens. In results-oriented management, Mr. Davis, I 
believe there are some countries that are certainly way ahead 
of the United States and that provide an exemplary benchmark of 
experience that has worked over a long period of time, in which 
major changes have been made and which it has become, I 
believe, even a political benefit. Those include Great Britain, 
Australia, New Zealand, Canada to some extent, Sweden to some 
extent. Within particular program measures, which I think is 
also incorporated within your question, yes, there are outside 
standards that can be used.
    A very good example of this is the Social Security 
Administration. We singled them out for favorable comment 
because of their experience in improving their 800 number for 
answering the telephone requests for information they get. And, 
in fact, they have improved it so much that they have been 
recognized along--in the same scale as some very good mail 
order operations like L.L. Bean for having done extremely well 
in terms of responsiveness and customer satisfaction to them.
    So, yes, and I think using that outside measure has been 
therapeutic to them and also instructive as to what an agency 
can do if the motivations and rewards are there.
    Mr. Koskinen. As a general matter, I think that our goal 
is, in fact, to be the best in class, to benchmark against who 
can do this--who does this the best around and we should do as 
well?
    As the Vice President has said on numerous occasions, if we 
are really good at this, ``good enough for government work'' 
will be a standard of the highest performance, not a way of 
dismissing a standard. And that is where we really ought to be 
going--across the board. I think this statute is a great 
vehicle and catalyst for us to get there.
    Mr. Davis of Illinois. Thank you very much. I have no 
further questions, Mr. Chairman.
    Mr. Horn. I thank the gentleman. I now yield 10 minutes to 
the gentleman from Texas, Mr. Sessions.
    Mr. Sessions. Thank you.
    Mr. Koskinen, have you had an opportunity to see this?
    Mr. Koskinen. Well, my glasses are off so I don't know what 
that is.
    Mr. Sessions. It is that same book just to the left.
    Mr. Koskinen. It is this. Yes.
    Mr. Sessions. Have you had an opportunity to see that at 
all?
    Mr. Koskinen. I have scanned it.
    Mr. Sessions. Well, I must confess, you are ahead of me. I 
have been trying to go through this.
    Without opening it up, I would like to just ask you a 
question. We are sitting here talking about the application of 
GPRA and all of these things and the plans, and we are 
hopefully going to have them go down to the lowest level of 
manager and worker within the Government to where they feel 
like that not only do they comply with the mission statement, 
but that what they are doing is of great benefit. And we have, 
I think, generally said that we think this will help improve 
not only the performance, but the measurements and the 
effectiveness of an agency.
    How well do you think or to what extent do you think that 
the Federal managers would respond if they said that this work 
that they are doing has had an impact on their agency up to 
now?
    Mr. Koskinen. Before I came to the Government, I spent 20 
years managing large-scale failures in the private sector, 
where you would have thought people would have been--and they 
were--in great shock, large enterprises like the Penn Central 
or Mutual Benefit Life Insurance had failed. Our experience in 
those most difficult circumstances were that when people felt 
that they were part of the solution, not part of the problem, 
where they understood your point, that what--how what they were 
doing related to the ultimate mission and success of the 
enterprise, they responded with great enthusiasm and worked a 
lot harder and longer than you could have asked them or made 
them work.
    My experience in the 3 years I have been in the Government 
is that Federal employees are at least as motivated as those in 
the private sector. People came to the Government because they 
were committed and dedicated to the mission and roles of their 
agencies. And that if we can accomplish just the paradigm that 
you describe, I think we will find a tremendous increase in the 
level of enthusiasm and morale, as well as productivity and 
effectiveness of our work force.
    But it is a great challenge because we have to, in fact, 
beyond everything else we are doing, change our concept of 
management. We have to catch up with the private sector. We 
have to understand that top down hierarchical control no longer 
works, whether it ever did in the past.
    As I have said in the past, General Motors went from 13,000 
people at headquarters to 1,300 not just to reduce costs, but 
as a way of, in fact, eliminating unnecessary layers between 
the people actually doing the work and the people running the 
companies.
    We need to reach out more to our employees, not just to 
energize them, but ultimately to recognize that they really 
know what is going on in our organizations. They know what the 
obstacles are. They know what unnecessary rules and regulations 
there are that interfere with their ability to perform with 
their job. So they have the information we need if we are going 
to continue to adjust and improve our performance.
    I think your question is exactly right. They represent a 
great resource for us, and I think that they would respond 
enthusiastically and effectively.
    Mr. Sessions. Do you perceive that up to now that this has 
been an exercise by headquarters in each of these agencies or 
that it has gone down within--permeated the agency to where 
some of those regional managers have gotten involved in this 
process?
    Mr. Koskinen. Like the answer to all of these general 
questions, I have decided all of life is a bell-shaped curve. 
You have some agencies that have reached out and actually 
brought in regional managers, tried to bring in front-line 
employees. We have encouraged that.
    There are clearly no other agencies, very large agencies, 
where they have, in fact, done it more than headquarters. As I 
noted, my concern is that we not in this process create the 
expertise in a small few people who are the GPRA experts; that 
we need to have these be operating documents. So we continue to 
push the agencies to understand that, ultimately, they can 
manage effectively only if they have support at the top, but if 
they involve people on the front lines at the same time.
    We won't succeed without leadership from the top of the 
agencies, but we will not be successful if we do not involve 
and energize people at the very bottom of the agencies at the 
same time. That is basically the kind of Zen conundrum that 
challenges people trying to make management change, and we need 
to work both ends. I think at this stage it is the minority of 
agencies that have done that, but we are continuing to 
encourage them, and I hope over time more of them will do that.
    Mr. Mihm. Mr. Sessions, we have some data that can speak 
directly to that.
    Mr. Sessions. Absolutely, and I am going to get to that.
    Mr. Mihm. OK. I am sorry.
    Mr. Sessions. I will get to that in just a minute.
    I want to pat you on the back. I think what you said is not 
only exactly correct about people wanting to have and be a part 
of the process and have a process and make their jobs better. 
But several months ago I was down in Dallas visiting an FAA 
installation, and if you are in Washington for even small 
periods of time, you have heard about the FAA and their 
management structure and some of the decisions that they make 
and perhaps they are one of the most, I will be careful here 
without picking on any of the management, perhaps their 
decisionmaking process and the things that they buy are not 
leading edge.
    That is trying to be very polite, Mr. Chairman. But when 
you go down to Dallas, TX, and you talk with a front-line 
manager, they are completely--the two I talked with were 
unaware that there was even a problem; that someone even made 
an accusation that their agency was not in complete compliance 
and that they weren't leading edge. In other words, it was kind 
of like they didn't even know about the disagreement.
    And I, as I look on page 87, I would like to draw your 
attention to--and you answered what would be on page 88, I 
believe. But page 87, is the distribution of Federal managers 
expressing an opinion on the extent to which implementing GPRA 
to date had improved their agencies' programs. And that is why 
I asked are these lower level, where the rubber meets the road, 
are those people involved in GPRA to where they feel like they 
are being asked and being heard from? Because if you look, it 
says--it looks like to me that about 1 percent, very great 
extent, and 9 percent, a great extent. So that is about 10 
percent.
    And then if you flip the page, you will find that it goes 
up, that they want to be involved and feel like if they were 
part of the process, it then goes to some 36 percent from 10 
percent. And so my--I don't know whether I take this to a 
conclusion, but I would like for you to hear me say I wonder 
how well it is being sold throughout all the way down to that 
bottom line person.
    Let me end with this: About a year ago, and I am not taking 
advantage of anybody who is from Chicago, Mr. Davis, at all, or 
from Illinois in any of this, there was a huge flood that came 
in the wintertime in Chicago. In fact, it was not a surprise to 
the people who had known about the problem. They simply did not 
want to spend $10,000 to fix the flood--the problem before the 
flood came and it cost over $1 billion.
    This is the kind of thing that we could tell the stories 
over and over about how lower level management people being in 
touch with whatever their job is and that should reflect not 
just from an agency's perspective of what they are about, but 
all the way down to their performance appraisal.
    So I hope that--not to take advantage of you or anyone 
else, but I hope that we see that this flips over with what 
they see the current standard can be and how it can impact 
them. Thank you.
    Mr. Horn. I thank the gentleman.
    Let me just pursue a number of questions here, and then 
I'll turn to Mr. Davis again.
    Was the Cabinet ever briefed on the results-oriented 
government effort? Did you have a chance or the Director of OMB 
have a chance to brief the Cabinet on it?
    Mr. Koskinen. Yes. Actually, in either January or February 
the director spent some time in the Cabinet briefing describing 
the act--we had a number of new Cabinet members at that time--
their responsibilities; the fact that, as we told them, there 
were a couple of things that they ought to be aware of. One is, 
these were agency plans that they were responsible for and 
that, at a minimum, they ought not to be embarrassed in the 
fall and have a plan out that they didn't understand or didn't 
know; and, even worse, they ought not to have a plan out there 
that they disagreed with that ultimately the people were going 
to expect that the Cabinet Secretaries understood and had been 
involved with the strategic plans that had been produced.
    We've spent a lot of time at the President's Management 
Council, which I chair, which is the deputy secretaries of the 
agencies and the chief operating officers, over the last 3 
years, talking about the challenges and opportunities in 
turning their organizations into performance-based 
organizations.
    Mr. Horn. On your early returns, as you look at the various 
pilots, do most of the problems that exist on not having 
perhaps as results-oriented a government as we would all like 
to have; to what extent is that related to the current 
personnel policies of the Federal Government?
    What I'm getting to is one category that comes to mind, and 
I don't know if there is any pilot that relates to it. It seems 
to me when people are given responsibility for millions, tens 
of millions, hundreds of millions, and billions of dollars in 
some agencies on procurement, that we ought to make sure those 
people are happy, they see a progression, and they get constant 
training on improved methods. What I'm thinking of is sort of a 
special class within the civil service that would reward 
procurement officers for this type of responsibility. I just 
wonder what you're getting out of the pilots that you've had a 
chance to go through that says we better do better by a lot of 
our public servants and procurement than we are doing?
    Mr. Koskinen. Well, I think you're exactly right. It 
applies across the board, obviously.
    Again, one of the great presentations we had at the 
President's Management Council about a year, year and a half 
ago, was from the interagency training leaders who said that 
their biggest challenge was making sure the people asked the 
strategic question: What were we training people for? Their 
concern was that people kept being sent to training, it was 
their training, but without an understanding of, again, how did 
that relate to improving their agency performance.
    But part of our problem with the personnel system isn't 
that we haven't held people accountable or isn't that we 
haven't, in fact, looked at their performance. The problem has 
been performance focused on process. We have been a compliance-
oriented system, for understandable reasons. Every time there 
has been a problem or failure, or something popped out up in 
procurement or other areas, we had a new rule that we would 
say, this is the way to do it, so that we have been a very 
process-oriented personnel system and have not necessarily been 
a results-oriented, other than the result of, don't violate any 
of these rules.
    So that we need to do exactly what you're talking about, 
and procurement, we've worked with it. Steve Kelman and the 
head of the Office of Procurement Policy are working on it. We 
look to look at training. We need to look at positive 
reinforcement in terms of performance appraisals and 
compensation, in terms of achieving the goals and objectives of 
the procurement system. But those goals and objectives also 
have to be more than complying with the rules. Everybody ought 
to comply with the rules. But the goals and objectives of the 
procurement system ought to be furthering the performance and 
effectiveness of the agency.
    Mr. Horn. In the pilots, the three approaches you had, you 
stressed performance, planning, and reporting in some pilots, 
managerial accountability and flexibility, and then performance 
budgeting.
    Now, the second pilot on managerial accountability and 
flexibility, I gather, really never got off the ground. And I 
guess what I would ask is, of both GAO and OMB, if we could go 
back to 1993, what sort of pilots and in what sequence would 
they occur to be most helpful in providing the experience and 
the lessons agencies would need to have had earlier in order to 
get more consistent success with the results-oriented 
government approach?
    Mr. Koskinen. I'm not sure, if we've done anything 
differently, we would get farther along than we are. I think we 
made good progress.
    I think had we known or the authors known when drafting the 
statute with regard to flexibility all that was going to happen 
in terms of procurement reform, personnel reform, and 
regulatory reform, we might have spent a little less time 
focusing on flexibility from administrative rules and we might 
have actually developed flexibility pilots that would have 
provided flexibility from statutory limitations, which I think 
was the biggest need the agencies felt they wanted to 
experiment with; that we had no authority under the statute to 
grant. So I think it might have been very helpful to have that 
pilot.
    As I noted in the past, our performance-based organization 
concepts, in effect, are flexibility pilots with flexibility 
from statutory requirements and limitations. I think we might 
also have early on had a few pilots, although we had 
experience, in the area of strategic planning. We produced case 
studies. There are 22 of them now on the Internet that we 
produced with the American Political Science Association of--
from agencies on strategic planning, performance planning, and 
performance measurement. We produced those case studies to give 
people object lessons on what actually did work or didn't work.
    We encouraged the agencies to include in those studies the 
problems they had, the failures they had, where they went 
wrong. And a couple of the best case studies had been about 
strategic planning, where the agencies talked about blind 
alleys they went down, the difficulty of pulling plans to go 
together. And I think, in my own view, we might have had a 
strategic planning pilot at the front end where we might have 
had a few more case studies to demonstrate the difficulty of 
this as we move forward.
    But I would be interested in the GAO response.
    Mr. Mihm. Well, one thing on the strategic planning, just 
to remind you, Mr. Chairman, under the performance plans, 
agencies were to have had a strategic plan in place for at 
least 1 of the 3 years that they were doing the performance 
plans; that would be either fiscal year 1994, 1995, or fiscal 
year 1996. So there was at least some effort there within--by 
the authors of the Results Act to have a strategic planning 
component, although that strategic plan didn't have to be GPRA 
compliant, meaning they didn't have to consult with the 
Congress.
    In terms of the managerial flexibilities, I think one of 
the--even though none of the pilots were chosen ultimately by 
OMB, we learned some very valuable lessons there, and that is, 
when we went to--when OMB went to the agencies asking them for 
waivers, what they came back with was a lot of statutory 
waivers or requests, as Mr. Koskinen mentioned. They also came 
back fundamentally with answers that agencies were finding that 
the--fundamentally, the constraints that confront agencies are 
of the agencies' own creation, it's not something that's based 
in regulation. It's not ultimately something that's often based 
in statute, although, as I mentioned, they did have some 
problems with those. But agencies have imposed requirements 
upon themselves.
    Mr. Sessions was asking earlier about the extent to which 
this has penetrated down to field locations. Some of the most 
interesting requests for waivers came in from field locations 
to their headquarters units.
    It was interesting being in those meetings where the 
headquarters units had to admit, well, gee, OMB wasn't doing 
that to you, we in headquarters are doing that to you. There 
was some agitation, to put it nicely, and, as a result of that, 
we've reported on one of those over at the Corps of Engineers 
that they made some substantial changes in the procurement area 
that were requirements that were imposed upon field locations 
because of requirements from headquarters.
    And it's not real clear to us that we would need to have--
in retrospect, that we should have changed the sequence of the 
pilot phase, because I think we learned some pretty good 
lessons all along.
    Mr. Horn. I'm sort of amused and completely agree with your 
comment, having been in State government for a long time, 
exactly the same problem, where agencies were blaming the 
control agencies in Sacramento, the equivalent of OMB in 
California being the Department of Finance, which is the 
Governor's management arm and budget arm. And the problem was 
within their own agency, and these things just crept up, and 
the people who were around that started 30 years ago aren't 
around anymore, and the newcomers take it as gospel out of the 
capitol. So I'm glad to see those things are rushing to the 
surface and we're dealing with them.
    You mentioned in your testimony on GAO five key challenges 
to successfully implementing the act. And there are many 
challenges to instilling a results oriented mind-set, let's 
face it. However, I would like to know what are the factors you 
think are the key to better goal setting, better measurement, 
better information, and the use of that information to make 
real improvements? When you look through all these different 
filings, does something stand out there that, if we could do 
nothing else, we ought to do that?
    And I'm sort of using an analogy when I've got an academic 
Senate to agree to the student evaluation of the faculty. You 
could ask 50 questions; you could ask 10 questions. It really 
boils down if you just asked one question.
    Mr. Stevens. Yes.
    Mr. Horn. The data return would be exactly the same.
    Mr. Stevens. My response to that, Mr. Chairman, would be 
something that is, in large part, under congressional control. 
That is, what will determine the success or failure of the 
Results Act is the extent to which the volumes of information 
that the act will require agencies to produce and the extent to 
which that information is actually used in decisions that 
matter to the agency--budget decisions, oversight decisions, 
and legislative decisions.
    The surest way to ensure that the act does not succeed will 
be for this information to be produced, to be available at some 
cost, great cost in some cases, and to find that the people 
making the real decisions affecting the agency, many of whom 
are right here, ignore it. Assuring that this really becomes 
the basis for decisionmaking is, to me, the sine qua non for 
success of the act.
    Mr. Horn. I now yield 10 minutes to the gentleman from 
Illinois, Mr. Davis.
    Mr. Davis of Illinois. Thank you very much, Mr. Chairman.
    Mr. Koskinen, the chairman touched upon the Defense 
Department in an earlier sequence, and we know that it 
represents almost half of the discretionary spending. DOD has 
stated that its Quadrennial Defense Review, the QDR, will be 
used to satisfy the requirements of GPRA's strategic plan. And 
even though the QDR does not seem to contain all of the 
elements required of the GPRA strategic plan, do we know if DOD 
will submit a GPRA-compliant strategic plan by this deadline of 
September 30th?
    Mr. Koskinen. It's our expectation that they will. The QDR 
just came out in the last couple weeks. We are reviewing that 
with the Department in the face of this question, which we have 
as well, which is, does the QDR meet the requirements of the 
act?
    The Department's view, appropriately, is the QDR is based 
on a statement of the mission of where we're going with our 
armed forces, what the challenges are over the next several 
years, a set of goals and objectives, performance measures, and 
strategies. So that a substantial volume of the information 
that one would expect one would have from an agency in terms of 
its strategic plan for the next several years is contained in 
that.
    The real question over that we're all looking at is, does 
it portray that in a way that provides measures against which a 
performance, annual performance plan, can be held accountable? 
Does it describe some of the issues that the act requires to be 
described in a way that are appropriate?
    I think the bottom line is that, to the extent that 
additional information is needed, it should be easily provided, 
I think, because the QDR does provide the most difficult parts 
of the strategic plan, which is the statement mission, the 
goals, the objectives of the Department and the external forces 
that the Department faces over the next several years. But the 
bottom line is that we are focused within the Department that 
ensuring that in September they produce an acceptable strategic 
plan.
    Mr. Davis of Illinois. And they have not indicated that 
there might be any unusual difficulty or circumstances or 
that----
    Mr. Koskinen. No. Actually, the Department at large has 
done over the years probably as good a job as by far most of 
the agencies in terms of looking at longer-term strategic and 
planning objectives. When they have a 4- to 5-year budget 
horizon, those aren't just spreadsheets, they actually have 
meaning and policy behind them. So that there is a fairly good 
history of development of performance measures, and in a 
budgetary sense as well as in a programmatic sense. So I think 
that to the extent that decisions need to be made to the QDR to 
provide a full-fledged strategic plan, that should not be the 
problem.
    Mr. Mihm. Mr. Davis, the challenge all agencies are facing, 
but particularly pointed at DOD, is being able to draw a 
linkage between the broad strategic goals or statements that 
may be in the QDR or will be in a strategic plan and the daily 
operations that are taking place throughout the Department. 
This is something Mr. Koskinen mentioned was a crosscutting 
issue that OMB had with most agencies' strategic planning 
efforts. It's going particularly a challenge within DOD.
    We've done some work recently and wrote to the Secretary of 
Defense on this, identifying problems and linking logistic 
strategic plans to the overall logistic plan for the 
Department, information technology at various component levels 
to information technology strategy for the whole Department, 
and, in fact, when we went and spoke with the key GPRA 
officials in various defense components, this was one of their 
real concerns. It wasn't real clear to them what the Results 
Act would mean to them down at a component level or within the 
military service or defense agencies.
    Again, getting back to Mr. Sessions' point of making sure 
that the strategic decisions that are being made at a 
departmental level and in consultation with the Congress really 
mean something in terms of the wheels turning back within an 
organization is something that DOD and other organizations will 
be challenged by.
    Mr. Davis of Illinois. OK. The GPRA requires agencies also 
to consult with their stakeholders as the strategic plan is 
being developed. Who does DOD consider to be its stakeholders, 
and how are they going about consulting with them?
    Mr. Koskinen. That's a good question. They obviously have a 
major consultation process that inevitably will occur around 
the QDR with the Congress as they go forward. Many of the 
agencies are consulting with each other. As we discussed 
earlier, they in effect provide services to or receive services 
from or work, hopefully collaboratively, with agencies in a 
range of areas. So we've been encouraging agencies to in fact 
share their plans as appropriately across the lines. And I 
think the Defense obviously provides a range of services in 
other areas as it goes forward.
    The more difficult question to analyze, and I don't have 
the answer off the top of my head, is who outside the 
Government are stakeholders for the defense strategic plan, who 
should they be discussing their plan with. And that really in a 
lot of ways rises to the level of international policy and 
treaty and the relationships we have with security 
organizations and treaty operations around the world. And I'm 
not sure anybody has really dealt with yet whether, and to what 
extent, those are stakeholders that should be consulted.
    Mr. Davis of Illinois. So in all probability I guess we 
could say that they're still being defined.
    Mr. Koskinen. I think that's a very felicitous way to 
phrase it.
    Mr. Davis of Illinois. That as we keep looking, I mean we 
keep finding and we keep finding out, I would assume.
    Mr. Koskinen. Yes.
    Mr. Davis of Illinois. My final question, Mr. Chairman: 
GPRA attempts to force the Government to focus on results and 
may require significant congressional oversight if it's to be 
effective. Do we think that implementation of the GPRA process 
in Congress may strengthen the case of those who advocate a 2-
year budget cycle, focusing 1 year on appropriations and 
oversight on the next?
    Mr. Koskinen. And your question is, would that be helpful?
    Mr. Davis of Illinois. [Indicating in the affirmative.]
    Mr. Koskinen. I think it's always hard to know for sure 
what will happen when you make process changes. But I think to 
the extent that our recent experience anyway over the last 
several years is that most of the time has been spent on inputs 
or the budget process, how many--where are the resources going 
to be allocated, as I say, in the last 3 or 4 years it's sort 
of been an endless process which has left less time for 
oversight.
    I think to that extent we would have, I think, perhaps the 
opportunity in the budget process to focus on results and in 
the off year, as it were, to spend time looking at internal 
structural and organizational issues.
    We've provided to those supporting the biannual budget the 
necessary technical adjustments to GPRA to make it consistent 
with that, and, as a general matter, we've supported the 
biannual budget process for the reasons you suggest, which is, 
we think we would end up with a more constructive dialog about 
a wider range of issues.
    Mr. Davis of Illinois. Is there an increase in multiyear 
budgeting, I mean across the board, I don't mean the Government 
but outside government?
    Mr. Koskinen. I think most organizations that I'm familiar 
with still budget on an annual basis. The best organizations 
run against a longer-term plan, business plan, strategic plan 
that has generally no longer than a 5-year horizon where people 
understand the real effective timeframe is probably 3 years, 
and done well. And we've been through a number of organizations 
that have never done it before; done well.
    The way people view it is, the budget is the first year of 
the next plan, and the plan becomes a rolling plan that gets 
redone every 3 or 4 years in total, but you continue to measure 
against those objectives as you go forward, which means that 
each year you do not de novo start with the budget process 
again.
    To some extent, the congressional budget process seems to 
have elements on occasion as if we didn't know anything from 
last year and we're going to start this year with the same 
arguments and same debates.
    So one of the hopes would be out of GPRA and strategic 
planning in the 5-year budget agreement to get to balance in 
2002--is that we would have more of an idea and a shared 
expectation as to where we're going to be, and we can measure 
ourselves and debate within those frameworks rather than sort 
of starting de novo each year and saying, ``OK, this is a new 
year, a new budget, let's start all over again.'' Most 
companies don't do it that way.
    Mr. Davis of Illinois. Thank you very much.
    I have no other questions, Mr. Chairman. I've always 
wondered what would happen if we were to collect our money 
first and then spend it as opposed to spending it and then 
collecting it.
    Mr. Horn. You mean we might keep some?
    Let me ask both of you this question. We've talked about 
the agencies, and the ones that have adequate data bases where 
they can use some of that data in the performance sense of the 
word. And we've talked about accounting systems. I mentioned 
the 49 different ones in the Pentagon. We didn't get into the 
hundreds of different computer systems that can't relate to 
each other and need some linkage to do that.
    And I guess that I've learned this is usually the agency 
Inspector General is sort of an invaluable source to find out 
if there's adequacy to an agency's data base and its various 
systems. And I guess I would ask both the executive and the 
GAO, in your opinion, is that a proper role for Inspectors 
General to play? And to what degree have we involved the 
Inspectors General in this process? Is it strictly a matter of 
agency judgment, or are we getting the benefit of their 
somewhat objective view as they look at the agency and its 
weaknesses and its strengths?
    Mr. Koskinen. One of the large number of speaker agency 
groups I chair is the two groups--or are the two groups that 
composed of the--or comprised of the Inspectors General from 
across the Government. And over the last 2, 2\1/2\ years, we 
have spent a significant amount of time discussing GPRA and the 
appropriate role of the Inspectors General to it. And their 
consensus is that they do have an important role to play 
defined really as you describe it. They view that their role 
has focused on the integrity of the data collection process, 
whether systems are appropriate for delivering it.
    They are careful to note that they do not have the 
resources and don't think it's appropriate to even consider 
having them. That they will be--are not going to be auditing 
every piece of performance information since there will be a 
substantial amount of volume, but, on the other hand, they 
think it is appropriate for them to provide the agencies and 
the Congress and us, their view in terms of the adequacy of the 
data collection process, the integrity of the data as it's 
provided over time.
    They also have decided and noted that they do not think it 
is their role to define for the agency performance measures. 
They think that's an appropriate political judgment for the 
Congress and the agencies to, in fact, discuss in terms of 
mission goals and objectives. Those are set legislatively as 
they go forward. But as a result, I expect that across the 
Government, the Inspectors General are prepared to play a role 
in ensuring that the performance information itself is valid, 
has been collected in an appropriate way, and in fact is being 
accurately presented.
    Mr. Horn. Would GAO like to----
    Mr. Stevens. I think that corresponds with our view of the 
Inspector General's approach to the Results Act, too.
    Mr. Horn. It's been mentioned several times by many members 
that were into the bit of consultation at this point between 
some of the agencies and some of the appropriate congressional 
committees. Is it your reading that we will be able to do this 
in a timely manner, according to the act? Or are we going to 
have dropoffs off the wagon as consultation goes on? What's it 
look like?
    Mr. Koskinen. No, I think we're making good progress. I 
think, in 80 percent of the cases, there's meaningful and 
constructive dialog going on. I think we will be able to 
identify, with the Hill, the agency or two that may be having 
difficulty and work jointly to ensure that the consultation 
process has meaning.
    As I've noted in several cases in the past, we at OMB feel 
very strongly that the consultation process is an important 
part of the act, and we are anxious to make sure that it gets 
done on an agency-by-agency basis. And I am confident that, 
with our joint efforts, everyone will participate in that 
process.
    Mr. Horn. In other words, you're saying with the majority 
leader having a major role, at least in-house consultation, 
there shouldn't be a problem in getting the executive agency in 
touch with the appropriate committees?
    Mr. Koskinen. That's correct.
    Mr. Horn. And you on your side will certainly be sure that 
the executive agency is prepared to consult and has most of 
their ducks in a row before they come up here?
    Mr. Koskinen. Yes.
    Mr. Horn. OK. So we don't have to worry about that one.
    I guess what I'd ask is a very broad question. We go 
through these phases of management reform in the private 
sector, we go through them in graduate schools of public 
administration and business, and we go through them in 
Government. And I guess I'd ask you, John, what do you expect 
from a strategic plan? What's strategic about it, in your 
judgment?
    Mr. Koskinen. Well, again, just to sort of repeat where 
I've been earlier, I think a strategic plan, and probably the 
important thing about a strategic plan is a process by which 
you get it, that if you can involve the agency leadership, if 
you can involve frontline workers, if you can involve the 
Congress, and ultimately if you can involve the public over 
time in a discussion about the roles, goals, and missions of an 
agency and its objectives. How is it going to hold itself 
accountable, what are its goals, what is its performance, that 
you will create, in effect, a management document.
    And I think Mr. Stevens is exactly right. We need this 
report and the active involvement in the Congress to justify 
the time and effort the agencies are putting into this in terms 
of the dialog. Although I have been pushing to the agencies 
that the information they're collecting is important, if it's 
done correctly and if it's in the context of goals and missions 
and objectives, and that they ought to be doing that even if 
nobody on the outside asked about it, because it's important 
for them to be able to manage more effectively.
    As I said at the start of my testimony, our resources are 
clearly going to be constrained over the next several years. 
Therefore, the only way we're going to expand the effectiveness 
of programs and of Government is, in fact, to be more 
productive in the way we do our work. The only way to do that 
is to get information back on a regular basis about what impact 
we're having, how effective are the programs, what can we do to 
increase that effectiveness, and, at least half the time, what 
we can do to increase the effectiveness is not spend more 
money?
    What we can do to increase the effectiveness is to change 
the way we manage, but we won't know that and we won't know the 
implications of that if we're not collecting performance 
information in the context of an overall strategic plan.
    Mr. Horn. Does GAO have a comment?
    Mr. Stevens. I would respond, Mr. Chairman, that there was 
a hearing not long ago in which Mr. Armey, the majority leader, 
sat in this very chair, I believe, and provided what I believe 
was an answer to that question. He tied it to the opinion of 
the American people and pointed to the low confidence of 
Government and the perception that many people have, that they 
are not getting very much for the tax dollars they're sending 
to Washington.
    And I think the discipline of the Results Act will provide 
the knowledge of what that money is going for. It still may not 
be satisfactory information. It may lead to changes, but it's 
knowledge that we really just now do not have: What are we 
getting for that tax dollar?
    Mr. Horn. Well, it's an interesting comment, because many 
Members of both parties and all ideologies do a survey often of 
their constituency. It isn't a legitimate random sample or 
anything, it's just, you send out the newsletter and there's a 
coupon attached to where you are to make certain judgments, and 
we tote them up, and see what it does.
    It so happens I've also done legitimate random samples, and 
it's my universe that responds is exactly in accord with the 
legitimate random sample. And here's what they sort of feel, 
and other Members have confirmed this in their constituency: 
You ask them at what level is governmental money wasted, the 
Federal, the State, or the local? And it's amazing around the 
country that 50 percent of the Government's money is wasted at 
the Federal level; maybe 35, 30 percent is wasted at the State 
level; and maybe 15 percent or so or 10 percent is wasted at 
the local level.
    Now one obvious observation on that subject is, when 
they're close to the Government at home and they can go down to 
city hall and harangue the mayor and the council members or 
they can wake the councilmen up or the councilwoman up at 2 
a.m., and say, hey, the garbage truck hasn't come yet, it's a 
little hard to find Members of the Congress, it's a little hard 
to find the Cabinet officers, and at the local level you can 
find them.
    So I would think that when visible Government is there to 
listen, that we get a better reaction out of it. I don't know, 
you've looked at a lot of surveys, I'm sure, in the 
administration.
    Mr. Koskinen. Well, I think that's right. And it's not 
inconsistent with Mr. Stevens' point, which I support, which I 
would say would be a corollary to those numbers, which is that 
the closer you are to the delivery of the service and the 
Government providing it, the more you understand and oftentimes 
support that service. The farther away you are from the 
organization, the harder it is to bear in mind what it is that 
the organization is trying to achieve.
    So that, as Mr. Stevens said--and I was here with Mr. 
Armey--I think it is correct that one of the things we've 
gotten away from over the time is continually reminding and 
explaining to the American public where we do what we do, what 
are we trying to accomplish with each of these specific 
programs and activities, which is part of that explanation, so 
people will understand why we're spending this money. Because 
part of the assumption of waste that we've seen in those 
surveys is waste not because we're ineffective, but it's waste 
because it's a program that they don't particularly support or 
understand why it is that it runs.
    To the extent we can better articulate what our mission is 
and our goals and objectives, that will help. But the corollary 
is that to the extent we can also say that we're holding 
ourselves accountable for achieving a result, I think we will 
increase significantly the confidence in people that we're not 
wasting the money.
    The experience in Britain and other countries has been that 
rather than having people object to the inability of the 
Government to achieve its performance standard, there's been a 
tremendous outpouring of support for organizations that care 
enough to even point to a goal and are actually striving to 
meet it. I think what we need to do, and what this act will 
allow us to do in a lot of areas, is to explain to people not 
only what we're trying to accomplish, but to tell them that we 
actually have goals for what the results are and that we're 
actually going to every year try to get better at it. If we can 
convince people that we're legitimately and honestly trying to 
do that, I think the level of confidence in the Government and 
the level of support for it will increase.
    Mr. Horn. Could you describe the type of group you have on 
your staff that is imbued with results-oriented government, 
that is knowledgeable about the British, Australian, New 
Zealand, Canadian, and Oregon experiments. Where's the 
institutional memory in the executive branch that can go out 
and help a Cabinet officer understand how this works so he or 
she gets imbued with the spirit?
    Mr. Koskinen. Well, I spent 3 years, with the support of 
two different directors and the strong support of two different 
directors, in effect, trying to turn the entire organization of 
OMB into that organization.
    I think that the one thing to remember, as we all know, is 
the Government is a very large enterprise. When you have almost 
2 million employees, we need to have that expertise in more 
than a handful of people.
    We have over 500 people at OMB. We have a significant 
amount of our time spent looking at resource questions. And I 
think we've been very successful over the last 3 years training 
and engaging those people in a dialog about why a fundamental 
part of the resource question is, what do we get for those 
resources, so that the institutional memory, if we're 
successful, and we're working on it, will be that the entire 
organization will be results oriented. The entire organization 
will be in communication with the agencies about these matters.
    I've talked about the reviews we've done in 1995 and 1996 
and this year. Those reviews aren't being done by a handful of 
my people who aren't very knowledgeable; those reviews are 
being done by the agency, OMB. The dialog going on with the 
Cabinet Secretaries, budget officers, and managers are dialogs 
with their normal program examiners. We've done a lot of 
training and a lot of dialog to get our end of the group up to 
speed. But I think that's the only way it starts, and even that 
won't be sufficient.
    The real goal, obviously, is to get people in the agencies 
who understand this and themselves to, even if we quit talking 
to them about it, which we don't plan to do, but that's the 
only way it's going to work. It won't work, as you and I have 
discussed in the past, if I had 10 more really great GPRA 
people. That's not the way it's going to work. The way it's 
going to work is if we at OMB and in the executive branch, and 
as, Mr. Stevens said ultimately, you in the Congress in your 
decisions continually resonating back asking questions about: 
What are the results? How much did it cost to get those 
results? What do we need to do differently to improve those 
results? Only then will we actually see the successful 
implementation of this act.
    Mr. Horn. Where do you find the budget examiners fitting in 
this process?
    Mr. Koskinen. Where do I find----
    Mr. Horn. Are the budget examiners going to still go about 
reviewing the budget as they always have?
    Mr. Koskinen. I know actually----
    Mr. Horn. OMB, frankly, hasn't been thinking much about 
management or results or performance or anything else, just, 
how much do you need? And we only have so much to give you.
    Mr. Koskinen. Right. We actually call them program 
examiners now. And one of the reasons we've changed that name, 
and changed the structure of the organization through OMB 2000, 
is to ensure that the budget dialog and process is not just 
about inputs, that it is, in fact, about structure and 
organization and outcomes.
    Many of the program examiners or budget examiners in the 
past asked those questions. We're very focused on education 
programs and other programs, what were the results of what we 
got for the money, and what we're trying to do now is 
institutionalize that, not only within OMB but within the 
agencies, so that they understand that resources are not a 
question just about inputs, they are a question about outcomes.
    Mr. Horn. When will we get a budget submitted by the 
President that looks at the outcomes on the budget page as well 
as the budget numbers past, present, and proposed?
    Mr. Koskinen. Well, the great joy of the statute is, it 
requires us to produce a governmentwide performance plan with 
the next budget, and we plan on doing that.
    Mr. Horn. So in February of next year we'll see it for the 
next fiscal year?
    Mr. Koskinen. Yes, and in fact as we've discussed this 
internally, I have an agency-wide implementation group for GPRA 
drawn from all the program examining divisions, increasingly 
done well. The budget ought to be, in effect, a performance-
based document, and to a large extent it already is. There is a 
lot of performance information in the budget.
    But again, the focus on the Hill and in the dialog has 
probably been on the input side. So we don't think it's a major 
change for us to turn the budget document into a results-
oriented document. And we plan to do that.
    Mr. Horn. Does GAO have a comment on this discussion?
    Mr. Stevens. Not yet, Mr. Chairman. We will.
    Mr. Koskinen. Forewarned is forearmed.
    Mr. Horn. You want to see who survives; is that it?
    I'm curious about the consultation so far, in your judgment 
and also GAO's judgment. As you've said, if we're simply going 
to have this dialog go on up here, and it isn't translated into 
how we make decisions and you make decisions, and there isn't 
agreement, let's say, on the performance standard and what they 
ought to look like if we're going to take them seriously up 
here and not just fluff, and we can count that so we gave you 
that--and I guess that's where I'm curious, what's your feel 
for the consultation thus far as you hear about it?
    Mr. Koskinen. I think we have room for improvement--on both 
sides. We have some agencies--a small number--that need to be 
responsive promptly to the interest in having strategic plans.
    From the congressional side, we've had very good and strong 
support from the majority leader's office, the Speaker, and 
from this committee. But we need in some areas, for specific 
areas, we need more involvement from appropriators and 
authorizers.
    The House in this area of consultation generally is the 
head of the Senate. Some specific Senate subcommittees or 
committees have engaged in very important consultations, but a 
lot of them have not yet. There are indications that more are 
starting. But again, I think that we need to broaden the base 
of consultation from the congressional side at the same time as 
we're encouraging the agencies to hold up their end of the 
bargain.
    Mr. Horn. Does GAO want to add anything to this?
    Mr. Mihm. Yes, Mr. Chairman. Mr. Koskinen spoke quite a 
while ago about, we all agree there's a bell curve, we just 
argue a little bit over the slope, or disagree a little bit 
over the slope. I think this might be one of the areas where we 
take a little bit different perspective on the slope of the 
curve. That is, based primarily on the discussions of 
congressional staff that have been leading the consultation 
effort and the 25 or so teams that have been formed here on the 
House side, our sense is, the consultations aren't going nearly 
as well as they could have.
    And there's a couple of things to keep in mind here. First 
is that the number of agencies that have not produced strategic 
plans is still, in our view, a little bit high. We're still 
dealing with half a dozen or so agencies that haven't been able 
to produce a strategic plan. For example, the Environmental 
Protection Agency, although it's produced parts of it, says it 
won't be able to get the Hill a complete plan until July, which 
doesn't leave an awful lot of time for consultations.
    The thing to keep in mind is that the strategic planning 
requirement and the consultation requirement does not sneak up 
on agencies. GPRA was passed in July 1993. They've known for 
3\1/2\ years that this requirement was going to be coming on 
board and, clearly, probably wouldn't have made an awful lot of 
sense to get up there, you know, 2 weeks after the act was 
passed. But it's a little bit of concern that there's such a 
rush to complete here within the final weeks before Congress 
goes out on the August recess in order to get these 
consultations completed.
    The other thing that's a bit of concern for us, and Mr. 
Stevens touched on this in the testimony that he had before 
your subcommittee back in March, when we talked about how there 
is a--based on the views that--of agency staff and 
congressional staff that we were finding some very different 
perspectives and what the consultation process ought to entail.
    The congressional staff and Congress generally was looking 
for a much deeper, much more innervative, much more give-and-
take process in consultations. We're not seeing yet an awful 
lot of that understanding penetrating within the agencies. 
There seems to be too much still of a view, if we come up and 
have a couple of briefings, then, well, we've checked that off, 
let's go to the next box on the mark.
    By no means is this universal. Some of the agencies--and 
we're hearing that they're having some real good consultations 
both from the agency's perspective and the Hill perspective, 
but there's just too much still, I think, in that category of 
where there's going to be a rush to complete, and we're not 
going to get the full effect that we could have gotten from the 
consultation process.
    Mr. Horn. I remember that old adage that the only 
difference between an A student and an F student is that the F 
student forgot it before the exam. And I expect that some are 
going back and saying, well, we've done that, and, as you say, 
check it off; we don't have to see those people for another 6 
months or another year. And that isn't the way it should be. 
There ought to be an open door and not, ``I gotcha.''
    But, hey, you've got problems, we've got problems. The 
Constitution makes sure we have those problems to some degree. 
And the question is, how do we get this system to work more 
effectively for the average system? And that's what our aim is.
    Now, in closing, I would like to ask, is there anything 
either side would like to say here that we haven't asked you or 
you felt you didn't get a chance to make that point? This is 
your chance to make the point.
    Mr. Koskinen. No. I would just say again that we genuinely 
appreciate the interest this committee generally and this 
subcommittee have had on this subject over time. I think it's 
an important matter.
    As Mr. Stevens noted, no matter what we tell the agencies, 
we, by ourselves, aren't going to be able to move the ball 
forward as far as we need to. We need your continued 
involvement. We need the broadest involvement from the Congress 
that we can in a bipartisan way, and I think thus far we're 
comforted by the bipartisan nature of the dialog.
    But I think this is a joint venture we're engaged in, and I 
would just close with the same point I've made several times, 
and that is that we need to drive to as much perfection as we 
can get in September, but it's a little like your A student/F 
student notation, we shouldn't all bet on October 1st and 
figure, oh, we'll go on to the next issue. This is part of a 
dialog that needs to be held on a regular basis over a long 
period of time.
    Mr. Horn. Yes. I suspect you've got a lot of people in 
Government who were around with Jimmy Carter and his budgeting 
proposal, and some even with McNamara and PPBS and those 
budgeting proposals, they're saying this too shall pass. But 
this, too, isn't going to pass; it's written into law. There's 
certainly a commitment in both parties--in both Houses that 
this shall be the law, and it isn't because it's some punitive 
thing, it's because it makes sense, and the New Zealanders and 
the Oregonians have already proved that it works. So we'll see 
what Canada does in its elections, and we'll see what Britain 
is now going to do. Maybe even the French are going to get on 
board.
    Does GAO have any closing comments?
    Mr. Stevens. Just that we stand ready, Mr. Chairman, to 
assist not only this committee, which has had a long and very 
productive history and concern about the Results Act, but also 
the authorizing and appropriations committees that are now 
beginning to take notice of it. Our interest, concern, and 
involvement is not limited to the Federal management issues 
group here, but throughout GAO. In all of our issue areas are 
people concerned about what executive agencies are producing 
and are ready to help Congress evaluate that.
    Mr. Horn. Well, you've done an excellent job in your 
report, as you always do, and we thank you and your staff for 
preparing that. It's been immensely helpful.
    Let me just--and I might say to the gentleman who is deputy 
director for management, your Duke education has survived you 
through another congressional hearing. I congratulate you.
    I want to thank the following people that helped prepare 
this hearing, starting with Russell George, against the wall 
there, staff director and counsel for the Government Management 
Information, and Technology Subcommittee; Jane Cobb we're 
delighted to have with us, the professional staff member of the 
full committee and specialist on management issues; Matt Ryan, 
professional staff member on our subcommittee; John Hynes, 
professional staff member on our subcommittee; and Andrea 
Miller, our clerk that makes sure these hearings work.
    And then on the Democratic side Mark Stephenson, 
professional staff member; Jean Gosa, the clerk for the 
minority, our two committee reporters of debates, Vicky 
Stallsworth and Mindi Colchico. And we have three interns 
working on this hearing: Melissa Holder, Grant Newman, and 
Michael Presicci. So we thank the interns. This is the time 
Congress gets free labor in violation of all the laws.
    So thank you all, and the meeting is adjourned.
    [Whereupon, at 12 noon, the subcommittee was adjourned.]
    [Additional information submitted for the hearing record 
follows:]
[GRAPHIC] [TIFF OMITTED] 45062.032

[GRAPHIC] [TIFF OMITTED] 45062.033

[GRAPHIC] [TIFF OMITTED] 45062.034

[GRAPHIC] [TIFF OMITTED] 45062.035

                                   -