The Collection Quality Measurement System’s Process Can Be Enhanced
September 2000
Reference Number: 2000-30-161
This report has cleared the Treasury Inspector General for Tax Administration disclosure review process and information determined to be restricted from public release has been redacted from this document.
September 27, 2000
MEMORANDUM FOR COMMISSIONER ROSSOTTI
FROM: Pamela J. Gardiner /s/ Pamela J. Gardiner
Deputy Inspector General for Audit
SUBJECT: Final Audit Report - The Collection Quality Measurement System’s Process Can Be Enhanced
This report presents the results of our review of the Collection Quality Measurement System (CQMS). In summary, we found that the CQMS should provide additional standards and information, and national corrective action is needed for those quality standards that are consistently not met. We made four recommendations related to these issues.
Management’s response was due on September 25, 2000. As of September 26, 2000, management had not responded to the draft report.
Copies of this report are also being sent to the Internal Revenue Service managers who are affected by the report recommendations. Please contact me at (202) 622-6510 if you have questions, or your staff may call Gordon C. Milbourn III, Associate Inspector General for Audit (Small Business and Corporate Programs), at (202) 622-3837.
Appendix I – Detailed Objectives, Scope, and Methodology
Appendix II – Major Contributors to This Report
Appendix III – Report Distribution List
The Internal Revenue Service’s (IRS) Collection function is responsible for collecting unpaid tax liabilities. Various IRS functions, including the Collection function, have developed a set of balanced measures to help assess progress against the IRS’ high level goals. One of the balanced measures in the Collection function is business results. The Collection Quality Measurement System (CQMS) consists of quality reviewers performing reviews of a sample of closed cases and is a major component of the Collection function’s method of assessing its business results.
The mission of the CQMS is to provide a qualitative assessment of a Collection Field function (CFf) case by determining if the case work addressed the right issues at the right time and if the right actions were taken timely and efficiently. Additionally, the CQMS determines whether the right procedures were followed and if the case was closed correctly. IRS management should use CQMS findings to help identify and correct problems in such areas as procedures, organization, and training.
The objectives of our review were to determine whether the CQMS process is effective to measure the quality of collection work and whether the results are used to improve overall effectiveness.
Results
The CQMS process uses numerous important standards to evaluate the key aspects of CFf work on Taxpayer Delinquent Accounts, which are unpaid tax liabilities. The sample selection process has recently changed to select cases more objectively; however, it was too early in the new process for us to evaluate its effectiveness.
Our review showed that CQMS standards and reported results could be enhanced to provide additional information to Collection function managers. Also, national guidance and corrective action should be provided regarding specific quality standards that showed a national trend of continually not being met.
Quality Standards Could Be Enhanced
The CQMS does not capture information related to pyramiding (i.e., the accruing of additional liabilities) during the time from assignment of a case to the CFf until contact with the taxpayer. In a prior audit, we determined that a large amount of tax dollars pyramid during this time frame and there is a need to shorten the time frame to address the problem. This time frame is already captured in the time analysis section of the CQMS; however, pyramiding is not measured for that period. Collection function managers do not receive feedback from the CQMS as to whether their offices have a problem with pyramiding taxes while cases are awaiting assignment to revenue officers, prior to first contacts with taxpayers. By being aware of this condition, Collection function managers may take actions to prevent additional taxes from accruing.
The CQMS also does not have a specific standard that measures whether the Trust Fund Recovery Penalty (TFRP) is applicable on each case. The TFRP can be assessed against responsible officers of corporations that have not paid their employment tax liabilities. In another audit, we found that the penalty was not being assessed timely against responsible officers, thereby decreasing the ability of the IRS to collect the taxes due. This information would also be useful to managers.
In addition, the CQMS reports do not provide information by type of taxpayer, such as business or individual, or have it available in a form that shows the trends and results for different types of taxpayers. This information could be useful to managers because different types of taxpayers may have different types of issues and need different approaches as cases are worked. This could also be helpful as the IRS reorganizes into its new operating divisions, which focus on specific groups of taxpayers. Three of these divisions are Small Business/Self-Employed, Large and Mid-Size Business, and Wage and Investment.
The Collection Field Function Should Use the Collection Quality Measurement System Results More Effectively
The three districts we visited took some actions based on the CQMS results, mostly through discussions in branch and group meetings. However, our review of 1 year (April 1999 - March 2000) of data from the CQMS results showed that, nationally, certain quality standards were met less than 60 percent of the time on average, yet no consistent national actions were taken to address the problem. These standards included:
Collection function management informed us that the CQMS standards were revised in April 1999 and the 1-year time frame to evaluate trends and make conclusions may not be significant. Also, the responsibility for interpreting CQMS results and taking corrective actions is left to Collection function managers in the field offices. Collection function management believes that field managers would be better able to analyze the causes of the problems. However, relying on the districts to take their own corrective actions has not resulted in improvement. Providing consistent national direction or training in areas that, month after month, indicate a problem may improve the quality of work nationwide.
Summary of Recommendations
We recommend that Collection function management add a standard to measure pyramiding from the date a case is assigned to the CFf until contact with a taxpayer, add a standard to measure the timely use of the TFRP, provide the ability for the districts to be able to get results based on type of taxpayer, and provide national direction, feedback, and training on areas that need improvement.
Management’s Response: Management’s response was due on September 25, 2000. As of September 26, 2000, management had not responded to the draft report.
The objectives of our audit were to determine whether the Collection Quality Measurement System (CQMS) process is effective to measure the quality of collection work and whether the results are used to improve overall effectiveness.
To accomplish these objectives, we:
We reviewed the CQMS "process;" however, we did not perform an independent review of cases to determine whether reviewers accurately and effectively reviewed the cases.
We conducted audit tests in the Manhattan, Northern California, and South Florida Internal Revenue Service (IRS) district offices and the National Headquarters between May and July 2000. This audit was performed in accordance with Government Auditing Standards.
Details of our audit objectives, scope, and methodology are presented in Appendix I. Major contributors to this report are listed in Appendix II.
The IRS’ Collection function is responsible for collecting unpaid tax liabilities. Various IRS functions, including the Collection function, have developed a set of balanced measures to help assess progress against the IRS’ high level goals. One of the balanced measures in the Collection function is business results. The CQMS consists of quality reviewers performing reviews of a sample of closed cases and is a major component of the Collection function’s method of assessing its business results.
The mission of the CQMS is to provide a qualitative assessment of a CFf case by determining if the case work addressed the right issues at the right time and if the right actions were taken timely and efficiently. Additionally, the CQMS determines whether the right procedures were followed and if the case was closed correctly. IRS management should use CQMS findings to help identify and correct problems that require change in such areas as procedures, organization, and training.
The Fiscal Year (FY) 2000 IRS Operations Plan states that the Business Results portion of balanced measures will include leveraging systems, such as the CQMS, to evaluate the quality of work. CQMS reviews will focus on factors that include whether IRS personnel:
The CQMS does not report individual revenue officer quality results. Instead, since FY 1999, it has been reporting the organizational quality results at the branch level. CQMS standards balance the measure of traditional case actions against a renewed emphasis on customer service, taxpayer rights, fairness, and judgment. Closed CFf case files are reviewed by quality reviewers to measure organizational performance in the following four key quality categories: a) customer service and observation of taxpayer rights, b) technical ability, c) timeliness of work, and d) judgment of outcome. Each case reviewed by CQMS reviewers is scored based on the number of standards that were met.
Beginning in June 2000, the CQMS process required each CFf branch in every district to forward recently closed cases systemically identified from the ICS. The list is provided to the district clerks who locate the cases and mail them to the CQMS. Closed cases selected for review include:
The CQMS process used numerous important quality standards to evaluate the key aspects of CFf work on TDAs, which are unpaid tax liabilities. The sample selection process has recently changed, and cases are now being selected systemically from closed cases on the ICS. While it was too early for us to fully evaluate its effectiveness, the new sample selection process should provide an objective sample.
Our review also showed that:
Quality Standards Could Be Enhanced
The CQMS standards cover a wide range of topics related to how effectively TDA cases are worked in the CFf. The categories of the standards are: 1) customer service and protection of taxpayer rights, 2) timeliness of work, 3) technical ability, and 4) judgment of outcomes. Some examples of specific standards are: if the taxpayer was notified of appeals rights; if proper approval was secured for specific enforcement actions; if there were activity lapses, after assignment to the CFf, of 75 days or more; if a financial analysis was completed; and if the case was closed correctly.
Collection function management established the CQMS standards based on the priority areas for work in the CFf. For example, many of these standards are related to the IRS Restructuring and Reform Act of 1998 (RRA 98).
Numerous important standards are used to cover the major aspects of working a TDA case. However, additional standards and information related to pyramiding, the TFRP, and the type of taxpayer would help Collection function managers make informed decisions about areas needing improvement and gear the improvements towards the applicable type of cases.
Certain information about pyramiding is not captured
The CQMS does not capture information related to the pyramiding of tax liabilities from assignment of a case to the CFf until the first contact with the taxpayer. In a prior audit, we determined that a large amount of tax dollars pyramid during this time frame. We recommended that the time frame for assigning and beginning work on these cases in the CFf be shortened to help prevent this pyramiding.
The time frame between assignment of the case to the CFf until first contact with a taxpayer is already captured as part of the CQMS. However, the Collection function managers do not receive feedback from the CQMS regarding whether their offices have a problem with pyramiding taxes during this time frame. This could be useful information to highlight potential problems and thereby help prevent additional taxes from accruing, both while cases are awaiting assignment to a revenue officer and prior to first contacts with taxpayers.
This information has not been captured because Collection function management has placed CQMS emphasis on the revenue officers’ actions on cases, especially taxpayer rights issues, but not necessarily on the whole CFf process, which would include assigning cases. Also, pyramiding is currently being used as a CQMS standard; however, it is measured only from after a revenue officer contacts a taxpayer, so the data do not reflect the whole picture during the time the case is in the CFf.
Information about the TFRP is not available
The CQMS also does not capture information on cases in which a TFRP is applicable. When the CQMS standards were established, this was not included as a separate standard. The TFRP can be assessed against responsible officers of corporations that have not paid their employment tax liabilities. In another audit, we found that the penalty was not being timely assessed against responsible officers, thereby decreasing the ability of the IRS to collect the taxes due. This information would be useful for managers because, without feedback, management may not know whether the TFRP is being assessed as a means of protecting the government’s interest.
Assessing the TFRP timely is an important enforcement tool to be used to ensure that the government’s interest is protected. Other enforcement tools are included on the CQMS, such as information on the filing of federal tax liens, the issuing of levies to obtain funds from taxpayers’ bank accounts, and the seizing of taxpayers’ property. Including TFRP information would enhance the CQMS.
Information by type of taxpayer is not included
The CQMS reports do not provide information by type of taxpayer, such as business or individual, or have it available in a form that shows the trends and results for different types of taxpayers. Without this type of information, managers may not be able to make informed decisions on appropriate corrective actions for different types of taxpayer cases.
CQMS management informed us that one of the reasons the information has not been differentiated among types of taxpayers is because they are concerned about fairness to taxpayers when identifying corrective actions on cases if they were to differentiate. However, this is one of the reasons why the IRS is organizing into business divisions, such as Small Business/Self-Employed (SB/SE), Large and Mid-Size Business, and Wage and Investment. Different types of taxpayers may have different types of issues and need different approaches as cases are worked.
Further, the SB/SE Division Commissioner recently commented that he wants to make use of the enormous quantity of data the IRS generates. Information on the type of taxpayer from the CQMS could help as the new SB/SE Division stands up.
Recommendations
Collection function management should:
Management’s Response: Management’s response was due on September 25, 2000. As of September 26, 2000, management had not responded to the draft report.
The Collection Field Function Should Use the Collection Quality Measurement System Results More Effectively
Field and national management should use quality review findings to help identify and correct problems that require changes in such areas as procedures, organization, and training. CQMS results are available on the CQMS website and most CFf mid-level and above managers have access to the data for their respective organizations. Each field office is required to review its own reports and take actions to improve in the quality standards it identifies as significant problems. After reviewing the results and identifying quality standards that need improvement, these managers should address any problems with their employees.
We visited three districts to determine how they used CQMS results to improve the case work in their offices. We determined that all three districts took some actions to identify the problems and address them with the revenue officers. Mostly, this was done through discussions in branch and group meetings. Some managers informed us that they keep the CQMS results in mind as they perform their own reviews of cases being worked by the revenue officers in their groups. The districts also had CQMS employees attend group meetings to explain the process.
We also reviewed data from 1 year (April 1999 - March 2000) of CQMS results to identify national trends for all districts and contacted Collection function management in the National Headquarters to determine how they used the results to address nationwide problems. Our review showed that, nationally, there were some standards that were met over 90 percent of the time. For example, fair and courteous treatment of taxpayers and tax accuracy verification were met 100 percent and 94.3 percent, respectively.
On the other hand, certain quality standards were continually not being met nationwide and in the majority of the field offices. However, we did not identify any actions or directions provided nationally to address those standards.
For example, certain standards had the following low average national scores from April 1999 through March 2000. These scores averaged less than 60 percent and were relatively consistent each month. There were no wide fluctuations in the ranges of scores. The majority of field offices nationwide experienced similarly low scores in these same standards month after month.
Quality Standard |
Yearly Average National Score as to How Often Standard Was Met |
Notification of Taxpayer Rights (Providing IRS Publication One on the First Contact) |
59.0% |
Were Clear Taxpayer Action Dates Set? |
46.0% |
Were Allowable Expenses Guidelines Followed? |
58.8% |
Did the Taxpayer Continue to Accrue Liabilities (after revenue officer contact)? |
50.6% |
Source: CQMS reports 4/99 through 3/00 for all field offices.
Collection management informed us that the CQMS standards were revised in April 1999 so, in their view, the time frame to evaluate trends and make conclusions may not be significant. In addition, the responsibility for interpreting CQMS results and taking corrective actions is left to Collection function managers in the field offices. Collection function management believes that field managers are more aware of local issues and can better analyze what caused the low scores than can management at the national level.
However, relying on the field offices to take their own corrective actions has not resulted in improvement. Consistent national direction, training, and executive leadership in areas that, month after month, indicate a problem may improve the quality of work nationwide. Without some form of national guidance, including establishing accountability at all employee levels, corrective actions and training may not be consistent, resulting in the same standards continually not being met.
Recommendation
The CQMS provides a qualitative assessment of CFf cases. The results of case reviews from the CQMS are a major component of the Collection function balanced measure on business results. Our review showed that the information provided to management from the CQMS could be enhanced to help managers make more informed decisions on how cases should be worked. This is especially important considering the IRS’ reorganization into divisions focused on specific groups of taxpayers, such as SB/SE, Large and Mid-Size Business, and Wage and Investment. In addition, certain quality standards continually were not met nationwide, and more national guidance and emphasis are needed to help improve case actions in those areas.
Appendix I
Detailed Objectives, Scope, and MethodologyOur overall objectives were to determine whether the Collection Quality Measurement System (CQMS) process is effective to measure the quality of collection work and whether the results are used to improve overall effectiveness.
We conducted the following tests to accomplish the objectives:
Appendix II
Major Contributors to This ReportGordon C. Milbourn III, Associate Inspector General for Audit (Small Business and Corporate Programs)
Parker F. Pearson, Director
Lynn W. Wofchuck, Audit Manager
Doris A. Cervantes, Auditor
Cristina Johnson, Auditor
Julian E. O’Neal, Auditor
Janis Zuika, Auditor
Appendix III
Report Distribution ListDeputy Commissioner Operations C:DO
Commissioner, Small Business/Self-Employed Division S
Assistant Commissioner (Collection) OP:CO
National Taxpayer Advocate C:TA
Office of the Chief Counsel CC
Office of Management Controls CFO:A:M
Director, Legislative Affairs CL:LA
Director, Office of Program Evaluation and Risk Analysis M:O
Director, Manhattan District
Director, Northern California District
Director, South Florida District