AccessibilitySkip to Top NavigationSkip to Main ContentHome  |  Contact IRS  |  About IRS  |  Site Map  |  Español  |  Help  

8.1.7  AQMS Purpose and Guidelines

8.1.7.1  (10-18-2007)
Purpose of Appeals Quality Measurement System

  1. Balanced Measures of Performance is one of the five levers of change in the IRS Modernization effort. The goals of Balanced Measures are to provide information on organizational performance and to highlight areas for performance improvement.

  2. Key output measures are used to assess organizational performance. Each functional unit, including Appeals, has a customized set of output performance measures within the Balanced Measures framework. Appeals Quality Measurement System (AQMS) is the quality measure of the Business Results component of Appeals Balanced Measures.

  3. Appeals Quality Measurement System was developed to provide statistically valid data on case quality for Appeals. Case quality is defined by specific quality Standards, Attributes and Reason Codes.

  4. Appeals case quality is evaluated by conducting reviews of closed cases called Appeals Closed Case Reviews. These reviews provide significant benefits for Taxpayers, Appeals Management and all Appeals employees. Specific benefits include:

    1. ensuring customer rights are protected;

    2. increasing consistency in Appeals decisions/settlements;

    3. allowing identification of training/CPE needs for Appeals employees;

    4. providing feedback to management on areas requiring improvement in the Appeals process.

8.1.7.1.1  (10-18-2007)
Prohibited Use of AQMS Information

  1. AQMS results are not, under any circumstances, used to measure the individual performance of Appeals employees. AQMS is designed and intended as a useful tool for executive and top level managers to use in determining strengths and weaknesses of the quality of the Appeals process.

  2. Any feedback or other work products generated from AQMS are not used as a substitute for case reviews, case file reviews, on the job visits and workload reviews.

8.1.7.1.2  (10-18-2007)
Selecting Cases for AQMS

  1. Closed cases are selected for AQMS review by a random sampling process that is statistically valid to the Area/Campus level for an annual period. The case sampling system is designed to ensure a representative number of cases are selected from each Appeals Area.

  2. The criteria used in selecting the representative case samples are case source and type.

  3. In addition to randomly selected cases, Closed Case Reviews may be conducted on certain types of cases at the request of Appeals Executive Management.

  4. AQMSSELECT is the indicator automatically set when the case is selected for AQMS review based on programmed criteria.

  5. When a case is selected for AQMS review, ACDS generates a partially completed form for the selected case which is completed by the APS function closing the case and attached to the case file. Upon closing the case, APS ensures documents identified on the form are included in the case file. APS then forwards the selected closed case to the appropriate AQMS reviewer/office as identified on the form.

8.1.7.1.3  (10-18-2007)
AQMS Rating System

  1. The AQMS rating system provides an objective, consistent, and equitable scoring system for selected cases, and emphasizes Standards identified as key factors for ensuring an acceptable quality Appeals process.

  2. The AQMS rating system consists of eight key Standards for Non-Collection Appeals cases and six key Standards for Collection Appeals cases.

8.1.7.1.4  (10-18-2007)
Quality Standards, Attributes and Reason Codes

  1. Quality Standards provide objective criteria upon which case quality is evaluated. Each one provides concise statements of Appeals' expectations of a quality work product.

  2. Each Quality Standard contains one or more Attributes that define the prerequisite of a quality case and reflect Appeals' goals.

  3. Some Attributes have Reason Codes. Reason Codes are specific examples of actions or tasks that are contrary to Appeals goals.

8.1.7.1.5  (07-17-2008)
Rating Attributes and Reason Codes

  1. Each Attribute is worded as a question. When rating aspects of cases relevant to an Attribute, the AQMS Reviewer assigns an answer of " Met" or "Not Met" to each applicable Attribute. For an Attribute with Reason Codes, the rating of the Attribute is determined based on whether any of the Reason Codes for the Attribute are selected.

  2. Reason Codes provide detailed information used for analytical purposes. The Reason Codes are used as a management tool to identify the cause(s) of a missed Attribute.

  3. A narrative comment is required for some Reason Codes and Attributes. A narrative comment is a brief summary of the Reviewer’s observations about a given Attribute or Reason Code. They are used to explain the reasons Attributes are rated Not Met and to further explain why a Reason Code was selected. They are also used to provide favorable comments.

  4. The rating assigned to an Attribute by the AQMS Reviewer is a component of the overall score of the related Standard.

8.1.7.1.6  (10-18-2007)
AQMS Review Check Sheet

  1. The AQMS Review Check Sheet is a form outlining the Quality Standards, Attributes, and Reason Codes. AQMS Reviewers use the check sheet to systematically score each case.

  2. The check sheet outlines the criteria for rating each Standard and includes a comment section for each Standard, Attribute, and Reason Code.

  3. When completing the check sheet, Reviewers take into account the significance of both positive and negative aspects of the case file and their respective impact on the Standards, Attributes, and/or Reason Codes.

  4. For many of the Attributes or Reason Codes, Reviewers are required to use the comment section to discuss NOT MET ratings on any Attribute or Reason Codes, and they are asked to share favorable comments regarding Standards and Attributes. Reviewers must ensure their comments are meaningful, clear and easily understood.

8.1.7.1.7  (10-18-2007)
AQMS Consistency Reviews

  1. To provide statistically valid data on case quality for Appeals, it is important to have consistency among the members of the Review Staff in evaluating cases and to have a procedure in place to evaluate consistency.

  2. Consistency checks are performed by having Reviewers independently evaluate the same case and comparing the consistency of the ratings for each Attribute and the selection of Reason Codes.

  3. Group meetings are held by the AQMS Review Staff to discuss specific aspects of the consistency reviews and methods to ensure consistency in the review of cases.

8.1.7.1.8  (07-17-2008)
AQMS Annual Report

  1. Each year AQMS issues a report containing the statistical findings for Non-Collection case reviews and for Collection case reviews. Recommendations for each Appeals Organizational Function are included in the report.

  2. The AQMS Reviewer’s Guides should be used when interpreting or analyzing the AQMS reports. The AQMS Reviewer’s Guides, check sheets, and the AQMS Reports are posted on the AQMS web site.

8.1.7.1.9  (10-18-2007)
AQMS Selection Report

  1. This report lists cases selected for AQMS review according to parameters selected by the user. The reports are created for the prior work day, prior work week, prior work month, or a specific period identified by entering a beginning and ending report date.

  2. This is an optional report available for use as determined on a local basis.

8.1.7.2  (10-18-2007)
AQMS Scoring System

  1. The scores for all applicable Standards are totaled to determine the case score. The maximum case score is 100 points.

  2. The scoring system provides equal ratings for each applicable Standard. Each applicable Standard earns points (up to a maximum per Standard) based on the number of Attributes within the Standard determined to be rated Met, or Not Met.

  3. The score for the Standard is a percentage for the Standard based on the number of Attributes rated MET divided by the number of applicable Attributes (the total MET and NOT MET Attributes) for the Standard.

  4. Attributes rated as Not Applicable are not counted.

8.1.7.3  (10-18-2007)
AQMS Review Check Sheet for Non-Collection Cases

  1. The AQMS Reviewer’s Check Sheet is a form outlining the Quality Standards, Attributes, and Reason Codes. Reviewers use the check sheet to systematically score each case. The check sheet outlines the criteria for rating each Standard and includes a comment section for each Standard, Attribute, and Reason Code.

8.1.7.3.1  (07-17-2008)
Customer Service and Taxpayer Rights (Standard 1)

  1. Standard 1 measures whether Appeals -

    • timely communicated with the Taxpayers in an appropriate, professional manner;

    • addressed the Taxpayers' needs; and

    • respected the Taxpayers' rights.

  2. The IRS is committed to providing Taxpayers with customer service that facilitates easier interactions with the IRS, provides assistance with Taxpayers' needs as necessary, and delivers professional treatment. This requires that Appeals keep Taxpayers appropriately informed throughout the Appeals process, and give them sufficient time to present their case.

  3. Respecting Taxpayers’ rights involves both advising them of their rights and observing those rights in Appeals' actions. Appeals must always keep the Taxpayers’ rights as the top priority.

  4. For Standard 1 to be rated at the maximum allowable score, the following actions must be taken on the case:

    1. Advise Taxpayers of their rights,

    2. Explain the Appeals process,

    3. Follow privacy, disclosure and ex parte rules, and

    4. Keep the taxpayer and/or representative informed throughout the Appeals process.

  5. To keep the Taxpayer and/or Representative informed about the status of the case, contact should generally be initiated timely and continue throughout the Appeals process.

8.1.7.3.2  (10-18-2007)
Analysis of Facts and Law (Standard 2)

  1. Standard 2 measures whether the Appeals settlement is supported by a well-reasoned analysis of facts and law. Issues referred to Appeals are controversial and rest upon judgment and opinion on which reasonable people may hold divergent views. Resolving these issues requires consideration of all relevant facts and law.

  2. The AQMS Reviewer will not substitute personal preference for the judgment of the Appeals/Settlement Officer when the decision is fairly supported by facts and applicable law.

  3. Standard 2 is rated at the maximum allowable score when the following occurs:

    1. Decision to settle is consistent with the legal authority,

    2. Relevant facts support the decision, and

    3. Settlement/decision reflects relevant interpretation of the law, facts and litigating hazards as applied to the case.

8.1.7.3.3  (10-18-2007)
Accuracy of Computations by AO/ATCL (Standard 3)

  1. Standard 3 measures the accuracy of the tax and penalty computations prepared by the AOs, ATCLs, etc. who do their own computations and whether correct closing information was provided for the computation of interest.

  2. Standard 3 includes a review of the following:

    • Tax computations (including all necessary supporting schedules and exhibits that are part of the tax computation), penalties, tax credits, carryovers, etc;

    • Form 2285, Restricted Interest Worksheet;

    • Form 2210 and Form 2220, Sequa Worksheets for computing dates when there has been a credit elect, and

    • Form 5403 Worksheet (Instructions to APS).

  3. The Reviewer uses reasonable judgment to determine what is considered an error. The Reviewer clearly demonstrates an error causing an incorrect tax or penalty, not merely a "possible" or " potential" error.

  4. Standard 3 is rated at the maximum allowable score when the following occurs:

    1. Tax and penalty are correctly computed,

    2. Required forms, schedules and exhibits are present, correct and clear, and

    3. Closing information for the computation of interest is correctly provided.

8.1.7.3.4  (10-18-2007)
Adequacy of Appeals Case Memorandum (Standard 4)

  1. Standard 4 measures whether the Appeals Case Memorandum (ACM) adequately explains and documents the rationale and merits of each settlement or unagreed disposition. The ACM is the written record prepared by the Appeals Officer and Appeals Team Case Leader that provides the principal support for the case conclusion and/or report.

  2. The ACM must adequately explain the conclusions reached in the Appeals process as well as reflect the significant and relevant information gathered during the process.

  3. The ACM is the document used to assist management in reviewing the case decision as well as providing feedback on the case settlement to Compliance.

  4. Standard 4 is rated at the maximum allowable score when the following occurs:

    1. Form 5402 and the schedule of adjustments, when required, are properly completed, and

    2. The ACM adequately addresses all issues as defined by the IRM, in a clear, concise and professional manner with sufficient detail in Plain English.

8.1.7.3.5  (07-17-2008)
Timeliness of Actions (Standard 5)

  1. Standard 5 measures the timeliness of actions taken by the Appeals Officer (AO), Appeals Team Case Leader (ATCL) and the Tax Specialist (TS) during the time span required to complete the case, and the use of time relative to the complexity of the issues. This includes whether actions are initiated timely and continue throughout the Appeals Process.

  2. Timeliness as a Standard is rated relative to the type and circumstances of each case.

  3. The focus of this Standard is the overall time management of the case.

  4. Standard 5 is rated at the maximum allowable score when the following occurs:

    1. Time span is appropriate for the actions taken,

    2. Time applied is commensurate with the work performed, and

    3. The AO/ATCL/TS keeps the case moving throughout the Appeals process.

8.1.7.3.6  (10-18-2007)
Procedures Followed on Non Collection Cases (Standard 6)

  1. Standard 6 measures whether important procedural aspects of Appeals non-collection cases are performed. There are numerous procedural actions Appeals must comply with during the processing of a case.

  2. Standard 6 is used by AQMS Reviewers to measure whether general procedural requirements of Appeals non-collection cases are followed, such as conducting a prompt preliminary review of the case; soliciting payment and offering payment options; and following the statute of limitation guidelines.

  3. Special case procedures, such as those required for Joint Committee, TEFRA and penalty appeals cases, are also measured under Standard 6.

  4. Standard 6 is rated at the maximum allowable score when the AO/ATCL/TS follows general and special case procedures relevant to the circumstances of the case.

    Note:

    If there is a difference between local and IRM procedures, the IRM and National guidelines are controlling for purposes of the AQMS rating.

8.1.7.3.7  (10-18-2007)
Accuracy of Computations by Tax Computation Specialists (Standard 7)

  1. Standard 7 measures the accuracy of the tax and penalty computations prepared by the Tax Computation Specialist (TCS), whether correct closing information is provided by the TCS for the computation of interest, and whether the TCS time span and time applied are appropriate.

  2. This Standard includes consideration of the following:

    • Tax computations (including all necessary supporting schedules and exhibits that are part of the tax computation), penalties, tax credits, carryovers, etc.;

    • Form 2285 Restricted Interest Worksheet;

    • Form 2210/2220 Sequa Worksheets for computing dates when there has been a credit elect; and

    • Form 5403 Worksheet (Instructions to APS), as well as the time span and time applied by the TCS.

  3. The Reviewer uses reasonable judgment in determining what is considered an error. The Reviewer clearly demonstrates an error causing an incorrect tax or penalty, not merely a "possible" or " potential" error.

  4. Standard 7 is rated at the maximum allowable score when the following occurs:

    1. Tax and penalties are computed correctly by the TCS,

    2. Required forms, schedules and exhibits are present, correct and clear,

    3. Closing information for the computation of interest is present and accurate, and

    4. TCS time span and time applied are appropriate.

8.1.7.3.8  (10-18-2007)
Accuracy of Interest Computations (Standard 8)

  1. Standard 8 measures the following actions taken by Tax Examiners (TE) and Tax Specialists (TS):

    • accuracy of interest computations;

    • computational and assessment/abatement procedures followed;

    • accuracy and timeliness of assessments/abatements; and

    • appropriate time spans and time applied.

  2. This Standard includes consideration of the accuracy of interest computations, the presence of all necessary reports and agreement forms, the use of proper procedures relating to Restricted interest (Form 2285 Worksheet) and Form 2210/2220 Sequa Worksheets.

  3. Both regular and restricted interest computations and the accuracy/timeliness of the assessments/abatements, etc., are considered as well as the time span and time applied by the TE and TS.

  4. Standard 8 is rated at the maximum allowable score when the following occurs:

    1. Interest is correctly computed by the TS and TE,

    2. Timely assessments/abatements are made following all applicable procedures, and

    3. TS and TE time spans and time applied are appropriate.

8.1.7.4  (10-18-2007)
AQMS Review Check Sheet for Collection Cases

  1. The AQMS Reviewer’s Check Sheet is a form that outlines the Quality Standards, Attributes, and Reason Codes. Reviewers use the check sheet to systematically score each case. The check sheet outlines the criteria for rating each Standard and includes a comment section for each Standard, Attribute, and Reason Code.

8.1.7.4.1  (07-17-2008)
Customer Service and Taxpayer Rights (Standard 1)

  1. Standard 1 measures whether Appeals -

    • timely communicated with the Taxpayers in an appropriate, professional manner;

    • addressed the Taxpayers' needs; and

    • respected the Taxpayers' rights.

  2. Appeals is required to keep Taxpayers appropriately informed throughout the Appeals process, address the taxpayers' needs and give them sufficient time to present their case.

  3. Respecting Taxpayers’ rights involves both advising them of their rights and observing those rights in Appeals actions. Appeals must always keep the Taxpayers’ rights as the top priority.

  4. For Standard 1 to be rated at the maximum allowable score, the following actions must be taken on the case:

    1. Advise Taxpayers of their rights,

    2. Explain the Appeals process,

    3. Follow privacy, disclosure and ex parte rules, and

    4. Keep the taxpayer informed throughout the Appeals process.

  5. To keep the Taxpayer and/or Representative informed about the status of the case, contact should generally be initiated timely and continue throughout the Appeals process.

8.1.7.4.2  (10-18-2007)
Analysis of Facts and Law (Standard 2)

  1. Standard 2 measures whether the Appeals settlement is supported by a well-reasoned analysis of facts and law. Issues referred to Appeals require consideration of all relevant facts and law.

  2. The AQMS Reviewer will not substitute personal preference for the judgment of the Appeals/Settlement Officer when the decision is fairly supported by facts and applicable law.

  3. Standard 2 is rated at the maximum allowable score when the case file reflects a quality decision.

8.1.7.4.3  (10-18-2007)
Accuracy of All Computations (Standard 3)

  1. Standard 3 measures the accuracy of the tax, penalty, interest and other computations. This Standard includes:

    • Consideration of the Reasonable Collection Potential (RCP) in OIC cases;

    • The amount of penalty in TFRP cases where adjustments are made by Appeals;

    • Payment amounts for installment agreements;

    • Liability adjustments in CDP cases; and

    • Interest computations, when applicable.

  2. Standard 3 is rated at the maximum allowable score when the AQMS Reviewer determines the relevant computations are correct.

8.1.7.4.4  (07-17-2008)
Adequacy of Appeals Case Memorandum (ACM) (Standard 4)

  1. Standard 4 measures whether the Appeals Case Memorandum (ACM) adequately explains and documents the rationale and merits of each settlement or unagreed disposition. The ACM is the written record prepared by the Appeals Officer/Settlement Officer that provides the principal support for the case conclusion and/or report.

  2. The ACM must adequately explain the conclusions reached in the Appeals process as well as reflect the significant and relevant information gathered during the process.

  3. The ACM is the document used to assist management in reviewing the case decision as well as providing feedback on the case settlement to Compliance.

  4. Standard 4 is rated at the maximum allowable score when the following occurs:

    1. Forms 5402(c) are properly completed,

    2. The ACM addresses all issues adequately, as defined by the IRM for each work stream,

    3. The ACM is written using the plain English writing style, and

    4. The ACM is presented in a clear, concise and professional manner.

8.1.7.4.5  (07-17-2008)
Timeliness of Actions (Standard 5)

  1. Standard 5 measures the timeliness of actions taken by the Appeals Officer/Settlement Officer/Appeals Account Resolution Specialist during the time span required to complete the case, and the use of time relative to the complexity of the issues. Once a case is received by the AO/SO/AARS, subsequent actions should be initiated timely throughout the Appeals Process.

  2. Timeliness as a Standard is rated relative to the type and circumstances of each case. The focus of this Standard is the overall time management of the case.

  3. Standard 5 is rated at the maximum allowable score when the time span is appropriate for the actions taken, time applied is commensurate with the work performed, and the case kept moving throughout the Appeals process.

8.1.7.4.6  (10-18-2007)
Procedures Followed on Collection Cases (Standard 6)

  1. There are numerous procedural actions Appeals must comply with during the processing of a case. Standard 6 measures whether important procedural aspects of Appeals Collection cases are performed.

  2. Special Appeals Collection case procedures, such as those required for Collection Due Process, Offer in Compromise, Collection Appeals Program and Trust Fund Recovery Penalty cases, are also measured under this Standard.

  3. Standard 6 is rated at the maximum allowable score when the Appeals Officer/Settlement Officer/AARS follows general and special case procedures relevant to the circumstances of the case.

    Note:

    If there is a difference between local and IRM procedures, the IRM and National guidelines are controlling when rating a case.


More Internal Revenue Manual