Skip Navigation HRSA - Health Resources and Service Administration U.S. Department of Health & Human Services
Home
Questions
Order Publications
 
Grants Find Help Service Delivery Data Health System Concerns About HRSA

The HIV/AIDS Program: Caring for the Underserved

 

A Guide To Primary Care For People With HIV/AIDS, 2004 edition

< Previous | Home | Next >

17 Quality Improvement
    Overview
    Data Collection
    Key Points
    References

Chapter 17
Quality Improvement

Bruce D. Agins, MD, MPH

" Quality of care is the degree to which health services for individuals
and populations increase the likelihood of desired health outcomes and
are consistent with current professional knowledge. "
(Institute of Medicine, 1990)

" All health care organizations, professional groups, and private and public purchasers should pursue six major aims; specifically, health care should be safe, effective, patient-centered, timely, efficient, and equitable. "
(Institute of Medicine, 2001)

Overview   TOP


Quality Improvement: Why Bother?

An open letter to clinic directors:

You may have dismissed quality improvement from your agenda for many reasons. You may think it is someone else's job, or it's a lot of extra work with no benefit, or think that you've already got a quality program in place. You may think that your current system of monitoring the charts in your clinic and giving feedback to the providers who aren't doing the right thing is a quality improvement (QI) program. You may also think that your clinic is doing a fantastic job and that you don't need to monitor its quality. Here's why it's worth investing the time and effort:

  • Data generated from your QI program showing improvements over time demonstrate that the program is worth its funding
  • QI provides an opportunity to solve problems that are part of the system and not dependent on one individual
  • Focus on performance measurement and improvement usually stimulates employees to maximize their performance
  • Clinicians have the opportunity to provide leadership through championing best outcomes for patient care
  • Innovative problem-solving techniques lead to better care and promote a positive working environment
  • QI projects demonstrate compliance with accreditation authorities and grant sponsors
  • Quality improvement activities that lead to better outcomes provide a competitive edge when competing for alliances with purchasers
  • Monitoring systems that are dependent on single individuals will not last when these key players leave the clinic or are absent for long periods, whereas a fully functioning quality improvement program that involves staff working in teams with a clearly defined infrastructure will keep going when even the most dynamic individuals depart.

This chapter describes how your clinic can develop, implement, and maintain a QI Program and what your role in it might be, whether part of a QI Project Team, the Quality Committee, or simply a customer of the performance measurement and quality improvement processes.

What is Quality Improvement (QI)?

Quality improvement (QI) includes regular measurement of care processes and outcomes to analyze processes and systems of care. It involves implementation of solutions to improve care and monitor their effectiveness with the goal of achieving optimal health outcomes for patients. Ongoing cycles of change and remeasurement are implemented to test and try different ideas to determine which result in improved care. QI activities in clinics can range from a single team focusing on improving one aspect of care to a comprehensive QI program with many teams working on a wide variety of improvement projects, with a well-established plan and an oversight committee.

The methods of QI are based on core principles that are readily translated into a practical approach and integrated into the clinical care delivery system (see Table 17-1). Successful implementation of QI involves actions at 2 different levels: the QI activities and the HIV program processes that provide the structural backbone for them. This section will articulate the core principles and describe activities that can be easily adapted into the HIV ambulatory care setting to implement a sustainable QI program.

Table 17-1: Core Principles of Quality Improvement
  • Focus on the customer: improvement activities result in improved patient health
  • Measurement: collect and use data to improve care
  • Emphasis on systems of care: improve processes that link to desired outcomes
  • Involvement of participants: encourage direct participation in teams by those individuals who implement the processes being evaluated

Descriptions of the chronic care model that serves as an important application of QI principles to HIV care can be found in Chapter 1, Figure 1-1, and Chapter 18, the section on Integrating HIV Specialty into Practice. A training manual developed from an HIV/AIDS collaborative is available from the Institute for Healthcare Improvement (see Suggested Resources).

Why aren't chart audits sufficient for QI - Why can't management just conduct QI?

Measurement alone is not sufficient to improve quality. A common pitfall in implementing QI programs is to rely solely upon performance data, the medical or program director's interpretation of it, and one person's decisions about how to make changes. Successful improvements most often result when staff members from the systems being assessed work together in teams. When they are engaged in the process, they are more likely to generate ideas to try and to accept changes.

Which personnel should be involved in QI?

The size of the clinic will determine who participates in quality-of-care activities. In small HIV clinics with a primary care provider, case manager, nurse, and support staff, most of the staff are involved in all aspects of QI work. Larger institutions usually establish an HIV Quality Committee that includes senior management staff of the HIV clinic, designated QI staff if there are any, and other key players who work in the clinic. A member of this committee represents the group in the agency-wide quality committee. The Quality Committee identifies the priorities for improvement or agrees to use priorities identified by staff or patients in the clinic. The Quality Committee also charters improvement teams, identifying potential members who are key stakeholders in the process under investigation or their representatives.

Who should be on the teams?

Teams are formed to address the specific care processes or systems undergoing improvement. Team members should be selected to represent the different functions involved in these processes or to represent the components of the system under focus. The size of a team varies according to the size of the clinic and the process under study. In small clinics, the few dedicated HIV program staff may constitute the project teams, with added representation from different departments as needed, such as from the lab, or from other medical disciplines. In larger clinics, teams often include 6-10 members. Membership should include representatives from the different groups in the clinic who are involved in the care process. In addition to the clinical and case management representatives, scheduling clerks and medical records staff are often important representatives, especially when followup appointments and documentation are important components of the care process or have been identified as areas that need to be improved.

What are the responsibilities of the team?

Teams are expected to identify areas of change, implement pilots to test the change, review data assessing the change, and ultimately make recommendations about improvements. Team meetings should be kept flexible and adapt to the working environment of the clinic as much as possible, although a few specific guidelines will help keep things running smoothly. These include designating a leader for the team, developing clear and specific aims and goals, and ensuring that a clear line of accountability is defined pointing back up to the Quality Committee. Sometimes, short impromptu meetings keep the momentum of the project going and enable rapid decisionmaking based on results as soon as they become available.
As the Project Team conducts its work and gains experience, it will become more independent and assume more responsibility for ongoing measurement, data collection, and implementation of steps toward improvement.


Data Collection   TOP

How do you select which components of care should be measured?

Indicators are measurable aspects of care that evaluate the extent to which a facility provides a certain element of care. Indicators should be based on standards or guidelines, meet the primary goals of QI, and reflect priorities specific to the community and the clinic. For example, in HIV clinics where the population includes a large number of women, indicators may include rates of routine Pap smears, rates of preconception counseling, or other aspects of care specific to women. In clinics that care for a high volume of patients with severe immunosuppression and advanced HIV disease, indicators may include rates of prophylaxis for specific opportunistic infections, such as PCP and MAC. Some indicators should be selected by soliciting input from patients who attend the clinic (see Table 17-2). Staff members also often know what aspects of care would benefit from being measured and improved and should be consulted to determine priorities. If routine data collection systems already exist in the clinic, data should be reviewed to determine which components of care would be prime candidates for improvement (see Table 17-3 for sample indicators).

Table 17-2: Methods for Obtaining Input from Patients
  • Suggestion box
  • Surveys
  • Focus groups
  • Consumer advisory board

Table 17-3: Sample HIV Quality Indicators
Element of Care Quality of Care Indicator
HIV staging
  • CD4 cell count test performed every 4 months
  • Viral load measurement test performed every 4 months
Antiretroviral therapy ART drug usage for stable and unstable patients
Tuberculosis screening Annual PPD testing
OI prophylaxis PCP prophylaxis (CD4 count <200 cells/mm3)
MAC prophylaxis (CD4 count <50cells/mm3)
Pneumococcal vaccination
Gynecological care Annual pelvic exam with Pap smear
Syphilis screening Annual syphilis serology
Substance abuse education Annual discussion of substance use
Annual discussion of tobacco use
Coordination of care Annual dental exam

Once the aspect of care has been selected, how do you develop and measure the indicators?

Three major activities constitute the process of indicator development:

  1. Define the measurement population: location, gender, age, clinical condition, visits.
  2. Define the measures.
  3. Develop the data collection plan.

The measurement population is defined by determining the location of care being studied, whether both men and women are eligible, the applicability of the indicator to different age groups, whether any clinical conditions are necessary to determine whether the indicator is applicable, and whether the patient must have been in treatment or visited the clinic more than once.

After defining the population, the measure needs to be defined. For each measure, specific criteria must be developed to define the "yes" response and the "no" response (see Table 17-4). Often this involves deciding during which time period an activity has been performed. For example, an indicator measuring viral load monitoring must include the frequency with which that test should be performed. One simple way to construct this measure would be to ask "Was viral load measured within the last 4 months?"

Table 17-4. Examples of Specific Measures with Definitions of Responses
Measure Definition of Measure Yes/No Response
TB screening (Eligibility: HIV- infected patients without a history of previous TB treatment or a history of a positive PPD) Was PPD testing performed (placed and read within 72 hours) in the past 12 months? Yes: PPD screening was performed (placed and read)
No: PPD screening was not performed (or it was placed but results were not documented)
PCP prophylaxis Did the patient with <200 CD4 cells/mm3 and no sustained CD4 cell increase to >200/mm3 during the last 6 months of the review period receive PCP prophylaxis? Yes: The patient received PCP prophylaxis
No: The patient did not receive PCP prophylaxis

The data collection plan includes determining the source of information, such as whether medical records or an electronic database will be used, how the data will be recorded, who will record the data, and how a sample will be selected. A representative sample will allow inferences to be made about the clinic population based on observations of the smaller sample. Some form of random sampling should be used, either from a random numbers table, or a selection of every nth record from the list of eligible patients.

A common pitfall at this point is to think of the measurement sample as a research project. For the purposes of QI, a sample just needs to be current, representative, and readily obtained (ie, sample size calculations and the achievement of statistically significant results are not necessary).

Should you measure only one indicator at a time?

Definitely not. Several indicators should be measured simultaneously, whether abstracted from medical records or analyzed through administrative databases. Indicators reflecting different aspects of patient management should be selected, as well as those involving different populations. Indicators should also be selected to evaluate different components of the health care system, such as the different components of the chronic disease model.

How should you analyze and display data?

Data should be reviewed and distributed to all members of the team and others involved in the care process under evaluation. Whenever possible, data should be displayed in graphic format. Once data from several time periods have been collected (eg, rates of patients with viral load performed every 4 months collected in 2 different time periods), a simple line graph (run chart) can be constructed with each point representing a performance rate (percentage) for a given period of time. This is usually the simplest and most effective way to show performance data (see Figure 17-1).

Figure 17-1: Sample Run Chart: Percentage of Patients PPD Tested, by Month

Figure 17-1. Sample Run Chart: Percentage of Patients PPD Tested, by Month. A line graph with the Month (Jan through Dec) on the horizontal X-axis and Percent (0% to 100%) on the vertical Y-axis.  The month/percentage pairs of the line show these approximate values: Jan/60%, Feb/70%, Mar/74%, Apr/62%, May/57%, Jun/63%, Jul/73%, Aug/80%, Sep/79%, Oct/81%, Nov/76%, and Dec/85%.

Source: Measuring Clinical Performace: A Guide for HIV Health Care Providers. New York, NY: New York State Department of Health AIDS Institute. April, 2002.

How does improvement occur?

Once the data have been reviewed by the team and the process for improvement identified, the next step is to decide where opportunities for improvement exist. This process is described as the PDSA (Plan-Do-Study-Act) or PDCA (Plan-Do-Check-Act) cycle (see Figure 17-2).

The first step is to investigate this care process in greater detail. Several techniques are often used to accomplish this goal. The simplest is brainstorming, in which individuals offer their suggestions for which processes are the best candidates for change. Another easy method is flowcharting, in which the group breaks down the process into its components to identify how it is coordinated and how its parts fit together. Then, the areas that would be most likely to benefit from improvement are selected for change (see Figure 17-3).

Figure 17-2. Plan-Do-Study-Act Cycle

Figure 17-2. Plan-Do-Act-Study Cycle. A circle is divided into quarters, with an arrow circling it indicating a clockwise direction to the cycle of actions.  The quarters are named (beginning with upper right and proceeding in a clockwise direction) Plan, Do, Study and Act. Plan means plan the change and collect baseline data. Do means test and change and collect data. Study means analyze the data. And Act means" If the change did not improve the process, try another idea. If the change resulted in improvement, adopt the change, monitor the process periodically, and spread the change throughout the clinic.

Once a change in a particular step of the process has been selected, a pilot test of the change can be quickly implemented and evaluated. A limited implementation of the proposed change can be tested - perhaps with just the next few patients, or those attending on the next day, or those seen by a particular clinician. If the pilot does not work, another change can be selected and quickly implemented. If the change is feasible and improvement is noted, then the change can be adopted more widely, before formal remeasurement occurs, and a regular period of remeasurement adopted. If the change was not successful, then another one can be chosen and tested.

What systems need to be established to support QI?

The key to sustaining QI in the clinic is development of an infrastructure that supports ongoing QI activities. The central components of this infrastructure include:

  • A QI Plan with goals and a process to prioritize
    these goals
  • An organizational framework that displays clear
    lines of accountability for QI in the organization
  • Commitment of senior management staff to support the program, allocate resources, and celebrate its successes
  • Creation of a culture that supports quality in the program and that values the activities of QI as part of the regular work of the clinic (see Table 17-5)
  • Establishment of a formal QI Committee to oversee quality activities, monitor the Quality Plan, and evaluate its effectiveness

Figure 17-3. Sample Flow Chart

Figure 17-3. Sample Flow Chart. A flow chart outlining the steps between "Patient arrives at front desk" at the top to "Medical nurse takes patient into exam room" at the bottom. From the "Patient arrives at front desk" oval, the chart shows "Nurse asks patient to complete paperwork for new clients and return it to the front desk" as the next step. The flow reaches a decision diamond next: Patient in System  If the answer is "Yes," the next step is "Ask patient to be seated in the waiting room." ?  If the answer is "No," the flow branches to the right to "Nurse asks patient to complete paperwork for new clients and return it to the front desk" before branching back to the main flow at "Ask patient to be seated in the waiting room." The flow suggests more steps take place before reaching the goal: "Medical nurse takes patient into the exam room."

Source: New York State Department of Health AIDS Institute. HIVQUAL Group Learning Guide: Interactive Quality Improvement Exercises for HIV Health Care Providers. Available online.

Table 17-5. Tips for Promoting a Culture of Quality Improvement: Integration of Quality into
the Regular Work of the Clinic
  • Educate staff about QI and provide them with the skills to participate in QI activities
  • Communicate results from improvement projects throughout the clinic
  • Display data and storyboards
  • Celebrate successes
  • Articulate the values of QI in meetings
  • Provide opportunities for all staff to participate in QI teams
  • Reward staff members through performance evaluation for their contributions to the QI Program

The regular, ongoing work of the QI Committee, supported by the clinic's leadership, constitutes the backbone of the infrastructure that supports ongoing QI activities. The committee oversees the dynamic process of planning, implementation, and evaluation that involves:

  • Analysis of data from the QI projects
  • Solicitation of feedback from participating staff
  • Decision-making based on the information from its analysis

These activities contribute to sustaining the QI Program and its activities in the clinic.

Will improvements last?

Sustainability is probably the biggest challenge that clinics face in the field of QI. All too often, improvements do not last once initial projects are completed, because the structure and culture to support QI is not present or is not supported. The challenge of sustainability is therefore two-fold - not only to maintain the successes of QI work and its clinical outcomes, but also to maintain the systems of QI and to keep the QI program vital. By asking questions about how care systems can be improved and how QI activities are progressing, clinicians play an important role in both catalyzing and supporting QI activities.

What are the key components of a quality plan?

The key elements of a quality plan include a quality statement that describes the purpose and goals of the QI program, priorities of the program, a description of the organizational systems needed to implement the program, including committee structure and functions, definitions of accountability, roles and responsibilities, the process for obtaining consumer input, core measures, data collection processes, and a description of how the plan will be evaluated.


Key Points TOP
  • Providers play an active role in the activities of QI and can lead these efforts by asking questions to determine how improvements can be made. Although the QI program may require extra work from busy providers, the opportunities to systematically measure clinical performance will provide useful information that leads to better care for the patients they serve.
  • QI includes regular measurement of care processes, analysis of processes and systems of care, and implementation of solutions to improve care and monitor their effectiveness. The goal of QI is to achieve optimal health outcomes for patients.
  • QI teams identify areas of change, implement pilots to test the change, review data assessing the change, and ultimately make recommendations about improvements. When staff members from the systems being assessed work together in teams and are engaged in the QI process, they are more likely to generate ideas and to accept changes.
  • Indicators, measurable aspects of care that evaluate the extent to which a facility provides a certain element of care, should be based on standards or guidelines, meet the primary goals of QI, and reflect priorities specific to the community and the clinic.
  • Once data have been reviewed by the team and the process for improvement identified, the next step is to decide where opportunities for improvement exist. This process is described as the PDSA (Plan-Do-Study-Act) process. The first step is to investigate this care process in greater detail. Once a change in a particular step of the process has been selected, a pilot test of the change can be quickly implemented and evaluated. If the pilot is successful, the change can be adopted widely. If the pilot is not successful, another change can be selected and tested.
  • Sustainability is probably the biggest challenge that clinics face in the field of QI. The key to sustaining QI in the clinic is development of an infrastructure that supports ongoing QI activities.

References   TOP

Institute for Healthcare Improvement. HIV/AIDS Bureau Collaborations: Improving Care for People Living with HIV/AIDS Disease. Boston: Institute for Healthcare Improvement; 2002.

Institute of Medicine. Medicare: A Strategy for Quality Assurance. Vol.1. Washington: National Academy Press; 1990.

Institute of Medicine. Crossing the Quality Chasm. Washington: National Academy Press; 2001.

Institute of Medicine. Measuring What Matters: Allocation, Planning, and Quality Assessment for the Ryan White CARE Act. Washington, DC:The National Academies Press; 2004.

New York State Department of Health AIDS Institute. HIVQUAL Group Learning Guide: Interactive Quality Improvement Exercises for HIV Health Care Providers. New York, NY: New York State Department of Health AIDS Institute.

New York State Department of Health AIDS Institute. Measuring Clinical Performance: A Guide for HIV Health Care Providers. New York, NY: New York State Department of Health AIDS Institute; April 2002.