Department of Labor Seal photos representing the workforce - digital imagery© copyright 2001 photodisc, inc.
Department of Labor Seal www.osha.gov   [skip navigational links] Search    Advanced Search | A-Z Index
Evaluation of the Voluntary Protection Program > Appendix F VPP Programs
Link to Printing InstructionsPrinting Instructions
APPENDIX F: Data Analysis Plan


OSHA –VPP Gallup Evaluation
Revised Data Analysis Plan
November 1, 2004

Mentoring Analysis
  1. How many sites conduct mentoring currently (or have in the past 12 months)? What percentage of all VPP sites does this represent?
  2. How many sites have conducted mentoring in the past but no longer conduct mentoring currently (or have in the past 12 months)?
  3. The number of people who have conducted mentoring in the past 12 months (average by site might be interesting also)
  4. Number of sites (average and/or median) mentored by a given facility (can do this by years in VPP as well which might be of more interest)
  5. How many total hours and how many average hours are spent on mentoring activities by the mentor per month and per year?
  6. What is the average number and the total number of employees at each site and by all sites affected by mentoring?
  7. Do mentoring activities increase with amount of time in VPP? (conducted on a site-by-site basis)
  8. Is there a difference in number of hours spent mentoring based on VPP designation (Star or Merit)?
  9. What is the breakdown, percentage and number, on sites mentored and hours spent mentoring sites within the corporation vs. sites outside of the corporation within the past 12 months?
  10. How does the amount of mentoring vary by site size, industry, and length of time in VPP?
  11. Does the number of years as a mentor correspond with the number of sites mentored that become VPP (analysis by site)?
  12. Of all sites mentored, how many (percentage and number) applied for and became VPP sites?
  13. Of the sites you have mentored in the last 12 months, how many people are affected directly by the VPP mentors (# of employees per site)?
  14. Within the last 12 months, do these numbers differ significantly inside/outside the corporation? Provide a breakdown of these numbers.
  15. How many sites conduct mentoring for non-VPP bound companies ( by industry)?
  16. How many hours are spent on mentoring for non-VPP bound companies (by industry)?
  17. Do sites believe they are spending too much time or too little time on mentoring and what are their projections for spending future amounts of time (# of hours) on it (by industry)?
  18. Why would sites want to give up or downsize their amount of mentoring activity?
  19. In the past year, how many sites mentored facilities within their own company (by industry)?
  20. How many sites are required to mentor other sites within their own companies?
  21. How many more hours per month/year would mentors be willing to spend on mentoring activities?
  22. Estimate a model to show the projected number of hours needed to service future VPP-bound sites
  23. Estimate a model to show the amount of mentoring to be performed on a yearly basis (by industry and/or by employee size, if data exists).
Outreach Analysis
  1. How many sites (percentage and average number) conduct outreach (by industry)?
  2. How many people (percentage and average number) attend any given outreach (by activity type & on average)?
  3. How many hours are spent on these activities by the outreach worker in a one-month period? In a twelve-month period? By site
  4. Do outreach activities increase with amount of time in VPP? Provide this breakdown.
  5. Is there a difference in number of outreach activities based on VPP designation (Star or Merit)
  6. What is the breakdown of outreach activities conducted in sites within the corporation vs. sites outside of the corporation?
  7. Does this type of outreach activity vary by site characteristics of the person providing the outreach? Define site characteristics.
  8. Which types of outreach activities are done the most and least? How does this vary by site characteristics?
  9. To what extent are people inclined to work on only one type of outreach program or do they participate in multiple outreach programs?
  10. Do outreach activities increase with the amount of time in VPP?
  11. To what extent are sites inclined to participate in only one type of outreach activities or do they participate in multiple outreach programs?
  12. Do these numbers differ significantly when outreach program is sponsored by VPP vs. non-VPP sponsorship?
  13. Do these outreach workers believe they are spending too much time, too little time on outreach and what are their projections for spending future amounts of time on it?
  14. Why would people want to give up or downsize their amount of outreach activities?
  15. How many additional hours per month/year would people be willing to spend on outreach activities?
  16. Estimate a model to show the amount of outreach to be performed on a yearly basis (by industry and/or by employee size, if data exists).
Injury and Illness Data (each of these questions are contingent on gathering sufficient data) Major Research Question: What are the Injury and Illness Reductions at VPP Site?
  1. Gallup will look at prior-VPP data over time to see if any loss or improvement occurs consistently. For example, between year 2 and 3 prior to acceptance into VPP, is there a larger change than between two other years? Also, is there a big difference between injury and illness data year 2 compared to year 3? This analysis will be conducted by employee size and by industry grouping to understand what happens as a company becomes eligible for VPP.
  2. Plot a performance curve for each participant grouping (employee size and industry grouping) based on the number of days away from work, number of other recordable cases (and any other items deemed important) from the baseline looking for change in scores over time.
  3. Calculate regression coefficients over time by industry and/or employee size once accepted into VPP (given the goodness of this existing data that OSHA has on these sites). The regression equation will be used to estimate rates at a given point in time. For instance, the coefficients will tell us what we would predict for days away from work at three years into the program compared to two years into the program. This analysis will also be conducted by star and merit categories.
  4. Determine whether VPP applicants improved their records compared to their industry peers (by comparing to BLS SIC average illness and injury rates for each site in the analysis data set) for the five years prior to acceptance into VPP and the five years of data subsequent to acceptance into the program provided by OSHA. A statistical test of averages will be conducted by SIC code to determine if any significant differences exist.
  5. Calculate TCIR/DART/injury and illness rates per site per year by employee size and industry type.
  6. Is there a point in time when sites tend to shift in terms of a significant change from previous injury and illness rates or does it depend on the site? A statistical test of diminishing returns will be performed to see what point in time a significant shift occurred.
  7. Do some of the injury and illness rates change more/less dramatically than others over time? If so, what are the characteristics of these sites whose rates change more or less?
  8. Was there an event that occurred prior to their acceptance into VPP which effected how quickly their numbers changed? An analysis will be conducted that compares those sites with a significant event occurring to those sites without a significant event occurring in terms of their changes over time.
  9. Consider this information gathering in terms of other OSHA programs; specifically the Strategic Partnership Program, and develop a model that estimates changes over time that could be used for other OSHA programs.
  10. Propose a model that OSHA can use to estimate potential gains in injury and illness rates given length of time in VPP.
  11. Propose additional data for OSHA to collect to continue to be able to calculate interval gains for VPP participants.
Business Case Analysis
  1. Identify list of costs by SIC code
  2. Identify list of gains by SIC code
  3. Identify and collect the data that would need to be collected for to obtain Total Costs, Total Benefits, and ROI for each of the sites
  4. Identify potential number of models that can be generated based on number of sites per SIC code and per number of employees.
  5. Document the cost savings in the models for VPP sites by completing an ROI analysis.
  6. Assess Discuss the usefulness of these models for other OSHA programs.
 
 
Back to Top Back to Top www.osha.gov www.dol.gov

Contact Us | Freedom of Information Act | Customer Survey
Privacy and Security Statement | Disclaimers
Occupational Safety & Health Administration
200 Constitution Avenue, NW
Washington, DC 20210
  Page last updated: 03/15/2007