and Health Training
With Technical Assistance from:
June 1998
Disclaimer
Mention of company names or products does not constitute endorsement by the National Institute for Occupational Safety and Health (NIOSH), Centers for Disease Control and Prevention (CDC).
Copies of this and other NIOSH documents are available from the
To receive information on other occupational safety and health issues, call
DHHS (NIOSH) Publication No. 98-145
Foreword
Occupational safety and health training remains a fundamental element in workplace hazard control programs. As training objectives, recognition of job hazards, learning safe work practices and appreciating other preventive measures are expected to contribute to the goal of reducing occupational risk of injury and disease. This report reviews data found in the literature reflecting the significance of training in meeting these kinds of objectives and outcomes. As will be seen, there is much positive evidence but the results seem very selective and highly qualified. An analysis to identify factors underlying a successful training experience is also presented and does confirm basic principles of learning. Here too, however, important gaps are noted in the available data. The document proceeds to offer an agenda for addressing outstanding needs and ways for strengthening the role that training can play in improving workplace safety and health. The reader audience concerned with these kinds of issues should find this report to be most informative.
Linda Rosenstock, M.D., M.P.H.
Abstract
More than 100 Occupational Safety and Health Administration (OSHA) standards for hazard control in the workplace contain requirements for training aimed at reducing risk factors for injury or disease; others limit certain jobs to persons deemed competent by virtue of special training. A literature review was undertaken to assess the merits of such training rules to achieve this objective and to sort out factors of consequence. The review focussed heavily on published reports, primarily drawn from the period 1980 through 1996, wherein training was used as an intervention effort to reduce risk of work-related injury and disease. Eighty (80) such reports were found and gave overwhelming evidence to show the merits of training in increasing worker knowledge of job hazards, and in effecting safer work practices and other positive actions in a wide array of worksites. Reports from select surveys and investigations of worker injuries and workplace fatalities were also accessed with many implicating lack of training as a contributing factor to the mishaps. In still other studies, workplace training devoted to first aid instruction showed linkage to reduced worker injury rates, suggesting that even this kind of training has benefits to job safety overall.
A critical analysis of the above findings found certain qualifications in viewing training impacts and successes with regard to current workplace standards. For example, most of the reported training intervention studies did not address OSHA training rules per se, and knowledge gain and safe behavior measures were used in many evaluations as opposed to actual injury/disease indicators. Also, in some instances, the training was coupled with other forms of intervention to make attribution difficult. Training deficits noted in some surveys of work injury cases lacked for confirmation and no information was available on the quality of the instruction if given at all.
Despite the above reservations and uncertainties, training's role as a necessary element in developing and maintaining effective hazard control activities remained firmly supported by the available literature. What did emerge from this review and analysis was an appreciation of meaningful training procedures and the recognition of factors both within and beyond the training process that could greatly affect its impact. In this regard, the OSHA voluntary training guidelines were described along with illustrations from the reports to show how the various steps contained within them can be met in realistic ways and have merit in framing an effective program. In addition, factors both within and beyond the training process were assessed for their effects on training outcomes based on data found in the reviewed literature. Variables such as size of training group, length/frequency of training, manner of instruction, and trainer credentials were each shown to be significant determinants to the training process. Equally important were extra-training factors such as goal setting, feedback and motivational incentives along with managerial actions to promote the transfer of learning to the jobsite.
Based on the literature review, follow-on efforts to address outstanding issues and needs regarding effective occupational safety and health training were noted.
Back to the Table of Contents
Executive Summary
This review sought evidence from the literature bearing on two questions: Are occupational safety and health training (OS&H) requirements, as cited in many Federal standards governing workplace conditions and operations, effective in reducing work related injury and illness? Does the available evidence show certain training factors or practices to be more important than others in having positive effects on these outcome measures?
The literature search focussed on reports of training intervention efforts designed in whole or in part to enhance worker knowledge of workplace hazards, effect behavior changes to ensure compliance with safe work practices, or prompt other actions aimed at reducing the risk of occupational injury or disease. Eighty (80) such reports met criteria for inclusion. They were products of two literature searches. The first search covered the period up to 1993; the second extended the first search through 1996. The included work came mainly from the period 1980 through 1996 and, by intent, addressed five types of hazardous agents. These were: traumatic injury forces, toxic chemicals/materials, harmful physical factors, ergonomic stressors, and biologic/infectious agents as encountered in an array of work settings. The search also examined data from select surveys and investigative reports where training factors were either implicated in the etiology of workplace injury or disease incidents or, alternatively, were considered a key element to the success of worksite hazard control programs that showed exemplary safety and health records. Still another source for information was reports of worksite training directed to other needs (e.g., first aid) but that had apparent positive effects on worksite safety and health indicators as well.
With regard to answering the first question, the literature accessed and reviewed in this report offered much direct and indirect evidence to show the benefits of training in establishing safe and healthful working conditions. The intervention studies in particular were especially supportive. Findings here were near unanimous in showing how training can attain objectives such as increased hazard awareness among the workers at risk, knowledge of and adoption of safe work practices, and other actions that improve workplace safety and health protection. Data from other types of studies suggested too that lack of required training may have contributed to events where workers were injured or killed.
Although affirming the effectiveness of training to meet hazard control objectives, this review also drew attention to some shortcomings in the supportive data. For example, the training intervention work that offered the most positive evidence did not address OSHA training requirements per se. Rather, the training interventions targeted site-specific problems, and while showing success in resolving such problems, i.e., improving safety performance, their exact relationship to OSHA mandated training rules was unclear. Moreover, where studies reported lower injury rates, reduced lost time or medical costs after training, analyses were lacking to show how the improvements could be accounted for by the positive results from training when measured in terms of knowledge gain or behavior indicators. One study that attempted such an analysis found that the targeted training could only account for 25% of the observed reduction in injury rate. Also, in some instances, the training was coupled to other forms of intervention (engineering, ergonomic) so as to make attribution even more difficult. Still another tempering fact was that successful training results appeared greatly influenced by "extra-training" considerations. Management's role/support of safety training and its transfer to the jobsite, setting goals and providing feedback to motivate use of the knowledge gained, and offering incentives or rewards for reinforcing safe performance all seemed crucial to attaining a positive result. These types of factors are not acknowledged in OSHA training requirements. It is noteworthy that a proposed OSHA safety and health program standard does recognize the need for management actions to support OS&H training among other critical components.
Some reports that suggested training deficits as factors contributing to injury/health problems lacked for confirmatory information. In other reports, workers who had received training to protect them against certain job hazards were nevertheless afflicted. Missing in these cases was information about the quality of the training offered; whether it met OSHA requirements, or took note of any of the extra-training factors noted above.
Even with the above reservations and uncertainties, however, the role of training as a necessary element in developing and maintaining effective hazard control activities appeared firm. Indeed, the issue was not so much whether OS&H training could make a difference in reducing risks from workplace hazards. Clearly, it can. But rather ascertaining the conditions for maximizing these training effects. This was the second question posed in this review and two approaches were used to offer a response. One effort focussed on the OSHA voluntary training guidelines wherein examples were extracted from the set of intervention studies to highlight the different steps that had to be taken. Various exhibits in this exercise showed how the steps could be met in realistic ways and could have merit in framing and implementing an effective training program.
A second approach considered factors not covered in the OSHA guidelines but more specific to the training process itself or the attainment of its objectives. Variables included were the size of training group, length and/or frequency of training, manner of instruction, trainer credentials, and training/transfer conditions. Addressed among the latter conditions were extra-training factors such as management/supervisory roles and motivational techniques for reinforcing the learning at the jobsite. The intervention studies were examined for data that could justify statements as to the significance of these factors and/or conditions and where they had the greatest potential for effecting successful training outcomes. A set of statements, tying together evaluative information from the different reports, emerged from this exercise. Some were more supportable than others owing to limitations in the data contained in the reports under review. Most statements about specific factors agreed with concepts in the general learning and motivation literature, i.e., increases in training time per unit group of workers or use of more frequent and shorter sessions suggested more favorable outcomes as did active learning experiences stressing jobsite applications. Some unique extensions or refinements were also noted such as the added benefits of having supervisors or foremen assume a more active trainer role in workplace safety and health training as opposed to others who may have that special responsibility. Particular attention was drawn to the length and frequency of training because of its implications for training schedules, both for initial and for refresher instruction. Needs to develop a decision logic for this purpose were mentioned along with some of the variables to be addressed.
Suggestions for follow-on work were offered to take account of the gaps in the reviewed literature or other shortcomings in responding to the two questions posed. Among those recommended were:
1) Undertaking studies to ascertain how industry is responding to OSHA training rules and the quality of such efforts. The major data set used in this literature review were researcher directed efforts and, for that reason were not the norm. Focussing the efforts on the most prevalent types of injuries and illnesses and selecting industries or work operations where they are most recurrent would be ideal. Differences in how the mandated training rules were met at the various selected sites and links between the training undertaken and specific injury and disease risk factors would be analyzed. The extent to which the operant practices followed OSHA training guidelines, and the resulting experiences could offer an important reference in gauging their utility.
2) Conducting in-depth studies of training practices and their interrelationship with other elements in an establishment's hazard control program. Directing this effort at companies showing exemplary safety and health records could offer program models for effective training that can best complement or enhance other workplace measures aimed at maximizing risk management.
3) Using case-control or cohort studies to compare differences in the level of training of workers injured or afflicted by occupational disease against those not so affected. The intent here would be to get a better assessment of how training deficits can lead to such problems. Such an analysis would require measures to separate out many nontraining factors that could also be responsible for apparent differences in these cases.
4) Convene workshops to discuss issues concerned with the effectiveness of worksite OS&H training both now and in the future. Invitees would include experts and practitioners conversant with OS&H training, job skills training, health education, organizational behavior and evaluation subject areas. The workshops would seek to pool ideas bearing on the questions posed in this report and added concerns such as the adequacy of current regulatory language in OSHA training rules, future training challenges due to changing workplace technologies, worker demographics, measurement outcomes for assessing the effectiveness of training, the merit of merging different workplace training domains (i.e., OS&H training, job skills training, worksite health promotion), and other issues. |
Table of Contents
It was these issues that prompted this literature review. The originally conceived purpose was to address two questions:
Q-1: Can the occupational safety and health (OS&H) training requirements cited in numerous Federal standards governing workplace conditions and operations be shown to be truly effective in reducing work related injuries and illness? Q-2: Does the evidence single out certain elements or characteristics of training programs as having the most positive effects on worker safety and health?Approaches to answering these questions would seem straightforward. Among the more obvious:
As noted in the course of this review, the existing literature only partially satisfies these approaches. For example, reports of efforts to comply with prescribed OSHA training rules are relatively few; more common in the literature are training studies targeting site-specific problems that may or may not be covered by regulation. Knowledge gain, attitude change, indications of safer work procedures being adopted by the workers are most frequently used to measure the training impact. Fewer studies note reduced injuries or disease outcomes from training, and if they do, there are cautions about drawing cause-effect conclusions. Results of epidemiology studies of occupational injury and disease may suggest training shortcomings as contributing factors but lack for baseline data or other evidence needed to support such claims. Assessments of OS&H training practices or the merits of certain instructional methods as found in the literature may not always be able to separate training-specific effects from other workplace factors. Also, in many instances, data collection for worksite training evaluation purposes may not always follow sound study design principles.
Clearly, then, the current literature cannot supply complete answers to the questions posed. Definitive responses require more research and some suggestions for such work are described at the conclusion of this report. Even with the above reservations, the benefits of a literature review at this time are believed twofold. First, to offer a preliminary appraisal of the merits of training directed to workplace safety and health concerns. Second, to offer a conceptual framework for treating OS&H training so as to clarify the issues that should be addressed in follow-on efforts.
Although the literature has much theory on learning having relevance to training, this review is not theory driven, i.e., intended to serve as a test of specific hypotheses derived from specific theoretical formulations. As will be noted, the treatment in various places does take account of suggested training models or guidelines for purposes of organizing and analyzing the material under review.
It is envisioned that this report can serve different audiences. For one, policy-makers engaged in setting OS&H standards need to be assured that training requirements are essential to achieving improved workplace safety and health. Finding such supportive evidence for training rules would offer this assurance. Also, information on whether certain rule formulations have more merit than others in producing successful training results would be of benefit to policy-makers. A second audience would be researchers. This review reveals both strengths and weaknesses in the database for effective training procedures and factors affecting OS&H training. Especially challenging and needed are studies to definitively tie immediate training results, e.g., increased knowledge of hazards and safer work behaviors, to outcome indicators such as reduced worker injuries and illness. A third and last audience for this report would be those who conduct OS&H training. Indeed, the wealth of training studies appended to this report is an information resource on instructional methods and evaluation techniques. By addressing different types of hazards in a variety of work settings and offering measures for indicating effects, they offer important lessons for OS&H trainers.
Back to the Table of Contents
A. Basic Program Thrusts
The OTA report included an analysis of 40 worker training and worker education programs conducted by business firms, trade associations, unions, hospitals and universities, and coalitions of OS&H groups. The analysis of activities and objectives suggested four types of programs: fundamental, recognition, problem-solving, and empowerment programs.
Fundamentals Programs: These programs involve instruction in prevention of work-related injury and illness through proper use and maintenance of tools, equipment, materials; knowledge of emergency procedures; personal hygiene measures; needs for medical monitoring; and use of personal protective equipment for non-routine operations or as an interim safeguard until engineering controls can be implemented.
Training interventions having these objectives permeate the literature and comprise most of the reports in Appendix A, which offers an inventory of studies aimed at evaluating the effectiveness of OS&H training for controlling workplace hazards.
Recognition Programs: These programs include instruction emphasizing awareness of workplace hazards; knowledge of methods of hazard elimination or control; understanding right-to-know laws and ways for collecting information on workplace hazards; recognizing symptoms of toxic exposures; and observing and reporting hazards or potential hazards to appropriate bodies. Training activities of this type were spurred largely by the OSHA Hazard Communication Standard (OSHA, 1983). The standard required employers to inform workers of chemical hazards found in their work areas and of ways to reduce apparent risk. Use of Material Safety Data Sheets and labels along with training are the three means prescribed for communicating the essential information. Several reports evaluating training efforts of this type are found in Appendix A.
Problem-Solving Programs: Instruction is aimed at giving workers the information and skills enabling them to participate in hazard recognition and control activities; to help identify/solve problems through teamwork, to use union and management means, and to exercise rights to have outside agencies investigate workplace hazards when warranted. Inviting worker input in company planning or in design of new operations or processes is recognized as a viable means for improving productivity, quality of products, and worker motivation. Extending this approach to hazard control seems reasonable especially since workers, owing to their everyday job work experience, possess an intimate knowledge of the hazards connected with their jobs and could be a rich source for corrective ideas. One report in assessing a worker participation approach to hazard control at a worksite (Lin & Cohen, 1983) found the overall effort to be successful but at the same time took note of some gaps of worker knowledge for which added worker instruction would have been of benefit. This report is listed in Appendix A along with other reports of union-sponsored efforts to sharpen worker skills in addressing the requirements of specific OS&H standards so that they could play a more effective role in responding to their workplace needs.
Empowerment Programs: These programs provide instruction to build and broaden worker skills in hazard recognition and problem-solving skills much like that noted above. Emphasis, however, is on worker activism with the goal of ensuring their rights to an illness-and injury-free workplace (Wallerstein & Baker, 1994). Hence, the program aims at enabling workers to effect necessary control measures through educating co-workers and supervisors, and through use of committee processes or in health/safety contract negotiations. This approach is in accord with the current "Total Quality Management" philosophy - having rank-and-file workers along with their supervisors share greater roles in and be more accountable for addressing workplace hazard control needs. Several reports of union and university coalitions engaged in furnishing such training and some first attempts to provide outcome measures are noted in Appendix A.
The above types of training suggest a progression from a workforce learning basic forms of protection to known hazards, through instruction aimed at enhancing their awareness of potential problems and problem-solving skills, and then learning how to make it all happen in their workplaces. Although treated separately, any given training program may contain elements of these approaches in varying degrees.
B. Worksite Training on Health Protection/Health Promotion
Personal lifestyle and occupational risk factors may interact in ways that can heighten the potential for adverse outcomes. For example, asbestos workers who smoke may have a 10-fold greater risk for lung cancer (Hammond, et al., 1979); alcohol or illicit drug use has been implicated in work accidents in high risk jobs (Holcomb, Lehman & Simpson, 1993). Alternatively, exercise training for enhancing physical fitness has been suggested as an added means to limit strains from jobs imposing undue stress on the musculoskeletal system (Genaidy, Gupta, & Alshedi, 1990; Hilyer et al., 1990; Shi, 1993). For these reasons, training and education activities addressing worksite health protection and health protection goals in combination may have mutually reinforcing effects. While health promotion studies are outside the scope of this literature review, some reports of these worksite activities have been evaluated from the standpoint of reducing occupational risks and will be so noted.
OS&H training as implemented at the workplace rarely has a stand-alone status. For example, OS&H training may be a natural part of job skills training or a simple add-on. On-the-job type of training, of necessity, would have to cover both objectives. In some cases, work methods to be learned and safe work practices prescribed by OSHA standards are much the same. In occupations such as logging, "poor technique" is widely reported as a cause of injury with inadequate training cited as the underlying problem. This shortcoming refers to a failure to develop (learn) proper work methods and the safety precautions that derive from them (Slappendel et al., 1993).
OS&H training is also an element of hazard control programming. Instruction in hazard recognition and control methods, knowledge of emergency procedures, and use of personal protective equipment may or may not be distinctive-the degree depends on what OSHA requirements may dictate. The Hazard Communication Standard (OSHA, 1983) for example, requires a written training plan describing the nature of instruction to ensure workers understand the chemical hazards to which they might be exposed, recognition of symptoms of overexposure, safeguards to be taken Other standards merely acknowledge the need for training but are less explicit as to requiring evidence of a plan for its implementation. Although not always recognized, OS&H training may also be needed to cover operational aspects of engineering or physical hazard control systems so that their benefits are realized to the fullest extent.
OS&H instruction as a component of both regular job training and worksite hazard control program practices is depicted in Figure 1 as nested in and representing the overlapping parts of these two types of activities. Encircling the job training and occupational safety and health program efforts are factors which can shape the success of these activities and their respective impacts on productivity and safety/health experience. Indeed, the transferability of training to actual jobsite demands, use of promotional or motivational efforts to drive the training exercise as well as boost post-training performance in both productivity and hazard control terms, and management's commitment to these activities as communicated to the workers can do much to affect these kinds of outcomes. Encompassing all of the above and shaping the ultimate results are an employer's goals and objectives. Presumably, management policies and actions that do not put company productivity and worker safety and health in conflict but rather stress their positive interrelationships would be ideal.
Viewing OS&H training in this context underscores the difficulty in attempts to treat or evaluate its effects separate from other workplace considerations. This is especially true if "bottom line" outcomes such as work related injuries and illness are used in the assessment. As will be noted, many evaluations of OS&H training use measures more immediate to the learning process itself (e.g., knowledge gained); others may take account of the instruction plus certain extra- or post-training factors in assessing on-the-job safety performance. In these instances, surrogate indicators for injury or disease reduction may be used (e.g., increased compliance with safe work practices and/or associated changes in exposure levels); these indicators can offer more opportunity for discerning effects than injury or illness measures. It must be remembered that work related injury or disease cases at least at the individual employer level are rare events which can complicate efforts at evaluating change.
Figure 1. Depiction of occupational safety/health (OSH) training as nested in other employer programs which are affected by numerous extra- or post-training factors. Interactions here complicate efforts to assess training-specific impacts on safety/health experience or productivity/performance measures. Employer goals and objectives and related policies ultimately determine the priorities or trade-offs between the two outcomes.
A. Some Definitions
Performance represents observable actions or behaviors reflecting the knowledge or skill acquired from training to meet a task demand. With regard to OS&H, performance can mean signs of complying with safe work practices, using protective equipment as prescribed, demonstrating increased awareness of hazards by reporting unsafe conditions to prompt corrective efforts, and executing emergency procedures should such events occur.
Motivation refers to processes or conditions that can energize and direct a person's behaviors in ways intended to gain rewards or satisfy needs. Setting goals for performance coincident with learning objectives and use of feed-back to note progress have motivational value. With regard to OS&H, motivation can mean one's readiness to adopt or exhibit safe behaviors, take precautions, or carry out self-protective actions as instructed. Bonuses, prizes, or special recognition can act as motivational incentives or rewards in eliciting as well as reinforcing these behaviors when they are displayed.
Knowledge or skills acquired in training may not always result in improved performance in actual work situations. This may indicate 1) lack of suitable motivation, 2) training content does not fit job demands (i.e., a problem in defining suitable training objectives, or 3) dissimilarity or conflicts between the instruction/practice in training conditions when compared to actual job conditions (i.e., a problem in transfer of training). More is said about this in the sections to follow.
B. Critical Training Elements
1. Needs Assessment
Step #1: ReactionHow did the trainees like the program? Typically this is done through evaluation sheets completed at the end of the training. Typical items inquire as to whether the material was well organized, relevant to the trainees needs, made interesting through the instructor's manner of presentation or use of visual aids, demonstrations, etc. |
Step #2: Knowledge Gain (or Skills Acquired)What principles, facts and techniques were learned? Knowledge of facts and principles is usually evaluated via pre/post paper-and-pencil tests or quizzes. Assessment of skills may be done through performance tests before and after training. An untrained or control group can be similarly tested to indicate any differences resulting from just the test-retest experience |
Step #3: Behavior ChangeWhat changes in behavior occurred as a result of the program? For this purpose, reports by the trainees themselves (self-appraisals) of their on-the-job performance, or observations by their peers, supervisors, instructors can be used. A time interval between the end of training and the observations may be necessary to allow for the training to be put into practice. Post-training measures taken at different time points are also suggested to determine if the training effect is sustained or needs refreshment. Again similar observations for a control group are recommended to acknowledge any effects from repeated testing. These control data also provide an added reference for gauging the significance of the apparent behavior changes in the training group. |
Step #4: ResultsWhat were the tangible results of the program in terms of its objectives or goals for the organization? Did it result in reduced injuries or illness, lower medical costs, improved productivity? As noted in Figure 1, extra- or post-training factors can affect these types of outcomes, and it is not always possible to design evaluations that can isolate the specific training contribution. Undertaking evaluations where these "extra-training factors" are held constant during the pre-and post stages of the training assessment or can be segregated as to their influence through use of suitable control groups are ideal. Needless to say, training impacts at the organization level can require an extended time line especially in using injury/illness outcomes owing to their infrequency. |
Criteria for rating training effects are the focus of much discussion in the literature. Several points that deserve mention or added emphasis in light of the subject of this report are:
(2) Reinforcing the above statement, trainee reactions to instruction may bear little relationship to the extent of actual learning. (Liking the instruction does not imply learning). Hence, it should not be used as the sole criterion to gauge effectiveness. Similarly, pre- and post-training quizzes or tests of skill showing the gains from instruction may or may not be related to improved on-the-job performance. Needs for multiple measures of effectiveness are apparent.
(3) As already noted in Figure 1, the effect of training is greatly affected by other workplace factors both in the training and post-training environment. Evaluations will need to account for these factors in terms of their influence on the training outcome.
(4) Simple performance outcome measures representing various levels of achievement may be critical to determining the validity of the instruction but may not indicate the factors that influenced these results. Provision of "process" measures, reflecting various amounts of training time, modes of training, trainer attitude/competency, can indicate why the overall results were or were not achieved. This can be important in efforts to revise the training to improve its efficacy.
A. Nature of Existing OSHA Training Rules
1. Content
2. Frequency/Duration
3. Documentation/Assurance
4. Trainer Qualifications and Specialty Training
5. Methods
Foreign Occupational Safety and Health Training Rules
B. OSHA Voluntary Training Guidelines
The OSHA voluntary training guidelines follow a model whose elements reiterate most of those in the general job training literature reviewed earlier. The seven guidelines below makes this readily apparent.
1. Determining If Training Is Needed
2. Identifying Training Needs
3. Identifying Goals and Objectives
4. Developing Learning Activities
5. Conducting the Training
6. Evaluating Program Effectiveness
7. Improving the Program
The OSHA voluntary training guidelines also contain suggestions for identifying those workers who may be at higher levels of risk and thus have the greatest need for training. Occupations posing known exposure hazards or otherwise shown to be associated with excess injury/illness are one determinant. The age and job service of the worker group in question can be another. (Young, new workers show a disproportionate number of injuries and illnesses.) Still another may be the size of the establishment. (Though the pattern may vary with industry, medium size companies (50 to 249 workers) tend to have higher incident rates than the rates for smaller or larger firms (Bureau of Labor Statistics, 1997).
C. Summary
A. Nature of the Literature review
Regarding items (1) and (4) above, the literature review was confined to those reports that described training plans and objectives, manner of implementation, methods for evaluation, and data/results reflecting effectiveness. Articles offering testimonials to various training approaches, or anecdotal references were not considered. Item (2) dealt with results from questionnaire surveys of persons having certain types of work injuries and investigative reports of workplace incidents where workers were injured, killed or found to exhibit health problems. The intent in both cases was to examine any references to training in appreciating why and how the injury producing event or health problems occurred. Item (3) sought analytical information on company program practices, especially aspects of worker training that were relatable to their success in hazard control.
B. Data Sources Tapped
A total of 25 different reference systems were scanned in the course of searching for documentation. The uniqueness of the indexing systems used with the various information sources coupled with the multidisciplinary nature and use of training concepts made a single list of keywords for searching impractical. In many instances, a customized list of database specific terms made up of a root or common word in combination with free-text search terms having proximal connection to the keyword had to be devised for the search. Some sample terms for one database (MEDLARS) included program-evaluation, risk-management, attitude-to-health, evaluation-studies, dangerous-behavior, inservice-training, patient compliance. Searches for titles through the various databases were conducted while constantly varying the mix of keywords and free-text in essentially a round-robin fashion. This yielded a listing of over 2000 citations which after deleting duplicates, eliminating false hits, was reduced to approximately 700 titles. Abstracts and references to these reports in other reviews found less than 150 to meet one of the four selection requirements noted earlier. The literature base for this review was the product of two searches. The one just described was concluded in 1993 and included reports published no later than that year. A second, subsequent search extended coverage through 1996 and yielded 188 additional titles. Screening abstracts of these reports found no more than 15 to be worthy of further consideration with regard to the purposes of this review.
The references drawn from the two search efforts were mostly from the period 1980 to 1996, though supplemented in some cases by earlier studies believed cogent to training evaluation issues. Final selection ensured representation in five different hazard agent categories which were:
The 5 agent conditions were chosen to reflect work related exposure risks recognized in various ways by current OSHA standards or those under development. (NOTE: Ergonomic agents were included in the data set in light of OSHA plans to develop a standard for controlling work related risks of musculoskeletal disorders (OSHA, 1992).
C. Training Intervention Studies
To varying degrees, the listed reports met the requirements stated above in describing training objectives, some form of training, efforts at implementation, and data collection on certain measures to evaluate the results of the instruction. Where noted extra-training factors of consequence to the evaluation are also entered in the listing. Although the 80 reports do not exhaust the available literature, they represent a large and diverse sample of empirical work which offers the reader a sense of the types of training efforts that have been conducted in addressing workplace hazards, the approaches used in their evaluation, and the results obtained.
Some overall impressions can be gained from viewing Tables 1 and 2 whose entries are culled from the studies listed in APPENDIX A.2
Table 1 tallies the evaluative measures found in the various training intervention studies using a modified version of Kirkpatrick's (1967) classification and the results reported on the measures. Specifically, under the heading of "Subjective/Self-Reports" are columns for "Reaction" (measures of whether the trainee thought the training interesting, worthwhile or relevant); "Knowledge Test" (scores on a quiz or other inquiry to determine their knowledge gain); and "Application" (reports from the trainees that they have changed their work practices as a result of the training or applied the learning in some other way). The heading "Objective/Surrogates" refers to more independent indicators, listing direct observations of "behavior change" or "other markers" (biological, environmental) that can be a product of the behavior changes. Positive changes from training on either of these measures can serve as surrogates for improved health/safety outcomes. The last columns of the table refer to actual measures of safety/health experience reflecting the organizational impact of the training. Note that some studies used more than one evaluative measure so the total number of entries in Table 1 exceeds the 80 reports.
The training target column in Table 2 uses the OTA categorization (1985) for defining the objectives of the study. As noted earlier, these were defined as learning fundamental work practices (FndtWkPract), training in hazard recognition-awareness (HazRecog), worker directed or participative efforts in hazard recognition and control (WkrPartic), and worker empowerment training for the same purpose (WkrEmpwr). The variables column describes the nature of the training conditions and/or other factors manipulated during training or in the follow-on evaluation. Those noted refer to training only (TrngOnly); feedback (FdBk) with and without goal setting (GlSet); use of incentives (Trng&Incentives); and where the training plan called for specific manipulations of training content/delivery variables (TrngMode).
The post-training measures column takes note of the frequency and time span of the data collected on the evaluative measures. The basic categories were short- versus long-term (ShTm, LgTm), and whether the data were collected one or more times (One, Rep). Long-term (LgTm) refers to a post-training period exceeding 3 months,
The last column, headed "Other Considerations", identifies other conditions described in the studies that deserved special mention in light of their likely effect on the results. Nature of management support, workplace constraints or aids to facilitating the training or its application in the post-training environment were among the factors noted.
The following observations elaborate upon the summary data contained in
Tables 1 and 2:
(3) Self-reports, especially knowledge gain and expressions of use in jobs, and objective behavioral measures predominate as outcome indicators in the training interventions. Positive findings of behavioral change from training such as adoption of safe work practices were in a number of instances coupled with reductions in injury, illness, and lost-days cost figures. Although suggestive, the reader is cautioned not to draw conclusions about a training specific effect on the latter indicators. One reason is that the instruction may have focussed on select (high risk) groups whereas the injury reports are for the whole organization. (Work reported by Lepore, Olson & Tomer, 1984 [A-IV] is an example). Some studies lacked proper control groups to rule out other factors that may have been responsible for the result on these types of outcome measures. Also, as one report notes (Reber & Wallin, 1984 [A-I]}), the findings may reflect changes in the manner of reporting mishaps during the intervention period. One deliberate effort to tie successful training outcomes such as improved work practices with reduced injury rates found that the adoption of the recommended work practices could only account for 25% of the actual reduction (Saari & Nasanen, 1989 [A-I]). In this study, worker training focussed on correcting housekeeping conditions believed responsible for an excess number of injuries based on accident reports. Post training observations indicated reduced injury rates far greater than those that could be accounted for by increased compliance with the better housekeeping practices also observed. The authors speculated that the gains in housekeeping left increased capacity for workers to notice other potential hazards. Another effort (Sulzer-Azaroff et al., 1990 [A-I]) suggested that attaining certain targeted safe work practices was responsible for reductions in lost-time injuries but furnished no definitive analysis to show an actual cause-effect relationship.
(4) As noted in Table 2, the work settings/occupational groups as training targets for the intervention studies were diverse. Most major industry categories are represented by the entries- agriculture, mining, construction, manufacturing, transportation, public services. Some entries are in several agent categories owing to the variety of hazards encountered in such work environs. As examples, there are reports of training interventions for health care workers (public services) at risk to injury, ergonomic and biologic hazards; metal fabricators (manufacturing) at risk to injury, chemical, ergonomic and physical agent hazards; warehousemen (transportation) at risk to injury and ergonomic hazards, etc. Employing the OTA classification of training emphases, most of the intervention work reported here is directed to learning fundamental work practices, but the more recent reports show worker empowerment approaches to be popular as well. This is especially true in hazardous waste site training where labor groups in concert with universities are conducting such activities. (Examples are McQuiston et al., 1994 [A-II]; Luskin et al., 1992 [A-II]; Cole and Brown, 1996 [A-II]). Hazard recognition training is also noted as are efforts at worker participation in problem solving. A one-mode training approach has been used in most studies with pre/post types of evaluations performed on the trainee group to assess the effects. Actual training objectives and training approaches, however, are much more varied than this summary would suggest. For example, fundamental type training objectives range from appreciating the more typical safeguards, e.g., use of personal protective equipment, proper operation of machines, housekeeping needs in factory environments, to the more exotic techniques such as defusing potentially violent patients in a mental hospital. The training methods also depict an assortment of approaches-classroom lecture, on-the-job instruction, audio-visual techniques, simulators, demonstrations/role play- with sessions of varying length and frequency. (See APPENDIX A for details.) This wide array of training situations and conditions combined with the positive results underscores the versatility of the learning process. At the same time, it invites efforts to examine whether some factors or factor combinations are more critical than others to attaining successful training outcomes.
2. Intervention Data on OSHA Training Requirements/Guidelines
The intervention studies reported in APPENDIX A and summarized above, though representing deliberate efforts to use training for hazard control purposes, provide only approximations to the ideal. Key limitations are:
Training Objectives: Many of the reports show training to be successful in improving protective actions or reducing a potentially hazardous condition but reference no particular OSHA standard or requirement pertaining to the situation posing a problem. Indeed, much of the work has been conducted by researchers who seek opportune targets for training that can yield results within a reasonably short time frame. Thus, positive results from training in these cases may or may not be considered as cogent support for any OSHA mandated rule. But having said this, the training plan in many reports does follow the OSHA guidelines in using a hazard analysis or injury reports to target the training needs and objectives, and in undertaking other steps for putting the plan in place. In this regard, the training effort may even be more relevant to the conditions under study. Perhaps OSHA rulemaking language calling for a training plan that defines and addresses site specific needs as opposed to one that dictates what they are a priori is worthy of discussion.
Training Effects/Outcome Measures: Whether the positive training effects reported such as knowledge gained, self-reports and/or actual observations of compliance with safe work practices can account for the reduced accidents, injury and lost days reported in several studies remain debatable. As already mentioned, the presence of other forms of hazard control introduced with training and uncertainties surrounding the basis for the accident/injury statistics argue against any such conclusions. Assessing the effects of training to reduce the risk of work-related chronic disease is even more problematic because of the long latency period needed to observe these kinds of outcomes. The reports on training plans undertaken in response to the OSHA foundry and coke standard show benefits in terms of increased worker knowledge of hazards and their professing greater adherence to safe work practices and protective behaviors (e.g., Parkinson et al., 1989 [A-II]). Although plausible, evidence that these training benefits have or will result in reduced lung/cancer diseases or other occupational illnesses for these work groups may require 10 or more years of surveillance. Similarly, it is too soon to say whether hazardous waste site workers and emergency responders who report that they were better able to manage chemical spills after taking required OSHA training (McQuiston et al., 1994 [A-II]) will also show fewer cases of diseases owing to better control of the exposure hazards.
Evaluation Design: In almost half of the reported studies, training effects were determined by evaluations of post-training measures for a given group or through pre- and post-training differences or comparisons before, during, and after training again on the same group. Since many of the interventions took the form of research projects, there is no way of separating out elements of novelty and researcher effects, which could have influenced the outcomes in these subject groups apart from any training effect. Some studies used comparable but untrained groups as ways to control these kinds of factors. Still, as noted in Table 2, other factors were present during the course of the evaluation, factors whose effects could not be accounted for in the results reported. In this regard, a variety of management actions were noted that deserve particular mention. For example, in one set of studies, they played roles in reinforcing and sustaining the learned behaviors (e.g., Zohar & Fussfeld, 1981 [A-III]). In other cases, supervisors were themselves the trainees and used to spearhead and effect the hazard control practices subject to evaluation (McKenzie et al., 1985 [A-IV]; Maples et al., 1982 [A-II]). As part of the training effort reported in other studies, supervisors were directed to increase their surveillance (Millican et al., 1981 [A-III]), or consider staff compliance in performance evaluations (Lynch et al.,1990 [A-V]). In still other reports, the authors indicate management's indifference to the training objectives (Fox & Sulzer-Azaroff, 1987 [A-I]). Being linked with management, these actions and other more subtle ones probably had profound effects on the evaluations which could not be sorted out because of the lack of suitable control groups or other confounding conditions.
There were other design weaknesses as well. Table 2 shows that more than half of the studies measured post-training effects less than 3 months after the instruction ended or only once after a longer interval of time. Thus, questions as to the durability of the reported effects, or possible intervening events affecting the longer term measures can be raised. Several studies did consider these issues with the results being somewhat gratifying (Zohar, Cohen & Azar, 1980 [A-III]; Hopkins 1983 [A-II]). In a few cases the subject groups were too small to make generalizable conclusions, and others assigned workers to training conditions on a non-random basis which could question the representativeness of the findings. Nevertheless, the sheer number of positive results found in so many different settings suggests that training effects are real even though the appraisals do not meet the more rigorous scientific standards.
Practicality Considerations: Given the success of the many intervention efforts noted in this report, there is the issue of whether the training plans under evaluation would be doable as a general practice at the worksite. The techniques employed in some studies to effect success were most elaborate. One example was the University of Kansas work (1982 [A-II]) in defining fundamental safe work practices and housekeeping measures as training objectives, and proceeding through formal instruction, practice trials plus incentives to establish worker compliance. But in targeting similar needs, the training plans in other reports seem almost incidental, confined to a brief session or two to define safe and unsafe practices. Having workers establish goals for conformance with safe practices when at the jobsite and provide feedback as to progress being made to the workers appear to be the more critical elements in the success of this approach. Studies by Reber & Wallin (1984 [A-II]), Fox & Sulzer-Azaroff (1987 [A-I]), Komaki, Barwick & Scott (1978 [A-I]) offer such examples as does an extensive review by Sulzer-Azaroff, Harris and McCann (1994). Provisions for goal setting and feedback as part of worksite training would not appear to be that formidable. Reports of training beyond learning fundamental work practices accent worker participation, active learning-type experiences using problem-solving exercises or other forms of instruction that show cogency to conditions found at one's workplace. In this regard, the merits of a learner-centered plan to address safety and health problems along with learning experiences that promote worker activism to effect improvements at their worksites have become emphasized. And, indeed, first results from evaluating this approach in hazardous waste site training programs appear promising [McQuiston et al., 1994 [A-II], Luskin et al., 1992 [A-II]; Cole & Brown, 1996 [A-II]). However, these findings are based on self-reports and thus have some limitation. Feasibility problems have also been noted. For example, needs to cover the subject matter of the course as well as to infuse empowerment ideas within usual time periods allotted to training mean that some topics get little treatment (Luskin et al., 1992 [A-II]). Another problem is the growing diversity of the workforce; this imposes added challenges in training approaches which stress worker inputs, group discussions and shared experiences. Cultural/language differences, among other factors, may be inhibiting (Cole & Brown, 1996 [A-II]). Two intervention studies reported in this review suggest ways for accommodating to language differences (Barnett et al., 1984 [A-II]; Weinger & Lyons, 1992 [A-II]). But perhaps the more important point is that training programs must be flexible in order to adapt methods and expectations to different working conditions and worker groups.
In summary, evidence for the effectiveness of OS&H training based upon the intervention studies reviewed above suggest the following observations:
(1) Taken as a whole, there is substantial documentation showing how training can meet objectives of knowledge gain, behavior change for improving worker health and safety. Reductions in work injuries and medical costs may also be noted in conjunction with these changes but evidence to show actual linkage or dependency remains to be ascertained.
(2) Because the intervention work does not address specific OSHA rules, the merits of specific training requirements can't be judged. On the other hand, the literature illustrates the benefits of training in meeting a variety of site-specific health and safety needs and objectives.
(3) Successful training outcomes in enhancing worker knowledge and control of workplace hazards and conformance with safe work practices depend greatly on extra-training or post-training environmental factors. Included in the latter are management's role/actions in favoring conditions which enable the knowledge gained from training or learned behaviors to be readily transferred to the jobsite. A proposed safety and health program standard as currently drafted by OSHA (OSHA, 1996) recognizes the merit of using a systematic approach to workplace safety and health. In doing so, management actions aimed at reinforcing training objectives along with other elements are duly noted.
The intervention literature on training in OS&H appears to be a collection of demonstration studies, some stronger in design than others in making a case for the benefits of a training approach (or in a few instances its shortcomings). As noted, more definitive analyses are needed to show how the outcomes of training relate to observed changes in injury or illness incidence. Also, and to be mentioned in a later section, certain factors critical to the learning process and post-training results, such as the length and frequency of the instruction, remain to be addressed in a more systematic way.
Even with all of the above uncertainties and qualifications, the array of evidence showing training-type interventions to effect positive changes in workplace safety and health remains formidable. Clearly, OS&H training can make a difference in reducing risks from workplace hazards. Rather than debate the issue of whether training is worthwhile, it would appear far more productive to determine what training procedures and related considerations are most crucial to optimizing its effects. Further support for this position comes from reviewing other sources of data bearing on the role of workplace training which are described below.
D. Training Data from Studies on Afflicted Workers
Using mail questionnaires, information was gathered on demographic factors, working conditions at the time of the injury event, use of personal protective equipment and extent or nature of safety training.
APPENDIX B describes the survey samples and includes extracts of the findings from 19 of 20 BLS survey reports reflecting worker responses to questions dealing with training issues. (One of the BLS reports [falls on stairs] did not include any training questions). The column entries are self-explanatory and cover the essential training-related data found in the surveys. The shaded entries are meant to suggest a serious training deficit for sizeable percentages of the afflicted workers. The authors hasten to note that this is purely judgmental; other readers may have different views about what is and is not noteworthy.
Table 3 summarizes the findings of APPENDIX B, reproducing in part those entries which suggest real or possible gaps in the job safety/health training as reported by the injured workers. For each of the 19 surveys listed, worker responses reveal at least one form of an apparent training deficit or a related problem. All but one injury category have at least two gaps and nine have three or more. "Limited coverage", meaning the percentage of those injured who lacked for any safety training, or had no training specific to their job needs, is the most frequent entry followed by "policy/action lapses" used to address training gaps after injury occurrence. "Content lacking" entries in Table 3 mainly referred to insufficient instruction in fitting, use, or limits of personal protective equipment issued workers. The "inexperience factor" was included in the listing insofar as it warrants even greater concern for adequate training. Entries here show that from 22% to as many as 78% of the affected workers had no more than 1 year's experience at the time of injury; for several categories more than 15% were injured within the first 6 months at the job. Fewer entries are noted in the "refresher needs" column because 13 of the 19 surveys did not include items about the time of the last safety training. Of the six surveys that did, percentage of injured workers with training more than 1 year old exceeded 50% in four of the six cases, and was above 25% in another.
2. Investigative Studies Acknowledging Training Needs and Effectiveness
Injury Investigations: As part of a NIOSH-supported epidemiological study of workplace fatalities, Manwaring & Conroy (1990) reported the results of on-site investigations of 55 confined-space incidents where 88 workers lost their lives. Through interviews with co-workers and company officials, data were obtained on the conditions surrounding the events, and applicable company safety policy and employee training. This was augmented by information contained in reports from the medical examiners, OSHA compliance officer, responding emergency medical services personnel. Analyses of the 55 incidents to establish possible patterns to the occurrences or common factors revealed that in only three events did workers receive any training in confined-space safety. In these three cases, two supervisors and two workers died, three of whom had received the training. Further testifying to an apparent lack of training among other factors, no testing of the confined-space atmosphere was done before entry in any of the events, nor were confined spaces labeled with appropriate warning signs. Also few events gave evidence of confined-space ventilation prior to entry and no formal space entry authorization procedure was in place. Indications of the wrong type or improper use of respirators were also noted. The authors used the findings to stress the need to increase worker understanding and awareness of confined space entry through development and implementation of confined-space entry procedures and worker training. Poor implementation of training procedures was still evident in a later NIOSH report which summarized the data gained from a greater number of confined-space fatality investigations (NIOSH, 1994).
A similar NIOSH investigation of 201 electrocution-type incidents with 217 worker fatalities also suggested training deficits as a contributing factor but the available data were not as convincing as that shown above for confined spaces (Casini, 1993). In these cases, laborers, who typically received minimal training, showed the highest number of fatalities (42 of the 217 victims). But not far behind were linemen (40 of the 217 victims) who generally received extensive training in electrical safety. A total of 180 victims did receive some typical on-the-job training, in many cases from small employers. This investigation raised questions as to the adequacy of the training, and mentioned needs for more structure and ways to demonstrate that the workers understand the hazards and can carry out recommended safety measures.
Tan et al. (1991) interviewed 41 hospitalized patients who were being treated for hand injuries sustained at their workplaces. The interview took place shortly after the patients were admitted and gathered information on the nature and extent of the patient's training plus factors such as length of job service, description of the circumstances of the injury event. Regarding the latter, rollers, guillotines and chain saws were the machines commonly involved; most workers were unable to give a specific reason for the injury. Twenty-one patients had no job training and 20 had either formal or supervised on-the-job training of variable length. Three weeks of training was noted for the majority of workers. To determine whether training could have prevented the injury, patients having training were compared with those who had none in terms of the time each spent on the job before the injury occurred. The results showed little differences between the two groups. Indeed, 3 workers with training were injured on the first day and 7 were hurt within 12 weeks of starting their jobs as compared with 8 untrained workers who injured their hands during the same period. The authors questioned the adequacy of training in light of these results.
Chemical Hazard Investigation: Bryant, Visser & Yoshida (1989) collected questionnaire data from 165 hospital workers involved in ethylene oxide (EtO) sterilizing work. They found from 20% to 40% of the respondents to suffer from headaches, eye/skin irritations, and sore throats attributed to the exposures. Other symptoms reported were nausea (19%), running nose (16%), shortness of breadth (15%), and drowsiness (20%). Included in the questionnaire were items asking about the amount of training, which for the sample ranged from less than 1 hour to more than 1 day. In more than one-third of the cases first aid was included, and use of protective equipment (i.e., gloves, gowns, masks) while working with EtO. Environmental samples of EtO were collected during each sterilizer task for the 18 hospitals which employed the 165 hospital workers. Correlational analyses showed amount of training time and use of protective equipment to each bear an inverse relation to the prevalence of reported symptoms; however, only a few of the symptoms showed a significant decrease. Moreover, the expected decrease in exposure levels from the use of protective clothing did not cause users to report fewer symptoms of short-term irritation. Indeed, 80% of the workers still complained of one or more symptoms despite exposures within current OSHA regulatory limits.
Ergonomic Hazard Investigations: Snook, Campanelli & Hart (1978) analyzed questionnaire returns from insurance agents who provided data on the latest compensible occupational back injury case in their workload. A total of 191 cases were described; the data included information as to onset of back pain, previous back injuries, act at time of injury along with selection and training procedures the employer was using to reduce the risk of back injury. Lifting/pushing tasks when implicated in the injury were rated in terms of percentage of population who could safely perform the same act without overexertion, and were the tasks used to supply job design or ergonomic reference data in the evaluation. The cases were separated in terms of the presence or absence of various techniques of selection (medical history, low back X-rays), whether or not training in safe lifting techniques was given, and whether the jobs rated below or above the 75% limits of overexertion risk. Neither training nor any of the selection techniques were found to have any significant differential effect on the numbers of reported cases. Only the job load variable proved significant. The authors concluded that selection or training approaches were not effective controls for low back injuries.
Green and Briggs (1989) conducted a questionnaire survey of 514 keyboard operators in a university workforce to determine the benefits of adjustable work station furniture-furniture used to alleviate postural discomfort as well as other ergonomic problems. The respondents included those who were classified as sufferers or nonsufferers of repetitive strain from keyboard work based upon symptoms previously associated with overuse injury. The questionnaire items sought information related to the adjustability of different components of the user's workstation (i.e., desk, chair, monitor), instruction received on how to make such adjustments, and the adequacy of both the instruction and the adjustability features for ensuring comfort. In addition to questionnaire data, anthropometric measures were taken on a subsample of the sufferer and nonsufferer groups on seated postures, specifically popliteal and elbow-rest height. Related to training and though recommended, a full-scale educational program to inform operators on use of the workstation and strategies for relieving discomfort was not followed; rather advice on use of adjustable workstations was handled by issuing circulars diagramming proper positions to the users, and by small seminars and demonstrations run by the safety officer at the request of individual departments.
Respondent data indicated that sufferers had more negative perceptions of the equipment. Significantly more sufferers constantly readjusted the workstations (70% vs 43% for nonsufferers), could not get comfortable (35% vs 18% for nonsufferers), and were more likely to report insufficient adjustability (50% vs 20% for nonsufferers). The anthropometric data found chair heights not in accord with guides distributed. The authors believed that these problems were due to the lack of appropriate information being given to the operators. Almost 40% of the respondents could not recall receiving any guidance on how to adjust their workstations. Only 12% noted the literature distributed by the university; the most common source of information (64%) was from other persons with no formal ergonomic training. The authors concluded that there is a great need for training and/or information on workstation adjustment among keyboard operators, and that the preference for verbal instruction is greater than for printed forms of instruction. Given the widespread use of fellow workers as sources of information, it was also suggested that supervisors as well as keyboard operators be trained to cover new employee needs.
3. Appraisal of Training Data of Afflicted Workers
In summary, workers without any OS&H training would appear at high risk for workplace injury or illness. Where training is given, the adequacy of the procedures in use becomes the issue. For this purpose, and like the intervention studies reviewed earlier, factors and conditions associated with effective OS&H training need to be ascertained.
In amplifying this point, OS&H training practices presently conducted throughout U.S. work establishments have not been examined to determine their adequacy in addressing known hazards and compliance with regulatory standards. One effort, limited to a small sample of companies engaged in waste site management, did in fact find many to be deficient in meeting existing OSHA training rules (Cole et al., 1994). The intervention studies summarized earlier cannot offer representative data since they were primarily demonstration efforts and special programs; they are not the norm. Although a new, independent survey would be ideal, much information characterizing OS&H training is already collected but remains buried in various databanks and report files that exist within NIOSH (e.g., Health Hazard Evaluation Reports, National Occupational Exposure Survey databank) and OSHA (e.g., compliance officer inspection reports). Systematic efforts to extract and assemble training related data from these sources could do much to provide a status statement on OS&H training practices and critical points.
E. Training Factors in the Context of Other Worksite Programs and Activities
NIOSH Studies: During the period 1975-1979, NIOSH published several reports resulting from a project aimed at defining factors in successful occupational safety programs. The project comprised three phases. The first was a questionnaire survey of the safety program practices of 42 pairs of companies in one state that were matched in type of industry, workforce size and locale but differed by more than two-to-one in recorded injury rate (Cohen, Smith & Cohen, 1975). The second phase comprised site visits to a sub-sample of the above group to verify and observe more closely apparent differences between the pairs that could explain the differential injury rate (Smith, Cohen & Cohen, 1978). The third phase used both mail questionnaires and site visits in collecting information from five companies recognized as having outstanding safety records based on total numbers of hours worked without a disabling injury (Cleveland et al., 1979). This third effort sought added confirmation of the findings from the previous two phases. Data collection for all phases focussed on such factors as management's commitment to the program, job safety training, safety incentives, hazard control measures, accident investigation/reporting procedures, and workforce characteristics. The general finding concerning training was that early indoctrination of new workers in safe job procedures with follow-up instruction to reinforce the learning was most frequently linked with successful safety performance. Formal classroom instruction versus on-the-job training or the use of varied instructional techniques were less notable considerations. The significance of training as compared with other program practices in accounting for safe performance could not be established. It is important to note, however, that management commitment factors both in these studies and others appeared to be the dominant or controlling element (Cohen, 1977).
(1) New miners in high-accident mines were less informed as to how to do their jobs than those in low accident mines.
(2) Lack of training in proper use of safety and health protective equipment was more frequently cited as being an important reason for miners not using the devices in high-accident mines.
(3) Having specific training in how the electrical system works; dealing with hazards such as coal dusts, gases and noise; and how to use tools, equipment was especially prevalent in the low-accident mines.
The Peters report noted that training for managers and supervisors produced significant improvements in mine safety and cited intervention studies demonstrating its effectiveness. One such study (Fiedler et al., 1984 [A-I]) is described in the collection of intervention work listed in APPENDIX A. This study found that the introduction of a structured supervisor training program accenting leadership style and skills in human relations or one stressing team-building and group problem-solving were each linked with reduced rates of injury and reduced MSHA citations at the mines under study.
Three observations about training derive from these NIOSH and BOM studies. The first is that training differences do exist between workplaces with good and poor safety records, but their overall importance remains to be ascertained. The second is that the differences seem relative, i.e., greater or more deliberate efforts are made to train, and to commit supervisor time and resources in the workplaces with better safety records. The third and related to the second is that supervisor training in how best to deliver and reinforce safe work practices seems crucial to the overall training effort and the success of the hazard control program. Somewhat at variance to this last point, one intervention study found that using external instructors to directly train employees was superior to a train-the-trainer approach in implementing aspects of a hazard materials information system in a large sample of companies (Saari et al., 1994 [A-II]). The differences between the two approaches, however, were least significant for companies with other well-established safety and health program practices. This suggests again, as shown in Figure 1, that training effectiveness depends greatly on other variables which complicates efforts at its assessment.
2. Implications of First Aid Training.
Miller and Agnew (1973) analyzed frequencies of accidents as reported for workers in five different Canadian work establishments over time periods ranging from 3 months to 3 years. For each workplace, workers trained in first aid, whether on a voluntary basis or as a requirement of the job, were found to have fewer injuries than those who did not have the training. Miller and Agnew speculated that worksite regulations and actions taken for hazard control in combination with the first aid instruction produced an increased safety consciousness in the workforce.
McKenna & Hale (1981; 1982) compared worker injuries in two factories for 1-year periods before and after the completion of first aid training. The training was given in two 2-hour sessions and covered the usual topics (i.e., treatment of asphyxia, shock, poisons, wounds and bleeding, fractures, etc.). This instruction was administered to one group of volunteers (the "experimental group") who before the training had worse injury records than a "control" group of workers matched by job, age, sex, and job- specific experience. Following the training, the experimental group showed a marked reduction in the injury rate as compared with the changes observed for the control group. Interview data collected 6 months before and 6 months after the training revealed no differences between the trainees and control workers in hazard awareness. When compared with the control group, however, the trainees did show shifts in attitudes and beliefs about accidents and injuries believed due to the first aid instruction. The major change was that the trainees regarded more accidents as being preventable and felt more responsibility for taking preventive actions. On this basis, McKenna and Hale suggest that the first aid training served as a personal motivator for adopting safe work practices and improving workplace safety conditions.
3. Worksite Physical Fitness/Exercise Training
Worksite health promotion programs that can enhance not substitute for required forms of hazard control is a laudable goal. Some intervention efforts combining elements of hazard protection and health promotion are beginning to appear but do not allow one to determine the contributions of each to the overall gains from the intervention. Shi (1993) for example, reported on a back injury prevention program for California county workers who in recent years experienced the highest prevalence of back pain and back-related injuries. The program combined 1) education on backache, weight control; 2) back safety training focussed on body mechanics and hazardous lifting tasks, 3) physical fitness emphasizing participation in regular exercises and 4) ergonomics improvements (e.g., making safety equipment more accessible, improving seating/work stations for easing postural stress, rearranging storage for minimizing materials handling burdens). Comparisons of questionnaire and medical claims data taken before and 1 year after the program showed significant reductions in individual risk factors for back pain (as much as 64% in the highest risk group), a decline in actual back pain experience (10-12%), and a 12% drop in medical costs per claim (versus a 15% increase in other groups not involved in the program). Although encouraged by the overall results, Shi admits that the study design is incapable of differentiating the individual effects of the program's components.
The question to be addressed here is whether certain factors stand out as crucial to attaining a successful training outcome in targeting some occupational safety and health objective. Two approaches to answering this question are taken. One verifies the importance of certain of the steps contained in the OSHA voluntary training guidelines by using empirical examples taken from the literature under review. A second considers evidence for singling out instructional factors as well as extra-training factors for their importance to the training experience and benefits to hazard control.
As a preface to this discussion, two points should be made. First, that the bulk of the training intervention literature reveals many studies showing positive results despite differences in training plans, targeted objectives, and evaluation methods. Indeed, few approaches seem ineffective which hampers the search for critical factors. Second, few efforts have been made to independently vary certain learning variables or conditions affecting the transfer of training to the jobsite so as to study their effects on outcome measures. This too nullifies a basis for rating the significance of key factors. Nevertheless, both in the intervention studies and other literature noted above, there are suggestions of controlling factors or at least factors that deserve more systematic evaluation to establish their importance. They will be noted along with other apparent needs in sorting out critical determinants in effective OS&H training.
A. Examples Supporting OSHA Voluntary Training Guidelines
OSHA Guideline: Determining if Training is Needed, i.e., whether a (hazard control) problem is solvable by training.
Exhibit #1: Cohen & Jensen (1984 [A-I]) found their training plan, though effective in having operators adopt certain targeted behaviors critical to safer use of forklift trucks in warehouses, could not effect a change in one that required them to do more driving in reverse and to continuously look over their shoulders when doing so. Inquiry revealed that this change was resisted for two reasons: First, lift trucks were propane-powered and driving in reverse caused the operators to breathe in more of the noxious fumes. Second, constantly looking over one's shoulder is unnatural and an uncomfortable posture to endure for prolonged periods. Use of battery-powered vehicles and installation of rear view mirrors would appear reasonable alternatives for alleviating these problems.
Exhibit #2: Carlton (1987 [A-IV]) instructed food service workers in the straight back/bent knee method of lifting and to recognize high risk workstyle factors (horizontal extension, spinal torque) for back problems. This group proceeded to score higher in a biomechanics assessment of their performance in a novel task of lifting/lowering trays of varying weight when compared with an untrained group. No such differences were found, however, for their on-the-job behaviors. Thwarting the transfer of this training were worksite obstructions that forced the workers to assume awkward positions, to engage in much extended horizontal lifts, and to subvert other actions aimed at risk reduction. Clearly, unless work station layout problems are addressed in this context, the benefits of training for reducing materials handling hazards will not be achieved.
OSHA Guideline #2: Identifying the Training Needs, i.e., what the worker is expected to do with regards to job hazard control and in what ways.
Exhibit #1: A University of Kansas study (1982 [A-II]), via industrial hygiene surveys, mapped out areas in plants manufacturing fiberglass products where concentrations of styrene, a hardening agent used in the production process and a known neurotoxin, were found to be the greatest. For these identified areas, job analyses plus interviews with managers and workers were then conducted to determine what tasks and worker actions could most influence exposure levels for work performed at these locations. This effort yielded a control plan, which included needs to effect worker compliance with 11 work practices and 20 housekeeping measures aimed at reducing exposure levels. Samples of prescribed work practices included avoidance of high exposure areas when there is no need to be present (e.g., keeping one's head out of a spray booth except when spraying), and exploiting existing engineering controls (e.g., spray toward exhaust ventilation). Housekeeping measures sought to reduce added sources of styrene exposure through covering waste cans of excess styrene coatings and locating them near exhaust ventilation ports; and covering floors with disposable material that could be changed frequently to reduce overspray buildup. These and other proposed actions constituted well-defined targets for the training program set in place. Compliance to the work practices and housekeeping measures as developed in this program resulted in significant reductions in styrene exposures to the workforce under study.
Exhibit #2: Sulzer-Azaroff et al. (1990 [A-I]), in instituting an injury prevention program in a large plant, reviewed accident and injury records, interviewed safety personnel, managers, and workers, and made direct observations to determine "hot spot" work areas and high risk job behaviors that would be candidates for intervention efforts. The diversity of ongoing operations dictated a subdivision of work units, each having its own set of safety performance targets, with the program starting in those groups where the bulk of accidents were happening. Safety performance targets included personal behaviors (e.g., wear eye protection; sort no more than one or two boards at one time), as well as behaviors affecting conditions (e.g., keep aisles clear; load carts without overhang). Targeted safety actions following training were achieved in all high risk units with some showing reductions in injury rates. All units showed a reduction in lost time cases and savings in medical costs.
OSHA Guideline #3: Identifying Goals and Objectives, i.e., specifying what the instruction is to attain in clear and measurable terms.
Exhibit #1: Zohar, Cohen & Azar (1980 [A-III]) undertook a program to promote awareness of the damaging effects of noise on hearing among workers who were at risk and to increase their motivation to wear ear protection. In addition to a conventional hearing conservation lecture, workers took hearing tests before and after their workshift to demonstrate how much temporary hearing loss occurred on days when they wore and did not wear ear protectors. Use of the protectors minimized such loss and the audiograms of those who routinely wore protection were posted along with those who didn't to show the benefits of the protection. The nonusers' audiograms showed profound permanent hearing losses which further accentuated the program's endgoals. This approach yielded a 50% increase in ear protector usage.
Exhibit #2: Bentley & Horstman (1986 [A-II]) instructed lumbermen on how to reduce dermal contact/exposure to timber coated with chlorophenol, a preservative agent with toxic properties. For this purpose, workers were counseled on the need to use gloves/aprons, apply barrier creams, wash hands at breaks, and each day wear freshly laundered clothes offering maximum skin coverage. Through adding a fluorescent agent to the chlorophenol, workers could see the extent of skin contact under ultraviolet light resulting from their work tasks. Workers were encouraged to view themselves under this light source during the course of training to show how the various protective practices helped to reduce their exposure. Post-training results for these workers found significant decreases in metabolites reflecting reduced exposure to chlorophenol which was attributed to the protective measures taken.
OSHA Guideline #4: Developing Learning Activities, i.e., instruction that emphasizes cognitive or physical skill factors commensurate with job demands and that is offered in ways that facilitate transfer to the actual job situation.
Exhibit #1: Michaels, et al. (1992 [A-II]) composed a training plan and materials for increasing worker awareness/knowledge of chemical hazards. The target groups were public employees engaged in shop work of various kinds (e.g., vehicle maintenance, carpentry/plumbing, printing) and in construction, custodial tasks. Materials were developed through site visits, interviews with workers to assess their health/safety concerns, and determinations of amounts of chemicals in use at site-specific locations. Consultations with the city OS&H office were also included. The training course covered the Hazard Communication Standard, how to read material safety data sheets, and to gain information on toxic chemicals, routes of entry, symptoms, health effects, and control measures. Information was tailored to fit exposures associated with different job titles and was offered to workers and their foremen/supervisors in such departments. Besides lecture, exercises used throughout the instruction allowed workers maximal input in identifying hazards of greatest concern, and in enabling them to work through various control options and the means for putting them in place. Post-training results indicated follow-through efforts at the workplace to correct a number of shortcomings in OS&H program practices.
Exhibit #2: Hultman, Nordin & Ortengen (1984 [A-III]) sought to train janitorial workers in ways to relieve increased stress on the spine caused by frequent forward bending in mopping tasks. The training plan comprised three 30- to 45-minute sessions. The first covered simple anatomy of the spine, muscle physiology and biomechanics. The second and third sessions included slides of workers performing tasks that put stress on the low back akin to mopping work. Techniques to relieve this loading were demonstrated (e.g., bend knees in mopping rather than flex the back; place water bucket on chair or leave on cart to avoid deep forward bending when bucket is placed on floor). The workers were given opportunities to practice them under the supervision of the instructor. Workers were found to spend more time in upright, less stressful condition following training.
OSHA Guideline #5: Conducting the Training, i.e., the use of an instructional format that promotes active learning with frequent feedback to mark progress, invites worker inputs and takes account of differential worker experience or skill levels to create/sustain motivation.
Exhibit #1: Saarela (1990 [A-I]) used a small group approach for effecting improved housekeeping practices in a shipyard where poor housekeeping was implicated in about one-third of the injuries reported. A steering committee of top management plus safety staff provided information and the basic aims of the program. Planning details and implementation were left to small groups (4-13 persons) formed within each of 13 departments. Each group consisted of the department chief, supervisors and workers. The groups, with the help of a facilitator, met to discuss housekeeping problems within their own areas, how they could be remedied, and once corrected, how they could best be maintained. They arranged training seminars for the total department staff to illustrate improved housekeeping practices, set goals for their attainment, established a system for monitoring compliance, the results of which were posted. All of the groups adopted measures for better housekeeping, the more active ones showing the greatest gains in terms of their department staff perceiving improvements in housekeeping practices. Overall, there was a 20% reduction in injuries associated with housekeeping during the intervention year.
Exhibit #2: Weinger & Lyons (1992 [A-II]) sought to increase farm worker knowledge of the health effects of pesticides, symptoms of poisoning, routes of entry, ways to minimize exposure, first aid procedures, and how to effect better preventive measures against these types of hazards. Needs assessment took account of pesticide exposures as documented by visits to farms and observations of work practices. Focal group discussions were held with farmers to consider content issues, best modes for conducting training as part of a learner-centered approach to address the information, behavioral skills, problem-solving objectives of the training. In some cases, training was in Spanish because of the Hispanic makeup of trainees. Techniques adopted for actual training used role-playing, case studies, and demonstrations to dramatize issues and facilitate worker participation. Post-training measures gave indications of lesser exposures to pesticides among trainees. Also greater activism on their part to report unsafe, hazardous working conditions.
OSHA Guideline #6: Evaluating Program Effectiveness, i.e., the training program should have an evaluation plan built in at the outset and include measures for assessing whether it has met its objectives, preferably indicators reflecting both knowledge and application.
Exhibit #1: Lynch, et al. (1990 [A-V]) instituted an infection control training program in a medical center. Its aim was to enhance staff (clinical, technician, housekeeping) knowledge of infection control and adoption of more stringent barrier practices for body substance isolation. Program content emphasized regular use of gloves/masks/gowns, compliance with upgraded containment/disposal methods in handling specimens, laundry, and trash, and special handling of highly infectious patients. After meetings were held with departments to iron out problems in adopting new procedures, fifty 45-minute lecture and slide sessions were held to inform staff and to maximize attendance. The pre-post training approach used to evaluate the intervention included three measures: 1) a questionnaire to ascertain knowledge, attitudes, and self-reports of infection control actions practiced before and after the training session, 2) appropriate glove use for patient contacts and procedures as recorded by independent observers for periods of 2 to 3 months before and after the training, and 3) use of microbiology lab reports monitoring marker organisms of nosocomial colonization and infection for the year before and 3 years after the intervention. Post-training results indicated significant increase in knowledge of infection control and glove use, plus a decline in the nosocomial colonization and infection rate.
Exhibit #2: Reber & Wallin (1984 [A-I]) divided the 11 plant departments that accounted for 95% of the company's injury reports into 3 groups. One group received safety training only; another, training plus goal setting; and the third, training plus goal setting plus feed-back according to a staggered schedule. The treatments were introduced at different times for the three groups, enabling one group to serve as a control for the other in assessing the impact of the training plus other factors. The training itself consisted of 10 weeks of daily 45-minute safety discussions of safety rules with slides showing safe and unsafe ways of doing job tasks specific to the departments involved. Training effects were evaluated by several measures. One consisted of a quiz given midway (5-week point) during the training to ascertain worker knowledge of safe practices. A second was direct observations of whether the workers were adhering to safe practices using a checklist to score their performance during baseline, training, goal-setting, goal setting plus feedback phases of the program. In addition, the overall injury incidence rate and lost time injury incidence rate was calculated for the 3 years before the training intervention and for the year during which it was implemented. Results showed that workers could identify over 80% of the safe and unsafe conditions at the midpoint of the training and that training, goal setting, and feedback were each found to increase the frequency of observed safe behaviors. Adding feedback to goal setting provided the greatest increase in safety performance. The lost time injury rate decreased post-training, but the authors noted that this effect must be treated with caution because of changes in the safety recordkeeping procedures during the 1980-84 period.
OSHA Guideline #7: Improving the Program, i.e., shortcomings observed in evaluation data such as knowledge gaps, deficient performance levels, poor retention would dictate needs to revise training plan to improve its efficacy.
Exhibit 1: Cole et al. (1988 [A-II]) found that a 14-step procedure for donning a self-rescuer breathing apparatus (SCSR) could not be performed proficiently for effective use in mine emergencies even after years of hands-on training and annual refresher demonstrations. A simplified 3+3 step plan was developed encompassing the major objectives of isolating the lungs and preparing for escape and was structured to overcome the position/sequence problems and slowed response noted in using the 14-step procedure. Instructor modeling of the new procedure and repeated opportunities for each miner trainee to don equipment and observe others doing the same was used for training with the new method. Evaluations comparing the donning times and sequential errors for the new method versus the old procedure found the revised one reduced overall donning time by 50% and displayed smoother, less confused or interrupted actions. As noted in this report, this demonstration of a revised and apparently improved training procedure was done in training rooms above ground and did not take account of the dark, muddy/wet floors and of the dirty/battered SCSR devices found in actual underground conditions. One company trained its miners with the new procedure both above and below ground and found more errors below ground which slowed donning time. Recommendations were made to train miners to high levels of mastery above ground and provide for frequent refresher exercises to overcome this problem. (See also report by Vaught, Brinch & Kellner (1988 [A-II]) on this point).
Exhibit #2: Karmy & Martin (1980 [A-III]) sought to increase ear protector use in a complex of eight plants, each averaging noise levels of 90 dBA. For this purpose, the eight plants were divided into four treatment groups: One group was educated to use ear protection through a poster campaign followed by a videotape presentation; a second was given repeat audiometric tests at 7 to 12 month intervals; a third was given both the educational message and repeat audiometry; and the fourth served as a control. Comparisons of ear protector use in the various plant groups were made over 22 months. The treatments began for the audiometry at the 3-month point; at the 10th month point for posters; and at the 15th month for the videotape. The control group showed little change throughout this period in percentage of workers wearing ear protection. The introduction of the posters resulted in a 15% increase in ear protector use, which then dropped in one plant until the videotape showing. This caused a 25% jump in use, which again trailed off. Repeat audiometry by itself increased ear protection by 40% in one plant and 20% in a second with little signs of regression. Repeat audiometry plus education attained a maximum 30% increase in ear protector use with indications of continued growth. The results here suggest that the educational offering by itself did not produce durable change. The education plus repeat audiometry did so but could be improved if the workers were given feedback regarding the results of their hearing tests to indicate the benefits of the ear protection. No such provision was made in the program, and a recommendation for doing so was offered.
B. Evidence for Distinctive Training and Extra-Training Factors
The aforementioned OSHA guidelines offer structure to an OS&H training program and the exhibits with the guidelines above give meaning to the various elements based upon empirical work. But inherent to the training process and attainment of its objectives are a number of factors of consequence barely touched upon in the guidelines as described. These include variables such as size of training group, length and/or frequency of training, manner of instruction, trainer credentials, and training transfer factors among others. Motivational considerations and extra-training factors such as management's interest in and concern for worker safety also need to be addressed as they would appear to greatly modify the learning experience and its outcome.
The reports summarized in APPENDIX A plus others cited in the literature offer some data for making statements as to the significance of these types of factors, or suggest the most promising conditions for achieving successful training results. Such evaluative findings are summarized in this section. As will be noted, evidence based on systematic manipulations of acknowledged variables, at least for the OS&H literature reviewed here, is available in only a few cases. Other evidence for significant factors tended to emerge by finding them common to a number of studies with apparent similar influences on the training outcomes. Table 4 lists different factors with capsule statements tying together evaluative information from different reports cited in APPENDIX A to indicate the nature of their effect on or importance to the training process or its outcome.
One immediate impression in viewing Table 4 is that the documentation identified with different factors is quite disproportional. Specifically, the information base on size of group and length/frequency factors is relatively small whereas that shown for motivational/promotional factors is much larger with the others falling in between. The supportive findings for the statements conveying the importance of the size of group and frequency/length of instruction to training are further limited by the fact that they were derived from post hoc data analyses in the few cited reports, not from efforts to vary parameters of each factor to ascertain their significance. Only the statements for mode of training and motivational/promotional factors rest on studies that in the main, employed systematic or controlled manipulation of conditions as a basis for deriving the statements. Evidence of the influence of other factors (as contained in the statements alluding to them) was based on the listed studies yielding similar results for the same factor; this was largely based on all-versus-none treatment comparisons.
Another impression is that many of the statements agree with or are consonant with well-known concepts in the psychology of learning and motivation (Deese, 1952; Ruch, 1963). For example, captured in the statements in Table 4 are the benefits of increasing training time, repeated practice sessions, opportunities for more individualized instruction (through lower student-to-teacher ratios), and active rather than passive learning experiences focussed on conditions that can promote transfer to the areas in need. Learner-centered, small-group problem-solving approaches are newer variants of these ideas. The intent is to prompt student actions to make needed workplace health and safety changes. Similarly, the statements on goal setting, feedback, and token rewards to help learn safe work practices and to strengthen such acts in the workplace are elements of the behavior reinforcement literature in psychology. Some extensions or illustrations of certain factors are also contained in the statements. That supervisors or foremen are key players in ensuring safe and healthful workplace conditions is well taken. Perhaps the trainer role further impresses upon the supervisor or foreman the importance of safety at work and ways to meet production goals without having to forego hazard control measures or permit workers to take undue injury or health risks. As noted, added supervisor/foremen instruction in both workplace safety and health as well as interpersonal relations enhances this result.
There is evidence too of how training is needed to complement or augment engineering or physical hazard control measures to realize successful safety and health outcomes. As described by the studies cited in this context, training is not only necessary to ensure proper use of the control systems that are in place but also to enable workers to adopt work methods that take greater advantage of their capabilities for providing protection. Cohen (1987) provides other examples of how worker actions and behaviors can affect different elements of worksite hazard control systems, all of which could be objectives in a training program.
With one exception, the evidence underlying each of the statements for the various factors in Table 4 reflects data obtained from more than one hazard target and from different work settings or worker groups. (The exception is one statement in Ancillary Factors where all reports dealt with biologic hazards and hospital personnel. Even here, however, the hospital personnel differed in makeup-some being professionals (clinical staff), and others in support services (laboratory technicians, janitorial/laundry workers). This suggests some generalizability of the findings though, as already mentioned, the actual amount of documentation varies greatly from factor to factor (and from factor statement to factor statement).
The motivational/promotional factors area in Table 4 shows the greatest number of citations. These entries reflect the major attention given to goal-setting and feed-back techniques as ways to promote the learning of safe behaviors during training. But even more, these techniques are shown to reinforce and strengthen the occurrence of such acts in the post-training or actual job situation. Indeed, in many of these studies, the training seems incidental, merely taking the form of workers viewing right and wrong ways of performing various tasks, usually in one session. The real emphasis is given to monitoring worker compliance with the safe acts when at the jobsite and varying the nature of information feed-back to the workers who may have set up safe performance goals to further spur compliance behavior. The overwhelming results from these studies is that the feedback and/or the goal setting conditions effect safer workplace behaviors. This has prompted the conclusion that training by itself does not account for improvements in worker safety and health but that the positive consequences of such actions in the form of feedback indicating compliance or progress in meeting performance goals is responsible (Sulzer-Azaroff, Harris & McCann, 1994). One could argue in these instances, however, that worker training does not end with the one session illustrating safe and unsafe practices. That the follow-on monitoring and feedback provided to workers of their job actions can be interpreted as "on-the-job" training in establishing safe workplace behaviors. The line between training and extra-training factors is difficult to draw and underscores the point noted in Figure 1 of the interactive nature of training with other workplace influences.
The literature on performance feed-back and use of incentives as a means of altering behavior in general and workplace safety in particular have been the subject of separate reviews (Lindell, 1994; Balcazar, Hopkins & Suarez 1985; McAfee & Winn, 1989). Conditions that favor consistently positive results are those where the feedback includes a tangible reward, is administered by a supervisor, and occurs at least biweekly. Private versus public feedback, individual versus group performance feedback appear about equal in effectiveness. Lindell (1994) explains how workers' respond to feed-back and incentive programs in different ways depending on their expectations regarding the outcomes of their actions, and the values they see in the rewards offered. Both he and McAfee & Winn (1989) stress the need for a conceptual framework for understanding relationships between knowledge of results, incentives and safe behavior and offer some formulations in that regard.
Feed-back/incentive programs would appear generally applicable to any situation where workers can be readily observed to assess their compliance with the prescribed safety procedures. Although the near uniform success of these interventions in enhancing safe worker behavior and safer workplace conditions is impressive, one reservation is that withdrawing the feedback or incentives could result in a reversion back to earlier problematic conditions. How management reacts to the gains and takes steps to maintain them can be critical. Instituting new policies stressing safe as well as productive job efforts, increasing supervisory training in and attention to safety conditions, and fostering greater contacts between management and employees on safety issues have been shown to be supportive. Taken together these kinds of actions create a positive safety climate in an organization that can do much to consolidate the benefits of the intervention effort.
Incentive awards raise concerns apart from the economic and delivery factors that might be involved. Those awards that remind one of how it was achieved are best, yet may be the least attractive to workers who would prefer cash or gift certificates offering more options to fit their wants. Group awards may decrease the size of the individual award but provide for peer pressure to maintain safe performance. This, in itself, can have negative consequences because the group might pressure workers to avoid reporting their injuries. As Lindell (1994) notes, "There appears to be little guidance in the research literature or agreement among practitioners regarding the optimum design of incentive plans" (Pg. 224).
In discussing alternatives for effecting the transfer of safety training to the job, Ford & Fisher (1994) suggest that techniques used for other behavior management purposes may have some utility. Reference is made to three different methods. One is a "buddy system" approach successfully used in smoking reduction; this pairs trainees to reinforce the need in each other to maintain learning, offer advice, and be alert for signs of relapse in themselves or their buddy. A second is use of "booster sessions" as an extension of training wherein periodic face-to-face contact between trainee and trainer is required. In weight control studies, inclusion of booster sessions at 2-,3-, and 5-week intervals induced a greater percentage of maintained weight loss than did the absence of such sessions. The third is a relapse prevention method in which the trainees are exposed to situations posing obstacles to their trained skills and are led through exercises preparing them to cope with these difficulties. The latter approach, in design and objective, seems similar to work already reported in this review by Brown & Nguyen-Scott (1992 [A-II] and LaMontagne, et al. (1992 [A-II] embracing worker empowerment ideas. In these instances, trainees defined likely workplace obstacles to improved hazard control, including those posed by organizational factors. Through role play and case study examples the trainees learned ways to resolve them. As noted, first evaluations of these efforts gave encouraging results.
Table 4 suggests conditions for the various factors that favor effective training, reinforcement of behaviors once learned, and success in their transfer to the jobsite. The question of some factors and conditions being more important than others is not addressed and, in actuality, may depend on situation-specific circumstances. One could argue, for example, that size of group, length/frequency, and mode of instruction factors may be less important in training aimed at making workers aware of and observant of fundamental safety rules/housekeeping measures in jobs that are routine in nature, performed at fixed locations and under well-defined conditions. Under these conditions, the emphasis can be less on how the training is conducted than on those factors or conditions that can motivate continued adherence to such practices. In contrast, factors in how the training is administered can be a major concern where knowledge of hazard recognition and control measures plus safe work practices becomes more formidable because of varied job operations and/or uncertain, changing workplace conditions. This would suggest that training regulations be performance-based, allowing employers to develop a training plan that can accomplish the safety training objectives required for their job operations or worksites. At this stage, and speaking in general terms, the statements on various factors noted in Table 4 coupled with the OSHA voluntary training guidelines offer aids in structuring an effective training program based on the current literature. At the same time, and as already mentioned, the knowledge base is not strong regarding certain factors underlying the training process, e.g., length/frequency of instruction. Added efforts to address these kinds of needs and others mentioned in the course of this review seem evident.
This review sought evidence from the literature to determine whether OS&H training requirements, as cited in Federal standards governing workplace conditions and operations, were effective in reducing work related injuries and illnesses. A secondary objective was to determine if the available documentation showed certain training factors or practices to be more important than others in producing positive effects on worker safety and health. Major sources of data used in this review were reports of training intervention efforts designed in whole or part to enhance worker knowledge of workplace hazards, effect compliance with safe work practices, and take other actions aimed at reducing risk of injury or disease. Surveys and investigative reports were also examined to determine whether training factors were implicated in the etiology of occupational injuries or disease or were considered significant to the success of those worksite hazard control programs showing exemplary safety and health performance. Still other sources for data were reports of worksite training directed to other needs but having apparent positive effects on workplace safety and health.
A. General Conclusions on Training Effectiveness
1. Evidence to show how reduced injury, lost time and medical costs reported in the intervention studies resulted from training, measured in terms of knowledge gain and behavior indicators, was never clearly established. In some instances training was coupled to other forms of interventions so as to make attribution even more difficult.
2. Much of the training intervention work reported in the literature targeted site-specific problems. This afforded researchers opportunities to put into place various training and other strategies that could yield meaningful data in a relatively short time-frame. Many of these efforts did follow the OSHA voluntary training guidelines, and their apparent success in improving protective actions and safe work conditions demonstrate the value of such guidelines. On the other hand, the cogency of these data to any OSHA mandated training rule remains to be seen.
3. Successful training outcomes in the intervention studies appeared greatly influenced by management's role in and support of safety training, especially its transfer to the jobsite. Policies which favor opportunities for applying the knowledge gained from training or reinforce learned behaviors through incentives or other means produce optimum results. Although referred to as extra-training or post-training environmental factors, the above considerations seemed so central to achieving training objectives as to raise the issue of whether they deserve mention in OSHA regulatory language covering training requirements. They are not acknowledged in current training requirements. Separating these kinds of extra-training factors from training per se may be artificial; indeed, everyday experiences on the job are a form of continuing training with safety performance being shaped by management policies and supervisor/worker actions aimed at accountability. OSHA's latest draft of a proposed safety and health program standard emphasizes management actions to ensure effective training results as well as to realize other program goals.
4. Reports suggesting training deficits as factors contributing to worker injuries, health complaints, and workplace fatalities lack confirmation. That workers having received safety and health training are also afflicted indicates needs for ascertaining the essential nature or quality of the training offered and whether it meets OSHA requirements.
Even with these shortcomings, evidence that OS&H training can reduce risks from workplace hazards remains strong. Indeed, the issue is not so much whether OS&H training is worthwhile but what factors both within and beyond the training process can produce the greatest possible impact.
B. General Conclusions on Critical Training Factors
1. Numerous examples illustrating the various steps contained in the OSHA voluntary training guidelines are found in the literature and show support for this approach. Various exhibits show how the intent of the guidelines can be met in realistic ways and have merit in framing and implementing an effective training plan.
2. Factors in the actual learning process, which were isolated in this review, included size of group, length/frequency of training, training mode, transfer, motivation, trainer qualifications, management role among others. Documentation was most extensive for motivational factors with evidence that feedback, goal-setting, reward incentives have near uniform success in facilitating safety instruction and the carryover of such knowledge to the jobsite. In contrast, reports and information on size of group and length/frequency of training factors were greatly limited. The latter raises questions about training schedules for safety and health subject matter, and whether the timing for both original and refresher training is appropriate.
3. Factors and conditions favoring effective safety training and its transfer to the jobsite agree with or are consonant with what is known in the general scientific literature on the psychology of learning and motivation. Some refinements are also noted in finding apparent benefits from using supervisors or foremen as safety trainers, and evidence that effective operation of engineering or physical systems for hazard control can be dependent on training.
4. Whether some learning factors are more important than others may vary with situation-specific concerns. The literature suggests that factors influencing safety training focussed on fundamental safety rules and housekeeping practices for routine jobs require no elaborate instructional effort; rather the stress is on factors that can ensure the transfer to the jobsite. Safety training requirements addressing more complex job demands and uncertain work conditions would have to give more consideration to the learning as well as carry-over needs.
5. Even with the qualified answers given in this report to the question of critical training factors, the material presented should benefit users of the OSHA voluntary training guidelines in terms of supplying illustrations of how the different guidelines work in practice, and enabling users to recognize the role that certain factors or conditions can play in moderating the effectiveness of any such training effort.
C. Needs for Follow-on Work
1. The training intervention studies reported in this review and showing evident success in meeting their objectives were found wanting for several reasons. One was that most did not address OSHA training requirements found in any particular standard. A second was that most measured training effectiveness in terms of gains in safety knowledge or increased preventive actions; relationships between these measures and reductions in injuries or disease, if also reported, were not clearly shown. Other criticisms were the limited timeframe for studying the results of any training intervention and the site-specific nature of many efforts. These findings could question the generalizability of the findings. More relevant work offering a broader base for evaluation would seem indicated. In this regard, one approach would be to focus on the most prevalent types of injuries and diseases and the select industries or work operations where they occur. Applicable OSHA training requirements for those industries or operations would be noted along with the actual training practices being followed at different sites directed to those specific injury or disease risks. Differences in how the mandated training rules were met at the various sites selected for study, and apparent linkages between the training undertaken and specific injury or disease control measures would be analyzed to assess the effect of training and identify strong or weak practices, etc. This type of study has not been done.3
3. A major point in this literature review is that OS&H training is embedded within a larger overall hazard control program of an organization, and thus its effectiveness in reducing work-related injury and disease can depend on other factors. Aside from the instruction itself and motivational factors such as goal setting, feedback that reinforces the learning, and its transfer to the jobsite, there are engineering, administrative, and organizational practices that can also affect the training activity and its objectives. Top management commitment to workplace safety and health, supervisor/worker communications on safety and other issues, and accountability stressing both safe performance as well as productivity can greatly influence the degree to which the lessons learned in the training program can be transferred to the shopfloor. To examine which types of training practices by themselves or in combination with these other factors can yield the most positive effects will require indepth studies, and it is proposed that such efforts be focussed on those establishments with exemplary hazard control programs as demonstrated by their low injury/illness rates. The OSHA "STAR" companies in their Voluntary Protection Programs (OSHA, 1988b) would appear to offer a sample of suitable candidates for study.4 Although seemingly repeating other work aimed at defining successful program practices, this proposal would look more critically at the training activities, both in isolation and in their interactions with other factors to define the dominant or controlling influences on the training outcomes. The endproduct of this work is envisioned as a series of case study reports describing the characteristics of effective training programs and ways to integrate them with other hazard control measures so as to produce the maximal benefit.
5. In considering factors inherent to the training process, duration/frequency issues drew special attention. The OS&H literature contained few references dealing with this subject despite its significance to scheduling instruction, both for initial and refresher training purposes so as to ensure a maximal, durable effect. The skills training literature offers some ideas about major variables that should be weighed in deciding on an appropriate schedule, and these could be the starting point for deriving a decision logic to address workplace safety and health training objectives. For this purpose, it is suggested that workshops be convened to discuss this as well as other matters relating to the effectiveness of OS&H training. Invitees would include experts and practitioners conversant with job skill and OS&H training plus others engaged in basic learning research, program evaluation, health education, and organizational behavior representing both the private and public sectors. This would be one way to tap the diverse knowledge applicable to answering the questions raised in this report. In addition to the topic of a decision logic for training schedules, other items on a workshop agenda could include:
Outputs from the workshop would be state-of-the-art information for training fulfilling its role in contributing to improved OS&H conditions, both now and in the future.
Alavosius MP, Sulzer-Azaroff B. (1985) An on-the-job method to evaluate patient lifting technique. Appl Ergo 16:307-311.
Alavosius MP, Sulzer-Azaroff B. (1986) The effects of performance feedback on the safety of client lifting and transfer. J Appl Behav Anal 19:261-267.
Alliger GM, Janak, EA. (1989) Kirkpatrick's levels of training criteria: Thirty years later. Personnel Psychol 42:331-342.
Askari E, Mehring. (1992) Human immunodeficiency virus/acquired immunodeficiency syndrome training from a union perspective. Amer J Indust Med 1992: 711-720.
Balcazar F, Hopkins BL, Suarez Y. (1985) A critical, objective review of performance feedback. J Org Behav Mgmt 7: 65-89.
Barnett PG, Midtling JE, Velasco AR, Romero P, O'Malley M, Clements C, Tobin MW, Wollitzer AO, Barbaccia JC. (1984) Educational intervention to prevent pesticide-induced illness of field workers. J Fam Pract 19:123-125.
Bentley R, Horstman SW. A counseling program for worker protection from Sapstan solution. Final Report, University of Washington Seattle, WA 1986.
Blomberg R, Levy E, Anderson, A. (1988) Assessing the value of employee training. Hlth Care Manage Rev 13:63-70.
Booker JM, Catlin M, Weiss LD. (1991) Asbestos training: Evaluation of a state certified program in Alaska. J Env Hlth 54:18-21.
Borland R, Hocking B, Godkin GA, Gibbs AF, Hill DJ. (1991) The impact of a skin cancer control education package for outdoor workers. Med J Australia 154:686-688.
Bosco,J, Wagner J. (1988) A comparison of the effectiveness of interactive laser disc and classroom video tape for safety instruction of General Motors workers. Educ Technol 28:15-22.
Brown MP, Nguyen-Scott N. (1992) Evaluating a training-for-action job health and safety program. Amer J Indust Med 22:739-749.
Bryant, HE, Visser ND, Yoshida K. (1989) Ethylene oxide sterilizer use and short-term symptoms amongst workers. J Soc Occup Med 39:101-106.
Bureau of Labor Statistics Work Injury Reports available from the National Technical Information Service (NTIS), 5285 Port Royal Road, Springfield, VA 22161
Bureau of Labor Statistics (1997). Occupational injuries and illnesses: Counts, Rates, and Characteristics, 1994. Bulletin 2485, U. S. Department of Labor, Washington, DC.
Campbell JP. (1988) Training design and performance improvement. In: Productivity in Organizations: New Perspectives from Industrial and OrganizationaL Psychology, Jossey-Bass, San Francisco, CA) Chapter 8.
Caparaz A, Rice, C, Graumlich S, Radike M, Morawetz J. (1990) Development and pilot evaluation of a health and safety training program for foundry workers. Appl Occup Env Hyg 5:595-603.
Carlton RS. (1987) The effects of body mechanics instruction on work performance. Amer J Occup Ther 41:16-20.
Carmel H, Hunter M. (1990) Compliance with training in managing assaultive behavior and injuries from inpatient violence. Hosp Commun Psychiat 41:558-560.
Casini VJ. (1993) Occupational electrocutions: Investigation and prevention. Prof Safety (Jan): 34-39.
Chaffin DB, Gallay LS, Wooley CB, Kuciemba SR. (1986) An evaluation of the effect of a training program on worker lifting postures. Intl J Indus Ergo 1:127-136.
Cheng C, Yang Y, Wu T. (1982) Radiation control through licensing and intensive training. Health Physics 43:803-811.
Chhokar JS, Wallin JA. (1984) A field study of the effect of feedback frequency on performance. J Appl Psychol 69:524-530.
Cleveland R, Cohen HH, Smith MJ, Cohen A. (1979) Safety program practices in record-holding plants. DHEW (NIOSH) Publication No. 79-136, National Institute for Occupational Safety and Health, Cincinnati, Ohio 45226
Cohen, A. (1977) Factors in successful occupational safety programs. J Safe Res 9:168-178.
Cohen A. (1987) Perspectives on protective behaviors in the workplace. In: Taking Care: Understanding and Encouraging Self-Protective Behavior (Ed: N. Weinstein; Cambridge University Press, New York, NY) 298-322.
Cohen A, Smith MJ, Cohen HH. (1975) Safety program practices in high versus low accident rate companies -an interim report. DHEW (NIOSH) Publication No. 75-185) National institute for Occupational Safety and Health, Cincinnati, OH 45226.
Cohen HH, Jensen RC. (1984) Measuring the effectiveness of an industrial lift truck safety training program. J Safe Res 15:125-135.
Cole BL, Brown MP. (1996) Action on worksite health and safety problems: A follow-up survey of workers participating in a hazardous waste worker training program. Amer J Indust Med 30:730-743.
Cole BL, Shatkin JP, Delp L, Brown MP. (1994) A cross-sectional survey of workers and their training needs at 29 hazardous waste sites. Appl Occup & Environ Hygiene 9(9):605-611.
Cole HP, Mallett LG, Haley JV, Berger PK, Lacefield WE, Wasielewski RD, Lineberry GT, Wala AM. (1988) A new SCSR donning procedure. In: Research and Evaluation Methods for Measuring Non-routine Mine Health and Safety Skills. Vol I. University of Kentucky, Lexington, KY, Chapter 4.
Collert J (Editor) (1996) Environmental Health and Safety CFR Training Requirements - 2nd Edition Government Institutes, Inc., Rockville, MD
Deese, J. The Psychology of Learning (McGraw-Hill Book Company, New York, NY) 1952
Dortch III HL, Trombley CA. (1990) The effects of education of hand use with industrial workers in repetitive jobs. Amer J Occup Ther 44:777-782.
Ewigman BG, Kivlahan CH, Hosokawa MC, Horman D. (1990) Efficacy of an intervention to promote use of hearing protective devices by firefighters. Pub Hlth Repts 105:53-59.
Feldman TB, Bell RA, Purifoy FE, Stephenson JJ, Schweinhart A, Grissom S. (1990) Outcomes of AIDS training for supervisory and non-supervisory personnel in the workplace. J Occp Med 32:103-109.
Feldstein A, Vollmer W, Valanis B. (1990) Evaluating the patient handling tasks of nurses. J Occup Med 32:1009-1013.
Feldstein A, Valanis B, Vollmer W, Stevens N, Overton C. (1993) The back injury prevention project pilot study. J Occup Env Med 35:114-120.
Fiedler FE, Bell Jr. CH, Chemers MM, Patrick D. (1984) Increasing mine productivity and safety through management training and organization development: A comparative study. Basic & Appl Psychology 5:1-18.
Fiedler FE. (1987) Structured management training in underground mining- five years later. Information Circular 9145, Bureau of Mines Technology Seminar, Pittsburgh, PA.
Ford, JK, Fisher, S. (1994) The transfer of training in work organizations: A systems perspective to continuous learning. Occupational Medicine: State of the Art Reviews 9(2): 241-259.
Foster L. (1996) Manual handling training and changes in work practices. Occup Health Nov (11):402-406.
Fox CJ, Sulzer-Azaroff B. (1987) Increasing completion of accident reports. J Safe Res 18:65-71.
Fox DK, Hopkins BL, Anger WK. (1987) The long-term effects of a token economy on safety performance in open-pit mining. J Appl Behav Anal 20:215-224.
Genaidy AM, Gupta T, Alshedi A. (1990) Improving human capabilities for combined manual handling tasks through a short and intensive physical training program. Amer Indust Hyg Assoc J 51:610-614.
Goldrick BA. (1989) Programmed instruction revisited: A solution to infection control inservice education. J Cont Educ Nurs 20:222-226.
Goldstein IL, Buxton VM. (1982) Training and human performance. In: Human Performance and Productivity, Ed: EA Fleischman, Erlbaum, Hillsdale, NJ, Chapter 5.
Green RA, Briggs CA. (1989) Effect of overuse injury and the importance of keyboard training on the use of adjustable workstations by keyboard operators. J Occup Med 31:557-562.
Gundewall B, Liljeqvist M, Hansson T. (1993) Primary prevention of back symptoms and absence from work. Spine 18(5): 587-594.
Hale, AR. (1984) Is safety training worthwhile? J Occup Accidents 6:17-33.
Hammond EC, Selikoff IJ, Seidman H. (1979) Asbestos exposure, cigarette smoking and death rates. Ann New York Acad Sci 330:473-490.
Heath E. (1982a) Worker training and education in occupational safety and health: A report on practice in six industrialized western nations (Part 1). J Safety Res 13:5-11.
Heath E. (1982b) Worker training and education in occupational safety and health: A report on practice in six industrialized western nations (Part 2). J Safety Res 13:73-87.
Heath E. (1982c) Worker training and education in occupational safety and health: A report on practice in six industrialized western nations (Part 3). J Safety Res 13:121-131.
Heath E. (1982d) Worker training and education in occupational safety and health: A report on practice in six industrialized western nations (Part 4). J Safety Res 13:157-162.
Hilyer JC, Brown KC, Sirles AT, Peoples L. (1990) A flexibility intervention to reduce the incidence and severity of joint injuries among municipal firefighters. J Occup Med 32:631-637.
Holcomb ML, Lehman WEK, Simpson DD. (1993) Employee accidents: Influences of personal characteristics, job characteristics and substance use in jobs differing in accident potential. J Safety Res 24(4):205-221.
Hopkins BL. (1984) An investigation of the durability of behavioral procedures for reducing workers' exposures to a suspect carcinogen. Special Report to National Institute for Occupational Safety and Health, Cincinnati OH 45226.
Hopkins, BL, Conard RJ, Dangel RF, Fitch HG, Smith MJ, Anger WK. (1986) Behavioral technology for reducing occupational exposures to styrene. J Appl Behav Anal 19:3-11.
Hungentober MK, Robins TG, Kaminski M, Graubarth R. Evaluation of health and safety working conditions and work practices in jobs involving hazardous materials. Paper presented at Amer Publ Hlth Assoc Meeting, Oct 1990, New York City, NY.
Hultman G, Nordin M, Ortengen R. (1984) The influence of a preventive educational programme on trunk flexion in janitors. Appl Ergo 15:127-133.
Janssens L, Grotenhuis H, Michiels H, Verhaegen P. (1989) Social organizational determinants of safety in nuclear power plants: Operator training in the management of unforeseen events. (1989) J Occup Accidents 11:121-129.
Karmy SJ, Martin AM. (1980) Employee attitudes towards hearing protection as affected by serial audiometry. In: Personal Hearing Protection in Industry (Ed: PW Alberti, Raven Press, N.Y.) 491-501.
Kearsley G. (1991) Training media and technology. In: Training for Performance (Ed: JE Morrison, John Wiley, New York) Chapter 8.
Kirkpatrick, DL. (1967) Evaluation of training. In: Training and Development Handbook (Eds: Rl Craig, Binel, LR. McGraw-Hill, New York, NY) 87-112.
Komaki J, Barwick KD, Scott LR. (1978) A behavioral approach to occupational safety pinpointing and reinforcing safe performance in a food manufacturing plant. J Safe Res 63:434-445.
Komaki, J, Heinzmann AT, Lawson L. (1980) Effect of training and a component analysis of a behavioral safety program. J Appl Psychol 65:261-270.
LaMontagne AD, Kelsey KT, Ryan CM, Christiani DC. (1992) A participatory workplace health and safety training program for ethylene oxide. Amer J Indust Med 22:651-664.
Lapping JE, Parsons MA. (1980) The impact of training in the construction industry. Prof Safe 13-18.
Lepore BA, Olson CN, Tomer GM. (1984) The dollars and sense of occupational back injury prevention training. Clin Mgmt 4:38-40.
Leslie Jr JH, Adams SK. (1973) Programmed safety through programmed learning. Hum Fact 15:223-236.
Lin L, Cohen HH. (1983) Development and evaluation of an employee hazard reporting and management information system in a hospital. Final Report, Safety Sciences, San Diego CA, NIOSH Contract 210-81-3102, Nat'l Inst Occup Safe & Hlth, Morgantown, WVA.
Lindell, MK. (1994) Motivational and organizational factors affecting implementation of worker safety training. Occupational Medicine: State of the Art Reviews 9(2):211-240.
Linnemann Jr CC, Cannon C, DeRonde M, Lamphear B. (1991) Effect of educational programs, rigid sharps containers and universal precautions on reported needle stick injuries in health care workers. Infect Contr Hosp Epidem 12:214-219.
Luskin J, Somers C, Wooding J, Levenstein C. (1992) Teaching health and safety: Problems and possibilities for learner-centered training. Amer J Indust Med 22:665-676.
Lynch P, Cummings MJ, Roberts PL, Herriott MJ, Yates, B Stamm WE. (1990) Implementing and evaluating a system of generic infection precautions: Body substance isolation. Amer J Infect Contr 18:1-12.
McAfee RB, Winn AR. (1989) The use of incentives/feedback to enhance workplace safety: A critique of the literature. J Safety Res 20:7-19.
McCarthy PK, Schietinger H, Fitzhugh ZA. (1988) AIDS education and training for health care providers. Hlth Educ Res 3: 97-103.
McKenna SP, Hale AR. (1981) The effect of emergency first aid training on the incidence of accidents in factories. J Occup Accidents 3:101-114.
McKenna SP, Hale AR. (1982) Changing behavior towards danger: The effect of first aid training. J Occup Accidents 4:47-59.
McKenzie F, Storment J, Van Hook P, Armstrong TJ. (1985) A program for control of repetitive trauma disorders associated with hand tool operations in a telecommunications manufacturing facility. Amer Indus Hyg Assoc J 46:674-678.
McQuiston TH, Coleman P, Wallerstein NB, Marcus AG, Morawetz JS, Ortleib DW. (1994) Hazardous waste worker education: Long-term effects. J Occup Med 36(12):1310-1323.
Mallett LG, Vaught C, Peters RH. (1992) Training that encourages miners to avoid unsupported roof. In: Preventing Coal Mine Groundfall Accidents: How to identify and respond to geologic hazards and prevent unsafe behavior. Proceedings of Technical Transfer Seminar. U. S. Bureau of Mines, Information Circular 9332, pp 32-45.
Manwaring JC, Conroy C. (1990) Occupational confined space-related fatalities: Surveillance and prevention. J Safe Res 21:157-164.
Maples TW, Jacoby JA, Johnson DE, Ter Haar GL, Buckingham FM. Effectiveness of employee training and motivation programs in reducing exposure to inorganic lead and lead alkyls. (1982) Amer Ind Hyg Assoc J 43:692-694.
Meridian Research Inc. (1993) Identification of training requirements in OSHA regulations. Contract No. J-9-F-1-0019, Office of Program Evaluation, Occupational Safety and Health Administration, Washington D.C. (In draft form)
Michaels D, Zoloth S, Bernstein N, Kass D, Schrier K. (1992) Workshops are not enough: Making right-to-know training lead to workplace change. Amer J Indus Med 22:637-649.
Miller G, Agnew N. (1973) First aid Training and accidents. Occup Psychol 47:209-218.
Millican R, Baker RC, Cook GT. (1981) Controlling heat stress- administrative versus physical control. Amer Indus Hyg Assoc J 42:411-416.
NIOSH (1994), Worker deaths in confined spaces. A summary of NIOSH surveillance and investigative findings. DHHS(NIOSH) 94-103, National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention, U.S. Department of Health and Human Services, Cincinnati, Ohio.
Occupational Safety and Health Administration. (1983) Hazard communication-final rule. Federal Register 48:53280.
Occupational Safety and Health Administration. (1988a) Training requirements in OSHA standards and training guidelines. OSHA Rept. 2254, Occupational Safety and Health Administration, U.S. Department of Labor, Washington D.C.
Occupational Safety and Health Administration. (1988b) Voluntary protection programs. Federal Register 53(133): 26339-26348.
Occupational Safety and Health Administration. (1992) Ergonomic safety and health management; Advance Notice of proposed rulemaking; requests for comments and information. 57 Federal Register 34192.
Occupational Safety and Health Administration. (1996) Working draft of a proposed safety and health program standard.
Occupational Safety and Health Administration, U.S. Department of Labor, Washington, D.C.
Office of Technology Assessment (1985) Preventing illness and injury in the workplace. OTA-H-256, U.S. Congress, Washington, D.C.
Parenmark G, Engvall B, Malmkvist AK. (1988) Ergonomic on-the-job training of assembly workers. Appl Ergo 19:143-146.
Parker, BL. (1984) Summative evaluation in training and development: A review and critique of the literature, 1980 through 1983. Project No. 4, Training and Development Research Center, University of Minnesota, St. Paul, MN.
Parkinson DK, Bromet EJ, Dew MA, Dunn LO, Barkman M, Wright M. (1989) Effectiveness of the United Steel Workers of America coke oven intervention program. J Occup Med 31:464-472.
Perkins R. (1995) Evaluation of and Alaskan marine safety training program. Public Hlth Repts 110:701-702.
Peters RH. (1989) Review of recent research on organizational and behavioral factors associated with mine safety. Bureau of Mines Circular IC 9232, Pittsburgh Research Center, U.S. Bureau of Mines, Pittsburgh, PA.
Porru S, Donato F, Apostoli P, Coniglio L, Duca, P, Alessio L. (1993) The utility of health education among lead workers: The experience of one program. Amer J Indust Med 22:473-481.
Ray PS, Purswell JL, Schlegel RE. (1990) A behavioral approach to improve safety at the workplace. In: Advances in Industrial Ergonomics and Safety (Ed: B. Das, Taylor & Francis, NY) 983-988.
Reber RA, Wallin JA. (1984) The effects of training, goal setting and knowledge of results on safe behavior:A component analysis. Acad Mgmt J 27:544-560.
Robins TG, Klitzman S. (1988) Hazard communication in a large U.S. manufacturing firm: The ecology of health education in the workplace. Hlth Educ Qtrl 15:451-472.
Robins TG, Hugentobler MK, Kaminski M, Klitzman S. (1990) Implementation of the federal hazard communication standard: Does training work? J Occup Med 32:1133-1140.
Rubinsky S, Smith NF. (1971) Final Report, Univ Rhode Island, Providence RI, PHS Contract 86-68-207, Injury Control Research Laboratory, Providence RI.
Ruch F. (1963) Psychology and Life (Scott, Foresman and Company, Chicago, IL) 6th Edition, Chapters 3, 4.
Saarela KL. (1990) An intervention program utilizing small groups: A comparative study. J Safe Res 21:149-156.
Saarela KL, Saari J, Alltonen M. (1989) The effects of an informational safety campaign in the shipbuilding industry. J Occup Accidents 10:255-266.
Saari J, Bedard S, Dufort V, Hryniewiecki J, Theriault G. (1994) Successful training strategies to implement a workplace hazardous materials information system - an evaluation at 80 plants. J Occup Med 36(5):569-574.
Saari J, Nasanen M. (1989) The effect of positive feedback on industrial housekeeping and accidents: A long-term study at a shipyard. Intl J Indus Ergo 4:201-211.
Sadler OW, Montgomery GM. (1982) The application of positive practice overcorrection to the use of hearing protection. Amer Indus Hyg Assoc J 43:451-454.
St. Vincent M, Tellier C, Lortie M. (1989) Training in handling: An evaluative study. Ergon 32:191-210.
Scholey M. (1983) Back stress: The effects of training nurses to lift patients in a clinical situation. Intl J Nurs Stud 20:1-13.
Schwartz RK. (1989) Cognition and learning in industrial accident injury prevention: An occupational therapy perspective. In: Health Promotion and Preventive Programs: Models of Occupational Therapy Practice (Haworth Press, N. Y.) 67-85.
Sechrest L, Figueredo AJ. (1993) Program evaluation. In: Annual Review of Psychology (Ed: LW Porter & MW Rosensweig, Annual Reviews Inc, Palo Alto, CA), Vol 44: 645-674.
Seto WH, Ching TY, Chu YB, Fielding F. (1990) Reduction of the frequency of needle recapping by effective education: A need for conceptual alteration. Infect Control Hosp Epidem 11:194-196.
Shi, L. (1993) A cost-benefit analysis of a California County's back injury prevention program. Publ Hlth Rept 108: 204-211.
Silverstein BA, Armstrong TJ, Longmate A, Woody D. (1988) Can in-plant exercise control musculoskeletal symptoms? J Occup Medicine 30(12:923-927.
Sitterley TE, Pietan OD, Metaftin, WE. (1974) Firefighter skills study: Effectiveness of training and retraining methods. Boeing Aerospace Company, Seattle, WA
Slappendel C, Laird I, Kawachi I, Marshall S, Cryer, C. (1993) Factors affecting work injury among forestry workers. J Safe Res 24:19-32.
Sleight RB, Cook KG. (1974) Problems in occupational safety and health: A critical review of select worker physical and psychological factors. HEW(NIOSH) Publ. No: 75-124, National Institute for Occupational Safety and Health, Cincinnati, OH Smeltzer LR. (1979) Do we really evaluate, or just talk about it. Training 17:6-8.
Smith, ME. (1980) Evaluating training operations and programs. Training & Dev J 34:70-78.
Smith MJ, Anger WK, Uslan SS. (1978) Behavior modification applied to occupational safety. J Safe Res 10:87-88.
Smith MJ, Cohen HH, Cohen A, Cleveland RJ. (1978) Characteristics of successful safety programs. J Safe Res 10:5-15.
Smith NF, Rubinsky S. (1972) Long-term retention of safety procedures learned through accident simulation. DHEW Publication No. (HSM) 72-10016, Injury C>
Snook, SH, Campanelli RA, Hart JW. (1978) A study of three preventive approaches to low back injury. J Occup Med 20:478-481.
Snook SH. (1988) Comparison of different approaches for the prevention of low back pain. Appl Indust Hyg 3:73-78.
Stubbs DA, Buckle PW, Hudson MP, Rivers PM. (1983) Back pain in the nursing profession II. The effectiveness of training. Ergon 26:767-779.
Sulzer-Azaroff B, Harris TC, McCann KB (1994) Beyond training: Organizational performance management techniques. Occupational Medicine: State of the Art Reviews 9(2):321-339.
Sulzer-Azaroff B, Loafman B, Merante RJ, Hlavcek AC. (1990) Improving occupational safety in a large industrial plant: A systematic replication. J Org Behav Mgmt 11:99-120.
Symes, AM, Graveling RA, Campbell SJ. (1992) Risk training and materials handling. Rept. No. TM/92/05, Institute of Occupational Medicine, Edinburgh, Scotland.
Tan KK, Fishwick NG, Dickson WA, Sykes PJ. (1991) Does training reduce the incidence of industrial hand injuries? J Hand Surg 16B:323-326.
Tannenbaum SI, Yukl G. (1992) Training and development in work organizations. Ann Rev Psychol 43:399-441.
Tomer GM, Olson CN, Lepore BA. (1984) Back injury prevention training makes dollars and sense. Natl Safe News 36-39.
Troup JDG, Rauhala HH. (1987) Ergonomics and training. Intl J Nurs Stud 24:325-330.
University of Kansas (1982) Behavioral procedures for reducing worker exposures to carcinogens. NIOSH Contract Rept. 210-77-0040. National Institute for Occupational Safety and Health, Cincinnati OH 45226.
University of Michigan. (1991) Training impact evaluation of NIEHS hazardous waste worker training programs. School of Public Health, Ann Arbor, MI.
Vaught C, Brinch MJ, Kellner HJ. (1988) Instructional mode and its effect on initial self-contained self-rescuer donning attempts during training. Rept of Investigations 9208, U.S. Bureau of Mines, Pittsburgh, PA.
Wallerstein N, Baker R (1994) Labor education programs in health and safety. Occupational Medicine: State of the Art Reviews 9(2): 305-320.
Weinger M, Lyons M. (1992) Problem-solving in the fields: An action-oriented approach to farmworker education about pesticides. Amer J Indust Med 22:677-690.
Wertz DC, Sorenson JR, Liebling L, Kessler L, Heeren TC. (1987) Knowledge and attitudes of AIDS health care providers before and after education programs. Pub Hlth Rept 102:248-254.
Wong ES, Stotka JL, Chinchilli VM, Williams DS, Stuart G, Markowitz SM. (1991) Are universal precautions effective in reducing the number of occupational exposures among health care workers? J Amer Med Assoc 265:1123-1128.
Yarrall M. (1986) Educating for hearing conservation. Occup Hlth (October) 333-335.
Zohar D, Cohen A, Azar N. (1980) Promoting increased use of ear protectors in noise through information feedback. Hum Fact 22:69-79.
Zohar D, Fussfield N. (1981) Modifying earplug wearing behavior by behavior modification techniques: An empirical evaluation. J Org Behav Mgmt 3:41-52.
Back to the Table of Contents
APPENDIX A
A-III. Control of Health Hazards-Physical Agents