FACT SHEET: The Development of EPA's National Certification Exams for Lead-Based Paint Abatement Professionals

How were the national exams developed and validated?

The national exams were developed for the U.S. EPA under contract to Westat, Inc., a consulting firm, that assembled a special project team for this task consisting of industrial hygienists, industrial psychologists and environmental scientists with a keen knowledge of the emerging lead abatement industry. The project, which officially began in July 1995, was overseen and supported by a workgroup consisting of representatives from six different States in addition to U.S. EPA headquarters and regional staff. The process began with a series of focus group meetings to complete the requisite job analyses and the selection and appointment of a panel of subject matter experts (SMEs). After the job dimensions for lead inspectors, supervisors and risk assessors had been established, Westat undertook a survey to identify and rank the proper learning objectives for each of the subject disciplines. The item bank of test questions and the examination blueprints were then developed based upon the learning objectives (these same learning objectives are also being incorporated into the U.S. EPA's model training course curricula as these materials are updated to help ensure that a direct and common link is maintained between what students are taught in the model courses and what they are tested for on the national exams). Once the blueprints became available, training entities administered draft versions of the exams voluntarily all around the country as a part of the procedure to validate items. The exam was completed through yet another focus group process which involved a careful review of each individual item before its acceptance. Throughout their development, Westat and the U.S. EPA have strenuously emphasized both excellence and validity as the essential foundation for the new national lead certification exams.

Top of page

Were the States and Tribes involved?

Yes, States and Tribes have been integrally involved in both the design and development of the national lead certification exams. Even before starting this project, the U.S. EPA convened a planning workshop attended by representatives from 13 different States, to discuss State issues and concerns regarding a national lead certification examination program. The consensus of this forum was that a national system should strive to fulfill the following performance objectives:
o prestige - States, Tribes, training providers and professionals should be willing to voluntarily associate themselves with the system because of perceived benefits to all parties,

o State/Tribal control - States and Tribes should have the ability to provide "signature" tests, and the flexibility to customize their participation,
o affordability - the cost to consumers should be kept nominal,
o simplicity - the system should be designed to have minimal infrastructure and procedural requirements,

o validity - the computer-based item bank of test questions forming the core of the examination system should be validated, legally-defensible, and amenable to updating, and

o reciprocity - the system should mitigate rather than create barriers to certification reciprocity between States and Tribes.

Following this workshop, EPA formed an agencywide work group and coordinated the development of the national lead exams. Six States then participated directly as members of this work group, and thereby helped to direct the 2-year project effort which culminated in completion of the national exams. Two other States donated their existing State examination item banks to this joint effort. Still another State, and also an Indian Tribe, contributed members to serve on the panel of subject matter experts responsible for exam validation. Other States helped the U.S. EPA to recruit qualified lead training entities to voluntarily assist with the pretesting of the exams. The U.S. EPA's goal has always been to achieve an examination program that would be both acceptable and helpful to the greatest number of States and Tribes. The national exams are truly "national" in the sense that they were developed with the help of experts from across the country, and they were designed specifically to fulfill performance standards set by the States and Tribes.

Top of page