Initial SME Classification Results

Subject Matter Experts were asked to classify 1,151 URL's in accordance with the SuDocs classification system. Of the 1151 URLs, 30% were in disagreement and 70% were in agreement. The disagreements were then classified based on the type of disagreement. The table displays the percentages for each disagreement category. The table is followed by a description of each of the categories.

Definitions of Disagreement Categories

Additional Parent/Subordinate

One of the classifiers added one or more additional parent authors or subordinate offices AND (1) the classifiers agreed on one or more parent authors/subordinate offices; OR (2) classifiers disagreed in one of three ways: (a) parent author v subordinate office of same parent, (b) subordinate office v subordinate office of same parent; or (c) subordinate office v subordinate office+series designation of the same parent.

Classified v In Scope Unable to Classify

One classifier assigned an author(s); second classifier indicated URL was in scope but was unable to classify it.

No Agreement

None of the classifications agree, regardless of how many were assigned; however, classifications were assigned by both (i.e., no “unable to classify” assignments); includes differences in subordinate office classifications within the same parent author; includes differences when subordinate offices are the same but one classifier identified a series designation.

Parent Author v. Subordinate Office

Differ only in that one classifier assigned a parent author and the second classifier assigned a subordinate office of the that parent; all other assignments (if any) are the same.

Classified v Out of Scope Unable to Classify

One classifier assigned an author(s); second classifier indicated URL was out of scope.

In Scope v Out of Scope

Neither assigned an author; one classified URL as in scope unable to classify; second classified URL as out of scope.