Initial SME Classification Results
From eotcd
Subject Matter Experts were asked to classify 1,151 URL's in accordance with the SuDocs classification system. Of the 1151 URLs, 30% were in disagreement and 70% were in agreement. The disagreements were then classified based on the type of disagreement. The table displays the percentages for each disagreement category. The table is followed by a description of each of the categories.
Disagreement Category | % of Total
(N = 1151) |
% of Disagreements
(n = 343) |
Additional Parent/Subordinate | 10% | 32% |
Classified v In scope-unable to classify | 6% | 20% |
No Agreement | 6% | 19% |
Parent Author v Subordinate Office | 5% | 16% |
Classified v Out of scope-unable to classify | 3% | 10% |
Unable to classify: In scope v Out of scope | 1% | 2% |
Definitions of Disagreement Categories
- Additional Parent/Subordinate
- One of the classifiers added one or more additional parent authors or subordinate offices AND (1) the classifiers agreed on one or more parent authors/subordinate offices; OR (2) classifiers disagreed in one of three ways: (a) parent author v subordinate office of same parent, (b) subordinate office v subordinate office of same parent; or (c) subordinate office v subordinate office+series designation of the same parent.
- Classified v In Scope Unable to Classify
- One classifier assigned an author(s); second classifier indicated URL was in scope but was unable to classify it.
- No Agreement
- None of the classifications agree, regardless of how many were assigned; however, classifications were assigned by both (i.e., no “unable to classify” assignments); includes differences in subordinate office classifications within the same parent author; includes differences when subordinate offices are the same but one classifier identified a series designation.
- Parent Author v. Subordinate Office
- Differ only in that one classifier assigned a parent author and the second classifier assigned a subordinate office of the that parent; all other assignments (if any) are the same.
- Classified v Out of Scope Unable to Classify
- One classifier assigned an author(s); second classifier indicated URL was out of scope.
- In Scope v Out of Scope
- Neither assigned an author; one classified URL as in scope unable to classify; second classified URL as out of scope.