Crash and inspection records were used in this evaluation if the date of the event
occurred within the 12-month time period, not when the records were uploaded to
MCMIS. The quality of this data is evaluated with each monthly snapshot and the
States receive ratings of "Good," "Fair," or "Poor" for nine SSDQ Measures. Based
on these individual ratings, plus the Overriding Indicator, each State receives
an Overall State Rating. The methodology used to determine these ratings is provided
below.
Crash Record Completeness: Average of Driver and Vehicle Identification Completeness
Evaluations
The Crash Record Completeness Measure evaluates fatal and non-fatal crash records
that represent interstate and intrastate carriers and includes large truck and bus
vehicle types. This measure determines a rating based on the completeness of driver
and vehicle crash data reported to FMCSA. A State's rating is determined by evaluating
the completeness of the driver data and vehicle data separately and then averaging
these results together. The completeness of the driver data is determined by the
Driver Identification Completeness Evaluation and the completeness of the vehicle
data is determined by the Vehicle Identification Completeness Evaluation.
|
|
The Crash Record Completeness rating is determined as follows:
Rating |
Criteria
|
Good
|
|
Percentage of completed driver
and vehicle information is >= 85% |
Fair
|
|
Percentage of completed driver
and vehicle information is 70 - 84% |
Poor
|
|
Percentage of completed driver
and vehicle information is < 70% |
Updated Non-Fatal Crash Completeness Measure
All States are responsible for reporting fatal and non-fatal crash records to FMCSA
that meet the standard reporting criteria. FMCSA uses these records to support its
mission to reduce crashes, injuries, and fatalities involving large trucks and buses
on our nation's roadways. Because of the complexity of State crash reporting systems,
it is often difficult for States to determine if all reportable non-fatal crash
records have been submitted to FMCSA. State-specific evaluations of crash reporting
have determined significant underreporting and prompted the need to develop non-fatal
crash record benchmarks for each State. The NFCC measure is intended to serve as
a guideline to assess whether a State's non-fatal crash reporting falls within an
expected range.
![](images/arrow_sm.gif)
View the
Interactive Guide to learn about the NFCC evaluation process
The NFCC measure
determines a State rating by comparing the number of State-reported non-fatal crash
records in MCMIS to an expected range of non-fatal crash records generated by a
statistical model. The input data used by the model, how the data are processed
through the model, and the evaluation and final determination of a State's NFCC
rating are described in a 4-step approach.
Step 2: Process Data Through a Statistical Model
It is hypothesized that a ratio of fatal crash involvements to non-fatal reportable
involvements exists that is independent of any State’s data system and applies across
all the States. Since the number of fatal crash involvements is generally well known,
it is then possible to predict the number of non-fatal crash involvements that occur
in a State. The NFCC measure utilizes a simple log-linear regression model that
translates the number of fatal crash involvements in MCMIS to an expected range
of non-fatal crash record involvements. The State fatal data is input to the statistical
model to generate estimates of non-fatal crash involvements.
Two sets of prediction intervals are generated by the model to provide ranges of
non-fatal crash involvements. The prediction intervals are expressed in terms of
the probability that the number of reportable non-fatal crash involvements fall
within the prediction interval. The model was programmed to output 99% and 90% prediction
intervals. The prediction intervals are used to define expected data ranges, and
each range has an upper and lower boundary.
The model incorporates an urbanization factor to account for the proportion of rural
to urban commercial vehicle travel in a State. The purpose of the adjustment is
to account for any variation in the ratio of fatal to non-fatal reportable crash
involvements that may be due to variations in the proportion of rural or urban commercial
motor vehicle travel in a State.
The document “A New Model of Crash Severities Reportable to the MCMIS Crash
File” explains more about the statistical model used by this measure.
Step 3: Compare State Non-Fatal Data to Model Results
The State-reported number of non-fatal crash records in MCMIS are compared against
the expected data ranges output by the model. It is determined where the MCMIS non-fatal
crash records fall within the expected data ranges. This determination is used to
assign each State a base rating of 'good', 'fair', 'poor', or 'insufficient data'.
The base rating assignments are one part of the final rating assignment process.
The diagram below illustrates the rating ranges based on the expected ranges generated
from the statistical model. States with few fatal crash records may yield less predictable
output and may be assigned an 'insufficient data' rating.
* Assign a base rating of 'Insufficient Data' if Reported MCMIS Fatal Records is
less than 15
AND Non-Fatal Records is within the Poor Rating Range
The base rating assignments are defined as follows.
Base Rating Assignments:
Good rating range: Reported Non-Fatal
crash records (from MCMIS) is greater than or equal to lower boundary of 90% prediction
interval AND less than or equal to upper boundary
of 99% prediction interval
Fair rating range Reported Non-Fatal
crash records (from MCMIS) is greater than or equal to lower boundary of 99% prediction
interval AND less than lower boundary of 90% prediction
interval (under reporting) OR
Reported Non-Fatal crash records is greater than upper boundary of 99% prediction
interval (over reporting)
Reported Non-Fatal crash
records (from MCMIS) is less than lower boundary of 99% prediction interval AND MCMIS fatal crash records is greater than or
equal to 15 (under reporting)
Insufficient Data rating range: Reported
Non-Fatal crash records (from MCMIS) is less than lower boundary of 99% prediction
interval AND MCMIS Fatal crash records is < 15
Step 4: Determine Rating Results
The NFCC rating is determined by reviewing the base rating results and the most
recent fatal crash completeness (FCC) measure rating for each State. Both of these
ratings are important for the assignment of the final NFCC rating.
The FCC measure rating is considered since the model's output is using State-reported
fatal crash records to generate estimated non-fatal crash record values. If a State's FCC rating is 'good' or 'fair', it is assumed their MCMIS fatal crash
reporting is sufficient to estimate the expected number of non-fatal crash records.
In those cases, the NFCC base rating is regarded as the final NFCC measure rating.
If a State's FCC rating is either 'poor' or 'insufficient data', it is assumed their
MCMIS fatal crash reporting is insufficient due to inadequate reporting or too few
fatal crash involvements occurring in the State. An “override” is administered,
meaning, the base rating cannot be used. The override will result in an NFCC rating
of either 'poor' or 'insufficient data' due to incomplete MCMIS fatal reporting.
The final Non-Fatal Crash Completeness rating is determined as follows:
Rating |
Criteria
|
Good
|
|
Reported MCMIS non-fatal records fall within
Good rating range AND FCC rating is Good or Fair
|
Fair
|
|
Reported MCMIS non-fatal records fall within
Fair rating range AND FCC rating is Good or Fair
|
Poor
|
|
Reported MCMIS non-fatal records fall within
Poor rating range AND FCC rating is Good, Fair
or Poor |
Insufficient
Data |
|
Base rating is assigned Insufficient Data OR
Reported MCMIS non-fatal records fall within Good or Fair rating range
AND FCC rating is Poor OR
FCC rating is Insufficient Data
|
Crash Consistency †: Percentage of State-Reported Non-Fatal Crash Records
The Crash Consistency Overriding Indicator evaluates non-fatal crash records that represent interstate and intrastate carriers and includes large truck and bus vehicle types. This "red flag" indicates States that have reported less than 50% of non-fatal crash records for the current 12-month period compared to the yearly average, based on the previous 36-months.
The Crash Consistency Overriding Indicator "flag" is determined as follows:
Rating |
Criteria
|
No Flag
|
|
Estimate Reported is >= 50% |
Red Flag
|
|
Estimate Reported is < 50% |
Insufficient Data
|
|
State has < 15 records reported in current timeframe AND State has < 15 records reported in previous 3 year average AND Estimate Reported is <= 50% |
† States that have an obvious and significant decline in crash record reporting will be categorized as Poor in the Overall State Rating and Crash Rating, without regard to their rating on other measures.
Inspection Record Completeness: Average of Driver and Vehicle Identification Completeness Evaluations
The Inspection Record Completeness Measure evaluates level 1, 2, and 3 roadside inspection records that represent interstate and intrastate carriers and includes large truck and bus vehicle types. This measure determines a rating based on the completeness of driver and vehicle inspection data reported to FMCSA. A State's rating is determined by evaluating the completeness of the driver data and vehicle data separately and then averaging these results together. The completeness of four (4) driver data elements are determined by the Driver Identification Completeness Evaluation and the completeness of two (2) vehicle data elements are determined by the Vehicle Identification Completeness Evaluation.
|
|
The Inspection Record Completeness rating is determined as follows:
Rating |
Criteria
|
Good
|
|
Percentage of completed driver and vehicle information is >= 85% |
Fair
|
|
Percentage of completed driver and vehicle information is 70 - 84% |
Poor
|
|
Percentage of completed driver and vehicle information is < 70% |
Inspection VIN Accuracy: Percentage of Valid Vehicle Identification Numbers Reported on the First Vehicle Unit within Inspection Records
The Inspection VIN Accuracy Measure evaluates level 1-6 roadside inspection records that represent interstate and intrastate carriers and includes large truck and bus vehicle types. This measure determines a rating based on the completeness and accuracy of the vehicle identification number reported on the first vehicle unit reported to FMCSA – all trailing units are excluded from this measure. A State’s rating is determined by evaluating the 17-character VIN using the "checksum" digit in the 9th character position. The checksum digit is used to determine if the VIN is accurate based upon an algorithm that uses the other 16 characters in the VIN. Any VIN with invalid characters (i.e. I, O, or Q) or an incomplete field (i.e. less than 17 characters) does not pass the checksum algorithm and is invalid. For this measure, records with all the same numbers (i.e. 99999999999999999) are also counted as invalid.
The Inspection VIN Accuracy rating is determined as follows:
Rating |
Criteria
|
Good
|
|
Percentage of completed and accurate VIN is >= 85% |
Fair
|
|
Percentage of completed and accurate VIN is 70 - 84% |
Poor
|
|
Percentage of completed and accurate VIN is < 70% |
Inspection Timeliness: Percentage of Inspection Records Reported within 21 Days
The Inspection Timeliness Measure evaluates inspection records that represent interstate and intrastate carriers and includes large truck and bus vehicle types. This measure determines a rating based on the percentage of inspection records reported to FMCSA within 21 days over a 12-month period.
The Inspection Timeliness rating is determined as follows:
Rating |
Criteria
|
Good
|
|
Percentage reported within 21 Days is >= 90% |
Fair
|
|
Percentage reported within 21 Days is 65 - 89% |
Poor
|
|
Percentage reported within 21 Days is < 65% |
Inspection Accuracy: Percentage of Matched Inspection Records
The Inspection Accuracy Measure evaluates inspection records that represent interstate carriers and intrastate carriers transporting hazardous material and includes large truck and bus vehicle types. This measure determines a rating based on the percentage of inspection records reported by the States over a 12-month period that were matched to a company registered in MCMIS.
The Inspection Accuracy rating is determined as follows:
Rating |
Criteria
|
Good
|
|
Percentage of matched records is >= 95% |
Fair
|
|
Percentage of matched records is 85 - 94% |
Poor
|
|
Percentage of matched records is < 85% |