Numerous GAO reports on "Assessments of Selected Weapon Systems," have cited the lack of product knowledge a key decision points as a major factor in programs that overrun costs, are behind schedule and do not deliver the performance as promised. After nine reports, the GAO continues to find that newer programs are beginning to demonstrate higher levels of knowledge at key decision points, but most are still not fully adhering to a knowledge-based acquisition approach. Good acquisition outcomes require the use of a knowledge-based approach to product development that demonstrates knowledge before significant commitments are made. On the basis of their studies the GAO has identified three key knowledge points:
- Knowledge Point 1: Resources and Requirements Match.
- Knowledge Point 2: Product Design is Stable.
- Knowledge Point 3: Manufacturing Processes are Mature.
Figure 12- 5 GAO Identified Knowledge Points
Each of these knowledge points can be measured during the acquisition life cycle and using the technical reviews and audits as a knowledge assessment tool makes a lot of sense.
12.7.1 Knowledge Point 1: Resources and Requirements Match
Achieving a high level of technology maturity by the start of system development is an important indicator of whether this match has been made. This means that the technologies needed to meet essential product requirements that have been demonstrated to work in their intended environment. In addition, the developer has completed a preliminary design of the product that shows the design is feasible.
12.7.2 Knowledge Point 2: Product Design is Stable
This point occurs when a program determines that a product's design will meet customer requirements, as well as cost, schedule, and reliability targets. A best practice is to achieve design stability at the system-level critical design review, usually held midway through system development. Completion of at least 90 percent of engineering drawings at this point or 100 percent of the 3D product models for ships at fabrication start provides tangible evidence that the product's design is stable, and a prototype demonstration shows that the design is capable of meeting performance requirements.
12.7.3 Knowledge Point 3: Manufacturing Processes Are Mature
This point is achieved when it has been demonstrated that the developer can manufacture the product within cost, schedule, and quality targets. A best practice is to ensure that all critical manufacturing processes are in statistical control — that is, they are repeatable, sustainable, and capable of consistently producing parts within the product's quality tolerances and standards — at the start of production.
