ExpectMore.gov


Detailed Information on the
Department of Defense Training and Education Programs -- Voluntary Training Assessment

Program Code 10003232
Program Title Department of Defense Training and Education Programs -- Voluntary Training
Department Name Dept of Defense--Military
Agency/Bureau Name Department of Defense--Military
Program Type(s) Direct Federal Program
Assessment Year 2006
Assessment Rating Moderately Effective
Assessment Section Scores
Section Score
Program Purpose & Design 100%
Strategic Planning 75%
Program Management 71%
Program Results/Accountability 75%
Program Funding Level
(in millions)
FY2008 $608
FY2009 $603
*Note: funding shown for a program may be less than the actual program amount in one or more years because part of the program's funding was assessed and shown in other PART(s).

Ongoing Program Improvement Plans

Year Began Improvement Plan Status Comments
2006

DoD should consider altering it's output goal of measuring the number of degress obtained and the number of annual enrollments to take into account the eligible population. For example, the percentage of the force enrolled or the percentage of the force who obtain degrees may be more telling measures.

No action taken
2006

Continuing to monitor cost efficiency per service memer trained.

Action taken, but not completed

Completed Program Improvement Plans

Year Began Improvement Plan Status Comments

Program Performance Measures

Term Type  
Long-term Output

Measure: Number of College Degrees/High School Diplomas Earned


Explanation:Measures the actual number of diplomas and degrees earned by Servicemembers through the Voluntary Education program. Did not meet target in 2005 due to low enrollments, Service members were deployed and were not able to take courses to complete their degrees.

Year Target Actual
2011 38,440
2010 38,440
2009 38,440
2008 38,440
2007 38,440
2006 38,714 36,527
2005 38,714 36,527
2004 33,527 38,714
2003 28,963 33,527
Long-term Output

Measure: Sustainment and/or Growth in annual enrollments in Voluntary Education Programs


Explanation:This measure tracks servicemember's enrollment in vountary education programs. The program aims to at least sustain the number of enrollments each year, this can be particulary challeneing with the current War and the changing force. The annual number of enrollments direclty related the the long-term outcome measure of number of degrees obtained. DoD did not meet target in 2005 due to Service members deployment.

Year Target Actual
2011 882,467
2010 882,467
2009 882,467
2008 882,467
2007 882,467
2006 882,467 819,526
2005 882,467 819,526
2004 665,029 882,467
2003 651,989 665,029
2002 600,000 651,989
Long-term/Annual Efficiency

Measure: Average servicemember cost share per credit hour.


Explanation:This new measure will track the percent of average in-state cost per credit hour that the servicemember pays out-of-pocket. Average in-state costs per credit hour information is provided from the Department of Education.

Year Target Actual
2011 19% or less
2010 19% or less
2009 19% or less
2008 19% or less
2007 19% or less
2006 19% or less 19%
2005 19% or less 19%
Annual Efficiency

Measure: Reduce Servicemembers out-of-pocket education costs


Explanation:This measures aims to ensure that Services fund tuition assistance and expenses per the Department of Defense policy of $250 per semester unit cap with an annual per Service member ceiling of $4,500. Increase in dollars from '02-'03 due to policy change. Decrease in dollars between '04-'05 Service members deployed and enrollments dropped

Year Target Actual
2009 4 Services - $551M
2008 4 Services - $551M
2007 4 Services $534M
2006 4 Services - $511M 4 Services -$511M
2005 4 Services - 4 Services - $513 M
2004 4 Services 4 Services - $460 M
2003 4 Services 4 Services - $371 M
2002 4 Services 4 Services - $243 M
Long-term Output

Measure: Sustainment and/or Growth in annual enrollments in Voluntary Education Programs


Explanation:This measure tracks servicemember's enrollment in vountary education programs. The program aims to at least sustain the number of enrollments each year, this can be particulary challeneing with the current War and the changing force. The annual number of enrollments direclty related the the long-term outcome measure of number of degrees obtained. DoD did not meet target in 2005 due to Service members deployment.

Year Target Actual
2011 882,467
2010 882,467
2009 882,467
2008 882,467 1/09
2007 882,467 805,415
2006 882,467 819,526
2005 882,467 819,526
2004 665,029 882,467
2003 651,989 665,029
2002 600,000 651,989
Annual Efficiency

Measure: Reduce Servicemembers out-of-pocket education costs


Explanation:This measures aims to ensure that Services fund tuition assistance and expenses per the Department of Defense policy of $250 per semester unit cap with an annual per Service member ceiling of $4,500. Increase in dollars from '02-'03 due to policy change. Decrease in dollars between '04-'05 Service members deployed and enrollments dropped

Year Target Actual
2009 4 Services - $551M
2008 4 Services - $551M 1/09
2007 4 Services $534M 4 services - $465 M
2006 4 Services - $511M 4 Services -$511M
2005 4 Services - 4 Services - $513 M
2004 4 Services 4 Services - $460 M
2003 4 Services 4 Services - $371 M
2002 4 Services 4 Services - $243 M
Long-term/Annual Efficiency

Measure: Average servicemember cost share per credit hour.


Explanation:This new measure will track the percent of average in-state cost per credit hour that the servicemember pays out-of-pocket. Average in-state costs per credit hour information is provided from the Department of Education.

Year Target Actual
2011 19% or less
2010 19% or less
2009 19% or less
2008 19% or less 1/09
2007 19% or less 19%
2006 19% or less 19%
2005 19% or less 19%
Long-term Output

Measure: Number of College Degrees/High School Diplomas Earned


Explanation:Measures the actual number of diplomas and degrees earned by Servicemembers through the Voluntary Education program. Did not meet target in 2005 due to low enrollments, Service members were deployed and were not able to take courses to complete their degrees.

Year Target Actual
2011 38,440
2010 38,440
2009 38,440
2008 38,440 1/09
2007 38,440 39,013
2006 38,714 36,527
2005 38,714 36,527
2004 33,527 38,714
2003 28,963 33,527

Questions/Answers (Detailed Assessment)

Section 1 - Program Purpose & Design
Number Question Answer Score
1.1

Is the program purpose clear?

Explanation: The purpose of the program is to provide active duty Service members with educational opportunities. This may include completing their high school education or earning an equivalency diploma; enrolling in vocational technical schools; receiving college credit for military training; or enrolling in post-secondary education programs that lead to degrees. The Voluntary Education program is a combination of financial tuition assistance and Department of Defense coordination with schools.

Evidence: Voluntary Education programs and services are authorized under Title 10, U.S. Code. Specific sections: ?? 2007 - Tuition For Off-Duty Training And Education http://www4.law.cornell.edu/uscode/html/uscode10/usc_sec_10_00002007----000-.html ?? 2005 - Advanced Education Assistance http://www.law.cornell.edu/uscode/html/uscode10/usc_sec_10_00002005----000-.html Service Voluntary Education programs are governed by specific instructions: ?? DoD Directive 1322.8: http://www.voled.doded.mil/voled_web/library/docs/DoDDirective1322.8.pdf ?? DoD Instruction 1322.25 http://www.voled.doded.mil/voled_web/library/docs/DodInstruction1322.25.pdf ?? DoD Instruction 1322.19 http://www.dtic.mil/whs/directives/corres/pdf/i132219_050988/i132219p.pdf

YES 20%
1.2

Does the program address a specific and existing problem, interest, or need?

Explanation: Service members may enter the military without their high school diploma or GED; vocational technical training or college education. Voluntary Education enhances the individual's academic achievement which in turn improves job performance and promotion potential. Surveys have demonstrated that (77% of enlisted and 72% of officers) military personnel reported continuing education while in the service was of high importance.

Evidence: Army Continuing Education System Findings from Fall 2004 Sample Survey of Military Personnel Marine Corps Administrative policy 576/04, Tuition Assistance Funding Policy. Paragraph 2 identifies the two-year requirement for officers; paragraph 4.B.3 describes the MASP. Marine Corps Community Service, outlines the Military Academic Skills Program http://www.usmc-mccs.org/education/masp.cfm Army Regulation 621-5 relates Tuition Assistance directly to force readiness.

YES 20%
1.3

Is the program designed so that it is not redundant or duplicative of any other Federal, state, local or private effort?

Explanation: The program is tailored to meet service members' needs. The program provides tuition assistance for Service members to continue their education and arranges for education opportunities to meet the unusual needs of the military population, such as frequent moves, making this program unique. Among the specific benefits: ?? Classes are offered on military installations worldwide. Some bases in the United States are in remote locations where a quality college would not be viable. And in some overseas locations it is against regulations for some service members to own a vehicle, so classes on base are more accessible. ?? Service members Opportunity Colleges is a partnership of colleges and universities with unique degree and transfer requirements tailored to service members and their families, who frequently move from place to place. It includes the Army, Navy, and Marine Corps. This program is designed so that all schools will accept completed semester hours so members will not have to repeat courses. ?? Distance learning also supports the needs of the Service and the member. While there are other programs that provide financial assistance for education, and service members may be eligible for those - there are none that provide the financial assistance in concert with the coordinated effort to support service members unique needs.

Evidence: ?? Title 10, U.S. Code Sections 2005 & 2007 authorize Tuition Assistance for Off-duty and advanced education, respectively, for Service members. http://www4.law.cornell.edu/uscode/html/uscode10/usc_sec_10_00002007----000-.html http://www.law.cornell.edu/uscode/html/uscode10/usc_sec_10_00002005----000-.html ?? Service members Opportunity Colleges and its associated universities guarantee to accept transfers from participating schools, allow military service schools and occupational experience to apply towards degree programs and issue Student Agreements that service as degree plans to enrolled students. http://www.soc.aascu.org

YES 20%
1.4

Is the program design free of major flaws that would limit the program's effectiveness or efficiency?

Explanation: There is no evidence to indicate that another approach would be more effective or efficient. The current method of providing education opportunities is more cost-effective than running a brick and mortar institution, in the US or in foreign countries. Their are not enough people to support individual colleges at each location, yet when aggregated across the Services the population is significant and argues for the program's effectiveness. At overseas education sites postsecondary education offerings are conducted via contracts to avoid unnecessary duplication and ensure the quality of the program is of the same standard as programs offered by institutions on their main campuses.

Evidence: DoD Instruction 1322.19 pg 1 http://www.dtic.mil/whs/directives/corres/pdf/i132219_050988/i132219p.pdf DoD Instruction 1322.25, 5.3 pg 3 http://www.voled.doded.mil/voled_web/library/docs/DodInstruction1322.25.pdf For the Marine Corps, Marine Corps Order 1560.25C defines the total Voluntary Education program, including required reports used to identify and correct any flaws. All Services have similar directives.

YES 20%
1.5

Is the program design effectively targeted so that resources will address the program's purpose directly and will reach intended beneficiaries?

Explanation: The application of resources is based on requirements and execution history; Services and operational and planning staff set education and training goals. Funds are controlled through DoD's Program Objective Memorandum process to ensure efficient and effective resourcing. Finally, agencies that administer the programs have the ability to prioritize funding to meet their education mission. The Voluntary Education program goes through an annual mid-year review during which funding that was authorized is compared to funding that has been executed. As a result of mid-year review, program effectiveness is examined . To insure that resources only reach intended beneficiaries, there ae installation level education program that must validate that the service member is eligible to receive tuition assistance. DoD has established financial management policy and procedures applicable to all programs, including Voluntary Education. DoD Financial Management Regulation 7000.14-R governs financial management for DoD and directs financial management requirements, systems, and functions for all appropriated, working capital, revolving, and trust fund activities. Implementation of these policies in specific programs: ?? Funding caps ensure effective targeting and distribution of available resources; policy memoranda explain the details. ?? Marine Corps Order P1560.25C details how funds are managed and expended in support of Voluntary Education.

Evidence: ?? Audit verification Marine Corps DD Form 1002, showing funding categories for Voluntary Education. All Services are required to prepare and submit similar forms. ?? Assistant Secretary of Defense Policy Memorandum, Uniform Tuition Assistance Policy, November 26, 2001 http://www.voled.doded.mil/voled_web/tapolicies/TAPolicy112601.htm ?? Policy Memorandum, Caps and Ceilings for Military Tuition Assistance, September 23, 2002 http://www.voled.doded.mil/voled_web/library/docs/caponfees.pdf MCO 1560.25C is an example that defines the total Marine Corps VOLED program profile. ?? Fund expenditures are reported annually in Service OP-5 exhibits, OP-5 for Navy and Air Force are provided as examples; all Services prepare and submit these forms.

YES 20%
Section 1 - Program Purpose & Design Score 100%
Section 2 - Strategic Planning
Number Question Answer Score
2.1

Does the program have a limited number of specific long-term performance measures that focus on outcomes and meaningfully reflect the purpose of the program?

Explanation: A primary goal of the Voluntary Education program is to sustain and/or increase number of degrees and diplomas earned annually. The program also aims to sustain or increase the number of servicemembers enrolled in Voluntary Education. While these are primarily output goals, this because the Voluntary Education program focuses on these process oriented activities. They do tie into the overal outcome goal of ensuring that we have the best educated and best military force possible. Every quarter, a briefing Monitoring the Status of the Force is presented to the Under Secretary of Defense (Personnel and Readiness). This briefing includes updates on performance measures related to education, and progress towards targets.

Evidence: ?? The Monitoring the Status of the Force briefing dated May 2006, is presented quarterly to Under Secretary of Defense (Personnel and Readiness). The report has performance measures for Off-Duty and Voluntary Programs. ?? Deputy Assistant Secretary of Defense (Military Community and Family Policy) publication, "A New Social Compact; A Reciprocal Agreement Between The Department Of Defense, Service Members And Families," has short, mid and long-term goals (July 2002). ?? The Military Installation Voluntary Education Review Final Report for FY 2004 found that most voluntary education institutions have program outcome assessments in place. ?? All Services have established voluntary education regulations and guidance to ensure targeted and authorized population receive resources. http://www.army.mil/usapa/epubs/pdf/r621_5.pdf

YES 12%
2.2

Does the program have ambitious targets and timeframes for its long-term measures?

Explanation: Although the Voluntary Education program has a sufficient long term measure, its targets are not ambitious. DoD aims to "sustain and / or increase" the number of degree awarded annually. This measure is not tied to a percentage of of the force obtaining degrees, nor is sustainment considered ambitious.

Evidence: The Monitoring the Status of the Force briefing presented quarterly to Under Secretary of Defense (Personnel and Readiness) shows the following goals: ?? Sustain and/or increase degrees and diplomas earned annually ?? Sustain and/or increase the number of course enrollments Chief of Naval Operations Instruction 1560.9 outlines the Navy Voluntary Education program. Goals are in paragraphs 3.a-3.d. http://neds.daps.dla.mil/directives/1560_9.pdf. All Services have similar directives. Marine Corps Order P1560.25C, (Appendix F pg 102)

NO 0%
2.3

Does the program have a limited number of specific annual performance measures that can demonstrate progress toward achieving the program's long-term goals?

Explanation: All Services have annual measures that build towards the long term measures and demonstrate progress. These include -Reduce Service member out-of-pocket Education Costs -Sustain Tuition Assistance enrollment in courses during off duty time -Adjust coverage annually to cover inflation reflected in the annual increase in tuition These contribute the long-term goal of increase degree attainment because they are steps needd to cahieve the long term goal. FOr example, degree attainment will not increase if enrollments in course does not correspondinlgy increase. While these are all output measures, the outcome is having the best educated best military force possible. The Voluntary Education program, however, only tracks output measures.

Evidence: The Monitoring the Status of the Force briefing (Evidence book), presented quarterly to Under Secretary of Defense (Personnel and Readiness) provides an update on the goals mentioned above. DMDC "Status of Forces Survey for Active Duty Members" Numbers are tracked in the annual Voluntary Education Management Information Systems report http://www.dantes.doded.mil/dantes_web/library/docs/voledfacts/FY05.pdf http://www.dantes.doded.mil/dantes_web/library/docs/voledfacts/ed_levels_FY05.pdf

YES 12%
2.4

Does the program have baselines and ambitious targets for its annual measures?

Explanation: Baselines have been well established through the collection of data in the annual Voluntary Education Management Information System report submitted by the Services to DoD. Ambitious annual targets for annual measures the Services have been established and are found in the Services Budget Exhibits. Baseline and targets are evaluated annually.

Evidence: The Monitoring the Status of the Force quarterly briefing: ?? Services fund the tuition assistance and expenses per DoD policy: $250 per semester unit cap with an annual per Service member ceiling of $4,500 ?? Enrollment baseline is obtained from the previous 3 years number of enrollments ?? Degrees/diplomas baseline is obtained from the previous years number of degrees/diploma Numbers are tracked in the annual Voluntary Education Management Information Systems report. http://www.dantes.doded.mil/dantes_web/library/docs/voledfacts/FY05.pdf http://www.dantes.doded.mil/dantes_web/library/docs/voledfacts/ed_levels_FY05.pdf Budget Exhibits: Navy FY2006/2007 Off Duty and Voluntary Education is a good example, typical of exhibits submitted annually by all Services.

YES 12%
2.5

Do all partners (including grantees, sub-grantees, contractors, cost-sharing partners, and other government partners) commit to and work toward the annual and/or long-term goals of the program?

Explanation: Partners include institutions that provide college and high school classes, contractors and commands and units at all levels in the Services that implement the program. Institutions are encouraged to become members of the Servicemembers Opportunity Colleges (SOC) - a consortium of over 1,800 colleges and universities that provide education opportunities for the unique needs of service members . Each SOC member agrees to accept military courses for credit, transfer of credit from other institutions and award credit towards a degree. Institutions that receive DoD tuition assistance dollars enter into Memoranda of Understanding and DoD contracts to provide course work / enrollments to Service members. Schools that receive tuition dollars are required (by contract or MOU) to provide enrollment data that demonstrates students' enrollment and successful completion. Contractors have partnered with DoD to the expand post-secondary programs into deployed sites and made modifications to the overseas contracts to meet troop deployment populations and the needs to the Servicemembers.

Evidence: DoD Instruction 1322.19 Voluntary Education Programs in Overseas Areas (http://www.dtic.mil/whs/directives/corres/pdf/i132219_050988/i132219p.pdf) The Servicemembers Opportunities College has articulation agreements between schools to accept and transfer credits so that the Serviceman can obtain their degree faster without duplication/repeat course work. (http://www.soc.aascu.org) The American Council on Education evaluates military coursework/training for equivalent academic credit. The Servicemembers apply military training experience towards college degrees, permitting the individual to DoD tuition assistance dollars to be used for courses needed to obtain their degrees. https://www.Militaryguides.acent.edu/index.htm

YES 12%
2.6

Are independent evaluations of sufficient scope and quality conducted on a regular basis or as needed to support program improvements and evaluate effectiveness and relevance to the problem, interest, or need?

Explanation: The American Council on Education conducts the Military Installation Voluntary Education Review (MIVER) to evaluate individual Service education centers on a schedule that varies from annually to every few years. The MIVER Project has two purposes: (1) to assess the quality of selected on base voluntary education programs and (2) to assist in the improvement of such education through appropriate recommendations to institutions installations, and the military services." These are of high quality and sufficient scope. An example of independent evaluations can be found in the Marine Corps order on Life Long Learning (LLL). It states that LLL will be inspected by MIVER as well as evaluated in the Commanding General's Inspection Program. In addition, LLL receives assistance visits from senior Marine Corps and Navy education personnel. In addition, the Servicemembers Opportunity College (SOC) enforces the Principles described in its Guide. If a postsecondary institution is not adhering to the SOC Principles, expectations and standards essential to their performance SOC will address the infractions with the institution. If corrective actions are not taken the institution will no longer be a member of SOC.

Evidence: MIVER: http://www.acenet.edu/Content/NavigationMenu/ProgramsServices/MilitaryPrograms/MIVER/index.htm MIVER Reports are provided to the MIVER-inspected installation commander, Voluntary Education Service Chiefs and DoD. The annual summary demonstrates that recommendation have been accepted and acted upon by activities . An excerpt from the report indicates the project's scope. Marine Corps Order P1560.25C, section 1004. Servicemembers Opportunity College Guide, 2005-2007 [pages I and vi-xi]: http://www.soc.aascu.org/pubfiles/socmisc/SOCGuideVolTwo.pdf

YES 12%
2.7

Are Budget requests explicitly tied to accomplishment of the annual and long-term performance goals, and are the resource needs presented in a complete and transparent manner in the program's budget?

Explanation: The relationship between performance and budget is unclear and DoD is unable to say what level of performance increase a given level of additional funding would cause. However, DoD is working towards better performance budgeting. Steps DoD is taking include the Planning, Program, Budget and Execution Process, which requires budgeting based on resources needed to achieve goals. Budget models are determined using historical program and financial data in combination with known or perceived changes to program elements (i.e. number of users, location of user populations and future directives). Both annual and out year requests are tied to information provided by the forecasting models and identified needs of the programs. DoD Supplementary FY2007-FY2011 Program and Budget Submission Guidance state that the Deputy Secretary of Defense has directed each Service to use performance-based measures for its budget formulation.

Evidence: All Services submit performance information for their Voluntary Education budgets. An example is the Navy's exhibit which shows detailed information about changes in the program and their connection to its budget. Monitoring the Status of the Force briefing slide showing an assessment of Budget and Performance Integration for Voluntary Education. DoD Supplementary FY2007-FY2011 Program and Budget Submission Guidance.

NO 0%
2.8

Has the program taken meaningful steps to correct its strategic planning deficiencies?

Explanation: The Voluntary Education program has taken significant steps in rectifying strategic planning deficiencies. In February 1991, DoD awarded a contract to the American Council on Education (ACE) to administer the Military Installation Voluntary Education Review (MIVER) Project. Any results of the independent MIVER reviews are enacted upon both at the installation level, and at the DoD level, if applicable.

Evidence: 2005 MIVER Site Revisit Report

YES 12%
Section 2 - Strategic Planning Score 75%
Section 3 - Program Management
Number Question Answer Score
3.1

Does the agency regularly collect timely and credible performance information, including information from key program partners, and use it to manage the program and improve performance?

Explanation: DoD collects information on a regular basis from the Services and other partners of Off-duty Voluntary Education Programs. Types of data collected include: enrollments and associated costs, graduations/completions, degrees/diplomas awarded, tests taken, percent of eligible personnel enrolled, and others. The DoD Voluntary Education Management Information System Program Report contains course enrollments, degrees obtained, and other performance information. Service reports are provide quarterly to monitor progress during the fiscal year and an annual roll up report is submitted to the Office of the Under Secretary. All Services have centralized and automated track processes systems. Their centralized management systems monitor tuition assistance, student participation, student records/progress, and program costs. The systems are integrated with those of their partners, such as Servicemembers Opportunities College and schools, Military Personnel Systems and the Defense Financial and Accounting Service.

Evidence: ?? DoD Voluntary Education Management Information System Program Report, FY 2005. (http://www.dantes.doded.mil/dantes_web/library/docs/voledfacts/FactSheetArchive.pdf) http://www.dantes.doded.mil/dantes_web/library/docs/voledfacts/FY05.pdf

YES 14%
3.2

Are Federal managers and program partners (including grantees, sub-grantees, contractors, cost-sharing partners, and other government partners) held accountable for cost, schedule and performance results?

Explanation: Although the Voluntary Education program does have some measures to hold program partners accountable, the link between program performance and DoD managers is more tenuous. Partners use the Federal Acquisition Regulation to encourage savings or terminate contracts. The FAR is used in rewarding and penalizing other government partners and contractors as the situation dictates.

Evidence: Federal Acquisition Regulation

NO 0%
3.3

Are funds (Federal and partners') obligated in a timely manner, spent for the intended purpose and accurately reported?

Explanation: Fund appropriated for Voluntary Education are largely spent on voluntary education, there is no evidence of significant transfer of this money to other accounts. It is by statue one year authority, and virtually all resources are obligated within that timeframe. This information is accurately reported in audits and in the budget.

Evidence: Congressional justification volumes show previous year's spending, thus validating that money appropriated for this purpose is spent for this purpose. DoD Financial Management Regulation, DoD 7000.14 makes the following statements about appropriate and timely obligation of funds, Volume 5, FOREWARD: "[this directive] governs financial management by establishing and enforcing requirements, principles, standards, systems, procedures, and practices necessary to comply with financial management statutory and regulatory requirements applicable to the Department of Defense. It directs financial management requirements, systems, and functions for all appropriated, working capital, revolving, and trust fund activities. In addition, it directs statutory and regulatory financial reporting requirements." http://www.dod.mil/comptroller/fmr/05/05_foreward.pdf

YES 14%
3.4

Does the program have procedures (e.g. competitive sourcing/cost comparisons, IT improvements, appropriate incentives) to measure and achieve efficiencies and cost effectiveness in program execution?

Explanation: All Services have Voluntary Education automated information/management systems that track and analyze allocated/spent dollars and participation in the program. Contract efficiencies are achieved in a number of ways. For example, whenever possible, Tri-Service or Joint Contracts are made with providers, as opposed to each service contracting independently. The contract with the American Council of Education to conduct Military Installation Voluntary Education Reviews is centrally managed by the Defense Activity for Non-Traditional Education Support. In addition, the Voluntary Education program has the efficiency measure of reducing service members out of pocket tuition costs, this measure has baselines and targets.

Evidence: ?? Contract between DoD and American Council on Education for Military Installation Voluntary Education Reviews. ?? Navy FY 2006 / 2007 Off Duty and Voluntary Education budget document is an example of exhibits submitted annually by all Services. ?? Marine Corps Voluntary Education Functionality Assessment contains baseline information and efficiency/effectiveness recommendations ?? Marine Corps Administrative Instruction 576/04, Marine Corps Tuition Assistance Funding Policy, sections 3.K, 3.L, 4.B.(3), and 4.B.(4) detail controls to ensure cost effectiveness. http://www.usmc.mil/maradmins/maradmin2000.nsf/0/c0ba5eacdc8945b685256f7a00045f0c?OpenDocument

YES 14%
3.5

Does the program collaborate and coordinate effectively with related programs?

Explanation: Voluntary Education program collaborates with American Council on Education, Servicemembers Opportunity College (SOC), Department of Labor (Army Cool program), Department of Education (Troops to Teachers program) Department of Veterans Affairs (VA education benefits), Service Training for Professional Development Technology Centers, Defense Activity for Non-Traditional Education Support (DANTES) and numerous post-secondary institutions. For example, DoD officials have collaborated and coordinated effectively with State Legislatures to pass legislation to promote in-state college tuition rates for active military service members and their families in their home state or state of duty assignment. This ensures that costs remain within the Uniform TA Policy and that the Service member does not have to pay for their education out of pocket.

Evidence: ?? SOC Consortium Guide, (http://www.soc.aascu.org) ?? In-State TA web page: https://www.hrc.army.mil/site/education/InState/index.htm The link "State Summary" shows status/details for each of the 50 states. ?? Troops to Teachers: http://www.dantes.doded.mil/dantes_web/troopstoteachers/overview.htm?Flag=True; this program is funded through the Department of Education. ?? Army Cool: https://www.cool.army.mil/

YES 14%
3.6

Does the program use strong financial management practices?

Explanation: While there are automated centralized financial management tracking systems in place for this program, there are still improvements needed in financial management practices. For example, procedures need to be in place to minimize erroneous payments.

Evidence:

NO 0%
3.7

Has the program taken meaningful steps to address its management deficiencies?

Explanation: DOD's financial management weaknesses have been well documented and affect most activities and organizations within DoD. To the greatest extent possible, however, financial managers follow extensive Service-level guidance and procedures, and their organizations undergo regular and rigorous audits and inspections. In addition, the Services are addressing existing financial management weaknesses. At the top level: ?? The Monitoring the Status of the Force briefing is presented quarterly to Under Secretary of Defense (Personnel and Readiness). It includes several measures relevant to program management at a high level: Strategic Management of Human Capital and Financial Management. The same briefing provides the Under Secretary a more detailed look at program management by tracking several measures associated with professional development education. Corrective actions at the Services level: ?? As a result of the Functionality Assessment, the Marine Corps is implementing strategies in the areas of information technology, standard staffing structure, tuition assistance management, contract management, and redundancies. ?? For all Services, Voluntary Education: The Military Installation Voluntary Education Review program identifies problem areas; follow up reports and corrective actions are reported annually to the Service Chiefs. Installations must provide corrective or progress updates to the Service Chiefs annually on all weaknesses.

Evidence: DoD Supplementary FY2007-FY2011 Program and Budget Submission Guidance directing each Service to "use performance-based measures for 100% of its resources" as a step to address management deficiencies in the areas of budget and finance. Measuring the Status of the Force brief. Marine Corps Community Services Functionality Assessment Scorecard The President's Management Agenda Scorecard Cascade. http://cpol.army.mil/library/nonarmy/dod_102703-pma.html Army regulation 11-2, Management Controls, chapters 1 and 2. Navy Functional Area Managers have been established to review functionality of systems within their responsible area and develop a suite of systems, eliminating those with duplicative functionality

YES 14%
Section 3 - Program Management Score 71%
Section 4 - Program Results/Accountability
Number Question Answer Score
4.1

Has the program demonstrated adequate progress in achieving its long-term performance goals?

Explanation: DOD's targets and baselines for this program are based on providing an uninterrupted opportunity for the Servicemember to voluntarily continue their off-duty education. Targets are based on past participation and enrollments, and progress has steadily been made. ?? Increase in the number of Degrees and Diplomas Earned - reviews the degree to which the Services meet the long-term goal of minimally sustaining enrollments and increase in the number of degrees and diplomas earned. DoD has established a minimum annual growth target of 2.5% to ensure the Services will meet the long-term objective. Throughout the program, Services collect information that shows goals are being met. Community College of the Air Force gathered evidence that participation resulted in reduced time to promotion, compared to non-enrolled personnel.

Evidence: Briefings on Community College of the Air Force Monitoring the Status of the Force briefing dated 31 May 2005, presented quarterly to Under Secretary of Defense (Personnel and Readiness) DoD Voluntary Education Management Information System Program Report, FY2005. http://www.dantes.doded.mil/dantes_web/library/docs/voledfacts/FactSheetArchive.pdf

SMALL EXTENT 8%
4.2

Does the program (including program partners) achieve its annual performance goals?

Explanation: DoD continues to make excellent progress toward achieving annual performance goals. This is demonstrated in using the measures: ?? Sustainment and/or Growth in annual enrollments in Voluntary Education Programs ?? Number of College Degrees/High School Diplomas Earned, measures the actual number of diplomas and degrees earned by Servicemembers against a growth target of 2.5% per year in FY 05 there were 36,527 degrees earned. ?? Cost per enrollment: Targets and baselines are evaluated annually as part of the budget process. The target is not to exceed $750 per enrollment.

Evidence: The DoD Voluntary Education Management Information System Program Report. http://www.dantes.doded.mil/dantes_web/library/docs/voledfacts/FactSheetArchive.pdf Monitoring the Status of the Force briefing dated May 2006, presented quarterly to Under Secretary of Defense (Personnel and Readiness).

LARGE EXTENT 17%
4.3

Does the program demonstrate improved efficiencies or cost effectiveness in achieving program goals each year?

Explanation: DoD achieves cost effectiveness in this program year after year. For example, Costs are controlled through limitations emplaced in the DoD Uniform Tuition Assistance policy with course and yearly caps ($250 per credit hour not to exceed $4,500 per year). This limitation allows all Servicemembers that voluntarily participate to continue their education. In addition, DoD has added a new measure that will track the average percent per credit hour that the servicemember is responsible for, this will demonstrate cost efficiencies over time

Evidence: Standard Uniform Tuition Assistances policy: (http://www.voled.doded.mil/voled_web/tapolicies/TAPolicy112601.htm) MIVER report DoD Instruction 1322.19 Voluntary Education Programs in Overseas Areas (http://www.dtic.mil/whs/directives/corres/pdf/i132219_050988/i132219p.pdf)

YES 25%
4.4

Does the performance of this program compare favorably to other programs, including government, private, etc., with similar purpose and goals?

Explanation: There are no comparable programs with similar purposes and goals that DoD's Voluntary Education program can be easily compared with. While there are other education assistance programs, there are none that meet the unique needs of servicemembers in such a coordinated and cohesive way.

Evidence:

NA 0%
4.5

Do independent evaluations of sufficient scope and quality indicate that the program is effective and achieving results?

Explanation: The American Council on Education was the project contractor for the Military Installation Voluntary Education Review project for FY 2005. MIVER reviews have found that "????" The Community College of the Air Force is accredited by the Commission on Colleges, Southern Association of Colleges and Schools - an independent evaluation that has found the program to be effective. The Center for Naval Analyses is an independent organization that studies military matters, and in found that this program has several strong positive effects: "improves promotion prospects significantly," "has a significant positive impact on retention," and "is cost-effective." The Community College of the Air Force is accredited by the Commission on Colleges, Southern Association of Colleges and Schools - an independent evaluation stated the program is effective. All of these evalutions are high quality and of sufficient scope.

Evidence: Center for Naval Analyses report CRM 98-40, "Effectiveness of the Voluntary Education Program." Community College of the Air Force fact sheet, Feb 2005. Military Installation Voluntary Education Review "Final Report Fiscal Year 2004."

YES 25%
Section 4 - Program Results/Accountability Score 75%


Last updated: 01092009.2006FALL