This report presents an analysis of the effectiveness of the Talent Search in Florida, Indiana, and Texas, drawing upon project, state, and federal administrative records to examine short-term program outcomes for program participants and a matched comparison group. The specific goals of the Talent Search program are to identify qualified youths with potential for postsecondary education programs, publicize the availability of student financial aide, and encourage secondary and postsecondary school dropouts to reenter an educational program.
The main research questions posed in this design and addressed in this report are (1) Is it possible to rely on administrative records to compile a complete, retrospective record of participation in Talent Search, characteristics of students in secondary school, and secondary and postsecondary outcomes? And (2) Can administrative data sources and quasi-experimental techniques be used to identify students similar to Talent Search students but who did not participate in the program, in order to generate valid estimates of the relationship of participation in Talent Search to secondary and postsecondary outcomes?
The compilation of data from administrative data sources to study the effect of Talent Search on participants was a success in three states: Florida, Indiana, and Texas. Information was assembled on the characteristics and outcomes of the cohort of students who were in ninth grade during the 1995-1996 school year, along with participation by any of the cohort members in Talent Search. Because a large amount of data was compiled in each state, complex propensity score matching models were used to identify nonparticipating students who were most similar to Talent Search participants. However, analyzing the effect of Talent Search on participants in any one state suffered from serious limitations. Still, the variations in the data, as well as the strategies for drawing comparison students in each state, provided a good test of the sensitivity of the findings to using different data sources and comparison students.
This research is limited in its ability to attribute participation in Talent Search to improved outcomes in any one state. However, findings that were consistent across all three states suggest greater robustness. These findings include:
Last Modified: 08/30/2006
|