AHSI wishes to assist organizations in the network in assembling and disseminating information about their individual and collective performance with respect to a common core of significant outcomes. To that end, AHSI proposes that AHSI organizations reach a consensus on common core outcomes, indicators, and measures. This system will address performance outcomes, not enabling objectives that typically are unique to each organization’s service design.

Major Tasks

1. Develop a common core of outcomes and indicators addressed to significant outcomes for which all AHSI organizations will collect and report data (Figure 1).
2. Assist each organization in identifying outcomes and indicators not included in the common core but addressed to its significant out outcomes and enabling objectives.
3. Assist each AHSI organization in sharing its outcomes, indicators, and measures throughout the network.

Each organization has specific outcomes and enabling objectives for which it collects performance data. For example, EdVisions collects performance data using its Hope Index, and YouthBuild is particularly interested in vocational certifications. The common core data system will not address these organization-specific outcomes and indicators.

Common Core of Data

The common core of data will include basic demographic and risk factor data on the populations served by each organization as well as selected performance outcomes that operationally define program success. The table below provides suggested categories and indicators for each. Operational definitions will need to be established for each indicator.

Developing outcomes and indicators for the population served by AHSI organizations poses different challenges than those for typical high school student populations. Because students enter AHSI programs with many substantial risk factors, it is important to understand student background in establishing definitions of what constitutes success. Many of these students do not follow traditional pathways to developing themselves or their careers.

Data Category

Potential Common Core Indicators

Demographic Information

Age, gender, ethnicity, parental status, grades completed, high school attendance, high school diploma, eligibility for free and reduced lunch

Risk Factors

Court involved, foster care, special needs, substance abuse

Dropout Diversion / Recovery

# / % eligible students graduating

College Ready

# / % of graduates enrolled in college;# / % of graduates enrolled in college with requirement for enrolling in one or fewer remedial courses

Career Ready

# / % of graduates ready to work and ready to learn job-specific technical skills[1]

# / % of graduates placed in full-time employment with benefits and growth opportunities

# / % graduating with vocational certification(s)

Improved agency and civic responsibility

# / % 18yrs or older registered to vote

# / % demonstrating community leadership while in program, hours of community service performed

[1] Definition used in Equipped for the Future (EFF). EFF is a Work Readiness Credential supported by state and National partners including NY, NJ, FL, WA, and The National Governors’ Association.

Data Collection Considerations

Retrospective data will be collected where possible. In most cases, historical data are not available on these indicators across all organizations. Therefore, it is likely that 2005-06 may constitute a baseline year for most or all of these proposed common core indicators. AHSI will develop common data collection forms for recording these data, including the demographic information on the student population. AHSI will also align data collection with that conducted by AIR and Parthenon for Gates Foundation reporting.

Data Analysis

Performance outcome data will be analyzed by demographic and risk-factor variables. Comparisons will be made to national and regional data on similar student populations in order to judge the significance of changes in performance outcome measures over time.

Reporting

Identify major audiences, such as policy makers, potential adopters, students and parents, program staff, and the public. It is likely that the common core of data, which is addressed primarily to program outcomes rather than to enabling objectives, will be used primarily for communicating with policymakers and the public. Program staff, potential adopters, and students and parents are likely to be interested in performance information regarding key enabling objectives which are not part of the common core of data.

Suggested Action Steps

1. Achieve consensus on establishing a common core of data.
2. Select common core outcomes and indicators (with operational definitions).
3. Align data collection with Gates reporting requirements conducted by AIR and Parthenon.
4. Develop data collection forms for all demographic, risk factor, and outcome indicators.
5. Identify non-common core outcomes and indicators unique to each organization.
6. Develop processes and structures for data collection, analysis, and reporting of common core data.
7. Assist each organization in developing processes and structures for data collection, analysis, and reporting of performance data on organization-specific outcomes.