The Midnight Basketball Program
You are Director of Programming for a local gymnasium. Your gym has recently extended its hours to offer a Midnight Basketball program. The program is intended to reduce gang activity by providing an alternative late-night engagement for teen and pre-teen boys and girls, and by fostering mentoring relationships between the adults who coach and the boys and girls who participate. It is supported by a grant from a local philanthropic organization. The grant has been provided for three years, but in order for it to be renewed, the philanthropic organization wants evidence that it is making a difference – that is, that the program is keeping participants out of gangs, and is thereby helping to reduce gang activity. In order to determine whether or not it is worthwhile for your program to continue, the philanthropic organization wants to know what effects your program is having, and how substantial those effects are.
Each question worth 9 points.
1. In this case, would you conduct an evaluation or research? Why? Also, what would you choose as the criteria/research questions for your evaluation/research? (be specific when justifying your answer)
2. What kinds of evidence are likely to be most informative about the effectiveness of the midnight basketball program?
3. How would you get that evidence? What data are required?
Sample Solution
Midnight Basketball Program Evaluation: Research or Evaluation?
1. Conduct an Evaluation:
This scenario calls for an evaluation rather than research. Here's why:
- Program exists and seeks improvement: We're not testing a new program or theory, but assessing the existing Midnight Basketball program's effectiveness.
- Focus on program impact: Our goal is to measure the program's specific impact on gang activity and participant well-being, not generate generalizable knowledge.
- Inform decision-making: The evaluation needs to provide evidence to inform the program's continuation or improvement, not contribute to broader scientific understanding.
Full Answer Section
Research questions and criteria:
- Primary question:Â To what extent has the Midnight Basketball program reduced gang activity and its risk factors among participating youth?
- Secondary questions:
- How has the program affected participants' attitudes towards gangs and violence?
- Have participants experienced improvements in self-esteem, social skills, or academic performance?
- How satisfied are participants and coaches with the program?
- Criteria:Â We'll measure success based on:
- Reduction in gang membership:Â Decrease in self-reported gang affiliation or documented gang involvement among participants.
- Reduced risk factors: Decreased exposure to violence, improved school attendance, increased positive social connections.
- Positive participant outcomes: Improved self-esteem, social skills, and academic performance.
- Program satisfaction:Â Positive feedback from participants and coaches.
2. Sources of Evidence:
- Quantitative data:
- Pre- and post-program surveys of participants on gang involvement, risk factors, and well-being.
- School attendance records and academic performance indicators.
- Police data on gang-related crime in the program's target area (before and after).
- Qualitative data:
- Focus groups and interviews with participants, coaches, and community members to understand their experiences and perspectives.
- Observations of program sessions to assess engagement and positive interaction.
- Analysis of program documents and records.
3. Data Collection:
- Pre-program baseline data: Conduct surveys and gather relevant data (school records, crime statistics) before program launch to establish a baseline for comparison.
- Ongoing data collection: Conduct surveys and interviews with participants periodically throughout the program. Monitor school records and crime data continuously.
- Post-program evaluation: Repeat surveys and interviews at the program's end to assess changes in participants' attitudes and behaviors. Analyze crime data for the post-program period.
- Qualitative data collection: Schedule focus groups and interviews throughout and after the program. Observe program sessions regularly. Analyze program documents and records for insights.
Remember, ethical considerations are paramount. Ensure informed consent, confidentiality, and data security throughout the evaluation process.
By employing a well-designed evaluation and collecting diverse data sources, you can provide the philanthropic organization with valuable evidence about the Midnight Basketball program's effectiveness, influencing its future and potentially impacting the lives of countless youths.