Wednesday 1 February 2012

Assignment #4 - Logic Model

This assignment is a continuation of Assignment #3: Program Evaluation of the Saskatoon Ball Hockey League.

Goals
Objectives
Activities
Outputs
Outcomes
Impacts
To help children from low income homes an opportunity to participate in the SBHL.
- Gain Kidsport program approval for individual funding.
- Show where stated goals of SBHL match user perception and where they differ.
- Suggest areas of improvement for SBHL
1. Research and present Kidsport objectives and sport requirements.
2. Research and present goals of SBHL (emphasize how they match goals of Kidsport)
3. Distribute surveys to participants.
4. Compile data and analyze based on Kidsport requirements.
5. Secondary activity: make suggestions to SBHL based on participant feedback.
1. Quantitative information will be gathered and compiled based on survey results.
2. Qualitative information will be gathered through open-ended survey questions.
3. Concrete evidence of equity.
4. Final report will match Kidsport objectives.
5. Suggestions for improvements will be given to SBHL.
1. Kidsport will approve SBHL for funding.
2. More children will be able to participate in ball hockey-especially from low income families.
3. League will make changes to improve product and increase customer satisfaction.
1. Children from low income families reap the long term benefits of physical activity on a team sport (self-confidence, improved health, friends, etc).
2. The SBHL grows and provides a stable and fun sporting environment for all ages.

Goals and Objectives were covered in detail in Assignment #3.
Activities:
  1. Using the Kidsport website, Joel will summarize relevant information. If additional information is required, Joel will contact Kendra Greyeyes of the Saskatoon Chapter of Kidsport.
  2. Using the SBHL website, Joel will summarize relevant information. If additional information is required, Joel will contact Dean Crossland, President of the SBHL.
  3. Dean will provide Joel will email addresses of current participants in the Saskatoon Youth leagues. May add emails of past participants to help determine if finances was a factor in them no longer participating. The surveys will be sent out and several days later a reminder email will be sent out (from the league). Within two weeks of the first email, Joel will begin compilation.
  4. Joel will compile, categorize,and analyze survey information and prepare a report that shows that ball hockey satisfies the requirements of Kidsport. The SBHL will present it to Kidsport (Joel will provide support)
  5. Joel will summarize survey results of strengths and weaknesses of the league and will make appropriate recommendations.
Outputs:
      Reports will include quantitative data as well as testimonials, video, and observational information.
Outcomes and Impacts:
      Obtaining funding for low-income families through Kidsport is one of the objectives, but ultimately this decision is beyond the control of the SBHL. However, through the information gathered through this process, the SBHL will identify areas of improvements and changes that can be made to all participants – including low income participants. So, the goal of helping kids from low-income families will more quickly be met if if Kidsport approves funding but can also succeed if the SBHL makes necessary changes and grows and, as a result of economies of scale, can offer ball hockey at a lower cost.
      Therefore, this evaluation will provide multiple ways for the SBHL to fulfill its motto of being “a sport for everyone.”















Assignment #3: Saskatoon Ball Hockey


Saskatoon Ball Hockey Evaluation Proposal

      The purpose of this evaluation is to gather information and make recommendations that will help to grow and improve the SBHL both in the short and long term and to make the sport more accessible to lower income families.  The evaluation will document the goals of the SBHL and to survey participants to see how well they are meeting these goals and to use this information to compare to Kidsport objectives.  If it is clear that the two are a good fit, this evaluation will provide the SBHL with a framework to apply for approval  from Kidsport Canada for funding for children from low income families to play ball hockey.  We will receive valuable feedback from its participants and, based on this feedback, we will make recommendations to the SBHL that will make the league more attractive and successful.  Ultimately, the league will grow and become more economically stable and affordable for all participants.
      Ultimately, this evaluation should help in three areas:
  1. Help families who could otherwise not afford to participate an opportunity to play.
  2. Improve the league through feedback from survey participants.
  3. Strengthen and grow the league through increased participation.
      The first step in this process is to identify what Kidsport does and what their requirements are for sporting activities to be eligible for funding. This will be taken from www.kidsport.ca and can be summarized with their motto, “So all kids can play.” This evaluation is NOT for the league to obtain funding directly (which Kidsport does provide), it is to gain approval for SBHL participants to apply for personal funding to help cover the individual costs of registration.
      The second step is to document background, procedures, and the mission of the Saskatoon Ball Hockey League, especially as it pertains to the Kidsport requirements. Included will be facts such as number of participants, cost to participate, number of seasons throughout the year, etc. This information can be gathered from their extensive website, www.saskatoonballhockey.com and can be summarized with their motto, “A game for everyone.”
      The third step will be to collect data. Since the SBHL has the email address of all of its participants (approximately 250 youth), an email survey would be most appropriate to collect quantitative data. Considering the personal and emotional nature of Kidsport, the statistics collected from the surveys will be supplemented with video evidence from games as well testimonials. Also, if time allows, specific statistics on playing time could be recorded to satisfy questions of equality regardless of ability.
      Step four will be the compilation and analysis of the data and narrative responses. This will provide tangible evidence to the decision-makers at Kidsport that the SBHL satisfies Kidsport requirements and deserves to be recognized as an approved sport for funding. While approval is out of the hands of the SBHL, at the very least this will provide them with feedback from Kidsport as to what changes they would need to make in order to qualify.
      Since all participants will have a chance to fill out a survey, there will also be an opportunity for them to provide feedback as to what they would like to see improved with the SBHL. At this point, this would be a secondary goal for this evaluation but, if time and resources allow, it may provide invaluable information for league organizers.

Who might use the evaluation? What do they want to know? How will they use the results?
SBHL
- Dean Crossland (president)
- Justin Podhorodeski (coordinator)
- Jordan Berry (marketing)
- Is program delivering as promised?
- What are Kidsport requirements?
- Does program meet Kidsport requirements?
- How can we improve the league?
- Apply for Kidsport approval.








- Make appropriate changes.
- Quantify claims in marketing and promotion.




Kidsport - Does league meet approval requirements? - Make decision on league qualification.
Parents of potential participants - Does league deliver what it promises? - Decide if child should participate.

Secondary level of groups who may be interested in the results of the evaluation:

Henk Ruys Soccer Centre - How many parents come to games?
- Do players want more time?
- Decide of it is profitable to open concession/charge admission, etc.
- Decide priority of ball hockey among renters.
Other potential facilities - Is the league growing?
- Do teams want more playing time (or practices)?
- Should we be pursuing the SBHL as a potential location for games (or practices)?

      As part of step one, the Kidsport mission must be detailed and the survey questions based around Kidsport requirements. The Kidsport mission is “We believe that no kid should be left on the sidelines and all should be given the opportunity to experience the positive benefits of organized sports. KidSport™ provides support to children in order to remove financial barriers that prevent them from playing organized sport.” Specifically they look at the following areas:
Does ball hockey...
  • Allow all kids to play?
  • Encourage kids to be physically active?
  • Improve their self-esteem and self-confidence?
  • Help develop life-long skills?
  • Improve their academic performance?
  • Help kids make new friends?
Sub-questions about the SBHL will be based around the above main questions. For example:
Do you agree with the following statements (scale of 1 (mostly disagree)to 5 (mostly agree)):
  1. All players get equal playing time, regardless of ability.
  2. Both boys and girls are welcome to participate.
  3. The rules are clearly laid out and enforced by referees.
  4. Ball hockey is a safe sport.
  5. Games are held at convenient times.
  6. Players get lots of exercise during games.
  7. My child looks forward to games.
  8. Since playing ball hockey, my child's self-confidence has improved.
  9. Ball hockey is a sport that kids may keep playing as an adult.
  10. Since playing ball hockey, my child's academic performance has improved.
  11. My child has made new friends at ball hockey.
  12. Ball hockey is about having fun.
  13. Paying for ball hockey is a financial sacrifice for our family.
  14. The schedule is clearly laid out and followed throughout the year.
  15. Financial barriers may prevent future participation in ball hockey.
  16. It would be better to have more games.
  17. It would be better if teams had practice times.
  18. The ball hockey website is helpful and easy to use.
  19. Ball hockey has been a positive experience for my child.
  20. I would recommend ball hockey to other families.
Some yes/no questions:
  1. Have you ever received funding assistance for an organized sport (Kidsport, Jumpstart, etc.)?
  2. Is your combined household salary less than $40,000/year?
  3. Did you help coach or manage your child's team?
And some open ended questions:
  1. What is the best thing about the ball hockey league?
  2. What would you like to see done differently?
  3. Please share a story about how ball hockey has positively impacted your child and/or your family.
      If possible, it would also be helpful to contact past players who are no longer participating in ball hockey to see why they did not return especially if it was for financial reasons.
      Once this data is collected and various narrative stories compiled, we will use the Kidsport mission statement as a template to reveal our findings (step 4). For example, the main goal is to allow ALL kids to play. We will show the statistics that prove that the SBHL is meeting that goal: “94% of respondents believe that any child, regardless of ability or gender is welcome to play ball hockey and will enjoy equal playing time as all other players.”
      We will also focus on the financial aspect: “58% of respondents said that ball hockey is a financial hardship and, of those, 77% have a combined household salary of less than $40,000/year.” If possible we will also show that the reason some children stop playing is for financial reasons.
      This report will be given to Kidsport along with the SBHL request to be recognized as an eligible sport for participant funding.
      A second report will be added to the first that will detail participant perceptions on the strengths and weaknesses of the SBHL along with our recommendations as to how the league could address concerns and improve their product. Both reports will be given to Dean Crossland, President of the SBHL.
      We believe that the combination of these two reports will drastically improve what is already a very popular league. The first report will help secure funding which will, in turn, add more participants to the various youth leagues. And the second report will suggest improvements that will increase player and parent satisfaction and enhance the possibility of players returning season after season.