Evaluation & Research Work
Canadian Coalition for Seniors Mental Health (CCSMH) - Substance Use Disorder Project Evaluation (2020) Canadian Coalition for Seniors Mental Health (CCSMH)- Substance Use Disorder Project Evaluation (2020) We conducted an evaluation of a three-year Health Canada funded Substance Use Disorder project for CCSMH, a network embedded within the College of Geriatric Psychiatrists. The project has been focused on the development of four sets of clinical guidelines and knowledge translation tools for the prevention, screening, assessment and treatment of alcohol, benzodiazepine, cannabis and opioid use disorders among older adults. The evaluation included the development of an evaluation framework; collection of data from stakeholders through a document review, key informant interviews, and web surveys; analysis and synthesis of the data; and a final report of evaluation findings and recommendations.
Ecology Action Centre - Our Food Project Evaluation (2020) Ecology Action Centre - Our Food Project Evaluation (2020) Horizons worked with the Ecology Action Centre to complete the evaluation of the Our Food Project. The evaluation included a synthesis and analysis of existing project data and new data collected through key informant interviews and was used to complete their Phase 3 Funder Report to the Public Health Agency of Canada.
Autism Nova Scotia (ANS) -Design and Facilitation of the Supported Housing Summit for Nova Scotians with Disability (2019) Autism Nova Scotia - Design and Facilitation of the Supported Housing Summit for Nova Scotians with Disability (2019) We were involved in the design and facilitation of the Supported Housing Summit for Nova Scotians with Disability based on a review of the evidence on best practice and the current state in Nova Scotia. The purpose of the work was to:
With ANS, Horizons prepared three evidence-based papers: 1. On the Autism Spectrum in Nova Scotia: Reviewing the Evidence for Community Living Models 2. In Crisis with Autism Spectrum Disorder: A Review of the Evidence 3. Building To Better: A White Paper on Supported Housing for the Autism and Developmental Disability Community Using these evidence documents, we designed an inclusive consultation and facilitation plan to conduct two one-day consultations on Supported Housing in Nova Scotia. The purpose of this work was to identify the major strengths and gaps in meeting the desires, needs and expectations in Nova Scotia’s communities. This work and the learnings we shared will serve as a guide to help individuals, families, and service providers navigate supported housing options, a foundation for stakeholder agencies and individuals in relevant sectors to collaborate, and laid the groundwork for building opportunities for supported housing across Nova Scotia.
Department of Health and Wellness -Evaluation of the Direct Health Benefits Program (2019) Department of Health and Wellness - Evaluation of the Direct Health Benefits Program (2019) Horizons worked with the NS Department of Health & Wellness to complete an evaluation of the Department’s Direct Benefits Program. The main aim of this evaluation was to assess the implementation and cumulative effects of the programs, and how they work in concert with the broader formal and informal system of supports for unpaid caregivers and care recipients to enable them to remain at home in community, to inform decision making aimed at the potential further expansion of the program. We used a mixed-methods approach for this evaluation, including an extensive analysis of existing assessment data, web-based surveys, and key informant interviews. The final reports for the Caregiver Benefit Program and the Supportive Care and Self-Management Care Programs, including recommendations created collaboratively with the Evaluation Working Group, were submitted to the Department.
Juniper House -Safety Assessment and Risk Management Approach Evaluation(2019) Juniper House - Safety Assessment and Risk Management Approach Evaluation(2019) Juniper House provides a safe refuge for women and their children who have experienced abuse. They received funding to implement an adapted version of the Safety Assessment and Risk Management Package (developed by The Redwood, a shelter and outreach service in Toronto, Ontario) for their services in rural Nova Scotia. Our role was to monitor and evaluate the implementation process over the past year, tracking learnings, successes, challenges, and adaptations along the way. We used a variety of data collection tools with staff, women who the organization serves, and the project coordinators.
Homeless No More -Theory of Change (2019) Homeless No More - Theory of Change (2019) We worked with Homeless No More, a plan to end youth homelessness in the Annapolis Valley, Nova Scotia, by 2027, to develop a theory of change for their work. A theory of change describes how and why a desired change is expected to happen in a particular context. It maps out the spaces between a program’s activities and describes how they lead to the desired goals being achieved. First, stakeholders identify the desired long-term goals, and then work backwards to identify all the conditions that must be in place (and how these related to one another causally) for the goals to occur. These are all mapped out in an ‘Outcomes Framework’.
Antigonish Women's Resource Centre -Design of Evaluation Plan (2019) Antigonish Women's Resource Centre - Design of Evaluation Plan (2019) In January 2018, Status of Women Canada (SWC) announced the launch of the first call for concepts under the Gender Based Violence (GBV) Program, with $20 million in funding for organizations to test promising practices to address gaps in supports to survivors of gender-based violence. Horizons worked with the Antigonish Women’s Resource Centre (AWRC) to design the evaluation plan to be included in their proposal to SWC for this funding.
Glooscap First Nation - Health Centre Needs Assessment (2019) Glooscap First Nation - Health Centre Needs Assessment (2019) We worked with Glooscap First Nation to conduct a health facility needs assessment for the community. The assessment is the first step of the Health Facilities and Capital Program (HFCP) of the First Nations and Inuit Health Branch (FNIHB), whose mandate is to assist First Nations and Inuit recipients design, develop, implement, coordinate and evaluate capital projects required to support the delivery of health services in their communities. Our work included a demographic analysis of the community to identify trends that may impact health services; building of a community profile through a document review, inventory of health-related programs and services; and interviews and focus groups held with community members and key stakeholders to identify community assets and challenges.
Atlantic Policy Congress of First Nations Chiefs Secretariat - First Nations Treatment Centre Governance Models Review (2019) Atlantic Policy Congress of First Nations Chiefs Secretariat - First Nations Treatment Centre Governance Models Review (2019) Through Indigenous Services Canada, the National Native Alcohol and Drug Abuse Program (NNADAP) and the National Youth Solvent Abuse Program (NYSAP) fund treatment centres across Canada to help Indigenous and Inuit communities develop local programs aimed at preventing alcohol, drug, and solvent abuse, and to help restore the well-being of individuals and communities. We were contracted by the Atlantic Policy Congress of First Nations Chiefs Secretariat (APC) to conduct an environmental scan to review treatment centre governance models across Canada, internationally, as well as leading practices throughout Atlantic Canada. Our work consisted of a mix of methods to gather the required information, including interviews and online search of First Nation and international Treatment Centres’ website searches to determine their governance models.
Inspiring Communities - Research and Evaluation Team (2017-2019) Inspiring Communities – Research and Evaluation Team (2017-2019) As the Research & Evaluation Team for this innovative collective impact initiative, we were responsible for the development of its theory of change, evaluation framework and tools, and the ongoing evaluation of its work to address complex social issues in Nova Scotia communities. As part of the work, we also supported a network of communities in using research-based and innovative approaches to addressing issues.
Tri-County Women’s Centre - Housing Data Analysis (2018) Tri-County Women’s Centre - Housing Data Analysis (2018) NSHA Public Health Services contracted us through the Tri-County Women’s Centre to complete an in-depth analysis of responses to the Housing Needs Assessment survey conducted across six counties in fall 2017 and winter 2018.
The purposes of the survey were to 1) increase knowledge of affordable and supportive housing needs and issues; 2) engage the community to better understand the local housing situation; 3) generate reports with current data on housing needs relevant to our communities that can be used for planning, service delivery, and funding proposals; and 4) to document the housing needs of all citizens including vulnerable populations (women leaving domestic violence, youth, seniors, LGBTQ people, persons with disabilities, people experiencing homelessness). The survey reports are available here.
National Aboriginal Diabetes Association - Evaluation and Report (2018) National Aboriginal Diabetes Association - Evaluation and Report (2018) The National Aboriginal Diabetes Association held its National Indigenous Diabetes Conference in Halifax in April. We conducted a bilingual web-based evaluation of the event. We also followed up with a number of delegates to include additional quotes/testimonials about the conference in the evaluation report we submitted.
First Nations and Inuit Health Branch (FNIHB), Indigenous Services Canada - Health Promotion and Disease Prevention Screening Brief Intervention and Referral (SBIR) in Atlantic First Nations Community Health Centres (2017 - 2018) First Nations and Inuit Health Branch (FNIHB), Indigenous Services Canada - Health Promotion and Disease Prevention Screening Brief Intervention and Referral (SBIR) in Atlantic First Nations Community Health Centres (2017 - 2018) SBIR is an approach that service providers can use for early identification and interventions with people who have real or potential alcohol and/or substance abuse challenges; it is a key component of identifying issues early and allowing for better care planning and better referrals.
FNUIHB contracted us to determine the best way to implement SBIR (with a target population of pregnant women) in First Nations communities in the Atlantic Region. We completed a literature review on SBIR with Indigenous populations, conducted interviews with health staff in selected First Nation Health Centres, facilitated focus groups with women in those communities, and developed a final report. The report included recommendations on implementation SBIR, as well as recommendations about training and ongoing support to communities.
First Nations and Inuit Health Branch (FNIHB), Indigenous Services Canada - National Anti-Drug Strategy Prescription Drug Abuse Investment Assessment Methodology (2017) First Nations and Inuit Health Branch (FNIHB), Indigenous Services Canada - National Anti-Drug Strategy Prescription Drug Abuse Investment Assessment Methodology (2017) Health Canada and Indigenous Services Canada are part of a federal multi-year inter-departmental initiative, the National Anti-Drug Strategy (NADS). It focuses on preventing illicit drug use, treatment of people who have illicit/prescription drug dependencies, and combatting the production and distribution of illicit drugs. Since 2014, the program has also focused on addressing problematic prescription drug use. A portion of the funding is used to enhance prevention and treatment services in First Nation communities, and focuses on prevention training, case management and crisis intervention, specific to problematic usage. We worked with FNIHB regional leads across Canada to review and update the methodology they use to report on the work that is happening. Then we met with representatives from three communities who receive funding through this program to gather their input about the reporting methodology. Finally, we prepared an updated reporting tool, and presented it to FNIHB regional leads across the country.
Feed Nova Scotia - Evaluation Support Feed Nova Scotia - Evaluation Support We worked with Feed Nova Scotia, a provincial charity that supports a network of 146 members across the province (comprised of food banks, meal programs, soup kitchens, shelters, and a wide range of social development agencies), to review and enhance their existing theory of change, evaluation plan, and data collection processes; and we developed evaluation tools for measuring the impact of the Network.
Atlantic Policy Congress of First Nations Chiefs (APC) - Evaluation of Nursing Policies’ Usefulness and Uptake in Atlantic First Nations Communities Atlantic Policy Congress of First Nations Chiefs (APC) - Evaluation of Nursing Policies’ Usefulness and Uptake in Atlantic First Nations Communities In 2004, community health nursing practice policies were developed in each Atlantic province, and one province’s policies have been updated annually since then. The policies address professional responsibility and accountability, nursing practice, health protection, health promotion, administration, and human resources.
We worked with the APC to conduct an evaluation about the usefulness and uptake of the policies. The findings will inform future policy development and evaluation, as well as novel approaches for knowledge translation. We are also exploring whether the policies were developed using established systematic literature reviews and evidence appraisal tools, and using Indigenous knowledge.
Nova Scotia Health Authority, Mental Health and Addiction - Change the Odds - Nova Scotia Youth Gambling Prevention Project Evaluation Nova Scotia Health Authority, Mental Health and Addiction - Change the Odds - Nova Scotia Youth Gambling Prevention Project Evaluation We completed an evaluation of the first phase of a provincial initiative to prevent gambling and gambling harm among youth in Nova Scotia. Mental Health & Addiction Services staff from Nova Scotia’s former nine District Health Authorities and the IWK collaborated to conceive of and implement the first phase of the project. We worked with the group from the beginning of the project, contributing community development expertise, and working with the group to build a program model and an evaluation process that accurately reflected the evolving nature of the project, in the context of relevant work in the community. We collaboratively developed a logic model, a program description, an evaluation framework, and a performance measurement system for tracking project implementation, process, outputs, and outcomes. The evaluation methodology included a document review, key informant interviews, a focus group, and web and learning event surveys. The evaluation findings informed the next phase of the work.
In January 2016, we began working with the provincial project team to evaluate the second phase of the work. We collaborated to update the objectives, logic model, and evaluation framework, and we developed evaluation tools. The methodology, currently being implemented, includes focus groups, key informant interviews, paper and web surveys, and a performance measurement tracking tool. We developed an action planning tool for the project’s working groups and a monthly reporting template for the project coordinator to use with the funder (Nova Scotia Department of Health and Wellness).
YMCA Employment Centre - Portfolio Express Tool Evaluation (2016) YMCA Employment Centre - Portfolio Express Tool Evaluation (2016) We worked with the Greater Halifax YMCA Employment Centre to evaluate the effectiveness of the Portfolio Express tool they developed and piloted with participants at the East Preston Empowerment Academy. Portfolio Express helps people identify their knowledge, skills, and competencies; draws heavily on storytelling as a method for participants to uncover their prior learning; and helps people identify additional competencies they need to build in order to meet their goals. The goals could be for personal learning, for furthering education, and/or for obtaining red seal certification for trades many have been working in for years.
East Preston Empowerment Academy - Development of a Phase Two Evaluation Framework (2016) East Preston Empowerment Academy - Development of a Phase Two Evaluation Framework (2016) The East Preston Empowerment Academy is a grassroots, community-driven initiative of the East Preston United Baptist Church. The Academy provides literacy and academic enrichment adult learning program to adults who do not have high school diplomas. There are several components within the Academy, including learning foundations, employability pathways, leadership, and well-being. Our role was to create an evaluation framework for Phase 2 of the Academy’s Employability Pathways in the Skilled Trades, including a logic model and the evaluation questions.
Atlantic Policy Congress of First Nation Chiefs Secretariat (APC) - Renewal of the Atlantic Chiefs’ Priorities (2016) Atlantic Policy Congress of First Nation Chiefs Secretariat (APC) - Renewal of the Atlantic Chiefs’ Priorities (2016) We conducted a process to assist APC in renewing the Atlantic Chiefs̛ health priorities. This process involved gathering, reviewing, synthesizing and analyzing relevant data and evidence; gathering input about priorities from Health Directors; identifying and addressing gaps in knowledge; and facilitating an exercise to assist Chiefs in prioritizing health issues/needs. We meaningfully engaged the Health Directors and the Atlantic Health Partnership First Nation members, and created a framework for the priorities that aligns with their holistic view of health.
Eskasoni Community Health Centre - Review and Update of Eskasoni Community Health Centre Policies and Job Descriptions (2015-2016) Eskasoni Community Health Centre - Review and Update of Eskasoni Community Health Centre Policies and Job Descriptions (2015-2016) We completed a contract with the Eskasoni Health Centre to review its policies, procedures, and job descriptions to ensure that they are current, comprehensive, and that they align with the Community Health Plan. We reviewed existing policies, identified gaps, reworked the policies into a consistent format, and facilitated a day-long session with staff to review the policies and their work plans. We subsequently incorporated feedback from staff, and revised the policies, procedures, and job descriptions. We engaged staff in examining the policies, and fostering a sense of engagement and ownership of them.
Atlantic Policy Congress of First Nation Chiefs Secretariat (APC)- Family Violence Needs and Resources Assessment (2015)
Mental Health & Addiction Services, Annapolis Valley District Health Authority (AVDHA) - Evaluation of Prevention of Gambling and Gambling Harm among Youth (2014-2015)
Canadian Mental Health Association (CMHA) - Nova Scotia Division - Communities Addressing Suicide Together (CAST) Evaluation (2015)
Chrysalis House - Evaluation of Engaging Men and Boys in Ending Violence against Women and Girls (2014-2015)
Kings Community Action Group on Gambling - Building Community Readiness to Reduce Gambling Harm (2014 - 2015)
Wagmatcook First Nation - Give Us Wings Program Evaluation (2014 - 2016)
IWK Health Centre, Dalhousie University - Mothers Mental Health Toolkit Project Evaluation (2014)
First Nations and Inuit Health Branch, Health Canada - Brighter Futures and Building Healthy Communities Outcome Studies Coordination and Reporting (2013-2014)
Nova Scotia Department of Justice - Evaluation of the Mi'kmaq Legal Support Network (2013)
Department of Health and Wellness - Evaluation Services to Develop an Evaluation Plan for Collaborative Emergency Centres (2013)
Health Canada First Nations and Inuit Health Branch, Interprofessional Advisory and Program Support Directorate, Mental Wellness Division - National Native Alcohol and Drug Abuse Program (NNADAP) Community Outcome Study Methodology (2013)
Health Canada First Nations and Inuit Health Branch, Interprofessional Advisory and Program Support Directorate, Mental Wellness Division - Core Components of Standards and Guidelines for the FNIHB FASD Mentoring Program (2013)
IWK Mental Health and Addictions - Supporting Treatment Services for At-Risk Youth Final Outcome Evaluation (2012-2013)
Recreation Nova Scotia - Examining Municipal Recreation in Nova Scotia (2012)
Health Canada, First Nations and Inuit Health Branch (FNIHB) Community Programs Directorate, Children and Youth Division - A Literature Review on Standards and Best Practices of Case Management in Home Visitation Programs in the Context of Maternal Child Health (2012-2013)
Guysborough Antigonish Strait Health Authority - Evaluation of Community Health Board Planning and Activities (2012)
Department of Health and Wellness - Evaluation of Eskasoni Mental Health Crisis Line Services (2012)
Department of Health and Wellness - Evaluation of Eskasoni Mental Health Crisis Line Services (2012)
Health Canada, First Nations and Inuit Health Branch (FNIHB) Community Programs Directorate, Children and Youth Division - A Literature Review and Scan of Standards and Guidelines for Supervision Practices in Home Visitation Programs (2012)
Pictou Landing First Nation Health Centre - Report Preparation for Let's Deal With It Gambling Awareness Project (2012)
Department of Justice Canada - Family, Children & Youth Section - Identifying Promising Practices to Reduce Violence and Improve Safety of Aboriginal Women and Girls in Canada (2011 - 2012)
Nova Scotia Association for Sexual Health - Consultation and Best Practice Literature Review (2011 - 2012)
Nova Scotia Department of Health and Wellness Continuing Care - Challenging Behaviour Program Evaluation Framework Development & Evaluation Implementation (2009 - 2012)
Atlantic Policy Congress of First Nations Chiefs Secretariat (APCFNC) - Evaluation of the Atlantic Aboriginal Economic Development Integrated Research Program (AAEDIRP) (2011)
Health Canada First Nations & Inuit Health (FNIH) - Maternal & Child Health (MCH) Program Evaluation (2011)
IWK CHOICES Program- Supporting Treatment Services for At-Risk Youth in Capital Health & Aboriginal Youth Provincially Project Interim Evaluation (2011)
Lunenburg County & Queens Community Health Boards -South Shore Community Consultation (2011)
Health Canada - First Nations & Inuit Health - Aboriginal Health Transition Fund (AHTF) Integration Projects Comprehensive Process and Outcomes Evaluation (2010-2011)
Nova Scotia Department of Health and Wellness (DHW) - Aboriginal Health Transition Fund (AHTF) Adaptation Plan, Mi'kmaq Health Policy Framework, and Cultural Safety Project Evaluations (2009 - 2011)