Move to Improve Evaluation

Right To Play

The Client

Established in 2000, Right to Play (RTP) is a global organisation committed to improving the lives of children and young people affected by conflict, disease, and poverty. RTP has pioneered a unique play-based approach to learning and development which focuses on quality education, life skills, health, gender equality, child protection and building peaceful communities.  InFocus supported RTP to carry out an evaluation of the Move to Improve (M2I) project. This was a pilot intervention designed in the context of the ‘Building Back Better’ programme (led by RTP and the Lego Foundation) where adult coaches were trained to deliver psychomotricity play-based activities to support children’s holistic development and mitigate risk factors of living in the Lebanese mixed emergency context. This evaluation project was supported by Qualisus Consulting, a Lebanese based organisation which led the data collection process in the local languages.  

The Challenge

RTP aimed to understand the extent to which the M2I intervention was relevant and appropriate to the needs of the targeted children in a mixed emergency context. RTP wanted to gather insights on how play-based activities could contribute to psychomotricity development and the improvement of psychosocial wellbeing and resilience among children. There were a set of challenges that emerged in the project, which included that the M2I was a pilot project and early-stage intervention, and data needed to be gathered from children aged from 6 to 12 years old in a rapidly changing and fragile context.

Our Support

Given the nature of early-stage pilot interventions, the evaluation followed a realist and participatory approach where a set of key learning questions were designed under the OECD-DAC criteria. During the inception phase, key concepts such as psychomotor, psychomotricity, psychomotor activities, psychosocial wellbeing, resilience and the social ecological model were defined to help the development of precise outcomes and indicators. Shorter term outcomes and indicators were incorporated in the existing M2I Theory of Change to map results on the level of engagement of children with the resource.

Data was also gathered on how the M2I materials supported adult coaches’ knowledge and skills to deliver psychomotor activities. inFocus and RTP team worked together to develop child- friendly data collection tools adapted to their context in Lebanon. This contributed to gathering accurate data among children (and adult facilitators) in deprived areas in Beirut. To enable a learning environment to improve the project design, a set of learning workshops were held to reflect on insights collected on the ground and contextualise the emerging findings.

Scope of Work

The evaluation project was structured in three phases:  

  • Evaluation Design: Prioritising this participatory approach in the design phase, the inFocus team facilitated a design workshop with the relevant RTP team members to reflect on the key learning questions. The workshop was a space to discuss and prioritise the M2I learning questions and subsequently to map and prioritise outcomes/sub-outcomes from the current M2I logical framework, as well as any new outcomes suggested by inFocus against each learning question. In addition, a set of consultation interviews were conducted to inform the evaluation and sample design. 
  • Data collection: Following a mixed-method approach to data collection and analysis, both qualitative and quantitative data were collected. This implies the combination of pre and post surveys with methods that focus on more qualitative data, such as observations, focus group discussions and interviews. The data collection tools were developed through a process of pilot, feedback, edit and translation, and were subsequently deployed in Arabic by Qualisus, with the support of RTP Lebanon staff members and the community centre staff.  
  • Dissemination and Learning: A baseline report and an endline report were developed, together with a set of recommendations for RTP to improve the monitoring, evaluation and learning practices for the Move to Improve (M2I)Project. 

Impact of Evaluation

The evaluation project provided the RTP team with key insights to improve the M2I implementation and increase its impact on adult coaches and children. The learning study found that the M2I resource was significantly relevant to the mixed emergency context in Lebanon. Despite the significant level of relevance and appropriateness of the M2I resource and its model of implementation significant areas of improvements of the M2I activities and the implementation model were identified to improve the adult facilitator learning process and support socio emotional skills development among children. Last but not least, inFocus compiled recommendations to improve the monitoring, evaluation and learning practices for the M2I future projectsuch as inputs to evolve the Theory of Change, suggestions to deploy more effective data collection. inFocus also outlined approaches and practices for evaluating pilot projects (or early-stage interventions) in mixed emergency contexts such as in Lebanon. 

During a final debrief call, the Evaluation Lead at Right To Play stated how “inFocus were collaborative, it felt as if we were one team working together. The inFocus team and roles were well defined and the project management approach helped keep things on track. InFocus demonstrated a high level of flexibility in any changes that were required to the evaluation. InFocus also adopted a learning approach to the partnership, with constant feedback and openness to explore issues and ideas collectively”. 

Want to see more?

Check out our other Case Studies to read more examples of our work.