How do we measure our impact?
How do we measure our impact?
LEAD Monrovia Football Academy aims to be among the leaders reshaping the sport for development sector into one driven by evidence-based research. Together with professors from the College of William & Mary, we have designed a robust quantitative impact evaluation to assess our effect on academic proficiency, attitudes toward gender, pro-social skills, and pride in Liberian identity. The study is explained in depth below, but results from the 2018 impact evaluation can be accessed here.
We augment our quantitative study with additional research tools, such as parent surveys, participant observation, football skills tests, and more. In the future, another key impact metric will be the number of students who gain access to academic, athletic, and leadership opportunities.
Students enrolled in the Academy are being compared to those who just missed the cut on the admissions list (i.e., those to whom we would have offered an invitation if we had greater capacity). This regression discontinuity design allows us to carefully measure the improvement of students' learning abilities compared to when they entered the program and to similar students who ended up in alternative schools. Initial results from a 2017 pilot reveal statistically significant impact on academic proficiency, attitudes toward gender, and pride in Liberian identity. An in-depth research paper will be available by July 2018.
1) Academic Impact: Between June 2016 and July 2017, Academy students improved performance on a standardized exam by 12 percentage points more than the control group.
2) Attitudes Toward Gender: Academy students were 46% more likely than the control group to say girls are as smart as boys. Academy students were also 59% more likely than the control group to say girls can play football as well as boys.
3) Pride in Liberian Identity: Academy students were significantly more likely than the control group to describe themselves as proud to be Liberian.
We are using a mixed-methods approach to assess impact on the football pitch. Quantitatively, passing and controlling technique is assessed using an innovative counting system. We assess passing efficiency by putting two cones four feet apart and asking the player to stand three yards away. The challenge is to one-touch pass the ball on the ground and through the two cones. Each player makes 10 passes with each foot, and the success rate is recorded. We run this 'test' throughout the school year to examine progress. Beyond these quantitative methods, we are using participant observation and other forms of ethnographic research to qualitatively assess impact.
MFA student-athletes completed a passing efficiency test on October 15, 2017, and then again on December 8, 2017. The basic idea is as follows: if, on average, we see more successful passes in December than October, then there is a correlation between the Academy's coaching and the student-athletes’ football performance.
On October 15, the average number of successful passes on the right foot was 7.3/10 and on the left foot it was 5.5/10. On December 8, the average number of successful passes on the right foot was 8.6/10 and on the left foot it was 6.8/10. Those numbers represent an 18% improvement on the right foot and a 24% improvement on the left foot.
In March/April 2017, we measured the satisfaction of our student-athletes' parents by conducting parent interviews. Interviews were administered by independent enumerators provided by The Khana Group. Despite numerous attempts, a few of our parents could not be reached for interview. The data covers 42 of our 47 student-athletes from the 2016-17 school year.
100% of MFA parents are happy their child has joined the Academy.
100% of MFA parents say the Academy is better than their child's previous school.
100% of MFA parents say they have seen an improvement in their child's attitude since joining the Academy.
100% of MFA parents say they would recommend the Academy to a friend.
What are the challenges facing our students?
What are the challenges facing our students?
In 2013, 25,000 high school graduates took the University of Liberia’s entrance exam. Every single one of them failed (BBC 2013). That year, President Ellen Johnson Sirleaf admitted that the education system is “a mess” (BBC 2013). Indeed, 58% of 15-24 year olds have not completed primary education (EPDC 2014).
LEAD Monrovia Football Academy has developed an innovative solution to fill Liberia’s education gap. We uniquely use football – the most popular sport in Liberia – as a positive-incentive mechanism to encourage our students to attend school and improve academic performance.
In 2011, the Education Innovation Laboratory at Harvard University argued that “well-designed rewards to students can improve achievement at relatively low costs” (Fryer and Allan, 2011). As a football academy, we design football-based rewards that have real consequences on the lives of our student-athletes. At the end of each week, our teachers decide which student had the best performance in school. Whoever is chosen then gets to decide which type of ‘football challenge’ the entire team will complete for the last fifteen minutes of the next practice. Challenges include mini-games, shooting drills, defensive training, and other fun football-based activities, but different students prefer different challenges. In order to play their favorite one, the students compete to be the best in the classroom. This brings our football and educational programming into conversation, and it ensures our students value their education and commit to their studies.
Gender inequality is deeply entrenched in Liberian society, and it is especially prevalent in the education system. While 62% of Liberian boys between the ages of 15 and 24 are literate, only 37% of young women can say the same. Scholars and activists suggest this discrepancy exists because of gendered expectations within the household, the family, and the classroom itself (Gbowee, 2015; Abramowitz and Moran, 2012).
In addition, girls are often denied the opportunity to play organized football. Even though there is a functioning women's national team and an abundance of girls who want to play, football is commonly referred to as 'manball'.
We at LEAD Monrovia Football Academy are confronting gender inequality, and we have been thrilled by the difference in attitude we have seen in our girls. By training with the boys – and often outplaying them on the pitch – our girls have a sense of empowerment that they themselves have vocalized. In addition to having the boys and girls play together, our Liberian staff members constantly engage our students in discussions about gender, challenging them to critically analyze traditional roles.
Without LEAD MFA's domestic academy, talented footballers in Liberia are vulnerable to predatory agents offering development opportunities abroad. Culture Foot Solidaire, a French NGO, estimates that 15,000 West African footballers are illegally trafficked overseas every year, with many of them coming from Liberia. According to the BBC, players "gratefully accept invitations" from shady agents who offer them false contracts, confiscate their passports, and abandon them in foreign countries.
Despite these issues, a number of Liberian footballers have played for professional clubs around the world, including George Weah (PSG, AC Milan, Chelsea, Manchester City, AS Monaco), James Debbah (AS Monaco, PSG, Lyon, Nice, Anderlecht), and Christopher Wreh (Arsenal, AS Monaco).
LEAD Monrovia Football Academy provides Liberia's best young footballers with access to professional coaching at an affordable, domestic academy. Since opening in October 2015, we have developed a comprehensive football curriculum that disrupts bad habits, introduces fundamental techniques, and encourages our student-athletes to "think the game" at a high level. In addition, we have acted on our intention to build legitimate partnerships with the best clubs in Liberia and abroad. To date, we have had positive conversations with several Liberian clubs, Hartford Athletic (USA), New England Revolution (USA), and FC Barcelona (Spain).
Liberia's malnutrition rates are among the highest in the world. According to Liberia's Ministry of Health, "more than 1/3 of Liberian children are stunted, 1/5 are underweight, and more than 1/2 suffer from micronutrient deficiencies" (Government of Liberia, National Nutrition Policy). While the government is making a concerted effort to address malnutrition through its National Nutrition Policy and the introduction of a Food Security and National Strategy, a large number of Liberians are not receiving adequate nutrients.
Good nutrition is vital for all athletes, but "the importance of proper nutrition is even greater for the adolescent athlete" (Smith and Jeukendrop, 2013). Scholars and top athletes alike argue that carbohydrate intake prior to high-intensity exercise is vital for performance and stamina. In addition, scholars advise that, after high-intensity training, endogenous carbohydrate supplies should be supplemented by additional carbohydrates and proteins (Beelen et. al., 2015).
At LEAD Monrovia Football Academy, we ensure our student-athletes eat three nutrient-rich meals per day. Breakfasts and dinners are comprised of Liberian staples such as power gari, oats, and cream of wheat. Lunch is the main meal of the day, with big portions of classic Liberian meals (such as potato greens, jollof rice, special rice, etc.) that contain a large amount of carbohydrates, protein, and vegetables. These balanced meals reinvigorate our student-athletes by accelerating their recovery.
Academic classes and football practices are supplemented with life skills lessons on a daily basis. 'Life skills' is a vague concept, but we focus on four key, culturally-relevant areas: leadership, enthusiasm, accountability, and discipline (LEAD). Every day – during training sessions, at lunch, and in class – we make a concerted effort to reinforce these ideas. Student-athletes are encouraged to think critically about their interactions with other people, and then use their analysis to improve as leaders, be more enthusiastic/accountable, and remain disciplined.
For example, at the end of each class, our teachers and students collectively decide whether the students showed leadership, expressed enthusiasm, held themselves accountable, and were disciplined learners. Over time, this consistent messaging is meant to develop our student-athletes' life skills, enabling them to be leaders in their communities.
At LEAD Monrovia Football Academy, we provide each of our staff members and student-athletes with quality healthcare. Activa Liberia provides health insurance for both our staff and student-athletes. The plan covers more than 25 hospitals and clinics across Liberia, giving our staff and student-athletes the flexibility to select their preferred health facility. In addition, our student-athletes receive on-site treatment on a daily basis from our trained medics.
We provide support and counseling for each of our student-athletes and staff with emotional, social, and learning needs. Our professional guidance counselor and social workers liaise with families of student-athletes to develop support plans and indicate the contents of the plans to senior staff to create an amenable environment for the progress of student-athletes. The guidance counselor and social workers keep their doors open during academic classes and football training, ensuring that support is available on a daily basis. Our staff with emotional and social needs also seek help and support from our guidance counselor.