ABSTRACT

  • Objective: To incorporate media strategies into the nutrition education intervention, Jump with Jill (JWJ), to (1) change student knowledge and intentions; (2) stimulate enthusiasm; and (3) enhance evaluation.
  • Methods: Third graders (n=193) completed a pre-survey, watched a 60-minute show, and completed a post-survey. Data was collected interactively, where students lined up behind an emoji that best represented their answers.
  • Results: Statistically significant improvements were reported for drink preferences, enjoyment of nutrition education and experience taking the survey; all aggregate responses for knowledge, attitudes and intention became significantly more positive (p=.05).  Furthermore, approximately 95% reported positive ratings to participating in the survey (P<0.0001).
  • Conclusions and Implications: Use of edutainment may serve to stimulate change in nutrition knowledge and intention in 3rd grade students. Perfecting this gamification of nutrition education evaluations may serve the field by increasing accuracy of student responses when language, reading level, or survey inexperience are barriers.

INTRODUCTION

Although amenable to change, habits and food preferences formed during childhood typically track into adulthood.1-3 Hence, it is important to utilize strategies directed at elementary-aged children that influence targeted food and beverage choices known to impact health, such as increasing intake of fruits, vegetables and low-fat dairy foods as well as decreasing intake of sugar-sweetened beverages.4 Successful nutrition education aimed at children cannot simply be didactic but should be interactive, enjoyable and developmentally appropriate.5-7 Moreover, programming should have a theoretical framework5-7 such as those used in behavior change, education and social marketing.8 Finally, unique evaluation processes must be considered because children are mastering written language and inexperienced with surveys.

No matter how well theorized a child nutrition program might be, it must compete with the mass media environment that successfully uses a variety of strategies to impact food intake in children.9 Marketing strategies such as repetition, music, characters and excitement are well-thought-out, well-funded and incorporate theoretical frameworks.10 Nutrition educators can adopt and adapt marketing strategies to enhance both interventions and evaluation processes.

Use of entertainment as an educational tool, termed edutainment,11 is a science with established guidelines.12 In brief, research-based messages are woven into the audiences’ lived experiences13 with compelling plots, songs and characters. To be effective, edutainment messages should be sustained as part of a comprehensive campaign that connects learners to characters and stories showing behavior change while establishing a new social norm. Edutainment has been a successful component of previous nutrition interventions, improving knowledge, attitude and intention14–16 and developing resistance to persuasive messages.17 Gamification, another recent education strategy, incorporates gaming concepts into the learning process.18 Because health skills develop through practice, the positive experiences derived from learning through play help develop deep intrinsic motivations that positively influence health outcomes7 and lead to high levels of program satisfaction among participants.13

Although schools are an obvious venue for educating children about healthy eating,5,19,20 many students receive inadequate education despite its success.21 Although teachers consider nutrition education valuable for students,22 Common Core State Standards and high-stakes standardized testing make nutrition and physical education expendable.23 Limited resources22 and lack of subject expertise make external/supplemental nutrition education programs attractive.5  Employing media strategies can entice classroom teachers into including nutrition education, thereby overriding cost and time barriers.17

Furthermore, nutrition educators often are required to evaluate their interventions. Assessment strategies for children are generally informal (using some type of written format) and focus on measuring changes in knowledge, attitude and behavior. Such changes are especially difficult to assess in young children given their cognition levels.24 Moreover, with required standardized testing in elementary schools, questions have arisen regarding student stress in relation to any testing,23, 25 generating interest in investigating alternative evaluation strategies.

Employing media strategies, Jump with Jill (JWJ) is a music-based program that transforms nutrition education into a school-wide rock concert. JWJ creates an unforgettable experience using original music, lighting, props and live characters to inspire their audiences for better nutrition (Figure 1). During the 60-minute show, students dance and sing to behaviorally-focus songs that address increasing consumption of fruits, vegetables, low-fat milk products and water. Following the concert, these characters and their messages are used by classroom teachers via follow-up materials (music downloads, activity sheets, danceable music videos, etc.).

FIGURE 1: THE MUSIC-BASED NUTRITION EDUCATION SHOW, JUMP WITH JILL (JWJ), IN ACTION

This study was undertaken to determine the feasibility of incorporating media strategies (e.g. edutainment and gamification) into a nutrition education campaign. The hypotheses were that incorporation of media strategies would (1) change student knowledge and intentions; (2) stimulate enthusiasm towards nutrition education; and (3) enhance the evaluation process.

METHODS

Recruitment

After receiving project funding, the author worked with an independent booking agency to recruit schools for the 2015-2016 school year to receive JWJ at no cost. Eligible schools (n=50) were within the 10 New Jersey counties that ranked lowest in the 2014 County Health Rankings (Atlantic, Camden, Cape May, Cumberland, Essex, Gloucester, Hudson, Passaic, Salem, and Union). One performance school per county was randomly chosen for testing. While the show was available to the entire school, only one randomly-selected 3rd grade class completed the deidentified pre- and post-surveys. Parental, student and teacher permission for participation was handled at the district level. All schools viewed JWJ as an adjunct to their education while conducting the evaluation as part of normal practice by providing researchers with deidentified data; the XXX’s Institutional Review Board approved this study. No demographic information was collected.

Survey Development

To match the delivery method of the intervention, a survey was designed incorporating edutainment and gamification strategies to assess knowledge, attitudes and intentions. For the first question about drink preferences, actual products (milk, water, energy drinks, fruit drinks and soda) were displayed. Milk and Water were classified as a positive response (coded as 1) and Energy Drink/Fruit Drink/Soda (coded as 0) were classified as a negative response (Figure 2).

For questions two through seven, instead of adapting more traditional ‘yummy/yucky faces’26 or indication of ‘yes’ or ‘no,’ customized emojis were used to determine responses (Figure 2). To overcome obstacles associated with using a Likert Scale with children,27 emoji faces varied in relationship to the strength of response and were accompanied by words rather than numbers. Responses were recorded such that each emoji represented a point on a 1 to 5 Likert scale with 1 reflecting “ABSOLUTELY NOT” and 5 reflecting “YES!” (Figure 2).27 Prior to administration, cognitive testing with a small, convenience sample (n=5; grades K-4) was conducted to determine how the expressions would be interpreted. Except for “No,” students indicated agreement with the label associated with each face. Originally a face with a tear depicted “No.” but students thought that face represented “Sad.” The emoji was changed to a face with a line for a mouth. Furthermore, students were asked to raise their hands to determine previous experience with survey taking (pre-test) and to reflect on their survey enjoyment (post-test) by mobilizing to an emoji. Questions were designed to repeat phrasing from the show in an attempt to separate “Jump with Jill’s version” of knowledge and attitudes from other sources.

FIGURE 2: INTERACTIVE EMOJI LIKERT SCALE SURVEY WITH QUESTIONS

Survey Administration

Stations containing either a beverage (energy drink, fruit drink, soda, milk or water) (Question 1) or an emoji (Questions 2-7) were arranged. Before starting the survey, students were told by JWJ characters that there was no right answer and that the survey was not a test. To capitalize on the power of peer influence, students make a “Promise to be Honest” as a commitment to being thoughtful “research subjects” where their authentic opinions were valued. To minimize group think, students were asked to select their answers before moving to a station. Students were then asked to fully commit to their answer by lining up by the emoji that matched their response (Figure 3). The JWJ cast recorded the number of children at each station for each question. After the show, students reaffirmed their honesty pledge and repeated the pre-survey process.

FIGURE 3: SURVEY IMPLEMENTATION STRATEGY

 

 

 

 

 

 

 

 

 

Data Analysis

Frequencies were calculated from recorded responses. Two types of outcomes were determined using aggregated data from all schools and time points (pre-test, post-test): the proportion of responses (children lining up behind an emoji) and an overall score. The proportion of responses per time point was calculated as: sum of children lining up behind an emoji divided by total of children lining up behind all emojis multiplied by 100.  Pairwise differences among dependent proportions were tested using simultaneous 95% confidence intervals among the dependent proportions (assuming a multinomial distribution).28,29 The overall score was calculated (for all but question 1) by multiplying the emoji’s response choice (1-5) by the number of children lining up behind it, then summing all multiples for each time point and school. Higher overall scores indicate more positive responses. Differences in scores between pre- and post-tests were determined. Distribution of overall scores and differences were determined to be non-normal using normality testing and graphical plots. The Wilcoxon Signed-Ranks test was conducted to examine differences in responses between pre- and post-test scores using Statistical Analysis Software (version 9.3, 2011, SAS Institute Inc, Cary, NC).

RESULTS

JWJ performed 50 shows reaching nearly 14,700 elementary school students in the 2015-2016 school year. Over 75% of the 194 3rd graders participating in the evaluation reported no previous experience with taking a survey. Following the show, statistically significant differences in individual scores were noted for questions 1, 3, 4, 5 and 7 (Table 1); all aggregate responses became significantly more positive (Table 2). Furthermore, approximately 85% reported the highest positive rating (YES!) to participating in this survey, and 95% reported positive ratings (YES! or Yeah) to participating in the survey, which differed significantly from the number of children reporting negative ratings (ABSOLUTELY NOT and No) (P<0.0001).

DISCUSSION

Overall, feasibility for using media strategies to change student knowledge and intention as well as to evaluate these changes was confirmed. Use of enthusiastic endorsement of the expected behaviors (a Social Learning Theory component) by JWJ characters (a marketing strategy) appeared to stimulate change in nutrition knowledge and intention in 3rd grade students. These findings confirm previous observations that theatrical interventions in schools can be successful.14–16,30,31

Unique to this study was the integration of media strategies into the evaluation process.  Edutainment and gamification techniques successfully captured changes in 3rd grade students’ knowledge and intention. Making the evaluation process interactive and fun resulted in over 95% of students enjoying participation in a study, in contrast to reports of student stress in relation to testing.32,33 Additionally, children in 3rd grade are in Piaget’s concrete operational phase of cognitive development, where they begin to use inductive logic and become less egocentric.34 Using the “Promise to be Honest” pledge built upon their developing senses of having unique thoughts and of fairness.34 Perfecting this gamification of nutrition education evaluations may serve the field by increasing accuracy of student responses when language, reading level, or survey inexperience are barriers. These study participants saw the evaluation as part of the intervention, so creating a positive experience at all touch points appears to deepen satisfaction.

Several limitations must be acknowledged. This current study lacks follow-up to demonstrate students’ knowledge retention or behavior change. Other limitations include lack of a control group and unpaired pre- and post- survey data, both of which restrict generalizability.  Furthermore, statistically significant proportions that change by a fraction of a decimal to a few points must be interpreted with caution.

CONCLUSIONS AND IMPLICATIONS

The mass media has proven successful at impacting food intake in children.9 If ‘celebrities’ can shape social norms about unhealthy behaviors, then nutrition educators might be able to use these same strategies to shift youth toward healthy behaviors. If children demand high quality entertainment, then health-related media can compete. The media could be the best guide in developing solutions to address youth health.

To provide additional validation for using media strategies in nutrition education, along with the impact of JWJ on food choice behavior, future studies including a comparison group, more follow-up data points, demographic characteristics of children, and other confounding variables are warranted. 

REFERENCES

1. Grimm KA, Kim SA, Yaroch AL, Scanlon KS. Fruit and Vegetable Intake During Infancy and Early Childhood. Pediatrics. 2014;134(Supplement):S63-S69. doi:10.1542/peds.2014-0646K.

2. Nicklaus S, Boggio V, Chabanet C IS. A prospective study of food preferences in childhood. Food Qual Prefer. 2004;15(7-8):805-818.

3. Lien N, Lytle LA KK-I. Stability in consumption of fruit, vegetables, and sugary foods in a cohort from age 14 to age 21. Prev Med. 2001;33(3):217-226.

4. Nielsen SJ, Rossen LM, Harris DM, Odgen CL. Fruit and vegetable consumption of u.s. Youth, 2009-2010. NCHS Data Brief. 2014;(156):1-8. http://www.ncbi.nlm.nih.gov/pubmed/25027507.

5. Hard A, Uno C, Koch PA. The Importance of Nutrition Education in the 2015 Child Nutrition Reauthorization. 2015. http://www.tc.columbia.edu/media/media-library-2014/centers/tisch-center/Nutrition-Ed-White-Paper-09.14.pdf.

6. Contento IR. Nutrition Education: Linking Theory, Research and Practice. Sudbury, MA,: Jones & Barlett; 2011.

7. Gao Z, Podlog L, Huang C. Associations among children’s situational motivation, physical activity participation, and enjoyment in an active dance video game. J Sport and Health Science. 2013;2(2):122-128.

8. Luca NR, Suggs LS. Theory and Model Use in Social Marketing Health Interventions. J Health Commun. 2013;730(January):1-21. doi:10.1080/10810730.2012.688243.

9. Boyland E, Nolan S, Bridget K, et al. Advertising As A Cue To Consume: A Systematic Review And Meta-Analysis Of The Effects Of Acute Exposure To Unhealthy Food And Nonalcoholic Beverage Advertising On Intake In Children And Adults. Am J Clin Nutr. 2016;103:519-533. doi:10.3945/ajcn.115.120022.

10. Evans WD. Social Marketing Campaigns and Children’s Media Use. Futur Child. 2008;18(1):181-203. doi:10.1353/foc.0.0009.

11. Moyer-Gusé E. Toward a theory of entertainment persuasion: Explaining the persuasive effects of entertainment-education messages. Commun Theory. 2008;18(3):407-425. doi:10.1111/j.1468-2885.2008.00328.x.

12. Singal A RE. The status of entertainment-education worldwide. In: Singal A, Rogers E, Sabido M, ed. Entertainment-Education and Social Change: History, Research and Practie. Lawrence Eribaum Associates. 2004:3-20.

13. Neumark-Sztainer D, Haines J, Robinson-O’Brien R, et al. “Ready. Set. ACTION!” A theater-based obesity prevention program for children: A feasibility study. Health Educ Res. 2009;24(3):407-420. doi:10.1093/her/cyn036.

14. Wechsler H, Basch CE, Zybert P, Shea S. Promoting the selection of low-fat milk in elementary school cafeterias in an inner-city Latino community: Evaluation of an intervention. Am J Public Health. 1998;88(3):427-433. doi:10.2105/AJPH.88.3.427.

15. Perry CL, Zauner M, Oakes JM, Taylor G, Bishop DB. Evaluation of a theater production about eating behavior of children. J Sch Health. 2002;72(6):256-261. doi:10.1111/j.1746-1561.2002.tb07339.x.

16. Cheadle A, Cahill C, Schwartz PM, et al. Engaging Youth in Learning about Healthful Eating and Active Living: An Evaluation of Educational Theater Programs. J Nutr Educ Behav. 2012;44(2):160-165. doi:10.1016/j.jneb.2011.06.005.

17. Sangalang A, Jessie MQJ, Ciancio KE. Exploring audience involvement with an interactive narrative: implications for incorporating transmedia storytelling into entertainment-education campaigns. Crit Arts. 2013;27(1):127-146. doi:10.1080/02560046.2013.766977.

18. Glover I. Play as you learn : gamification as a technique for motivating learners. Proc World Conf Educ Multimedia, Hypermedia Telemcommunications. 2013:1998-2008. http://shura.shu.ac.uk/7172/.

19. Franks A, Kelder S, Dino G, Horn K, SL G, Wiecha, JL SE. School-Based Programs Lessons learned from CATCH, Planet Helth and Not-On-Tobacco. Prev Chronic Dis. 2007;4(2):1-9.

20. Robinson LE, Webster EK, Whitt-Glover MC, Ceaser TG, Alhassan S. Effectiveness of pre-school- and school-based interventions to impact weight-related behaviours in African American children and youth: A literature review. Obes Rev. 2014;15(October):5-25. doi:10.1111/obr.12208.

21. Kann L, Telljohann SK WS. Health education: Results from the School Health Policies and Programs Study 2006. J Sch Health. 2007;77(8):408-434.

22. Perera T, Frei S. Improving Nutrition Education in U.S. Elementary Schools: Challenges and Opportunities. J Educ Pract. 2015;6(30):41-50.

23. Saeki E, Pendergast L, Segool NK, von der Embse NP. Potential Psychosocial and Instructional Consequences of the Common Core State Standards: Implications for Research and Practice. Contemp Sch Psychol. 2015;19(2):89-97. doi:10.1007/s40688-014-0043-5.

24. Seattle PI. The 4 Types of Tests Teachers Give (and Why). http://education.seattlepi.com/advantages-teachermade-tests-1595.html. Accessed February 2, 2018.

25. Gubi AA, Bocanegra JO. Impact of the Common Core on Social-Emotional Learning Initiatives with Diverse Students. Contemp Sch Psychol. 2015;19(2):98-102. doi:10.1007/s40688-015-0045-y.

26. Baxter SD, Thompson WO. Fourth-Grade Children’s Consumption of Fruit and Vegetable Items Available as Part of School Lunches Is Closely Related to Preferences. J Nutr Educ Behav. 2002;34(3):166-171.

27. Mellor D, Moore KA. The Use of Likert Scales with Children. J Pediatr Psychol. 2014;39(3):396-379.

28. SAS Institute Inc. MULTINOM SAS/IML module; 2008.

29. Berry JJ, Hurtado GI. Comparing Non-Independent Proportions. Observations: The Technical Journal for SAS Software Users. 1994; 3(4), 21-27.

30. Powers AR, Struempler BJ, Parmer SM. Effects of a Nutrition Education Program on the Dietary Behavior and Nutrition Knowledge of Second-Grade and Third-Grade Students. J Sch Heal. 2005;75(4):129-134.

31. FoodPlay Productions. Proven Success. 2010. http://foodplay.com/downloads/pdf/FP-Eval-Feedback.pdf. Accessed February 3, 2018.

32. Lobman C. “I Feel Nervous . . . Very Nervous” Addressing test anxiety in inner city schools through play and performance. Urban Educ. 2014;49(3):329-359. doi:10.1177/0042085913478621.

33. Nichols S, Berliner D. Collateral Damage: How High Stakes Testing Corrupts American Schools. Cambridge, MA: Harvard University Press; 2007.

34. Simatwa EMW. Piaget’s theory of intellectual development and its implication for instructional management at pre- secondary school level. Educ Res Rev. 2010;5(7):366-371.

FULL STUDY CITATION INFORMATION

Jayne, Jill (2018). Evaluation of a music-based nutrition education intervention Jump with Jill: Impacts of edutainment and gamification techniques on 3rd graders in New Jersey. Retrieved from http://jumpwithjill.com/wp-content/uploads/2018/03/4Manuscript-2951-words.pdf

View the full report.