Read the latest from PowerMyLearning!

Family Playlists Evidence Base

Written by PowerMyLearning | Jul 7, 2023 5:28:45 PM
Updated: May 2, 2024
About Family Playlists

PowerMyLearning’s early grades math practice tool (“Family Playlists”) helps students master grade-level content through play-based learning and math discourse. Unlike tools that focus on "answer-getting," ours focuses on “sense-making” and offers teachers deep insights into students' mathematical thinking.

Students engage in interactive, curriculum-aligned learning games with a learning partner and then produce videos explaining what they learned. Teachers then use these videos and other data as formative assessment to tailor their instruction. Additionally, when paired with coaching, this tool can help teachers improve their math practice by enhancing their ability to identify common student misconceptions and on-grade-level discourse.

The tool was designed for grades K-2 to extend learning with a trusted adult outside of school time and was aptly named “Family Playlists.” We are now focusing on building out resources and supports for the tool to be used for in-class implementation and aging-up the tool to grades K-5 so we can scale use and deepen impact.

  • Focus: Early grades (K-2); additional grades to be added in future school years
  • Evidence rating: ESSA Level II Moderate Evidence*
*Family Playlist’s evidence rating is based on the U.S. Department of Education’s nonregulatory guidance for ESSA.
Current Evidence

Over the past several years, PowerMyLearning has conducted research studies examining the impact of Family Playlists on students’ academic skills and SEL competencies. These studies, summarized below, have provided evidence of a statistically significant impact of Family Playlists on both math learning and SEL skills.

Study #1:

PowerMyLearning examined the impact of Family Playlists and our Social Emotional Learning (SEL) professional development program on student math and SEL outcomes at a partner school in Brooklyn, New York during the 2022-23 and 2021-22 school years.

During the 2022-23 school year, K-2 students and their families were assigned Family Playlists and their teachers participated in the SEL program. Based on a pre/post analysis of students’ iReady math data, there was a statistically significant difference in the proportion of students who exceeded or met grade-level math achievement benchmarks before and after Family Playlists and the SEL program (+28pp, p<.001). There is also evidence that we are successfully reaching high needs students, including Black and Hispanic students. For Black students, the change in the proportion of students who exceeded or met district benchmarks before and after Family Playlists and the SEL program was significant (+31pp, p<.001). For Hispanic students there was also a significant difference in the proportion of students who exceeded or met math achievement benchmarks before and after Family Playlists and the SEL program (+22pp, p=.01).

During the 2021-22 spring semester, Kindergarten students and their families were assigned Family Playlists and their teachers participated in the SEL program. Findings from a pre/post analysis of DESSA SEL assessment data indicate that Family Playlists and the SEL program were related to significantly better SEL for Kindergarten students (+7%, p=.02, ηp2 =.02). When looking at specific SEL skills, these students had significantly better self-awareness (+28%, p<.001, ηp2 =.30), goal-directed behavior (+19%, p<.01, ηp2 =.19), optimistic thinking (+16%, p=.01, ηp2 =.17), and relationship skills (+15%, p=.02, ηp2 =.14).

James, K. Rocha, K., & Pandit, N. (2023). Impact of a Whole Child Approach to Math Instruction: SEL Program and Math Practice Tool. [White Paper]. PowerMyLearning. 

Read the Impact of a Whole Child Approach to Math Instruction Study
Study #2:

PowerMyLearning conducted a short-cycle Randomized Control Trial (RCT) followed by a delayed Family Playlists implementation with both the control and implementation groups. This study focused on 67 Kindergarten students at a partner school in San Jose, California. Findings from the short-cycle RCT indicate that students in the implementation condition had significantly better self-efficacy (p=.04) and growth mindset (p=.07) compared to the control group. Findings from the pre/post analysis of the delayed implementation indicate that students’ SEL skills were significantly better for both the control group and the implementation group. After three weeks of Family Playlists, students in the control group had significantly better self-efficacy (p=.004), growth mindset (p=.01), self-management (p=.001), engagement (p=.001), and social awareness (p=.005) than before the implementation. After six weeks of Family Playlists, students in the implementation group had significantly better self-efficacy (p=.01) and growth mindset (p=.09). Only within and between condition simple effects from mixed Anovas are included here for simplicity. Results were considered statistically significant at the p ≤.10 level.

James, K. & Pandit. N. (2022). PowerMyLearning Family Playlists Impact Study. [White Paper]. PowerMyLearning.

Read the Family Playlists Impact Study
Study #3:

PowerMyLearning conducted short-cycle RCTs that were published with Project Evident with support from the Gates Foundation. This study focused on 6th grade students at a partner school in South Los Angeles, California. The study results indicated that, Family Playlists had a statistically significant positive impact on key SEL outcomes related to student agency, including intrinsic motivation, perceived competence, and perceived choice, as compared to standard homework assignments. Findings also showed that the positive impact of Family Playlists on SEL competencies was especially pronounced for English Language Learners. In addition, ELL students reported a significantly better sense of belonging at school, agreement that the assignment helped their teacher better understand their family, and enjoyment of teaching (family vs self) in the Family Playlists condition than in the solo homework condition. All reported results were statistically significant at the p ≤ .05 level. This research was conducted on an earlier version of Family Playlists that targeted older students.

Martin, J. & Stock, E. (2021). Actionable Evidence in Education: Examining Family Playlists’ Impact on Student Social Emotional Learning and Science Mastery through Short-Cycle RCTs. [White Paper]. PowerMyLearning and Project Evident.

Read the Project Evident Study
Study #4:

The results of a quasi-experimental (QED) study indicated that students who were assigned Family Playlists had significantly better math achievement relative to a comparison group (p<.001; d=.33). This finding equates to four additional months of math learning. Math achievement was measured by the New York State standardized test. This study focused on 7th grade students at two partner schools in the Bronx, New York. The comparison group was students who had the same teacher at the same schools the prior school year. The comparison group was not assigned Family Playlists. This research was conducted on an earlier version of Family Playlists that targeted older students

PowerMyLearning (2018). Evidence of Family Playlists’ Impact on Math Achievement. [White Paper]. PowerMyLearning.

Read "Evidence of Family Playlists' Impact on Math Achievement
Future Evidence

PowerMyLearning is in the first year of a prestigious Education Innovation and Research (EIR) Grant from the U.S. Department of Education. This project will involve a larger-scale, two-year Randomized Control Trial, which will provide even more robust evidence of the impact of Family Playlists on math and SEL outcomes among 1st and 2nd graders. This project will use What Works Clearinghouse (WWC) reviewable measures, such as the NWEA MAP and DESSA SEL Assessment. The study design and outcomes will be reviewed by the WWC and are being designed to meet the WWC “without reservations” standards.