Grantee: Ithaka Harbors Inc. The study report is linked here.
Description of the Intervention: This randomized controlled trial (RCT) evaluated MAAPS as implemented by 11 universities across the United States. Originally developed by Georgia State University, the three-year program pairs students with dedicated college advisors who (i) help navigate key academic choices; (ii) put together degree plans to ensure timely graduation; and (iii) receive real-time alerts when students veer off-track or are at-risk of not graduating on time. Earlier interim RCT results show that MAAPS had no effect on either persistence or degree completion at four-year follow-up; this interim report covers six-year follow-up.
Study Design: The researchers randomly assigned a sample of 10,946 low-income or first-generation students across 11 universities to either a treatment group that was offered access to MAAPS, or a control group that was not offered the program but had access to the usual services offered by their college. Sample members averaged 18 years old, and were 45% White/24% Hispanic/11% Asian/13% Black, 57% female, 80% Pell-eligible, and 53% first generation college students. The study measured primary outcomes using administrative data from the National Student Clearinghouse (NSC).
Impact on the Primary Outcomes: Six years after random assignment the study found the following impacts on the study’s two primary pre-registered outcome 1: (i) no statistically significant effect on college persistence, defined as degree completion or enrollment in the Spring 2022 term (76% of the treatment group had earned a degree or was still enrolled vs. 77% of the control group); and (ii) no statistically significant effect on degree completion (70% of the treatment and control groups had earned a degree.)
The study also examined a range of secondary outcomes, including institution-level impacts, as described in the study report.
Study Quality: Based on a careful review, we believe this study was well-conducted and produced valid findings 2.
-
1
The study’s pre-analysis plan was created and registered after interim two-year results were posted, as a condition of Arnold Ventures supporting the RCT through six-year follow-up.
↩︎ -
2
For example, the study had successful random assignment (as evidenced by highly similar treatment and control groups), low (4%) non-differential sample attrition, and valid analyses that were publicly pre-registered.
↩︎
