Q&A
Evaluation of the Summer Rising program
1:35:43
·
160 sec
Council Member Stevens inquires about formal evaluations of the Summer Rising program. DOE Deputy Chancellor Emma Vadehra explains that while no formal evaluation has been conducted, the program has been analyzed for continuous improvement in several ways.
- Academic impact was assessed using citywide screeners, showing statistically significant improvements in math and ELA for certain student groups
- Curriculum-aligned assessments also showed improvement across grades and subjects
- Surveys of families, students, and staff were conducted to gather feedback on the program
- Over 13,000 families and about 6,000 students completed the surveys, with overwhelmingly positive results
Althea V. Stevens
1:35:43
Yeah.
1:35:43
Absolutely shout out to them because pivoting at that late in the game is not easy.
1:35:49
Especially when we know that there's so many barriers even around, like, hiring staff.
1:35:54
We know that's not an easy task.
1:35:55
So definitely shout out to them and but, also, we have to just do better because that's just not okay.
1:36:01
Right?
1:36:03
Has there been a formal evaluations done on summarizing it?
1:36:06
If so, if no, why not?
1:36:09
And is that something that we're looking to do in the future?
Emma Vadehra
1:36:14
Thank you for the question.
1:36:15
I'll jump in, and then You guys should add on top, obviously.
1:36:19
There has not been a formal evaluation done, but we have done we have looked at the program for continuous improvement for our own purposes across agencies in a couple of different ways.
1:36:32
One of those ways is looking at academic impact of the program, which is something we started doing in 2023 and plan to do again for summer 2024, but have not done that yet.
1:36:46
We looked at that academic piece in a couple of ways as well.
1:36:49
1 is we looked at our city wide screeners, so our assessments that we use across the system for everybody.
1:36:56
So that's common system wide folks are required to pick from a couple of assessments.
1:37:01
When we looked at those, we found a statistically significant impact in math, particularly for our English language learners.
1:37:10
We found a statistically significant impact in ELA for a number of our priority student subgroups.
1:37:17
On the academic side, we will continue to look at that.
1:37:22
We obviously want to keep doing better in that front, but that's what we found for summer 2023.
1:37:27
On the academic side, we also do the as Danielle mentioned, there are and chair Joseph, as you knew, there are assessments built in with the curriculum that are aligned with the curriculum themselves that folks are using.
1:37:40
So we also look at those.
1:37:42
Those also showed improvement across grades and subjects.
1:37:47
I will say the other thing we look at as evaluation of the program is not just that.
1:37:51
Right?
1:37:51
It's also how our families, our students, our staff, our providers feeling about the program itself.
1:37:59
We were really glad to see the report out yesterday.
1:38:01
It gave us additional data, but we do also have our own survey data that we look at very, very closely.
1:38:07
We had about 13,000 families complete that this year.
1:38:11
We had I think in total about 6000 students completed this year.
1:38:15
I'll check the data in a minute.
1:38:17
And the data there is really overwhelmingly positive.
1:38:20
It's one of the reasons we think there's more to the agenda.
