2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 18
You need something that that actually has a statistical measure that has meaning to it. But the other reason that we think this is important to us and it's the reason we're willing to take the pain of it's going to maybe be more difficult for families to understand and we'll need to do more communication around that is it also allows those tool sets to be more useful to us in how we adjust our practice over the course of the year. So, you know, one of the problems is if the result is is obfuscated or hidden from you, then you're really making adjustments over the course of the year kind of in the dark. And by having a more accurate correlation, it'll allow us to make more effective adjustments throughout the year, ultimately benefiting the students because it will it it will put us in a position to be able to pos more positively impact those student outcomes.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 19
I wanted to add um which is I this is what you you were saying too um superintendent man is that it helps us set goals with kids easier. So like if you were a student at 19 before you'd say okay I'm at to even get out of this I have to be at 40. That seems like a lot more. But if you're at 19, you really only need to jump six points by the next test, which is a lot seems much more attainable than I have to jump from 19 to 60 actually to be proficient or move the next the next test. So, it's just um also helps the kids have um what's it called for smart goals, reasonable go um attainable goals, right? Attainable goals. >> Um I'm just I just have a couple of thoughts. I guess I really love this especially when it comes to our two-way communication when we have to go out and talk to parents is a very good way of letting them know how to decipher that when it comes right and it also I think it's a good bright spot for parents if they're already coming in in the post test or the pre-EST at a high level that for us as a governing board member when we're out there is like what is working what did you guys do in the summer what you know there's so much two-way communication that can go there to help us communicate with their parents better what we're doing and also this just a thought is I think it's great that we're doing this because when we were doing our community feedback one of the things that we were hearing a lot is that you guys are not being rigorous enough you know we want high expectation for our students so now that we're moving our cut scores even higher I think it brings that in and it will clarify with teachers too I believe in classrooms to see which kids are at that a little bit better so they can also maneuver their, you know, materials or their curriculum to better meet the needs of the students if they need a little bit more support or those ones that already have the high, you know, efficiency.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 20
How do we keep them on track versus them being lost in the system? Because sometimes that happens, too. So, I I love all those this those are just some of the wonderings and thoughts I had. >> The other one I want to do is correct myself because before I kept saying predicting, it's not predicting, it's the likelihood, >> right? the likelihood or the relationship. So just saying when we're looking at the correlation, it's the likelihood that they will score this on the state assessment. Um and then I wanted to bring your attention >> projecting either then. >> Would you think projecting is the same as predicting then? >> Like if I use that word, I shouldn't use that word. >> No. >> Okay. >> Just the likelihood. It's like this is the most likely that you'll be in this category or in this score. This score.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 21
So, >> so correlation efficiency, we're comparing two things that are different. So, even though our benchmarks and AASA are still measuring academic standards, they're really very different because our benchmarks we have they're still aligned to the same blueprint from the Department of Education, but we don't have the same robustness because on ASA there's three to four to five questions per standard, which is why the kids take a couple days and large blocks of time. under our under what we do for DNA through Renaissance, we have basically one question per standard. So they're they're they're close but they're not the same which is why we it's why it's a likelihood of because you say predict project or predict that's it's almost like a cause and effect relationship like oh if this happens this will happen. So like a cause and effect would be you know if we use the basketball measure if we practice every day and we watch our game film then our halftime score is going to be better right one something happens to cause something else to happen.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 22
This is not that because they're not related. Even though we think they are, they're really not. Two different vendors, two different tests, two different questions, different cut scores, different waitings of the questions. So, they're not really the the same, but they're not the same. If that makes sense. >> And I just want to bring your we just printed the math because we're talking about math today um with our progress monitoring reports. But you can see here we have all the grades. Let me put and on the very far column to the right the correlation you can see that all of them there are pretty high either 6.78 and these are um you can see just to bring your to understand it so on the very left it says math pre math IBM1 the first the pre-estes we just did in August IBM 1 is in October or late September actually right before fall break IBM 2 is um right before the winter break and then the post is after the state assessment.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 23
And so these are the cut scores for all the grades um and all the proficiency levels. I'm going to give you a minute to read it in case you have any questions or or um want us to explain something one of the columns. So, I'll give you a minute to look at that document. Yes, she did. Notice >> I'm sorry. >> Say that. I'm sorry. >> Kindergarten. >> Oh. Um, no. They're they're on they're on Fastbridge, right? >> For kindergarten. They're on FastBridge. Oh, okay. >> We we do have a kinder we do have a a kinder assessment. Um but it's um it's a we don't have a kinder mimic, so we can't align it to the state test. Grade one is about as low as we go. We do have a comprehensive, but it's much more robust. Um and kinder's it's it's read to the kids, but really fast, a universal screener, gives us a lot more tools because it's more skill-based.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 24
So that's really what helps us drive where kinders are at with letter names, letter sounds, high frequency words, um basic math facts, identif identifying numbers, patterns, those kinds of things. So we do have one, but it's really not appropriate for kinders. Maybe in maybe in May we can have them take something like that. Um but we can't do a correlation coefficient because it's not aligned to the the state standards. >> And and there is you'll notice there's no correlation coefficient for first or second grade. And that's because those students don't take it the AASA test. So there's no way to correlate it because you'd have to have both data sets in order to create a correlation. >> Okay, that was going to be I I think that's probably related to my question, which is why the uh cut scores are so much higher for first and second graders or like they're they progressively are higher and then get lower as the grades go up.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 25
>> Yeah. So, one thing you will notice on our on our previous model, you had to get uh 40 percentage points or 40% correct to be partially proficient. If you notice, now our test cut scores are actually going down, >> not up. So, you don't have to get 40. Now, for your for a third grader on the pretest, you would get 27. So, there So, the reason this is important is that when we bring progress monitoring to the board, you're probably going to notice a difference. So on the little the the line graphs that show, you know, mentally proficient, partially proficient, those kinds of things, you're probably going to see a difference because our cut scores are going to be lower. So it may look like we have more kids moving out when actually it's just a more accurate representation of where our kids are really at because we've reormed our cut scores to where they really where they should be in alignment with how they're how we the likelihood of performing on the state assessment.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 26
If that makes sense. and and and um I know Mr. Myers is on um a committee for the state board of education like where they help with figuring out you know measures for things. So I I think one of the reasons you see that difference is and correct me if I'm wrong there are cut scores for the actual AASA test too that they use to determine what label they're going to provide a child with and so those cut scores at those other grade levels are lower. So that's that's that's why the mimic correlation is also a lower score. So it's not like, you know, the mimic's just so super hard for eighth grade that the score is lower. It's because the mimic is theoretically mimicking the actual AASA test and the cut scores on the AASA test for that grade level or lower. And I just want to make sure that all of us as board members understand that because as stuff cuts out to community, we never want the misconception of, oh, you're lowering standards or you're doing this or you're doing that, you're changing your curriculum, so you're a benchmarking or your progress marking looks better.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 27
So this is the time to ask questions and really get into what a cut score is so we can announce or you know go out and explain it in the correct manner. >> Okay. Yeah, I'm I want to say I'm feeling a little bit lost. Um, but so let me just maybe ask a couple. Oh jeez, it is a hello. Hello. Oh, maybe I just need to project into the mic. Okay, sorry. Um, just feeling maybe a little bit lost, but also just going to throw out some questions. So when you know, for instance, I'm looking at the math post test 8th grade above 62% is highly proficient. So, you know, when coming like as a parent and my own experience seeing like, well, isn't 62% like a C? Um, you know, just relating it to how I've known scoring and grading. Is this saying that they got 62% of the questions right then then that makes them that relates to highly proficient?
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 28
>> Yes. So, the way that um so within our Renaissance family of products, these are percent corrects. So, it's a percentage. So if a kid if it's 10 questions and the kid gets two right, it's 20% correct. AASA use what's called scale scores. And scale scores are are because it's a a much larger assessment, they use scale scores because there's different weightings of different questions. There's parts and different kinds of things. And those scale scores when ASA came out several years ago and we're actually getting ready, the department's getting ready to go out with an RFP for a new state assessment in school year 27. So we're now going through that process. We actually, the department brought in teachers. So teachers actually set the cut scores for AASA. We also set the cut scores for AELA. Um I was on the committee that did that for fifth grade a couple years ago.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 29
Um so if you're out in the community and 67% that's a C >> or a D. When I was in school, you know, when I was in school, I was, you know, I was grounded for a month if I brought that score down. Well, it's different now because this is what because we looked at the rigor of the test. um especially in the upper grades in six, seven, and eight. In math especially, it's a hard test. I mean, it is we it is hard. We've given it to adults and you know because on the committees we actually go through and take the test. I mean they you go I I'm on third grade language arts. We go yeah I taught third grade so that's why I do that. But they give it to us and we take it and when the committees come and it's a group of oh hundreds and hundreds of teachers that they actually set the scale scores which is identifies this is what teachers think in the state of Arizona is >> minally proficient partially proficient and then when you get to proficient and above that's passing.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 30
So when you stop passing is proficient and highly proficient. And so what what this does is we're trying to align what the Department of Education and the teachers in the in the field say to what our our our mimics or our DNA tests. So it just more accurately aligned which is why we may see a greater change. So if you remember that pie chart how we had more less reds and more yellows and more greens. It's just a more accurate representation. We're not lowering our standards. We're not we're not saying that our this is a lower expectation in Kraton schools. What we're saying is we're more accurately representing how our kids are doing aligned to the state assessment in which teachers in the state determined student proficiency and accuracy and those kinds of things. >> Okay, that makes sense. >> Does that does that help when you talk to the talk to the community >> for me?
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 31
Um and then going over to moving over to correlation. So can maybe just explain a little bit how so is that in when it says correlation does because these are are these are the like assessment not assessment that's not um >> is this in correlation to the actual like a AASA the the state test so that this figure represents what they're getting on our little benchmarks. >> Yeah it's the likelihood of them and if you notice it starts relatively low. So if you look at our pre-est, it starts in the 7s. So if you're looking kind of at the the the pre-EST as you kind of go to uh IBM, which stands for interim benchmark one and then two in post, you know, the see the numbers get higher. It goes from point sixes and point sevens up to point8s. That's because we're getting closer and closer and we're having more and more instruction and more and more data.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 32
So we're able to more tightly align the likelihood of the students performing on the state assessment. So when we get to point8s and above that is a very high a very high correlation. >> Okay. >> Which is why when we came in May and which is maybe in some of the discrepancies where it's like we're not on track, we're not on track, we're not on track and all a sudden whoa wait hey we're on track. That's because in May we have we've under 40 60 80 it's a very it's a higher correlation which closely line to what we were thinking they were getting but because of benchmark 2 benchmark one and the pre-EST having a very low correlation which is why it was perceived that we were off track when actually we were on track but our cut scores were not aligned properly. So we're hoping for as we come to the board this school year we're bringing much more accurate information that's aligned.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 33
It may look a little different and we may have more kids in different buckets, but it's going to be more accurately aligned to how we think they're going to perform on the state assessment. >> Okay. And the these correlation numbers are based on or these predictions because this is showing 25 26 DNA, right? Or >> yes. So what so what this what the study did was take um through last year. So we have data for all of um 24 25. So pre-est, interim one, interim two, and then we have our state results. So we get that all to Dr. Forester who's in Gainesville, Florida, and I worked with her, and which is why we now have So these cut scores, even though they're 26, it's based on 25 scores, which is the most recent scores that we have available to us. >> They're not predictions.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 34
So I just want to make sure we're clarifying real quick. So these these numbers so for example if you look at math pregrade 1 the red column minimally proficient it's saying that this is now in the next school year 2025 2026 if I'm a first grader and I take our like testing our benchmark testing um at the beginning for the math pre-EST which I don't know if they've already done that but if I'm a first grader and I scored below 30% I'm going to be minimally proficient. So, it's not really a prediction, but it's just telling you where I'm going to fall depending on what my score is this school year for our new cut scores, >> right? Yeah. I was my question was in relation to the the the gray column, the correlation, like what what that is, what that number is telling us.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 35
>> Yeah. So, >> so, >> um, >> oh, I don't know. Gosh, now you're gonna actually make my brain work even more. Um >> here somebody else's brain is >> I I'm trying to remember the correlation coefficient thing now. >> Uh the likelihood. Sorry. So that's where we get to the thing that's not a prediction but a likelihood, right? And so the likelihood that that somebody's going to be that there's that they're going to wait that they're going to land in each one of these buckets or >> sol whatever assessment I Gotcha. >> I'm proficient on the post assessment. According to the DNA benchmark assessment, when I take the state assessment, AASA, um there's a likelihood that I'll probably be proficient. >> And so we're talking, but it's a likelihood. >> So we're talking about anybody in the green or blue column. >> Yes. Anyone in the green column >> or the blue column >> or any column.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 36
Yes. any way. >> Okay. Can I give an analogy real quick? >> Yes. Go ahead. >> So, and and someone's going to have to correct me if this analogy is wrong. Oh, go ahead. >> Pause though. I don't understand how somebody who's scoring below 17% as a third grader is going to have the same correlation coefficient to be proficient at the end as somebody who is proficient already. Can you explain that to me if that's what you're just saying right now? It said it doesn't matter what column you're in. >> No, it does. What? What? Yeah. I was like, uh, >> like if I am a minimally proficient, if I score minimally proficient on the post test, then I'm probably going to score minimally proficient. >> Gotcha. Sorry. >> Whatever college you're in, that's what it's going to be. >> Thank you. Okay. I heard you would be proficient and I was likelihood that you'll be that on the statement.
⚗ AI-reconstructed · cite from original above
2025-08-16 Maricopa County, AZ YouTube / Creighton School District transcript source: youtube August 16, 2025, Governing Board Meeting · passage 37
>> The correlation is the same for all of the columns, but it's to that column. So, so the best analogy I can think of is a coin flip. So cuz because if you think about it, the the correlation coefficient for a coin flip is 0.5. It's 50%. Right? Which means that there half of the time it's going to come up heads and half of the time it's going to come up tails. Doesn't mean that's going to happen. I shouldn't say it means that because this is literally just a correlation. It should come up half of the time heads, half of the time tails. If I flip that coin four times, I'm not necessarily going to get two heads results and two tails results. I might get three heads results and one tails result. If the if the pool of data is large enough, because it's a statistical correlation, it should land right around that 0.5.
⚗ AI-reconstructed · cite from original above