Saint Paul Music Academy (2018)

St Paul, MN

Closing the Gap


Students targeted in closing the gap activities included African American students who had received 2 or more Office Behavior Referrals (ODR’s) in the 2015-2016 school year. African American students comprise 21% of total student enrollment, yet represented nearly 60% of total ODR’s as reflected by school-wide SWIS behavior data. This data was used to establish program goal #1 and the closing the gap goal was established as a subset of the program goal. It was chosen to eliminate the overrepresentation of African American students who receive ODR’s.

The closing the gap goal is not written in SMART format, it was written as a total percentage reduction based on the average number of ODR’s students received. The average ODR’s from the 15-16 school year for this group was 3.55 referrals, and the goal was to reduce that number to 2.84, a 20% reduction. In reflection, I will change this to a SMART format to simplify and strengthen the goal, more appropriately tie to the program goal, and read easier for stakeholders.

All 9 participating students from grades 2-5 were in the “tier 3 category” in school-wide SWIS behavior data reports. Many factors led this group to be a small set of students. Several other students in this “tier 3 category” were special education students who already receive social work support and, simply put, some teachers write more referrals than others. While likely additional students could have benefitted, the data was not available to inform me of who they were and their behavior struggles.

The primary intervention used in the closing the gap activities was the “Check In, Check Out” (CICO) program (see link attachment). A student goal sheet is attached for reference. It was initially intended to have students also participate in the same small group services. However, upon reviewing individual student data, they were put in differentiated small group topics to best meet their needs. Students participated in one of the following small groups: impulse control, anger management, or relational aggression. Approximately bi-monthly, students participated in individual counseling for additional skills practice and received in-classroom support for skill implementation. These interventions were chosen because they combined an intense, evidence-based, behavior monitoring intervention with several layers of skill building services. A specific example was a 5th grade girl who had individual CICO goals of controlling her body and anger, also participated in an impulse control group. In individual sessions, we worked further on impulse control strategies. For classroom support, I provided coaching and feedback on skill implementation during partner math work time, a subject she historically struggled.

While students participated in differentiated small groups, they all completed the same student assessment. The student assessment was intentionally written to reflect the targeted Mindsets and Behaviors. For example, the first and third student assessment questions are focused towards student beliefs around controlling their behavior, developed through participation in CICO. The second question asks about strategies to control their behavior, which is intentionally open ended to include skills acquired through differentiated small group services. In reflection, as an area for growth, I want to analyze the balance between differentiated student services that best meet individual needs and the potential consequences of fragmenting the intervention. I question sustainability and room for growth if a chosen gap in the future proves to have a larger group of students. Further, I question if the student assessment, with such a large scope of interventions, sufficiently captured student perception growth. I also, embarrassingly, see in reflection that I missed one of the targeted mindsets and behaviors, B- SS 3, about creating a positive relationship with adults. While the counselor-student relationship is cornerstone in the CICO intervention, I missed the opportunity to capture that through student perception data and will need to be added.

As outlined in the data table, implemented activities and interventions resulted in improved individual student outcomes, mindsets, and behaviors. Originally, I tied ODR outcomes to social emotional learning targets from student report cards. In reflection, this was incorrect and I will change to academic learning targets. While it is a numerical data source, which is nice for quickly reference student progress, it is tricky because it is teacher perception of student progress, which is subjective. I believe this change will strengthen closing the gap services and the outcomes shared with stakeholders as it is predicted that increased student classroom seat time that accompanies a reduction in ODR’s will lead to better academic outcomes.

Goal: Identified African American students with 2 or more Office Behavior Referrals (ODR’s) in the 2015-2016 school year will decrease their ODR’s by 20% in the 2016-2017 school year.

Target Group: Identified African American Students with 2 or more Office Behavior Referrals (ODR’s) in the 2015-2016 school year

Data Used to Identify Students: School-wide behavior data collected from SWIS Behavior Data System tracking ODR's

School Counselor(s): Keela Kuhlers

ASCA Domain, Mindsets & Behaviors Standard(s): Mindset 5: Belief in using abilities to their fullest to achieve high-quality results and outcomes; B-LS4: Apply self-motivation and self direction to learning; B-SMS 2: Demonstrate self-discipline and self-control; B-SS3: Create relationships with adults that support success

Type of Activities to be Delivered in What Manner?: Check In Check out (CICO) Intervention Parent-Teacher Conferences, Parent Contacts Student Small Group Counseling: Differentiated to different behavioral and developmental needs of students in target group with topics on relational aggression, anger management, and impulse control Individual Counseling In-class student support of skill implementation

Process Data (Number of students affected): 9 Students in grades 2-5. 6 female, 3 male. 1- 2nd grade 2- 3rd grade 2- 4th grade 4- 5th grade

Perception Data (Surveys or assessments used): Student Assessment Results showed that students had a 50% increase in reporting a belief in themselves and their ability to be successful in controlling their behavior in school, a 60% increase in their election of knowing strategies to control their behavior, and 75% increase in their belief they can practice known strategies and make their Check In, Check Out (CICO) goal on a daily basis.

Outcome Data (Achievement, attendance, and/or behavior data): Average ODR’s decreased by 53.1%. Students had an average of 3.55 in 15-16 school year. That reduced to 1.66 in 16-17 school year.

Implications: Overall, data shows closing the gap activities improved outcomes in reducing ODR’s with the target group. However, while ODR’s decreased, report card social emotional learning target data was incongruent with that outcome data showing minimal to negative student growth. The conclusion made from this is that teachers may not be writing ODR’s despite still seeing the problem behavior in the classroom, resulting in the appearance the behaviors are improving on school-wide behavior data sources, but not in teacher perceptions in report card data. It could also be conversely concluded that the behavior is improving, but teacher perceptions of student are fixed, resulting in lower improvements in report cards. Additionally, it is concluded that the positive individual relationship made between counselor and student in CICO intervention served as integral to effective intervention implementation. Targeted small group services and classroom support also increased student success through the opportunity for skill building and implementation practice, resulting in improved classroom behavior, resulting positive CICO scores/meeting daily goal and reduced ODR’s. It is believed that students increased their classroom learning time due to the reduction in ODR’s, resulting in increased access to their education and improved academic outcomes. As discussed in the narrative, I will improve outcome data collection to include academic learning target report card data to better connect this conclusion in the future.