6808 Views (as of 05/2023)
  1. Heather Hill
  2. Presenter’s NSFRESOURCECENTERS
  3. Harvard Graduate School of Education
  1. Fallon Blossom
  2. Senior Project & Communications Coordinator
  3. Presenter’s NSFRESOURCECENTERS
  4. Center for Education Policy Research, Harvard Graduate School of Education
  1. MQI Coaching Team
  2. http://mqicoaching.org
  3. Presenter’s NSFRESOURCECENTERS
  4. Center for Education Policy Research, Harvard Graduate School of Education, American Institutes for Research

MQI Coaching

NSF Awards: 1348144

2018 (see original presentation & discussion)

Grades K-6, Grades 6-8, Grades 9-12, Adult learners

We tell the story of how an instrument designed for research, the Mathematical Quality of Instruction observation rubric (MQI), has become a powerful tool for use by coaches and teachers in the improvement of mathematics instruction.

Though the research literature on professional development programs is mixed, 1:1 instructional coaching appears to be a bright spot, particularly when the coaches are highly trained and coaching conversations are focused on classroom observation and feedback over time, both features of MQI Coaching protocols. Our MQI Coaching program leverages classroom video, a math-specific observation rubric (MQI), teacher self-reflection, and ongoing oversight and support for coaches.

In an NSF-funded randomized controlled trial, students of MQI-coached teachers reported that their teachers ask more substantive questions and require more use of mathematical vocabulary as compared to students of control teachers. In the year following the intervention, teachers who received MQI Coaching had significantly stronger instruction than control teachers on three out of four math-specific instructional domains: Common Core-Aligned Student Practices, Working with Students and Mathematics; and Richness of the Mathematics. We found no impacts on student scores from a state standardized test.

This video gives a high-level overview of the MQI rubric, the MQI Coaching protocols and routines, and the coach training and support that facilitates high-quality implementation, as well as how teachers and coaches can access MQI Coaching resources and tools to support growth in their contexts. 

This video has had approximately 438 visits by 350 visitors from 121 unique locations. It has been played 188 times as of 05/2023.
Click to See Activity Worldwide
Map reflects activity with this presentation from the 2018 STEM for All Video Showcase: Transforming the Educational Landscape website, as well as the STEM For All Multiplex website.
Based on periodically updated Google Analytics data. This is intended to show usage trends but may not capture all activity from every visitor.
show more
Discussion from the 2018 STEM for All Video Showcase (6 posts)
  • Icon for: MQI Coaching Team

    MQI Coaching Team

    Co-Presenter
    May 13, 2018 | 07:02 p.m.

    Thank you for taking the time to watch our video on the MQI Coaching project! MQI Coaching originated as a research project structured around the Mathematical Quality of Instruction (MQI) rubric, with the goal of exploring the impacts of video-based remote coaching on instruction. MQI Coaching has since grown into a high quality, content specific, teacher-focused professional development program available for teachers and districts throughout the country.

    We are excited to engage with you about MQI Coaching over the next week and are eager to learn what questions our video raises for you. To start the discussion, please consider the following questions:

    What are the benefits of using video for professional growth?

    What supports and resources are needed to effectively use video?

    What are the benefits of content-specific coaching?

    What supports and resources are needed to effectively implement content specific coaching?



    You can read more about MQI Coaching here.

  • Icon for: Louis Gross

    Louis Gross

    Facilitator
    Director and Professor
    May 15, 2018 | 11:35 a.m.

    Heather et al., Thanks for an interesting summary of the MQI approach. It certainly appears that you have thought carefully about scaling this to a broader set of teachers. Can you say anything about the differences you have found to be more or less effective in the coaching process depending upon the level of the math? Also since you have now moved to provide consulting on building these MQI, can you provide an introduction to the literature on evaluation of this approach relative to other methods, particularly given the constraints on teacher time and school district funding?

    Thanks,

          Lou

  • Icon for: MQI Coaching Team

    MQI Coaching Team

    Co-Presenter
    May 15, 2018 | 04:46 p.m.
    Interesting question, re: the level of the math! That's not something we've explicitly studied. In this study, we worked with teachers teaching math in grades 3-8 (treatment and control teachers were in the same grade range), but it wasn't part of our experiment to try to compare across grade levels. In terms of some general differences between more and less coaching processes, the literature suggests that effective coaching programs have a few key features that set them apart from less effective ones:  
    1. the coaching is focused on classroom observation and feedback over time,
    2. the interactions between teachers and coaches are of a high quality, and
    3. the coaches are highly trained, monitored, and supported.
    In practice, this is not characteristic of all coaching programs. In fact, we hear from many coaches in the field who were great math teachers who were promoted to a coaching role, then were give no training, structure, or support to facilitate high-quality work with other teachers. (It was hearing from many coaches in this position that drove our initial transition from research to practice; there was a demand for training and support for coaches in the field.)   In terms of your second question, district funding and teacher time are certainly always a challenge!  Schools and districts spend an enormous amount of time and money on teacher professional development every year, and the literature suggests that much of it does not change teacher practice or student achievement for the better. In general, coaching appears to be a bright spot in the larger world of professional development, when the key features above are present. Of course, just about everywhere we've worked, teachers and coaches have reported that one of the most challenging aspects of implementing a rigorous coaching program is finding all the time. Still, in many places, folks are making it work. Anecdotally, it seems like the places that make it work are schools and districts with good alignment and support across all levels: administrators, teachers, and other instructional leaders (such as coaches, specialists, etc.). When everyone is on the same page and working toward a common goal and focused on the same priorities, finding time becomes far more possible. However, when there are competing initiatives or inconsistent priorities, it's really, really hard.     Thanks for the thoughtful questions, and let us know if we can clarify anything else about our work!   -The MQI Coaching team
  • Icon for: Louis Gross

    Louis Gross

    Facilitator
    Director and Professor
    May 16, 2018 | 12:24 p.m.

    Folks, I really appreciated the summary of what works in effective coaching programs. It makes sense, but it is great to have some firm guidelines. The importance of buy-in across the levels of a school or district is I suspect highly relevant across all educational initiatives - it does take a village with consistent and agreed upon goals. Thanks for all your work on this.

     
    1
    Discussion is closed. Upvoting is no longer available

    MQI Coaching Team
  • Icon for: Dave Barnes

    Dave Barnes

    Facilitator
    Associate Executive Director
    May 15, 2018 | 07:38 p.m.

    Hi Heather and team,

    Very interesting!  I have to say that the model seems to have enough simplicity to for teachers to consider while teaching and enough complexity to add value and structure to the reflections.  

    Maybe I missed it but how much time do teachers spend engaged in the PD during an academic year? Do you see teachers wanting to continue with the coaching in following years?  

    I'm also wondering if you have any insights on why Errors and Imprecision are most challenging for teachers?

    Great work!  

  • Icon for: MQI Coaching Team

    MQI Coaching Team

    Co-Presenter
    May 16, 2018 | 05:03 p.m.

    Great questions, Dave. In this study, teachers and coaches started working together in the mid/late fall, and the suggested/ideal timeline was to meet with their coach every other week. Of course, various conflicts get in the way, and very few folks were able to stick to the suggested biweekly schedule. Most teacher-coach pairs met 8-12 times over the course of the school year (with a max of 17). You can see a participation graph (and other research results) here: https://mqicoaching.cepr.harvard.edu/mqi-research-study.

    In this study and in our work since, we have had many teachers express interest in continuing to work with their coach for a second year, but so far this is not something we’ve studied. We were very happy to see lasting effects on instruction after just one year of coaching, but most teachers don’t work on all the possible MQI codes in one year, so there’s plenty more potential if folks were to continue. It’s certainly something we’re looking into studying in the future (likely with our “train the trainer” model this time). As to your question about Errors & Imprecision, we have a couple of thoughts.

    First, the overall rate of errors (which we count when they are by or endorsed by the teacher and uncorrected) across all lessons in this study were fairly low in both treatment and control groups. Second, our intervention doesn’t directly teach teachers more math content- we work on generalizable changes to instruction (e.g., students providing explanations, or teacher or students explicitly linking between different representations).

    We only work on the Errors dimension on an as-needed basis if something comes up, so most teachers didn’t focus any of their time there. So, it’s not surprising that we didn’t see growth. This is also something that we’re looking into studying further, though- we’d love to add some more work on content knowledge alongside the MQI-focused instructional coaching to see if we can also address the content knowledge piece in a way that’s still guided by the MQI and aligned with the existing coaching program. Stay tuned!

  • Further posting is closed as the event has ended.