18909 Views (as of 05/2023)
  1. Caroline Ebby
  2. http://scholar.gse.upenn.edu/ebby
  3. Senior Researcher
  4. Presenter’s NSFRESOURCECENTERS
  5. University of Pennsylvania, CPRE
  1. Nicole Fletcher
  2. Postdoctoral Researcher
  3. Presenter’s NSFRESOURCECENTERS
  4. CPRE, University of Pennsylvania
  1. Beth Hulbert
  2. Co-Director
  3. Presenter’s NSFRESOURCECENTERS
  4. OGAP
Facilitators’
Choice

Developing Formative Assessment Tools and Routines for Additive Reasoning

NSF Awards: 1620888

2018 (see original presentation & discussion)

Grades K-6

This video highlights an early stage design and development project focused on translating research into tools and routines that K-2 teachers can use to formatively assess and respond to student thinking in relation to research-based learning trajectories in early number, addition and subtraction. The tools include: 1) a framework designed for teachers that includes problem contexts and structures as well as learning progressions illustrating student strategies along a continuum of understanding 2) a bank of formative assessment items and pre-assessments that teachers can use to quickly collect evidence of student thinking in relation to core concepts in order to inform instruction on an ongoing basis, and 3) professional development for teachers, teacher leaders and OGAP trainers on the underlying research on the development of number and operations and the analysis of formative assessment items to improve instruction. The video illustrates how these tools are being used by teachers in classrooms across the country to inform and target instruction to the needs of diverse learners. 

This video has had approximately 3,414 visits by 2,907 visitors from 723 unique locations. It has been played 1,999 times as of 05/2023.
Click to See Activity Worldwide
Map reflects activity with this presentation from the 2018 STEM for All Video Showcase: Transforming the Educational Landscape website, as well as the STEM For All Multiplex website.
Based on periodically updated Google Analytics data. This is intended to show usage trends but may not capture all activity from every visitor.
show more
Discussion from the 2018 STEM for All Video Showcase (35 posts)
  • Icon for: Caroline Ebby

    Caroline Ebby

    Lead Presenter
    Senior Researcher
    May 13, 2018 | 06:27 p.m.

     Thank you for watching our video presentation. This is an early stage design and development project in its second year; we are continually revising and improving our newly developed K-2 materials based on what we are learning from field testing in urban, suburban, and rural school districts across the country. We are most interested in discussion about the use of formative assessment, learning trajectories, and visual representations to improve mathematics teaching and learning. We look forward to hearing from you!

  • Icon for: Beth Hulbert

    Beth Hulbert

    Co-Presenter
    Co-Director
    May 13, 2018 | 08:50 p.m.

    We hope you will enjoy this small look into the work we are doing around formative assessment and learning progressions. It is really exciting to have the opportunity to extend the OGAP work to K-2. 

  • Jessica Jeffers

    K-12 Teacher
    May 13, 2018 | 09:42 p.m.

     This work is so powerful and truly impacts teachers understanding of the learning progressions in additive reasoning. It has been the most powerful professional development my system has ever done!! 

     
    1
    Discussion is closed. Upvoting is no longer available

    Caroline Ebby
  • Icon for: Nicole Fletcher

    Nicole Fletcher

    Co-Presenter
    Postdoctoral Researcher
    May 15, 2018 | 08:43 a.m.

    Thanks for your support!

  • Amanda Hope

    K-12 Teacher
    May 13, 2018 | 10:13 p.m.

    This video is just a brief overview of OGAP additive and how it can be used to impact instruction. I first learned about OGAP in the fall of 2017 when I attended a local four day intensive professional development. I am a special education teacher for grades 1 and 2. I can honestly say that OGAP additive is the one process and prodcedural training that all teachers in younger grades need, especially interventionists and resource teachers. Since the training, I have been able to see the specifics areas of weakness that are prohibiting my students from making progress within the general education curriculum. These are areas and gaps that don’t just go away and have to be addressed for students to truly grasp and have conceptual understanding of numerical operations and math problem solving along the mathematical development required to attain mastery of grade level skills. 

     
    2
    Discussion is closed. Upvoting is no longer available

    Marcy Seavey
    Caroline Ebby
  • Icon for: Nicole Fletcher

    Nicole Fletcher

    Co-Presenter
    Postdoctoral Researcher
    May 15, 2018 | 08:42 a.m.

    It's great to hear how OGAP is having an impact on all students! I'm glad OGAP has been useful in your work as a special education teacher.

  • Elizabeth Ball

    K-12 Teacher
    May 14, 2018 | 08:12 a.m.

    This work has completely changed K-2 math instruction at my school.  Teachers have developed a deeper understanding of the mathematical content they are teaching in addition to the importance of early numeracy as the foundation for all other mathematics.  Teachers are able to move beyond identifying student work as right or wrong and are looking for the strengths in all student work so that they can work to move students forward in their mathematical reasoning.  Every teacher who attends OGAP comments that this is the information they have always wanted and that it is the college class they wish they would have had before beginning their teaching.  It is truly life changing.  

     
    1
    Discussion is closed. Upvoting is no longer available

    Caroline Ebby
  • Icon for: Nicole Fletcher

    Nicole Fletcher

    Co-Presenter
    Postdoctoral Researcher
    May 15, 2018 | 08:41 a.m.

    Moving from thinking about right or wrong to looking for strengths in all work is a powerful shift!

  • Icon for: Caroline Ebby

    Caroline Ebby

    Lead Presenter
    Senior Researcher
    May 14, 2018 | 08:52 a.m.

    Thank you all for your comments about the impact this work has had in your schools and districts. One thing we hear a lot is that elementary teachers have not had access to this information on how young children learn mathematics and develop understanding of counting, number, addition and subtraction. Professional learning takes time and resources. There is a lot of pressure to bypass that and just give teachers and students the right curriculum materials or technology-based programs to use, rather than investing in teachers and supporting them in developing their own understanding so they can make more informed instructional decisions. 

  • Natalie Burt

    May 14, 2018 | 11:28 a.m.

    OGAP has been the game changer in teacher content knowledge in mathematics for lower elementary.  This formative teaching and learning process has helped teachers become reflective instructional facilitators in their classrooms.  School administrators have been enthusiastic about the change in the learning environment in the school after the teachers have given OGAP the commitment and proper implementation.  OGAP has also changed my mathematical thinking in my daily life. There is now knowledge about numbers that can not be taken away from the daily life of teachers, students, school leaders, and adults. 

     
    1
    Discussion is closed. Upvoting is no longer available

    Caroline Ebby
  • Icon for: Nicole Fletcher

    Nicole Fletcher

    Co-Presenter
    Postdoctoral Researcher
    May 15, 2018 | 08:40 a.m.

    Glad to hear about the support of school administrators and the impact on your own mathematical thinking!

  • Icon for: June Goodwin

    June Goodwin

    May 14, 2018 | 12:57 p.m.

    The videographer has done a very professional job in taking and editing the work.  The subject is clearly and concisely portrayed so that teachers can learn of useful strategies in teaching children critical subjects of interest. 

  • Icon for: Caroline Ebby

    Caroline Ebby

    Lead Presenter
    Senior Researcher
    May 14, 2018 | 08:44 p.m.

    Thank you--we were very fortunate to have a professional videographer to help us portray this work in action! 

  • Marilee Bryant

    K-12 Teacher
    May 14, 2018 | 04:08 p.m.

    I am a huge OGAP supporter.  I have used many of the strategies to help my students progress through their math understanding.  It is a great resource and program.  It helps teachers understand the framework of additive strategies and ways to be more deliberate  during instruction.   

     
    1
    Discussion is closed. Upvoting is no longer available

    Caroline Ebby
  • Icon for: Nicole Fletcher

    Nicole Fletcher

    Co-Presenter
    Postdoctoral Researcher
    May 15, 2018 | 08:39 a.m.

    Thanks for your support! Glad to hear how our work is helping teachers!

  • Clayton III

    K-12 Administrator
    May 14, 2018 | 04:10 p.m.

    This work is extraordinarily powerful and has limitless potential to help us develop that deep number sense that will stay with our students for their entire lives. The focus is on high quality instruction with an emphasis on supporting teachers' understanding of both the mathematics and their students' work. Thank you for the brilliant contribution to our profession. 

     
    1
    Discussion is closed. Upvoting is no longer available

    Caroline Ebby
  • Icon for: Nicole Fletcher

    Nicole Fletcher

    Co-Presenter
    Postdoctoral Researcher
    May 15, 2018 | 08:38 a.m.

    Thanks for watching and commenting!

  • Icon for: Nancy McGowan

    Nancy McGowan

    Facilitator
    Math Instructional Coach
    May 14, 2018 | 11:14 p.m.

    Our school system has used OGAP for approximately four years.  The way in which students are able to think about problem solving and their fluency in strategies is amazing.  As an adult, it has changed my teaching.  The process is methodical and thorough.  The assessments are so helpful in guiding students to greater mathematical understanding. 

     
    1
    Discussion is closed. Upvoting is no longer available

    Caroline Ebby
  • Icon for: Nicole Fletcher

    Nicole Fletcher

    Co-Presenter
    Postdoctoral Researcher
    May 15, 2018 | 08:37 a.m.

    It's great to hear about your experiences using OGAP!

  • Icon for: Nadine Bonda

    Nadine Bonda

    Facilitator
    Assistant Professor
    May 15, 2018 | 08:49 a.m.

    The testimonials for this project speak to the success that teachers feel they have both in their own mathematical development and the mathematical development of their students.  Seeing a small snippet of what you are doing for early ages and hearing you say that you have worked with older students, I wonder if you can talk a bit about the early development of algebraic thinking and how and when that occurs in your program.  Thank you.

  • Icon for: Caroline Ebby

    Caroline Ebby

    Lead Presenter
    Senior Researcher
    May 15, 2018 | 12:30 p.m.

    Hi Nadine--thanks for your question. While algebraic thinking is not directly a focus, it comes up quite a bit in all of our materials. For the K-2 strand (highlighted in this video), the properties of operations are an important part of the learning trajectory in helping students move towards more sophisticated strategies. We do a full session on properties, relationships, and equality in the PD, and we have a section of the item bank with items specifically designed to elicit student thinking and understanding of equality, relationships and/or properties. The same is true for the OGAP multiplicative reasoning and fractions work in grades 3-5. Across these content areas, we also focus on the development of increasingly efficient and generalizable strategies and algorithms, and the role of models, like the open area model and open number line in supporting that development. So, while not a main focus, these aspects of algebraic thinking come up throughout the training and are also a focus of many of the formative assessment items.

  • Whitney Cook

    K-12 Teacher
    May 15, 2018 | 10:07 a.m.

    OGAP has had a tremendously positive impact on teaching ad learning in our district!  The investment has paid significant dividends.  

     
    1
    Discussion is closed. Upvoting is no longer available

    Caroline Ebby
  • Icon for: Nicole Fletcher

    Nicole Fletcher

    Co-Presenter
    Postdoctoral Researcher
    May 15, 2018 | 01:48 p.m.

    Glad to hear you've seen a positive impact on both teaching and learning!

  • Icon for: Michael Belcher

    Michael Belcher

    Graduate Student
    May 15, 2018 | 10:33 a.m.

    Great video! OGAP sounds like a powerful tool for increasing teacher capacity and improving instruction. From the video and your summary, it seems like much of your focus is on supporting teachers to use LTs as a lens for analyzing students' strategies on assessment tasks. In your PD (or through features of the tool), how do you support teachers to act on their analyses (e.g. adapting instruction or guiding classroom discourse)? What does that support look like and how quickly do teachers in your program understand and embrace LTs for use in instruction? Have you experienced any challenges in this regard? Thanks and great work on your video!

  • Icon for: Caroline Ebby

    Caroline Ebby

    Lead Presenter
    Senior Researcher
    May 15, 2018 | 12:45 p.m.

    Hi Michael. Thank you for your questions. Yes, supporting teachers to use LTs as a lens to analyze and respond to student thinking is the focus--not only through assessment tasks, but throughout instruction. There are 3 parts to the formative assessment cycle-- assessing, analyzing, and responding--and the instructional response is definitely the most challenging for teachers. However, the progression (LT) not only serves as a tool for analysis, but also for response. Once teachers identify the level of student thinking represented in the student work, the progression provides guidance as to the appropriate next step. For example, if a student is counting on by ones to solve an additive problem, the next step is not to teach the  standard algorithm (which is at the top of the progression). Rather the next step might be to use a model that incorporates groups of ten ones (like the bead strings shown in the video) to support the student in unitizing and developing a counting by tens strategy. If a student is jumping by tens on the number line, then the next step would be to help them jump by multiples of ten (as you see a teacher highlighting in the classroom clip). Teachers find that the progression give them this guidance but they also need to have the autonomy and confidence to make those decisions, sometimes against the recommendations of the curricular materials or pacing guides that they are using. This can be a challenge. Maybe some of the teachers who have posted here could also respond to this!

    We are also currently studying how teachers are understanding and making sense of the LT in sorting and responding to their own student work, and while that research is very much in progress, we are seeing that there is a progression of their own understanding. This has been very useful for us in thinking about how to improve the LT progression and the PD, and also in better understanding how teachers take this up in practice, often in ways we didn't anticipate.

  • Icon for: Karen Economopoulos

    Karen Economopoulos

    Facilitator
    Co-Director, Investigations Center for Curriculum and Professional Development
    May 16, 2018 | 04:24 p.m.

    OGAP seems to be as much a tool to support student understanding and learning as it is to supporting teacher learning - such an important combination for the teaching and learning of mathematics.  I'm curious about whether on not you can envision OGAP being utilized in pre-service education? 

  • Icon for: Nicole Fletcher

    Nicole Fletcher

    Co-Presenter
    Postdoctoral Researcher
    May 16, 2018 | 05:00 p.m.

    Absolutely! The progressions distill the learning trajectory research and illustrate the development of children's thinking about/understanding of addition, subtraction, and number. The progressions are powerful tools to help teachers analyze student work and determine next instructional steps. Incorporating this type of work into teacher education courses could certainly help pre-service teachers to learn the value of formative assessment and how to implement formative assessment on an ongoing basis. 

  • Icon for: Beth Hulbert

    Beth Hulbert

    Co-Presenter
    Co-Director
    May 16, 2018 | 05:08 p.m.

    Thanks for the comments and question Karen. When we first began the OGAP work we didn't fully appreciate the importance of the teacher PD and thought the OGAP tools could stand alone. We learned quickly that using the tools for both teacher and student knowledge was vital to impacting classroom practice. 

    We do have some pre-service instructors who are using the OGAP progressions and other materials in their courses. They have found them to be very effective with pre-service to expand content knowledge and strategies and thinking about student work in planning for instruction. 

    We really try to emphasize the idea that the progressions help you design instruction and provide access to the content for all students and this is an important message for pre-service teachers to understand.

  • Icon for: Jeanine Brownell

    Jeanine Brownell

    Higher Ed Faculty
    May 16, 2018 | 11:57 p.m.

    I am interested to hear more about how your additive LT integrates strategies with problem structures and problem situations. Can you share how the framework was developed and whether it is available to share?

    This work sounds really powerful!

  • Icon for: Caroline Ebby

    Caroline Ebby

    Lead Presenter
    Senior Researcher
    May 17, 2018 | 11:06 a.m.

    Thank you for your comment and questions Jeanine. The OGAP Additive framework for K-2 was developed after a review of relevant research, including existing learning trajectories, and through extensive piloting of formative assessment items with K-2 students and analyzing their work. It has gone through several iterations as we learn more through piloting and implementation. You can find the OGAP frameworks on http://ogapmathllc.com but as Beth mentioned in a previous comment, we have learned that the progressions are most useful when paired with intensive professional development, rather than as stand-alone tools.

    An important underlying idea for all the OGAP frameworks is that student strategies will move up and down the progression as the problem structures and situations are varied. Therefore, unlike some other learning trajectories, we don’t categorize students by levels on the progression, but rather their strategies on particular problems. Teachers can therefore gather more robust and actionable evidence of student understanding by varying problem structures and situations (e.g., giving a problem with larger numbers or a different problem situation). The front of the OGAP Additive framework has the chart on additive situations (based on the CGI work) from the common core standards as well as information on other structures that can be varied (number complexity, representations, properties and relationships). Teachers learn about these problem situations and the interaction with problem difficulty and strategies during the training. The item bank is searchable by topics, problem situations, problem structures (such as number complexity of representations) so that teachers can be intentional in selecting items to use as formative assessment. 

  • Icon for: Jeanine Brownell

    Jeanine Brownell

    Higher Ed Faculty
    May 17, 2018 | 01:45 p.m.

    Thanks for sharing more. I can see how your tools and training would support teachers in formative assessment. I appreciate how your additive progression includes number concepts that are necessary to support using procedures with understanding.

    I also appreciate your comment that the progression helps categorize children's strategies, not the children. In my work with teachers, we are always trying to move away from thinking in terms of "my low kids" and "my high kids" to thinking about what student work reveals about their understanding.

     

  • Icon for: Caroline Ebby

    Caroline Ebby

    Lead Presenter
    Senior Researcher
    May 17, 2018 | 02:35 p.m.

    Yes, we are also trying to support teachers in making that shift. We are also currently studying how teacher beliefs about students in these ways might be interacting with their take up of OGAP tools and routines. 

  • Nicole Kee

    Graduate Student
    May 17, 2018 | 02:46 p.m.

    Hello Caroline, Nicole, and Beth,

    This program sounds wonderful!  I teach 8th grade pre-algebra, algebra, and geometry in bucks county and graduated with my undergrad in secondary ed, math from Penn State University.  I often think about the extensive methods courses that our elementary school teachers have gone through in order to prepare them to effectively teach multiple disciplines.  However, I also know that there are times when our elementary school teachers may not feel as confident in the ways to formatively assess math and to ensure that our students are learning at a level that promotes deep understanding. I think that OGAP sounds like a great opportunity to help teachers focus strictly on ways to analyze student thinking and move forward with instruction.

    Do you have a program that currently exists for grades 3 through 6? Does this program look similar to the one that is implemented at the K through 2 level?

    I am also interested in knowing if the teachers that participate in OGAP are supplied with the materials to implement the items from the online item bank.  It looks like there are a lot of manipulatives being used within the classroom to help students create an understanding.  Does the additive reasoning framework help show teachers how to utilize the manipulatives effectively in the classroom?

    Being a secondary math teacher, it is important for us  to understand how our students are being taught the mathematical concepts at the elementary school level. Creating a deep foundation of number sense is crucial for our students to be successful at the secondary level.

     

  • Icon for: Caroline Ebby

    Caroline Ebby

    Lead Presenter
    Senior Researcher
    May 17, 2018 | 05:53 p.m.

    Hi Nicole--Yes the K-2 materials are modeled after previously developed tools for grades 3-8 in multiplicative reasoning, fractions and proportional reasoning. You can find more information on all of this at http://ogapmathllc.com. Once teachers go through the 4 days of training, they have access to an item bank with over 300 formative assessment items. The use of concrete materials and more importantly, visual models, is emphasized throughout the training.  (In the additive training, teachers make and use the bead strings that you see in the video, and it is  very inexpensive to purchase materials to make a class set) For more discussion on the role of visual models in K-2, you can read about our work in CADRE's latest spotlight: http://cadrek12.org/projects/developing-formati...

    I agree that understanding how concepts develop at the elementary level is important for secondary teachers as well. This is how I first got interested in elementary mathematics-- as a middle school math teacher getting a masters degree, I was encouraged to take an elementary course and I became fascinated with the research on how children learn mathematics.

     

  • Icon for: Beth Hulbert

    Beth Hulbert

    Co-Presenter
    Co-Director
    May 17, 2018 | 06:09 p.m.

    Hi Nicole...Thanks for all your questions. Yes we do have OGAP Multiplicative Reasoning and Fractional Reasoning for grades 3-5/6. We also have proportional reasoning for grades 6-8. You can see more about all of these at ogapmathllc.com. You can also find contact information for me and I would be happy to answer all your questions and describe our program. Our original development work was in these other content areas and then we partnered with Penn and Caroline to expand our work to the K-2. Teachers do have access to all the materials as part of the training. The item bank is one of the core components of our work along with the progressions and the PD. I look forward to hearing from you.

     

  • Further posting is closed as the event has ended.