Icon for: Dor Abrahamson


University of California, Berkeley

Gesture Enhancement of Virtual Agent Mathematics Tutors

NSF Awards: 1321042

2016 (see original presentation & discussion)

Grades K-6, Grades 6-8

People learn through interacting with the world. Yet when computers first entered educational practice, they provided limited forms of interaction, because the user-interfaces were not yet sophisticated enough. But now we have natural user-interfaces such as Wii, Kinect, and touchscreen tablets that are once again allowing educational designers to build activities in which students interact with objects. Often these are virtual objects, but they elicit and shape essentially the same perceptual and action patterns as what we find with concrete objects. What about virtual teachers? We want virtual teachers to be able to speak, gesture, and manipulate the virtual objects and gesture about these actions. Animation software now enables us to create virtual characters that move their hands in ways that look quite naturalistic. The virtual teacher needs a virtual brain, too. State-of-the-art artificial intelligence is now allowing students to receive customized feedback from software as they interact with technology. All these innovations have created an opportunity to design an interactive human-like teacher or “pedagogical agent” that intelligently and responsively supports the mathematical learning of students as they engage in interactive work with virtual objects in a computer interface. A collaborative project of UC Davis (Neff) and UC Berkeley (Abrahamson) is developing and evaluating a pedagogical agent that is inserted into an interactive learning environment, the Mathematical Imagery Trainer.

This video has had approximately 356 visits by 306 visitors from 193 unique locations. It has been played 246 times.
activity map thumbnail Click to See Activity Worldwide
Map reflects activity with this presentation from the NSF 2016 STEM For All Video Showcase website, as well as the STEM For All Multiplex website.
Based on periodically updated Google Analytics data. This is intended to show usage trends but may not capture all activity from every visitor.
Public Discussion
  • Post to the Discussion

    Presenters and Facilitators, please login before contributing to the discussion.



    NOTE: Your email will be kept private and will not be shared with any 3rd parties