Abstract:

We proposed Paper-Top Interface (PTI), the fusion of paper and digital material, and developed a PTI system for classroom education [1]. The PTI system, which uses a visual-marker-based AR (Augmented Reality) technology and projects a digital learning material onto the corresponding page of a notebook, supports note-taking in a class. This is because students can write with their favorite writing materials (e.g., pencils and colored ink pens), viewing the learning material projected onto the notebook.
Currently, however, the PTI system does not have adaptive support for the students and is not enough to increase their understanding. Thus, we are designing the adaptive support.

In the PTI system, a different visual marker is pasted (or printed) on every page of a notebook beforehand―one learning material corresponds to one page. The system constantly observes whether a student hides (covers) the visual marker. If recognizing the marker hidden, the system changes the current state in predefined states or activates one of prepared functions. The predefined states are associated with the options in a single-choice quiz, which is superimposed on the projected material. The system enables the student to select an option (his/her answer) of the quiz by hiding the marker. An example of the prepared functions is to bookmark the current page with an attribute such as “important”, “interesting”, etc.

One of our ideas for the adaptive support is to change the order of digital learning materials based on a student’s knowledge level represented as his/her status of correct and incorrect answers to the quizzes. For example, if the student answered a quiz incorrectly, the system inserts digital learning materials about the fundamentals into the subsequent pages. Another idea is to change the visual effect of digital learning materials based on a student’s impression represented as his/her attribute to the bookmarked material. For example, if the student bookmarked a page with the attribute of “important”, the system highlights the subsequent pages related with the bookmarked page using annotation (e.g., “The currently projected material is about an advanced topic of the material you thought important.”) These adaptive supports are expected to increase students’ understanding.

The paper we are going to submit will schematically illustrate the PTI system and describe the ideas of the adaptive support.

References:
[1] Mitsuhara, H., Moriyama, T., and Yano, Y., 2010. Paper-top Interface for Supporting Note-taking and its Preliminary Experiment, Proc. of the 2010 IEEE International Conference on Systems, Man, and Cybernetics, pp.3456-3462.

Keywords:

Adaptive support (adaptation), digital learning material, Human-computer interaction.