Japan Society for the Promotion of Science:Grants-in-Aid for Scientific Research
Date (from‐to) : 2004 -2007
Author : NAKAKOJI Kumiyo; YAMAMOTO Yasuhiro; YAMADA Kazuaki; KOIKE Yasuharu; SATO Himko
The goal of this research is to construct the human-centered media interaction environment that supports people to create and reconstruct knowledge when collect, analyze, and share a large amount of data, such as scientific data, marketing data, or video data. While existing simulation and visualization approaches have mainly focused on the presentation of such data, our approach is unique by focusing on people's incremental knowledge processes when interacting with the data. We have developed a framework for the human-centered media interaction environment that consists of three subsystems : a system for knowledge creation, one for manipulation, and one for representation. We have applied the framework in three domains : predicting chemical reaction, analyzing temporal numerical data, and analyzing video data.
The results of this research projects include that we have developed a interaction model that uses a two-dimensional representation to help people express knowledge in linear, networked, and hierarchical structures, that we have developed an innovative tele-kinesthetic interaction model that uses EMG signals and a 3D physical object as a display, that we have explored visual and auditory media as a representation for creative knowledge work, that we have developed an open-source software library that is specifically dedicated to support molecular visualization and manipulation, that we have constructed an interaction history framework, which is a general framework to interact with temporal data, and that we have built a theoretical framework for active watching (i.e., a knowledge-intensive activity where an analyst interacts with video data) and built interaction primitives based on the framework.