Educational Activities

Graduate School: Human and Environment Informatics Wearable Sensing, Human and Environment Informatics (Development)
Department of Mechanical Engineering: Creative Design Exercise

Research Activities

1. Development of tactile displays using cross-modal effects (2010-):
   We are trying to realize a high quality tactile presentation using only a simple hardware configuration by utilizing the cross-modal effects that occur when multiple sensory stimuli are integrated and interact with each other to create an illusion. In particular, We have confirmed that the cross-modal effect between visual and tactile sensations can be used to present sensations such as the shape, hardness, and impact of objects without the use of a physical tactile presentation device. Recently, we have been developing wind-sensing displays using cross-modal effects [1, 2].
2. Behavior induction and ability expansion using illusions (2016-):
   Our research focuses on the use of cross-modal effects and other illusory effects to induce human behavior and enhance human abilities. In recent years, we have been developing systems to reduce human stress, such as a cushion-type device that presents breathing motions to induce a relaxed, deep breathing by creating the illusion of one's own breathing pace [3,4].
3. Emotion and ability estimation by biometric and behavioral sensing (2017-):
   To prevent and eliminate the accumulation of chronic stress, which can lead to neuropsychiatric disorders, we are researching methods for monitoring the body and mind through daily sensing. We have constructed a model to estimate stress and emotional states during work based on the characteristics of center of gravity sway and key typing during seated work, and proposed a method to estimate current work productivity based on biometric information such as electrocardiogram and pupil diameter [5,6].

Literature

1. Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose:"Modifying Perceived Size of a Handled Object through Hand Image Deformation", Presence: Teleoperators and Virtual Environments, Vol.22 No.3 pp.255–270, Summer 2013.
2. Kenichi Ito, Yuki Ban, Shin'ichi Warisawa: "Manipulating the Perceived Directions of Wind by Visuo-Audio-Haptic Cross-Modal Effects", EuroHaptics, pp.235-243, 2020.
3. Y Ban, H Karasawa, R Fukui, S Warisawa: "Presenting Sense of Loud Vocalization Using Vibratory Stimuli to the Larynx and Auditory Stimuli", Frontiers in Computer Science, 33, 2022
4. Yuki Shimomura, Yuki Ban, Shin'ichi Warisawa: "Development of a Cushion-shaped Device to Induce Respiratory Rhythm and Depth for Enhanced Relaxation and Improved Cognition", Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology, pp. 1-10, 2021
5. Kei Hasegawa, Hikaru Miyamoto, Yuki Ashida, Yuki Ban, Rui Fukui, Masahiro Inazawa, Shin’ichi Warisawa: "Estimation of Affective State Based on Keystroke and Typing Vibration during Computer-Mediated Communication", BIOSIGNALS2021, pp.235-242, 2021.
6. Hu, X., Nakatsuru, S., Ban, Y., Fukui, R. and Warisawa, S.: A Physiology-Based Approach for Estimation of Mental Fatigue Levels With Both High Time Resolution and High Level of Granularity. Informatics in Medicine Unlocked, p.100594, 2021.

Other Activities

Institute of Electrical and Electronics Engineers (IEEE)
The Virtual Reality Society of Japan (VRSJ)

Future Plan

Based on the knowledge of XR, AI, biometric measurement and information processing technologies, human interface and cognitive psychology, we aim to create innovative display technologies that utilize human perception and cognitive characteristics.

Messages to Students

We believe it is important to be able to quickly implement minimal prototypes in order to confirm the possibility of the system we want to realize. We hope that students will experience the joy of actively creating something.

URL

http://www.lhei.k.u-tokyo.ac.jp/