Multisensory human-computer interaction system and multisensory human-computer interaction method

Abstract

This invention provides a multisensory human-computer interaction system and a multisensory human-computer interaction method. [Solution] A multisensory human-computer interaction system comprising an interaction device, a plurality of sensors, and a server, wherein each of the plurality of sensors performs the operation of receiving a plurality of sensing signals from the real environment; the server performs the operation of generating event data corresponding to each of the plurality of sensing signals and representing the situation of the real environment based on the plurality of sensing signals; the server performs the operation of generating a plurality of multisensory relevance data corresponding to the situation based on the plurality of event data; the server performs the operation of determining a sensory feedback result based on the plurality of multisensory relevance data; and the interaction device performs the operation of generating an interaction message for interacting with the user based on the sensory feedback result.

Images