Multi-sensory data recording system

Abstract

The invention discloses a multi-sensory data recording system. The system at least comprises a computer; an auditory test device connected with the computer and configured to generate an audio signal; the sound production device is connected with the auditory test equipment and is configured to transmit an audio signal to the ears of the subject; the host is connected with the computer and the auditory test equipment and is configured to generate a character signal according to the audio signal; the tablet computer is connected with the host and is configured to display character information and allow a subject to respond and control; and the first acquisition device is connected with the host and is configured to acquire actions and vision of the response process of the subject. The system at least can simultaneously collect data such as gestures, vision, hearing and the like and related data and record the data, stimulate by using one signal and simultaneously obtain response data in aspects such as gesture actions, vision, hearing and the like, and integrate and analyze the data to judge the consciousness of a subject or the demand of the subject on the signal, so that the accuracy of the system is improved. And finally obtaining multi-sensory data.

Description

technical field [0001] The invention relates to the field of hearing equipment, in particular to a multi-sensory data recording system. Background technique [0002] Human beings sometimes dance to songs, talk to themselves, express thoughts with gestures, and so on. Analysis of human multisensory data can understand the consciousness and attention of some people. [0003] For example: when seeing the shape of food, humans usually make a variety of behavioral responses, including physical, visual, auditory, etc., these different sensory responses are related, and collecting different sensory response information can be used in multiple Domain applications, such as skill training, language learning, recognition ability training, etc., can also be used for machine learning. [0004] However, most of the current devices for collecting sensory responses or sensory data are relatively simple, and can only collect or record data from a single sensory. This kind of data has low r...

AI Technical Summary

Problems solved by technology

[0004] However, most of the current devices for collecting sensory responses or sensory data are relatively single, and can only collect or record data from a single sense. This kind of data has low reference value and cannot meet the applications in the above fields.

Images