Three-dimensional (3D) somatosensory biofeedback comprehensive relaxing and training system

[0035] The embodiments of the present invention will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary, and are only used to explain the present invention, and cannot be construed as limiting the present invention.

[0036] The embodiment of the present invention proposes a 3D somatosensory biofeedback comprehensive relaxation training system,

[0037] See figure 1 , The multi-channel physiological signal digital acquisition module shown therein is composed of biosensor probes, lead wires, operational amplifier circuits, filter circuits, analog-to-digital conversion circuits, and computer interfaces including Bluetooth, Wifi and other wireless interfaces.

[0038] The physiological parameters include, but are not limited to, heart rate signals, blood oxygen saturation signals, muscle signals, skin signals, brain signals, and the like. Based on cost considerations, the cost of heart rate and blood oxygen saturation signals will be relatively low, which is suitable for users with low accuracy requirements and more cost-sensitive users; muscle signals and skin signals can accurately reflect the relaxed state of the human body, but the cost is slightly higher and suitable Medical-grade equipment; high brain signal accuracy, but high cost, suitable for occasions with particularly high accuracy requirements.

[0039] figure 1 The physiological signal comprehensive analysis and processing module shown is software running on various computer hardware. This module comprehensively analyzes and calculates multi-clock digital signals. The analysis method can be to first take the arithmetic average and mean square error of different signal values ​​within a certain period of time, and then assign weighted values ​​to the different signals to obtain the final reference value representing the relaxed state of the trainee.

[0040] figure 1 The somatosensory interaction device shown includes all devices that control input and output through somatosensory, including but not limited to touch screen, gravity sensor, gyroscope, air mouse, somatosensory joystick, light gun, etc., even based on temperature and pressure Various types of equipment.

[0041] figure 1 The comprehensive training module shown also gathers the information of the physiological signal comprehensive analysis and processing module and the trainee's intentions from the somatosensory interactive device, retrieves the data from the psychology database, and provides the trainees with the most suitable training methods and training content. The training methods include, but are not limited to, psychological measurement evaluation, psychological knowledge learning, music relaxation training, hypnotic relaxation training, 3D biofeedback training, etc. Training methods and training content are comprehensively selected based on the trainee’s historical testing situation, the trainee’s subjective intentions, and a large number of clinical practice results.

[0042] figure 1 The psychology database shown, including but not limited to psychological assessment question bank, psychology knowledge books, expert psychology lecture videos, psychological relaxation therapy music, etc., are all materials that have been validated by a large number of clinical practices by psychologists. figure 1 The 3D material library shown is composed of 3D models of different plot contents divided into small fragments and material materials such as 3D video and audio. figure 1 The seamless 3D player shown is a special audio-visual input and output software, which can accept the scheduling of the comprehensive training module, read the 3D materials in the 3D material library, and integrate the discrete 3D materials into a complete 3D audio-visual The scene is smoothly output to the 3D real sense restoration device. The seamless 3D player prevents the trainees from feeling the flicker or intermittent when switching between different 3D materials that characterize their mental state, avoiding distracting the trainees, interfering with the trainee's thinking, and ensuring the training effect. figure 1 The 3D real sense restoration device shown is to restore the 3D video clips output by the seamless 3D player to the trainees as a device that approximates real vision and hearing and even other tactile experiences, including but not limited to 3D televisions, 3D displays, 3D surround sound systems and even tactile transmission devices such as vibration and scent generators. The 3D real sense restoration equipment greatly enhances the trainee's sense of presence and strengthens the training effect.

[0043] figure 2 Shown is the 3D biofeedback training flowchart of the present invention, describing how the system integrates the different functions of each module to provide effective biofeedback training.

[0044] Such as figure 2 In the process shown, before each formal biofeedback training, there will be a preparation stage. The purpose of this preparation stage is to collect the basic data of the current trainees for later formal training reference. In this preparation phase, the training system will first play a pre-recorded guide 3D material to the trainee, which lasts about 3 minutes, and collect the trainee's physiological data. After guiding the 3D material, the system will determine a basic value based on the collected data, and then ask the trainer to enter a target value for the trainee. The basic value represents the current psychophysiological state of the trainee, and the target value represents the state hoped to be achieved after training.

[0045] After collecting the basic value and target value, the system enters the formal training phase.

[0046] Such as figure 2 In the process shown, the training system starts to continuously play the training 3D material content, and at the same time collects the physiological data of the trainee. Whenever a scene stage is reached (generally set to 30 seconds), a stage value is determined. The value of this stage represents the training result of the trainee at this stage. The training system compares the relationship between the value of this stage and the basic value and target value through a certain algorithm, and judges whether the value of this stage can reach the stage goal, and the training result is effective and ineffective. According to the result of the judgment, the 3D material representing success or failure is seamlessly played to the trainee, and the training is continued, and the loop is repeated.

[0047] When the training time reaches the set duration, the training will enter the end phase. At this stage, some relaxing 3D materials are played to the trainees, and a test result report is given to the testees or training guides. So far the biofeedback training is over.

[0048] image 3 Shown is one of the implementations of a seamless 3D player. This implementation is composed of a controller, two players, and a material resource library. The controller coordinates the interactive operation of two players at the same time, effectively avoiding flickering or intermittent switching of materials.

[0049] Such as image 3 In the sequence shown, when the first piece of 3D material needs to be played, the controller sends a cache instruction to player A, and player A then reads the material from the material resource library and caches it. After the buffer is over, the controller controls the player A to play. When the first segment of 3D material is about to end, Player A informs the controller. After the controller receives the notification, it sends an instruction to the player B to cache the second piece of 3D material. The player B then reads the material from the material resource library and caches it, and notifies the controller when the cache is completed. After the controller determines that the buffering is complete, when Player A informs it that the first segment of 3D material has been played, it transfers Player B to the foreground to play material 2, and then hides Player A. At this time, the material at both ends can be seamlessly connected. . When the playback of the second piece of 3D material is about to end, the controller uses the same scheduling method to let Player A take over from Player B and seamlessly play the third piece of 3D material, looping in turn until the end of the training.

[0050] In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean specific features described in conjunction with the embodiment or example , Structure, materials or features are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics may be combined in any one or more embodiments or examples in a suitable manner.

[0051] Although the embodiments of the present invention have been shown and described, those of ordinary skill in the art can understand that various changes, modifications, and substitutions can be made to these embodiments without departing from the principle and spirit of the present invention. And variations, the scope of the present invention is defined by the appended claims and their equivalents.