Sensory stimulation presentation device, sensory stimulation presentation method, and program

Abstract

This sensory stimulus presentation device includes: a label acquisition unit that acquires a classification label of intellectual work to be performed by a user; and a sound emission unit that emits a first class of sound satisfying a prescribed standard when the acquired classification label indicates a creative task and that emits a second class of sound satisfying a standard different from that of the first class of sound when the acquired classification label indicates a storage task.

Description

[Technical field]

[0001] The present invention relates to a sensory stimulus presentation device, a sensory stimulus presentation method, and a program for presenting a sensory stimulus so as to obtain a desired effect. [Background technology]

[0002] There are conventional technologies that present artificial sensory stimuli such as visual, auditory, and tactile stimuli to encourage continued concentration. For example, Non-Patent Document 1 suggests that presenting a heartbeat-like tactile stimulus slower than the heartbeat may create a sense of calm in tense situations. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Ruben T. Azevedo, Nell Bennett, Andreas Bilicki, Jack Hooper, Fotini Markopoulou and Manos Tsakiris, "The calming effect of a new wearable device during the anticipation of public speech," Sci Rep 7, Article number:2285, 2017. Summary of the Invention [Problem to be solved by the invention]

[0004] When the type and characteristics of the intellectual work performed by a user change, the sensory stimuli that have a positive effect on the user may also change, but the prior art does not take this into consideration.

[0005] Therefore, an object of the present invention is to provide a sensory stimulation presentation device that can provide sensory stimulation from the external environment so as to obtain a desired effect, taking into account the type and characteristics of the intellectual task being performed by the user. [Means for solving the problem]

[0006] The sensory stimulation presentation device of the present invention includes a label acquisition unit and a sound emission unit.

[0007] The label acquisition unit acquires a classification label of an intellectual task to be performed by a user. The sound emission unit emits a first type of sound satisfying a predetermined criterion when the acquired classification label indicates a creativity task, and emits a second type of sound satisfying a criterion different from the first type of sound when the acquired classification label indicates a memory task. Effect of the Invention

[0008] According to the sensory stimulation presentation device of the present invention, it is possible to provide sensory stimulation from the external environment so as to obtain a desired effect, taking into consideration the type and characteristics of the intellectual task to be performed by the user. [Brief description of the drawings]

[0009] [Figure 1] FIG. 2 is a block diagram showing the functional configuration of the sensory stimulus modulation device of the first embodiment. [Diagram 2] 4 is a flowchart showing the operation of the sensory stimulus modulation device of the first embodiment. [Diagram 3] FIG. 1 shows an example of categorizing intellectual work based on the skills required. [Figure 4] FIG. 1 shows an example of a quantitative evaluation of the abilities required for each intellectual task. [Diagram 5] FIG. 4 is a block diagram showing the functional configuration of a sensory stimulation presentation device according to a first modified example. [Figure 6] 13 is a flowchart showing the operation of the sensory stimulation presentation device of the first modification example. [Figure 7] FIG. 11 is a block diagram showing the functional configuration of a sensory stimulation presentation device according to a second modification. [Figure 8] 11 is a flowchart showing the operation of the sensory stimulation presentation device of the second modification example. [Figure 9] FIG. 2 is a diagram showing an example of the functional configuration of a computer. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described in detail. Note that components having the same functions are given the same reference numbers and duplicated explanations will be omitted. EXAMPLES

[0011] The functional configuration of the sensory stimulus modulation device of the first embodiment will be described with reference to Fig. 1. As shown in the figure, the sensory stimulus modulation device 1 of the present embodiment includes a personal pattern extraction unit 11, a modulation parameter estimation unit 12, and a sensory stimulus modulation unit 13. Below, the operation of each component will be described with reference to Fig. 2.

[0012] <Individual pattern extraction unit 11> Input: Subjective assessment value, biosignal y(t), classification label of intellectual task Output: Parameter representing individuality (individuality pattern α) The subjective evaluation value is, for example, the result of answering a preliminary questionnaire. The biological signal is, for example, an electroencephalogram signal, a heart rate, etc. The classification label of the intellectual task is a label indicating the type and characteristics of the intellectual task that the target user is engaged in when using the sensory stimulation modulation device. Figs. 3 and 4 are shown as examples of classification of intellectual tasks. Fig. 3 is a diagram showing an example of categorizing intellectual tasks based on the required ability, and Fig. 4 is a diagram showing an example of quantitative evaluation of the required ability for each intellectual task.

[0013] Processing: The individuality pattern extraction unit 11 receives the subjective assessment value, the biosignal y(t), and the classification label of the intellectual task as input, extracts the individuality pattern α based on a predetermined criterion, and outputs the individuality pattern α (S11). The predetermined criterion corresponds to, for example, the Harman model or the Burtzik model. The individuality pattern is classified mainly based on the results of an individual questionnaire. In addition to the above criteria, an algorithm for classifying the individuality pattern from an electroencephalogram signal, etc. may be used.

[0014] <Modulation parameter estimation unit 12> Input: biosignal y(t), individual pattern α, sensory stimulus x(t), modulation method (modulation method) Output: Modulation parameter β^(t) The modulation parameter estimation unit 12 receives as input the biosignal y(t), the individual pattern α output from the individual pattern extraction unit 11, the sensory stimulus x(t), and the modulation method, and estimates a modulation parameter β^(t) for modulating the sensory stimulus x(t) into an optimal stimulus x^(t) for increasing the concentration of the target user using the specified modulation method (S12).

[0015] The modulation method may be preset in the sensory stimulus modulation device 1. Modulation methods available in this embodiment include, for example, if the sensory stimulus is an audio signal, increasing or decreasing the amplitude value, increasing or decreasing the frequency component (equalizing), amplitude modulation, mixing of some signal (such as noise), and the like, and if the sensory stimulus is a video signal, increasing or decreasing the brightness, increasing or decreasing the frequency component (changing the color), mixing of a noise component, and the like. The available modulation methods are not limited to these, and any method may be used as long as it is capable of modulating the sensory stimulus into an optimal stimulus. The modulation parameter estimation unit 12 outputs the estimated modulation parameter β^(t) to the sensory stimulus modulation unit 13.

[0016] A more detailed description will now be given of the processing of the modulation parameter estimation section 12. First, the modulation parameter estimation section 12 selects from the individual characteristic pattern storage section 10 a model that matches the individual characteristic pattern α output by the individual characteristic pattern extraction section 11.

[0017] Next, the modulation parameter estimation unit 12 estimates the current concentration level from the biosignal y(t) output by the biosignal acquisition unit 11. The modulation parameter estimation unit 12 sequentially estimates an optimal stimulus x^(t) that increases the concentration level, assuming that the current concentration level corresponds to the current stimulus x(t) in the selected model. Finally, the modulation parameter estimation unit 12 sequentially estimates a modulation parameter β^(t) required to obtain an optimal stimulus x^(t) from the current stimulus x(t) in the specified modulation method. That is, the modulation parameter estimation unit 12 estimates β^(t) that satisfies x^(t)=h(x(t), β^(t)). Here, h(·) is a function that changes the stimulus x(t) to the stimulus x^(t) using the parameter β^(t), and a specific function is determined according to the specified modulation method.

[0018] The following table shows examples of functions corresponding to available modulation methods and the parameters required for each. These are just examples, and various modulation methods and their parameters that can modulate audio signals and video signals, which are sensory stimuli, can be used. [Table 1] <Sensory Stimulus Modulation Section 13> Input: sensory stimulus x(t), modulation method, modulation parameter β^(t) Output: Modulated sensory stimulus x^(t) Processing: The sensory stimulus modulation unit 13 receives the sensory stimulus x(t), a modulation method (modulation scheme), and a modulation parameter β^(t), and obtains a modulated sensory stimulus x^(t) by modulating the sensory stimulus x(t) using the modulation parameter β^(t) based on the specified modulation scheme (S13). The sensory stimulus modulation unit 13 presents the modulated sensory stimulus x^(t) so that it can be perceived by the target user.

[0019] When the sensory stimulus x(t) is an environmental sound signal, a sound based on the modulated sensory stimulus x^(t) is output from a sound output unit (not shown) such as a speaker or a headphone that is set at a position and volume that allows the target user to hear it. An example of the sensory stimulus x^(t) to be output is a sensory stimulus based on a binaural beat (Reference Non-Patent Document 1).

[0020] (Reference Non-Patent Document 1: J. Park, H. Kwon, S. Kang and Y. Lee, "The effect of binaural beatbased audiovisual stimulation on brain waves and concentration," 2018 International Conference on Information and Communication Technology Convergence (ICTC), pp. 420-423, 2018.) In addition, when the sensory stimulus x(t) is a landscape video signal, an image based on the modulated sensory stimulus x^(t) is output from a display unit (not shown), such as a display or a head-mounted display installed in a position where the target user can view it.

[0021] <Effects> The sensory stimulation modulating device 1 of this embodiment processes the type of intellectual work in addition to the individual pattern of the target user. As a result, it is expected that the interruption of the concentration state will be reduced and the concentration will be improved even for a combination of a user and a type of intellectual work for which the effect of continuing and improving concentration was low with conventional methods.

[0022] Furthermore, unlike conventional technology, the sensory stimulus modulation device 1 of this embodiment can take into account the type and characteristics of the intellectual work the target user is performing into the target user's individual pattern (a model representing the relationship between concentration level and sensory stimulation).

[0023] <Evaluation experiment> An evaluation experiment was conducted on the relationship between the performance of intellectual tasks and ambient environmental sounds. The purpose of this evaluation experiment was to have subjects engage in two types of intellectual tasks (creativity task, word memory task) while listening to one of eight types of ambient environmental sounds (background noise, vacuum cleaner sound, restaurant ambient sound, train interior ambient sound, office ambient sound, children's voices, river murmuring sound, music (jazz)), and to verify whether the type of ambient environmental sound had any effect on the performance and perception of the tasks.

[0024] The results of the experiment showed that in the creativity task, performance was improved by listening to environmental sounds that occur indoors in everyday life (environmental sounds inside a train, restaurant, office, vacuum cleaner, etc.), while performance was decreased by listening to children's voices, background noise, and music.

[0025] Meanwhile, a different trend from that seen in the creativity task was observed in the word memory task. In the word memory task, listening to ambient sounds with little time-varying tone (background noise, the sound of a babbling river, the sounds inside a train, the sounds of an office, etc.) improved task performance. On the other hand, listening to ambient sounds with a lot of time-varying tone (the sounds of a restaurant, music, children's voices, etc.) decreased task performance.

[0026] <Variation 1> Based on the results of the evaluation experiments described above, a sensory stimulus presentation device 2 according to a first modified example is disclosed, as shown in Fig. 5. As shown in the figure, the sensory stimulus presentation device 2 includes a label acquisition unit 21 and a sound emission unit 22. Hereinafter, the operation of the sensory stimulus presentation device 2 according to this modified example will be described with reference to Fig. 6.

[0027] <Label Acquisition Unit 21> Input: Classification label of intellectual task Output: Classification label of intellectual task Processing: The label acquisition unit 21 acquires a classification label of the intellectual work that the user is to perform (S21).

[0028] <Sound part 22> Input: Classification label of intellectual task Output: First type of sound, or second type of sound Processing: The sound emission unit 22 emits a first type of sound that satisfies a predetermined criterion when the acquired classification label indicates a creativity task, and emits a second type of sound that satisfies a criterion different from the first type of sound when the acquired classification label indicates a memory task (S22). The first type of sound is preferably selected from sounds that satisfy the criterion based on environmental sounds that occur indoors in daily life (e.g., the above-mentioned environmental sounds inside a train, the environmental sounds in a restaurant, the environmental sounds of an office, the sounds of a vacuum cleaner, etc.). The second type of sound is preferably selected from sounds that satisfy the criterion based on ambient environmental sounds with little time-varying tone (e.g., the above-mentioned background noise, the murmuring sounds of a river, the environmental sounds inside a train, the environmental sounds of an office, etc.).

[0029] <Variation 2> A personality pattern storage unit 10 that stores in advance a personality pattern that is a parameter representing individuality may be added to the sensory stimulation presentation device 2 of Modification 1. In detail, as shown in Fig. 7 , the sensory stimulation presentation device 3 of Modification 2 includes a label acquisition unit 21, a sound emitting unit 32, and a personality pattern storage unit 10, and the sound emitting unit 32 modulates and emits a first type of sound for the corresponding user or a second type of sound for the corresponding user based on the personality pattern stored in the personality pattern storage unit 10 (S32).

[0030] <Additional Notes> The device of the present invention has, as a single hardware entity, an input section to which a keyboard or the like can be connected, an output section to which a liquid crystal display or the like can be connected, a communication section to which a communication device (e.g., a communication cable) capable of communicating with the outside of the hardware entity can be connected, a CPU (which may also have a central processing unit, cache memory, registers, etc.), memories such as RAM and ROM, an external storage device such as a hard disk, and buses connecting the input section, output section, communication section, CPU, RAM, ROM, and external storage device so that data can be exchanged between them. If necessary, the hardware entity may also be provided with a device (drive) capable of reading and writing a recording medium such as a CD-ROM. A physical entity equipped with such hardware resources is, for example, a general-purpose computer.

[0031] The external storage device of the hardware entity stores the programs required to realize the above-mentioned functions and the data required in the processing of these programs (not limited to the external storage device, but for example the programs may be stored in a ROM, which is a read-only storage device). Data obtained by the processing of these programs is stored appropriately in the RAM, the external storage device, etc.

[0032] In the hardware entity, each program stored in an external storage device (or ROM, etc.) and the data required to process each program are loaded into memory as necessary, and interpreted, executed, and processed by the CPU as appropriate, so that the CPU realizes a predetermined function (each of the components represented as the above, "units," "means," etc.).

[0033] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the present invention. In addition, the processes described in the above-described embodiment are not limited to being executed in chronological order according to the order described, but may be executed in parallel or individually depending on the processing capacity of the device that executes the processes or as necessary.

[0034] As described above, when the processing functions of the hardware entities (the devices of the present invention) described in the above embodiments are realized by a computer, the processing contents of the functions that the hardware entities should have are described by a program. Then, by executing this program on a computer, the processing functions of the hardware entities are realized on the computer.

[0035] The various processes described above can be implemented by loading a program for executing each step of the above method into the recording unit 10020 of the computer 10000 shown in FIG. 9, and operating the control unit 10010, input unit 10030, output unit 10040, etc.

[0036] The program describing the processing contents can be recorded on a computer-readable recording medium. The computer-readable recording medium may be, for example, a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, or any other suitable medium. Specifically, for example, a hard disk drive, a flexible disk, a magnetic tape, or the like can be used as the magnetic recording device, a DVD (Digital Versatile Disc), a DVD-RAM (Random Access Memory), a CD-ROM (Compact Disc Read Only Memory), a CD-R (Recordable) / RW (ReWritable), or the like can be used as the optical disk, an MO (Magneto-Optical disc), or the like can be used as the magneto-optical recording medium, and an EEP-ROM (Electrically Erasable and Programmable-Read Only Memory) or the like can be used as the semiconductor memory.

[0037] The program may be distributed, for example, by selling, transferring, lending, etc. portable recording media such as DVDs and CD-ROMs on which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of a server computer and transferring the program from the server computer to other computers via a network.

[0038] A computer that executes such a program, for example, first stores the program recorded on a portable recording medium or the program transferred from a server computer in its own storage device. Then, when executing a process, the computer reads the program stored in its own recording medium and executes a process according to the read program. As another execution form of the program, the computer may directly read the program from the portable recording medium and execute a process according to the program, or may execute a process according to the received program each time a program is transferred from the server computer to the computer. The above-mentioned process may be executed by a so-called ASP (Application Service Provider) type service that realizes a processing function only by issuing an execution instruction and obtaining a result, without transferring a program from the server computer to the computer. Note that the program in this embodiment includes information used for processing by an electronic computer and equivalent to a program (data that is not a direct command to the computer but has a nature that specifies the processing of the computer, etc.).

[0039] In addition, in this embodiment, a hardware entity is configured by executing a specific program on a computer, but at least a part of the processing contents may be realized by hardware.

Claims

1. a label acquisition unit for acquiring a classification label of an intellectual task to be performed by a user; a sound emitting unit that, when the acquired classification label indicates a creativity task, modulates a first type of sound that satisfies a predetermined criterion based on the user's subjective evaluation value, the user's biosignal, and a personal pattern of the user extracted based on a label indicating a type and characteristic of the intellectual task the user is working on, and emits the first type of sound, and modulates the second type of sound that satisfies a criterion different from the first type of sound, based on the personal pattern, and emits the second type of sound, when the acquired classification label indicates a memory task, based on the personal pattern, and Sensory stimulation presentation device.

2. The sensory stimulation presentation device according to claim 1 , The first type of sound is a sound that satisfies a standard based on environmental sounds generated indoors in daily life. Sensory stimulation presentation device.

3. The sensory stimulation presentation device according to claim 2, The first type of sound is one of environmental sounds in a train, environmental sounds in a restaurant, environmental sounds in an office, and sounds of a vacuum cleaner. Sensory stimulation presentation device.

4. The sensory stimulation presentation device according to claim 1 , The second type of sound is a sound that satisfies a criterion based on an ambient environmental sound that has little time variation in tone. Sensory stimulation presentation device.

5. The sensory stimulation presentation device according to claim 4, The second type of sound is any one of background noise, the murmuring sound of a river, the environmental sound inside a train, and the environmental sound in an office. Sensory stimulation presentation device.

6. A sensory stimulation presentation method executed by a sensory stimulation presentation device, comprising: a label acquisition step of acquiring a classification label of an intellectual task to be performed by a user; The method includes a sound emission step of modulating a first type of sound that satisfies a predetermined criterion when the acquired classification label indicates a creativity task, based on a personal characteristic pattern of the user extracted based on the subjective evaluation value of the user, the biosignal of the user, and a label indicating a type and characteristics of the intellectual task the user is working on, so as to further increase the current concentration level of the user estimated based on the biosignal, and emitting the sound; and modulating a second type of sound that satisfies a criterion different from the first type of sound, based on the personal characteristic pattern, so as to further increase the current concentration level of the user when the acquired classification label indicates a memory task. Method of presenting sensory stimuli.

7. A program for causing a computer to function as the sensory stimulation presentation device according to any one of claims 1 to 5.

Images