Reproduction system, reproduction method, and program

Abstract

A content reproduction system (1) that guides a user's emotion from a first emotion to a second emotion is provided with: an acquisition unit (101) that acquires first content corresponding to the first emotion and second content corresponding to the second emotion; and a reproduction unit (103) that reproduces, by means of the speaker (15), first content together with first non-audible sound corresponding to the first content, and then reproduces second content together with second non-audible sound corresponding to the second content, the first non-audible sound being obtained by amplifying a base signal of the first non-audible sound at a first amplification factor, and the second non-audible sound being obtained by amplifying a base signal of the second non-audible sound at a second amplification factor. The first non-audible sound is obtained by amplifying a base signal of the first non-audible sound at a first amplification factor, the second non-audible sound is obtained by amplifying a base signal of the second non-audible sound at a second amplification factor, and the reproduction unit (103) gradually reduces the first amplification factor of the first non-audible sound being reproduced during reproduction of the first content and gradually increases the second amplification factor of the second non-audible sound being reproduced during reproduction of the second content.

Description

Technical Field

[0001] The present disclosure relates to a reproduction system, a reproduction method, and a program. Background Art

[0002] There is a technology for controlling the reproduction of inaudible sound included in audio sound according to whether the driver needs to concentrate on driving the vehicle (for example, see Patent Document 1).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2019-6191

[0006] Non-patent literature

[0007] Non-patent document 1: Junichiro Hayano, "Emotional Spectrum Estimation Based on Biosignals", [online], October 3, 2017, Health / Medical New Technology Briefing, Science and Technology Agency, [retrieved on August 29, 2022], Internet,<URL:https: / / shingi.jst.go.jp / list / list_2017 / 2017_3chubu.html#20171003X-008>

[0008] Non-patent document 2: Takeda Kaori, "The influence of negative emotions (anger, depression, anxiety) tendency on blood pressure", [online], March 31, 2011, Bulletin of Nayoro City University (2007.3+) Vol. 5, [retrieved on August 29, 2022], Internet,<URL:http: / / id.nii.ac.jp / 1088 / 00000025 / > Summary of the invention

[0009] Problems to be solved by the invention

[0010] An object of the present disclosure is to provide a reproduction system, a reproduction method, and a program for appropriately guiding a user's emotions by reproduction of non-audible sounds.

[0011] Means used to solve problems

[0012] The reproduction system disclosed in the present invention is a content reproduction system that guides the user's emotion from a first emotion to a second emotion, and comprises: an acquisition unit that acquires a first content corresponding to the above-mentioned first emotion and a second content corresponding to the above-mentioned second emotion; and a reproduction unit that, through a speaker, (a) reproduces the above-mentioned first content together with a first inaudible sound corresponding to the above-mentioned first content, and (b) reproduces the above-mentioned second content together with a second inaudible sound corresponding to the above-mentioned second content, wherein the above-mentioned first inaudible sound is obtained by amplifying the basic signal of the above-mentioned first inaudible sound at a first amplification factor, and the above-mentioned second inaudible sound is obtained by amplifying the basic signal of the above-mentioned second inaudible sound at a second amplification factor; the above-mentioned reproduction unit gradually reduces the above-mentioned first amplification factor of the above-mentioned first inaudible sound being reproduced during the reproduction of the above-mentioned first content; and gradually increases the above-mentioned second amplification factor of the above-mentioned second inaudible sound being reproduced during the reproduction of the above-mentioned second content.

[0013] Effects of the Invention

[0014] The reproduction system of the present disclosure can appropriately guide the user's emotions by using the reproduction of non-audible sounds. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is an illustration showing human emotions and the guidance of emotions.

[0016] Figure 2 This is a block diagram showing the structure of a reproduction system according to an embodiment.

[0017] Figure 3 This is a block diagram showing the structure of the reproduction unit of the embodiment.

[0018] Figure 4 It is an explanatory diagram showing the reproduction of content by the reproduction unit according to the embodiment.

[0019] Figure 5 It is an explanatory diagram showing a first example of transition of the magnification factor according to the embodiment.

[0020] Figure 6 It is an explanatory diagram showing a second example of transition of the magnification factor according to the embodiment.

[0021] Figure 7 It is an explanatory diagram showing a third example of transition of the magnification factor according to the embodiment.

[0022] Figure 8 This is a flowchart showing a first example of processing of the reproduction system according to the embodiment.

[0023] Fig. 9 It is an explanatory diagram showing a fourth example of transition of the magnification factor according to the embodiment.

[0024] Fig.10It is an explanatory diagram showing a fifth example of transition of the magnification factor according to the embodiment.

[0025] Fig.11 This is a flowchart showing a second example of the processing of the reproduction system according to the embodiment.

[0026] Fig.12 It is an explanatory diagram showing target transition according to a modification example of the embodiment.

[0027] Fig.13 This is a flowchart showing the processing of the reproduction system according to a modified example of the embodiment.

[0028] Fig.14 This is an explanatory diagram showing an example of the transition of emotions in a modified example of the implementation method.

[0029] Fig.15 It is an explanatory diagram showing an example of transition of the magnification factor according to a modification of the embodiment. DETAILED DESCRIPTION

[0030] (Understanding that is the basis of the present disclosure)

[0031] The present inventors have discovered that the following problems may occur with respect to the technology related to reproduction of inaudible sound described in the “Background Art” column.

[0032] In the above technology, it is assumed that the audio sound of the content contains audible sound and inaudible sound. And by switching whether to apply or not to apply a filter that removes inaudible sound from the audio sound, it is switched whether to output audible sound and inaudible sound or only audible sound. It is known that inaudible sound has the effect of activating the brain of a person who perceives the inaudible sound.

[0033] Thus, when the driver should concentrate on driving the vehicle, the driver can be made to perceive the audible sound and the inaudible sound, which helps the driver to concentrate on driving. In addition, when the driver does not need to concentrate on driving, the driver can be made to perceive only the audible sound, which helps the driver to relax and enjoy the audio. In this way, in the above technology, the driver's emotions are guided.

[0034] On the other hand, there is a principle called the "homogeneity principle" regarding the guidance of human emotions. According to the homogeneity principle, people can further enhance their emotions by listening to music that corresponds to their emotions. "Music that corresponds to emotions" refers to music that brings the same impression as the emotion.

[0035] For example, when a person is relaxed, by listening to music corresponding to the relaxed emotion, the relaxed emotion can be enhanced. When a person is in an excited state, by listening to music corresponding to the excited emotion, the excited emotion can be enhanced.

[0036] Therefore, the inventor of the present application has thought that when guiding a person's emotions, by first making the person listen to music corresponding to the person's current (i.e., before guidance) emotions, and then listening to music corresponding to the target emotion to be guided, it is possible to guide the person's emotions more appropriately. In addition, it is thought that when guiding emotions, by reproducing inaudible sounds and appropriately controlling the strength of the sound pressure of the reproduced inaudible sounds, the strength of the person's emotions can be controlled, and it is possible to guide the person's emotions more appropriately.

[0037] Hereinafter, inventions obtained based on the disclosure of this specification will be exemplified, and effects etc. obtained based on the invention will be described.

[0038] (1) A reproduction system is a content reproduction system that guides a user's emotion from a first emotion to a second emotion, comprising: an acquisition unit that acquires first content corresponding to the first emotion and second content corresponding to the second emotion; and a reproduction unit that, through a speaker, (a) reproduces the first content together with a first inaudible sound corresponding to the first content, and (b) reproduces the second content together with a second inaudible sound corresponding to the second content, wherein the first inaudible sound is obtained by amplifying a basic signal of the first inaudible sound at a first amplification factor, and the second inaudible sound is obtained by amplifying a basic signal of the second inaudible sound at a second amplification factor; the reproduction unit gradually reduces the first amplification factor of the first inaudible sound being reproduced during the reproduction of the first content; and gradually increases the second amplification factor of the second inaudible sound being reproduced during the reproduction of the second content.

[0039] According to the above technical solution, the reproduction system guides the user's emotion to the target emotion based on the homogeneity principle by causing the user to perceive the first content that gives the same impression as the user's emotion (first emotion) before the guidance together with the non-audible sound, and then causing the user to perceive the second content that gives the same impression as the target emotion together with the non-audible sound. And, after the intensity of the user's emotion before the guidance is weakened by gradually reducing the amplification rate of the non-audible sound in the reproduction of the first content, the intensity of the user's target emotion is enhanced by gradually increasing the amplification rate of the non-audible sound in the reproduction of the second content. In this way, the reproduction system can appropriately guide the user's emotion by using the reproduction of non-audible sound.

[0040] (2) In the reproduction system described in (1), the reproduction unit sets the first amplification ratio to 0 at the end time of reproduction of the first content, and sets the second amplification ratio to 0 at the start time of reproduction of the second content.

[0041] According to the above technical solution, the reproduction system sets the amplification rate of the inaudible sound to 0 at the timing of switching the content to be reproduced, so it is helpful to switch the content at the timing when the intensity of the user's emotion before guidance is the weakest, and then gradually strengthen the target emotion. Therefore, the reproduction system can more appropriately guide the user's emotion by reproducing the inaudible sound.

[0042] (3) In the reproduction system described in (1) or (2), the reproduction unit, in the reproduction of the first content, maintains the first amplification factor of the first inaudible sound being reproduced at the first value in a first section from the beginning of the first content to the end of a chorus portion included in the first content; and gradually reduces the first amplification factor of the first inaudible sound being reproduced from the first value in a section later than the first section; and in the reproduction of the second content, the reproduction unit maintains the second amplification factor of the second inaudible sound being reproduced at the second value in a second section from the beginning of a chorus portion included in the second content to the end of the second content; and gradually increases the second amplification factor of the second inaudible sound being reproduced toward the second value in a section earlier than the second section.

[0043] According to the above technical solution, the reproduction system can further increase the intensity of the user's emotion before guidance when the user perceives the chorus part of the first content, and further increase the intensity of the user's target emotion when the user perceives the chorus part of the second content. Therefore, the reproduction system can guide the user's emotion more appropriately.

[0044] (4) In the reproduction system described in any one of (1) to (3), when the reproduction unit gradually reduces the first amplification rate during the reproduction of the first content, the first amplification rate is linearly reduced relative to time; and when the reproduction unit gradually increases the second amplification rate during the reproduction of the second content, the second amplification rate is linearly increased relative to time.

[0045] According to the above technical solution, the reproduction system can reduce or increase the amplification rate of the inaudible sound by a relatively simple process of reducing or increasing the amplification rate of the inaudible sound linearly with respect to time. Therefore, the reproduction system can appropriately guide the user's emotions by using the reproduction of inaudible sound through a relatively simple process.

[0046] (5) In the reproduction system described in any one of (1) to (3), when the reproduction unit gradually reduces the first amplification rate during the reproduction of the first content, the first amplification rate is reduced by an exponential function relative to time; and when the reproduction unit gradually increases the second amplification rate during the reproduction of the second content, the second amplification rate is increased by an exponential function relative to time.

[0047] According to the above technical solution, the reproduction system reduces or increases the amplification rate of the inaudible sound with respect to time in an exponential function, so that the user can feel the strength of the inaudible sound close to the strength of the sound perceived by humans, in other words, can feel the strength of the inaudible sound that is natural to humans. As a result, the reproduction system can use the appropriate strength of the inaudible sound and use the reproduction of the inaudible sound to appropriately guide the user's emotions.

[0048] (6) A reproduction system as described in any one of (1) to (5), wherein the reproduction system further comprises a recognition unit, which recognizes the emotion of the user when the reproduction unit reproduces the first content or the second content, and when the emotion recognized by the recognition unit deviates from a predetermined transition, the reproduction unit adjusts the first amplification factor of the first inaudible sound being reproduced so that the emotion of the user approaches the predetermined transition.

[0049] According to the above technical solution, when the user's emotion during the reproduction of the content shows a transition different from the preset transition, the reproduction system can make the transition close to the preset transition. Therefore, the reproduction system can more appropriately guide the user's emotion by reproducing the inaudible sound.

[0050] (7) In the reproduction system as described in any one of (1) to (5), the reproduction system further includes a recognition unit that recognizes the emotion of the user when the reproduction unit reproduces the first content or the second content, and the reproduction unit sets the amplification factor of the first inaudible sound being reproduced to 0 when the emotion recognized by the recognition unit deviates from a predetermined transition.

[0051] According to the above technical solution, when the user's emotion presentation during the reproduction of the content changes from a preset change, the reproduction system stops the reproduction of the inaudible sound, thereby helping to suppress the adverse effects on the user. Therefore, the reproduction system can guide the user's emotion more appropriately by using the reproduction of the inaudible sound.

[0052] (8) In the playback system according to any one of (1) to (7), the playback unit starts playback of the second content at the time when playback of the first content is finished.

[0053] According to the above technical solution, the reproduction system can easily guide the user's emotions by continuously reproducing the first content and the second content. The reproduction system can more easily and appropriately guide the user's emotions by reproducing non-audible sounds.

[0054] (9) A reproduction system as described in any one of (1) to (8), wherein the reproduction system guides the emotion of the user from the first emotion to the second emotion via one or more third emotions, the acquisition unit acquires one or more third contents, and the one or more third contents are third contents corresponding to the one or more third emotions respectively. The reproduction unit, after finishing the reproduction of the first content, sequentially reproduces the third contents together with third non-audible sounds corresponding to the one or more third contents respectively, and starts the reproduction of the second content at the time when the reproduction of the one or more third contents is finished. In the reproduction of each of the one or more third contents, the third amplification factor of the third non-audible sound being reproduced is gradually increased and then gradually reduced.

[0055] According to the above technical solution, the reproduction system can easily induce the user's emotions by continuously reproducing the first content, the third content, and the second content in this order. The reproduction system can more easily and appropriately induce the user's emotions by reproducing inaudible sounds.

[0056] (10) In the playback system described in (9), the playback unit sets the third amplification factor to 0 at a start time and an end time of playback of the one or more third contents.

[0057] According to the above technical solution, the reproduction system sets the amplification rate of the inaudible sound to 0 at the timing of switching the content to be reproduced, so it is helpful to switch the content at the timing when the intensity of the user's emotion before guidance is the weakest, and then gradually strengthen the target emotion. Therefore, the reproduction system can more appropriately guide the user's emotion by reproducing the inaudible sound.

[0058] (11) In the reproduction system described in (9) or (10), the reproduction unit maintains the third amplification factor of the third inaudible sound being reproduced at a third value in a third interval including the beginning to the end of the chorus portion of the third content during the reproduction of each of the one or more third contents; gradually increases the third amplification factor of the third inaudible sound being reproduced toward the third value in an interval before the third interval; and gradually decreases the third amplification factor of the third inaudible sound being reproduced from the third value in an interval after the third interval.

[0059] According to the above technical solution, the reproduction system can further enhance the intensity of the user's intermediate emotion when the user perceives the chorus part of the third content. Therefore, the reproduction system can more appropriately guide the user's emotion through the intermediate emotion.

[0060] (12) A reproduction system as described in any one of (1) to (11), wherein the reproduction system further comprises a selection unit which selects the first content corresponding to the first emotion and the second content corresponding to the second emotion from a plurality of contents, and the acquisition unit acquires the first content and the second content selected by the selection unit.

[0061] According to the above technical solution, the reproduction system can appropriately select the first content and the second content corresponding to the user's emotion before guidance and the target emotion, respectively, and guide the user's emotion using the selected first content and the second content. Therefore, the reproduction system can appropriately guide the user's emotion using appropriate content and the reproduction of non-audible sound corresponding to the content.

[0062] (13) A reproduction method is a reproduction method executed by one or more computers in a reproduction system for guiding a user's emotion from a first emotion to a second emotion, wherein a first content corresponding to the first emotion and a second content corresponding to the second emotion are obtained; and through a speaker, (a) the first content is reproduced together with a first inaudible sound corresponding to the first content, and (b) the second content is reproduced together with a second inaudible sound corresponding to the second content, wherein the first inaudible sound is obtained by amplifying a basic signal of the first inaudible sound at a first amplification factor, and the second inaudible sound is obtained by amplifying a basic signal of the second inaudible sound at a second amplification factor; in the reproduction of the first content, the first amplification factor of the first inaudible sound being reproduced is gradually reduced; and in the reproduction of the second content, the second amplification factor of the second inaudible sound being reproduced is gradually increased.

[0063] According to the above technical solution, the same effect as the above reproduction system is achieved.

[0064] (14) A program causing a computer to execute the reproduction method described in (13).

[0065] According to the above technical solution, the same effect as the above reproduction system is achieved.

[0066] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings as appropriate. However, sometimes the necessary detailed description is omitted. For example, sometimes the detailed description of the well-known matters or the repeated description of the substantially same structure is omitted. This is to avoid the following description from becoming unnecessarily lengthy and to facilitate the understanding of those skilled in the art.

[0067] In addition, the inventor(s) provide the drawings and the following descriptions in order to enable those skilled in the art to fully understand the present disclosure, and the subject matter described in the claims is not limited by them.

[0068] (Implementation Method)

[0069] In the present embodiment, a reproduction system for appropriately guiding the user's emotions by reproducing inaudible sounds will be described.

[0070] First, refer to Figure 1 Explain human emotions.

[0071] Figure 1 This is an explanatory diagram that shows human emotions and changes (also called transitions) in human emotions.

[0072] exist Figure 1 , a diagram showing multiple human emotions (eg, tension, joy, and relaxation) arranged in a circular shape. Figure 1 It is also commonly referred to as Russell's emotional circle model.

[0073] like Figure 1 As shown, it is known that human emotions are arranged on a two-dimensional plane consisting of a pleasant and unpleasant axis (horizontal axis) and an awake and sleepy axis (vertical axis). In addition, the so-called emotion can include concepts such as feelings, moods, psychological states or emotions.

[0074] The changes in people's emotions Figure 1 In the process of emotion, it is shown as a movement from a position corresponding to one emotion to a position corresponding to another emotion. The process of causing a person's emotion to change is also called guiding emotion.

[0075] For example, when guiding a person's emotion from tension to relaxation, one of a plurality of paths can be taken. The paths from tension to relaxation include, for example, paths P and Q. Path P is a path that directly (i.e., not via other emotions) changes from tension to relaxation. Path Q is a path that changes from tension to relaxation via the emotion of joy, which is an example of other emotions. When the distance between the emotion of the person before being guided and the emotion of the person after being guided is relatively large, it is appropriate to guide the emotion via other emotions.

[0076] The reproduction system 1 according to the present embodiment helps to appropriately guide the user's emotion toward the target emotion along an arbitrary path.

[0077] [1.Structure]

[0078] Figure 2 It is a block diagram showing the structure of the reproduction system 1 according to this embodiment.

[0079] The reproduction system 1 is an information processing system that guides the user's emotion from the emotion before being guided (also referred to as the emotion before guidance or the first emotion) to the target emotion (also referred to as the target emotion or the second emotion).

[0080] like Figure 2As shown, the reproduction system 1 includes a terminal 10 and a server 20. The terminal 10 and the server 20 are connected via a network N. The network N may be composed of any communication line or network, such as the Internet, a mobile phone carrier network, an Internet provider's access network, or a public access network.

[0081] The terminal 10 is an information processing terminal that outputs sound related to the content so that the user can perceive it. The terminal 10 may be, for example, a smartphone, a tablet computer, a personal computer, or the like.

[0082] like Figure 2 As shown, the terminal 10 includes an input IF 11 , a sensor 12 , a communication IF 13 , a processor 14 , and a speaker 15 .

[0083] Input IF11 receives input of information from the user. The information received by input IF11 includes a target emotion (e.g., relaxation). The information received by input IF11 may also include an emotion (also called an intermediate emotion) that is passed through in order to guide the user's emotion from the emotion before guidance to the target emotion. In the case where the reproduction system 1 guides the user's emotion from the emotion before guidance to the target emotion via the intermediate emotion, the information received by input IF11 needs to include the intermediate emotion (e.g., joy). In addition, the intermediate emotion may be one or more than two.

[0084] The input IF11 is, for example, a touch interface, a keyboard, a mouse, or a microphone. When the input IF11 includes a touch interface, a keyboard, or a mouse, the input IF11 receives information through key operations, clicks, taps, etc. When the input IF11 includes a microphone, the input IF11 receives input of the above information by performing voice recognition processing on the user's voice received by the microphone.

[0085] The sensor 12 senses a physical quantity related to the user's biological body and generates information related to the biological body (also referred to as biological information). The sensor 12 provides the generated biological information to the processor 14 (more specifically, the recognition unit 102).

[0086] The sensor 12 is, for example, a camera, a body temperature sensor, a heart rate sensor, or a blood pressure sensor. The camera captures the user's face to obtain an image (also called a facial image) reflecting the user's face, and provides the image to the processor 14 as biometric information.

[0087] The sensor 12 may be provided on a device external to the terminal 10. In this case, the device is communicably connected to the terminal 10, and the sensor 12 transmits the biological information to the terminal 10 via communication. The device may be, for example, a wristband device worn on the wrist of the user.

[0088] The communication IF 13 is a communication interface capable of communicating with the server 20 via the network N. The communication IF 13 may be a wireless LAN (Local Area Network) interface such as Wi-Fi (registered trademark) or a wired LAN interface such as Ethernet (registered trademark).

[0089] The processor 14 executes a predetermined program using a memory (not shown) to realize the software functions of the terminal 10. The software functions realized by the processor 14 will be described later.

[0090] The speaker 15 outputs sound. The sound output by the speaker 15 includes not only audible sound but also inaudible sound. Audible sound is a sound in a frequency band that humans can perceive, and is generally a sound included in the range of 20 Hz to 20 kHz. Inaudible sound is a sound in a frequency band that humans cannot perceive, and is a sound included in a range other than the frequency range of audible sound. Here, sound having a frequency higher than the frequency range of audible sound (high-frequency inaudible sound) is referred to as inaudible sound.

[0091] The speaker 15 outputs sound based on waveform data (also simply referred to as waveform data) of the amplitude of sound pressure supplied from the processor 14 (more specifically, the reproduction unit 103 ).

[0092] In addition, the terminal 10 may include an output IF instead of the speaker 15. In this case, the output IF is connected to an external speaker, and the waveform data is output to the external speaker to output sound.

[0093] The following describes the acquisition unit 101 , the identification unit 102 , and the reproduction unit 103 , which are functional units implemented by the processor 14 executing a predetermined program using a memory (not shown).

[0094] The recognition unit 102 recognizes the user's emotion. The recognition unit 102 recognizes the user's emotion using the user's biological information provided by the sensor 12. The recognition unit 102 recognizes the user's emotion before guidance (in other words, before the content is reproduced). In addition, the recognition unit 102 may also recognize the user's emotion during guidance (in other words, when the content is reproduced).

[0095] For example, the recognition unit 102 recognizes the user's emotion by analyzing the user's expression based on the user's facial image acquired by the camera as the sensor 12. For recognizing the user's emotion, a well-known emotion recognition technology can be used.

[0096] In addition, for example, the recognition unit 102 recognizes the emotion of the user based on the body temperature measured by the body temperature sensor as the sensor 12. In this case, the recognition unit 102 can recognize the emotion of the user based on the measured body temperature using the well-known correspondence between human emotion and body temperature. As a well-known correspondence between human emotion and body temperature, for example, there is a correspondence between a relatively high body temperature and an emotion of happiness or anger, and a relatively low body temperature and an emotion of sadness or depression.

[0097] In addition, for example, the recognition unit 102 recognizes the user's emotion based on the heart rate variation measured by the heart rate sensor as the sensor 12. In this case, the recognition unit 102 can use the well-known correspondence between human emotions and heart rate variations to recognize the user's emotion based on the measured heart rate variations. For example, the well-known correspondence between human emotions and heart rate variations is shown in non-patent document 1. For example, there is a known technology that allows a person who has emotions such as joy, worry, surprise, sadness, or anger to see characteristic heart rate variations corresponding to the emotions they have.

[0098] In addition, for example, the recognition unit 102 recognizes the user's emotion based on the blood pressure measured by the blood pressure sensor as the sensor 12. In this case, the recognition unit 102 can use the well-known correspondence between human emotions and blood pressure to recognize the user's emotion based on the measured blood pressure. For example, the well-known correspondence between human emotions and blood pressure is shown in non-patent document 2. For example, an increase in blood pressure corresponds to an emotion of anger, and a decrease in blood pressure corresponds to an emotion of relaxation.

[0099] The acquisition unit 101 acquires content used for guiding the user's emotions. The content acquired by the acquisition unit 101 is content including at least sound, such as music, and this case is used as an example for description. In addition, the content acquired by the acquisition unit 101 may also include video together with sound.

[0100] Specifically, the acquisition unit 101 acquires the first content corresponding to the emotion before guidance and the second content corresponding to the target emotion from the server 20 via the communication IFs 13 and 21 and the network N. The acquisition unit 101 converts the acquired first content and second content into waveform data (also referred to as waveform data of a sound source), respectively, and provides them to the reproduction unit 103.

[0101] In order to obtain the first content and the second content from the server 20, the acquisition unit 101 provides the user's emotion before guidance and the target emotion to the server 20 via the communication IFs 13 and 21 and the network N. The first content and the second content obtained by the acquisition unit 101 are contents selected by the server 20 (more specifically, the selection unit 201 described later) as contents corresponding to the emotion before guidance and the target emotion, respectively. The emotion before guidance is the emotion of the user obtained by the sensor 12 and the recognition unit 102 before the reproduction unit 103 reproduces the first content. The target emotion is the target emotion input to the input IF 11.

[0102] In addition, when the reproduction system 1 guides the user's emotion directly from the emotion before guidance to the target emotion, the acquisition unit 101 obtains the first content and the second content as described above. When the reproduction system 1 guides the user's emotion from the emotion before guidance to the target emotion via the intermediate emotion, the acquisition unit 101 obtains the third content corresponding to the intermediate emotion in addition to the first content and the second content. In order for the acquisition unit 101 to obtain the third content from the server 20, the intermediate emotion may also be provided to the server 20. The intermediate emotion may be generated by the terminal 10 using the emotion before guidance and the target emotion, for example.

[0103] The reproduction unit 103 reproduces the first content and the second content provided by the acquisition unit 101 in sequence through the speaker 15. The reproduction unit 103 first reproduces the first content together with the inaudible sound corresponding to the first content (also referred to as the first inaudible sound), and then reproduces the second content together with the inaudible sound corresponding to the second content (also referred to as the second inaudible sound). The first inaudible sound is the inaudible sound obtained by amplifying the basic signal of the first inaudible sound, and the second inaudible sound is the inaudible sound obtained by amplifying the basic signal of the second inaudible sound. The amplification factor of the first inaudible sound is also referred to as the first amplification factor, and the amplification factor of the second inaudible sound is also referred to as the second amplification factor. The reproduction unit 103 gradually reduces the first amplification factor of the first inaudible sound being reproduced during the reproduction of the first content, and gradually increases the second amplification factor of the second inaudible sound being reproduced during the reproduction of the second content. The basic signal will be described in detail later.

[0104] The reproduction unit 103 may include a period during which the first amplification factor of the first inaudible sound being reproduced is maintained when reproducing the first content. The reproduction unit 103 may include a period during which the second amplification factor of the second inaudible sound being reproduced is maintained when reproducing the second content.

[0105] Here, the reproduction unit 103 may also set the first amplification factor of the first inaudible sound being reproduced at the end time point of the reproduction of the first content and the second amplification factor of the second inaudible sound being reproduced at the start time point of the reproduction of the second content to the same value. The above-mentioned same value is, for example, 0. In addition, the reproduction unit 103 may also maintain the first amplification factor of the first inaudible sound being reproduced at the same value during a certain period including the end time point of the reproduction of the first content. In addition, the reproduction unit 103 may also maintain the second amplification factor of the second inaudible sound being reproduced at the same value during a certain period including the start time point of the reproduction of the second content.

[0106] The playback unit 103 also updates while adding a code (also called a time code) indicating the playback position of the content being played back, and plays back the content while referring to the time code. The configuration of the playback unit 103 will be described in detail later.

[0107] In addition, if Figure 2 As shown, the server 20 includes a communication IF 21 , a processor 22 , and a storage 23 .

[0108] The communication IF 21 is a communication interface capable of communicating with the terminal 10 via the network N. The communication IF 21 may be a wireless LAN interface such as Wi-Fi or a wired LAN interface such as Ethernet.

[0109] The processor 22 executes a predetermined program using a memory (not shown) to realize the software functions of the server 20. The software functions realized by the processor 22 will be described later.

[0110] The storage 23 stores a plurality of contents. The plurality of contents stored in the storage 23 are a plurality of contents that can be reproduced by the terminal 10. The plurality of contents stored in the storage 23 are read by the processor 22 (more specifically, the selection unit 201). The storage 23 can be implemented by a memory or a HDD (Hard Disk Drive) or the like.

[0111] The selection unit 201 implemented by the processor 22 executing a predetermined program using a memory (not shown) will be described below.

[0112] The selection unit 201 selects content. Specifically, the selection unit 201 provides the first content corresponding to the emotion before guidance and the second content corresponding to the target emotion to the terminal 10 via the communication IFs 13 and 21 and the network N.

[0113] Specifically, the selection unit 201 obtains the user's emotion before guidance from the acquisition unit 101 via the communication IF 21, the communication IF 13, and the network N, and selects content corresponding to the obtained emotion before guidance as the first content. The selection unit 201 previously maintains a correspondence relationship between the emotion and a plurality of contents stored in the storage 23, and selects the first content corresponding to the emotion before guidance with reference to the correspondence relationship.

[0114] Furthermore, the selection unit 201 acquires the target emotion from the acquisition unit 101 via the communication IFs 21 and 13 and the network N, and selects content corresponding to the acquired target emotion as the second content. The selection unit 201 refers to the above correspondence relationship and selects the second content corresponding to the target emotion.

[0115] In addition, when the reproduction system 1 guides the user's emotion from the emotion before guidance to the target emotion via the intermediate emotion, the selection unit 201 selects the content corresponding to the intermediate emotion as the third content. The selection unit 201 refers to the above correspondence and selects the third content corresponding to the intermediate emotion. The intermediate emotion may be obtained from the terminal 10 or generated by the selection unit 201 using the emotion before guidance and the target emotion.

[0116] Figure 3 This is a block diagram showing the structure of the reproduction unit 103 according to this embodiment.

[0117] like Figure 3 As shown, the reproduction unit 103 includes a generation unit 111 , a determination unit 112 , an adjustment unit 113 , and an addition unit 114 .

[0118] The generating unit 111 generates a basic signal of inaudible sound corresponding to the content. The generating unit 111 generates waveform data of the basic signal of inaudible sound based on the waveform data of the sound source provided by the acquiring unit 101. More specifically, the generating unit 111 generates a basic signal of inaudible sound corresponding to the first content and a basic signal of inaudible sound corresponding to the second content based on the waveform data of the first content and the second content, respectively. In addition, when using the third content, the generating unit 111 generates a basic signal of inaudible sound (third inaudible sound) corresponding to the third content based on the waveform data of the third content. The generating unit 111 provides the generated waveform data of the basic signal of inaudible sound to the adjusting unit 113.

[0119] In addition, the processing of generating waveform data of a basic signal of inaudible sound based on waveform data of audible sound can be achieved, for example, by removing the audible sound component from waveform data containing inaudible sound generated by clipping waveform data obtained by amplifying the waveform data of the sound source (i.e., the waveform data of the audible sound).

[0120] The determination unit 112 determines the amplification factor of the base signal of the inaudible sound generated by the generation unit 111 (may also be simply referred to as the amplification factor of the inaudible sound). Specifically, the determination unit 112 determines the amplification factor of the inaudible sound based on the time code updated by the reproduction unit 103. The amplification factor determined by the determination unit 112 includes a first amplification factor and a second amplification factor, and when the third content is used, includes a third amplification factor as the amplification factor of the third inaudible sound. For example, the determination unit 112 retains the transition of the amplification factor of the inaudible sound set for the time code, and refers to the transition of the amplification factor to determine the amplification factor of the inaudible sound added to the waveform data provided from the acquisition unit 101 to the generation unit 111 at each moment. The transition of the amplification factor of the inaudible sound will be described later.

[0121] The adjustment unit 113 adjusts the sound pressure of the reproduced inaudible sound by multiplying the amplitude of the waveform data of the inaudible sound generated by the generation unit 111 by the amplification factor determined by the determination unit 112. The adjustment unit 113 supplies the adjusted waveform data of the inaudible sound to the addition unit 114.

[0122] The adding unit 114 generates waveform data to be reproduced by the speaker 15 by adding the waveform data of the inaudible sound supplied from the adjusting unit 113 to the waveform data of the sound source supplied from the acquiring unit 101 .

[0123] The following describes the reproduction of content by the reproduction unit 103.

[0124] Figure 4 It is an explanatory diagram showing the reproduction of content by the reproduction unit 103 according to the present embodiment.

[0125] When the reproduction system 1 directly guides the target emotion from the emotion before guidance, the reproduction unit 103 reproduces two contents. The above two contents are equivalent to Figure 4 Contents A and B.

[0126] Specifically, the reproduction unit 103 starts reproduction of content A at time T1. When reproducing content A, the reproduction unit 103 reproduces inaudible sound generated based on content A. The reproduction unit 103 reproduces content A to the end. The time when the reproduction unit 103 ends reproduction of content A is set to time T2.

[0127] Next, the reproduction unit 103 starts reproduction of content B at time T2. When reproducing content B, the reproduction unit 103 reproduces the inaudible sound generated based on content B. The reproduction unit 103 reproduces content B to the end. The time when the reproduction unit 103 ends reproduction of content B is set to time T3.

[0128] In addition, as described above, time T2 is determined based on the playback time length of content A. In addition, as described above, time T3 is determined based on the playback time length of contents A and B. Therefore, the time length from time T1 to time T2 and the time length from time T2 to time T3 are independent, in other words, they may be the same or different.

[0129] The playback unit 103 ends the playback of a series of contents when the playback of the content B is finished. In this case, the content A corresponds to the first content, and the content B corresponds to the second content.

[0130] In addition, when the reproduction system 1 guides the target emotion from the emotion before guidance via one intermediate emotion, the reproduction unit 103 reproduces three contents. The above three contents are equivalent to Figure 4 Contents A, B and C.

[0131] Specifically, the reproduction unit 103 reproduces the contents A and B in the same manner as in the case of reproducing two contents, and then reproduces the content C. When reproducing the content C, the reproduction unit 103 starts reproducing the content C at time T3. When reproducing the content C, the reproduction unit 103 reproduces the inaudible sound generated based on the content C. The reproduction unit 103 reproduces the content C to the end. The time when the reproduction unit 103 ends the reproduction of the content C is set to time T4.

[0132] As described above, time T4 is determined based on the playback time of contents A, B, and C. Therefore, the time from time T3 to time T4 is independent of the time from time T1 to time T2 or the time from time T2 to time T3. In other words, they may be the same or different.

[0133] The playback unit 103 ends the playback of a series of contents when the playback of the content C is finished. In this case, the content A corresponds to the first content, the content C corresponds to the second content, and the content B corresponds to the third content.

[0134] In addition, when the reproduction system 1 guides the target emotion from the emotion before guidance via a plurality of intermediate emotions, it is sufficient to set the content B in the case of using three contents as described above to a plurality of contents.

[0135] Hereinafter, the transition of the amplification factor of the inaudible sound will be described. Here, the case where the reproduction system 1 guides the user's emotion using two contents and the case where the reproduction system 1 guides the user's emotion using three contents will be described respectively.

[0136] [2. Change in the amplification rate of inaudible sound (when two contents are used)]

[0137] Hereinafter, a plurality of examples will be described regarding the transition of the amplification factor of the inaudible sound (the first inaudible sound and the second inaudible sound) when the reproduction system 1 reproduces two contents to induce the user's emotion. The reproduction unit 103 (more specifically, the determination unit 112) determines the transition of the amplification factor and determines the amplification factor of the inaudible sound at each time.

[0138] Figure 5 This is an explanatory diagram showing a first example of transition of the magnification factor according to the present embodiment.

[0139] exist Figure 5 In the transition of the magnification shown in FIG. 1 , the reproduction unit 103 decreases the magnification from 100% to 0% linearly with respect to time during the period from time T1 to time T2. In addition, the reproduction unit 103 increases the magnification from 0% to 100% linearly with respect to time during the period from time T2 to time T3. In this way, the reproduction unit 103 can generate a transition of the magnification that decreases or increases linearly with respect to time by a relatively simple process.

[0140] Thus, the reproduction system 1 can guide the user's emotions while adjusting the amplification factor of the inaudible sound through relatively simple processing.

[0141] Figure 6 It is an explanatory diagram showing a second example of transition of the magnification factor in this embodiment.

[0142] Figure 6 The change in the amplification ratio shown is a change in the position setting of the chorus part of the content. Here, the chorus part is a relatively strong part in the content, in other words, a part that makes a strong impression on the user who is perceiving the part. The process of detecting the chorus part in the content can be realized by, for example, extracting a part with relatively high sound pressure in the content, and can be executed by the reproduction unit 103.

[0143] Figure 6 The chorus part P1 shown is the chorus part of content A, and the chorus part P2 is the chorus part of content B.

[0144] exist Figure 6 In the transition of the amplification factor shown, the playback unit 103 maintains the amplification factor at 100% from time T1 to the end time point of the chorus part P1, and reduces the amplification factor linearly with respect to time from the end time point of the chorus part P1 to time T2 from 100% to 0%.

[0145] Furthermore, the reproduction unit 103 increases the amplification rate linearly from 0% to 100% with respect to time from time T2 to the start time point of the chorus part P2, and maintains the amplification rate at 100% from the start time point of the chorus part P2 to time T3. In addition, the section from the start of the content A to the end of the chorus part P1 is also referred to as the first section, and the section from the start of the chorus part P2 to the end of the content B is also referred to as the second section. The amplification rate in the first section is also referred to as the first value, and the first value can be selected from a relatively high amplification rate range (for example, 70% to 100%). The amplification rate in the second section is also referred to as the second value, and the second value can be selected from a relatively high amplification rate range (for example, 70% to 100%).

[0146] In this way, the process of the reproduction unit 103 generating a transition of the amplification factor that decreases or increases linearly with respect to time can be realized by a relatively simple process.

[0147] If content A has a plurality of chorus parts, one of the chorus parts may be set as chorus part P1. If content B has a plurality of chorus parts, one of the chorus parts may be set as chorus part P2.

[0148] Furthermore, when content A has multiple choruses, the last chorus among the multiple choruses may be set as chorus part P1. Furthermore, when content B has multiple choruses, the first chorus among the multiple chorus parts may be set as chorus part P2.

[0149] Thus, the reproduction system 1 adjusts the amplification rate of the inaudible sound through relatively simple processing, thereby increasing the intensity of the user's emotion when the reproduction unit 103 reproduces the chorus part of each content and guiding the user's emotion more appropriately.

[0150] Figure 7 It is an explanatory diagram showing a third example of transition of the magnification factor according to the present embodiment.

[0151] Figure 7 The transition of the magnification shown is a transition set nonlinearly with respect to time.

[0152] exist Figure 7 In the transition of the magnification shown, the reproduction unit 103 decreases the magnification from 100% to 0% in an exponential function with respect to time from time T1 to time T2, and increases the magnification from 0% to 100% in an exponential function with respect to time from time T2 to time T3.

[0153] in addition, Figure 7The change in magnification shown is generally also called the A curve. Figure 5 The transition of the amplification factor shown is generally also called the B curve. Generally, the strength of the sound after adjusting the amplification factor according to the A curve is considered to be closer to the sense of strength of the sound perceived by humans. Therefore, by using the amplification factor that transitions according to the A curve, the intensity of the user's emotion can be naturally guided.

[0154] As a result, the reproduction system 1 can guide the intensity of the user's emotions more naturally.

[0155] in addition, Figure 7 The magnification shown is changed by Figure 5 The linear change in the magnification shown in FIG. 1 is replaced by an exponential change. Figure 6 The linear change in the transition of the amplification factor shown is replaced by an exponential change. Thus, the playback system 1 can enhance the intensity of the user's emotion when the playback unit 103 plays back the chorus of each content, and can guide the user's emotion more appropriately.

[0156] [3. Processing of playback system 1 (when two contents are used)]

[0157] Figure 8 This is a block diagram showing a first example of processing of the reproduction system 1 of this embodiment. In addition, the components (terminal 10 and server 20 and components possessed by terminal 10 and server 20) that are the main body for executing the processing shown below are examples, and the main body for executing the processing may also be other components.

[0158] In step S101 , the acquisition unit 101 acquires a target emotion using the input IF 11 .

[0159] In step S102 , the acquisition unit 101 acquires the emotion of the user before guidance using the sensor 12 and the recognition unit 102 .

[0160] In step S103, the acquisition unit 101 sends the user's pre-guidance emotion and target emotion to the server 20, and requests the content to be reproduced by the terminal 10. The selection unit 201 acquires the user's pre-guidance emotion and target emotion sent by the acquisition unit 101, selects the content corresponding to the acquired user's pre-guidance emotion and target emotion, that is, the content to be reproduced by the terminal 10, and provides the selected content to the acquisition unit 101. The content to be reproduced by the terminal 10 includes content A and B. Content A is the content corresponding to the user's pre-guidance emotion, and content B is the content corresponding to the target emotion. The acquisition unit 101 acquires the content provided by the selection unit 201.

[0161] In step S104, the reproduction unit 103 determines the change in the amplification factor of the inaudible sound. The change in the amplification factor to be determined is, for example, Figure 5 , Figure 6 or Figure 7 Magnification shift shown.

[0162] In step S105, the reproduction unit 103 gradually reduces the amplification factor of the inaudible sound while reproducing the content A. Specifically, the reproduction unit 103 generates waveform data of the inaudible sound based on the waveform data of the content A (the waveform data of the sound source) acquired by the acquisition unit 101 in step S103, adds the generated waveform data of the inaudible sound to the waveform data of the content A, and supplies the added waveform data to the speaker 15, thereby reproducing the content A together with the inaudible sound. Furthermore, the reproduction unit 103 gradually reduces the amplification factor of the inaudible sound being reproduced according to the transition determined in step S104 while reproducing the content A together with the inaudible sound. When the reproduction unit 103 has reproduced the content A to the end, the process proceeds to step S106.

[0163] In step S106, the reproduction unit 103 gradually increases the amplification factor of the inaudible sound while reproducing the content B. Specifically, the reproduction unit 103 generates waveform data of the inaudible sound based on the waveform data of the content B (the waveform data of the sound source) acquired by the acquisition unit 101 in step S103, adds the generated waveform data of the inaudible sound to the waveform data of the content B and provides the data to the speaker 15, and reproduces the content B together with the inaudible sound. Furthermore, the reproduction unit 103 gradually increases the amplification factor of the inaudible sound being reproduced according to the transition determined in step S104 while reproducing the content B together with the inaudible sound. When the reproduction unit 103 has reproduced the content B to the end, the reproduction process ends. Figure 8 A series of processing is shown.

[0164] pass Figure 8 Through the series of processing shown, the reproduction system 1 can appropriately guide the user's emotions by using two contents and the reproduction of inaudible sounds corresponding to the two contents.

[0165] [4. Changes in the amplification rate of inaudible sound (when three contents are used)]

[0166] Hereinafter, a plurality of examples will be described regarding the transition of the amplification factor of the inaudible sound (the first inaudible sound, the second inaudible sound, and the third inaudible sound) when the reproduction system 1 reproduces three contents to induce the user's emotion. The reproduction unit 103 (more specifically, the determination unit 112) determines the transition of the amplification factor and determines the amplification factor of the inaudible sound at each time.

[0167] The reproduction unit 103 gradually increases and then gradually decreases the amplification rate of the third inaudible sound being reproduced during the reproduction of the one or more contents B. The reproduction unit 103 may also set the amplification rate of the third inaudible sound being reproduced to 0 at the start time point and the end time point of the reproduction of the one or more contents B.

[0168] Fig. 9 It is an explanatory diagram showing a fourth example of transition of the magnification factor according to the present embodiment.

[0169] exist Fig. 9 In the transition of the magnification ratio shown in FIG. 1 , the reproduction unit 103 reduces the magnification ratio linearly from 100% to 0% with respect to time from time T1 to time T2 .

[0170] Furthermore, the reproduction unit 103 increases the amplification factor from 0% to 100% linearly with respect to time during the period from time T2 to time T2A, and then decreases the amplification factor from 100% to 0% linearly with respect to time during the period from time T2A to time T3. Time T2A is any time between time T2 and time T3, for example, a time in the middle between time T2 and time T3.

[0171] Furthermore, the reproduction unit 103 increases the amplification factor linearly from 0% to 100% with respect to time during the period from time T3 to time T3.

[0172] In this way, the process of the reproduction unit 103 generating a transition of the amplification factor that decreases or increases linearly with respect to time can be realized by a relatively simple process.

[0173] Thus, the reproduction system 1 can guide the user's emotions while adjusting the amplification factor of the inaudible sound through relatively simple processing.

[0174] Fig.10 It is an explanatory diagram showing a fifth example of transition of the magnification factor according to the present embodiment.

[0175] Fig.10 The change in the magnification ratio shown is determined based on the position of the chorus part of the content.

[0176] Fig.10 The chorus part P1 shown is the chorus part of content A, the chorus part P2 is the chorus part of content B, and the chorus part P3 is the chorus part of content C.

[0177] exist Fig.10 In the change of the magnification shown in FIG. 1 , the change of the magnification during the period from time T1 to time T2 is similar to that during the period from time T1 to time T2. Figure 6 It's the same.

[0178] Furthermore, the reproduction unit 103 increases the amplification rate from 0% to 100% linearly with respect to time from time T2 to the start time point of the chorus part P2, and maintains the amplification rate at 100% from the start time point to the end time point of the chorus part P2. Furthermore, the reproduction unit 103 decreases the amplification rate from 100% to 0% linearly with respect to time from the end time point of the chorus part P2 to time T3.

[0179] Furthermore, the playback unit 103 increases the amplification factor linearly with respect to time from 0% to 100% from time T3 to the start time of the chorus part P3, and maintains the amplification factor at 100% from the start time of the chorus part P3 to time T4.

[0180] In addition, the section from the beginning of content A to the end of chorus P1 corresponds to the first section, and the section from the beginning of chorus P3 to the end of content C corresponds to the second section. The section from the beginning to the end of chorus P2 is also called the third section. The amplification factor in the third section is also called the third value, and the third value can be selected from a relatively high amplification factor range (for example, 70% to 100%).

[0181] In this way, the process of the reproduction unit 103 generating a transition of the amplification factor that decreases or increases linearly with respect to time can be realized by a relatively simple process.

[0182] In addition, when content A has multiple chorus parts, one of the multiple chorus parts can be set as chorus part P1. In addition, when content B has multiple chorus parts, one of the multiple chorus parts can be set as chorus part P2. In addition, when content C has multiple chorus parts, one of the multiple chorus parts can be set as chorus part P3.

[0183] Furthermore, if content A has multiple chorus parts, the last chorus part P1 among the multiple chorus parts may be used. Furthermore, if content B has multiple chorus parts, the period from the start time point of the first chorus part among the multiple chorus parts to the end time point of the last chorus part may be used as chorus part P2. Furthermore, if content C has multiple chorus parts, the last chorus part among the multiple chorus parts may be used as chorus part P3.

[0184] Thus, the reproduction system 1 adjusts the amplification rate of the inaudible sound through relatively simple processing, thereby increasing the intensity of the user's emotion when the reproduction unit 103 reproduces the chorus part of each content and guiding the user's emotion more appropriately.

[0185] Alternatively, you can Fig. 9 or Fig.10 The linear change in the transition of the amplification factor shown is replaced by an exponential change. Thus, the playback system 1 can enhance the intensity of the user's emotion when the playback unit 103 plays back the chorus of each content, and can guide the user's emotion more appropriately.

[0186] [5. Processing of playback system 1 (when three contents are used)]

[0187] Fig.11 This is a block diagram showing a second example of the processing of the reproduction system 1 according to the present embodiment.

[0188] In step S201 , the acquisition unit 101 acquires a target emotion using the input IF 11 .

[0189] In step S202 , the acquisition unit 101 acquires the emotion of the user before guidance using the sensor 12 and the recognition unit 102 .

[0190] In step S203, the acquisition unit 101 acquires the emotion (also called intermediate emotion) passed through for guidance from the emotion before guidance to the target emotion. The intermediate emotion may be obtained by inputting it into the input IF 11 from the user, or may be determined by the acquisition unit 101 based on the emotion before guidance and the target emotion.

[0191] In step S204, the acquisition unit 101 sends the user's pre-guidance emotion, intermediate emotion, and target emotion to the server 20, and requests the content to be reproduced by the terminal 10. The selection unit 201 acquires the user's pre-guidance emotion, intermediate emotion, and target emotion sent by the acquisition unit 101, selects the content corresponding to the acquired user's pre-guidance emotion, intermediate emotion, and target emotion, that is, the content to be reproduced by the terminal 10, and provides the selected content to the acquisition unit 101. The content to be reproduced by the terminal 10 includes content A, B, and C. Content A is the content corresponding to the user's pre-guidance emotion, content B is the content corresponding to the intermediate emotion, and content C is the content corresponding to the target emotion. The acquisition unit 101 acquires the content provided by the selection unit 201.

[0192] In step S205, the reproduction unit 103 determines the change in the amplification factor of the inaudible sound. The change in the determined amplification factor is, for example, Fig. 9 or Fig.10 Magnification shift shown.

[0193] In step S206, the reproduction unit 103 reproduces the content A while gradually reducing the amplification factor of the inaudible sound. The process of reproducing the content A while gradually reducing the amplification factor of the inaudible sound is similar to the process of reproducing the content A in step S205 ( Figure 8If the playback unit 103 plays back the content A to the end, it proceeds to step S207.

[0194] In step S207, the reproduction unit 103 gradually increases the amplification factor of the inaudible sound while reproducing the content B. The reproduction unit 103 reproduces the content B at a timing ( Fig. 9 At time T2A, or Fig.10 The process of reproducing content B continues in step S208. The process of reproducing content B while gradually increasing the amplification rate of the inaudible sound is continued with the transition determined in step S205, and step S106 ( Figure 8 ) proceed similarly.

[0195] In step S208, the reproduction unit 103 gradually reduces the amplification factor of the inaudible sound while reproducing the content B. The reproduction of the content B is continuously performed from step S207. The process of reproducing the content B while gradually reducing the amplification factor of the inaudible sound is similar to the process of reproducing the content B in step S205 ( Figure 8 If the playback unit 103 plays back the content B to the end, it proceeds to step S209.

[0196] In step S209, the reproduction unit 103 gradually increases the amplification rate of the inaudible sound while reproducing the content C. The process of reproducing the content C while gradually increasing the amplification rate of the inaudible sound is similar to the process of step S106 ( Figure 8 ) is performed in the same manner. If the playback unit 103 plays back the content C to the end, the playback ends. Fig.11 A series of processing is shown.

[0197] In addition, the processing of step S203 may be performed by the selection unit 201 instead of being performed by the acquisition unit 101. That is, the selection unit 201 may also acquire the intermediate emotion. The acquisition of the intermediate emotion is determined by the selection unit 201 based on the emotion before guidance and the target emotion. In the case where the selection unit 201 determines the intermediate emotion, the emotion before guidance and the target emotion required for the determination of the intermediate emotion are acquired by the acquisition unit 101 in steps S201 and S202, and may be sent to the server 20 after the acquisition. In addition, in the case where the processing of step S203 is performed by the selection unit 201, in step S203, the selection unit 201 may also send the intermediate emotion to the acquisition unit 101. Furthermore, in this case, in step S204, the selection unit 201 selects contents A, B, and C using the emotion before guidance and the target emotion acquired in step S203 and the intermediate emotion acquired in step S204.

[0198] pass Fig.11 Through the series of processing shown, the reproduction system 1 can appropriately guide the user's emotions by using the three contents and the reproduction of the inaudible sounds corresponding to the three contents.

[0199] (Variation of the embodiment)

[0200] In this modification, a reproduction system that appropriately guides the user's emotions by using the reproduction of inaudible sounds will be described. The reproduction system of this modification guides the user's emotions more appropriately by controlling the intensity of the inaudible sounds according to the guided user's emotions.

[0201] The reproduction system 1 of this modification guides the user's emotions by reproducing content similarly to the reproduction system 1 of the above-described embodiment, senses the guided user's emotions, and controls the amplification rate of inaudible sound according to the user's emotions.

[0202] The reproduction unit 103 maintains a target transition that is a preset transition representing the emotion of the user to whom the emotion is guided. The target transition is information representing the type of emotion of the user in the middle of the guided emotion and the intensity of the emotion. When the emotion of the user recognized by the recognition unit 102 deviates from the target transition, the reproduction unit 103 adjusts the amplification factor of the first non-audible sound being reproduced so that the emotion of the user approaches the target transition. In addition, when the emotion recognized by the recognition unit 102 deviates from the target transition, the reproduction unit 103 may also set the amplification factor of the first non-audible sound being reproduced to 0. Whether the emotion of the user deviates from the target transition can be determined by determining whether the difference between the emotion of the user and the emotion in the target transition is greater than a specified value.

[0203] Fig.12 It is an explanatory diagram showing target transition in this modification example.

[0204] exist Fig.12 , the target shift relative to the time (corresponding to the time code) is shown. Fig.12 The target transition shown shows the target transition when the emotion before guidance is excitement and the target emotion is relaxation, and the user's emotion is guided using two contents. Here, the intensity of emotion is shown in a range from 0% to 100% as an example, but it is not limited to this.

[0205] During the period from time T1 to time T2, the type of emotion is excitement, and the emotion intensity gradually decreases from 100% to 0%. During the period from time T2 to time T3, the type of emotion is relaxation, and the emotion intensity gradually increases from 0% to 100%.

[0206] Fig.13 This is a flowchart showing the processing of the reproduction system 1 according to this modification.

[0207] When the reproduction system 1 reproduces content by the reproduction unit 103 (for example Figure 8 Steps S105 and S106) are executed simultaneously and in parallel Fig.13 Assume that as an example, the change of the amplification factor of the inaudible sound is determined as follows: Figure 5 The transition of the magnification ratio shown in FIG. 1 (step S104 ) will be described below.

[0208] In step S301, the acquisition unit 101 acquires a time code at the playback time point of the content being played back by the playback unit 103. The time code indicates the temporal position of the content being played back by the playback unit 103.

[0209] In step S302, the acquisition unit 101 acquires the emotion at the reproduction time point during the target transition. The emotion at the reproduction time point includes the type of emotion and the intensity of the emotion.

[0210] In step S303 , the acquisition unit 101 acquires the emotion of the user at the current time point (that is, the time point when the present process is being executed).

[0211] In step S304, the acquisition unit 101 determines whether the difference between the emotion at the reproduction position in the target transition obtained in step S302 and the emotion of the user at the current time point obtained in step S303 is greater than a prescribed value. For example, the acquisition unit 101 may determine that the difference is greater than a prescribed value when the type of emotion at the reproduction position in the target transition is the same as the type of emotion at the user's current time point, and the intensity of the emotion at the user's current time point is higher or lower than the intensity of the emotion at the reproduction position in the target transition by more than 10 points. In addition, for example, the acquisition unit 101 may determine that the difference is greater than a prescribed value when the type of emotion at the reproduction position in the target transition is different from the type of emotion at the user's current time point. When it is determined that the difference is greater than a prescribed value ("Yes" in step S304), the process proceeds to step S305. Otherwise, step S301 is executed again.

[0212] In step S305, the acquisition unit 101 adjusts the magnification. For example, when the type of emotion at the reproduction position in the target transition is the same as the type of emotion at the user's current time point, and the intensity of the emotion at the user's current time point is 10 points or more higher than the intensity of the emotion at the reproduction position in the target transition, the acquisition unit 101 adjusts the magnification at the current time point in the transition of the magnification determined in step S104 to a lower value. At this time, when the magnification after the current time point in the transition of the magnification determined in step S104 is in a decreasing trend, the acquisition unit 101 adjusts the magnification after the current time point to be less than the adjusted magnification at the current time point.

[0213] Furthermore, for example, when the type of emotion at the reproduction position in the target transition is the same as the type of emotion at the current time point of the user, and the intensity of the emotion at the current time point of the user is 10 points lower than the intensity of the emotion at the reproduction position in the target transition, the acquisition unit 101 adjusts the magnification at the current time point in the transition of the magnification determined in step S104 to a higher value. At this time, when the magnification after the current time point in the transition of the magnification determined in step S104 is in an increasing trend, the acquisition unit 101 may adjust the magnification after the current time point to be greater than the adjusted magnification at the current time point.

[0214] Fig.14 This is an explanatory diagram showing an example of the transition of emotions in this variation. Fig.15 It is an explanatory diagram showing an example of transition of the magnification factor in this modification.

[0215] exist Fig.14 , the actual emotional transition of the user, to whom the reproduction system 1 induces emotion, is shown together with the target transition. The actual emotional transition of the user is obtained by expressing the emotion of the user obtained by the sensor 12 and the recognition unit 102 as the transition over time.

[0216] Fig.14 The actual emotion of the user shown is an excited emotion with an intensity of 100% at time T1, and continues to decrease from 100% after time T1.

[0217] Assume that at time T5, the acquisition unit 101 determines that the difference d between the emotion intensity of the user at the current time point and the emotion intensity at the playback position during the target transition is 10 points or more higher.

[0218] In this case, the reproduction unit 103 adjusts the amplification factor at time T5 so as to decrease from the value A1 before adjustment to the value A2. In addition, the transition of the amplification factor after time T5 is adjusted so as to gradually decrease from the value A2 after adjustment (see Fig.15 ). Thus, the reproduction system 1 improves the effect of reducing the intensity of the user's excitement, and helps guide the user's emotions with a transition close to the target transition.

[0219] In addition, the reproduction unit 103 may also set the amplification factor after time T5 to 0. The case where the reproduction unit 103 sets the amplification factor after time T5 to 0 is, for example, the case where the acquisition unit 101 determines in step S304 that the type of emotion at the reproduction position in the target transition is different from the type of emotion of the user at the current time point. As a result, the reproduction system 1 can stop the reproduction of the non-audible sound (that is, stop guiding the user's emotions). In the case where the user is in a state where his emotions are not suitable for being guided, guiding the user's emotions will have an adverse effect on the user (for example, it will become a psychological burden, etc.), and this helps to suppress this situation.

[0220] As described above, the embodiments are described as examples of the technology disclosed in the present invention. For this purpose, the drawings and detailed description are provided.

[0221] Therefore, the components recorded in the drawings and detailed descriptions include not only the components necessary for solving the problem, but also the components not necessary for solving the problem, in order to illustrate the above-mentioned implementation. Therefore, it should not be directly determined that these non-essential components are essential just because they are recorded in the drawings or detailed descriptions.

[0222] In addition, the above-mentioned embodiments are for illustrating the technology of the present disclosure, and therefore various changes, substitutions, additions, omissions, etc. can be made within the scope of the claims or their equivalents.

[0223] Industrial Applicability

[0224] The present disclosure can be used in a system for guiding a user's emotions.

[0225] Description of symbols

[0226] 1 Reproduction system

[0227] 10 Terminal

[0228] 11 Input IF

[0229] 12 Sensors

[0230] 13, 21 Communication IF

[0231] 14, 22 Processor

[0232] 15 Speakers

[0233] 20 Servers

[0234] 23 Storage

[0235] 101 Acquisition Department

[0236] 102 Identification Department

[0237] 103 Recapitulation

[0238] 111 Generation Department

[0239] 112 Decision Department

[0240] 113 Adjustment Department

[0241] 114 Addition

[0242] 201 Selection Department

[0243] N Network

[0244] P, Q Path

Claims

1. A reproduction system is a content reproduction system for guiding a user's emotion from a first emotion to a second emotion, wherein: have: an acquisition unit that acquires a first content corresponding to the first emotion and a second content corresponding to the second emotion; and a reproduction unit that, through a speaker, (a) reproduces the first content together with a first inaudible sound corresponding to the first content, and (b) reproduces the second content together with a second inaudible sound corresponding to the second content, wherein the first inaudible sound is obtained by amplifying a basic signal of the first inaudible sound at a first amplification factor, and the second inaudible sound is obtained by amplifying a basic signal of the second inaudible sound at a second amplification factor, The above recapitulation part, During the reproduction of the first content, the first amplification factor of the first inaudible sound being reproduced is gradually reduced. During reproduction of the second content, the second amplification factor of the second inaudible sound being reproduced is gradually increased.

2. The reproduction system according to claim 1, wherein: The above recapitulation part, At the end time of the reproduction of the first content, the first magnification ratio is set to 0, The second amplification factor is set to 0 at a start time of playback of the second content.

3. The reproduction system according to claim 1 or 2, wherein: The reproduction unit, during reproduction of the first content, maintaining the first amplification factor of the first inaudible sound being reproduced at a first value in a first section from the start of the first content to the end of the chorus portion included in the first content, In a section later than the first section, the first amplification factor of the first inaudible sound being reproduced is gradually reduced from the first value, The reproducing unit, during the reproducing of the second content, maintaining the second amplification factor of the second inaudible sound being reproduced at a second value in a second section from the beginning of the chorus portion included in the second content to the end of the second content, In a section before the second section, the second amplification factor of the second inaudible sound being reproduced is gradually increased toward the second value.

4. The reproduction system according to claim 1, wherein: The above recapitulation part, When gradually reducing the first magnification ratio during playback of the first content, the first magnification ratio is reduced linearly with respect to time. When the second amplification factor is gradually increased during reproduction of the second content, the second amplification factor is increased linearly with respect to time.

5. The reproduction system according to claim 1, wherein: The above recapitulation part, When gradually reducing the first magnification ratio during playback of the first content, the first magnification ratio is reduced in an exponential function with respect to time. When the second amplification factor is gradually increased during reproduction of the second content, the second amplification factor is increased in an exponential function with respect to time.

6. The reproduction system according to claim 1, wherein: The reproduction system further includes a recognition unit that recognizes the emotion of the user when the reproduction unit reproduces the first content or the second content. When the emotion recognized by the recognition unit deviates from a preset transition, the reproduction unit adjusts the first amplification factor of the first inaudible sound being reproduced so that the emotion of the user approaches the preset transition.

7. The reproduction system according to claim 1, wherein: The reproduction system further includes a recognition unit that recognizes the emotion of the user when the reproduction unit reproduces the first content or the second content. The reproduction unit sets the amplification factor of the first inaudible sound being reproduced to 0 when the emotion recognized by the recognition unit deviates from a preset transition.

8. The reproduction system according to claim 1, wherein: The reproduction unit starts reproduction of the second content at a time point when reproduction of the first content is finished.

9. The reproduction system according to claim 1, wherein: The reproduction system guides the user's emotion from the first emotion to the second emotion via one or more third emotions, The acquisition unit acquires one or more third contents, wherein the one or more third contents are third contents corresponding to the one or more third emotions, respectively. The above recapitulation part, After the reproduction of the first content ends, the third content is reproduced sequentially together with the third inaudible sounds corresponding to the one or more third contents, At a time point when the reproduction of the one or more third contents is finished, the reproduction of the second content is started, During reproduction of each of the one or more third contents, a third amplification factor of the third inaudible sound being reproduced is gradually increased and then gradually decreased.

10. The reproduction system according to claim 9, wherein: The reproduction unit sets the third amplification factor to 0 at a start time point and an end time point of reproduction of the one or more third contents.

11. The reproduction system according to claim 9, wherein: The reproduction unit, during reproduction of each of the one or more third contents, In a third section including the beginning to the end of the chorus part of the third content, the third amplification factor of the third inaudible sound being reproduced is maintained at a third value, In a section before the third section, the third amplification factor of the third inaudible sound being reproduced is gradually increased toward the third value, In a section later than the third section, the third amplification factor of the third inaudible sound being reproduced is gradually reduced from the third value.

12. The reproduction system according to claim 1, wherein: The reproduction system further includes a selection unit that selects the first content corresponding to the first emotion and the second content corresponding to the second emotion from a plurality of contents. The acquisition unit acquires the first content and the second content selected by the selection unit.

13. A reproduction method, the method being executed by one or more computers in a content reproduction system for guiding a user's emotion from a first emotion to a second emotion, wherein: obtaining a first content corresponding to the first emotion and a second content corresponding to the second emotion, After (a) reproducing the first content together with a first inaudible sound corresponding to the first content, (b) reproducing the second content together with a second inaudible sound corresponding to the second content through a speaker, wherein the first inaudible sound is obtained by amplifying a basic signal of the first inaudible sound at a first amplification factor, and the second inaudible sound is obtained by amplifying a basic signal of the second inaudible sound at a second amplification factor. During the reproduction of the first content, the first amplification factor of the first inaudible sound being reproduced is gradually reduced. During reproduction of the second content, the second amplification factor of the second inaudible sound being reproduced is gradually increased.

14. A program for causing a computer to execute the reproducing method according to claim 13.

Images