Video and audio providing device

Abstract

To stabilize the user's emotions. [Solution] The video and audio providing device includes an acquisition unit that acquires user-related information, including video and audio information captured and recorded of the user and their surroundings; a storage processing unit that, based on the acquired user-related information, calculates the level of positive emotion when it detects that the user has experienced positive emotion, and stores it in a storage unit as positive emotion information in chronological order in relation to the video and audio information; and a providing processing unit that, based on the user-related information, calculates the level of negative emotion when it detects that the user has experienced negative emotion, and provides the user with video and audio information of the level of positive emotion corresponding to the level of negative emotion from among the stored positive emotion information.

Description

Technical Field

[0001] The present invention relates to a video and audio providing apparatus.

Background Art

[0002] During the implementation of an event using content, a technique is known in which emotion information indicating the emotions of participants is acquired, and an emotion rank calculated from the acquired emotion information is assigned to the content as an emotion tag (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In recent years, as an apparatus for providing video and audio, for example, it has been demanded to stabilize the emotions of users by providing content to the users. The technique described in Patent Document 1 does not describe providing content that stabilizes the emotions of users.

[0005] The present invention has been made in view of the above, and an object thereof is to provide a video and audio providing apparatus capable of stabilizing the emotions of users.

Means for Solving the Problems

[0006] The video and audio providing device according to the present invention includes: an acquisition unit that acquires user-related information including video and audio information captured and recorded of the user and their surroundings in real or virtual space; a storage processing unit that, based on the acquired user-related information, detects that the user has received a positive-causing action from another person that may cause the user to feel positive emotions, or that the user has felt positive emotions, calculates the level of the positive-causing action or the level of the positive emotion, and stores it in a storage unit as positive-causing action information or positive emotion information in a time-series association with the video and audio information; and a storage processing unit that, based on the user-related information, detects that the user has felt negative emotions. The system includes a processing unit that, upon detecting that the user has received a negative behavior from another person or that the user has experienced a negative emotion, calculates the level of the negative behavior or the level of the negative emotion, and provides the user with video and audio information from the stored positive behavior information or positive emotion information, which pertains to the positive behavior information received by the user from the person who gave the negative behavior, and corresponds to the level of the positive behavior corresponding to the level of the negative behavior, or video and audio information corresponding to the level of the positive emotion corresponding to the level of the negative emotion. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a video and audio providing device that can stabilize the user's emotions. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a functional block diagram showing an example of a video and audio providing device according to an embodiment. [Figure 2] Figure 2 shows an example of the operation of storing positive causal behavior information and positive emotional information in the memory unit. [Figure 3]Figure 3 shows an example of how a user behaves when they experience negative-causing behavior or when they experience negative emotions. [Figure 4] Figure 4 is a flowchart showing an example of the operation of a video and audio providing device according to an embodiment. [Modes for carrying out the invention]

[0009] Hereinafter, embodiments of the video and audio provisioning device according to the present invention will be described with reference to the drawings. However, the present invention is not limited by these embodiments. Furthermore, the components in the following embodiments include those that are easily substituted or substantially identical to those that are easily substituted by those skilled in the art.

[0010] Figure 1 is a functional block diagram showing an example of a video and audio providing device 100 according to this embodiment. The video and audio providing device 100 shown in Figure 1 comprises a communication unit 10, a control unit 20, and a storage unit 30. The video and audio providing device 100 may be a portable information terminal such as a smartphone, tablet, or laptop computer, a wearable device such as glasses or a watch, or a stationary terminal such as a desktop computer.

[0011] The communication unit 10 communicates with external devices via wired or wireless means. The communication unit 10 includes an interface such as a network interface card. The video and audio providing device 100 may also have a configuration that incorporates at least one of the following: a camera 40, an audio input device 50, a biological information detection device 60, a display device 70, and an audio output device 80.

[0012] The control unit 20 performs various information processing. The control unit 20 includes a processor such as a CPU (Central Processing Unit) and memory such as ROM (Read Only Memory) and RAM (Random Access Memory). The control unit 20 has an acquisition unit 21, a storage processing unit 22, and a provision processing unit 23.

[0013] The acquisition unit 21 acquires user-related information. In this embodiment, user-related information includes video and audio information captured by photographing and recording the user and their surroundings in real space or virtual space. The video and audio information are acquired in a state associated with time. In real space, for example, video and audio information can be acquired based on the results of photographing and recording the user and their surroundings using a camera or other imaging device 40 and a microphone or other audio input device 50. In virtual space, for example, video information can be acquired by recording the video of the virtual space displayed on a display device 70. In addition, audio information can be acquired by collecting the audio of the virtual space output from an audio output device 80.

[0014] The acquisition unit 21 can acquire user-related information, specifically the user's biometric information. Preferably, the user's biometric information is not immutable, such as fingerprints, but rather information whose value changes in response to external stimuli. Examples of such biometric information include heart rate, blood pressure, pulse wave, skin temperature, sweating amount, electroencephalogram, and blood flow rate. This biometric information can be detected by a biometric information detection device 60, such as a wearable device. Alternatively, the system may be configured to detect biometric information such as heart rate using the imaging results from the imaging device 40.

[0015] The memory processing unit 22 detects, based on the video and audio information acquired by the acquisition unit 21, whether the user has received positive-causing actions from others that may generate positive emotions in the user. Positive emotions include, for example, emotions corresponding to "joy" and "happiness" among joy, anger, sorrow, and pleasure, as well as emotions experienced during successful experiences. Specifically, these include feelings of happiness, comfort, exhilaration, and accomplishment. Positive-causing actions include, for example, praising, commending, comforting, empathizing, expressing gratitude, and affirming.

[0016] When the memory processing unit 22 detects that the user has received a positive-inducing action from another person, it detects the content of that positive-inducing action. The memory processing unit 22 associates the detected content of the positive-inducing action with video information and audio information in chronological order and stores it in the memory unit 30 as positive-inducing action information.

[0017] The content of a positive-inducing action includes, for example, the person who performed the positive-inducing action on the user, the circumstances under which the user received the positive-inducing action, and the level of the positive-inducing action received by the user. When the memory processing unit 22 detects that the user has received a positive-inducing action, it can generate tag information indicating the content of the positive-inducing action and store the generated tag information in the memory unit 30 in association with the positive-inducing action information. When generating tag information, for example, a machine learning model can be generated by associating video information and audio information including the scene in which the positive-inducing action was performed or the scene in which positive emotions arose with tag information that has the content of the positive-inducing action or the content of the positive emotions as items, and this machine learning model can be used. In this case, by inputting video information D1 and audio information D2 into the machine learning model, video information D1 and audio information D2 with tag information attached, i.e., positive-inducing action information or positive emotion information, are output.

[0018] Furthermore, the memory processing unit 22 detects whether or not the user has experienced a positive emotion based on the biometric information acquired by the acquisition unit 21. If the memory processing unit 22 detects that the user has experienced a positive emotion based on the biometric information acquired by the acquisition unit 21, it detects the content of the positive emotion. The content of the positive emotion includes items such as the type of positive emotion and the level of the positive emotion. The memory processing unit 22 associates the detected content of the positive emotion with the video information and audio information in chronological order and stores it in the memory unit 30 as positive emotion information. If the memory processing unit 22 detects that the user has experienced a positive emotion, it can generate tag information indicating the content of the positive emotion and store the generated tag information in the memory unit 30 in association with the positive emotion information.

[0019] The providing processing unit 23 detects whether the user has received negative cause actions that cause negative emotions to the user based on the video information and audio information acquired by the acquisition unit 21. Examples of negative emotions include emotions corresponding to "anger" and "sorrow" among joy, anger, sorrow, and happiness, and emotions during failure experiences. Specifically, emotions such as sad emotions, fear emotions, irritation, sense of loss, and restlessness can be mentioned. Also, examples of negative cause actions include getting angry, scolding, blaming, and denying.

[0020] When the providing processing unit 23 detects that the user has received negative cause actions from others, the providing processing unit 23 detects the action content of the negative cause actions. The providing processing unit 23 provides the user with the video information and audio information of positive cause actions whose action content corresponds to the negative cause actions from the stored positive cause action information. When tag information is associated with the positive cause action information, the providing processing unit 23 can easily select the video information and audio information to be provided to the user from the positive cause action information based on the tag information.

[0021] Also, when the providing processing unit 23 detects that the user has received negative cause actions from others, in addition to the video information and audio information of the positive cause action information described above, the providing processing unit 23 can extract positive content that the user has highly evaluated in the past and provide it to the user. Information regarding the positive content can be stored in the storage unit 30.

[0022] In addition, the providing processing unit 23 detects whether a negative emotion has occurred in the user based on the biological information acquired by the acquisition unit 21. When the providing processing unit 23 detects that a negative emotion has occurred in the user based on the biological information acquired by the acquisition unit 21, the providing processing unit 23 detects the emotional content of the negative emotion. The emotional content of the negative emotion includes items such as, for example, the type of negative emotion and the level of negative emotion. The providing processing unit 23 associates the detected emotional content of the negative emotion with the video information and audio information in time series and stores it in the storage unit 30 as negative emotion information. When the providing processing unit 23 detects that a negative emotion has occurred in the user, the providing processing unit 23 detects the emotional content of the negative emotion. The providing processing unit 23 provides the user with the video information and audio information of the positive emotion corresponding to the negative emotion and the emotional content from the stored positive emotion information. When tag information is associated with the positive emotion information, the providing processing unit 23 can easily select the video information and audio information to be provided to the user from the positive emotion information based on the tag information.

[0023] The storage unit 30 stores information such as various programs, data, etc. for performing the processing in the control unit 20, applications, etc. The storage unit 30 includes a storage such as an HDD (Hard Disk Drive), SSD (Solid State Drive), etc. The storage unit 30 stores the above-mentioned user-related information (video information, audio information, biological information), positive cause behavior information, positive emotion information, tag information, etc. in a state of being associated with each other in time series. In addition, the storage unit 30 stores information regarding positive content, which is content highly evaluated by the user in the past. The information regarding the positive content may be, for example, the positive content data itself, or the address on the network of the positive content, etc.

[0024] The memory unit 30 stores a video and audio provision program that causes the computer to execute the following processes: acquiring user-related information including video information, audio information, and biometric information of the user captured and recorded around the user and the user in real or virtual space; detecting the content of the positive-causing action or the content of the positive emotion when the system detects that the user has received a positive-causing action from another person that may cause the user to feel positive emotions, or that the user has felt positive emotions, based on the acquired user-related information, and storing it in the memory unit 30 as positive-causing action information or positive emotion information, associated with the video and audio information in chronological order; and detecting the content of the negative-causing action or the content of the negative emotion when the system detects that the user has received a negative-causing action from another person that may cause the user to feel negative emotions, or that the user has felt negative emotions, based on the user-related information, and providing the user with video and audio information of a positive-causing action that corresponds to the negative-causing action and its content, or video and audio information of a positive emotion that corresponds to the negative emotion and its content, from among the stored positive-causing action information or positive emotion information.

[0025] In the video and audio providing device 100, the processor in the control unit 20 reads various programs and loads them into memory, thereby executing information processing corresponding to the functions of each of the above-mentioned parts. Examples of various programs include programs received by the communication unit 10, programs stored in the storage unit 30, and programs recorded on an external recording medium. The video and audio providing device 100 functions as an information processing device (computer) that performs various information processing. Note that other information processing devices different from the video and audio providing device 100 may execute various programs, or the video and audio providing device 100 and other information processing devices may cooperate to execute various programs.

[0026] Next, an example of the operation of the video and audio providing device 100 configured as described above will be explained. First, the operation of storing positive behavioral information and positive emotional information in the storage unit 30 will be explained. Figure 2 is a diagram showing an example of the operation of storing positive behavioral information and positive emotional information in the storage unit 30. As shown in Figure 2, first, the shooting device 40 such as a camera and the audio input device 50 such as a microphone are used to photograph and collect sound from the user and the user's surroundings, and the results of the shooting and collection are input to the video and audio providing device 100 as video information D1 and audio information D2. In addition, the biometric information detection device 60 such as a wearable device detects the user's biometric information, and the detection result is input to the video and audio providing device 100 as biometric information D3. The acquisition unit 21 acquires the input video information D1, audio information D2 and biometric information D3 as user-related information. Note that shooting by the shooting device 40 may be performed continuously, or shooting may be started when a sensor (not shown) detects that a person is approaching the surroundings. Furthermore, if the fluctuation in the detection result of the biological information detection device 60 exceeds a threshold, the camera 40 may start taking images and the audio input device 50 may start collecting sounds.

[0027] The memory processing unit 22 detects whether the user has received a positive response from another person based on the acquired video information D1 and audio information D2. The memory processing unit 22 detects the user, for example, through image processing, and if there is a person to whom the user is interacting, it detects that person. The memory processing unit 22 determines whether the user has received a positive response from the other person by analyzing, for example, the facial expressions, gestures, and words spoken by the other person. For example, if the memory processing unit 22 detects facial expressions, gestures, or words from the other person such as praising, commending, comforting, empathizing, thanking, or affirming the user, it determines that the user has received a positive response from that person. In this case, the memory processing unit 22 detects the content of the positive response based on the other person's facial expressions, gestures, and words. In this case, the memory processing unit 22 can detect, for example, the person from whom the user received the positive response, the circumstances under which the user received the positive response, and the level of the positive response received by the user. The memory processing unit 22 generates the detected content of the response as tag information T1.

[0028] The memory processing unit 22 associates the video information D11 and audio information D21 that include the portion in which the user received a positively motivated action with the generated tag information T1 in chronological order and stores them in the memory unit 30 as positively motivated action information D4.

[0029] For example, if a scene in which a user is highly praised for their work by their supervisor A is captured and recorded by the camera 40 and the audio input device 50, the video information D11 and audio information D21 of the scene in which the user is praised by supervisor A are stored in the memory unit 30 as positive behavior information D4. At this time, the identification information of supervisor A, the "recipient," the "situation" being work-related, and a numerical value indicating that the praise was very strong (for example, 4 or 5 on a 5-point scale) are generated as tag information T1 and stored in the memory unit 30 in association with the positive behavior information D4.

[0030] Furthermore, the memory processing unit 22 detects whether or not the user has experienced a positive emotion based on the acquired biometric information D3. The memory processing unit 22 can detect, for example, whether or not a change in emotion has occurred in the user, and to what extent, based on the detected value of the biometric information D3, the amount of change in the detected value, etc. If the memory processing unit 22 detects that the user has experienced a positive emotion, it detects the content of that positive emotion. The memory processing unit 22 can detect, for example, the type of positive emotion and the level of that positive emotion as the content of the positive emotion. The memory processing unit 22 generates the detected emotion content as tag information T2.

[0031] The memory processing unit 22 associates the video information D12 and audio information D22, which occur when a positive emotion is felt by the user, with the generated tag information T2 in chronological order and stores them in the memory unit 30 as positive emotion information D5. Furthermore, by using the time correspondence relationship between the video information D12 and audio information D22 and the biometric information D3, the video information D1 and audio information D2 from the time corresponding to the time when the positive emotion occurred can be acquired as video information D12 and audio information D22.

[0032] For example, if a user experiences a strong feeling of happiness when their supervisor A praises them enthusiastically for their work, and this scene is captured and recorded by the camera 40 and audio input device 50, the video information D12 and audio information D22 of the scene in which the user experienced happiness are stored in the memory unit 30 as positive emotion information D5. At this time, information about the "type" of positive emotion, namely happiness, and a numerical value indicating the strength of the happiness (for example, 4 or 5 on a 5-point scale) are generated as tag information T2 and stored in the memory unit 30 in association with the positive emotion information D5.

[0033] Similarly, if a user experiences a strong feeling of happiness, such as achieving good results in a sports competition, getting a good score on a test, or being praised by a teacher for playing a musical instrument, and this is captured and recorded by the camera 40 and audio input device 50, the video information D12 and audio information D22 of that scene are stored in the memory unit 30 as positive emotion information. At this time, the type of positive emotion and the level of the positive emotion are generated as tag information T2 and stored in the memory unit 30 in association with the positive emotion information.

[0034] Next, we will describe the actions taken when the user experiences negatively triggered behavior or when negative emotions arise in the user. Figure 3 shows an example of the actions taken when the user experiences negatively triggered behavior or when negative emotions arise in the user. As shown in Figure 3, a camera or other imaging device 40 and a microphone or other audio input device 50 capture images and sound of the user and their surroundings, and the results of the capturing and sound collection are input to the video and audio providing device 100 as video information D1 and audio information D2. In addition, a biometric information detection device 60 such as a wearable device detects the user's biometric information, and the detection result is input to the video and audio providing device 100 as biometric information D3. The acquisition unit 21 acquires the input video information D1, audio information D2, and biometric information D3 as user-related information. As described above, the camera 40 may capture images continuously, or it may start capturing images when a sensor (not shown) detects that a person is approaching. In addition, the camera 40 may start capturing images and the audio input device 50 may start collecting sound when the fluctuation in the detection result of the biometric information detection device 60 exceeds a threshold.

[0035] The processing unit 23 detects whether the user has experienced negative behavior from another person based on the acquired video information D1 and audio information D2. The processing unit 23 detects the user, for example, through image processing, and if there is a person to whom the user is interacting, it detects that person. The processing unit 23 determines whether the user has experienced negative behavior from the other person by analyzing, for example, the facial expressions, gestures, and words spoken by the other person. For example, if the processing unit 23 detects facial expressions, gestures, or words from the other person that indicate anger, reprimand, blame, or denial towards the user, it determines that the user has experienced negative behavior from that person. In this case, the processing unit 23 detects the content of the negative behavior based on the other person's facial expressions, gestures, and words. In this case, the processing unit 23 can detect the person who subjected the user to the negative behavior, the circumstances under which the user experienced the negative behavior, and the level of the negative behavior the user experienced.

[0036] When the provision processing unit 23 detects the content of a negative-causing behavior, it provides the user with video information D11 and audio information D21 of the positive-causing behavior that corresponds to the negative-causing behavior, selected from the positive-causing behavior information D4 stored in the storage unit 30. Various methods of providing this information to the user include, for example, supplying the video information D11 and audio information D21 data, displaying it on the display device 70, and outputting it to the audio output device 80.

[0037] For example, if the camera 40 and audio input device 50 capture and record a scene in which the user is then thoroughly reprimanded by the same supervisor A for their work, the providing processing unit 23 detects the identification information of supervisor A, the "situation," which is work-related, and a numerical value indicating that the reprimand was very strong (for example, 4 or 5 on a 5-point scale) as the content of the negative-causing behavior. In this case, the providing processing unit 23 can provide the user with the video information D11 and audio information D21 of the positive-causing behavior that corresponds to the negative-causing behavior, from the positive-causing behavior information D4 stored in the storage unit 30, as the video information D11 and audio information D21 of the above-mentioned extensive praise.

[0038] In addition, the provision processing unit 23 can extract positive content C that the user has previously given a high rating to from the storage unit 30, in addition to the video information D11 and audio information D21, and provide it to the user.

[0039] Furthermore, the providing processing unit 23 detects whether or not the user has experienced a negative emotion based on the acquired biometric information D3. The providing processing unit 23 can detect, for example, whether or not a change in emotion has occurred in the user, and to what extent, based on the detected value of the biometric information D3, the amount of change in the detected value, etc. If the providing processing unit 23 detects that the user has experienced a negative emotion, it detects the content of the negative emotion. The providing processing unit 23 can detect, for example, the type of negative emotion and the level of the negative emotion as the content of the negative emotion. If the providing processing unit 23 detects the content of a negative emotion, it provides the user with video information D12 and audio information D22 of a positive emotion that corresponds to the negative emotion and its content, selected from the positive emotion information stored in the storage unit 30.

[0040] For example, if a user makes a mistake at work and experiences strong feelings of distress, and this is captured and recorded by the recording device 40 and the audio input device 50, the providing processing unit 23 detects the "type" of the negative emotion, which is information about the distressing emotion, and the "level," which is a numerical value indicating how strong the distressing emotion was (for example, 4 or 5 on a 5-point scale), as the emotional content of the negative emotion. In this case, the providing processing unit 23 can provide the user with video information D12 and audio information D22 of the scene in which the user experienced strong feelings of happiness from being praised extensively, as video information D12 and audio information D22 of the positive emotion corresponding to the negative emotion in question, from among the positive emotion information stored in the storage unit 30.

[0041] Similarly, if the camera 40 and audio input device 50 capture and record a scene in which the user experiences strong negative emotions, such as when the user is upset because they did not perform well in a sports competition, when they did not get good grades on a test, when studying becomes difficult, or when they are upset because they could not play a musical instrument well, the providing processing unit 23 will also detect that the user has experienced negative emotions. In this case, the providing processing unit 23 can provide the user with video information D12 and audio information D22 of positive emotions that correspond to the negative emotion in question, from the positive emotion information stored in the memory unit 30. For example, video information D12 and audio information D22 of a scene in which the user achieved good results in a sports competition, when they got good grades on a test, or when they were praised by their teacher for playing a musical instrument.

[0042] Figure 4 is a flowchart showing an example of the operation of the video and audio providing device 100 according to this embodiment. As shown in Figure 4, the acquisition unit 21 acquires video and audio information captured and recorded of the user and their surroundings in real space or virtual space, as well as user-related information including the user's biometric information (step S10).

[0043] If the memory processing unit 22 detects, based on the acquired user-related information, that the user has received a positive-causing action from another person or that the user has experienced a positive emotion (Yes in step S20), the memory processing unit 22 detects the content of the positive-causing action or the content of the positive emotion (step S30). The memory processing unit 22 stores the detected content of the action or emotion in the memory unit 30 as positive-causing action information and positive emotion information, associating them with the video information and audio information (step S40). If, in step S20, it is not detected that the user has received a positive-causing action from another person or that the user has experienced a positive emotion (No in step S20), the process in step S20 is repeated.

[0044] If the providing processing unit 23 detects, based on the acquired user-related information, that the user has experienced a negative-causing behavior from another person or that the user has experienced a negative emotion (Yes in step S50), the providing processing unit 23 detects the content of the negative-causing behavior or the content of the negative emotion (step S60). The providing processing unit 23 extracts from the stored positive-causing behavior information or positive emotion information the video and audio information of the positive-causing behavior that corresponds to the content of the negative-causing behavior, or the video and audio information of the positive emotion that corresponds to the content of the negative emotion, and provides it to the user (step S70). If, in step S50, the providing processing unit 23 does not detect that the user has experienced a negative-causing behavior from another person or that the user has experienced a negative emotion (No in step S50), the processing in step S50 is repeated.

[0045] As described above, the video and audio providing device 100 according to this embodiment includes: an acquisition unit 21 that acquires user-related information including video and audio information captured and recorded of the user and their surroundings in real space or virtual space; a storage processing unit 22 that, based on the acquired user-related information, detects the content of the positive-causing action or the content of the positive emotion when it is detected that the user has received a positive-causing action from another person that may cause the user to feel positive emotions, or that the user has felt positive emotions, and stores it in the storage unit 30 as positive-causing action information or positive emotion information in chronological order with the video and audio information; and a providing processing unit 23 that, based on the user-related information, detects the content of the negative-causing action or the content of the negative emotion when it is detected that the user has received a negative-causing action from another person that may cause the user to feel negative emotions, or that the user has felt negative emotions, and provides the user with video and audio information of a positive-causing action that corresponds to the negative-causing action and its content, or video and audio information of a positive emotion that corresponds to the negative emotion and its content, from among the stored positive-causing action information or positive emotion information.

[0046] With this configuration, when it is detected that the user has experienced a negative-causing action from another person or that the user has experienced a negative emotion, the user is provided with video and audio information of a positive action that corresponds to the negative action and its content, or video and audio information of a positive emotion that corresponds to the negative emotion and its content, from the positive-causing action information or positive emotion information stored in the memory unit 30. By using this video and audio information to remind the user of positive actions they have experienced in the past or positive emotions they have experienced in the past, it is possible to move away from negative emotions and switch to positive feelings. This helps to stabilize the user's emotions.

[0047] In the video and audio providing device 100 according to this embodiment, the storage processing unit 22 detects when a user has received a positive-causing action using video information and audio information as user-related information, and the providing processing unit 23 detects when a user has received a negative-causing action using video information and audio information as user-related information.

[0048] This configuration allows for the appropriate detection of positive and negative behaviors using video and audio information.

[0049] In the video and audio providing device 100 according to this embodiment, the acquisition unit 21 acquires the user's biometric information as user-related information, the storage processing unit 22 detects when a positive emotion arises in the user using the biometric information as user-related information, and the providing processing unit 23 detects when a negative emotion arises in the user using the biometric information as user-related information.

[0050] This configuration allows for the appropriate detection of positive and negative emotions based on biometric information.

[0051] In the video and audio providing device 100 according to this embodiment, if the providing processing unit 23 detects that the user has experienced a negative-causing action or has developed negative emotions based on user-related information, it extracts positive content that the user has previously given a high rating to and provides it to the user.

[0052] This configuration allows us to shift users' feelings from negative to positive from a wide range of perspectives by providing them with positive content that they have previously rated highly.

[0053] In the video and audio providing device 100 according to this embodiment, when the memory processing unit 22 detects that the user has received a positive-inducing action or that the user has experienced a positive emotion, it generates tag information indicating the content of the positive-inducing action or the content of the positive emotion, and stores the generated tag information in the memory unit 30 in association with the positive-inducing action information or the positive emotion information.

[0054] With this configuration, tag information indicating the content of positively motivated behaviors or positively emotional content is generated and stored in the storage unit 30 in association with the positively motivated behavior information or positively emotional information. As a result, the positively motivated behavior information or positively emotional information stored in the storage unit 30 can be easily searched for each type of behavior or emotional content.

[0055] The technical scope of the present invention is not limited to the embodiments described above, and modifications can be made as appropriate without departing from the spirit of the invention. [Explanation of Symbols]

[0056] C... Positive content, D1, D11, D12... Video information, D2, D21, D22... Audio information, D3... Biometric information, D4... Positive behavioral information, D5... Positive emotional information, T, T1, T2... Tag information, 10... Communication unit, 20... Control unit, 21... Acquisition unit, 22... Memory processing unit, 23... Provisioning processing unit, 30... Memory unit, 40... Shooting device, 50... Audio input device, 60... Biometric information detection device, 70... Display device, 80... Audio output device, 100... Video and audio provisioning device

Claims

1. An acquisition unit that acquires user-related information, including video and audio information captured and recorded of the user and their surroundings in real or virtual space, A storage processing unit, based on the acquired user-related information, detects when the user has received a positive-causing action from another person that may cause the user to feel positive emotions, or when the user has felt positive emotions, and stores in the storage unit as positive-causing action information or positive emotion information, in chronological order in association with the video information and audio information. Based on the user-related information, when it is detected that the user has received a negative-causing action from another person that causes the user to experience negative emotions, or that the user has experienced negative emotions, the processing unit detects the content of the negative-causing action or the content of the negative emotion, and provides the user with the video and audio information of the positive action that corresponds to the negative action and its content, or the video and audio information of the positive emotion that corresponds to the negative emotion and its content, from among the stored positive-causing action information or positive emotion information. A video and audio providing device equipped with the following features.

2. The memory processing unit detects that the user has received the positive cause action using the video information and audio information as user-related information. The processing unit detects that the user has experienced the negative behavior using the video information and audio information as user-related information. The video and audio providing device according to claim 1.

3. The acquisition unit acquires the user's biometric information as user-related information. The memory processing unit detects that the user has experienced positive emotions using the biometric information as user-related information. The processing unit, using the biometric information as user-related information, detects that the user has experienced negative emotions. The video and audio providing device according to claim 1.

4. If the provision processing unit detects, based on the user-related information, that the user has experienced the negative-causing behavior or that the user has developed negative emotions, it extracts positive content that the user has previously given a high rating to and provides it to the user. The video and audio providing device according to claim 1.

5. When the memory processing unit detects that the user has received the positive-inducing action or that the user has experienced a positive emotion, it generates tag information indicating the content of the positive-inducing action or the content of the positive emotion, and stores the generated tag information in the memory unit in association with the positive-inducing action information or the positive emotion information. The video and audio providing device according to claim 1.

Images