Information processing device, information processing method, and program

Abstract

Provided are a device and method for performing a notification process in which a process for outputting a scent corresponding to content is being executed. The device has, for example, a control unit that executes reproduction control of content such as VR content. The control unit further executes output control of a scent corresponding to the content being reproduced, and executes notification processing that the scent output processing is being executed when executing the output processing of the scent corresponding to the content being reproduced. When executing the output processing of the scent corresponding to the content being reproduced, the control unit executes a voice message or a image output such as an icon or the like by which the scent output processing being executed and the type of the scent can be identified.

Description

Information processing device, information processing method, and program

[0001] The present disclosure relates to an information processing device, an information processing method, and a program, and more particularly to an information processing device, an information processing method, and a program that output an odor corresponding to an object in content being played back when the content is being played back.

[0002] For example, when content such as game content is played back, a device has been proposed that outputs a smell associated with an object in the content in order to enhance the sense of realism and immersion of the viewing user.

[0003] For example, when playing content including a scene of a burning fire, a burnt smell may be output. When playing content including a scene of a flower field, a floral scent may be output. Patent Document 1 (JP 2019-046495 A) is an example of a conventional technology that discloses a device capable of outputting various smells.

[0004] However, for example, when a user wears a content playback device such as VR goggles to watch content, the user cannot observe the outside world while wearing the VR goggles. In such a case, the content viewing user may be unable to distinguish whether an odor is being output by the device in response to the content being viewed or whether it is a real odor unrelated to the content. For example, even if a fire is actually occurring around the user, the user may not notice the fire.

[0005] Furthermore, if there are people around a user wearing VR goggles and watching content, the people may mistake the smell output by the device for a real smell, and if the device outputs a burning smell, they may become anxious and think that something is actually burning.

[0006] Japanese Patent Application Laid-Open No. 2019-046495

[0007] The present disclosure has been made in consideration of, for example, the above-mentioned problems, and provides an information processing device, an information processing method, and a program that, when using a device that outputs an odor corresponding to the content being played, can inform people around the content viewing user whether the odor is an odor being output from the device or an actual odor.

[0008] In addition, one embodiment of the present disclosure provides an information processing device, an information processing method, and a program that, when using a device that outputs an odor corresponding to the content being played, can inform a content viewing user whether the odor is an odor being output from the device or an actual odor.

[0009] A first aspect of the present disclosure is an information processing device that has a control unit that executes content playback control, the control unit executes odor output control corresponding to the content being played, and when executing the odor output process corresponding to the content being played, executes a notification process that the odor output process is being executed.

[0010] Furthermore, a second aspect of the present disclosure is an information processing method executed in an information processing device, wherein the information processing device has a control unit that controls content playback, the control unit controls the output of an odor corresponding to the content being played, and when the output process of an odor corresponding to the content being played is executed, the information processing method executes a notification process that the odor output process is being executed.

[0011] Furthermore, a third aspect of the present disclosure is a program for causing an information processing device to execute information processing, the information processing device having a control unit that executes content playback control, the program causing the control unit to execute control of outputting an odor corresponding to the content being played, and, when executing the output process of an odor corresponding to the content being played, execute a notification process that the odor output process is being executed.

[0012] The program of the present disclosure is, for example, a program that can be provided in a computer-readable format via a storage medium or a communication medium to an information processing device or a computer system capable of executing various program codes. By providing such a program in a computer-readable format, processing according to the program is realized on the information processing device or the computer system.

[0013] Further objects, features, and advantages of the present disclosure will become apparent from the following detailed description of the embodiments of the present disclosure and the accompanying drawings. Note that in this specification, a system refers to a logical collective configuration of multiple devices, and is not limited to devices that are housed in the same housing.

[0014] According to a configuration of an embodiment of the present disclosure, a device and method are realized that perform notification processing that a content-specific odor output process is being executed. Specifically, the device includes a control unit that controls playback of content such as VR content. The control unit further controls the output of an odor corresponding to the content being played, and, when the odor output process corresponding to the content being played is being executed, performs notification processing that the odor output process is being executed. When the odor output process corresponding to the content being played is being executed, the control unit outputs a voice message or an image such as an icon that indicates that the odor output process is being executed and that the type of odor can be identified. This configuration realizes a device and method that perform notification processing that a content-specific odor output process is being executed. Note that the effects described in this specification are merely examples and are not limiting, and additional effects may also be present.

[0015] FIG. 1 is a diagram illustrating processing executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating processing executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating processing executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating odor output notification processing for surrounding people executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating odor output notification processing for surrounding people executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating odor output notification processing for content viewing users executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating odor output notification processing for content viewing users executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating processing executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating odor output notification processing for surrounding people executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating odor output notification processing for content viewing users executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating odor output notification processing for content viewing users executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating odor output notification processing for content viewing users executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating odor output notification processing for content viewing users executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating odor generation notification processing in real space for content viewing users executed by an information processing device of the present disclosure. FIG. 1 is a diagram illustrating an odor output notification process executed by an information processing device of the present disclosure. FIG. 2 is a diagram illustrating an odor output notification process executed by an information processing device of the present disclosure. FIG. 3 is a diagram illustrating an odor output notification process executed by an information processing device of the present disclosure. FIG. 4 is a diagram illustrating an odor output notification process executed by an information processing device of the present disclosure. FIG. 5 is a diagram illustrating an odor output notification process executed by an information processing device of the present disclosure. FIG. 6 is a diagram illustrating a voice message control process executed by an information processing device of the present disclosure. FIG. 7 is a diagram illustrating an odor output notification process executed by an information processing device of the present disclosure.Fig. 1 is a diagram illustrating a flowchart for explaining a processing sequence of an odor output notification process executed by an information processing device of the present disclosure. Fig. 2 is a diagram illustrating a flowchart for explaining a processing sequence of an odor output notification process executed by an information processing device of the present disclosure. Fig. 3 is a diagram illustrating a configuration example of an information processing device of the present disclosure. Fig. 4 is a diagram illustrating a hardware configuration example of an information processing device of the present disclosure.

[0016] The information processing device, information processing method, and program of the present disclosure will be described in detail below with reference to the drawings. The description will be made according to the following items: 1. Processing executed by the information processing device of the present disclosure 2. Example of outputting an odor other than a burning odor 3. Configuration for notifying a content viewing user of the generation of an actual odor in real space 4. 4. Other Examples 4-(1) Example of display data on the outer display unit 23 of the VR goggles 20 4-(2) Example of odor source notification processing using equipment other than a content playback device 4-(3) Example of processing for notifying a content viewing user of an odor source by, for example, vibrating the device worn by the user 4-(4) Example of processing for notifying people around the content viewing user of an odor source by, for example, vibrating the device of the people around the content viewing user 4-(5) Example of processing for making the message audio less audible to the content viewing user when a warning message is output 4-(6) Example of processing for outputting a message after odor generation has ended 4-(7) Example of notification processing for distinguishing between a state caused by content other than odor and an actual state in real space 5. Sequence of processing executed by the information processing device of the present disclosure 6. Example of configuration of the information processing device of the present disclosure 7. Example of hardware configuration of the information processing device of the present disclosure 8. Summary of configuration of the present disclosure

[0017] 1. Processing Executed by the Information Processing Apparatus of the Present Disclosure First, processing executed by the information processing apparatus of the present disclosure will be described with reference to FIG. 1 and subsequent drawings.

[0018] 1 is a diagram showing a state in which a user 10 is wearing VR goggles 20, which is an example of an information processing device disclosed herein, and viewing content. The VR goggles 20 are goggles that display and enable observation of virtual reality images (VR images). Based on control by a control unit of the VR goggles 20, a display process of the virtual reality images (VR images) is executed on a display unit of the VR goggles 20.

[0019] 1 , the VR goggles 20 are provided with an odor output unit 21. The odor output unit 21 outputs an odor associated with an object included in the content being viewed by the user 10, i.e., the display content of the VR goggles 20, based on the control of the control unit of the VR goggles 20. In other words, the VR goggles 20 output an odor associated with the reproduced content or an object within the reproduced content via the odor output unit 21.

[0020] 1, the playback content 30 displayed on the VR goggles 20 is image content showing a fire. In this case, the odor output unit 21 outputs a burning odor under the control of the control unit of the VR goggles 20.

[0021] A user 10 viewing the content will smell a burning odor while viewing image content depicting a fire. By performing this odor output process, the user 10 can view the content while increasing the sense of realism and immersion in the content.

[0022] The VR goggles 20 are an example of an information processing device of the present disclosure. The information processing device of the present disclosure is not limited to VR goggles, but also includes various devices capable of reproducing content, such as PCs, smartphones, tablet devices, televisions, etc. Furthermore, an odor output device that executes processing in cooperation with these content reproduction devices is also included in the information processing device of the present disclosure.

[0023] 2 is a diagram showing an example of a configuration using an odor output device 40 that executes processing in cooperation with the VR goggles 20. The VR goggles 20 and the odor output device 40 are configured to be able to communicate with each other using, for example, Bluetooth (registered trademark). The control unit of the VR goggles 20 transmits an odor output instruction command to the odor output device 40 to output an odor corresponding to the playback content.

[0024] The odor output device 40 outputs various odors in accordance with the odor output instruction command received from the VR goggles 20. In the example shown in Fig. 2, the playback content 30 displayed on the VR goggles 20 is image content showing a fire, similar to the example in Fig. 1. In this case, the VR goggles 20 transmits an odor output instruction command to the odor output device 40 to output a burning odor, which is an odor corresponding to the playback content.

[0025] The odor output device 40 outputs a burnt odor in accordance with an odor output instruction command for a burnt odor received from the VR goggles 20.

[0026] However, if such a smell corresponding to the content is output to the surroundings, there is a possibility that people nearby may mistake the smell output by the device for a real smell. If the device outputs a burning smell, people nearby may become anxious, thinking that something is actually burning. An example is shown in Figure 3.

[0027] The example in Fig. 3 shows a state in which a user 10 is viewing the fire content described with reference to Fig. 1 using VR goggles 20. A burning smell is being output from the smell output unit 21 of the VR goggles 20. As shown in Fig. 3, there are several people near the user 10 who are not viewing the content.

[0028] In such a case, people in the vicinity may mistake the burning smell output by the device (the smell output unit 21 of the VR goggles 20) for a real smell and become anxious, thinking that something is actually burning.

[0029] In order to solve such a problem, the information processing device of the present disclosure, for example, the VR goggles 20, outputs a warning message to the surroundings via the speaker 22 of the VR goggles 20 as shown in Fig. 4. For example, in the example shown in Fig. 4, the following message is output: "Beep, beep, it's time to die now"

[0030] By hearing this message, people around the user 10, i.e., people who are not viewing the content, can be reassured by reassuring them that the burning smell is not a real smell, but a smell output by the device (VR goggles 20 or smell output device 40).

[0031] The example shown in Fig. 4 is an example in which a warning message is output as audio from the VR goggles 20, but for example, as shown in Fig. 5, a configuration may be adopted in which a warning image (image of a flame) indicating an odor output object in the content being viewed by the user 10, such as a "flame image," is output and displayed on the external display unit 23 of the VR goggles 20. Alternatively, a configuration may be adopted in which a message indicating that an odor is being output is output. Note that the external display unit 23 is a display unit attached to the outside of the VR goggles 20 and is a display unit that can display images that can be observed from the outside.

[0032] People around the user 10, i.e., people who are not viewing the content, can confirm by looking at the warning image (image showing the odor output object (image of a flame)) displayed on the external display unit 23 that the burning smell is not a real smell, but a smell being output by the device (VR goggles 20 or odor output device 40).

[0033] The audio warning message output process described with reference to FIG. 4 and the warning image output process described with reference to FIG. 5 may be configured to be executed together. For example, as shown in FIG. 6, the following audio warning message is output via the speaker 22 of the VR goggles 20: "Beep, beep, it's time to burn." Furthermore, a warning image (a flame image) indicating the odor output object is output and displayed on the external display unit 23 of the VR goggles 20. These processes may be configured to be executed in parallel. Furthermore, in conjunction with these processes, time information indicating how long the device plans to continue outputting the odor may be output by voice or displayed as numbers or a message. For example, a message such as "The odor is scheduled to continue for another 30 seconds" may be displayed.

[0034] In this way, when outputting an odor according to content, the information processing device (e.g., the VR goggles 20) of the present disclosure outputs an audio message, a warning image, or a warning message that can be confirmed by people in the vicinity. These processes allow people in the vicinity other than the content viewing user to confirm that the odor is not a real odor, but an odor being output by a device (the VR goggles 20 or the odor output device 40).

[0035] Furthermore, when the user 10 is watching content using an information processing device, for example, while wearing the VR goggles 20, the user 10 may be unable to observe the outside world. In such cases, the user 10 watching the content may be unable to distinguish whether the smell he or she is sensing is an smell output by the device in accordance with the content being viewed, or a real smell unrelated to the content. For example, even if a fire is actually breaking out around the user 10, the user may not notice the fire.

[0036] A configuration for solving this problem will be described with reference to Fig. 7. Fig. 7 shows a user 10 wearing VR goggles 20, which is an example of an information processing device according to the present disclosure, and viewing content.

[0037] 7, as explained above with reference to FIG. 1 etc., the playback content 30 displayed on the VR goggles 20 is image content showing a state in which a fire has broken out. In this case, the odor output unit 21 outputs a burning odor. The user 10 viewing the content will smell the burning odor while viewing the image content showing a state in which a fire has broken out.

[0038] The VR goggles 20, which are the information processing device of the present disclosure, display an "odor output identification icon 31" in the upper left corner of the playback content 30 displayed on the display unit, as shown on the right side of Figure 7.

[0039] A user 10 wearing VR goggles 20 and viewing the playback content 30 can recognize that an odor (a burning odor) is being output from the device (VR goggles 20 or odor output device 40) by looking at the "odor output identification icon 31" displayed on the display unit along with the content.

[0040] In other words, the user 10 can know that the burning smell that the user 10 is experiencing is an odor output from the device (VR goggles 20 or odor output device 40) and is not a real odor.

[0041] On the other hand, for example, if the user 10 smells a burning smell even though the "smell output identification icon 31" is not displayed, the user 10 can infer that the burning smell is a real smell emanating from the real space, and can immediately notice if, for example, something is burning nearby.

[0042] The example shown in Figure 7 is an example in which an "odor output identification icon 31" is displayed in conjunction with the playback content 30 displayed on the display unit of the VR goggles 20, thereby notifying the content viewing user that an odor related to an object (flame) in the playback content is being output from the device.

[0043] Note that the example of the process for notifying that an odor related to an object (fire) in the playback content is being output from the device is not limited to the icon display process described with reference to Figure 7, but may also be a configuration that performs processing such as that shown in Figure 8, for example.

[0044] The example shown in Figure 8 is a processing example in which an odor output object (flame) in the reproduced content is highlighted to notify the user 10 watching the content that an odor (burning odor) is being output from a device (VR goggles 20 or odor output device 40). As shown in "Odor output object (flame) highlighting 32" in Figure 8, the image portion of the "flame" which is the odor output object in the reproduced content 30 is highlighted.

[0045] A user 10 wearing VR goggles 20 and viewing the playback content 30 can see that the "flame," an odor output object within the content, is highlighted, and can recognize that an odor (a burning odor) is being output from the device (VR goggles 20 or odor output device 40).

[0046] In other words, the user 10 can know that the burning smell that the user 10 is experiencing is an odor output from the device (VR goggles 20 or odor output device 40) and is not a real odor.

[0047] In this way, when an odor is output from a device (the VR goggles 20 or the odor output device 40), the information processing device (such as the VR goggles 20) of the present disclosure not only outputs a warning to the surroundings but also provides information to the content viewing user that enables the user to identify whether or not an odor is being output. Note that, in addition to displaying an odor output identification icon and highlighting the odor output object, the device may also be configured to output a message indicating that an odor is being output.

[0048] By performing these processes, not only people around the content viewing user but also the content viewing user himself / herself can distinguish whether the smell being emitted is a real smell or a smell being output by the device in conjunction with the content.

[0049] 2. Example of Outputting an Odor Other Than a Burnt Odor Next, an example of outputting an odor other than a burnt odor will be described.

[0050] The embodiment described with reference to FIGS. 1 to 8 is an example in which the content viewed by the user 10 wearing the VR goggles 20 is image content of a fire, and a burning smell is output.

[0051] The odor output unit 21 of the information processing device (such as the VR goggles 20) disclosed herein and the odor output device 40 described with reference to Fig. 2 are configured to be able to output various odors other than burnt odors, and even when the output odor is different, they output information that enables surrounding people and content viewing users to distinguish whether or not the device is outputting an odor. An example of processing for outputting a floral odor will be described with reference to Fig. 9 and subsequent figures.

[0052] 9 shows a state in which a user 10 wearing VR goggles 20 is viewing image content of a flower field as playback content 30. In this case, the scent output unit 21 of the VR goggles 20 outputs the sweet scent of flowers. The user 10 viewing the content can smell the sweet scent of flowers while viewing the image content of the flower field. By performing such scent output processing, the user 10 can view the content while increasing the sense of realism and immersion in the content.

[0053] However, when a device outputs the sweet scent of flowers, people around may be curious about where the scent is coming from. The information processing device of the present disclosure, for example, the VR goggles 20, outputs a warning message to those around via the speaker 22 of the VR goggles 20 as shown in Fig. 10. For example, in the example shown in Fig. 10, the following message is output: "Beep, beep, the flowers smell sweet now."

[0054] By hearing this message, people around the user 10, i.e., people who are not viewing the content, can be reassured by reassuring them that the sweet smell of the flowers is not a real smell, but a smell output by the device (VR goggles 20 or smell output device 40).

[0055] 10 is an example in which a warning message is output as audio from the VR goggles 20, but for example, as shown in Fig. 11, a warning image (flower image) indicating an odor output object in the content being viewed by the user 10, such as a "flower image," may be output and displayed on the external display unit 23 of the VR goggles 20. Alternatively, a message indicating that an odor is being output may be output.

[0056] People around the user 10, i.e., people who are not viewing the content, can see the warning image (image showing the odor output object (flower image)) displayed on the external display unit 23 and confirm that the sweet smell of the flower is not a real smell, but a smell output by the device (VR goggles 20 or odor output device 40).

[0057] The audio warning message output process described with reference to Fig. 10 and the warning image output process described with reference to Fig. 11 may be configured to be executed together. For example, as shown in Fig. 12, the following audio warning message is output via the speaker 22 of the VR goggles 20: "Beep, beep, now smell the flower." Furthermore, a warning image (flower image) indicating the odor output object is output and displayed on the external display unit 23 of the VR goggles 20. These processes may be configured to be executed in parallel.

[0058] In this way, the information processing device (e.g., the VR goggles 20) of the present disclosure outputs a voice message, a warning image, or a warning message that can be confirmed by people in the vicinity when outputting an odor according to content. These processes allow people in the vicinity other than the content viewing user to confirm that the odor is not a real odor but an odor being output by a device (the VR goggles 20 or the odor output device 40).

[0059] Figures 13 and subsequent figures illustrate the process of outputting information notifying the user 10, who is the content viewing user, of the source of the odor. Figure 13 shows an example in which the user 10 is wearing VR goggles 20 and viewing image content of a flower field. In this case, the odor output unit 21 outputs the sweet odor of flowers. The VR goggles 20, which are the information processing device of the present disclosure, display an "odor output identification icon 31" in the upper left corner of the playback content 30 displayed on the display unit, as shown on the right side of Figure 13.

[0060] A user 10 wearing VR goggles 20 and viewing the playback content 30 can recognize that a scent (the sweet scent of flowers) is being output from the device (VR goggles 20 or scent output device 40) by looking at the "scent output identification icon 31" displayed on the display unit along with the content.

[0061] In other words, the user 10 can know that the sweet smell of the flowers that the user 10 is sensing is a smell output from the device (VR goggles 20 or smell output device 40) and is not a real smell.

[0062] On the other hand, for example, if the user 10 senses the sweet smell of flowers even though the "scent output identification icon 31" is not displayed, the user 10 can infer that the sweet smell of flowers is a real smell emanating from the real space.

[0063] The example shown in Figure 14 is a processing example in which an odor output object (flower) in the reproduced content is highlighted to notify the user 10 watching the content that an odor (the sweet odor of a flower) is being output from a device (VR goggles 20 or odor output device 40). As shown in "Odor output object (flower) highlighting 32" in Figure 14, the image portion of the "flower", which is the odor output object in the reproduced content 30, is highlighted.

[0064] A user 10 wearing VR goggles 20 and viewing the playback content 30 can see that the "flower," an odor output object within the content, is highlighted, and can recognize that an odor (the sweet odor of a flower) is being output from the device (VR goggles 20 or odor output device 40).

[0065] In other words, the user 10 can know that the sweet smell of the flowers that the user 10 is sensing is a smell output from the device (VR goggles 20 or smell output device 40) and is not a real smell.

[0066] In this way, when an odor is output from a device (the VR goggles 20 or the odor output device 40), the information processing device (such as the VR goggles 20) of the present disclosure not only outputs a warning to the surroundings but also provides information to the content viewing user that enables the user to identify whether or not an odor is being output. Note that, in addition to displaying an odor output identification icon and highlighting the odor output object, the device may also be configured to output a message indicating that an odor is being output.

[0067] By performing these processes, not only people around the content viewing user but also the content viewing user himself / herself can distinguish whether the smell being emitted is a real smell or a smell being output by the device in conjunction with the content.

[0068] 3. Configuration for notifying a content viewing user of an actual odor occurring in a real space Next, a configuration for notifying a content viewing user of an actual odor occurring in a real space will be described.

[0069] As described above, the VR goggles 20, which is an example of an information processing device of the present disclosure, executes a process to notify that an odor is being output when there is an odor-emitting object in the playback content and an odor is being output from the device (the VR goggles 20 or the odor output device 40).

[0070] However, this process alone has the problem that when a real smell is occurring in the real space, it is difficult for the content viewing user to notice it.

[0071] For example, as shown in FIG. 15 , suppose that a user 10 is wearing VR goggles 20 and watching content about a fire, and something actually starts to burn near the user 10 while a burning smell corresponding to the content is being output from the smell output unit 21.

[0072] In such a case, the user 10 may believe that a burning smell is being output from the device (the VR goggles 20 or the smell output device 40) and that he or she is smelling that smell. If the user 10 continues to watch the content under this belief, the user 10 may be unable to escape in time.

[0073] To prevent such a situation, the VR goggles 20, which are the information processing device of the present disclosure, use the detection information from the sensors attached to the VR goggles 20 to analyze the surrounding situation, and output warning information based on the analysis results to the display unit of the VR goggles 20 along with the content that the user 10 is viewing.

[0074] Specifically, the image captured by a camera, which is a sensor attached to the VR goggles 20, is analyzed to detect a fire occurring around the user 10. When the control unit of the VR goggles 20 detects a fire occurring around the user 10, the control unit of the VR goggles 20 outputs warning information to the display unit of the VR goggles 20 along with the content that the user 10 is viewing.

[0075] For example, as shown in FIG. 16, a fire warning message 45 and a fire warning icon 46 are displayed in conjunction with the playback content 30 that the user 10 is viewing with the VR goggles 20 .

[0076] In the example shown in the figure, the following message is displayed as the fire warning message 45: "A fire has broken out. Please stop playing the game and evacuate immediately."

[0077] A user 10 viewing the playback content 30 with the VR goggles 20 can see the fire warning message 45 and the fire warning icon 46, recognize that a fire has broken out around the user 10, and take immediate action.

[0078] Note that the above-described processing example is configured to notify the content viewing user of the occurrence of a real odor in real space, but the control unit of the information processing device may also be configured to analyze and notify other events in real space.

[0079] For example, a control unit of the information processing device analyzes an event occurring in real space based on input information from a sensor capable of communicating with the information processing device, and notifies the content viewing user of the event that has occurred as a result of the analysis.

[0080] Specifically, for example, the control unit of the information processing device analyzes input information from a sensor that can communicate with the information processing device, such as the occurrence of an earthquake, the detection of an intercom sound indicating a visitor, or the detection of a suspicious person, and notifies the content viewing user of the analysis results. By performing these processes, the content viewing user can be made aware of events occurring in real space.

[0081] [4. Other Examples] Next, other examples will be described.

[0082] The following examples will be described in order: (1) Example of display data on the outer display unit 23 of the VR goggles 20 (2) Example of an odor source notification process using a device other than a content playback device (3) Example of a process for notifying a content viewing user of an odor source by vibrating the device worn by the user (4) Example of a process for notifying people around the content viewing user of an odor source by vibrating the device of the people around the content viewing user (5) Example of a process for making the message audio less audible to the content viewing user when a warning message is output (6) Example of a process for outputting a message after odor generation has ended (7) Example of a notification process for distinguishing between a state caused by content other than an odor and an actual state in real space

[0083] (4-(1) Examples of display data on the outer display unit 23 of the VR goggles 20) In the above-described embodiment, an example was described in which an image of an odor-emitting object is displayed on the outer display unit 23 of the VR goggles 20, which is an example of an information processing device disclosed herein, as a configuration for notifying people near the content viewing user of the odor source.

[0084] For example, the example described with reference to Fig. 5 is an example of displaying an image of a "flame" which is an odor-emitting object, and the example described with reference to Fig. 11 is an example of displaying an image of a "flower" which is an odor-emitting object.

[0085] A configuration for displaying an image different from the image of such an odor-emitting object on the outer display section 23 of the VR goggles 20 to notify people in the vicinity of the odor-emitting source will be described with reference to Figure 17.

[0086] The diagram on the left side of Figure 17 corresponds to the example described with reference to Figure 5, and is an example in which an image of a "flame", which is an odor-emitting object, is displayed on the outer display unit 23 of the VR goggles 20.

[0087] An example of a process different from this display process is shown on the right side of Fig. 17. The right side of Fig. 17 shows examples of display data on the outer display unit 23 of the VR goggles 20 in the following two states: (a) Odor output stop state (b) Odor output execution state

[0088] 17, in the "(a) odor output stopped state," a normal facial image of the user 10, which has been photographed in advance, is displayed on the outer display unit 23 of the VR goggles 20. On the other hand, in the "(b) odor output execution state," i.e., in a state in which an odor related to the playback content is being output from the device (the VR goggles 20 or the odor output device 40), an image of the user 10's face with their nose covered is displayed.

[0089] If the facial image of the user 10 displayed on the outer display unit 23 of the VR goggles 20 is a normal image, people nearby will determine that an odor related to the played content is not being output from the device (the VR goggles 20 or the odor output device 40). On the other hand, if the facial image of the user 10 displayed on the outer display unit 23 of the VR goggles 20 is not a normal image but an image of the user covering their nose, they will determine that an odor related to the played content is being output from the device (the VR goggles 20 or the odor output device 40).

[0090] By switching the output image in this way, a process may be performed to notify people in the vicinity whether the source of the odor is a device (VR goggles 20 or odor output device 40).

[0091] (4-(2) Examples of odor source notification processing using equipment other than a content playback device) In the above-described embodiment, an example was described in which an image of an odor-emitting object is displayed on the outer display unit 23 of a content playback device, such as VR goggles 20, as an odor source notification configuration for people near the content viewing user.

[0092] The odor source notification process for people near the content viewing user can also be configured using a device other than the content playback device, such as VR goggles 20.

[0093] For example, as shown in Figure 18, a wristwatch (smartwatch, etc.) 51 worn by a user 10 wearing VR goggles 20 may be used to perform odor source notification processing on people near the user 10.

[0094] The VR goggles 20 and the wristwatch (smartwatch, etc.) 51 are configured to be able to communicate with each other using Bluetooth (registered trademark), etc. When the odor output unit 21 of the VR goggles 20 outputs a content-related odor, the control unit of the VR goggles 20 transmits an output instruction command for the odor output identification icon 31 to the wristwatch 51.

[0095] In response to the command to output the odor output identification icon 31 received from the VR goggles 20, the wristwatch 51 outputs the odor output identification icon 31 on the display unit of the wristwatch 51 as shown in the lower right of Figure 18.

[0096] A person near a user 10 wearing VR goggles 20 and watching content can determine that the source of the odor is a device (VR goggles 20 or odor output device 40) by looking at the odor output identification icon 31 displayed on the display of the user's 10 wristwatch 51.

[0097] (4-(3) Example of processing for notifying a content viewing user of an odor source by, for example, vibrating the user's wearable device) Next, we will explain an example of processing for notifying a content viewing user of an odor source by, for example, vibrating the user's wearable device.

[0098] In the previously described embodiment, the process of notifying the content viewing user of the odor source was described as a process of displaying an odor output identification icon 31 in conjunction with the playback content 30 being displayed on the display unit of the VR goggles 20 worn by the user 10, or executing an odor output object highlighting display 32, as explained with reference to Figures 7 to 8 and Figures 13 to 14.

[0099] The process of notifying the content viewing user of the odor source is not limited to these processes, and can also be performed by, for example, vibration processing of the VR goggles 20 worn by the user 10, as shown in Figure 19.

[0100] The control unit of the VR goggles 20 executes a process to vibrate the VR goggles 20 when an odor associated with the playback content 30 of the VR goggles 20 is output from the odor output unit 21. The vibration of the VR goggles 20 enables the user 10 to determine that the source of the odor is a device (the VR goggles 20 or the odor output device 40).

[0101] Note that the vibration process is not limited to being performed by the VR goggles 20. For example, as shown in Fig. 20, a wristwatch (such as a smartwatch) 51 worn by a user 10 wearing the VR goggles 20 may be configured to vibrate.

[0102] The VR goggles 20 and the wristwatch (smartwatch, etc.) 51 are configured to be able to communicate with each other using Bluetooth (registered trademark), etc. When the odor output unit 21 of the VR goggles 20 outputs an odor related to the content, the control unit of the VR goggles 20 transmits a vibration execution instruction command to the wristwatch 51.

[0103] In response to the vibration execution instruction command received from the VR goggles 20, the wristwatch 51 vibrates as shown in the upper right (a) of FIG.

[0104] A user 10 wearing VR goggles 20 and watching content can determine that the source of the odor is a device (VR goggles 20 or odor output device 40) by the vibration of the wristwatch 51.

[0105] Furthermore, as shown in the lower right (b) of FIG. 20 , a configuration may be adopted in which a physical change occurs, such as causing a part of the wristwatch (e.g., smartwatch) 51, such as a button, to pop out when an odor is output. The user 10 can determine that the source of the odor is a device (e.g., the VR goggles 20 or the odor output device 40) by the button on the wristwatch 51 popping out. Furthermore, the wristwatch 51 may be provided with a display (e.g., a tactile display) that displays image or graphic information using projections and depressions on the screen, and projection and depression data indicating a shape corresponding to the type of odor may be output to this display. Specifically, for example, if the device is emitting a burning odor, projection and depression data in the shape of a "flame" may be output to the display. Furthermore, if the device is emitting a floral scent, projection and depression data in the shape of a "flower" may be output to the display. By performing such processing, the user 10 can recognize that the source of the odor is a device (e.g., the VR goggles 20 or the odor output device 40) and the type of odor being emitted by the device.

[0106] (4-(4) Example of a process for notifying people around a content viewing user of an odor source by vibrating the devices of the people around them) Next, we will explain an example of a process for notifying people around a content viewing user of an odor source by vibrating the devices of the people around them.

[0107] FIG. 21 is a diagram illustrating an example of a process for notifying people around a content viewing user of an odor source by vibrating the devices of the people around the user.

[0108] 21 , a person wearing a wristwatch 52 is sitting near a user 10 who is wearing VR goggles 20 and watching content. The VR goggles 20 and the wristwatch (smartwatch, etc.) 52 are configured to be able to communicate with each other using Bluetooth (registered trademark) or the like.

[0109] When an odor related to the content 30 being played back by the VR goggles 20 is output from the odor output unit 21, the control unit of the VR goggles 20 transmits a vibration execution instruction command to the wristwatch 52.

[0110] In response to the vibration execution instruction command received from the VR goggles 20, the wristwatch 52 vibrates as shown in the upper right (a) of Fig. 21. Furthermore, in conjunction with the vibration processing, a message such as "The device worn by XXX is producing a burning smell" may be displayed on the screen of the wristwatch 52. An odor output identification icon may also be displayed on the screen of the wristwatch 52. When displaying the odor output identification icon, the text "XXX" or the like may be superimposed around the icon to make it possible to recognize whose device is producing the odor in addition to the icon image.

[0111] The person wearing the wristwatch 52 can determine that the source of the odor is a device (VR goggles 20 or odor output device 40) by the vibration of the wristwatch 52.

[0112] Furthermore, as shown in the lower right (b) of FIG. 21 , a configuration may be adopted in which a physical change occurs, such as a button portion of the wristwatch (e.g., smartwatch) 52 popping out when an odor is output. A person wearing the wristwatch 52 around the user 10 watching content can determine that the source of the odor is a device (the VR goggles 20 or the odor output device 40) by the button popping out of the wristwatch 52. Furthermore, the wristwatch 52 may be provided with a display (e.g., a tactile display) that displays image or graphic information using surface irregularities on the screen, and surface irregularity data representing a shape corresponding to the type of odor may be output to this display. Specifically, for example, if the device is emitting a burning odor, surface irregularity data in the shape of a "flame" may be output to the display. Similarly, if the device is emitting a floral scent, surface irregularity data in the shape of a "flower" may be output to the display. By performing such processing, a person wearing the wristwatch 52 around the user 10 can recognize that the source of the odor is a device (the VR goggles 20 or the odor output device 40) and the type of odor being emitted by the device.

[0113] The device that executes the vibration process, button pop-out, etc. is not limited to a wristwatch. For example, as shown in Fig. 22, a smartphone 53 placed on a table may be configured to vibrate or to perform a physical change such as a button pop-out.

[0114] 22 , the VR goggles 20 and the smartphone 53 are configured to be able to communicate with each other using Bluetooth (registered trademark) etc. The control unit of the VR goggles 20 transmits a vibration execution instruction command to the smartphone 53 when an odor related to the playback content 30 of the VR goggles 20 is to be output from the odor output unit 21.

[0115] 22 in response to the vibration execution instruction command received from the VR goggles 20. This process allows people around the content viewing user to determine that the source of the odor is a device (the VR goggles 20 or the odor output device 40).

[0116] (4-(5) Example of processing for making the message audio difficult for the content viewing user to hear when a warning message is output) Next, an example of processing for making the message audio difficult for the content viewing user to hear when a warning message is output will be described.

[0117] In the previous example, for example, referring to Figure 4 etc., an example of a process for outputting a voice message when notifying people around a content viewing user of the source of an odor, i.e., when notifying that the source of the odor is a device (VR goggles 20 or odor output device 40), was described.

[0118] The output process of this voice message is executed using the speaker 21 of the VR goggles 20 worn by the user 10. This voice message is unrelated to the story of the content that the user 10 is viewing through the VR goggles 20, and if it reaches the ears of the user 10, it may disrupt the sense of immersion in the content.

[0119] In order to prevent such a problem, it is preferable to execute a process that makes the message voice difficult to hear for the user 10 viewing the content.

[0120] 23, when outputting a voice message, the control unit of the VR goggles 20 uses a speaker capable of highly directional voice output to output the voice message with high directionality, or uses a noise cancellation function to perform voice output control that makes it difficult for the voice to reach the user 10.

[0121] By performing these processes and outputting a notification message to people around the user, the user 10 who is viewing the content can concentrate on the viewing content without worrying about the output message.

[0122] (4-(6) Example of a Process for Outputting a Message After the End of Odor Generation) Next, an example of a process for outputting a message after the end of odor generation will be described.

[0123] For example, if a burnt smell is output from the smell output unit 21 of the VR goggles 20, the burnt smell will continue to linger for a while even after the smell output process from the smell output unit 21 has finished.

[0124] Surrounding people who are not viewing the content will continue to smell a burning odor for a while even after the odor output process has finished from the odor output unit 21 of the VR goggles 20. In such a case, it is preferable to output a message to inform surrounding people who are not viewing the content that the source of the odor was a device (the VR goggles 20 or the odor output device 40) and that the odor will linger for a while.

[0125] A specific example of this processing will be described with reference to Fig. 24. The example shown in Fig. 24 is a diagram illustrating the state at the time when the user 10 views the fire content described with reference to Fig. 1 using the VR goggles 20, the odor output unit 21 of the VR goggles 20 outputs a burning odor, and then the odor output is completed.

[0126] Even after the odor output from the odor output unit 21 of the VR goggles 20 has finished, people in the vicinity will continue to smell a burning odor for a while. In such a case, the information processing device of the present disclosure, for example, the VR goggles 20, will output a warning message to those in the vicinity via the speaker 22 of the VR goggles 20, as shown in Figure 24. For example, in the example shown in Figure 24, the following message is output: "Beep, beep, there is a tick-eating bug."

[0127] By hearing this message, people around the user 10, i.e., people who are not viewing the content, will recognize that the burning smell output by the device (VR goggles 20 or odor output device 40) is still lingering, and will be able to confirm that the burning smell is not a real smell, providing peace of mind. Similarly, the user 10 may be notified that the burning smell is still lingering. For example, an icon that is distinguishable from the odor output in progress icon, for example, an icon with a lighter color, may be displayed. This icon display process allows the user 10 to recognize that the odor output has stopped but that the odor still lingers. When highlighting the odor output object is used, the display is performed with a reduced degree of highlighting after the odor output has stopped. This control allows the user 10 to recognize that the odor output has stopped but that the odor still lingers.

[0128] (4-(7) Example of notification processing for distinguishing between states caused by content other than smells and actual states of real space) Next, we will explain an example of notification processing for distinguishing between states caused by content other than smells and actual states of real space.

[0129] In the above-described embodiment, an example of a notification process for distinguishing between an odor-emission state caused by content and an actual odor-emission state in real space has been described. The process of the present disclosure can also be applied as a configuration for performing notification process for distinguishing between a state caused by content other than odor and an actual state in real space.

[0130] For example, vibrations of an operating part such as a steering wheel that occur in a driving game or the like are vibrations caused by the content. In contrast, vibrations also occur in real-life events such as earthquakes. In order to distinguish between these, when vibrations of an operating part such as a steering wheel that occur in a driving game or the like are executed, people around and the game player are notified that the vibrations are caused by the content.

[0131] Furthermore, it may be difficult to distinguish an output sound such as "ping pong" that is output as a sound effect during playback content from a "ping pong" chime that announces a visitor in the real space.

[0132] To distinguish between these, when the output process of the "ping pong" sound data that is output as a sound effect during playback content is executed, people around and the content viewing user are notified that this output sound is an output sound that originates from the content by displaying an icon or a message.

[0133] In this way, the processing of the present disclosure can be applied as processing for notifying users that a state that occurs due to various content other than odor output processing is a state that occurs due to content.

[0134] 5. Processing Sequence Executed by the Information Processing Device of the Present Disclosure Next, a processing sequence executed by the information processing device of the present disclosure will be described.

[0135] A processing sequence executed by an information processing device of the present disclosure, such as the VR goggles 20 described in the above-described embodiment, will be described with reference to the flowcharts shown in Figures 25 and 26. Note that the processing according to the flowcharts shown in Figures 25 and 26 is executed under the control of a control unit configured with a CPU or the like having a program execution function, in accordance with a program stored in a storage unit of the information processing device of the present disclosure (such as the VR goggles 20). The processing of each step of the flow shown in Figures 25 and 26 will be described in order below.

[0136] (Step S101) First, in step S101, a content playback process is executed. For example, the control unit of the VR goggles 20 described above with reference to FIG. 1 and other figures executes the content playback process by performing content playback control to display content such as VR content on the display unit of the VR goggles 20.

[0137] The content to be reproduced is not limited to virtual reality image content such as VR content, but may be three-dimensional image content, two-dimensional image content, live-action image content, animated image content, or any other content type.

[0138] (Step S102) Next, in step S102, the control unit of the information processing device (VR goggles or the like) determines whether or not the content being played is content for performing line-of-sight analysis processing.

[0139] Gaze analysis processing execution content is content that analyzes the gaze direction of the user viewing the content, selects an object in the gaze direction, and performs a predefined process on that object, such as an odor output process.

[0140] If it is determined in step S102 that the content being played is the content for performing line-of-sight analysis processing, the process proceeds to step S103. On the other hand, if it is determined in step S102 that the content being played is not the content for performing line-of-sight analysis processing, the process proceeds to step S104.

[0141] (Step S103) If it is determined in step S102 that the reproduced content is the gaze analysis processing execution content, the process proceeds to step S103.

[0142] In this case, in step S103, the control unit of the information processing device analyzes the line of sight of the user viewing the content, and determines whether or not there is an odor output object in the line of sight direction area.

[0143] The odor output object is an object that has been registered in advance as an odor output object in attribute information corresponding to the content, such as content playback control information, such as "fire" or "flower" in the previously described embodiment. For example, in addition to "fire" and "flower," various objects such as "ocean," "market," and "grilled meat" are registered as odor output objects.

[0144] If it is determined in step S103 that the odor output object is in the line-of-sight direction area of ​​the content viewing user, the process proceeds to step S105. On the other hand, if it is determined in step S103 that the odor output object is not in the line-of-sight direction area of ​​the content viewing user, the process returns to step S101, and the processes from step S101 onwards are repeated for the next content playback scene.

[0145] (Step S104) On the other hand, if it is determined in step S102 that the reproduced content is not a gaze analysis processing execution content, the process proceeds to step S104.

[0146] In this case, in step S104, the control unit of the information processing device analyzes the entire reproduced image of the content and determines whether or not there is an odor output object in any area of ​​the entire reproduced image.

[0147] If it is determined in step S104 that an odor output object exists in any area of ​​the entire playback image, the process proceeds to step S105. On the other hand, if it is determined in step S104 that an odor output object does not exist in any area of ​​the entire playback image, the process returns to step S101, and the processes from step S101 onwards are repeated for the next content playback scene.

[0148] (Step S105) If it is determined in step S103 that an odor output object is present in the line of sight direction area of ​​the content viewing user, or if it is determined in step S104 that an odor output object is present in any area of ​​the entire playback image, proceed to step S105.

[0149] In either case, the control unit of the information processing device executes a surrounding situation analysis process based on the sensor detection information in step S105, for example, analyzing the surrounding situation of the content viewing user based on an image captured by a camera.

[0150] (Step S106) Next, in step S106, the control unit of the information processing device determines whether or not a person has been detected around the content viewing user as a result of the surrounding situation analysis process in step S105.

[0151] If a person is detected around the content viewing user, the process proceeds to step S107. On the other hand, if no person is detected around the content viewing user, the process proceeds to step S110.

[0152] (Step S107) If a person is detected around the content viewing user in step S106, the control unit of the information processing device further determines in step S107 whether the area around the content viewing user is a public place, for example, a public place such as a train.

[0153] This determination is made by performing an analysis process based on the sensor detection information acquired in step S105, for example, an image captured by a camera, using, for example, a learning model generated by a machine learning process executed in advance.

[0154] If it is determined that the surroundings of the content viewing user are a public place, the process proceeds to step S108. On the other hand, if it is determined that the surroundings of the content viewing user are not a public place, the process proceeds to step S109.

[0155] (Step S107) In step S107, if it is determined that the surroundings of the content viewing user are a public place, the process proceeds to step S108.

[0156] In this case, the control unit of the information processing device stops the odor output process in step S108. Alternatively, the odor may be output at an extremely low level.

[0157] (Step S109) On the other hand, if it is determined in step S107 that the surroundings of the content viewing user are not a public place, the process proceeds to step S109.

[0158] In this case, in step S109, the control unit of the information processing device executes odor output and notifies surrounding people that odor output is in progress. Specifically, for example, notification processing is executed using a voice message or a display image to notify surrounding people that odor output is in progress.

[0159] (Step S110) The processing of step S110 is executed when it is determined in step S106 that there are no people in the vicinity, or after the processing of notifying people in the vicinity that odor output is in progress is executed in step S109.

[0160] In these cases, in step S110, the control unit of the information processing device executes odor output and also executes processing to notify the content viewing user that odor output is currently being executed.

[0161] Specifically, for example, the content viewing user is notified that odor output is in progress by displaying an odor output identification icon or highlighting an odor output object.

[0162] (Step S111) After executing the odor output stop process in step S108 or the process of notifying the content viewing user that odor output is in progress in step S110, the control unit of the information processing device determines in step S111 whether content playback has ended.

[0163] If the content playback has ended, all processing ends. If odor output is in progress, odor output also ends. If the content playback has not ended, the process returns to step S101, and the processing from step S101 onwards is repeated for the next content playback scene.

[0164] As described above, the information processing device of the present disclosure executes processing in accordance with the flowcharts shown in Figures 25 and 26. By executing processing in accordance with these flows, when the information processing device outputs an odor, it is possible to notify people around the content viewing user that the source of the odor is the device, and further to make the content viewing user aware that an odor is being output.

[0165] 6. Configuration Example of Information Processing Apparatus According to the Present Disclosure Next, a configuration example of an information processing apparatus according to the present disclosure will be described.

[0166] FIG. 27 is a block diagram showing the functional configuration of an information processing device of the present disclosure, that is, an information processing device such as VR goggles, a PC, or a smartphone.

[0167] As shown in Figure 27, the information processing device 100 includes an operation unit 101, a memory unit 102, a sensor unit (camera, etc.) for checking the surrounding conditions 103, an odor output unit 104, a display unit 105, a sensor unit for controlling the displayed image 106, a microphone 107, a speaker 108, a communication unit 109, and a control unit 110.

[0168] The operation unit 101 detects various operations by the user, such as device operations for applications. Device operations include, for example, operations on the power switch and various other switches, and touch processes (tapping, flicking, swiping, etc.) on the display unit. User operation information on the operation unit 101 is input to the control unit 110.

[0169] The storage unit 102 is a storage area for temporarily or permanently storing various programs and data. For example, the storage unit 102 stores programs and data for the information processing device 100 to execute various functions. As a specific example, the storage unit 102 stores programs for executing a content playback processing application and various other applications, management data for managing various settings, and the like.

[0170] The storage unit 102 also stores control programs for various odor output processes, as well as information such as icons and messages indicating that an odor is being output. These are stored in association with each piece of odor information.

[0171] The sensor unit (camera, etc.) 103 is a sensor that acquires information for analyzing the surrounding situation of the information processing device 100. For example, it is configured with a camera, an infrared sensor, a distance sensor, etc. Based on the control of the control unit 110, it acquires information such as an image captured by the camera.

[0172] Under the control of the control unit 110, the odor output unit 104 executes a process of outputting an odor corresponding to an object in the content displayed on the display unit 105. The control unit 110 analyzes the content displayed on the display unit 105, and when a pre-registered odor output object is detected in the reproduced content, the control unit 110 selects an odor corresponding to the odor output object, and under the control of the control unit 110, outputs the selected odor via the odor output unit 104.

[0173] The display unit 105 displays various information such as the content being reproduced under the control of the control unit 110. It also displays information indicating that an odor is being output under the control of the control unit 110. The display unit 105 may include various display devices such as a liquid crystal display (LCD) device or an organic light emitting diode (OLED) display device.

[0174] The image control sensor unit 106 is configured with, for example, an acceleration sensor, a gyro sensor, a vibration sensor, etc., and detects the tilt of the VR goggles, etc. The detected information is used to control the display of content displayed on the display unit 105, etc.

[0175] The microphone 107 includes a microphone that collects sounds uttered by the user under the control of the control unit 110. The speaker 108 outputs various sounds, such as a warning message indicating that an odor is being output under the control of the control unit 110.

[0176] The communication unit 109 communicates with an external device. For example, it is used for communication with an external device such as a game server. Furthermore, as described with reference to FIG. 2, if the odor output device is an external device, it also communicates with the odor output device. It is also used for the process of transmitting notification information indicating that odor output is in progress to the external device.

[0177] The communication unit 109 functions as a transmitter / receiver for data communication via Wi-Fi communication, Bluetooth (registered trademark) communication, or other networks such as the Internet or a local area network, and communicates with external devices.

[0178] The control unit 110 controls, for example, display data output to the display unit 105 and transmission data transmitted via the communication unit 109. The control unit 110 also controls applications, such as starting, running, and stopping applications, based on user operations on the operation unit 101. The control unit 110 also controls the output of various icons and messages, as described above. The control unit 110 also controls data communication via the communication unit 109.

[0179] An example of the functional configuration of the information processing device 100 has been described above, but the functional configuration described using Fig. 27 is merely an example, and the functional configuration of the information processing device 100 according to this embodiment is not limited to this example. For example, the information processing device 100 does not necessarily have to have all of the configuration shown in Fig. 27, and some of the configuration may be provided in a device different from the information processing device 100. The functional configuration of the information processing device 100 according to this embodiment can be flexibly modified according to specifications and operations.

[0180] Furthermore, the functions of each component may be performed by a computing device such as a CPU (Central Processing Unit) reading a control program from a storage medium such as a ROM (Read Only Memory) or RAM (Random Access Memory) that stores a control program describing the processing procedures for realizing these functions, and interpreting and executing the program. Therefore, the configuration to be used can be changed as appropriate depending on the technical level at the time of implementing this embodiment.

[0181] 7. Hardware Configuration Example of Information Processing Device of the Present Disclosure Next, a hardware configuration example of an information processing device of the present disclosure will be described with reference to FIG.

[0182] 28 corresponds to hardware such as VR goggles, a smartphone, and a PC, which are examples of information processing devices disclosed herein. Each component constituting the hardware of the information processing device shown in FIG. 28 will be described below.

[0183] The CPU (Central Processing Unit) 301 functions as a control unit or data processing unit that executes various processes according to programs stored in the ROM (Read Only Memory) 302 or the storage unit 308. For example, it executes processes according to the sequences described in the above-mentioned embodiments. The RAM (Random Access Memory) 303 stores programs and data executed by the CPU 301. The CPU 301, ROM 302, and RAM 303 are interconnected by a bus 304.

[0184] The CPU 301 is connected to an input / output interface 305 via a bus 304, and the input / output interface 305 is connected to an input unit 306 including various switches, buttons, a touch panel, sensors, a camera, a microphone, etc., and an output unit 307 that outputs data to a display unit, a speaker, etc. The CPU 301 executes various processes in response to commands input from the input unit 306, and outputs the processed results to the output unit 307, for example.

[0185] A storage unit 308 connected to the input / output interface 305 stores various data and programs executed by the CPU 301. A communication unit 309 functions as a transmitter / receiver for data communication via Wi-Fi communication, Bluetooth (registered trademark) communication, or other networks such as the Internet or a local area network, and communicates with external devices.

[0186] A drive 310 connected to the input / output interface 305 drives a removable medium 311 such as a semiconductor memory such as a memory card, and executes recording or reading of data.

[0187] [8. Summary of the Configuration of the Present Disclosure] The embodiments of the present disclosure have been described above in detail with reference to specific examples. However, it is obvious that those skilled in the art can modify or substitute the embodiments without departing from the gist of the present disclosure. In other words, the present invention has been disclosed in the form of examples and should not be interpreted as being limited. To determine the gist of the present disclosure, the claims should be taken into consideration.

[0188] The technology disclosed in this specification can be configured as follows: (1) An information processing device having a control unit that controls the playback of content, wherein the control unit controls the output of an odor corresponding to the content being played, and when the output process of the odor corresponding to the content being played is being executed, the information processing device executes a notification process that the odor output process is being executed.

[0189] (2) The information processing device according to (1), wherein the control unit outputs a voice message indicating that the odor output process is being executed when the odor output process corresponding to the content being played is being executed.

[0190] (3) The information processing device according to (2), wherein the control unit outputs a voice message that enables identification of the type of odor when executing an output process of an odor corresponding to the content being played.

[0191] (4) The information processing device according to any one of (1) to (3), wherein the control unit, when executing an odor output process corresponding to the content being played, displays an image or a message on the display unit indicating that the odor output process is being executed.

[0192] (5) The information processing device according to (4), wherein the control unit displays an icon on the display unit that identifies the type of odor when executing an output process of an odor corresponding to the content being played.

[0193] (6) The information processing device according to (4) or (5), wherein the control unit, when executing an output process of an odor corresponding to the content being played, displays an object highlighting image on the display unit that makes it possible to identify an object corresponding to a source of the odor.

[0194] (7) An information processing device according to any one of (4) to (6), wherein the control unit, when executing an odor output process corresponding to the content being played, displays an image or message indicating that the odor output process is being executed on a display unit that can be seen by people around the content viewing user other than the content viewing user.

[0195] (8) The information processing device is a goggle-type device, and when an odor output process corresponding to the content being played is executed, an image or message indicating that the odor output process is being executed is displayed on a display unit outside the goggles that can be seen by people around the content viewing user. (7) The information processing device described above.

[0196] (9) The information processing device described in any one of (4) to (8), wherein the control unit, when executing an odor output process corresponding to the content being played, displays an image or message indicating that the odor output process is being executed on a display unit that can be confirmed by the content viewing user.

[0197] (10) The information processing device is a goggle-type device, and when an odor output process corresponding to the content being played is executed, an image or message indicating that the odor output process is being executed is displayed on a display unit inside the goggles that can be seen by the content viewing user. (9) The information processing device described above.

[0198] (11) The information processing device according to any one of (1) to (10), wherein the control unit analyzes the surrounding situation, and when it detects that a dangerous situation has occurred in the real space based on the analysis results, displays information notifying the content viewing user of the occurrence of the dangerous situation on a display unit of the content being viewed by the content viewing user.

[0199] (12) The information processing device described in any one of (1) to (11), wherein the control unit acquires a state occurring in real space based on an analysis of the surrounding situation, and displays information notifying the state occurring in real space on a display unit of the content being viewed by the content viewing user.

[0200] (13) The information processing device described in (12) in which the control unit executes a detection process of detecting a state occurring in the real space, either detecting the occurrence of an earthquake, detecting a visitor, or detecting a suspicious person, and displays information on the display unit of the content being viewed by the content viewing user notifying that either the occurrence of an earthquake, a visitor, or a suspicious person has been detected as a state occurring in the real space.

[0201] (14) The information processing device according to any one of (1) to (13), wherein the control unit, when executing an odor output process corresponding to the content being played, sends a command to an external device and causes the external device to execute a process of notifying the external device that the odor output process is being executed.

[0202] (15) The information processing device according to (14), wherein the control unit transmits a command to an external device and executes control to vibrate the external device when executing an output process of an odor corresponding to the content being played.

[0203] (16) The information processing device according to (14) or (15), wherein the control unit transmits a command to an external device when an odor output process corresponding to the content being played is being executed, and controls the display unit of the external device to display an image or a message indicating that the odor output process is being executed.

[0204] (17) The information processing device described in any one of (1) to (16), wherein the control unit, when executing an odor output process corresponding to the content being played, determines whether or not there is a person around the content viewing user, and if it determines that there is a person, executes a notification process that the odor output process is being executed.

[0205] (18) The information processing device described in any one of (1) to (17), wherein the control unit determines whether the surroundings of the content viewing user are a public place, and if it determines that the surroundings are a public place, stops the output process of the odor corresponding to the content being played.

[0206] (19) An information processing method executed in an information processing device, the information processing device having a control unit that controls playback of content, the control unit controls output of an odor corresponding to the content being played, and when output processing of an odor corresponding to the content being played is executed, executes a notification process that the odor output process is being executed.

[0207] (20) A program for causing an information processing device to execute information processing, the information processing device having a control unit that controls playback of content, the program causing the control unit to: execute control of outputting an odor corresponding to the content being played; and, when executing the output process of an odor corresponding to the content being played, execute a notification process that the odor output process is being executed.

[0208] The series of processes described in this specification can be executed by hardware, software, or a combination of both. When executing processes by software, a program recording the processing sequence can be installed and executed in the memory of a computer incorporated in dedicated hardware, or the program can be installed and executed on a general-purpose computer capable of executing various processes. For example, the program can be pre-recorded on a recording medium. In addition to installing the program on a computer from a recording medium, the program can also be received via a network such as a LAN (Local Area Network) or the Internet and installed on a recording medium such as an internal hard disk.

[0209] The various processes described in this specification may not only be executed in chronological order as described, but may also be executed in parallel or individually depending on the processing capabilities of the devices executing the processes or as needed. Furthermore, in this specification, a system refers to a logical collective configuration of multiple devices, and is not limited to devices that are all located in the same housing.

[0210] As described above, according to the configuration of one embodiment of the present disclosure, a device and method are realized that perform notification processing that a content-specific odor output process is being executed. Specifically, the device includes a control unit that controls playback of content, such as VR content. The control unit further controls the output of an odor corresponding to the content being played, and, when the odor output process corresponding to the content being played is being executed, performs notification processing that the odor output process is being executed. When the odor output process corresponding to the content being played is being executed, the control unit outputs a voice message or an image, such as an icon, that indicates that the odor output process is being executed and that the type of odor can be identified. This configuration realizes a device and method that perform notification processing that a content-specific odor output process is being executed.

[0211] 10 User 20 VR goggles 21 Smell output unit 22 Speaker 23 Outer display unit 30 Playback content 31 Smell output identification icon 32 Smell output object highlighting 40 Smell output device 45 Fire warning message 46 Fire warning icon 51 Wristwatch 52 Wristwatch 53 Smartphone 100 Information processing device 101 Operation unit 102 Memory unit 103 Surrounding situation confirmation sensor unit 104 Smell output unit 105 Display unit 106 Image control sensor unit 107 Microphone 108 Speaker 109 Communication unit 110 Control unit 301 CPU 302 ROM 303 RAM 304 Bus 305 Input / output interface 306 Input unit 307 Output unit 308 Memory unit 309 Communication unit 310 Drive 311 Removable Media

Claims

1. An information processing device having a control unit that controls the playback of content, wherein the control unit controls the output of an odor corresponding to the content being played, and when the output process of an odor corresponding to the content being played is being executed, the information processing device executes a notification process that the odor output process is being executed.

2. The information processing device according to claim 1, wherein the control unit outputs a voice message indicating that the odor output process is being executed when the odor output process corresponding to the content being played is being executed.

3. The information processing device according to claim 2, wherein the control unit outputs a voice message that enables identification of the type of odor when executing an odor output process corresponding to the content being played.

4. The information processing device according to claim 1, wherein the control unit, when executing the odor output process corresponding to the content being played, displays an image or message on the display unit indicating that the odor output process is being executed.

5. An information processing device according to claim 4, wherein the control unit displays an icon on the display unit that identifies the type of odor when executing an odor output process corresponding to the content being played.

6. The information processing device according to claim 4, wherein the control unit displays an object highlighting image on the display unit that makes it possible to identify the object corresponding to the source of the odor when executing an output process of the odor corresponding to the content being played.

7. The information processing device of claim 4, wherein the control unit, when executing an odor output process corresponding to the content being played, displays an image or message indicating that the odor output process is being executed on a display unit that can be seen by people in the vicinity other than the content viewing user.

8. The information processing device according to claim 7, wherein the information processing device is a goggle-type device, and when an odor output process corresponding to the content being played is executed, an image or message indicating that the odor output process is being executed is displayed on a display unit outside the goggles that can be seen by people around the content viewing user.

9. An information processing device as described in claim 4, wherein the control unit, when executing an odor output process corresponding to the content being played, displays an image or message indicating that the odor output process is being executed on a display unit that can be confirmed by the content viewing user.

10. The information processing device according to claim 9, wherein the information processing device is a goggle-type device, and when an odor output process corresponding to the content being played is executed, an image or message indicating that the odor output process is being executed is displayed on a display unit inside the goggles that can be seen by the content viewing user.

11. The information processing device according to claim 1, wherein the control unit analyzes the surrounding situation and, if it detects that a dangerous situation has occurred in real space based on the analysis results, displays information notifying the content viewing user of the occurrence of the dangerous situation on the display unit of the content being viewed by the content viewing user.

12. The information processing device according to claim 1, wherein the control unit acquires a state occurring in real space based on an analysis of the surrounding situation, and displays information notifying the content viewing user of the state occurring in real space on a display unit of the content being viewed by the content viewing user.

13. The information processing device according to claim 12, wherein the control unit executes a detection process of detecting the occurrence of an earthquake, a visitor, or a suspicious person as a detection process of a state occurring in the real space, and displays information on the display unit of the content being viewed by the content viewing user notifying that the occurrence of an earthquake, a visitor, or a suspicious person has been detected as a state occurring in the real space.

14. The information processing device according to claim 1, wherein the control unit, when executing an odor output process corresponding to the content being played, sends a command to an external device and causes the external device to execute a process of notifying the external device that the odor output process is being executed.

15. The information processing device according to claim 14, wherein the control unit transmits a command to an external device and executes control to vibrate the external device when executing an odor output process corresponding to the content being played.

16. An information processing device as described in claim 14, wherein the control unit, when executing an odor output process corresponding to the content being played, sends a command to an external device and executes control to display an image or message on a display unit of the external device indicating that the odor output process is being executed.

17. The information processing device of claim 1, wherein the control unit determines whether there is a person around the content viewing user when executing the odor output process corresponding to the content being played, and if it determines that there is a person, executes a notification process that the odor output process is being executed.

18. The information processing device of claim 1, wherein the control unit determines whether the surroundings of the content viewing user are a public place, and if it determines that the surroundings are a public place, stops the output process of the odor corresponding to the content being played.

19. An information processing method executed in an information processing device, wherein the information processing device has a control unit that controls content playback, and the control unit controls the output of an odor corresponding to the content being played, and when the output process of an odor corresponding to the content being played is being executed, the information processing method executes a notification process that the odor output process is being executed.

20. A program for causing an information processing device to execute information processing, the information processing device having a control unit that controls the playback of content, the program causing the control unit to: execute control of the output of an odor corresponding to the content being played; and, when executing the output process of an odor corresponding to the content being played, execute a notification process that the odor output process is being executed.

Images