Information processing device, information processing method, and program

Abstract

To suppress sickness felt by a user due to a digital content including a virtual space experience.SOLUTION: An information processing device according to embodiment comprises an acquisition unit, an estimation unit, and a suppression processing unit. The acquisition unit acquires internal and external situations concerning a user of a digital content including a virtual space experience. The estimation unit estimates the situation of sickness felt by the user, on the basis of the situation acquired by the acquisition unit. The suppression processing unit executes suppression processing of the sickness concerning each of the audio and the video of the digital content, in accordance with the situation of the sickness felt by the user estimated by the estimation unit. In the execution of the suppression processing, the suppression processing unit adjusts the balance between the suppression processing concerning the audio and that concerning the video, in accordance with the situation of the sickness felt by the user.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The disclosed embodiments include an information processing device and an information processing method. and Program To Regarding. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a technique for providing a user with digital content including a virtual space experience, such as VR (Virtual Reality) or MR (Mixed Reality), using a head mounted display (HMD) or the like.

[0003] In addition, in this technology, a VR system has been proposed that is mounted on a moving object such as a vehicle and that can use the moving object as a motion platform (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-102401 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional techniques have room for further improvement in terms of preventing users from becoming motion sickness-prone due to digital content that includes virtual space experiences.

[0006] For example, it is known that users who receive VR content may experience "VR sickness," which is similar to motion sickness. VR sickness is a type of motion sickness that can occur due to a lack of synchronization between audio and video, or large fluctuations in audio and video that the brain cannot keep up with. In particular, in the case of VR systems installed in vehicles, users' sickness tends to be even worse because it also involves regular motion sickness.

[0007] One aspect of the embodiment has been made in consideration of the above, and aims to provide an information processing device, an information processing method, a program, and a data structure that can prevent a user from becoming motion sickness caused by digital content including a virtual space experience. [Means for solving the problem]

[0008] According to one aspect of the embodiment, there is provided an information processing device comprising: controller The above-mentioned controller is a digital content that includes virtual space experiences. acquiring a physical condition of a user who is viewing the program, a usage status of the digital content, and a driving status of a vehicle in which the user is riding; The user's drunkenness state is estimated based on the acquired state. death, According to the estimated drunkenness state of the user As a process for suppressing motion sickness, a sound suppression process for the sound of the digital content or a video suppression process for the video of the digital content is executed, When the suppression process is executed, the drunkenness state of the user is When the degree of intoxication of the user is mild, the audio suppression process and the video suppression process are mainly executed, and when the degree of intoxication of the user is moderate, the audio suppression process and the video suppression process are mainly executed. Execute. Effect of the Invention

[0009] According to one aspect of the embodiment, it is possible to prevent a user from becoming motion sickness caused by digital content that includes a virtual space experience. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of an information processing system according to an embodiment. [Diagram 2] Figure 2 is an explanatory diagram of VR sickness. [Diagram 3] FIG. 3 is a diagram illustrating an outline of the information processing method according to the embodiment. [Figure 4] FIG. 4 is a block diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Diagram 5] FIG. 5 is a block diagram illustrating an example of the configuration of the suppression processing unit. [Figure 6] FIG. 6 is a diagram showing the process contents of the suppression process. [Figure 7] FIG. 7 is a diagram illustrating an example of the suppression process information. [Figure 8]FIG. 8 is a flowchart showing a processing procedure executed by the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of an information processing device, an information processing method, a program, and a data structure disclosed in the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the embodiments described below.

[0012] In the following, the information processing system 1 according to the embodiment will be described as an in-vehicle system mounted in a vehicle. In the following, the information processing system 1 according to the embodiment is a VR system that provides a user with VR content as digital content including a virtual space experience.

[0013] First, an overview of an information processing method according to an embodiment will be described with reference to Fig. 1 to Fig. 3. Fig. 1 is a diagram showing a schematic configuration of an information processing system 1 according to an embodiment. Fig. 2 is an explanatory diagram of VR sickness. Fig. 3 is an explanatory diagram showing the overview of the information processing method according to an embodiment.

[0014] As shown in FIG. 1, an information processing system 1 according to the embodiment includes an HMD 3 and an information processing device 10.

[0015] The HMD 3 is an information processing terminal that presents VR content provided by the information processing device 10 to the user U and allows the user to enjoy a VR experience. The HMD 3 is a wearable computer that is worn on the head of the user U and is a goggle-type computer in the example of Fig. 1. The HMD 3 may be a glasses-type computer or a hat-type computer.

[0016] The HMD 3 includes a display unit 31, a speaker 32, and a sensor unit 33. The display unit 31 is provided so as to be placed in front of the eyes of the user U, and displays images included in the VR content provided by the information processing device 10.

[0017] In the example of Fig. 1, one display unit 31 is provided in front of each of the left and right eyes of the user U, but only one display unit may be provided. The display unit 31 may be a non-transmissive type that completely covers the field of view, or may be a video-transmissive type or an optical-transmissive type. In this embodiment, the display unit 31 is a non-transmissive type.

[0018] 1, the speaker 32 is provided in a headphone type, for example, and is worn on the ears of the user U. The speaker 32 outputs sound included in the VR content provided by the information processing device 10.

[0019] The sensor unit 33 is a device that detects changes in the inside and outside circumstances of the user U, and includes, for example, a camera, a motion sensor, and the like.

[0020] The information processing device 10 is, for example, a computer, an in-vehicle device mounted on a vehicle, connected to the HMD 3 by wire or wirelessly, and provides VR content to the HMD 3. In addition, the information processing device 10 acquires changes in the situation detected by the sensor unit 33 at any time, and reflects such changes in the situation in the VR content.

[0021] For example, the information processing device 10 can change the direction of the field of view in the virtual space of the VR content in response to a change in the head or line of sight of the user U detected by the sensor unit 33.

[0022] Incidentally, it is known that when VR content is provided using such an HMD 3, the user U may experience "VR sickness," which is similar to motion sickness.

[0023] As shown in Figure 2, VR sickness can occur due to factors such as out-of-sync audio and video, or large fluctuations in audio and video that the brain cannot keep up with. VR sickness can also occur due to a mismatch between the sensations of the VR experience enjoyed using the HMD 3 and the physical sensations of the user U due to changes in the surrounding environment.

[0024] Therefore, in the information processing method according to the embodiment, the indoor and outdoor conditions of the user U are acquired, the VR sickness state of the user U is estimated based on the acquired conditions, and the suppression process of VR sickness related to audio and video is executed according to the estimated VR sickness state. In addition, in this case, the balance adjustment of the suppression process related to audio and the suppression process related to video is executed according to the VR sickness state.

[0025] 3, in the information processing method according to the embodiment, the information processing device 10 acquires indoor and outdoor conditions related to the user U at any time and estimates the VR sickness state of the user U (step S1). The information processing device 10 estimates the VR sickness state by detecting a change in the physical condition of the user U, for example.

[0026] Furthermore, the information processing device 10 estimates the VR sickness state based on the usage state of the VR content, such as the type of VR content being provided, the video state, and the audio state.

[0027] The information processing device 10 also estimates the VR sickness state based on the vehicle's driving conditions, such as road conditions, vehicle conditions, operation conditions, etc. The information processing device 10 also estimates the VR sickness state based on user information including various parameters indicating the ease of sickness for each user, for example.

[0028] In addition, in the process of estimating the VR sickness state, the information processing device 10 can use an estimation model generated using, for example, a machine learning algorithm. The estimation model is appropriately reinforced learning based on the estimation result of the actual VR sickness state. As a result of the reinforcement learning, for example, a judgment threshold for estimating the VR sickness state, etc. are appropriately updated.

[0029] Then, the information processing device 10 executes a process of suppressing VR sickness for each of the sound and the video of the VR content according to the estimation result in step S1. The process of suppressing VR sickness for sound is generally a process of weakening the stimulation related to the sound of the VR content, for example, a process of lowering the sense of sound localization. The process of suppressing VR sickness for video is generally a process of weakening the stimulation related to the video of the VR content, for example, a process of lowering the contrast, color, etc.

[0030] In this way, by weakening the stimuli related to the sound and image of the VR content, it is possible to mitigate the tendency for sickness to be caused by the sound and image of the VR content. In other words, it is possible to contribute to preventing VR sickness of the user U caused by the VR content.

[0031] Then, in the information processing method according to the embodiment, when the information processing device 10 performs VR sickness suppression processing for each of the audio and video of the VR content, it performs balance adjustment of the VR sickness suppression processing for the audio and video in accordance with the VR sickness state of the user U (step S2).

[0032] This makes it possible to prevent the user U from experiencing VR sickness due to the VR content while maintaining the effectiveness of the VR experience provided by the VR content as much as possible.

[0033] As described above, the information processing method according to the embodiment acquires the internal and external conditions of the user U, estimates the VR sickness state of the user U based on the acquired conditions, and performs the suppression process of VR sickness related to audio and video according to the estimated VR sickness state. In addition, at this time, the balance adjustment of the suppression process related to video and the suppression process related to audio is performed according to the VR sickness state.

[0034] Therefore, according to the information processing method of the embodiment, it is possible to prevent VR sickness caused by VR content in the user U. Hereinafter, a configuration example of the information processing system 1 to which the information processing method of the embodiment is applied will be described more specifically.

[0035] Fig. 4 is a block diagram showing a configuration example of an information processing system 1 according to an embodiment. Fig. 5 is a block diagram showing a configuration example of a suppression processing unit 12d. Note that Figs. 4 and 5 show only components necessary for explaining the features of the embodiment, and descriptions of general components are omitted.

[0036] In other words, each component shown in Figures 4 and 5 is a functional concept, and does not necessarily have to be physically configured as shown in the figures. For example, the specific form of distribution and integration of each block is not limited to that shown in the figures, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0037] In addition, in the description using FIG. 4 and FIG. 5, the description of components that have already been described may be simplified or omitted.

[0038] As shown in FIG. 4, the information processing system 1 according to the embodiment includes an HMD 3 and an information processing device 10.

[0039] The HMD 3 has already been described with reference to Fig. 1, and therefore description thereof will be omitted here. The information processing device 10 includes a storage unit 11 and a control unit 12. In addition, various sensors 5 are connected to the information processing device 10.

[0040] The various sensors 5 are a group of sensors that sense the conditions inside and outside the vehicle, and include, for example, a camera 5a, a vital sign sensor 5b, an acceleration sensor 5c, a steering angle sensor 5d, and the like.

[0041] The camera 5a is a front camera, a rear camera, a side camera, an interior camera, etc., mounted on the vehicle, and captures images of the inside and outside of the vehicle. The interior camera captures images of the state of the user U, for example.

[0042] The vital sensor 5b is a sensor that detects the physical condition of the user U, and is attached to the user U, for example, to measure vital data of the user U, such as heart rate, brain waves, blood oxygen concentration, and sweating.

[0043] The acceleration sensor 5c measures the acceleration and speed of the vehicle. The steering angle sensor 5d measures the steering angle of the vehicle. Of course, the various sensors 5 may include sensors other than the sensors 5a to 5d shown in FIG.

[0044] The memory unit 11 is realized, for example, by semiconductor memory elements such as a RAM (Random Access Memory) or a flash memory, and in the example of Figure 4, stores a VR content DB (database) 11a, user information 11b, an estimation model 11c, and suppression processing information 11d.

[0045] The VR content DB 11a is a database that stores a group of VR contents to be provided to the HMD 3. The user information 11b is information about the user who uses the HMD 3, and includes various parameters that indicate the susceptibility of each user to sickness, etc. The user information 11b is appropriately updated based on the estimation result of the user U's past VR sickness state.

[0046] The estimation model 11c is an estimation model generated using the above-mentioned machine learning algorithm. For example, the estimation model 11c outputs a value indicating the VR sickness state of the user U (for example, a level value indicating the degree of VR sickness) by inputting data indicating various internal and external situations of the user U acquired by the acquisition unit 12b described later.

[0047] The suppression process information 11d is information that defines a process for suppressing VR sickness that should be executed in accordance with the level of VR sickness of the user U. A specific example of the suppression process information 11d will be described later with reference to FIG.

[0048] The control unit 12 is a controller, and is realized, for example, by a CPU (Central Processing Unit), MPU (Micro Processing Unit), etc., executing various programs (not shown) stored in the storage unit 11 using a RAM as a working area. The control unit 12 can also be realized, for example, by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0049] The control unit 12 has a providing unit 12a, an acquiring unit 12b, an estimating unit 12c, and a suppression processing unit 12d, and realizes or executes the functions and actions of information processing described below.

[0050] The providing unit 12a provides the VR content stored in the VR content DB 11a to the HMD 3. In addition, the providing unit 12a acquires a change in the situation detected by the sensor unit 33 of the HMD 3 at any time, and reflects the change in the situation in the VR content.

[0051] The acquisition unit 12b constantly acquires sensing data from the various sensors 5. The acquisition unit 12b also constantly acquires the usage status of the VR content, such as the type of the VR content being provided, the video status, and the audio status, from the provision unit 12a. The acquisition unit 12b also outputs the various acquired data to the estimation unit 12c.

[0052] The estimation unit 12c estimates the VR sickness state of the user U using the estimation model 11c based on the various data acquired by the acquisition unit 12b. In addition, the estimation unit 12c outputs the estimation result to the suppression processing unit 12d.

[0053] The suppression processing unit 12d executes a process of suppressing VR sickness related to the audio and video of the VR content while adjusting the balance between the suppression of VR sickness due to audio and the suppression of VR sickness due to video in accordance with the estimation result of the estimation unit 12c.

[0054] 5, the suppression processing unit 12d includes an audio processing unit 12da, an image processing unit 12db, and a balance adjustment unit 12dc. The audio processing unit 12da performs a process of suppressing VR sickness related to the audio of the VR content. The image processing unit 12db performs a process of suppressing VR sickness related to the image of the VR content.

[0055] The balance adjustment unit 12dc performs balance adjustment between the audio processing by the audio processing unit 12da and the video processing by the video processing unit 12db, depending on the estimation result by the estimation unit 12c.

[0056] Here, the contents of the suppression process executed by the suppression processing unit 12d will be described more specifically with reference to Fig. 6 and Fig. 7. Fig. 6 is a diagram showing the processing contents of the suppression process. Fig. 7 is a diagram showing an example of the suppression process information 11d.

[0057] As shown in Fig. 6, the balance adjustment unit 12dc of the suppression processing unit 12d performs "balance adjustment according to the degree of VR sickness" of the user U estimated by the estimation unit 12c, for example. More specifically, as shown in the figure, the balance adjustment unit 12dc performs suppression processing related to audio, for example, when the user U has mild VR sickness. Such "mainly performing suppression processing related to audio" includes a case where only suppression processing related to audio is performed.

[0058] For example, audio generally contains less information than video, so suppression processing of audio is thought to have a smaller effect on suppressing VR sickness than suppression processing of video. In other words, suppression processing of video has a large effect on suppressing VR sickness, but the effect of the VR experience is weakened.

[0059] Therefore, if user U is suffering from mild VR sickness, by proactively executing audio suppression processing, it is possible to prevent user U from experiencing VR sickness while maintaining as much of the effect of the VR experience provided by the VR content as possible.

[0060] Also, as shown in the figure, for example, when the user U has moderate VR sickness, the balance adjustment unit 12dc performs suppression processing related to the image on its own. Such "suppression processing related to the image on its own" includes the case where only suppression processing related to the image is performed.

[0061] This makes it possible to prevent user U from experiencing VR sickness even if the user U is experiencing moderate VR sickness while maintaining as much of the effect of the VR experience provided by the VR content as possible.

[0062] Also, as shown in the figure, the balance adjustment unit 12dc may execute suppression processing for audio and video with respective intensities determined according to the degree of VR sickness of the user U. This point will be shown later in FIG.

[0063] As shown in the figure, the balance adjustment unit 12dc can perform "audio-related balance adjustment" for multiple audio signals. In this case, the balance adjustment unit 12dc causes the audio processing unit 12da to synthesize audio signals according to the environment, rather than simply adding the audio signals together.

[0064] Specifically, when outputting the sound of virtual objects corresponding to two vehicles outside the vehicle in VR content, for example, the balance adjustment unit 12dc synthesizes the sound of the vehicle at the back from the listening position (i.e., the position of the user U) so that part of the sound is blocked by the vehicle in front, just as in real space.

[0065] This reduces the discrepancy between sensations in virtual space and sensations in real space, making it possible to prevent user U from experiencing VR sickness while maintaining as much of the effectiveness of the VR experience provided by the VR content as possible.

[0066] The suppression process for audio includes, for example, a process of lowering the sense of sound image localization, a process of lowering the volume change speed, a process of reducing the volume change width, and the like.

[0067] In the process of decreasing the sense of sound localization, the audio processor 12da mixes in, for example, non-localized sound (monaural sound). When mixing in such non-localized sound, the audio processor 12da adjusts the mixing ratio of the localized sound and the non-localized sound according to the VR sickness state.

[0068] For example, the audio processing unit 12da increases the mixing ratio of the non-localized sound as the degree of VR sickness increases. It is effective to gradually change the mixing ratio of the localized sound and the non-localized sound. The audio processing unit 12da may also mix random noise as the non-localized sound.

[0069] In addition, in the process of reducing the sense of sound localization, the audio processor 12da mixes audio whose localization is uncorrelated with the video. Such audio is, for example, healing sound or environmental sound (such as the sound of wind or the sound of a bonfire). When mixing such uncorrelated sound, the audio processor 12da adjusts the mixing ratio of the localized sound and the uncorrelated sound according to the VR sickness state.

[0070] For example, the audio processor 12da increases the mixing ratio of uncorrelated sounds as the degree of VR sickness increases.

[0071] In addition, in the process of decreasing the sense of sound localization, the audio processor 12da performs, for example, localization sound processing, but prohibits the movement process. Note that, at this time, the audio processor 12da allows instantaneous movement between two points, but prohibits gradual movement.

[0072] In the process of decreasing the sense of sound localization, the sound processor 12da shortens the localization movement distance, for example, but does not change the localization movement time.

[0073] In addition, in the process of decreasing the sense of sound localization, the audio processor 12da outputs left and right sounds in opposite phases, for example, so that the stereo effect becomes closer to monaural.

[0074] In addition, in the process of reducing the sense of sound localization, the audio processor 12da, for example, emphasizes and synthesizes deep bass sounds. In the process of reducing the sense of sound localization, the audio processor 12da, for example, outputs healing sounds or environmental sounds (such as the sound of wind or the sound of a bonfire). This is the case where the sounds are not mixed with the sounds of the VR content.

[0075] In addition, in the process of decreasing the sense of sound localization, the sound processor 12da, for example, synthesizes the sound of BGM (i.e., constantly mixed sound) to be louder. When synthesizing the sound of such BGM to be louder, the sound processor 12da adjusts the synthesis ratio according to the VR sickness state.

[0076] In addition, in the process of decreasing the sense of sound localization, the sound processor 12da switches the sound source, for example, from the speaker 32 of the HMD 3 to a bone conduction speaker or body sonic (not shown).

[0077] Furthermore, the sound processing unit 12da may appropriately combine the processes for decreasing the sense of sound localization described above.

[0078] The sense of sound image localization can be generated by giving the sound source itself a sense of localization, or by processing the sound from the sound source. The former method can strengthen or weaken the sense of localization by performing various mixing such as level adjustment, time and phase adjustment, etc. for each multi-track sound signal. The latter method can strengthen or weaken the sense of localization by adjusting each parameter of the sound processing. In addition, the sound source of one VR content itself may be recorded in advance with a data structure consisting of multiple sound source patterns with different sound image localization sense, localization movement distance, volume change width, etc., and the VR sickness suppression effect level may be switched by switching these sound source patterns according to the VR sickness state.

[0079] The suppression process related to the image is, for example, a process of decreasing contrast, brightness, brightness change width, etc., a process of adjusting the perspective, a process of decreasing the moving speed of a virtual object, etc. The process of decreasing contrast, brightness, brightness change width, etc. is realized by the image processing unit 12db, for example, by image processing, but may be realized by display drive control. The perspective adjustment process may be performed by switching the VR sickness suppression effect level by switching the image patterns according to the VR sickness state by the image processing unit 12db, in which the image data of one VR content itself has a data structure consisting of multiple image patterns with different perspectives and is recorded in advance. Also, at this time, the switching process of the sound source pattern is preferably performed while maintaining a balance with the image pattern.

[0080] 7, the suppression processing information 11d defines the VR sickness suppression processing for each of the audio and video that should be executed by the suppression processing unit 12d according to the degree of VR sickness. As shown in the figure, the suppression processing information 11d may further be associated with a content type.

[0081] In the example shown in the figure, the degree of motion sickness gradually increases from L1 to L3. Also, the content type indicates that it becomes easier to get motion sickness from A to C. Examples of types that are easy to get motion sickness include action content and horror content.

[0082] In the example shown in the figure, processes a, b, and c, which are suppression processes related to audio, show that the strength of the suppression process gradually increases from process a to process c. Also, the numbers 1, 2, and 3 assigned to processes a, b, and c, respectively, show that the strength of the suppression process gradually increases from 1 to 3. For example, with regard to process a, the strength relationship is as follows: a1 <a2<a3となる。

[0083] The same is true for the image suppression processes l, m, and n. Therefore, for example, for process m, the strength relationship is m1 <m2<m3となる。

[0084] Based on this premise, in the example of Fig. 7, if the level of sickness is L1, the suppression processing unit 12d executes only the processing a1 related to audio when the content type is A. When the content type is B, the suppression processing unit 12d executes the processing a2, which is stronger than the processing a1, for audio, and the processing l2, for video. When the content type is C, the suppression processing unit 12d executes the processing a3, which is stronger than the processing a2, for audio, and the processing l3, which is stronger than the processing l2, for video.

[0085] If the degree of sickness is L2, the suppression processing unit 12d executes processing b1 for audio that is stronger than the processing a1 to a3, and processing m1 for video that is stronger than the processing l2 and l3, when the content type is A. If the content type is B, the suppression processing unit 12d executes processing b2 for audio that is stronger than the processing b1, and processing m2 for video that is stronger than the processing m1. If the content type is C, the suppression processing unit 12d executes processing b3 for audio that is stronger than the processing b2, and processing m3 for video that is stronger than the processing m2.

[0086] Similarly, if the level of sickness is L3, the suppression processing unit 12d executes processing c1 for audio that is stronger than processing b1 to b3, and processing n1 for video that is stronger than processing m1 to m3, when the content type is A. If the content type is B, the suppression processing unit 12d executes processing c2 for audio that is stronger than processing c1, and processing n2 for video that is stronger than processing n1. If the content type is C, the suppression processing unit 12d executes processing c3 for audio that is stronger than processing c2, and processing n3 for video that is stronger than processing n2.

[0087] Returning to the description of Fig. 4, the suppression processing unit 12d executes the suppression processing described with reference to Fig. 6 and Fig. 7 based on the estimation result of the estimation unit 12c and the suppression processing information 11d, and causes the execution result to be reflected in the VR content provided by the provision unit 12a to the HMD 3.

[0088] Next, a process procedure executed by the information processing device 10 according to the embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the process procedure executed by the information processing device 10 according to the embodiment. Note that the process procedure shown in Fig. 8 is repeated as needed while the providing unit 12a provides VR content to the HMD 3.

[0089] 8, first, the acquisition unit 12b acquires indoor and outdoor conditions related to the user U (step S101). Then, the estimation unit 12c estimates the VR sickness state of the user U based on the acquired conditions (step S102).

[0090] Then, the suppression processing unit 12d adjusts the balance of the suppression processing of VR sickness regarding the sound and the video according to the estimated result (step S103). Then, the suppression processing unit 12d executes the suppression processing with the adjusted balance (step S104) and ends the processing.

[0091] As described above, the information processing device 10 according to the embodiment includes an acquisition unit 12b, an estimation unit 12c, and a suppression processing unit 12d. The acquisition unit 12b acquires the inside and outside conditions of the user U of the VR content (corresponding to an example of "digital content including a virtual space experience"). The estimation unit 12c estimates the VR sickness (corresponding to an example of "sickness") condition of the user U based on the conditions acquired by the acquisition unit 12b. The suppression processing unit 12d executes a VR sickness suppression process for the sound and video of the VR content according to the VR sickness condition of the user U estimated by the estimation unit 12c. In addition, when executing the suppression process, the suppression processing unit 12d executes a balance adjustment between the suppression process for the sound and the suppression process for the video according to the VR sickness condition of the user U.

[0092] Therefore, according to the information processing device 10 according to the embodiment, it is possible to prevent the user U from getting VR sickness due to the VR content. In particular, it is possible to prevent VR sickness that may occur due to a lack of synchronization between audio and video, or due to a large fluctuation in audio and video that the brain cannot keep up with. In addition, it is possible to prevent the user U from getting VR sickness due to the VR content while maintaining the effect of the VR experience due to the VR content as much as possible.

[0093] Furthermore, when the degree of the VR sickness state is mild, the suppression processing unit 12d proactively executes the suppression processing related to the sound.

[0094] Therefore, according to the information processing device 10 according to the embodiment, it is possible to prevent the user U from getting VR sickness due to the VR content while maintaining the effect of the VR experience due to the video of the VR content as much as possible.

[0095] Furthermore, when the degree of the VR sickness state is mild, the suppression processing unit 12d executes only the suppression processing related to the sound.

[0096] Therefore, according to the information processing device 10 according to the embodiment, it is possible to prevent the user U from getting VR sickness due to the VR content while maintaining the effect of the VR experience through the images of the VR content as much as possible and without increasing the processing load.

[0097] Furthermore, when the degree of VR sickness is moderate, the suppression processing unit 12d proactively executes suppression processing related to the video.

[0098] Therefore, according to the information processing device 10 according to the embodiment, when the user U has mild or higher levels of VR sickness, the VR sickness of the user U caused by the VR content can be quickly alleviated.

[0099] Furthermore, the suppression processing unit 12d executes suppression processing for each of the audio and video with respective intensities determined according to the degree of VR sickness.

[0100] Therefore, according to the information processing device 10 according to the embodiment, it is possible to execute suppression processes for both audio and video with an appropriate balance according to the user U's VR sickness.

[0101] Furthermore, the video data of the VR content has a plurality of video patterns with at least different perspectives, and the suppression processing unit 12d executes a switching process for switching the above-mentioned video patterns as a suppression process related to the video.

[0102] Therefore, according to the information processing device 10 according to the embodiment, it is possible to switch, for example, the level of the suppression effect of VR sickness by switching the pre-recorded video pattern.

[0103] In addition, the sound source data of the VR content has a plurality of sound source patterns that differ at least in sound image positioning sense, positioning movement distance, or volume change range, and the suppression processing unit 12d executes a switching process for switching the sound source pattern while maintaining a balance with the video pattern as a suppression process related to audio.

[0104] Therefore, according to the information processing device 10 of the embodiment, by switching between pre-recorded sound source patterns while balancing them with video patterns, it is possible to switch between VR sickness suppression effect levels in a balanced manner in terms of vision and hearing.

[0105] In the above-described embodiment, an example has been given in which the HMD 3 and the information processing device 10 are configured separately, but this is not limited thereto, and the HMD 3 and the information processing device 10 may be configured as an integrated unit.

[0106] In addition, in the above-described embodiment, the HMD 3 is given as an example of a presentation device that presents the VR content provided from the information processing device 10 to the user U, but the presentation device is not limited to this and may include, for example, a bone conduction speaker or a vibration presentation device that presents vibrations such as bodysonics.

[0107] Furthermore, the presentation device is not limited to a wearable computer. For example, if it is a vehicle, the front window, side window, etc. may be configured as a display, and video output may be performed to the display. Furthermore, audio output may be performed to an in-vehicle speaker. In-vehicle speakers are usually suitable for 3D playback because multiple speakers can be appropriately arranged in multiple directions including front, back, left and right. If it is not a vehicle, the walls of the space in which the VR content is provided may be configured as a display, and multiple speakers may be arranged in the space in the same manner as in-vehicle speakers.

[0108] In the above-described embodiment, an example has been given in which the information processing device 10 provides VR content. However, any digital content that includes a virtual space experience may be used, and may be AR (Augmented Reality) content or MR content.

[0109] In addition, in the above-described embodiment, an example was given in which the information processing device 10 is an in-vehicle device mounted in a vehicle, but this is not limited to this, and the information processing device 10 may be a computer such as a game console that provides digital content including a virtual space experience.

[0110] Further advantages and modifications may readily occur to those skilled in the art. Thus, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and equivalents thereof. [Explanation of symbols]

[0111] 1. Information Processing Systems 3 HMD 5 Various sensors 10. Information processing device 11 Storage section 11a VR Content DB 11b User Information 11c Estimation model 11d Suppression Processing Information 12 Control section 12a Providing Department 12b Acquisition part 12c Estimation part 12d Suppression processing section 12da Audio Processing Unit 12db video processing section 12dc balance adjustment section 31 Display section 32 Speaker 33 Sensor section

Claims

1. Acquire a physical condition of a user viewing digital content including a virtual space experience, a usage status of the digital content, and a driving status of a vehicle in which the user is riding; Estimating the user's drunkenness state based on the acquired state; As a sickness suppression process according to the estimated sickness state of the user, a sound suppression process for the sound of the digital content or a video suppression process for the video of the digital content is executed; When the suppression process is executed, if the degree of the user's drunkenness is mild, the audio suppression process and the video suppression process are executed mainly, When the suppression process is executed, if the degree of intoxication of the user is moderate, the video suppression process is executed mainly out of the audio suppression process and the video suppression process. An information processing device including a controller.

2. The controller, As an execution mainly consisting of the voice suppression processing, only the voice suppression processing is executed, As an execution mainly consisting of the video suppression processing, only the video suppression processing is executed. The information processing device according to claim 1 .

3. The physical condition of the user is vital data indicating a heart rate, an electroencephalogram, a blood oxygen concentration, or sweating, The usage status of the digital content includes a type of the digital content, a video status, or an audio status; The vehicle driving conditions include road conditions, vehicle conditions, or operation conditions; 3. The information processing device according to claim 1 or 2.

4. The controller, Acquire user information including the user's susceptibility to intoxication; Estimating a drunkenness state of the user based on the acquired user information.

4. The information processing device according to claim 1, 2 or 3.

5. The controller: executing the audio suppression process and the video suppression process with respective intensities determined according to the degree of the drunkenness state; 3. The information processing device according to claim 1 or 2.

6. the video data of the digital content has at least a plurality of video patterns with different perspectives; The controller: As the image suppression process, a switching process for switching the image pattern is executed.

3. The information processing device according to claim 1 or 2.

7. The sound source data of the digital content has a plurality of sound source patterns that differ at least in sound image localization feeling, localization movement distance, or volume change range, The controller: As the sound suppression process, a switching process is executed to switch the sound source pattern while maintaining a balance with the video pattern. The information processing device according to claim 6.

8. Acquire a physical condition of a user viewing digital content including a virtual space experience, a usage status of the digital content, and a driving status of a vehicle in which the user is riding; Estimating the user's drunkenness state based on the acquired state; As a sickness suppression process according to the estimated sickness state of the user, a sound suppression process for the sound of the digital content or a video suppression process for the video of the digital content is executed; When the suppression process is executed, if the degree of the user's drunkenness is mild, the audio suppression process and the video suppression process are executed mainly, When the suppression process is executed, if the degree of intoxication of the user is moderate, the video suppression process is executed mainly out of the audio suppression process and the video suppression process. The information processing method carried out by the controller.

9. Acquire a physical condition of a user viewing digital content including a virtual space experience, a usage status of the digital content, and a driving status of a vehicle in which the user is riding; Estimating the user's drunkenness state based on the acquired state; As a sickness suppression process according to the estimated sickness state of the user, a sound suppression process for the sound of the digital content or a video suppression process for the video of the digital content is executed; When the suppression process is executed, if the degree of the user's drunkenness is mild, the audio suppression process and the video suppression process are executed mainly, When the suppression process is executed, if the degree of intoxication of the user is moderate, the video suppression process is executed mainly out of the audio suppression process and the video suppression process. A program that causes the controller to execute processing.

Images