Information processing device, information processing method, and program

The information processing device addresses VR sickness in vehicle-mounted systems by estimating user conditions and applying audio adjustments to reduce motion discomfort through sound localization and volume control, enhancing user comfort during VR experiences.

JP7611682B2Active Publication Date: 2025-01-10DENSO TEN LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2020199145
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-11-30
Publication Date
2025-01-10
Estimated Expiration
2040-11-30

AI Technical Summary

Technical Problem

Conventional VR systems, especially those installed in vehicles, fail to adequately prevent motion sickness caused by synchronization issues between audio and video, leading to severe user discomfort.

Method used

An information processing device that estimates a user's VR sickness state by analyzing internal and external conditions, and executes audio suppression processes such as reducing sound localization and volume change speed to mitigate VR sickness.

Benefits of technology

Effectively prevents VR sickness by adjusting audio stimuli based on user condition, reducing the risk of motion discomfort during VR experiences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007611682000001
    Figure 0007611682000001
  • Figure 0007611682000002
    Figure 0007611682000002
  • Figure 0007611682000003
    Figure 0007611682000003
Patent Text Reader

Abstract

To suppress sickness felt by a user due to a digital content including a virtual space experience.SOLUTION: An information processing device according to embodiment comprises an acquisition unit, an estimation unit, and a suppression processing unit. The acquisition unit acquires internal and external situations concerning a user of a digital content including a virtual space experience. The estimation unit estimates the situation of sickness felt by the user, on the basis of the situation acquired by the acquisition unit. The suppression processing unit executes suppression processing of the sickness concerning the audio of the digital content, in accordance with the situation of the sickness felt by the user estimated by the estimation unit.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The disclosed embodiments include an information processing device and an information processing method. and Program To Regarding. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a technique for providing a user with digital content including a virtual space experience, such as VR (Virtual Reality) or MR (Mixed Reality), using a head mounted display (HMD) or the like.

[0003] In addition, in this technology, a VR system has been proposed that is mounted on a moving object such as a vehicle and that can use the moving object as a motion platform (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-102401 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional techniques have room for further improvement in terms of preventing users from becoming motion sickness-prone due to digital content that includes virtual space experiences.

[0006] For example, it is known that users who receive VR content may experience "VR sickness," which is similar to motion sickness. VR sickness is a type of motion sickness that can occur due to a lack of synchronization between audio and video, or large fluctuations in audio and video that the brain cannot keep up with. In particular, in the case of VR systems installed in vehicles, users' sickness tends to be even worse because it also involves regular motion sickness.

[0007] One aspect of the embodiment has been made in consideration of the above, and aims to provide an information processing device, an information processing method, a program, and a data structure that can prevent a user from becoming motion sickness caused by digital content including a virtual space experience. [Means for solving the problem]

[0008] According to one aspect of the embodiment, there is provided an information processing device comprising: controller The above-mentioned controller acquires internal and external situations regarding a user of digital content including a virtual space experience. , take Based on the obtained state, the user's drunkenness state is estimated. Also, The above controller teeth , recommendation A process for suppressing sickness related to the audio of the digital content is executed according to the determined sickness level of the user. In addition, the controller executes a process of lowering a volume change rate of the audio of the digital content in the suppression process. Effect of the Invention

[0009] According to one aspect of the embodiment, it is possible to prevent a user from becoming motion sickness caused by digital content that includes a virtual space experience. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of an information processing system according to an embodiment. [Diagram 2] Figure 2 is an explanatory diagram of VR sickness. [Diagram 3] FIG. 3 is a diagram illustrating an outline of the information processing method according to the embodiment. [Figure 4] FIG. 4 is a block diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Diagram 5] FIG. 5 is a diagram showing the process contents of the suppression process. [Figure 6] FIG. 6 is a diagram illustrating an example of the suppression process information. [Figure 7]FIG. 7 is a flowchart showing a processing procedure executed by the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of an information processing device, an information processing method, a program, and a data structure disclosed in the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the embodiments described below.

[0012] In the following, the information processing system 1 according to the embodiment will be described as an in-vehicle system mounted in a vehicle. In the following, the information processing system 1 according to the embodiment is a VR system that provides a user with VR content as digital content including a virtual space experience.

[0013] First, an overview of an information processing method according to an embodiment will be described with reference to Fig. 1 to Fig. 3. Fig. 1 is a diagram showing a schematic configuration of an information processing system 1 according to an embodiment. Fig. 2 is an explanatory diagram of VR sickness. Fig. 3 is an explanatory diagram showing the overview of the information processing method according to an embodiment.

[0014] As shown in FIG. 1, an information processing system 1 according to the embodiment includes an HMD 3 and an information processing device 10.

[0015] The HMD 3 is an information processing terminal that presents VR content provided by the information processing device 10 to the user U and allows the user to enjoy a VR experience. The HMD 3 is a wearable computer that is worn on the head of the user U and is a goggle-type computer in the example of Fig. 1. The HMD 3 may be a glasses-type computer or a hat-type computer.

[0016] The HMD 3 includes a display unit 31, a speaker 32, and a sensor unit 33. The display unit 31 is provided so as to be placed in front of the eyes of the user U, and displays images included in the VR content provided by the information processing device 10.

[0017] In the example of Fig. 1, one display unit 31 is provided in front of each of the left and right eyes of the user U, but only one display unit may be provided. The display unit 31 may be a non-transmissive type that completely covers the field of view, or may be a video-transmissive type or an optical-transmissive type. In this embodiment, the display unit 31 is a non-transmissive type.

[0018] 1, the speaker 32 is provided in a headphone type, for example, and is worn on the ears of the user U. The speaker 32 outputs sound included in the VR content provided by the information processing device 10.

[0019] The sensor unit 33 is a device that detects changes in the inside and outside circumstances of the user U, and includes, for example, a camera, a motion sensor, and the like.

[0020] The information processing device 10 is, for example, a computer, an in-vehicle device mounted on a vehicle, connected to the HMD 3 by wire or wirelessly, and provides VR content to the HMD 3. In addition, the information processing device 10 acquires changes in the situation detected by the sensor unit 33 at any time, and reflects such changes in the situation in the VR content.

[0021] For example, the information processing device 10 can change the direction of the field of view in the virtual space of the VR content in response to a change in the head or line of sight of the user U detected by the sensor unit 33.

[0022] Incidentally, it is known that when VR content is provided using such an HMD 3, the user U may experience "VR sickness," which is similar to motion sickness.

[0023] As shown in Figure 2, VR sickness can occur due to factors such as out-of-sync audio and video, or large fluctuations in audio and video that the brain cannot keep up with. VR sickness can also occur due to a mismatch between the sensations of the VR experience enjoyed using the HMD 3 and the physical sensations of the user U due to changes in the surrounding environment.

[0024] Therefore, in the information processing method of the embodiment, the indoor and outdoor conditions related to the user U are acquired, the VR sickness state of the user U is estimated based on the acquired conditions, and processing for suppressing VR sickness related to audio is performed according to the estimated VR sickness state.

[0025] 3, in the information processing method according to the embodiment, the information processing device 10 acquires indoor and outdoor conditions related to the user U at any time and estimates the VR sickness state of the user U (step S1). The information processing device 10 estimates the VR sickness state by detecting a change in the physical condition of the user U, for example.

[0026] Furthermore, the information processing device 10 estimates the VR sickness state based on the usage state of the VR content, such as the type of VR content being provided, the video state, and the audio state.

[0027] The information processing device 10 also estimates the VR sickness state based on the vehicle's driving conditions, such as road conditions, vehicle conditions, operation conditions, etc. The information processing device 10 also estimates the VR sickness state based on user information including various parameters indicating the ease of sickness for each user, for example.

[0028] In addition, in the process of estimating the VR sickness state, the information processing device 10 can use an estimation model generated using, for example, a machine learning algorithm. The estimation model is appropriately reinforced learning based on the estimation result of the actual VR sickness state. As a result of the reinforcement learning, for example, a judgment threshold for estimating the VR sickness state, etc. are appropriately updated.

[0029] Then, the information processing device 10 executes a process for suppressing VR sickness related to the sound of the VR content according to the estimation result in step S1 (step S2). The process for suppressing VR sickness related to the sound is generally a process for weakening the stimulation related to the sound of the VR content, for example, a process for reducing the sense of sound image localization.

[0030] Moreover, the suppression process of VR sickness related to audio is, for example, a process of decreasing the volume change speed. Moreover, the suppression process of VR sickness related to audio is, for example, a process of reducing the volume change width. Details of the suppression process of VR sickness related to audio will be described later with reference to FIG. 5 etc.

[0031] In this way, by weakening the stimuli related to the sound of the VR content, it is possible to mitigate at least the tendency for sickness to be evoked by the sound of the VR content. In other words, it is possible to contribute to preventing VR sickness of the user U due to the VR content.

[0032] In the description of Fig. 3, the process of suppressing VR sickness related to audio is executed, but the process of suppressing VR sickness related to video may be used in combination. The process of suppressing VR sickness related to video is generally a process of weakening the stimulation related to the video of the VR content, for example, a process of reducing contrast, color, etc.

[0033] As described above, the information processing method of the embodiment acquires indoor and outdoor conditions related to a user U, estimates the user U's VR sickness state based on the acquired conditions, and performs processing to suppress VR sickness related to audio in accordance with the estimated VR sickness state.

[0034] Therefore, according to the information processing method of the embodiment, it is possible to prevent VR sickness caused by VR content in the user U. Hereinafter, a configuration example of the information processing system 1 to which the information processing method of the embodiment is applied will be described more specifically.

[0035] Fig. 4 is a block diagram showing an example of the configuration of an information processing system 1 according to an embodiment. Note that Fig. 4 shows only components necessary for explaining the features of the embodiment, and omits description of general components.

[0036] In other words, each component shown in Fig. 4 is a functional concept, and does not necessarily have to be physically configured as shown in the figure. For example, the specific form of distribution and integration of each block is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0037] In addition, in the description using FIG. 4, the description of components that have already been described may be simplified or omitted.

[0038] As shown in FIG. 4, the information processing system 1 according to the embodiment includes an HMD 3 and an information processing device 10.

[0039] The HMD 3 has already been described with reference to Fig. 1, and therefore description thereof will be omitted here. The information processing device 10 includes a storage unit 11 and a control unit 12. In addition, various sensors 5 are connected to the information processing device 10.

[0040] The various sensors 5 are a group of sensors that sense the conditions inside and outside the vehicle, and include, for example, a camera 5a, a vital sign sensor 5b, an acceleration sensor 5c, a steering angle sensor 5d, and the like.

[0041] The camera 5a is a front camera, a rear camera, a side camera, an interior camera, etc., mounted on the vehicle, and captures images of the inside and outside of the vehicle. The interior camera captures images of the state of the user U, for example.

[0042] The vital sensor 5b is a sensor that detects the physical condition of the user U, and is attached to the user U, for example, to measure vital data of the user U, such as heart rate, brain waves, blood oxygen concentration, and sweating.

[0043] The acceleration sensor 5c measures the acceleration and speed of the vehicle. The steering angle sensor 5d measures the steering angle of the vehicle. Of course, the various sensors 5 may include sensors other than the sensors 5a to 5d shown in FIG.

[0044] The memory unit 11 is realized, for example, by semiconductor memory elements such as a RAM (Random Access Memory) or a flash memory, and in the example of Figure 4, stores a VR content DB (database) 11a, user information 11b, an estimation model 11c, and suppression processing information 11d.

[0045] The VR content DB 11a is a database that stores a group of VR contents to be provided to the HMD 3. The user information 11b is information about the user who uses the HMD 3, and includes various parameters that indicate the susceptibility of each user to sickness, etc. The user information 11b is appropriately updated based on the estimation result of the user U's past VR sickness state.

[0046] The estimation model 11c is an estimation model generated using the above-mentioned machine learning algorithm. For example, the estimation model 11c outputs a value indicating the VR sickness state of the user U (for example, a level value indicating the degree of VR sickness) by inputting data indicating various internal and external situations of the user U acquired by the acquisition unit 12b described later.

[0047] The suppression process information 11d is information that defines a process for suppressing VR sickness that should be executed in accordance with the degree of VR sickness of the user U. A specific example of the suppression process information 11d will be described later with reference to FIG.

[0048] The control unit 12 is a controller, and is realized, for example, by a CPU (Central Processing Unit), MPU (Micro Processing Unit), etc., executing various programs (not shown) stored in the storage unit 11 using a RAM as a working area. The control unit 12 can also be realized, for example, by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0049] The control unit 12 has a providing unit 12a, an acquiring unit 12b, an estimating unit 12c, and a suppression processing unit 12d, and realizes or executes the functions and actions of information processing described below.

[0050] The providing unit 12a provides the VR content stored in the VR content DB 11a to the HMD 3. In addition, the providing unit 12a acquires a change in the situation detected by the sensor unit 33 of the HMD 3 at any time, and reflects the change in the situation in the VR content.

[0051] The acquisition unit 12b constantly acquires sensing data from the various sensors 5. The acquisition unit 12b also constantly acquires the usage status of the VR content, such as the type of the VR content being provided, the video status, and the audio status, from the provision unit 12a. The acquisition unit 12b also outputs the various acquired data to the estimation unit 12c.

[0052] The estimation unit 12c estimates the VR sickness state of the user U using the estimation model 11c based on the various data acquired by the acquisition unit 12b. In addition, the estimation unit 12c outputs the estimation result to the suppression processing unit 12d.

[0053] The suppression processing unit 12d executes a process for suppressing VR sickness related to the sound of the VR content, according to the estimation result of the estimation unit 12c.

[0054] The suppression process executed by the suppression processing unit 12d will now be described in more detail with reference to Fig. 5 and Fig. 6. Fig. 5 is a diagram showing the process content of the suppression process. Fig. 6 is a diagram showing an example of suppression process information 11d.

[0055] As shown in Fig. 5, the suppression process of VR sickness related to the sound of VR content is, for example, "a process of reducing the sense of localization of a sound image." In the process of reducing the sense of localization of a sound image, the suppression processing unit 12d mixes, for example, a non-localized sound (monaural sound). When mixing such a non-localized sound, the suppression processing unit 12d adjusts the mixing ratio of the localized sound and the non-localized sound according to the VR sickness state.

[0056] For example, the suppression processing unit 12d increases the mixing ratio of the non-localized sound as the degree of VR sickness increases. It is effective to gradually change the mixing ratio of the localized sound and the non-localized sound. In addition, the suppression processing unit 12d may mix random noise as the non-localized sound.

[0057] In addition, in the process of reducing the sense of sound localization, the suppression processing unit 12d mixes, for example, a sound whose localization is uncorrelated with the video. Such a sound is, for example, a healing sound or an environmental sound (such as the sound of the wind or the sound of a bonfire). When mixing such an uncorrelated sound, the suppression processing unit 12d adjusts the mixing ratio of the localized sound and the uncorrelated sound according to the VR sickness state.

[0058] For example, the suppression processing unit 12d increases the mixing ratio of uncorrelated sounds as the degree of VR sickness increases.

[0059] In addition, in the process of decreasing the sense of sound localization, the suppression processing unit 12d performs, for example, localization sound processing, but prohibits the movement process. Note that, at this time, the suppression processing unit 12d allows instantaneous movement between two points, but prohibits gradual movement.

[0060] In addition, in the process of decreasing the sense of sound localization, the suppression processing unit 12d shortens the localization movement distance, for example. At this time, the suppression processing unit 12d does not change the localization movement time.

[0061] In addition, in the process of decreasing the sense of sound image localization, the suppression processing unit 12d outputs the left and right sounds in opposite phases, for example, so that the stereo effect becomes closer to monaural.

[0062] In addition, in the process of reducing the sense of sound localization, the suppression processing unit 12d, for example, emphasizes and synthesizes deep bass sounds. In the process of reducing the sense of sound localization, the suppression processing unit 12d, for example, outputs healing sounds or environmental sounds (such as the sound of wind or the sound of a bonfire). This is the case where the sounds are not mixed with the sound of the VR content.

[0063] In addition, in the process of decreasing the sense of sound localization, the suppression processing unit 12d, for example, synthesizes the sound of BGM (i.e., constantly mixed sound) to be louder. When synthesizing the sound of such BGM to be louder, the suppression processing unit 12d adjusts the synthesis ratio according to the VR sickness state.

[0064] In addition, in the process of decreasing the sense of sound localization, the suppression processing unit 12d switches the sound source, for example, from the speaker 32 of the HMD 3 to a bone conduction speaker or body sonic (not shown).

[0065] Furthermore, the suppression processing unit 12d may appropriately combine the processes for reducing the sense of sound localization described above.

[0066] As shown in the figure, the suppression process for VR sickness related to the sound of the VR content is, for example, a "processing for lowering the volume change speed." Also, as shown in the figure, for example, a "processing for reducing the volume change width."

[0067] The sense of sound image localization can be generated by giving the sound source itself a sense of localization, or by processing the sound from the sound source. The former method can strengthen or weaken the sense of localization by performing various mixing such as level adjustment, time and phase adjustment, etc. for each multi-track sound signal. The latter method can strengthen or weaken the sense of localization by adjusting each parameter of the sound processing. In addition, the sound source of one VR content itself may be recorded in advance with a data structure consisting of multiple sound source patterns with different sound image localization sense, localization movement distance, volume change width, etc., and the VR sickness suppression effect level may be switched by switching these sound source patterns according to the VR sickness state.

[0068] 6, the suppression processing information 11d defines a VR sickness suppression process that the suppression processing unit 12d should execute according to the degree of VR sickness. As shown in the figure, the suppression processing information 11d may further be associated with a content type.

[0069] In the example shown in the figure, the degree of motion sickness gradually increases from L1 to L3. Also, the content type indicates that it becomes easier to get motion sickness from A to C. Examples of types that are easy to get motion sickness include action content and horror content.

[0070] 6, the processes a, b, and c, which are suppression processes related to audio, show that the strength of the suppression process gradually increases from process a to process c. In the example of FIG. 6, if the degree of sickness is L1, the suppression processing unit 12d executes process a only when the content type is C.

[0071] Also, if the degree of sickness is L2, the suppression processing unit 12d executes the process a when the content type is B, and executes the process b, which is stronger than the process a, when the content type is C.

[0072] Furthermore, if the level of sickness is L3, the suppression processing unit 12d will execute process a if the content type is A, process b if the content type is B, and process c, which is stronger than processes a and b, if the content type is C.

[0073] In addition, Fig. 6 shows an example in which suppression processing for VR sickness related to video is also defined, which indicates that it can be used in conjunction with suppression processing for VR sickness related to audio. Incidentally, processes l, m, n, and o indicate that the strength of the suppression processing gradually increases from process l to process o, similar to the above-mentioned processes a, b, and c.

[0074] Returning to the description of Fig. 4, the suppression processing unit 12d executes the suppression processing described with reference to Fig. 5 and Fig. 6 based on the estimation result of the estimation unit 12c and the suppression processing information 11d, and causes the execution result to be reflected in the VR content provided by the provision unit 12a to the HMD 3.

[0075] Next, a process performed by the information processing device 10 according to the embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the process performed by the information processing device 10 according to the embodiment. The process shown in Fig. 7 is repeated as needed while the providing unit 12a provides VR content to the HMD 3.

[0076] 7, first, the acquisition unit 12b acquires indoor and outdoor conditions related to the user U (step S101). Then, the estimation unit 12c estimates the VR sickness state of the user U based on the acquired conditions (step S102).

[0077] Then, the suppression processing unit 12d determines the suppression processing for VR sickness related to the sound according to the estimated result (step S103). Then, the suppression processing unit 12d executes the determined suppression processing (step S104) and ends the processing.

[0078] As described above, the information processing device 10 according to the embodiment includes an acquisition unit 12b, an estimation unit 12c, and a suppression processing unit 12d. The acquisition unit 12b acquires the inside and outside conditions of the user U of the VR content (corresponding to an example of "digital content including a virtual space experience"). The estimation unit 12c estimates the VR sickness (corresponding to an example of "sickness") condition of the user U based on the conditions acquired by the acquisition unit 12b. The suppression processing unit 12d executes a process of suppressing VR sickness related to the sound of the VR content according to the VR sickness condition of the user U estimated by the estimation unit 12c.

[0079] Therefore, according to the information processing device 10 according to the embodiment, it is possible to prevent the user U from getting VR sickness due to the VR content. In particular, it is possible to prevent VR sickness that may be caused by factors such as out-of-sync audio and video, or large fluctuations in audio and video that the brain cannot keep up with.

[0080] Moreover, the suppression processing unit 12d executes processing for lowering the sense of sound image localization in the sound of the VR content as the suppression processing.

[0081] Therefore, according to the information processing device 10 according to the embodiment, it is possible to prevent the user U from getting VR sickness caused by the VR content by performing a process of reducing the sense of sound localization without involving video processing, without increasing the processing load.

[0082] Furthermore, the suppression processing unit 12d executes a process of lowering the volume change rate of the sound of the VR content as the suppression process.

[0083] Therefore, according to the information processing device 10 according to the embodiment, the volume change rate reduction process that does not involve video processing can prevent the user U from getting VR sickness due to VR content without increasing the processing load.

[0084] Furthermore, the suppression processing unit 12d executes a process of reducing the volume change range of the sound of the VR content as the suppression process.

[0085] Therefore, according to the information processing device 10 according to the embodiment, the volume change range reduction process that does not involve video processing can prevent the user U from getting VR sickness caused by the VR content without increasing the processing load.

[0086] Furthermore, the sound source data of the VR content has a plurality of sound source patterns that differ at least in sound image localization feeling, localization movement distance, or volume change width, and the suppression processing unit 12d executes a switching process for switching the sound source pattern as the suppression process.

[0087] Therefore, according to the information processing device 10 according to the embodiment, it is possible to switch, for example, the level of the suppression effect of VR sickness by switching the pre-recorded sound source pattern.

[0088] In the above-described embodiment, an example has been given in which the HMD 3 and the information processing device 10 are configured separately, but this is not limited thereto, and the HMD 3 and the information processing device 10 may be configured as an integrated unit.

[0089] In addition, in the above-described embodiment, the HMD 3 is given as an example of a presentation device that presents the VR content provided from the information processing device 10 to the user U, but the presentation device is not limited to this and may include the bone conduction speaker described above, or may include a vibration presentation device that presents vibrations such as BodySonics.

[0090] Furthermore, the presentation device is not limited to a wearable computer. For example, if it is a vehicle, the front window, side window, etc. may be configured as a display, and video output may be performed to the display. Furthermore, audio output may be performed to an in-vehicle speaker. In-vehicle speakers are usually suitable for 3D playback because multiple speakers can be appropriately arranged in multiple directions including front, back, left and right. If it is not a vehicle, the walls of the space in which the VR content is provided may be configured as a display, and multiple speakers may be arranged in the space in the same manner as in-vehicle speakers.

[0091] In the above-described embodiment, an example has been given in which the information processing device 10 provides VR content. However, any digital content that includes a virtual space experience may be used, and may be AR (Augmented Reality) content or MR content.

[0092] In addition, in the above-described embodiment, an example was given in which the information processing device 10 is an in-vehicle device mounted in a vehicle, but this is not limited to this, and the information processing device 10 may be a computer such as a game console that provides digital content including a virtual space experience.

[0093] Further advantages and modifications may readily occur to those skilled in the art. Thus, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and equivalents thereof. [Explanation of symbols]

[0094] 1. Information Processing Systems 3 HMD 5 Various sensors 10. Information processing device 11 Storage section 11a VR Content DB 11b User Information 11c Estimation model 11d Suppression Processing Information 12 Control section 12a Providing Department 12b Acquisition part 12c Estimation part 12d Suppression processing section 31 Display section 32 Speaker 33 Sensor section

Claims

1. Acquire internal and external situations regarding users of digital content, including virtual space experiences; Estimating the user's drunkenness state based on the acquired state; execute a sickness suppression process related to the audio of the digital content in accordance with the estimated sickness state of the user; In the suppression process, a process of reducing a volume change rate of the audio of the digital content is executed. An information processing device including a controller.

2. The controller: In the suppression process, a process of reducing a sense of sound image localization in the sound of the digital content is executed. The information processing device according to claim 1 .

3. The controller: In the suppression process, a process of reducing a volume change range in the audio of the digital content is performed. The information processing device according to claim 1 .

4. The sound source data of the digital content includes a plurality of sound source patterns each having a different sound image localization feeling, a localization movement distance, or a volume change range, The controller: In the suppression process, a switching process is executed to switch the sound source pattern.

3. The information processing device according to claim 1 or 2.

5. Acquire internal and external situations regarding users of digital content, including virtual space experiences; Estimating the user's drunkenness state based on the acquired state; execute a sickness suppression process related to the audio of the digital content in accordance with the estimated sickness state of the user; In the suppression process, a process of reducing a volume change rate of the audio of the digital content is executed. The information processing method carried out by the controller.

6. Acquiring internal and external conditions regarding a user of digital content including a virtual space experience; Estimating the user's drunkenness state based on the acquired state; and Executing a sickness suppression process related to the audio of the digital content according to the estimated sickness state of the user; In the suppression process, a process of reducing a volume change rate of the audio of the digital content is executed; A program that causes a computer to execute the following.

Citation Information

Patent Citations

  • Simulation system, processing method, and information storage medium

    CN109478345A

  • Vr sickness reducing method

    JP2000339490A

  • Virtual reality system

    JP2017102401A

  • Display system, head mounted display device, display control method, and program

    JP2017183855A

  • Device, sound data generation method, and program

    JP2018126185A