Sensory feedback control device and its program

Abstract

To enable presentation of thermal sensation in conjunction with VR images.SOLUTION: A sensation presentation control device 3 is disclosed, comprising a position / posture input unit 30 for inputting the position and posture of a viewer in the real world, a position / posture computation unit 31 for computing the position and posture of the viewer in a virtual space, a heat source database 32 storing preregistered positions of a heat source, an output control unit 33 configured to determine whether to present a sensation of the heat source to the viewer or not and compute an output of the heat source to be presented to the viewer, and a sensation presenting unit 34 for presenting a thermal sensation of the heat source to the viewer.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] This invention relates to a sensory presentation control device and its program. [Background technology]

[0002] With the widespread use of HMDs (Head-Mounted Displays) and headphones, visual and auditory presentations in virtual reality (VR) have become possible, and the realization of other sensory presentations, such as temperature, is also expected. Therefore, methods have been proposed to present the sensation of warmth from heat sources such as the sun or a campfire using the sensation of warmth from the skin being warmed and the sensation of light from indirect light coming through the gaps in the HMD (for example, Patent Documents 1 and 2). [Prior art documents] [Patent Documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-85725 [Patent Document 2] Japanese Patent Publication No. 2001-166676 [Overview of the project] [Problems that the invention aims to solve]

[0004] However, the methods described in Patent Documents 1 and 2 mentioned above do not necessarily synchronize the image of the heat source with the presentation of temperature, and may not provide a high level of realism.

[0005] The object of this invention is to provide a sensory presentation control device and program that presents a sense of temperature in conjunction with VR images. [Means for solving the problem]

[0006] To solve the aforementioned problems, the sensory presentation control device according to the present invention is a sensory presentation control device that presents the sensation of a heat source to a person viewing a VR image of a virtual space containing a heat source, and comprises a position and orientation input unit, a position and orientation calculation unit, a heat source database, an output control unit, and a sensory presentation unit.

[0007] In this configuration, the position and orientation input unit receives the position and orientation of the person in the real world. The position and orientation calculation unit calculates the position and orientation of a person in the virtual space based on the person's initial position and orientation in the virtual space, which are set in advance, and the person's position and orientation in the real world. The heat source database pre-registers the locations of heat sources placed in a virtual space.

[0008] The output control unit determines whether or not to present the sensation of a heat source to the person based on their position and orientation in the virtual space and the heat source database, and calculates the output of the heat source to present to the person. The sensory presentation unit, based on the output of the heat source calculated by the output control unit, presents the person with the sensation of warmth from the heat source. The heat source database pre-registers the locations of a first heat source whose sensation does not depend on the distance from the person to the heat source, and the locations of a second heat source whose sensation depends on the distance from the person to the heat source. The output control unit receives identification information representing the type of heat source placed in the virtual space. If a first heat source is placed in the virtual space, it determines whether the person is shielded from the first heat source. If the person is shielded from the first heat source, it calculates the output of the heat source to present to the person as zero. If a second heat source is placed in the virtual space, it calculates the output of the heat source to present to the person according to the distance from the person to the heat source. In this way, the sensory presentation control device can present the sensation of warmth in conjunction with VR images.

[0009] Furthermore, the present invention can also be implemented using a program that causes a computer to function as the aforementioned sensory presentation control device. [Effects of the Invention]

[0010] According to the present invention, it is possible to present a sense of warmth in conjunction with VR images. [Brief explanation of the drawing]

[0011] [Figure 1] (a) and (b) are schematic diagrams of the sensory presentation system according to the embodiment. [Figure 2]This is a block diagram showing the configuration of a sensory feedback control device according to an embodiment. [Figure 3] This is an explanatory diagram illustrating the calculation of a person's position in an embodiment. [Figure 4] This is an explanatory diagram illustrating the calculation of a person's posture in an embodiment. [Figure 5] In this embodiment, (a) is an explanatory diagram of the case when the sun is not blocked, and (b) is an explanatory diagram of the case when the sun is blocked. [Figure 6] In this embodiment, (a) to (e) are explanatory diagrams illustrating the calculation of the output of the first heat source. [Figure 7] In this embodiment, (a) and (b) are explanatory diagrams illustrating the calculation of the output of the second heat source. [Figure 8] This graph shows an example of the output of the second heat source in the embodiment. [Figure 9] This is an explanatory diagram illustrating the adjustment of the output to the sensory presentation device in an embodiment. [Figure 10] This graph shows an example of the relationship between the angle between the sensory presentation device and the heat source and the output to the sensory presentation device in the embodiment. [Figure 11] This is an explanatory diagram illustrating the energy of thermal and luminous sensations in an embodiment. [Figure 12] This flowchart shows the operation of the sensory feedback control device when a first heat source is present in an embodiment. [Figure 13] This flowchart shows the operation of the sensory feedback control device when a second heat source is provided in one embodiment. [Modes for carrying out the invention]

[0012] Embodiments of the present invention will be described below with reference to the drawings. However, the embodiments described below are intended to embody the technical concept of the present invention, and unless otherwise specified, the present invention is not limited to these embodiments. In addition, the same reference numerals are used for the same means, and their descriptions may be omitted.

[0013] (Embodiment) [Overview of the sensory presentation system] Referring to Figure 1, an overview of the sensory presentation system 1 according to this embodiment will be described. The sensory presentation system 1 presents the sensation of a heat source (e.g., the sun, a bonfire) to the viewer (person) H who is viewing VR images with the HMD2, in conjunction with the VR images. As shown in Figure 1(a), the sensory presentation system 1 comprises the HMD2, the sensory presentation control device 3, and the sensory presentation device 4.

[0014] Furthermore, the presentation of the sensation of a heat source means making the viewer perceive the heat and light emitted by the heat source as a sensation of warmth or light.

[0015] HMD2 is a typical head-mounted display that displays VR images. For example, HMD2 has a goggle-like shape and is worn on the viewer's head by a band 20 or the like. HMD2 also includes position and orientation measuring means (e.g., a gyro sensor) to measure the viewer's position and orientation, and outputs the measured position and orientation to the sensory presentation control device 3. This position and orientation represents the position and orientation of the viewer's head in the real world.

[0016] Here, we assume that the HMD2 incorporates a sensory feedback control device 3. The sensory feedback control device 3 may be hardware independent of the HMD2 and connected to the HMD2 via wireless communication means such as Wi-Fi (registered trademark).

[0017] The sensory presentation control device 3 presents the sensation of a heat source to the viewer 90 who is viewing a VR image that includes a heat source. In this embodiment, the sensory presentation control device 3 outputs a control signal to the sensory presentation device 4 so as to present the sensation of heat and light of the heat source in conjunction with the VR image. The virtual space refers to a virtual computer-generated space reproduced using VR imagery. In this embodiment, heat sources such as the sun and a bonfire are placed in the virtual space.

[0018] The sensory presentation device 4 presents the sensation of a heat source to the viewer 90 in accordance with a control signal from the sensory presentation control device 3. As shown in Fig. 1(b), the sensory presentation device 4 includes a sensory presentation device 4 attached to the lower left side of the HMD 2 at a distance from the viewer 90 L and a sensory presentation device 4 attached to the lower right side of the HMD 2 at a distance from the viewer 90 R and is provided with. In the present embodiment, the sensory presentation device 4 L ,4 R presents both a warm feeling and a light sensation to the viewer 90. For example, as the sensory presentation device 4 L ,4 R there is a combination of a Peltier element or a small heater that presents a warm feeling to the viewer 90 and an LED (Light Emitting Diode) or a halogen lamp that irradiates the viewer 90 with indirect light.

[0019] In the present embodiment, the sensory presentation device 4 L ,4 R is driven according to the position of the heat source in the VR video. That is, when the heat source is located on the left side of the viewer 90 in the VR video, the left sensory presentation device 4 L operates to present the warm feeling and light sensation of the heat source to the left side of the viewer 90's head. Also, when the heat source is located on the right side of the viewer 90 in the VR video, the right sensory presentation device 4 R is driven to present the warm feeling and light sensation of the heat source to the right side of the viewer 90's head. Further, when the heat source is located in front of the viewer 90 in the VR video, the sensory presentation devices 4 on both sides L ,4 R are driven to present the warm feeling and light sensation of the heat source to both sides of the viewer 90's head.

[0020] [Configuration of the sensory presentation control device] Referring to Fig. 2, the configuration of the sensory presentation control device 3 will be described. As shown in Fig. 2, the sensory presentation control device 3 includes a position and orientation input unit 30, a position and orientation calculation unit 31, a heat source database 32, an output control unit 33, and a sensory presentation unit 34.

[0021] The position and orientation input unit 30 receives the position and orientation of the viewer 90 in the real world. In this embodiment, the position and orientation input unit 30 receives the position and orientation of the viewer 90 in the real world from the HMD2 and outputs the input position and orientation to the position and orientation calculation unit 31.

[0022] The position and orientation calculation unit 31 calculates the viewer's position and orientation in the virtual space based on the viewer's initial position and orientation in the virtual space and the viewer's position and orientation in the real world, which are set in advance. This initial position and orientation represents the initial values ​​of the viewer's head position and orientation (rotation coordinates) in the virtual space, and is set in advance by, for example, the VR video producer. The position and orientation calculation unit 31 then outputs the calculated position and orientation in the virtual space to the output control unit 33.

[0023] <Calculation of position and orientation> Referring to Figures 3 and 4, the position and attitude calculation performed by the position and attitude calculation unit 31 will be explained. As shown in Figure 3, the position of viewer 90 in the real world is (X r ,Y r ,Z r ), the initial position of viewer 90 in the virtual space is (X p ,Y p ,Z p ), let S be the scale of viewer 90 in the virtual space (in the example in Figure 3, S=1). Also, let (0,0,0) be the origin of the virtual space, and let (X) be the position of the heat source (e.g., bonfire 93). f ,Y f ,Z f ) Let this be the position of viewer 90 in the virtual space (X c ,Y c ,Z c ) is expressed by the following equation (1).

[0024]

number

[0025] As shown in Figure 4, the orientation (rotation coordinates) of viewer 90 in the virtual space is (X' c,Y' c ,Z' c ), the initial posture of the 90 viewers in the virtual space (X' p ,Y' p ,Z' p ) Let's assume that the attitude of viewer 90 in the real world is (X' r ,Y' r ,Z' r ) is expressed by the following equation (2).

[0026]

number

[0027] Therefore, the position and orientation calculation unit 31 uses equation (1) to calculate the position of the viewer 90 in the virtual space (X c ,Y c ,Z c ) should be calculated. Also, the position and attitude calculation unit 31 calculates the attitude (X') of the viewer 90 in the virtual space from equation (2). c ,Y' c ,Z' c You just need to work backwards from that.

[0028] Returning to Figure 2, we will continue our explanation of the configuration of the sensory presentation control device 3. The heat source database 32 is a database in which the locations of heat sources placed in the virtual space are pre-registered. These locations represent the three-dimensional coordinates of the heat sources within the virtual space. Specifically, the heat source database 32 pre-registers the locations of a first heat source whose sensation does not depend on the distance from the viewer 90 to the heat source, and the locations of a second heat source whose sensation depends on the distance from the viewer 90 to the heat source. The heat source database 32 is manually registered by the VR video creator.

[0029] The first heat source is one in which the perceived temperature of the viewer 90 does not change regardless of the distance from the viewer 90 to the heat source (for example, the sun). The second heat source is one in which the perceived temperature of the viewer 90 changes depending on the distance from the heat source (for example, a bonfire).

[0030] Furthermore, the heat source database 32 has pre-registered information about the types of heat sources. This heat source type is identification information indicating whether it is the first heat source or the second heat source (for example, 0: sun, 1: bonfire). Furthermore, the heat source database 32 registers coefficients for each weather condition as information about the first heat source. For example, the coefficients for each weather condition are 0 for rain, 0.2 for cloudy weather, and 1 for sunny weather. Furthermore, the heat source database 32 pre-registers the short-range threshold TH1 and the long-range threshold TH2, which will be described later, as information about the second heat source.

[0031] The output control unit 33 determines whether or not to present the sensation of a heat source to the viewer 90 based on the position and orientation in the virtual space and the heat source database 32, and calculates the output of the heat source to be presented to the viewer 90. In this embodiment, the output control unit 33 is input with identification information representing the type of heat source placed in the virtual space. In addition, for the first heat source, the output control unit 33 is input with information about the shielding object placed in the virtual space (e.g., position, shape, size) and the type of weather (e.g., sunny, cloudy).

[0032] In this embodiment, the output control of the first heat source and the second heat source are mutually exclusive. That is, the output control unit 33 will only provide sensory feedback for either the first heat source or the second heat source.

[0033] <Calculation of output from the first heat source> The calculation of the output of the first heat source will be explained with reference to Figures 5 and 6. As shown in Figure 5(a), in the case of VR images with good weather and a heat source such as the sun, the output of the first heat source is increased. On the other hand, as shown in Figure 5(b), in the case of VR images that are obscured by obstacles such as tunnels, the output of the first heat source is set to zero.

[0034] In Figure 6, the first heat source is assumed to be Solar 91. The output H of the heat source is calculated to be between 0 and 1, and the output of Solar 91 as a heat source is given by H. SUN (However, 0≦H) SUN ≤1).

[0035] The output control unit 33 determines whether the viewer 90 is shielded from the sun 91 if the sun 91 is located in the virtual space. If the viewer 90 is not shielded from the sun 91, the output control unit 33 sets a coefficient for each weather condition to the output H of the sun 91. SUN The calculation is performed as follows. On the other hand, the output control unit 33 calculates the output H of the sun 91 when the viewer 90 is shielded from the sun 91. SUN It is calculated as zero. Then the output control unit 33 calculates the output H of the solar 91. SUN This is output to the sensory presentation unit 34.

[0036] In the example in Figure 6(a), the viewer 90 is not obstructed by the sun 91, and the weather is clear, so the output H of the sun 91 is SUN = 1. Also, in the example in Figure 6(b), the viewer 90 is not shielded from the sun 91, and the weather is cloudy, so the output H of the sun 91 is 1. SUN = 0.2. As shown in Figure 6(c), the viewer 90 is shielded from the sun 91, so the output H of the sun 91 SUN = 0.

[0037] At this time, the output control unit 33 determines whether the viewer 90 is shielded from the sun 91 by checking whether the direction vector V from the viewer 90 to the sun 91 collides with the shield 92. As shown in Figure 6(d), if the direction vector V does not collide with the shield 92, the output control unit 33 determines that the viewer 90 is not shielded from the sun 91. Also, as shown in Figure 6(e), if the direction vector V collides with the shield 92, the output control unit 33 determines that the viewer 90 is shielded from the sun 91.

[0038] Specifically, the output control unit 33 uses the following equation (3) to determine the output H of the solar 91. SUN This can be calculated. Note that in equation (3), LineTrace is a function that performs occlusion determination. Also, Vector_sun is the reverse direction vector of sunlight (i.e., the direction vector V). Also, Player_position(X c ,Y c ,Z c) represents the virtual space position of viewer 90. Also, weather represents a coefficient for each weather condition.

[0039]

number

[0040] In this LineTrace, the vector specified by Vector_sun is traced in the reverse direction, and Player_position(X c ,Y c ,Z c The calculation is performed to project a ray of light from ).LineTrace returns zero if the ray collides with the shield 92, and returns the value of weather if the ray does not collide with the shield 92.

[0041] <Calculation of output from the second heat source> Referring to Figure 7, the calculation of the output of the second heat source will be explained. In Figure 7, the second heat source is the bonfire 93, and the output of the bonfire 93 as a heat source is H FIRE (However, 0≦H) FIRE ≤1). Also, as shown in Figure 3, the distance d from the viewer 90 to the bonfire 93 is given by the following equation (4).

[0042]

number

[0043] The output control unit 33, when a bonfire 93 is located in the virtual space, controls the output H of the bonfire 93 according to the distance d. FIRE The output H of the bonfire 93 is calculated as the distance d approaches. As shown in Figure 7(a), the output control unit 33 calculates the output H of the bonfire 93 as the distance d approaches. FIRE When the power is increased and the distance d approaches to a certain extent, the output H of the campfire 93 FIRE Let this be the maximum (for example, 1). As shown in Figure 7(b), the output control unit 33 increases the output H of the bonfire 93 as the distance d increases. FIRE The value is lowered, and when the distance d is a certain distance away, it is set to zero. Then, the output control unit 33 calculates the output H of the bonfire 93.FIRE This is output to the sensory presentation unit 34.

[0044] Specifically, the output control unit 33, when the distance d is less than the short-range threshold TH1, controls the output H of the bonfire 93. FIRE The maximum value is calculated as 1. Furthermore, the output control unit 33, when the distance d is greater than or equal to the short-range threshold TH1 and less than the long-range threshold TH2, adjusts the output H of the bonfire 93 according to the distance d. FIRE The output control unit 33 calculates the output H of the bonfire 93 if the distance d is greater than or equal to the long-distance threshold TH2. FIRE This is calculated as zero. In other words, the output control unit 33 uses the following equation (5) to calculate the output H of the bonfire 93. SUN This can be calculated. Note that `if` is a function that performs the operation in the next section if the condition in parentheses is met. Figure 8 shows the output H of Bonfire 93. FIRE An example of this is illustrated in the graph.

[0045]

number

[0046] Returning to Figure 2, we will continue our explanation of the configuration of the sensory presentation control device 3. The sensory presentation unit 34 presents the viewer 90 with the sensation of warmth from the heat source, based on the output H of the heat source calculated by the output control unit 33. Specifically, the sensory presentation unit 34 converts the output H of the heat source into a control signal (power) P for the sensory presentation device 4 using the following equation (6). Note that the maximum output P of the sensory presentation device 4 is... max This is pre-configured.

[0047]

number

[0048] As shown in Figure 9, the sensory presentation unit 34 has two sensory presentation devices 4 on the left and right sides. L ,4 R Since it is positioned, sensory presentation device 4 L ,4 RThe control signal P for each may be adjusted. In FIG. 9, the heat source is described as the campfire 93, but the same applies to the case of the sun 91. Also, in FIG. 9, the viewer 90 is facing forward, and the campfire 93 is located in front of the viewer 90.

[0049] As shown in FIG. 9, the sensory presentation device 4 L ,4 R is attached to the HMD 2 so that the viewer 90 faces outward by an angle θ L ,θ R from the front. Therefore, the sensory presentation unit 34 determines the angle φ L ,4 R formed between each of the sensory presentation devices 4 L ,φ R and the campfire 93. Specifically, the sensory presentation unit 34 determines the position (X c ,Y c ,Z c ) and orientation (X´ c ,Y´ c ,Z´ c ) of the viewer 90 in the virtual space and the position (X f ,Y f ,Z f ) of the campfire 93, and calculates the angle φ L formed between the sensory presentation device 4 L and the campfire 93. Similarly, the sensory presentation unit 34 calculates the angle φ R formed between the sensory presentation device 4 R and the campfire 93.

[0050] Next, the sensory presentation unit 34 adjusts the control signal P L ,4 R for each of the sensory presentation devices 4 L ,φ R according to the angle φ L ,4 R formed between each of the sensory presentation devices 4 L ,P R and the campfire 93. Specifically, the sensory presentation unit 34 increases the control signal P L ,φ R as the angle φ L ,P RTo reduce the angle between the sensory presentation device 4 and the bonfire 93, an example of the relationship between the angle φ and the control signal (power) P of the sensory presentation device 4 is illustrated in a graph. This relationship is expressed by the following equation (7).

[0051]

number

[0052] Referring to Figure 11, the relationship between the control signal P to the sensory presentation device 4 and the energy E output by the sensory presentation device 4 will be explained. Let E1 be the energy due to the radiant heat of the sensory presentation device 4 (in W), and E2 be the light energy of the sensory presentation device 4 (in W).

[0053] The energy E1 due to radiant heat is expressed by the following equation (8). Note that σ is the Stefan-Boltzmann constant (σ = 5.67 × 10⁻⁶). -8 ). Also, ε is the emissivity, T1 is the temperature of the sensory presentation device 4 (in Kelvin), and T2 is the room temperature (in Kelvin).

[0054]

number

[0055] The light energy E2 of the light sensor display unit 41 is expressed by the following equation (9). Here, I is the luminous efficiency (in lm / W) and P is the power (in W).

[0056]

number

[0057] As shown in Figure 11, the energy E1 from radiant heat and the light energy E2 from the sensory presentation device 4 are absorbed by the viewer's skin 90, thereby providing a sensation of warmth and light. The rise in skin temperature ΔT of the viewer's skin is expressed by the following equation (10). Here, D is the distance between the viewer's skin 90 and the sensory presentation device 4, C is the specific heat of the viewer's skin 90, U is the light absorption rate of the viewer's skin 90, and k is a constant.

[0058]

number

[0059] Here, the temperature T1 of the sensory presentation device 4 changes according to the power P, as shown in equation (11) below. Here, M is the mass of the sensory presentation device 4, and Ct is the specific heat of the sensory presentation device 4. Also, the energies E1 and E2 are uncorrelated. The light energy E2 is greater than the energy E1 due to radiant heat, so less heat remains in the sensory presentation device 4, and faster control becomes possible. For example, when a 50W LED is used, the temperature T1 of the sensory presentation device 4 becomes about 70 degrees, and the E1:E2 ratio becomes about 1:9. When providing sensory information, the power P applied to the sensory presentation device 4 should be controlled.

[0060]

number

[0061] [Operation of the sensory presentation control device] <1st heat source> Referring to Figure 12, the operation of the sensory feedback control device 3 in the case of the first heat source will be explained. As shown in Figure 12, in step S1, the position and orientation input unit 30 receives the position and orientation of the viewer 90 in the real world. The position and orientation calculation unit 31 then calculates the position and orientation of the viewer 90 in the virtual space based on the viewer 90's initial position and orientation in the virtual space and its position and orientation in the real world.

[0062] In step S2, the output control unit 33 determines whether the viewer 90 is shielded from the first heat source. If the sensory input is blocked (Yes in step S2), the sensory input device 3 proceeds to step S3. If the sensory input is not blocked (No in step S2), the sensory input device 3 proceeds to step S4.

[0063] In step S3, the output control unit 33 calculates the output of the first heat source as zero. In this case, the sensory presentation unit 34 does not present any sensations of warmth or light to the viewer 90. After that, the sensory presentation control device 3 returns to step S1.

[0064] In step S4, the output control unit 33 calculates a coefficient for each weather condition as the output of the first heat source. Then, the sensory presentation unit 34 presents the viewer 90 with the sensation of heat and light from the heat source based on the output of the first heat source calculated by the output control unit 33. After that, the sensory presentation control device 3 proceeds to step S5.

[0065] In step S5, the sensory presentation control device 3 determines whether or not to terminate the process. For example, if the viewer 90 stops playing the VR video, the sensory presentation control device 3 determines to terminate the process. If the process is terminated (Yes in step S5), the sensory presentation control device 3 proceeds to step S6. If the process does not terminate (No in step S5), the sensory presentation control device 3 returns to step S1.

[0066] In step S6, the output control unit 33 calculates the output of the first heat source as zero. After that, the sensory presentation control device 3 terminates the process.

[0067] <1st heat source> Referring to Figure 13, the operation of the sensory feedback control device 3 in the case of the second heat source will be explained. As shown in Figure 13, in step S10, the position and orientation input unit 30 receives the position and orientation of the viewer 90 in the real world. The position and orientation calculation unit 31 then calculates the position and orientation of the viewer 90 in the virtual space based on the viewer 90's initial position and orientation in the virtual space and its position and orientation in the real world.

[0068] In step S11, the output control unit 33 determines whether the distance d from the viewer 90 to the bonfire 93 is greater than or equal to the long-distance threshold TH2. If the distance d is greater than or equal to the long-distance threshold TH2 (Yes in step S11), the sensory presentation control device 3 proceeds to step S12. If the distance d is not greater than or equal to the long-distance threshold TH2 (No in step S2), the sensory presentation control device 3 proceeds to step S13.

[0069] In step S12, the output control unit 33 calculates the output of the second heat source as zero. In this case, the sensory presentation unit 34 does not present any sensations of warmth or light to the viewer 90. After that, the sensory presentation control device 3 returns to step S10.

[0070] In step S13, the output control unit 33 calculates the output of the second heat source according to the distance d. Then, the sensory presentation unit 34 presents the viewer 90 with the sensation of heat and light from the heat source based on the output of the second heat source calculated by the output control unit 33. After that, the sensory presentation control device 3 proceeds to step S14.

[0071] In step S14, the sensory presentation control device 3 determines whether or not to terminate the process. For example, if the viewer 90 stops playing the VR video, the sensory presentation control device 3 determines to terminate the process. If the process is terminated (Yes in step S14), the sensory presentation control device 3 proceeds to step S15. If the process does not terminate (No in step S14), the sensory presentation control device 3 returns to step S10.

[0072] In step S15, the output control unit 33 calculates the output of the second heat source as zero. After that, the sensory presentation control device 3 terminates processing.

[0073] [Effects / Effects] As described above, the sensory presentation control device 3 can present thermal and luminous sensations in conjunction with VR images. In other words, the sensory presentation control device 3 enables the viewer 90 to perceive heat sources such as the sun or flames through thermal sensations caused by the warming of the skin and luminous sensations caused by indirect light entering through the gaps in the HMD2. This allows the sensory presentation control device 3 to provide the viewer 90 with a more immersive experience and improves the range of expression.

[0074] Although embodiments have been described in detail above, the present invention is not limited to the embodiments described above, and also includes design modifications that do not depart from the spirit of the present invention. In the embodiments described above, the sun and a bonfire were given as examples of heat sources, but it goes without saying that the heat sources are not limited to these.

[0075] In the embodiments described above, the sensory presentation control device was described as an independent piece of hardware, but the present invention is not limited thereto. For example, the present invention can also be implemented by a program that causes hardware resources such as a CPU, memory, and hard disk of a computer to function as the sensory presentation control device described above. This program may be distributed via a communication line, or it may be written to a recording medium such as a CD-ROM or flash memory and distributed. [Explanation of symbols]

[0076] 1. Sensory Presentation System 2 HMD 3. Sensory Presentation Control Device 4. Sensory Presentation Devices 30 Position and attitude input section 31 Position and orientation calculation section 32 Heat Source Database 33 Output control unit 34 Sensory Presentation Unit

Claims

1. A sensory presentation control device that presents the sensation of a heat source to a person viewing a VR image containing a heat source, A position and orientation input unit where the position and orientation of a person in the real world are input, A position and posture calculation unit calculates the position and posture of a person in the virtual space based on the initial position and posture of the person in the virtual space and the position and posture of the person in the real world, A heat source database in which the locations of heat sources placed in the virtual space are pre-registered, An output control unit that determines whether or not to present the sensation of the heat source to the person based on the position and orientation in the virtual space and the heat source database, and calculates the output of the heat source to present to the person, Based on the output of the heat source calculated by the output control unit, a sensory presentation unit presents the person with a sensation of warmth from the heat source, Equipped with, The heat source database has pre-registered locations of a first heat source whose sensation does not depend on the distance from the person to the heat source, and locations of a second heat source whose sensation depends on the distance from the person to the heat source. The output control unit, Identification information representing the type of heat source placed in the virtual space is input. If the first heat source is located in the virtual space, it is determined whether the person is shielded from the first heat source, and if the person is shielded from the first heat source, the output of the heat source to be presented to the person is calculated to be zero. A sensory presentation control device characterized in that, when the second heat source is placed in the virtual space, it calculates the output of the heat source to be presented to the person according to the distance from the person to the heat source.

2. The sensory presentation control device according to claim 1, wherein the heat source database has pre-registered coefficients for each weather condition as information of the first heat source, and the output control unit calculates the coefficients for each weather condition as the output of the heat source to be presented to the person if the person is not shielded from the first heat source.

3. The heat source database has the short-range threshold and long-range threshold pre-registered as information for the second heat source. The output control unit, If the distance from the person to the heat source is less than the short-distance threshold, the output of the heat source presented to the person is calculated to be the maximum. If the distance from the person to the heat source is greater than or equal to the short-distance threshold and less than the long-distance threshold, the output of the heat source to be presented to the person is calculated according to the distance from the person to the heat source. The sensory presentation control device according to claim 2, characterized in that, if the distance from the person to the heat source is greater than or equal to the long-distance threshold, the output of the heat source presented to the person is calculated to be zero.

4. The sensory presentation control device according to claim 3, characterized in that the sensory presentation unit further presents the optical sensation of the heat source as the sensation of the heat source.

5. A program for causing a computer to function as a sensory presentation control device according to any one of claims 1 to 4.

Images