Simulated experience provision system and haptic presentation device

Abstract

To provide a simulated experience provision system and a tactile presentation device capable of improving the reproducibility of tactile sensations. [Solution] The simulated experience provision system is a system that provides a user with a simulated experience, and comprises: a storage unit that stores content data including video data and haptic data; a display device that displays video; a video processing unit that extracts video data from the content data and displays video on the display device based on the video data; a haptic presentation device 40 that presents tactile sensations to the user; and a haptic processing unit that extracts tactile data from the content data and presents tactile sensations in accordance with the video to the haptic presentation device 40 based on the tactile data. The haptic presentation device 40 comprises: a compressor 41 that supplies compressed air; a nozzle that sprays compressed air onto the user's legs; and a valve provided between the compressor 41 and the nozzle that switches between supplying and shutting off compressed air to the nozzle.

Description

Technical Field

[0004] ,

[0006] , , ,

[0005] , , , ,

[0001] The present disclosure relates to a virtual experience providing system and a tactile presentation device.

Background Art

[0002] A system that provides a virtual experience to a user in conjunction with video is known. For example, Patent Document 1 describes a tactile output device that outputs a tactile sensation associated with sound and video. Examples of such a tactile output device include a device that allows a user to feel a non-contact tactile sensation by receiving the wind pressure from a fan.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, since the tactile sensation of fingertips and the like is sensitive, the user may feel the wind from the fan itself rather than the tactile sensation of the object in the video. In this technical field, it is desired to improve the reproducibility of the tactile sensation.

[0005] The present disclosure describes a virtual experience providing system and a tactile presentation device capable of improving the reproducibility of the tactile sensation.

Means for Solving the Problems

[0006] The simulated experience provision system relating to one aspect of this disclosure is a system that provides a user with a simulated experience. The simulated experience provision system comprises a storage unit that stores content data including video data and haptic data; a display device that displays video; a video processing unit that extracts video data from the content data and displays video on the display device based on the video data; a haptic presentation device that presents tactile sensations to the user; and a haptic processing unit that extracts tactile data from the content data and presents tactile sensations in accordance with the video on the haptic presentation device based on the tactile data. The haptic presentation device comprises a compressor that supplies compressed air; a nozzle that sprays compressed air onto the user's legs; and a valve provided between the compressor and the nozzle that switches between supplying and shutting off compressed air to the nozzle.

[0007] Another aspect of this disclosure relates to a haptic presentation device used in a simulated experience provision system that provides a user with a simulated experience, and is a device that presents touch to the user. The haptic presentation device comprises a compressor that supplies compressed air, a nozzle that sprays compressed air onto the user's legs, and a valve provided between the compressor and the nozzle that switches between supplying and shutting off compressed air to the nozzle.

[0008] In the above simulated experience provision system, video is displayed based on video data extracted from content data, and tactile sensations corresponding to the video are presented to the user based on haptic data extracted from the content data. In the haptic presentation device, the compressed air blown onto the user's legs is controlled by switching between supplying and shutting off compressed air. Legs have a unique sense of touch that differs from fingers, and by applying compressed air to the legs, a tactile sensation similar to contact with a solid is obtained. Therefore, it is possible to improve the reproducibility of tactile sensations.

[0009] The compressor may supply compressed air at a pressure of 0.2 MPa to 0.7 MPa. The nozzle may have an outlet with a diameter of 4 mm to 5 mm. The nozzle may be positioned so that the distance from the outlet to the leg is 20 mm to 50 mm. In this case, the reproducibility of tactile sensation can be further improved.

[0010] The haptic feedback device may include, as nozzles, a front nozzle that sprays compressed air onto the front of each of the user's legs, a rear nozzle that sprays compressed air onto the rear of the leg, a left nozzle that sprays compressed air onto the left side of the leg, and a right nozzle that sprays compressed air onto the right side of the leg. In this case, compressed air can be sprayed from the front, back, left, and right for each leg. Therefore, the tactile sensation can be reproduced taking into account the part of the leg that comes into contact with an object. Thus, the sense of presence can be enhanced.

[0011] The above-described simulated experience provision system may further include an airflow generation device that generates airflow, and an airflow processing unit that extracts airflow data further contained in the content data from the content data and causes the airflow generation device to generate airflow that matches the video based on the airflow data. In this case, the airflow around the user is reproduced in accordance with the video. Therefore, the sense of realism can be enhanced.

[0012] The haptic feedback device may further include a movable frame to which a nozzle is attached, a distance sensor provided on the movable frame for measuring the distance to the user's leg, and a movement mechanism for moving the movable frame according to the distance measured by the distance sensor. In this case, the distance from the nozzle outlet to the user's leg can be adjusted. Therefore, the reproducibility of tactile sensation can be further improved.

[0013] The movement mechanism may involve moving the movable frame horizontally. In this case, the distance from the nozzle outlet to the user's leg can be adjusted with a simple configuration that moves the movable frame horizontally.

[0014] The movement mechanism may involve raising and lowering a movable frame. In this case, the distance from the nozzle outlet to the user's leg can be adjusted with a simple configuration that raises and lowers the movable frame. [Effects of the Invention]

[0015] Each aspect and embodiment of this disclosure can improve the reproducibility of tactile sensations.

Brief Description of the Drawings

[0016] [Figure 1] FIG. 1 is a configuration diagram schematically showing a virtual experience providing system according to an embodiment. [Figure 2] FIG. 2 is a diagram showing a configuration example of the tactile presentation device shown in FIG. 1. [Figure 3] FIG. 3 is a diagram showing a specific example of the virtual experience providing system shown in FIG. 1. [Figure 4] FIG. 4 is a diagram showing an arrangement example of nozzles. [Figure 5] FIG. 5 is a configuration diagram schematically showing a virtual experience providing system according to another embodiment. [Figure 6] FIG. 6 is a diagram showing another configuration example of the tactile presentation device shown in FIG. 1. [Figure 7] FIG. 7 is a diagram showing yet another configuration example of the tactile presentation device shown in FIG. 1.

Embodiments for Carrying Out the Invention

[0017] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the description of the drawings, the same reference numerals are assigned to the same elements, and duplicate descriptions are omitted.

[0018] A virtual experience providing system according to an embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a configuration diagram schematically showing a virtual experience providing system according to an embodiment. FIG. 2 is a diagram showing a configuration example of the tactile presentation device shown in FIG. 1. The virtual experience providing system 1 shown in FIG. 1 is a system that provides a virtual experience (real reverse) to the user U (see FIG. 3). The virtual experience providing system 1 provides a feeling synchronized with the video to the user U while displaying the video. The virtual experience providing system 1 provides, for example, a feeling of touching an object (tactile sensation) included in the video to the user U. Examples of such objects include weeds, fallen leaves, and small stones. The virtual experience providing system 1 includes an information processing device 10, a display device 20, an airflow generating device 30, and a tactile presentation device 40.

[0019] The information processing device 10 is a device that controls a display device 20, an airflow generation device 30, and a tactile presentation device 40 according to content data for virtual experience. The information processing device 10 is configured as a computer including, for example, a processor, a memory, and a communication device. Examples of the processor include a CPU (Central Processing Unit). The memory includes main storage devices such as a RAM (Random Access Memory) and a ROM (Read Only Memory), and auxiliary storage devices such as a hard disk device and a flash memory. Examples of the communication device include a network card. Examples of the information processing device 10 include a desktop computer, a laptop computer, a tablet terminal, and a smartphone.

[0020] By the processor reading out and executing a computer program stored in the auxiliary storage device in the main storage device, each hardware operates under the control of the processor, and reading and writing of data in the main storage device and the auxiliary storage device are performed. Thereby, each functional unit shown in FIG. 1 of the information processing device 10 is realized. The information processing device 10 includes, as functional units, a storage unit 11, a video processing unit 12, an airflow processing unit 13, and a tactile processing unit 14.

[0021] The storage unit 11 stores content data for virtual experience. The content data includes video data, airflow data, and tactile data. The video data, airflow data, and tactile data are stored together with information (time stamp) indicating the reproduction timing. The airflow data is data for reproducing the airflow around the user U and includes the wind direction and wind speed. The tactile data is data for reproducing the tactile sensation of the user U and includes information indicating portions (for example, the front of the left foot, the back of the left foot, the left side of the left foot, the right side of the left foot, the front of the right foot, the back of the right foot, the left side of the right foot, and the right side of the right foot) of the legs that come into contact with an object in the video.

[0022] The video processing unit 12 acquires content data from the storage unit 11 and extracts video data from the content data. The video processing unit 12 outputs the video data to the display device 20 and displays the video on the display device 20 based on the video data. The video to be displayed on the display device 20 is, for example, a three-dimensional video.

[0023] The airflow processing unit 13 acquires content data from the storage unit 11 and extracts airflow data from the content data. Based on the airflow data, the airflow processing unit 13 causes the airflow generator 30 to generate airflow that matches the video. For example, the airflow processing unit 13 generates control signals to control the airflow generator 30 based on the airflow data and outputs the control signals to the airflow generator 30 at the timing indicated by the timestamp. For example, the airflow processing unit 13 generates control signals so that the wind direction and wind speed included in the airflow data can be obtained.

[0024] The haptic processing unit 14 acquires content data from the storage unit 11 and extracts haptic data from the content data. Based on the haptic data, the haptic processing unit 14 causes the haptic presentation device 40 to present haptic sensations that match the video. For example, based on the haptic data, the haptic processing unit 14 generates open / close signals to control the opening and closing of each valve (described later) included in the haptic presentation device 40, and outputs the open / close signals to the haptic presentation device 40 at the timing indicated by the timestamp. For example, the haptic processing unit 14 generates open / close signals so that compressed air is supplied to the nozzle (described later) corresponding to the part that comes into contact with the object in the video indicated by the haptic data, and not to the other nozzles.

[0025] The display device 20 is a device that displays images. Examples of the display device 20 include a projector (image projection device) and a display. The display device 20 displays images based on the image data output from the image processing unit 12.

[0026] The airflow generator 30 is a device that generates airflow. An example of the airflow generator 30 is a circulator. The airflow generator 30 generates airflow based on control signals output from the airflow processing unit 13.

[0027] The tactile presentation device 40 is a device that presents tactile sensations to the user U. As shown in Figure 2, the tactile presentation device 40 includes a compressor 41, a valve, a nozzle, a hose 44, and a hose 45.

[0028] The compressor 41 is a device that supplies compressed air. The compressor 41 is, for example, an air compressor. The compressor 41 supplies compressed air at a pressure of, for example, 0.1 MPa to 1.0 MPa.

[0029] Each nozzle is a device that sprays compressed air onto the user U's leg. Each nozzle has an outlet with a diameter of 1 mm to 10 mm and sprays compressed air from the outlet. Each nozzle is positioned so that the distance from the outlet to the leg (surface of the leg) is 10 mm to 200 mm. In this embodiment, the tactile presentation device 40 includes nozzles 43lf, 43lb, 43ll, 43lr, 43rf, 43rb, 43rl, and 43rr.

[0030] Nozzles 43lf, 43lb, 43ll, and 43lr are provided to eject compressed air onto the left leg Ll (see Figure 4). Nozzle 43lf ejects compressed air onto the front of the left leg Ll. Nozzle 43lb ejects compressed air onto the rear of the left leg Ll. Nozzle 43ll ejects compressed air onto the left side of the left leg Ll. Nozzle 43lr ejects compressed air onto the right side of the left leg Ll.

[0031] Nozzles 43rf, 43rb, 43rl, and 43rr are provided to eject compressed air to the right leg Lr (see Figure 4). Nozzle 43rf ejects compressed air to the front of the right leg Lr. Nozzle 43rb ejects compressed air to the rear of the right leg Lr. Nozzle 43rl ejects compressed air to the left side of the right leg Lr. Nozzle 43rr ejects compressed air to the right side of the right leg Lr.

[0032] In other words, the haptic presentation device 40 includes, as nozzles, a front nozzle that sprays compressed air onto the front of the leg, a rear nozzle that sprays compressed air onto the rear of the leg, a left nozzle that sprays compressed air onto the left side of the leg, and a right nozzle that sprays compressed air onto the right side of the leg, for each leg of the user U.

[0033] A valve is provided for each nozzle. Each valve is located between the compressor 41 and the nozzle corresponding to the valve, and is a device that switches between supplying and shutting off compressed air to the nozzle. For example, an electromagnetic valve is used as the valve. In this embodiment, the tactile presentation device 40 includes valves 42lf, 42lb, 42ll, 42lr, 42rf, 42rb, 42rl, and 42rr.

[0034] Each valve is connected to the compressor 41 by a hose 44. One end of the hose 44 is connected to the exhaust port of the compressor 41, and the other end of the hose 44 is branched and connected to each valve. Each valve is connected to the nozzle corresponding to that valve by a hose 45.

[0035] Each valve switches between an open state and a closed state in response to an open / closed signal output from the tactile processing unit 14. The open state means that compressed air is supplied to the nozzle connected to the valve. The closed state means that compressed air is not supplied to the nozzle connected to the valve.

[0036] Next, a specific example of the simulated experience provision system 1 will be described with reference to Figures 3 and 4. Figure 3 is a diagram showing a specific example of the simulated experience provision system shown in Figure 1. Figure 4 is a diagram showing an example of nozzle arrangement. The simulated experience provision system 1 shown in Figure 3 provides a simulated experience to user U in room 2 by generating a virtual space within room 2. In the example shown in Figure 3, a projector is exemplified as the display device 20, and a circulator is exemplified as the airflow generation device 30.

[0037] A chair 3 for user U to sit in is installed in room 2. A projector is installed on the ceiling 2a of room 2, projecting images onto the wall 2b in front of user U seated in chair 3 and the walls 2c on both sides. Multiple airflow generators 30 are installed in room 2 surrounding chair 3, arranged to blow air onto user U seated in chair 3 from various directions. A compressor 41 is installed outside room 2, and hoses 44 extend from the compressor 41 to valves located at the bottom of chair 3. The compressor 41 may be installed inside room 2, at a location away from chair 3. If the compressor 41 is installed outside room 2, the valves may also be located outside room 2.

[0038] As shown in Figure 4, nozzles 43lf, 43lb, 43ll, and 43lr are located at the bottom of the chair 3 and are positioned to spray compressed air onto the front, rear, left, and right sides of the left leg Ll of a user U seated in the chair 3, between the knee and ankle. Similarly, nozzles 43rf, 43rb, 43rl, and 43rr are located at the bottom of the chair 3 and are positioned to spray compressed air onto the front, rear, left, and right sides of the right leg Lr of a user U seated in the chair 3, between the knee and ankle.

[0039] In this simulated experience provision system 1, user U sits in chair 3, positioning their left leg Ll in the area surrounded by nozzles 43lf, 43lb, 43ll, and 43lr, and their right leg Lr in the area surrounded by nozzles 43rf, 43rb, 43rl, and 43rr. At this time, user U may sit in chair 3 with their lower legs exposed.

[0040] In this state, the provision of the simulated experience (Realverse) begins. First, in the information processing device 10 located outside Room 2 or away from Chair 3, the video processing unit 12 extracts video data from the content data stored in the memory unit 11 and displays the video on the display device 20 based on the video data. At this time, the airflow processing unit 13 extracts airflow data from the content data stored in the memory unit 11 and causes the airflow generation device 30 to generate an airflow that matches the video based on the airflow data. The haptic processing unit 14 extracts haptic data from the content data stored in the memory unit 11 and causes the haptic presentation device 40 to present a haptic sensation that matches the video based on the haptic data.

[0041] In other words, images are displayed on wall 2b and both wall 2c surfaces, and the airflow around user U, who is seated in chair 3, is reproduced in sync with these images. Furthermore, when user U's legs touch an object in the image, compressed air is sprayed onto user U's legs from nozzles located at the corresponding positions, thereby reproducing a tactile sensation that matches the image.

[0042] Here, sensory evaluation of tactile reproducibility was performed while changing the pressure of the compressed air supplied by the compressor 41, the diameter of the nozzle outlet, and the distance from the nozzle to the leg. Tactile reproducibility was high when the pressure of the compressed air supplied by the compressor 41 was set to 0.5 MPa to 0.7 MPa, the diameter of the nozzle outlet was set to 4 mm to 5 mm, and the distance from the nozzle to the leg was set to 20 mm to 50 mm.

[0043] In the simulated experience provision system 1 described above, video is displayed based on video data extracted from content data, and tactile sensations corresponding to the video are presented to user U based on tactile data extracted from content data. In the tactile presentation device 40, the compressed air blown onto user U's legs is controlled by switching between supplying and shutting off compressed air. Legs have a unique sense of touch that differs from fingers, etc., and their sense of touch is duller compared to fingers, etc. The inventors have found that by applying compressed air to the legs, a tactile sensation similar to contact with a solid can be obtained. Therefore, the simulated experience provision system 1 makes it possible to improve the reproducibility of tactile sensations.

[0044] If the pressure of the compressed air supplied by the compressor 41 is set to 0.5 MPa to 0.7 MPa, the diameter of the nozzle outlet is set to 4 mm to 5 mm, and the distance from the nozzle outlet to the leg is set to 20 mm to 50 mm, the tactile reproducibility can be further improved. For example, the tactile reproducibility of bare legs can be further improved.

[0045] Nozzles 43lf, 43lb, 43ll, and 43lr are provided to eject compressed air to the left leg Ll. Nozzles 43rf, 43rb, 43rl, and 43rr are provided to eject compressed air to the right leg Lr. With this configuration, compressed air can be ejected from the front, back, left, and right of each leg. Therefore, the sense of touch can be reproduced by considering the part (position) of the leg that comes into contact with an object. For example, in the video, if a fallen leaf hits the front of the right leg Lr and moves along the right side of the right leg Lr to the rear of the right leg Lr, compressed air will be ejected from nozzle 43rf, then from nozzle 43rr, ​​and then from nozzle 43rb, in accordance with the video. In this way, the accuracy of the reproduction of the sense of touch can be further improved, and the sense of realism can be enhanced.

[0046] In the simulated experience provision system 1, the airflow processing unit 13 extracts airflow data from the content data stored in the memory unit 11, and causes the airflow generation device 30 to generate airflow that matches the video based on the airflow data. With this configuration, the airflow around the user U is reproduced in accordance with the video. Therefore, the sense of realism can be further enhanced.

[0047] The simulated experience provision system and haptic presentation device related to this disclosure are not limited to the embodiments described above.

[0048] The content data may further include audio data. In this case, the simulated experience provision system 1 may further include an audio output device such as a speaker, and the information processing device 10 may further include an audio processing unit that extracts audio data from the content data stored in the storage unit 11 and outputs it to the audio output device.

[0049] The content data does not need to include airflow data. In this case, the information processing device 10 does not need to include the airflow processing unit 13, and the simulated experience provision system 1 does not need to include the airflow generation device 30.

[0050] The memory unit 11 may be located outside the information processing device 10. In this case, the information processing device 10 does not need to include the memory unit 11. The video processing unit 12, the airflow processing unit 13, and the haptic processing unit 14 do not need to be implemented in a single computer. The video processing unit 12, the airflow processing unit 13, and the haptic processing unit 14 may each be implemented in separate computers.

[0051] The pressure of the compressed air supplied by the compressor 41 may be set to 0.2 MPa to 0.7 MPa. For example, when the pressure of the compressed air supplied by the compressor 41 is set to 0.2 MPa to 0.4 MPa, the diameter of the nozzle outlet is set to 4 mm to 5 mm, and the distance from the nozzle outlet to the leg is set to 20 mm to 50 mm, the reproducibility of tactile sensation in the clothed state was high. Therefore, according to the above settings, the reproducibility of tactile sensation in the clothed state can be further improved.

[0052] The simulated experience provision system 1 uses edge computing, but cloud computing may also be used. Figure 5 is a schematic diagram showing a simulated experience provision system according to another embodiment. The simulated experience provision system 1A shown in Figure 5 differs from the simulated experience provision system 1 mainly in that the information processing device 10 is implemented using cloud computing, and further includes a synchronization device 51, a communication device 52, a communication device 53, and a communication device 54.

[0053] In the simulated experience provision system 1A, multiple computers are connected to each other via a communication network, allowing them to communicate with one another, and thus function logically as an information processing device 10. The information processing device 10 transmits video data, airflow data, and tactile data to the synchronization device 51.

[0054] When the synchronization device 51 receives video data, airflow data, and tactile data from the information processing device 10, it transmits the video data to the display device 20 via the communication device 52, the airflow data to the airflow generation device 30 via the communication device 53, and the tactile data to the tactile presentation device 40 via the communication device 54. The communication devices 52 to 54 are, for example, network cards. The synchronization device 51 synchronizes the display device 20, the airflow generation device 30, and the tactile presentation device 40. The synchronization device 51 may also be an intermediate server such as MEC (Multi-access Edge Computing) in 5G communication.

[0055] In the simulated experience provision system 1A, the same effects can be obtained as in the simulated experience provision system 1 for components that are common to the simulated experience provision system 1.

[0056] The haptic presentation device 40 may be configured to allow adjustment of the distance between each nozzle and the user U's leg. For example, as shown in Figure 6, the haptic presentation device 40 further includes a mounting base 61, a support column 62, an upper frame 63, a rail 64, a movable frame 65, a distance sensor 66, a moving mechanism 67, a drive circuit 68, and a control device 69. Note that in Figure 6, the compressor 41, valve, nozzle, hose 44, and hose 45 are not shown.

[0057] The mounting platform 61 is a platform on which the user U's feet are placed. The mounting platform 61 has, for example, a rectangular plate shape. Support columns 62 are erected at each of the four corners of the mounting platform 61. The upper ends of the four support columns 62 are connected by an upper frame 63. The upper frame 63 is a rectangular frame. A rail 64 is stretched across two adjacent support columns 62 along the outer edge of the mounting platform 61. Both ends of the rail 64 are fixed near the center in the vertical direction of the two support columns 62 on which the rail 64 is stretched.

[0058] In the example shown in Figure 6, the tactile presentation device 40 includes four rails 64 arranged front, back, left, and right. The front rail 64 and the rear rail 64 extend in the left-right direction and are spaced apart and substantially parallel in the front-back direction. The left rail 64 and the right rail 64 extend in the front-back direction and are spaced apart and substantially parallel in the left-right direction.

[0059] Two movable frames 65 extending in the front-to-back direction are spanned across the front and rear rails 64, and both ends of each movable frame 65 are attached to the front and rear rails 64 so that they can move in the left-to-right direction. Two movable frames 65 extending in the left-to-right direction are spanned across the left and right rails 64, and both ends of each movable frame 65 are attached to the left and right rails 64 so that they can move in the front-to-back direction. Each movable frame 65 is a columnar member. The four movable frames 65 define the space S surrounding the legs of the user U.

[0060] Although not shown in Figure 6, each movable frame 65 is fitted with a nozzle for spraying compressed air onto the user U's legs. Multiple nozzles are fitted to each movable frame 65 in the direction of its extension. Each nozzle is positioned on the movable frame 65 so that its outlet faces the space S. Each nozzle may be fixed to the movable frame 65 or may be mounted so as to be movable in the direction of its extension.

[0061] Each movable frame 65 is equipped with a distance sensor 66. An example of a distance sensor 66 is a ToF (Time of Flight) sensor. The distance sensor 66 measures the distance to the user U's feet while the user U's feet are placed on the mounting platform 61. Each distance sensor 66 transmits the measured distance (measured distance) to the control device 69.

[0062] The moving mechanism 67 is a mechanism for moving each movable frame 65. The moving mechanism 67 moves each movable frame 65 along the rail 64 to which the movable frame 65 is attached. That is, the moving mechanism 67 moves each movable frame 65 in the horizontal direction. The moving mechanism 67 includes, for example, a conveyor 67a for moving the movable frame 65 and a motor 67b for driving the conveyor 67a. The moving mechanism 67 moves the movable frame 65 according to the measured distance measured by a distance sensor 66 provided on the movable frame 65.

[0063] The drive circuit 68 is a circuit that drives each motor 67b. An example of a drive circuit 68 is an H-bridge IC (Integrated Circuit). The drive circuit 68 controls each motor 67b in response to commands from the control device 69.

[0064] The control device 69 is configured, for example, by a microcomputer. The control device 69 outputs a forward rotation command, a reverse rotation command, or a stop command for the motor 67b that moves the movable frame 65 to the drive circuit 68, according to the distance measured by the distance sensor 66 provided on the movable frame 65. The control device 69 receives a set distance from the nozzle to the leg (surface of the leg) from the information processing device 10 (tactile processing unit 14). The set distance may be a fixed value set in advance, or it may be a value set according to the content data.

[0065] The control device 69 outputs a forward rotation command, a reverse rotation command, or a stop command for the motor 67b so that the measured distance measured by the distance sensor 66 falls within the set range. The set range is a range of distances that includes the set distance, and is from a lower limit obtained by subtracting an acceptable error from the set distance to an upper limit obtained by adding an acceptable error to the set distance.

[0066] When user U inserts their legs into space S and places them on the mounting platform 61, the distance to the legs is measured by distance sensors 66 provided on each movable frame 65, and the measured distance is transmitted to the control device 69. The control device 69 compares the measured distance measured by each distance sensor 66 with a set range. If the measured distance is not within the set range, the control device 69 moves the movable frame 65 equipped with the distance sensor 66 that measured the distance so that the measured distance is within the set range. Specifically, if the measured distance is greater than the upper limit of the set range, the control device 69 outputs a command to the movement mechanism 67 to move the movable frame 65 closer to the legs. If the measured distance is less than the lower limit of the set range, the control device 69 outputs a command to the movement mechanism 67 to move the movable frame 65 away from the legs.

[0067] The tactile processing unit 14 may determine which nozzle to use to present tactile sensations depending on the position of each movable frame 65. The tactile presentation device 40 may also include an opening and closing mechanism for inserting legs.

[0068] The position of the user's legs may vary, and the thickness of the legs may also differ among users. If the distance between the nozzle outlet and the user's legs is outside the set range, the reproducibility of tactile sensation may decrease. To address this problem, in the tactile presentation device 40 shown in Figure 6, the nozzle is attached to a movable frame 65, and the distance to the user's legs (measured distance) is measured by a distance sensor 66 provided on the movable frame 65, and the movable frame 65 is moved according to the measured distance. The measured distance can be considered as the distance from the nozzle outlet to the user's legs. Therefore, by adjusting the position of the movable frame 65 using the measured distance, the distance from the nozzle outlet to the user's legs can be adjusted. Thus, the reproducibility of tactile sensation can be improved without the user having to perform any work such as adjusting the position of their legs.

[0069] The moving mechanism 67 moves the movable frame 65 horizontally. In this way, the distance from the nozzle outlet to the user U's legs can be adjusted with a simple configuration that moves the movable frame 65 horizontally.

[0070] The tactile presentation device 40 may include the configuration shown in Figure 7 instead of the configuration shown in Figure 6. Specifically, the tactile presentation device 40 may further include a base 71, a movable frame 72, a distance sensor 73, a moving mechanism 74, and a control device 75. Note that in Figure 7, the compressor 41, valve, nozzle, hose 44, and hose 45 are omitted from the illustration.

[0071] The base portion 71 is the part that is placed on the floor or other surface. In the example shown in Figure 7, the base portion 71 has an annular shape. The shape of the base portion 71 is not limited to an annular shape, and may be the same shape as the mounting base 61.

[0072] A movable frame 72 is provided above the base 71. The movable frame 72 has an annular (for example, circular) shape. The movable frame 72 defines a space S surrounding the user U's legs. Although not shown in Figure 7, nozzles for spraying compressed air onto the user U's legs are attached to the movable frame 72. Multiple nozzles are attached to the movable frame 72 in the circumferential direction of the movable frame 72. Each nozzle is provided on the movable frame 72 so that its outlet faces the space S. Each nozzle may be fixed to the movable frame 72 or may be mounted so as to be movable in the circumferential direction of the movable frame 72. Note that the shape of the movable frame 72 is not limited to an annular shape.

[0073] The movable frame 72 is equipped with distance sensors 73. In the example shown in Figure 7, two distance sensors 73 are provided on the inner surface of the movable frame 72 at positions facing each other. An example of a distance sensor 73 is a ToF sensor. The distance sensors 73 measure the distance to the user U's legs while the user U's legs are inserted into space S. Each distance sensor 73 transmits the measured distance (measured distance) to the control device 75.

[0074] A moving mechanism 74 is provided on the upper surface of the base 71. The moving mechanism 74 is a mechanism for moving the movable frame 72. The moving mechanism 74 moves the movable frame 72 up and down (raises and lowers). The moving mechanism 74 includes, for example, an actuator 74a that moves the movable frame 72 and a motor 74b that drives the actuator 74a. The moving mechanism 74 raises and lowers the movable frame 72 according to the measured distance measured by a distance sensor 73 provided on the movable frame 72.

[0075] Four actuators 74a are erected so as to extend upward from the upper surface of the base 71. Each actuator 74a is fixed to the base 71 so that its piston rod can move up and down. The tip of each piston rod is fixed to the movable frame 72. The motor 74b may be an air motor. In this case, the motor 74b may use compressed air supplied from the compressor 41 as its power source.

[0076] Since the control device 75 is the same as the control device 69, a detailed explanation of it will be omitted. In the example shown in Figure 7, the control device 75 controls the moving mechanism 74 so that, for example, the average value of the measured distances measured by the two distance sensors 73 falls within the above-mentioned set range.

[0077] When user U inserts their leg into space S, the distance to the leg is measured by a distance sensor 73 on the movable frame 72, and the measured distance is transmitted to the control device 75. The control device 75 compares the average value of the measured distances measured by the two distance sensors 73 with a set range. If the average value of the measured distance is not within the set range, the control device 75 raises or lowers the movable frame 72 so that the average value of the measured distance is within the set range.

[0078] For example, if the average value of the measured distance is greater than the upper limit of the set range, it is assumed that user U has thin legs. In this case, the control device 75 outputs a command to the movement mechanism 74 to raise the movable frame 72. If the average value of the measured distance is less than the lower limit of the set range, it is assumed that user U has thick legs. In this case, the control device 75 outputs a command to the movement mechanism 74 to lower the movable frame 72. The initial position of the movable frame 72 is set so that it is located between user U's knee and ankle.

[0079] In the haptic presentation device 40 shown in Figure 7, the same effects as the haptic presentation device 40 shown in Figure 6 can be obtained with the same configuration as the haptic presentation device 40 shown in Figure 6. In the haptic presentation device 40 shown in Figure 7, the moving mechanism 74 raises and lowers the movable frame 72. In this way, the distance from the nozzle outlet to the user U's leg can be adjusted with a simple configuration of raising and lowering the movable frame 72.

[0080] (Note) [Clause 1] A simulated experience provision system that provides users with a simulated experience, A storage unit that stores content data including video data and haptic data, A display device that displays images, A video processing unit that extracts video data from the content data and displays the video on the display device based on the video data, A tactile presentation device that presents tactile sensations to the user, A tactile processing unit extracts tactile data from the content data and causes the tactile presentation device to present tactile sensations that match the video based on the tactile data, Equipped with, The tactile presentation device is A compressor that supplies compressed air, A nozzle that sprays the compressed air onto the user's leg, A valve is provided between the compressor and the nozzle, which switches between supplying and shutting off the compressed air to the nozzle. A system that provides simulated experiences, equipped with the following features.

[0081] [Clause 2] The compressor supplies the compressed air at a pressure of 0.2 MPa to 0.7 MPa. The nozzle has an outlet with a diameter of 4 mm to 5 mm. The simulated experience provision system according to Clause 1, wherein the nozzle is arranged such that the distance from the nozzle outlet to the leg is 20 mm to 50 mm.

[0082] [Clause 3] The haptic presentation device is a simulated experience provision system according to Clause 1 or Clause 2, wherein the nozzles include, for each of the user's legs, a front nozzle for ejecting compressed air onto the front of the leg, a rear nozzle for ejecting compressed air onto the rear of the leg, a left nozzle for ejecting compressed air onto the left side of the leg, and a right nozzle for ejecting compressed air onto the right side of the leg.

[0083] [Clause 4] An airflow generating device that generates airflow, An airflow processing unit that extracts airflow data further contained in the content data from the content data and causes the airflow generating device to generate an airflow that matches the video based on the airflow data, A simulated experience provision system described in any one of clauses 1 to 3, further comprising the above.

[0084] [Clause 5] The tactile presentation device is The movable frame to which the nozzle is attached, A distance sensor is provided on the movable frame to measure the distance to the user's leg, A moving mechanism that moves the movable frame according to the distance measured by the distance sensor, A simulated experience provision system described in any one of Clauses 1 to 4, further comprising the above.

[0085] [Clause 6] The aforementioned moving mechanism is a simulated experience provision system as described in Clause 5, which moves the movable frame in the horizontal direction.

[0086] [Clause 7] The aforementioned moving mechanism is a simulated experience provision system as described in Clause 5, which raises and lowers the movable frame.

[0087] [Clause 8] A haptic presentation device used in a simulated experience provision system that provides a user with a simulated experience, which presents a tactile sensation to the user, A compressor that supplies compressed air, A nozzle that sprays the compressed air onto the user's leg, A valve is provided between the compressor and the nozzle, which switches between supplying and shutting off the compressed air to the nozzle. A tactile presentation device equipped with the following features. [Explanation of symbols]

[0088] 1,1A...Simulated experience provision system, 10...Information processing device, 11...Memory unit, 12...Image processing unit, 13...Airflow processing unit, 14...Haptic processing unit, 20...Display device, 30...Airflow generation device, 40...Haptic presentation device, 41...Compressor, 42lb,42lf,42ll,42lr,42rb,42rf,42rl,42rr...Valves, 43lb...Nozzle (rear nozzle), 43lf...Nozzle (front nozzle), 43ll...Nozzle (left side nozzle), 43lr...Nozzle (right side nozzle), 43rb...Nozzle (rear nozzle), 43rf...Nozzle (front nozzle), 43rl...Nozzle (left side nozzle), 43rr...Nozzle (right side nozzle), 65,72...Movable frame, 66,73...Distance sensor, 67,74...Movement mechanism, Ll...Left leg, Lr...Right leg, U...User.

Claims

1. A simulated experience provision system that provides users with a simulated experience, A storage unit that stores content data including video data and haptic data, A display device that displays images, A video processing unit that extracts video data from the content data and displays the video on the display device based on the video data, A tactile presentation device that presents tactile sensations to the user, A tactile processing unit extracts tactile data from the content data and causes the tactile presentation device to present tactile sensations that match the video based on the tactile data, Equipped with, The tactile presentation device is A compressor that supplies compressed air, A nozzle that sprays the compressed air onto the user's leg, A valve is provided between the compressor and the nozzle, which switches between supplying and shutting off the compressed air to the nozzle. A system that provides simulated experiences, equipped with the following features.

2. The compressor supplies the compressed air at a pressure of 0.2 MPa to 0.7 MPa. The nozzle has an outlet with a diameter of 4 mm to 5 mm. The simulated experience provision system according to claim 1, wherein the nozzle is arranged such that the distance from the nozzle outlet to the leg is 20 mm to 50 mm.

3. The haptic presentation device includes, as nozzles, a front nozzle for ejecting compressed air onto the front of the user's leg, a rear nozzle for ejecting compressed air onto the rear of the leg, a left nozzle for ejecting compressed air onto the left side of the leg, and a right nozzle for ejecting compressed air onto the right side of the leg, according to claim 1 or claim 2.

4. An airflow generating device that generates airflow, An airflow processing unit that extracts airflow data further contained in the content data from the content data and causes the airflow generating device to generate an airflow that matches the video based on the airflow data, A simulated experience provision system according to claim 1 or claim 2, further comprising the above.

5. The tactile presentation device is The movable frame to which the nozzle is attached, A distance sensor is provided on the movable frame to measure the distance to the user's leg, A moving mechanism that moves the movable frame according to the distance measured by the distance sensor, A simulated experience provision system according to claim 1 or claim 2, further comprising the above.

6. The aforementioned moving mechanism moves the movable frame in the horizontal direction, as described in claim 5 for the simulated experience provision system.

7. The aforementioned moving mechanism raises and lowers the movable frame, as described in claim 5, for the simulated experience provision system.

8. A haptic presentation device used in a simulated experience provision system that provides a user with a simulated experience, which presents a tactile sensation to the user, A compressor that supplies compressed air, A nozzle that sprays the compressed air onto the user's leg, A valve is provided between the compressor and the nozzle, which switches between supplying and shutting off the compressed air to the nozzle. A tactile presentation device equipped with the following features.

Images