Stress feedback device and virtual image display system

Abstract

The present application provides a stress feedback device and a virtual image display system. The stress feedback device includes a position sensor and a pressure generator. The position sensor is used to generate position information based on a trigger signal and transmit the position information to a host. The pressure generator is used to apply stress to a target area and adjust the intensity of the stress according to the trigger signal.

Description

Technical Field

[0001] This invention relates to a stress feedback device and a virtual image display system, and more particularly to a stress feedback device and a virtual image display system that can enhance the user's immersion in a virtual image world. Background Technology

[0002] With the continuous advancement of the technology industry, virtual image displays capable of virtual reality (VR) or augmented reality (AR) have become widespread in the consumer market.

[0003] In virtual reality, when a user touches or pushes a virtual object, existing technologies typically use vibrations to alert the user and simulate the sensation of contact. However, in this case, existing technologies can only simulate the tactile sensation of contact, but cannot provide the user with a clear sense of force feedback and immersion when interacting with the virtual object. Summary of the Invention

[0004] This invention provides a stress feedback device and a virtual image display system, which can enhance the user's immersive experience in the virtual image world.

[0005] The stress feedback device of the present invention includes a position sensor and a pressure generator. The position sensor generates position information based on a trigger signal and transmits the position information to a host device. The pressure generator is coupled to the position sensor and applies stress to a target area and adjusts the intensity of the stress according to the trigger signal.

[0006] The virtual image display system of the present invention includes a first stress feedback device, a second stress feedback device, and a host terminal. The first and second stress feedback devices are interconnected via a linkage mechanism, and are respectively disposed at a first and a second location of the user. At least one of the first and second stress feedback devices includes a position sensor and a pressure generator. The position sensor generates position information based on a trigger signal. The pressure generator is coupled to the position sensor. The host terminal is coupled to the first and second stress feedback devices. The host terminal is used to cause the position sensors of the first and second stress feedback devices to sense the relative position between the first and second locations based on the trigger signal, and to cause the pressure generator to apply stress to at least one of the first and second locations and adjust the intensity of the stress based on the trigger signal.

[0007] Based on the above, the virtual image display system of the present invention can apply stress to the user's upper arm and / or lower arm through the pressure generator of the stress feedback device when a trigger event is activated, thereby fixing the relative position of the stress feedback device worn on the upper arm and / or lower arm and changing the user's skin tension. In this way, the present invention allows the user's brain to feel force feedback as if it were real movement, thereby enhancing the user's immersion in the virtual image world. Attached Figure Description

[0008] Figure 1 A schematic diagram illustrating a stress feedback device according to an embodiment of the present invention is shown.

[0009] Figure 2 A schematic diagram illustrating a virtual image display system according to an embodiment of the present invention is shown.

[0010] Figure 3 A flowchart illustrating the operation of the virtual image display system according to an embodiment of the present invention is provided. Detailed Implementation

[0011] Reference will now be made in detail to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same component symbols are used in the drawings and description to denote the same or similar parts.

[0012] Please refer to Figure 1 , Figure 1 A schematic diagram illustrating a stress feedback device according to an embodiment of the present invention is shown. The stress feedback device 100 includes a position sensor 110, a pressure generator 120, and a pressure and displacement detector 130. In this embodiment, the stress feedback device 100 can be worn on any part of the user's body (e.g., hand or foot). When the user performs virtual reality operations via a host device (e.g., a head-mounted display or any computing-capable electronic device), the host device and the stress feedback device 100 communicate and transmit data wirelessly. Thereby, the host device can reflect the resistance or force felt by the user when touching or manipulating virtual objects in virtual reality to the stress feedback device 100 based on the virtual image, thereby generating corresponding force feedback on the stress feedback device 100, enhancing the user's immersion during operation.

[0013] In this embodiment, the position sensor 110 can receive a trigger signal TR and generate position information PD based on the trigger signal TR, and can transmit the position information PD to the host device. For example, in some embodiments, when the host device determines from a virtual image that the user's hand needs to apply pressure to a virtual object (e.g., turning a door lock, gripping a hand gripper, or carrying a plate), it indicates that a trigger event has been initiated. At this time, the host device can generate a trigger signal TR to the position sensor 110 based on the trigger event. Then, the position sensor 110 can sense its absolute position on the target area (e.g., the user's arm) based on the trigger signal TR, and correspondingly generate position information PD.

[0014] In other embodiments, when a user observes that a trigger event is about to be initiated based on a virtual image, the user can generate a trigger signal TR to the position sensor 110 by pressing a button (not shown) on the stress feedback device 100. The position sensor 110 can then sense its absolute position on the target area based on the trigger signal TR, thereby generating position information PD accordingly.

[0015] On the other hand, the pressure generator 120 includes a driver 121 and a compression belt 122. The driver 121 is coupled between the position sensor 110 and the compression belt 122. The pressure and displacement detector 130 is coupled between the position sensor 110 and the pressure generator 120. In this embodiment, the driver 121 may be, for example, an air pump or other type of actuation device, but the invention is not limited thereto. Any device that can drive the compression belt 122 to apply pressure to a user can be used to implement the driver 121 of the present invention, without specific limitations.

[0016] Specifically, the pressure generator 120 is used to apply stress to the user's target area and adjust the intensity of this stress according to the trigger signal TR. For example, when the trigger event is activated, the pressure generator 120 can drive the compression belt 122 according to the trigger signal TR via the driver 121, and cause the compression belt 122 to inflate and pressurize the user's arm.

[0017] Furthermore, in this embodiment, when the triggering event is activated, the stress feedback device 100 can detect the stress SV1 applied to the target area by the pressure generator 120 and the displacement DV1 of the position sensor 110 in the target area via the pressure and displacement detector 130. Then, the pressure and displacement detector 130 can obtain a comparison result CR1 by comparing the stress SV1 with the reference stress RSV1, and transmit the comparison result CR1 to the pressure generator 120.

[0018] On the other hand, the pressure and displacement detector 130 can obtain a comparison result CR2 by comparing the displacement amount DV1 with the reference displacement amount RDV1, and transmit the comparison result CR2 to the pressure generator 120.

[0019] It is worth mentioning that in this embodiment, when the pressure and displacement detector 130 determines that the stress SV1 is not greater than the reference stress RSV1, or the displacement DV1 is not less than the reference displacement RDV1, the pressure generator 120 can pressurize the user's target area through the compression belt 122 based on the comparison results CR1 and CR2.

[0020] In this way, when a user needs to touch or operate a virtual object in virtual reality, the stress feedback device 100 can apply stress to the user's target area (e.g., hand) according to the trigger signal TR, so that the user can feel the same as if they were actually touching or operating the object.

[0021] Please refer to the following for further information: Figure 1 as well as Figure 2 , Figure 2 A schematic diagram illustrating a virtual image display system according to an embodiment of the present invention is shown. The virtual image display system 200 includes a stress feedback device 210, a stress feedback device 220, and a host terminal 230. The stress feedback devices 210 and 220 can be configured to... Figure 1 The stress feedback device 100 shown is used for implementation.

[0022] In this embodiment, the host device 230 can be a head-mounted display capable of generating virtual reality or augmented reality display effects. The user can wear stress feedback devices 210 and 220 on the back of one hand (i.e., the first part) and forearm (i.e., the second part), respectively. Stress feedback devices 210 and 220 can be interconnected with the linkage mechanism LM. Stress feedback devices 210 and 220 can communicate and transmit data with the host device 230 wirelessly.

[0023] For implementation details of the virtual image display system 200, please also refer to... Figures 1 to 3 , Figure 3 A flowchart illustrating the operation of the virtual image display system according to an embodiment of the present invention is provided. In step S310, when the host terminal 230 determines that a trigger event has been initiated based on the virtual image, the host terminal 230 can generate a trigger signal TR to the position sensor 110A of the stress feedback device 210 and the position sensor 110B of the stress feedback device 220.

[0024] At this time, position sensors 110A and 110B can sense their position information TR on the user's first part P1 and second part P2 respectively based on the trigger signal TR, and transmit the position information TR to the host terminal 230. Then, stress feedback devices 210 and 220 can calculate the relative positions of position sensors 110A and 110B between the first part P1 and the second part P2 based on the position information TR.

[0025] Furthermore, in step S320, the host terminal 230 can use the trigger signal TR to enable position sensors 110A and 110B to determine whether the change in their relative position VA between the user's first part P1 and second part P2 is greater than a preset threshold value RVA, so as to obtain the comparison result CR3.

[0026] For example, suppose in virtual reality, a user needs to rotate a virtual object (e.g., a door lock). When position sensors 110A and 110B determine that the change VA is greater than the threshold value RVA, it means that the user's rotation of the virtual door lock has exceeded the threshold value RVA. In this case, the virtual image display system 200 can continue to execute the operation action of step S340.

[0027] In step S340, the host terminal 230 can generate a first locking command LC1 to the pressure generator 120A and / or the pressure generator 120B of the stress feedback device 220 based on the comparison result CR3. The pressure generators 120A and / or 120B can apply stress to the user's first part P1 and / or second part P2 according to the first locking command LC1, thereby fixing the stress feedback device 210 and / or the stress feedback device 220 on the user's arm. Thus, when a trigger event is activated, the virtual image display system 200 can simulate the force feedback and action when the user touches or manipulates a virtual object in the virtual image by applying stress to the user's arm.

[0028] On the other hand, when position sensors 110A and 110B determine that the change VA is not greater than the critical value RVA, it indicates that the user's rotation of the virtual door lock has not exceeded the critical value RVA. In this case, the virtual image display system 200 can continue to execute the operation action of step S330.

[0029] In step S330, the host terminal 230 can control the pressure and displacement detectors 130A and 130B of the stress feedback device 210 and stress feedback device 220, based on the comparison result CR3, to compare the stress SV2 applied to the user's first part P1 and second part P2 with the reference stress RSV2 to obtain the comparison result CR4. Furthermore, the host terminal 230 can also control the pressure and displacement detectors 130A and 130B, based on the comparison result CR3, to compare the displacement DV2 of the position sensor 110A on the user's first part P1 and the displacement RDV2 of the position sensor 110B on the user's second part P2 with the reference displacement RDV2 to obtain the comparison result CR5.

[0030] For example, when pressure and displacement detectors 130A and 130B determine that the stress SV2 is greater than the reference stress RSV2 and the displacement DV2 is less than the reference displacement RDV2, it indicates that the force feedback felt by the user when turning the virtual door lock is sufficiently large. In this case, pressure and displacement detectors 130A and 130B will report a force application status information FSI to the host terminal 230 based on the comparison results CR4 and CR5, so that the host terminal 230 can adjust the generated virtual image according to the force application status information FSI.

[0031] On the other hand, when pressure and displacement detectors 130A and 130B determine that the stress SV2 is not greater than the reference stress RSV2, or the displacement DV2 is not less than the reference displacement RDV2, it indicates that the force feedback felt by the user when turning the virtual door lock is not large enough. In this case, the virtual image display system 200 can continue to execute the operation action of step S340.

[0032] In step S340, the host terminal 230 can generate a second locking command LC2 to pressure generator 120A and / or pressure generator 120B based on the comparison results CR4 and CR5. Pressure generator 120A and / or pressure generator 120B can further apply stress to the user's first part P1 and / or second part P2 according to the second locking command LC2, thereby fixing the stress feedback device 210 and / or stress feedback device 220 on the user's arm. Thus, when a trigger event is activated, the virtual image display system 200 can simulate the force feedback and action force when the user touches or manipulates a virtual object in the virtual image by applying stress to the user's arm.

[0033] In summary, the virtual image display system of the present invention can apply stress to the user's upper arm and / or lower arm through the pressure generator of the stress feedback device when a trigger event is activated, thereby fixing the relative position of the stress feedback device worn on the upper arm and / or lower arm and changing the user's skin tension. In this way, the present invention allows the user's brain to feel force feedback as if it were real movement, thereby enhancing the user's immersion in the virtual image world.

[0034] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A stress feedback device, characterized in that, include: A position sensor is used to generate position information based on a trigger signal and transmit the position information to the host device; as well as A pressure generator, coupled to the position sensor, is used to apply stress to the target area based on the trigger signal. The pressure generator adjusts the intensity of the stress based on a first comparison result indicating a comparison between the stress applied by the pressure generator to the target area and a reference stress, and a second comparison result indicating a comparison between the displacement of the position sensor in the target area and a reference displacement.

2. The stress feedback device according to claim 1, characterized in that, The stress feedback device further includes: A pressure and displacement detector, coupled to the position sensor and the pressure generator, is used to detect the stress exerted by the pressure generator on the target area and the displacement of the position sensor in the target area. The pressure and displacement detector obtains a first comparison result by comparing the stress force with the reference stress force, and obtains a second comparison result by comparing the displacement amount with the reference displacement amount, and the pressure generator adjusts the intensity of the stress based on the first comparison result and the second comparison result.

3. The stress feedback device according to claim 1, characterized in that, The pressure generator said therein includes: A compression band, coupled to the position sensor; and A driver, coupled to the position sensor and the compression belt, is used to drive the compression belt according to the trigger signal, so that the compression belt inflates and pressurizes the target area.

4. The stress feedback device according to claim 3, characterized in that, The drive is an air pump or actuator.

5. A virtual image display system, characterized in that, include: A first stress feedback device and a second stress feedback device are interconnected by a linkage mechanism. The first stress feedback device and the second stress feedback device are respectively disposed at a first part and a second part of the user's body. At least one of the first stress feedback device and the second stress feedback device includes: Position sensors are used to generate position information based on trigger signals; and A pressure generator, coupled to the position sensor; and The host end is coupled to the first stress feedback device and the second stress feedback device, wherein the host end is used for: The position sensors of the first stress feedback device and the second stress feedback device sense the relative position between the first part and the second part based on the trigger signal; and The pressure generator applies stress to at least one of the first and second portions according to the trigger signal. The pressure generator adjusts the intensity of the stress based on a first comparison result indicating a comparison between the stress applied by the pressure generator to at least one of the first and second locations and a reference stress, and a second comparison result indicating a comparison between the displacement of the position sensor between the first and second locations and a reference displacement.

6. The virtual image display system according to claim 5, characterized in that, The pressure generator said therein includes: A compression band, coupled to the position sensor; and A driver, coupled to the position sensor and the compression belt, is used to drive the compression belt according to the trigger signal, so that the compression belt inflates and pressurizes at least one of the first portion and the second portion.

7. The virtual image display system according to claim 6, characterized in that, The drive is an air pump or actuator.

8. The virtual image display system according to claim 5, characterized in that, At least one of the first stress feedback device and the second stress feedback device further includes: A pressure and displacement detector, coupled to the position sensor and the pressure generator, is used to detect the stress exerted by the pressure generator on at least one of the first and second portions and the displacement of the position sensor between the first and second portions.

9. The virtual image display system according to claim 8, characterized in that, The host side is also used for: Based on the trigger signal, the position sensors of the first stress feedback device and the second stress feedback device determine whether the change in the relative position between the first part and the second part is greater than a critical value, in order to obtain a third comparison result, wherein, When the position sensor determines that the change in relative position is greater than the threshold value, the host terminal, based on the third comparison result, causes the pressure generator to apply the stress to at least one of the first and second parts, and When the position sensor determines that the change in the relative position is not greater than the critical value, the host terminal uses the third comparison result to make the pressure and displacement detector compare the stress with the reference stress to obtain the first comparison result, and compare the displacement with the reference displacement to obtain the second comparison result.

10. The virtual image display system according to claim 9, characterized in that, When the pressure and displacement detector determines that the stress is greater than the reference stress and that the displacement is less than the reference displacement, the pressure and displacement detector reports the applied force status information to the host based on the first comparison result and the second comparison result. When the pressure and displacement detector determines that the stress is not greater than the reference stress, or determines that the displacement is not less than the reference displacement, the host terminal causes the pressure generator to apply the stress to at least one of the first part and the second part based on the first comparison result and the second comparison result.

Images