Method of stabilizing a beam and electronic device using the method

Abstract

Embodiments of the present disclosure provide a method of stabilizing a ray and an electronic device. The method includes determining a particular raycast associated with a gesture in a virtual environment, determining whether the gesture is a pinch gesture, and in response to determining that the gesture is a pinch gesture, locking the particular ray during the pinch gesture. Thereby, a user can interact with virtual objects in a more stable manner.

Description

Technical Field

[0001] This invention generally relates to a radiation control mechanism, and more specifically, to a method for stabilizing radiation and an electronic device. Background Technology

[0002] In some services that provide virtual environments, the system can determine rays based on the user's gestures so that the user can point to the desired object in the virtual environment.

[0003] In some situations, when a user points to a desired object so that the corresponding ray also points to the desired object, the user can perform specific gestures (e.g., pinch gestures) to select / activate the desired object. However, during the execution of a specific gesture, the corresponding ray may move away from the desired object, making it impossible for the user to accurately select / activate the desired object. Summary of the Invention

[0004] Therefore, the present invention relates to a method for stabilizing radiation and an electronic device that can be used to solve the above-mentioned technical problems.

[0005] Embodiments of this disclosure provide a method for stabilizing a ray, comprising: determining a specific ray associated with a gesture in a virtual environment; determining whether the gesture is a pinch gesture; and locking the specific ray during the pinch gesture in response to determining that the gesture is a pinch gesture.

[0006] Embodiments of this disclosure provide an electronic device including a storage circuit and a processor. The storage circuit stores program code. The processor is connected to the non-transitory storage circuit and accesses the program code to execute: determining a specific ray associated with a gesture in a virtual environment; determining whether the gesture is a pinch gesture; and locking the specific ray during the pinch gesture in response to determining that the gesture is a pinch gesture. Attached Figure Description

[0007] The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0008] Figure 1 A schematic diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure is shown.

[0009] Figure 2 A flowchart illustrating a method for stabilizing rays according to an embodiment of the present disclosure is shown.

[0010] Figure 3 A schematic diagram illustrating a specific ray associated with a gesture according to an embodiment of the present disclosure.

[0011] Figure 4An application scenario according to an embodiment of this disclosure is illustrated.

[0012] Explanation of icon numbers

[0013] 100: Electronic devices;

[0014] 102: Storage circuit;

[0015] 104: Processor;

[0016] 311: Reference point;

[0017] 313: Reference direction;

[0018] 399: Hand;

[0019] 400: Virtual environment;

[0020] 411, 412, 413, 414, 415, 416: Options;

[0021] P1: First finger pointing;

[0022] P2: Second finger pointing;

[0023] R1: Specific ray;

[0024] S210, S220, S230: Steps. Detailed Implementation

[0025] Reference will now be made in detail to the presently preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numerals are used in the drawings and description to refer to the same or similar parts.

[0026] See Figure 1 This illustration depicts a schematic diagram of an electronic device according to exemplary embodiments of the present disclosure. In various embodiments, the electronic device 100 may be any device capable of providing visual content (e.g., reality service content, such as VR / AR / MR / ER content) to a user. In embodiments of the present disclosure, the electronic device 100 may be a host of a reality service system (e.g., a VR / AR / MR / ER system), wherein the reality service system may include other components such as a head-mounted display (HMD), controllers, position tracking elements, but the present disclosure is not limited thereto. In other embodiments, the electronic device 100 may also be a standalone reality service HMD capable of generating and displaying reality service content to its user, but the present disclosure is not limited thereto.

[0027] To better understand the concepts of this disclosure, it will be assumed that the electronic device 100 is a host that can provide visual content for a corresponding HMD display, but this disclosure is not limited thereto.

[0028] exist Figure 1 In the electronic device 100, there are storage circuitry 102 and processor 104. Storage circuitry 102 is one or a combination of the following: static or mobile random access memory (RAM), read-only memory (ROM), flash memory, hard disk, or any other similar device, and storage circuitry 102 records program code and / or multiple modules executable by processor 104.

[0029] Processor 104 can be connected to storage circuit 102, and processor 104 can be, for example, a graphics processing unit (GPU), a general-purpose processor, a special-purpose processor, a conventional processor, a digital signal processor (DSP), multiple microprocessors, one or more microprocessors associated with a DSP core, a controller, a microcontroller, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) circuit, any other type of integrated circuit (IC), a state machine, etc.

[0030] In embodiments of this disclosure, processor 104 may access modules and / or program code stored in storage circuit 102 to implement the method for stabilizing rays provided in this disclosure, which will be further discussed below.

[0031] See Figure 2 The diagram illustrates a flowchart of a method for stabilizing rays according to an embodiment of the present disclosure. The method of this embodiment can be derived from... Figure 1 The electronic device 100 in the middle performs the operation, and Figure 2 Details of each step will be provided below. Figure 1 The components shown in the figure are described.

[0032] First, in step S210, the processor 104 determines a specific ray in the virtual environment that is associated with the gesture. To better understand, Figure 3 This will be used as an example, where Figure 3 A schematic diagram illustrating a specific ray associated with a gesture according to an embodiment of the present disclosure.

[0033] exist Figure 3In this context, the virtual environment under consideration can be a VR environment, and the user can interact with the VR environment by performing various gestures using the user's hand 399. The processor 104 can detect the gestures of the hand 399 via any existing gesture detection algorithm and adjust the VR environment accordingly based on the detected gestures, but this disclosure is not limited thereto.

[0034] In one embodiment, in the step of determining a specific ray R1 associated with a gesture of hand 399, processor 104 may determine a reference point 311 and a reference direction 313 on hand 399. Figure 3 In this embodiment, reference point 311 may correspond to the wrist joint of hand 399, and reference direction 313 may be the normal direction of the palm of hand 399. In other embodiments, processor 104 may consider any other point associated with hand 399 as reference point 311. In one embodiment, processor 104 may first determine the plane corresponding to the palm of hand 399 and define the normal direction of this plane as reference direction 313 accordingly, but this disclosure is not limited thereto.

[0035] After determining the reference point 311 and the reference direction 313, the processor 104 can determine a specific ray R1 based on the reference point 311 and the reference direction 313 on the hand 399, wherein the specific ray R1 passes through the reference point 311 and is perpendicular to the reference direction 313, but this disclosure is not limited thereto. In other embodiments, the processor 104 can determine the specific ray R1 associated with the hand 399 based on any existing ray determination mechanism.

[0036] In step S220, the processor 104 determines whether the gesture is a pinching posture. In one embodiment, the processor 104 can obtain a first finger point P1 and a second finger point P2 on the hand 399, wherein the first finger point P1 and the second finger point P2 correspond to different fingers on the hand 399. Figure 3 In this embodiment, the first finger point P1 and the second finger point P2 may correspond to the fingertips of the thumb and index finger on the hand 399, but this disclosure is not limited thereto. In other embodiments, the first finger point P1 and the second finger point P2 may correspond to the fingertips of any two fingers of the hand 399.

[0037] Next, the processor 104 can determine the relative velocity between the first finger point P1 and the second finger point P2. In one embodiment, in response to determining that the first finger point P1 and the second finger point P2 are approaching each other at a relative velocity higher than a velocity threshold, the processor 104 can determine that the gesture is a pinching gesture; otherwise, the processor 104 can determine that the gesture is not a pinching gesture. In various embodiments, the velocity threshold can be designed to be any value chosen by the designer, for example, from 0.2 m / s to 0.25 m / s, but this disclosure is not limited thereto.

[0038] In one embodiment, in response to determining that the gesture is a pinching gesture, processor 104 performs step S230 to lock a specific ray R1 during the pinching gesture. In one embodiment, processor 104 may maintain the position of the specific ray R1 in the virtual environment. Therefore, the specific ray R1 will not move in response to the movement of hand 399 during the pinching gesture.

[0039] In some embodiments, in response to determining that a specific ray R1 points to a specific object in the virtual environment during a pinch gesture, the processor 104 may trigger the specific object. For example, if the specific object pointed to by the specific ray R1 is a virtual option in the virtual environment, then the processor 104 may determine that the virtual option has been selected by the user and adjust the content of the virtual environment accordingly. For another instance, if the specific object corresponds to a specific function provided in the virtual environment, then the processor 104 may activate the specific function accordingly and adjust the content of the virtual environment accordingly, but this disclosure is not limited thereto.

[0040] Because a specific ray R1 is locked during the pinch gesture, users can trigger specific objects in a more stable manner, which can improve the user experience of interacting with the virtual environment.

[0041] In another embodiment, in response to determining that the gesture has changed to a gesture other than a pinching gesture, the processor 104 may unlock a specific ray R1 and re-determine the specific ray R1 associated with the gesture based on the teachings above, which will not be repeated herein.

[0042] In other embodiments, if the processor 104 determines in step S220 that the gesture is not a pinching gesture, then the processor 104 may execute step S210 to determine a specific ray based on the current gesture. That is, the specific ray R1 will move around in response to the movement of the hand 399. In some embodiments, if the hand 399 is detected to perform a pinching gesture again, then the processor 104 will lock the specific ray R1 again to allow the user to interact with the virtual environment more accurately.

[0043] See Figure 4 It illustrates an application scenario according to embodiments of this disclosure. Figure 4 In this context, the virtual environment 400 may be a VR environment providing options 411 to 416, where options 411 to 416 may correspond to different user interfaces, but this disclosure is not limited thereto.

[0044] exist Figure 4In this scenario, suppose a user performs a pinch gesture to select option 411 when a specific ray R1 is pointed at option 411. In a conventional approach where the specific ray R1 is not locked during the pinch gesture, the specific ray R1 may accidentally move and point to other options near option 411 (e.g., option 412 or option 414), potentially causing the user to accidentally trigger other undesirable options.

[0045] However, since the processor 104 can lock a specific ray R1 during the pinch gesture, the specific ray R1 will stably point to option 411 during the pinch gesture, allowing the user to accurately trigger the desired option 411. Therefore, the user experience can be improved.

[0046] In summary, this disclosure allows locking the ray associated with the gesture while the user is performing a pinch gesture. Therefore, a specific ray will not move in response to movement of the user's hand during the pinch gesture. In some cases, when the user wants to trigger (e.g., select / activate) a virtual object in a virtual environment, the ray will be stably pointed at the virtual object during the pinch gesture, allowing the user to interact with the virtual object in a more stable manner.

[0047] It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the invention without departing from its scope or spirit. In view of the foregoing, it is intended that this invention cover modifications and variations thereof, provided that such modifications and variations fall within the scope of the appended claims and their equivalents.

Claims

1. A method for stabilizing radiation, comprising: Determine specific rays in a virtual environment that are associated with gestures; Determine whether the gesture is a pinching or squeezing motion; as well as In response to determining that the gesture is the pinching posture, locking the specific ray during the pinching posture includes: Maintain the position of the specific ray in the virtual environment during the pinching gesture.

2. The method for stabilizing rays according to claim 1, wherein, The gesture is made by a hand, and the step of determining the specific ray associated with the gesture includes: Determine the reference point and reference direction in your hand; and The specific ray is determined based on the reference point on the hand and the reference direction, wherein the specific ray passes through the reference point and is perpendicular to the reference direction.

3. The method for stabilizing rays according to claim 2, wherein, The reference point corresponds to the wrist joint of the hand, and the reference direction is the normal direction of the palm of the hand.

4. The method for stabilizing rays according to claim 1, wherein, The gesture is made by the hand, and the step of determining whether the gesture is the pinching posture includes: Obtain a first finger point and a second finger point on the hand, wherein the first finger point and the second finger point correspond to different fingers on the hand; Determine the relative velocity between the first finger point and the second finger point; and In response to determining that the first finger point and the second finger point approach each other at a relative speed higher than a speed threshold, the gesture is determined to be the pinching posture.

5. The method for stabilizing rays according to claim 4, wherein, The first finger point and the second finger point correspond to the fingertips of the thumb and index finger on the hand.

6. The method for stabilizing rays according to claim 1, further comprising: In response to determining that the gesture has changed to another gesture other than the pinching gesture, the specific ray is unlocked and the specific ray associated with the gesture is re-determined.

7. The method for stabilizing radiation according to claim 1, further comprising: In response to determining that the specific ray is pointing at a specific object in the virtual environment during the pinching gesture, the specific object is triggered.

8. An electronic device comprising: Storage circuitry stores program code; as well as The processor is connected to the storage circuit and accesses the program code for execution: Determine specific rays in a virtual environment that are associated with gestures; Determine whether the gesture is a pinching or squeezing motion; as well as In response to determining that the gesture is the pinching posture, locking the specific ray during the pinching posture includes: Maintain the position of the specific ray in the virtual environment during the pinching gesture.

9. The electronic device according to claim 8, wherein, The gesture is made by the hand, and the processor executes it: Determine the reference point and reference direction in your hand; and The specific ray is determined based on the reference point on the hand and the reference direction, wherein the specific ray passes through the reference point and is perpendicular to the reference direction.

10. The electronic device according to claim 9, wherein, The reference point corresponds to the wrist joint of the hand, and the reference surface corresponds to the normal direction of the palm of the hand.

11. The electronic device according to claim 8, wherein, The gesture is made by the hand, and the processor executes it: Obtain a first finger point and a second finger point on the hand, wherein the first finger point and the second finger point correspond to different fingers on the hand; Determine the relative velocity between the first finger point and the second finger point; as well as In response to determining that the first finger point and the second finger point approach each other at a relative speed higher than a speed threshold, the gesture is determined to be the pinching posture.

12. The electronic device according to claim 11, wherein, The first finger point and the second finger point correspond to the fingertips of the thumb and index finger on the hand.

13. The electronic device according to claim 8, wherein, The processor also performs: In response to determining that the gesture has changed to a gesture other than the pinching gesture, the specific ray is unlocked and the specific ray associated with the gesture is re-determined.

14. The electronic device according to claim 8, wherein, The processor also performs: In response to determining that the specific ray is pointing at a specific object in the virtual environment during the pinching gesture, the specific object is triggered.

Images