Head mounted display and tracking mode switching method

Abstract

A head-mounted display and a method for switching tracking modes. The head-mounted display calculates first motion information corresponding to a controller and second motion information corresponding to a tracked hand based on real-time images. Based on the motion relationship between the controller and the tracked hand, the head-mounted display determines whether to switch to a hand-holding controller tracking posture mode or a hand tracking posture mode.

Description

[Technical Field]

[0001] This invention relates to a head-mounted display and a method for switching tracking modes. Specifically, this invention relates to a head-mounted display capable of actively switching tracking posture modes and a method for switching tracking modes. [Previous Technology]

[0002] In recent years, various technologies related to virtual reality have developed rapidly, and various related technologies and applications have been proposed one after another.

[0003] In some application environments, users can interact with the head-mounted display by using their hands or holding the controller. In such cases, the head-mounted display needs to determine the current tracking mode to be performed.

[0004] In the prior art, the head-mounted display determines whether to enable the controller's tracking mode by judging whether the controller is in a static state (e.g., powered off or completely stationary on a table). When the controller is determined to be in a static state, the head-mounted display enables the hand tracking mode. Conversely, when the controller is determined to be in a non-static state, the head-mounted display disables the hand tracking mode and enables the controller's tracking mode.

[0005] However, in some application environments, the controller may be attached to the user and move with the user. In such cases, since the controller is not in a stationary state, the existing technology may not be able to correctly switch the tracking mode. In addition, if the hand tracking mode and the controller tracking mode are turned on at the same time, when the user holds the controller, the controller may partially obscure the image of the hand, which may lead to inaccurate hand tracking posture data, thus reducing the user's service experience.

[0006] In view of this, how to provide a technology that can actively switch tracking posture modes is an urgent goal for the industry. [Summary of the Invention]

[0007] One object of the present invention is to provide a head-mounted display. The head-mounted display includes an image capture device and a processor electrically connected to the image capture device. Based on the real-time images, the processor calculates first motion information corresponding to a controller and second motion information corresponding to a tracked hand. Based on the motion relationship between the controller and the tracked hand, the processor determines whether to switch to a hand-grip controller tracking posture mode or a hand tracking posture mode, wherein the motion relationship is generated based on the first motion information and the second motion information.

[0008] Another object of the present invention is to provide a tracking mode switching method for an electronic device. The electronic device includes an image capture device and a processor. The image capture device is used to generate a plurality of real-time images, and the tracking mode switching method includes the following steps: calculating, based on the real-time images, first motion information corresponding to a controller and second motion information corresponding to a tracked hand; and determining, based on the motion relationship between the controller and the tracked hand, to switch to a hand-grip controller tracking posture mode or a hand tracking posture mode, wherein the motion relationship is generated based on the first motion information and the second motion information.

[0009] The tracking mode switching technology (including at least a head-mounted display and method) disclosed herein dynamically determines whether to switch to a hand-held controller tracking posture mode or a hand tracking posture mode by actively judging the movement relationship between the controller and the tracked hand. The tracking mode switching technology disclosed herein can adjust the display content on the display device based on the currently switched tracking posture mode. Furthermore, since the tracking mode switching technology disclosed herein can perform appropriate tracking posture mode switching and display adjustment when the controller is not in a static state, it solves the problems of the prior art and improves the user experience.

[0010] The following detailed description of the technology and implementation of the present invention is illustrated in conjunction with the drawings, so that those skilled in the art can understand the technical features of the claimed invention.

Implementation Method

[0012] The following will explain the head-mounted display and tracking mode switching method provided by the present invention through embodiments. However, these embodiments are not intended to limit the implementation of the present invention to any environment, application, or manner described in these embodiments. Therefore, the description of the embodiments is for illustrative purposes only and is not intended to limit the scope of the present invention. It should be understood that in the following embodiments and drawings, elements not directly related to the present invention have been omitted and are not shown, and the dimensions of each element and the dimensional ratio between elements are only illustrative and are not intended to limit the scope of the present invention.

[0013] First, the applicable scenario of this embodiment will be explained, and its schematic diagram is depicted in Figure 1. As shown in Figure 1, in the application environment disclosed herein, user C can wear a head-mounted display 1 and place the controller CR on their body (e.g., suspended on a belt around user C's waist) to perform interactive operations corresponding to the display screen of the head-mounted display 1. In this example, user C can directly perform interactive operations through hand tracking (e.g., gestures). In addition, user C can remove the controller CR placed on their body and operate the controller CR to perform interactive operations using a handheld controller.

[0014] It should be noted that this disclosure does not limit the number of controllers used by user C, and each controller CR can be paired with a part of user C's body during initial setup.

[0015] For example, one controller CR can be paired with the left hand of user C, and the other controller CR can be paired with the right hand of user C. In addition, since the controllers of different hands usually have a distinguishable appearance (e.g., mirrored button configuration), the head-mounted display 1 can distinguish the different controller CRs by their appearance.

[0016] For ease of understanding, this disclosure will be illustrated using one hand controlling the controller CR (e.g., the tracked hand using the controller CR). It should be understood that the tracking mode switching mechanism of this disclosure can be used simultaneously and independently for different tracked hands.

[0017] A first embodiment of the present invention is a head-mounted display 1, the schematic diagram of which is shown in Figure 2. In this embodiment, the head-mounted display 1 includes an image capture unit 11, a processor 13, a display device 15, and a transceiver interface 17. The processor 13 is electrically connected to the image capture unit 11, the display device 15, and the transceiver interface 17. The image capture unit 11 may include a plurality of image capturing units (e.g., a plurality of depth camera lenses) for capturing a plurality of real-time images including the user C's hand or the controller CR held by the hand.

[0018] In this embodiment, user C can use the controller CR to perform input operations such as moving, controlling, pressing, dragging, etc. The controller CR can perform corresponding operations for sensing / tracking actions. For example, user C can use the head-mounted display 1 and the controller CR to play a police role-playing interactive game. The display device 15 in the head-mounted display 1 displays the controller CR as a pistol image.

[0019] It should be noted that the image capture device 11 may be an image capture device with an image capture function (e.g., a depth camera lens) to generate real-time images corresponding to a field of view (FOV) for tracking operations. The processor 13 may be various processing units, central processing units (CPUs), microprocessors, or other computing devices known to those skilled in the art to which this invention pertains. The display device 15 may be any display screen with display function. The transceiver interface 17 is an interface capable of receiving and transmitting data or other interfaces capable of receiving and transmitting data known to those skilled in the art to which this invention pertains. The transceiver interface may receive data from sources such as external devices, external web pages, external applications, etc.

[0020] First, in this embodiment, the head-mounted display 1 can continuously track the motion information of the controller and the tracked hand through the real-time images captured by the image capturer 11, and determine the switching tracking mode based on the motion relationship between the controller and the tracked hand.

[0021] Specifically, the processor 13 calculates first motion information corresponding to a controller and second motion information corresponding to a tracked hand based on the real-time images. Then, based on the motion relationship between the controller CR and the tracked hand, the processor 13 determines whether to switch to a hand-holding controller tracking posture mode or a hand tracking posture mode, wherein the motion relationship is generated based on the first motion information and the second motion information.

[0022] In some embodiments, the head-mounted display 1 can analyze the position and time sequence relationship of the controller CR and the tracked hand at a frequency of 30-60 times per second to generate motion information.

[0023] For example, motion information may include at least one or a combination of position, velocity, and direction in three-dimensional space. Additionally, motion relationships may include at least one or a combination of distance relationships, velocity relationships, and direction relationships.

[0024] It should be noted that this disclosure determines whether the controller CR is being operated by the tracked hand based on the movement trajectory and movement relationship between the tracking controller CR and the tracked hand. For example, when the distance between the controller CR and the tracked hand is close and their movement directions are similar, the processor 13 can infer that the user C is currently holding the controller CR for interactive operation. Conversely, if the distance between the controller CR and the tracked hand is far or their movement directions are significantly different, the processor 13 can infer that the controller CR is not currently being operated by the user C's tracked hand. For ease of understanding, the following will specifically describe the implementation of this disclosure under different movement relationships.

[0025] In some embodiments, when the processor 13 determines that the spatial distance between two targets is far, the processor 13 may actively switch to the hand tracking posture mode. Specifically, the processor 13 determines whether the spatial distance between the controller CR and one of the tracked hands is greater than or equal to a distance threshold (e.g., 10 cm). Then, in response to the spatial distance being greater than or equal to the distance threshold, the processor 13 decides to switch to the hand tracking posture mode.

[0026] In some embodiments, the processor 13 can calculate the spatial position and spatial distance of two targets through real-time image analysis. Specifically, based on the real-time images, the processor 13 calculates a first spatial position of one of the controllers CR and a second spatial position corresponding to one of the tracked hands. Then, based on the first spatial position and the second spatial position, the processor 13 calculates the spatial distance between the controller CR and the tracked hand.

[0027] It should be noted that the processor 13 can use the base of the palm (e.g., the wrist) as a reference point for determining the position of the tracked hand. In addition, the processor 13 can use the center of the controller CR as a reference point for determining the position of the controller CR.

[0028] In some embodiments, when the processor 13 determines that the movement directions of the controller CR and the tracked hand are similar, the processor 13 can actively switch to the hand-grip controller tracking posture mode. Specifically, the processor 13 determines whether the spatial distance between the controller CR and the tracked hand is lower than a distance threshold. Then, in response to the spatial distance being lower than the distance threshold, the processor 13 determines whether the angle difference between the first movement vector of the corresponding controller CR and the second movement vector of the corresponding tracked hand is lower than an angle threshold (e.g., 5 degrees). Then, in response to the angle difference being lower than the angle threshold, the processor 13 decides to switch to the hand-grip controller tracking posture mode.

[0029] In some embodiments, the processor 13 may further avoid misjudgments caused by slight movements of the user C by setting a speed threshold (e.g., 1 m / s). Specifically, before determining whether the angle difference is lower than the angle threshold, the processor 13 determines whether a first movement rate of one of the controllers CR and a second movement rate of one of the tracked hands are both greater than a speed threshold. Then, in response to the first movement rate and the second movement rate being greater than the speed threshold, the processor 13 determines whether the angle difference is lower than the angle threshold. Then, in response to the first movement rate and the second movement rate not being greater than the speed threshold, the processor 13 suspends the operation of determining the angle difference.

[0030] For ease of understanding, please refer to the operation diagram 300 in Figure 3. In this example, under the initial execution operation, when the controller CR is disconnected from the head-mounted display 1, the operation can start from state S10. When the controller CR is connected to the head-mounted display 1, the operation can start from state S11.

[0031] First, when the processor 13 determines that the current state is S10, the processor 13 executes operation OP17 to turn off the hand controller tracking posture mode (i.e., turn on the hand tracking posture mode), and executes operation OP171 to display the hand tracking posture.

[0032] Next, the processor 13 executes operation OP18 to determine whether the motion relationship between the controller CR and the tracked hand conforms to the preset relationship.

[0033] In this example, in response to the motion relationship conforming to the preset relationship, the processor 13 executes operation OP13 to enable the hand-held controller tracking posture mode, and executes operation OP131 to hide the hand tracking posture (i.e., disable the hand tracking posture mode).

[0034] In some embodiments, if the motion relationship between the controller CR and the tracked hand continues to conform to a preset relationship, the processor 13 can maintain the state of having the hand-holding controller tracking posture mode enabled. If the motion relationship between the controller CR and the tracked hand does not conform to the preset relationship, the processor 13 can perform the judgment operation of operation OP15.

[0035] In another example, when the current state is S11, the processor 13 executes operation OP13 to enable the hand controller tracking posture mode (i.e., disable the hand tracking posture mode) and executes operation OP131 to hide the hand tracking posture.

[0036] Next, the processor 13 executes operation OP15 to determine whether the spatial distance between the controller CR and the tracked hand is greater than or equal to a distance threshold. Then, in response to the spatial distance being greater than or equal to the distance threshold, the processor 13 executes operation OP17 to turn off the hand-holding controller tracking posture mode (i.e., turn on the hand tracking posture mode), and executes operation OP171 to display the hand tracking posture.

[0037] It should be noted that the processor 13 can determine whether to switch to the hand-held controller tracking posture mode or the hand tracking posture mode by continuously executing the aforementioned judgment operation.

[0038] In some embodiments, operation OP18 may include a determination operation as shown in Figure 4. In this example, processor 13 executes operation OP18_1 to determine whether the spatial distance between the controller CR and the tracked hand is below a distance threshold. In response to the spatial distance between the controller CR and the tracked hand being below the distance threshold, processor 13 executes operation OP18_3 to determine whether the angular difference between the first movement vector corresponding to the controller CR and the second movement vector corresponding to the tracked hand is below an angle threshold. In response to the angular difference being below the angle threshold, processor 13 executes operation OP13 to activate the hand-grip controller tracking posture mode.

[0039] In some embodiments, operation OP18 may include a determination operation as shown in Figure 5. In this example, processor 13 executes operation OP18_1 to determine whether the spatial distance between the controller CR and the tracked hand is lower than a distance threshold. In response to the spatial distance between the controller CR and the tracked hand being lower than the distance threshold, processor 13 executes operation OP18_2 to determine whether the first movement rate of the controller CR and the second movement rate of the tracked hand are both greater than a speed threshold. In response to the movement rates being greater than the speed threshold, processor 13 executes operation OP18_3 to determine whether the angle difference between the first movement vector of the corresponding controller CR and the second movement vector of the corresponding tracked hand is lower than an angle threshold. In response to the angle difference being lower than the angle threshold, processor 13 executes operation OP13 to activate the hand-held controller tracking posture mode.

[0040] In some embodiments, to improve the accuracy of motion information of the controller CR, the controller CR may include an inertial sensor (IMU) that continuously generates a sequence of a plurality of inertial measurement parameters (e.g., an inertial measurement parameter stream generated at a frequency of 10 times per second). For example, each of these inertial measurement parameters may include, for example, an acceleration, a rotational magnitude, and an angular acceleration.

[0041] Specifically, the processor 13 receives a sequence of a plurality of inertial measurement parameters from the controller CR (e.g., via the wireless communication connection WC in Figure 2). Then, the processor 13 calculates the first motion information corresponding to the controller CR based on the real-time images and the inertial measurement parameters. In some embodiments, the wireless communication connection WC may be a Bluetooth Low Energy (BLE) communication connection or a Wi-Fi wireless network connection.

[0042] In some embodiments, the processor 13 may also dynamically adjust the frequency of the switching operation based on the frequency of changes in such motion information. For example, when the processor 13 determines that the user C is in a relatively vigorous state of motion, it increases the frequency of the switching operation. When the processor 13 determines that the user C is in a relatively calm state of motion, it decreases the frequency of the switching operation.

[0043] In some embodiments, the processor 13 and display device 15 of the head-mounted display 1 can dynamically adjust the displayed content according to different tracking modes. Specifically, in response to switching to the hand tracking posture mode, the processor 13 generates a hand tracking posture corresponding to one of the tracked hands based on the hand tracking posture mode. Then, the processor 13 transmits the hand tracking posture to the display device 15 so that the display device 15 displays the hand tracking posture corresponding to the tracked hand.

[0044] In some embodiments, in response to switching to the hand controller tracking posture mode, the processor 13 generates a controller tracking posture for the corresponding controller CR based on the hand controller tracking posture mode, and hides the hand tracking posture corresponding to the tracked hand. Then, the processor 13 transmits the controller tracking posture to the display device 15 so that the display device 15 displays the controller CR tracking posture for the corresponding controller CR.

[0045] In some embodiments, since the user's hand is holding the controller CR, the processor 13 can generate a corresponding hand tracking posture through the tracking information of the controller CR. Specifically, the processor 13 generates a new hand tracking posture corresponding to one of the tracked hands based on the controller tracking posture. Then, the processor 13 transmits the new hand tracking posture to the display device 15 so that the display device 15 displays the new hand tracking posture corresponding to the tracked hand.

[0046] In some embodiments, the processor 13 synthesizes a virtual hand image and feeds it to the controller to track the pose, thereby generating the new hand tracking pose. For example, the processor 13 may analyze the touched buttons (e.g., capacitive sensors) on the controller CR to display the corresponding finger touch image.

[0047] As described above, the head-mounted display 1 provided in this disclosure dynamically determines whether to switch to a hand-held controller tracking posture mode or a hand tracking posture mode by actively judging the movement relationship between the controller and the tracked hand. The head-mounted display 1 provided in this disclosure can adjust the displayed content on the display device based on the currently switched tracking posture mode. Furthermore, since the head-mounted display 1 provided in this disclosure can perform appropriate tracking posture mode switching and display screen adjustment when the controller is not in a static state, it solves the problems of the prior art and improves the user's service experience.

[0048] A second embodiment of the present invention is a tracking mode switching method, the flowchart of which is depicted in Figure 6. The tracking mode switching method 600 is applicable to an electronic device, such as the head-mounted display 1 described in the first embodiment. The electronic device includes an image capture device and a processor, such as the image capture device 11 and a processor 13 described in the first embodiment. The image capture device is used to generate a plurality of real-time images. The tracking mode switching method 600 determines whether to switch to a hand-held controller tracking posture mode or a hand tracking posture mode through steps S601 to S603.

[0049] In step S601, the electronic device calculates first motion information corresponding to one of the controllers and second motion information corresponding to one of the tracked hands based on the real-time images.

[0050] In step S603, the electronic device determines to switch to a hand-holding controller tracking posture mode or a hand tracking posture mode based on the motion relationship between the controller and the tracked hand, wherein the motion relationship is generated based on the first motion information and the second motion information.

[0051] In some embodiments, the electronic device further includes a display device, and the tracking mode switching method 600 further includes the following steps: in response to switching to the hand tracking posture mode, generating a hand tracking posture corresponding to the tracked hand based on the hand tracking posture mode; and transmitting the hand tracking posture to the display device so that the display device displays the hand tracking posture corresponding to the tracked hand.

[0052] In some embodiments, the electronic device further includes a display device, and the tracking mode switching method 600 further includes the following steps: in response to switching to the hand controller tracking posture mode, generating a controller tracking posture corresponding to the controller based on the hand controller tracking posture mode, and hiding a hand tracking posture corresponding to the tracked hand; and transmitting the controller tracking posture to the display device so that the display device displays the controller tracking posture corresponding to the controller.

[0053] In some embodiments, the tracking mode switching method 600 further includes the following steps: generating a new hand tracking posture corresponding to one of the tracked hands based on the controller tracking posture; and transmitting the new hand tracking posture to the display device so that the display device displays the new hand tracking posture corresponding to the tracked hand.

[0054] In some embodiments, generating the new hand tracking posture corresponding to the tracked hand includes the following steps: synthesizing a virtual hand image to the controller tracking posture to generate the new hand tracking posture.

[0055] In some embodiments, the decision to switch to the hand-grip controller tracking posture mode or the hand tracking posture mode further includes the following steps: determining whether the spatial distance between the controller and the tracked hand is greater than or equal to a distance threshold; and in response to the spatial distance being greater than or equal to the distance threshold, deciding to switch to the hand tracking posture mode.

[0056] In some embodiments, calculating the spatial distance between the controller and the tracked hand includes the following steps: calculating a first spatial position of the controller and a second spatial position corresponding to the tracked hand based on the real-time images; and calculating the spatial distance between the controller and the tracked hand based on the first spatial position and the second spatial position.

[0057] In some embodiments, deciding to switch to the hand controller tracking posture mode or the hand tracking posture mode further includes the following steps: determining whether the spatial distance between the controller and the tracked hand is lower than a distance threshold; in response to the spatial distance being lower than the distance threshold, determining whether the angle difference between a first movement vector corresponding to the controller and a second movement vector corresponding to the tracked hand is lower than an angle threshold; and in response to the angle difference being lower than the angle threshold, deciding to switch to the hand controller tracking posture mode.

[0058] In some embodiments, before determining whether the angle difference is lower than the angle threshold, the tracking mode switching method 600 further includes the following steps: determining whether a first movement rate of one of the controllers and a second movement rate of one of the tracked hands are both greater than a speed threshold; in response to the first movement rate and the second movement rate being both greater than the speed threshold, determining whether the angle difference is lower than the angle threshold; and in response to the first movement rate and the second movement rate not being both greater than the speed threshold, pausing the operation of determining the angle difference.

[0059] In some embodiments, the tracking mode switching method 600 further includes the following steps: receiving a sequence of a plurality of inertial measurement parameters from the controller by the electronic device; and calculating the first motion information corresponding to the controller by the electronic device based on the real-time images and the inertial measurement parameters.

[0060] In addition to the above steps, the second embodiment can also perform all the operations and steps of the head-mounted display 1 described in the first embodiment, have the same function, and achieve the same technical effect. Those skilled in the art to which this invention pertains can directly understand how the second embodiment performs these operations and steps based on the first embodiment described above, has the same function, and achieves the same technical effect, so it will not be described in detail.

[0061] The calculation method described in the second embodiment can be implemented by a computer program having a plurality of instructions. Each computer program can be a file that can be transmitted over a network, or it can be stored in a non-transitory computer-readable recording medium. For each computer program, after the instructions contained therein are loaded into an electronic device (e.g., a head-mounted display 1), the computer program executes the tracking mode switching method described in the second embodiment. The non-transitory computer-readable storage medium can be an electronic product, such as: a read-only memory (ROM), a flash memory, a floppy disk, a hard disk, a compact disk (CD), a USB flash drive, a database accessible via a network, or any other storage medium known to those skilled in the art and having the same function.

[0062] It should be noted that in the specification and claims of this invention, certain terms (including motion information, spatial position, movement vector, movement speed, etc.) are preceded by "first" or "second". These "first" or "second" are only used to distinguish different terms. For example, "first" and "second" in "first motion information" and "second motion information" are only used to indicate motion information used in different operations.

[0063] In summary, the tracking mode switching technology (including at least a head-mounted display and method) disclosed herein dynamically determines whether to switch to a hand-held controller tracking posture mode or a hand tracking posture mode by actively judging the motion relationship between the controller and the tracked hand. The tracking mode switching technology disclosed herein can adjust the displayed content on the display device based on the currently switched tracking posture mode. Furthermore, since the tracking mode switching technology disclosed herein can perform appropriate tracking posture mode switching and display screen adjustment when the controller is not in a static state, it solves the problems of the prior art and improves the user experience.

[0064] The above embodiments are only used to illustrate some implementations of the present invention and to explain the technical features of the present invention, and are not intended to limit the scope and range of protection of the present invention. Any changes or equivalent arrangements that can be easily made by those skilled in the art to which this invention pertains are within the scope of the present invention, and the scope of protection of the present invention is determined by the scope of the patent application. [Simplified Explanation of the Diagram]

[0011] Figure 1 is a schematic diagram of the environment of the first embodiment; Figure 2 is a schematic diagram of the architecture of the head-mounted display of some embodiments; Figure 3 is a schematic diagram of the operation of some embodiments; Figure 4 is a schematic diagram of the operation of some embodiments; Figure 5 is a schematic diagram of the operation of some embodiments; and Figure 6 is a partial flowchart of the tracking mode switching method of the second embodiment. [Biomaterial Storage]

[0066] Domestic storage information (please note in order of storage institution, date, and number): None. International storage information (please note in order of storage country, institution, date, and number): None.

Claims

1. A head-mounted display comprising: an image capture unit for generating a plurality of real-time images; and a processor electrically connected to the image capture unit and configured to perform the following operations: calculating, based on the real-time images, first motion information corresponding to one of a controller and second motion information corresponding to one of a tracked hand; and determining, based on the motion relationship between the controller and the tracked hand, to switch to a hand-grip controller tracking posture mode or a hand tracking posture mode, wherein the motion relationship is generated based on the first motion information and the second motion information; wherein determining to switch to the hand-grip controller tracking posture mode or the hand tracking posture mode further comprises the following operations: determining whether the spatial distance between the controller and the tracked hand is lower than a distance threshold; in response to the spatial distance being lower than the distance threshold, determining whether the angular difference between one of the first movement vectors corresponding to the controller and one of the second movement vectors corresponding to the tracked hand is lower than an angle threshold; and in response to the angular difference being lower than the angle threshold, determining to switch to the hand-grip controller tracking posture mode.

2. The head-mounted display as claimed in claim 1, wherein the head-mounted display further comprises: a display device electrically connected to the processor; wherein, The processor further performs the following operations: in response to switching to the hand tracking posture mode, generating a hand tracking posture corresponding to one of the tracked hands based on the hand tracking posture mode; and transmitting the hand tracking posture to the display device so that the display device displays the hand tracking posture corresponding to the tracked hand.

3. The head-mounted display as claimed in claim 1, wherein the head-mounted display further comprises: a display device electrically connected to the processor; wherein, The processor further performs the following operations: in response to switching to the hand controller tracking posture mode, it generates a controller tracking posture corresponding to one of the controllers based on the hand controller tracking posture mode, and hides the hand tracking posture corresponding to the tracked hand; and transmits the controller tracking posture to the display device so that the display device displays the controller tracking posture corresponding to the controller.

4. The head-mounted display as described in claim 3, wherein the processor further performs the following operations: generating a new hand tracking posture corresponding to one of the tracked hands based on the controller tracking posture; and transmitting the new hand tracking posture to the display device so that the display device displays the new hand tracking posture corresponding to the tracked hand.

5. The head-mounted display as described in claim 4, wherein generating the new hand tracking posture corresponding to the tracked hand includes the following operations: synthesizing a virtual hand image to the controller tracking posture to generate the new hand tracking posture.

6. The head-mounted display as described in claim 1, wherein deciding to switch to the hand-grip controller tracking posture mode or the hand tracking posture mode further comprises the following operations: determining whether the spatial distance between the controller and the tracked hand is greater than or equal to the distance threshold; and deciding to switch to the hand tracking posture mode in response to the spatial distance being greater than or equal to the distance threshold.

7. The head-mounted display as claimed in claim 6, wherein calculating the spatial distance between the controller and the tracked hand comprises the following operations: calculating a first spatial position of the controller and a second spatial position corresponding to the tracked hand based on the real-time images; and calculating the spatial distance between the controller and the tracked hand based on the first spatial position and the second spatial position.

8. The head-mounted display as described in claim 1, wherein before determining whether the angle difference is lower than the angle threshold, the processor further performs the following operations: determining whether a first movement rate of one of the controllers and a second movement rate of one of the tracked hands are both greater than a speed threshold; in response that the first movement rate and the second movement rate are both greater than the speed threshold, determining whether the angle difference is lower than the angle threshold; and in response that the first movement rate and the second movement rate are not both greater than the speed threshold, pausing the operation of determining the angle difference.

9. A tracking mode switching method for an electronic device, wherein the electronic device includes an image capture unit and a processor, the image capture unit being configured to generate a plurality of real-time images, and the tracking mode switching method comprising the following steps: calculating, based on the real-time images, first motion information corresponding to a controller and second motion information corresponding to a tracked hand; and determining, based on the motion relationship between the controller and the tracked hand, to switch to a hand-grip controller tracking posture mode or a hand tracking posture mode, wherein the motion relationship is generated based on the first motion information and the second motion information; wherein determining to switch to the hand-grip controller tracking posture mode or the hand tracking posture mode further comprises the following steps: determining whether the spatial distance between the controller and the tracked hand is lower than a distance threshold; in response to the spatial distance being lower than the distance threshold, determining whether the angle difference between a first movement vector corresponding to the controller and a second movement vector corresponding to the tracked hand is lower than an angle threshold; and in response to the angle difference being lower than the angle threshold, determining to switch to the hand-grip controller tracking posture mode.

Images