Method, host and computer readable storage medium for improving quality of visual content

CN116610209BActive Publication Date: 2026-09-04HTC CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211597100.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2022-10-02
Filing Date
2022-12-12
Publication Date
2026-09-04
Estimated Expiration
2042-12-12

AI Technical Summary

Technical Problem

由于一些原因(例如遮挡),对手部111、手部112的跟踪可能不准确,使得对应的手部对象121、手部对象122可能不能够正确地反映手部111、手部112之间的现实的相对位置

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116610209B_ABST
    Figure CN116610209B_ABST
Patent Text Reader

Abstract

Embodiments of the present application provide a method for improving quality of visual content, a host and a computer readable storage medium. The method comprises: determining a first hand gesture of a first hand and providing a first hand object in the visual content accordingly; determining a second hand gesture of a second hand and providing a second hand object in the visual content accordingly; in response to determining that the first hand gesture and the second hand gesture correspond to a first predetermined hand gesture and a second predetermined hand gesture respectively, determining a specific distance between the first hand gesture and the second hand gesture; and in response to determining that the specific distance is less than a distance threshold, refining the first hand object and the second hand object.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention generally relates to a method for improving the quality of visual content, a host computer, and a computer-readable storage medium. Background Technology

[0002] In technologies such as virtual reality (VR) and mixed reality (MR), a user's hand can be tracked and mapped to a corresponding hand object in the virtual world. However, due to various reasons (e.g., the hand is occluded), the accuracy of hand tracking may not be satisfactory, thus affecting the visual quality of the hand object.

[0003] See Figure 1 , Figure 1 A schematic diagram of gesture detection is shown. Figure 1 In this system, the user's hands 111 and 112 in the real world can be tracked and mapped to hand objects 121 and 122 in the virtual world, respectively. Due to various reasons (such as occlusion), the tracking of hands 111 and 112 may be inaccurate, causing the corresponding hand objects 121 and 122 to not accurately reflect the real relative positions between hands 111 and 112.

[0004] For example, when the user makes hand 111, hand 112 perform... Figure 1 When the gesture shown (e.g., making a triangle) is executed, hand objects 121 and 122 may be rendered inaccurately due to inaccurate determination of the distance between hands 111 and 112 and / or the depth of hands 111 and / or 112. This causes hand objects 121 and 122 to deviate from the realistic representation of hands 111 and 112. In this situation, although the user uses hands 111 and 112 to form a triangle, hand objects 121 and 122 cannot be rendered to properly represent the triangle the user expects, which may degrade the user's visual experience. Summary of the Invention

[0005] Therefore, the present invention relates to a method, host, and computer-readable storage medium for improving the quality of visual content that can be used to solve the above-mentioned technical problems.

[0006] This invention provides a method for improving the quality of visual content applicable to a host computer. The method includes: determining a first gesture of a first hand and correspondingly providing a first hand object in the visual content; determining a second gesture of a second hand and correspondingly providing a second hand object in the visual content; determining a specific distance between the first gesture and the second gesture in response to determining that the first gesture and the second gesture respectively correspond to a first predetermined gesture and a second predetermined gesture; and refining the first hand object and the second hand object in response to determining that the specific distance is less than a distance threshold.

[0007] This invention provides a host computer including a storage circuit and a processor. The storage circuit stores program code. The processor is coupled to the storage circuit and accesses the program code to execute: determining a first gesture of a first hand and correspondingly providing a first hand object in visual content; determining a second gesture of a second hand and correspondingly providing a second hand object in visual content; determining a specific distance between the first gesture and the second gesture in response to determining that the first gesture and the second gesture correspond to a first predetermined gesture and a second predetermined gesture, respectively; and refining the first hand object and the second hand object in response to determining that the specific distance is less than a distance threshold.

[0008] This invention provides a computer-readable storage medium that records an executable computer program, which is loaded by a host computer to perform the following steps: determining a first gesture of a first hand and correspondingly providing a first hand object in visual content; determining a second gesture of a second hand and correspondingly providing a second hand object in visual content; determining a specific distance between the first gesture and the second gesture in response to determining that the first gesture and the second gesture correspond to a first predetermined gesture and a second predetermined gesture, respectively; and refining the first hand object and the second hand object in response to determining that the specific distance is less than a distance threshold. Attached Figure Description

[0009] This document includes accompanying drawings to provide a further understanding of the invention, and the drawings are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with this description, serve to explain the principles of the invention.

[0010] Figure 1 A schematic diagram of gesture detection is shown.

[0011] Figure 2 A schematic diagram of a host computer according to an embodiment of the present invention is shown.

[0012] Figure 3 A flowchart illustrating a method for improving the quality of visual content according to an embodiment of the present invention is shown.

[0013] Figure 4A schematic diagram illustrating an application scenario according to an embodiment of the present invention is shown.

[0014] Figure 5 A schematic diagram illustrating a predefined combination of gestures according to an embodiment of the present invention is shown.

[0015] [Explanation of Symbols]

[0016] 40: Visual Content

[0017] 111, 112: Hands

[0018] 121, 122: Hand objects

[0019] 200: Host

[0020] 202: Storage Circuit

[0021] 204: Processor

[0022] 411: First Hand

[0023] 411a: First-hand object

[0024] 411b, 412b: Center

[0025] 412: Second Hand

[0026] 412a: Second hand object

[0027] 421: The first wearable device

[0028] 422: Second wearable device

[0029] 510, 520, 530: Predefined gesture combinations

[0030] 511, 521, 531: First predetermined gesture

[0031] 512, 522, 532: Second pre-defined gesture

[0032] D1: First Distance

[0033] D2: Second Distance

[0034] DI1, DI2: direction

[0035] S310, S320, S330, S340: Steps

[0036] T1, T2, T3: Time points Detailed Implementation

[0037] Reference will now be made in detail to the presently preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings. Throughout the drawings and this description, the same reference numerals are used to refer to the same or similar parts whenever possible.

[0038] See Figure 2 , Figure 2 A schematic diagram of a host computer according to an embodiment of the present invention is shown. Figure 2 In this embodiment, host 200 can be any device capable of tracking user gestures. In one embodiment, host 200 can be a head-mounted display (HMD) that provides augmented reality (AR) / VR services / content. In some embodiments, the HMD can determine the gestures performed by the user's hands by performing an inside-out tracking mechanism, but the invention is not limited thereto.

[0039] In some embodiments, the HMD may include a (front) camera with a field of view (FOV), and the HMD may track the user's hand when the user's hand is within the FOV of the camera, and determine the gesture accordingly based on the image captured by the camera, but the invention is not limited thereto. Details of the inside-out tracking mechanism in this invention can be found in the relevant prior art, and will not be repeated hereafter.

[0040] exist Figure 2 In this system, the host 200 includes a storage circuit 202 and a processor 204. The storage circuit 202 is one or a combination of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk, or any other similar device, and the storage circuit 202 records multiple modules and / or program code that can be executed by the processor 204.

[0041] Processor 204 is coupled to storage circuit 202, and processor 204 may be, for example, a general-purpose processor, a special-purpose processor, a conventional processor, a digital signal processor (DSP), multiple microprocessors, one or more microprocessors associated with a DSP core, a controller, a microcontroller, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) circuit, any other type of integrated circuit (IC), a state machine, and similar devices.

[0042] In this embodiment of the invention, processor 204 may access module / program code stored in storage circuit 202 to implement the method for improving the quality of visual content provided in this invention, which will be further discussed below.

[0043] See Figure 3 , Figure 3 A flowchart illustrating a method for improving the quality of visual content according to an embodiment of the present invention is shown. The method of this embodiment can be... Figure 2 The host 200 in the middle is used to execute, and Figure 3 The details of each step will be used below. Figure 2 The components shown are described below. To better illustrate the concept of the invention, the following will be used. Figure 4 As an example, where Figure 4 A schematic diagram illustrating an application scenario according to an embodiment of the present invention is shown.

[0044] In step S310, processor 204 determines a first gesture of the first hand 411 and provides a first hand object 411a accordingly in visual content 40. In step S320, processor 204 determines a second gesture of the second hand 412 and provides a second hand object 412a accordingly in visual content 40.

[0045] In various embodiments, visual content 40 may be provided as a reality service of a reality system running on host 200. In some embodiments, the reality system may be an augmented reality (AR) system, a VR system, a MR system, and / or an extended reality (XR) system, but the invention is not limited thereto. In some embodiments, the visual content 40 provided by processor 204 may be AR / VR / MR / XR content displayed to an HMD user via an HMD, and the first hand 411 and the second hand 412 may be the hands of the user of host 200. In one embodiment, visual content 40 may include a virtual environment with a 360-degree field of view. In one embodiment, processor 204 may provide a portion of the visual content for a user to view from the user's FOV, and the content within the user's FOV may be adjusted at least in response to the posture of the HMD.

[0046] In this embodiment of the invention, the processor 204 can execute any existing gesture recognition algorithm to track a first gesture and a second gesture performed by a first hand 411 and a second hand 412 in the field of view of the HMD's camera. In one embodiment, after acquiring the first gesture and the second gesture, the processor 204 can add / render a first hand object 411a and a second hand object 412a corresponding to the first hand 411 and the second hand 412, respectively, to the visual content 40.

[0047] In one embodiment, the first gesture can be determined more accurately by using a wearable device. For example, the first hand 411 may be worn with a first wearable device 421 (e.g., a smart bracelet), and the first wearable device 421 may be provided with a motion detection element (e.g., an inertial measurement unit (IMU)) for collecting motion data of the first hand 411 (e.g., six degrees of freedom values ​​and / or acceleration).

[0048] In one embodiment, processor 204 may determine a gesture of the first hand 411 obtained based on an inside-out tracking mechanism as a first reference gesture of the first hand 411. In this case, processor 204 may acquire multiple historical gestures of the first hand 411 and movement data of the first wearable device 421, and determine the first gesture of the first hand 411 by correcting the first reference gesture based on the historical gestures and movement data of the first hand 411. Therefore, processor 204 can determine the first gesture of the first hand 411 more accurately by taking into account the movement data of the first wearable device 421. Similarly, a second hand 412 may be worn with a second wearable device 422, and processor 204 can determine the second gesture of the second hand 412 more accurately by taking into account the movement data of the second wearable device 422.

[0049] In one embodiment, the processor 204 can determine whether the first gesture and the second gesture correspond to the first predetermined gesture and the second predetermined gesture, respectively.

[0050] In one embodiment, the first predetermined gesture and the second predetermined gesture belong to a predefined gesture combination. In one embodiment, the host 200 may maintain a database for storing various predefined gesture combinations, and each predefined gesture combination may include a pair of gestures.

[0051] See Figure 5 , Figure 5 A schematic diagram illustrating a predefined combination of gestures according to an embodiment of the present invention is shown. Figure 5 In the process, predefined gesture combinations 510, 520, and 530 can be stored in a database. Predefined gesture combination 510 may include a first predetermined gesture 511 and a second predetermined gesture 512, predefined gesture combination 520 may include a first predetermined gesture 521 and a second predetermined gesture 522, and predefined gesture combination 530 may include a first predetermined gesture 531 and a second predetermined gesture 532, but the present invention is not limited thereto.

[0052] like Figure 5 As shown, the predetermined gestures in each predefined gesture combination are symmetrical to each other. For example, the first predetermined gesture 511 and the second predetermined gesture 512 in predefined gesture combination 510 are symmetrical to each other; the first predetermined gesture 521 and the second predetermined gesture 522 in predefined gesture combination 520 are symmetrical to each other; and the first predetermined gesture 531 and the second predetermined gesture 532 in predefined gesture combination 530 are symmetrical to each other. In other embodiments, the predetermined gestures in some predefined gesture combinations may be asymmetrical to each other, but the present invention is not limited thereto.

[0053] In one embodiment, the processor 204 can determine whether the first gesture and the second gesture correspond to a predetermined gesture of any predefined gesture combination. Figure 4 In the exemplary scenario illustrated, the processor 204 can determine at time point T1 that the first gesture of the first hand 411 and the second gesture of the second hand 412 correspond to the first predetermined gesture 511 and the second predetermined gesture 512 of the predefined gesture combination 510, respectively. For example, the first hand 411 and the second hand 412 can move closer to each other along corresponding directions DI1 and DI2 until the index finger and thumb on the first hand 411 and the index finger and thumb on the second hand 412 form a triangle, but the invention is not limited to this. Therefore, the processor 204 can adjust the first hand object 411a and the second hand object 412a to correspond to the first gesture and the second gesture at time point T1. That is, the processor 204 can move the first hand object 411a and the second hand object 412a toward each other along corresponding directions DI1 and DI2, but the invention is not limited to this.

[0054] In this embodiment of the invention, predefined gesture combinations 510, 520, and 530 can be used to activate various system functions. For example, predefined gesture combination 510 can be used to display the system menu of the real system, and predefined gesture combination 530 can be used to send / display heart-shaped emojis, but the invention is not limited thereto.

[0055] exist Figure 4 In this invention, it can be assumed that the user presents a predefined gesture combination 510 with the first hand 411 and the second hand 412 at time point T2, but the invention is not limited thereto.

[0056] In step S330, in response to determining that the first gesture and the second gesture correspond to the first predetermined gesture 511 and the second predetermined gesture 512 respectively, the processor 204 determines a specific distance between the first gesture and the second gesture.

[0057] In this embodiment of the invention, since the first hand object 411a and the second hand object 412a are rendered based on the first gesture and the second gesture respectively, the specific distance between the first gesture and the second gesture can be regarded as corresponding to the distance between the first hand object 411a and the second hand object 412a, but the invention is not limited thereto.

[0058] In one embodiment, the specific distance may be the shortest distance between the first gesture and the second gesture. For example, the processor 204 may consider the distance between the index finger on the first hand 411 and the index finger on the second hand 412 as the specific distance.

[0059] In another embodiment, the specific distance may be a first distance between a first reference point on the first gesture and a second reference point on the second gesture. In this case, the first reference point on the first gesture may be any point desired by the designer of the first gesture, and the second reference point on the second gesture may be any point desired by the designer of the second gesture. Figure 4 In this context, the first reference point can be the center 411b of the palm of the first hand 411, the second reference point can be the center 412b of the palm of the second hand 412, and the specific distance can be the first distance D1 between the center 411b of the palm of the first hand 411 and the center 412b of the palm of the second hand 412.

[0060] In another embodiment, the specific distance may be a second distance D2 between the first wearable device 421 worn on the first hand 411 and the second wearable device 422 worn on the second hand 412, but the present invention is not limited thereto.

[0061] In one embodiment, processor 204 may determine whether a specific distance (e.g., a first distance D1) is less than a distance threshold. If so, it indicates that although the first hand object 411a and the second hand object 412a cannot be accurately rendered to reflect the actual situation at time point T2, the user may actually be presenting a predefined gesture combination 510. More specifically, as Figure 4 As shown, at time point T2, the first hand object 411a and the second hand object 412a may be slightly separated from each other, which deviates from the actual relative positions of the first hand 411 and the second hand 412 at time point T2 in the real world.

[0062] Therefore, in step S340, in response to determining that a specific distance is less than a distance threshold, the processor 204 refines the first hand object 411a and the second hand object 412a.

[0063] In one embodiment, when refining the first hand object 411a and the second hand object 412a, the processor 204 can move the first hand object 411a and the second hand object 412a closer to each other. That is, the processor 204 can shorten the distance between the first hand object 411a and the second hand object 412a.

[0064] As described above, the first hand object 411a and the second hand object 412a may be rendered inaccurately due to distance and / or depth errors, causing them to appear farther apart than they actually are in the real world. By moving the first hand object 411a and the second hand object 412a closer to each other, the visual effect presented by the first hand object 411a and the second hand object 412a can more closely resemble the actual situation of the first hand 411a and the second hand 412a.

[0065] In one embodiment, while moving the first hand object 411a and the second hand object 412a closer to each other, the processor 204 may move a first predetermined point on the first hand object 411a and a second predetermined point on the second hand object 412a closer to each other.

[0066] In this embodiment of the invention, the first predetermined point and the second predetermined point can be arbitrarily determined based on the designer's requirements. That is, the first predetermined point can be any point on the first hand object 411a preferred by the designer, and the second predetermined point can be any point on the second hand object 412a preferred by the designer.

[0067] In one embodiment, the first predetermined point on the first hand object 411a may be a first joint point (e.g., fingertip and / or knuckle) on the first hand object 411a, and the second predetermined point on the second hand object 412a may be a second joint point (e.g., fingertip and / or knuckle) on the second hand object 412a.

[0068] In one embodiment, the first and second predetermined points can be determined based on the predefined combination of gestures considered.

[0069] In the first embodiment, since the index fingertip of the first hand 411a and the index fingertip of the second hand 412a need to contact each other in the predefined gesture combination 510, the index fingertip on the first hand object 411a and the index fingertip on the second hand object 412a can be regarded as the first predetermined point and the second predetermined point, respectively. In this case, the processor 204 can shorten the distance between the index fingertip on the first hand object 411a and the index fingertip on the second hand object 412a while moving the first hand object 411a and the second hand object 412a closer to each other.

[0070] In the second embodiment, since the thumb tips of the first hand 411 and the second hand 412 need to contact each other in the predefined gesture combination 510, the thumb tips on the first hand object 411a and the second hand object 412a can be regarded as a first predetermined point and a second predetermined point, respectively. In this case, the processor 204 can shorten the distance between the thumb tips of the first hand object 411a and the second hand object 412a while moving the first hand object 411a and the second hand object 412a closer to each other.

[0071] In the third embodiment, the processor 204 can simultaneously perform the operations described in the first embodiment and the operations described in the second embodiment. That is, during the refinement of the first hand object 411a and the second hand object 412a, the processor 204 can simultaneously shorten the distance between the fingertip of the index finger on the first hand object 411a and the fingertip of the index finger on the second hand object 412a, and shorten the distance between the fingertip of the thumb on the first hand object 411a and the fingertip of the thumb on the second hand object 412a, but the present invention is not limited thereto.

[0072] In the fourth embodiment, since the fingertips of the middle fingers of the first hand 411a and the second hand 412a need to contact each other in the predefined gesture combination 520, the fingertips of the middle fingers on the first hand object 411a and the second hand object 412a can be regarded as the first predetermined point and the second predetermined point, respectively. In this case, the processor 204 can shorten the distance between the fingertips of the middle fingers on the first hand object 411a and the second hand object 412a while moving the first hand object 411a and the second hand object 412a closer to each other.

[0073] In the fifth embodiment, since the fingertip of the ring finger of the first hand 411 and the fingertip of the ring finger of the second hand 412 need to contact each other in the predefined gesture combination 520, the fingertip of the ring finger on the first hand object 411a and the fingertip of the ring finger on the second hand object 412a can be regarded as the first predetermined point and the second predetermined point, respectively. In this case, the processor 204 can shorten the distance between the fingertip of the ring finger on the first hand object 411a and the fingertip of the ring finger on the second hand object 412a while moving the first hand object 411a and the second hand object 412a closer to each other.

[0074] In the sixth embodiment, the processor 204 can simultaneously perform the operations described in the fourth embodiment and the operations described in the fifth embodiment. That is, during the refinement of the first hand object 411a and the second hand object 412a, the processor 204 can simultaneously shorten the distance between the fingertip of the middle finger on the first hand object 411a and the fingertip of the middle finger on the second hand object 412a, and also shorten the distance between the fingertip of the ring finger on the first hand object 411a and the fingertip of the ring finger on the second hand object 412a, but the invention is not limited thereto.

[0075] In the seventh embodiment, since the thumb tips of the first hand 411 and the second hand 412 need to contact each other in the predefined gesture combination 530, the thumb tips on the first hand object 411a and the second hand object 412a can be regarded as a first predetermined point and a second predetermined point, respectively. In this case, the processor 204 can shorten the distance between the thumb tips of the first hand object 411a and the second hand object 412a while moving the first hand object 411a and the second hand object 412a closer to each other.

[0076] In the eighth embodiment, since the index fingertip of the first hand 411 and the index fingertip of the second hand 412 need to contact each other in the predefined gesture combination 530, the index fingertip on the first hand object 411a and the index fingertip on the second hand object 412a can be regarded as the first predetermined point and the second predetermined point, respectively. In this case, the processor 204 can shorten the distance between the index fingertip on the first hand object 411a and the index fingertip on the second hand object 412a while moving the first hand object 411a and the second hand object 412a closer to each other.

[0077] In the ninth embodiment, the processor 204 can simultaneously perform the operations described in the seventh embodiment and the operations described in the eighth embodiment. That is, during the refinement of the first hand object 411a and the second hand object 412a, the processor 204 can simultaneously shorten the distance between the thumb tip on the first hand object 411a and the thumb tip on the second hand object 412a, and also shorten the distance between the index finger tip on the first hand object 411a and the index finger tip on the second hand object 412a, but the invention is not limited thereto.

[0078] In one embodiment, during the refinement of the first hand object 411a and the second hand object 412a, the processor 204 may align a first predetermined point on the first hand object 411a with a second predetermined point on the second hand object 412a.

[0079] In one embodiment, the processor 204 can directly set the coordinates of the first predetermined point and the coordinates of the second predetermined point to be adjacent or the same, so that the first predetermined point and the second predetermined point can appear to be in contact with each other.

[0080] In one embodiment, the processor 204 may shorten the distance between the first predetermined point and the second predetermined point to a specific value such that the first predetermined point and the second predetermined point may appear to be touching or slightly overlapping each other. In one embodiment, the specific value may be selected such that the contour corresponding to the first predetermined point and the contour corresponding to the second predetermined point are in contact with each other.

[0081] Taking the first embodiment as an example, during the process of fitting the fingertip of the index finger on the first hand object 411a and the fingertip of the index finger on the second hand object 412a (i.e., fitting the first predetermined point and the second predetermined point), the processor 204 can shorten the distance between the fingertip of the index finger on the first hand object 411a and the fingertip of the index finger on the second hand object 412a to a specific value so that the outline of the index finger on the first hand object 411a and the outline of the index finger on the second hand object 412a come into contact with each other.

[0082] Taking the second embodiment as an example, during the process of fitting the thumb tip on the first hand object 411a and the thumb tip on the second hand object 412a (i.e., fitting the first predetermined point and the second predetermined point), the processor 204 may shorten the distance between the thumb tip on the first hand object 411a and the thumb tip on the second hand object 412a to a specific value so that the outline of the thumb on the first hand object 411a and the outline of the thumb on the second hand object 412a slightly overlap each other.

[0083] In the third embodiment, the processor 204 can simultaneously abut the fingertips of the index fingers on the first hand object 411a and the second hand object 412a, and also abut the fingertips of the thumbs on the first hand object 411a and the second hand object 412a. Therefore, it can... Figure 4 The visual effect shown at time point T3 is presented to the user. In this case, the user will see first hand objects 411a and second hand objects 412a that appropriately reflect the real-world state of first hand 411 and second hand 412. That is, the user's visual experience will not be affected by inaccurately rendered hand objects (e.g., first hand objects 411a and second hand objects 412a corresponding to time point T2).

[0084] In one embodiment, in response to determining that a specific distance is less than a distance threshold, this indicates that the user may want to perform a predefined gesture combination corresponding to the first and second predetermined gestures determined in step S330. Therefore, the processor 204 can activate system functions corresponding to the predefined gesture combination.

[0085] For example, if the first predetermined gesture and the second predetermined gesture determined in step S330 are respectively Figure 5 If the first predetermined gesture 511 and the second predetermined gesture 512 are given, the processor 204 may activate a system function corresponding to the predefined gesture combination 510 (e.g., displaying the system menu of the real system) in response to determining that a specific distance is less than a distance threshold.

[0086] For example, if the first predetermined gesture and the second predetermined gesture determined in step S330 are respectively Figure 5 If the first predetermined gesture 531 and the second predetermined gesture 532 are given, the processor 204 may activate a system function corresponding to a predefined gesture combination 530 (e.g., sending / showing a heart-shaped emoji) in response to determining that a specific distance is less than a distance threshold, but the invention is not limited thereto.

[0087] The present invention also provides a computer-readable storage medium for performing a method for improving the quality of visual content. The computer-readable storage medium comprises a plurality of program instructions (e.g., setup program instructions and deployment program instructions) therein. These program instructions can be loaded into and executed by a host 200 to perform the aforementioned method for improving the quality of visual content and the functions of the host 200.

[0088] In summary, embodiments of the present invention can refine hand objects in visual content in response to determining that hand gestures correspond to predetermined gestures and are close to each other. Therefore, the quality of visual content can be improved, allowing users to see hand objects in the visual content that appropriately reflect the state of a hand tracked in the real world. In other words, the user's visual experience will not be affected by inaccurately rendered hand objects.

[0089] It will be apparent to those skilled in the art that various modifications and alterations can be made to the structure of the invention without departing from the scope or spirit of the invention. In view of the foregoing, the present invention is intended to cover any modifications and alterations of the invention that fall within the scope of the appended claims and their equivalents.

Claims

1. A method for improving the quality of visual content, applicable to a host computer, characterized in that, include: Determine the first gesture of the first hand and provide the first hand object accordingly in the visual content; Determine the second gesture of the second hand, and provide the second hand object accordingly in the visual content; In response to determining that the first gesture and the second gesture correspond to a first predetermined gesture and a second predetermined gesture, respectively, the distance between the first gesture and the second gesture is determined; as well as In response to determining that the distance is less than a distance threshold, the distance between the first hand object and the second hand object is shortened.

2. The method of claim 1, wherein the step of shortening the distance between the first hand object and the second hand object comprises: Move the first hand object and the second hand object closer to each other.

3. The method of claim 2, wherein the step of moving the first hand object and the second hand object closer to each other comprises: Move the first predetermined point on the first hand object and the second predetermined point on the second hand object closer to each other.

4. The method of claim 3, wherein the step of moving the first predetermined point on the first hand object and the second predetermined point on the second hand object to be closer to each other comprises: The first predetermined point on the first hand object is aligned with the second predetermined point on the second hand object.

5. The method of claim 3, wherein the first predetermined point on the first hand object is a first joint point on the first hand object, and the second predetermined point on the second hand object is a second joint point on the second hand object.

6. The method according to claim 1, wherein the distance is the shortest distance between the first gesture and the second gesture.

7. The method of claim 1, wherein the distance is a first distance between a first reference point on the first gesture and a second reference point on the second gesture.

8. The method of claim 1, wherein the distance is a second distance between a first wearable device worn on the first hand and a second wearable device worn on the second hand.

9. The method according to claim 1, wherein the first predetermined gesture and the second predetermined gesture belong to a predefined gesture combination.

10. The method of claim 9, further comprising: Activate the specific system function corresponding to the predefined gesture combination.

11. The method according to claim 1, wherein the first predetermined gesture is symmetrical to the second predetermined gesture.

12. The method of claim 1, wherein the step of determining the first gesture of the first hand comprises: Acquire multiple historical gestures of the first hand; Acquire movement data of the first wearable device worn on the first hand; Determine the first reference gesture of the first hand; Based on the historical gestures and movement data of the first hand, the first gesture of the first hand is determined by correcting the first reference gesture.

13. A host computer, characterized in that, include: Storage circuitry stores program code; The processor is coupled to the storage circuitry and accesses the program code for execution. Determine the first gesture of the first hand and provide the first hand object accordingly in the visual content; Determine the second gesture of the second hand, and provide the second hand object accordingly in the visual content; In response to determining that the first gesture and the second gesture correspond to a first predetermined gesture and a second predetermined gesture, respectively, the distance between the first gesture and the second gesture is determined; as well as In response to determining that the distance is less than a distance threshold, the distance between the first hand object and the second hand object is shortened.

14. The host computer of claim 13, wherein the processor performs: Move the first hand object and the second hand object closer to each other.

15. The host computer of claim 14, wherein the processor performs: Move the first predetermined point on the first hand object and the second predetermined point on the second hand object closer to each other.

16. The host computer of claim 15, wherein the processor performs: The first predetermined point on the first hand object is aligned with the second predetermined point on the second hand object.

17. The host computer of claim 15, wherein the first predetermined point on the first hand object is a first joint point on the first hand object, and the second predetermined point on the second hand object is a second joint point on the second hand object.

18. The host according to claim 13, wherein the distance is the shortest distance between the first gesture and the second gesture, a first distance between a first reference point on the first gesture and a second reference point on the second gesture, or a second distance between a first wearable device worn on the first hand and a second wearable device worn on the second hand.

19. The host computer of claim 13, wherein the first predetermined gesture and the second predetermined gesture belong to a predefined gesture combination, and the processor further activates a specific system function corresponding to the predefined gesture combination.

20. A computer-readable storage medium that records an executable computer program, the executable computer program being loaded by a host computer to perform the following steps: Determine the first gesture of the first hand and provide the first hand object accordingly in the visual content; Determine the second gesture of the second hand, and provide the second hand object accordingly in the visual content; In response to determining that the first gesture and the second gesture correspond to a first predetermined gesture and a second predetermined gesture, respectively, the distance between the first gesture and the second gesture is determined; as well as In response to determining that the distance is less than a distance threshold, the distance between the first hand object and the second hand object is shortened.

Citation Information

Patent Citations

  • Gesture error correction method, system and device in augmented reality environment

    CN109993108A

  • Hand gestures to signify what is important

    US8558759B1