Tracking performance presentation method and host

Abstract

Embodiments of the invention provide a tracking performance presentation method and host. The method includes providing visual content in a see-through mode, wherein the visual content corresponds to a real-world scene; assessing tracking performance associated with the real-world scene; and displaying a tracking performance indicator corresponding to the tracking performance in the visual content.

Description

Technical Field

[0001] This invention relates to a tracking technology, and more particularly to a tracking performance presentation method and host. Background Technology

[0002] In existing virtual reality (VR) technologies, using simultaneous localization and mapping (SLAM) to perform inside-outtracking is a common practice for related hosts (such as head-mounted displays (HMDs) running VR services).

[0003] However, in existing SLAM mechanisms, the relevant tracking performance is mostly presented as corresponding numerical results (such as attitude accuracy) and / or related system events (such as presenting a message of lost-tracking).

[0004] However, the above presentation method does not intuitively demonstrate the performance of SLAM tracking in certain specific environments to the average user. Summary of the Invention

[0005] In view of this, the present invention provides a tracking performance presentation method and host, which can be used to solve the above-mentioned technical problems.

[0006] This invention provides a tracking performance presentation method suitable for a host computer, comprising: providing visual content in a transparency mode, wherein the visual content corresponds to a real-world scene; evaluating a tracking performance associated with the real-world scene; and displaying a tracking performance indicator corresponding to the tracking performance in the visual content.

[0007] This invention provides a host computer including a storage circuit and a processor. The storage circuit stores program code. The processor is coupled to the storage circuit and accesses the program code to execute: providing visual content in a transparency mode, wherein the visual content corresponds to a real-world scene; evaluating a tracking performance associated with the real-world scene; and displaying a tracking performance indicator corresponding to the tracking performance in the visual content. Attached Figure Description

[0008] The accompanying drawings are included to further illustrate the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0009] Figure 1 This is a schematic diagram of a host computer drawn according to an embodiment of the present invention.

[0010] Figure 2 This is a flowchart illustrating a tracking performance presentation method based on an embodiment of the present invention.

[0011] Figure 3A This is a schematic diagram illustrating a display tracking performance indicator according to an embodiment of the present invention.

[0012] Figure 3B It is based on Figure 3A A schematic diagram illustrating the display tracking performance indicator.

[0013] Figure 4A and Figure 4B This is a schematic diagram illustrating a display tracking performance indicator according to another embodiment of the present invention.

[0014] Figure 5 This is an application scenario diagram illustrated according to an embodiment of the present invention. Detailed Implementation

[0015] Reference will now be made in detail to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same component symbols are used in the drawings and description to denote the same or similar parts.

[0016] Please refer to Figure 1 This is a schematic diagram of a host according to an embodiment of the present invention. In different embodiments, the host 100 may be implemented as various intelligent devices and / or computer devices, but is not limited thereto. In some embodiments, the host 100 may be an HMD that provides various reality services (e.g., VR services, augmented reality services), mixed reality (MR) services, or other similar services, but is not limited thereto.

[0017] exist Figure 1 In this system, the host 100 includes a storage circuit 102 and a processor 104. The storage circuit 102 may be, for example, any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk, or other similar device or combination of these devices, and may be used to record multiple program codes or modules.

[0018] Processor 104 is coupled to storage circuit 102 and may be a general purpose processor, special purpose processor, conventional processor, digital signal processor, multiple microprocessors, one or more microprocessors incorporating a digital signal processor core, controller, microcontroller, application specific integrated circuit (ASIC), field programmable gate array (FPGA), any other type of integrated circuit, state machine, processor based on advanced RISC machine (ARM), and the like.

[0019] In an embodiment of the present invention, the processor 104 may access the modules and program code recorded in the storage circuit 102 to implement the tracking performance presentation method proposed in the present invention, the details of which are described below.

[0020] Please refer to Figure 2 This is a flowchart illustrating a tracking performance presentation method according to an embodiment of the present invention. The method of this embodiment can be derived from... Figure 1 The host 100 executes, and the following is the configuration. Figure 1 Component description shown Figure 2 Details of each step.

[0021] First, in step S210, the processor 104 provides visual content in transparency mode.

[0022] In one embodiment, when the host 100 is operating in transparency mode, the host 100 may capture a real-world scene in front of the host 100 and / or the user through a front camera (not shown), and the processor 104 renders the captured real-world scene into corresponding visual content (e.g., VR content) and then provides it to the user for viewing.

[0023] In other words, users can observe the real-world scene in front of them through the visual content provided by the host 100, but it is not limited to this.

[0024] In step S220, processor 104 evaluates the tracking performance in relation to the real-world scene. In one embodiment, processor 104 may perform an inside-out tracking function (e.g., SLAM) on the real-world scene to obtain tracking results, but is not limited to this.

[0025] In embodiments of the present invention, the real-world scene may include one or more physical regions. In one embodiment, the processor 104 may, for example, treat the entire real-world scene as a single physical region. In another embodiment, the processor 104 may, for example, determine how to divide the real-world scene into multiple physical regions based on the designer's requirements.

[0026] In one embodiment, the processor 104 may, for example, after controlling the front camera to capture an image corresponding to the real-world scene, divide the image into multiple image regions according to a preset division method, and determine that these image regions correspond to the one or more entity regions respectively.

[0027] For example, the processor 104 can divide the image corresponding to the real-world scene into four image regions: top, bottom, left, and right, and determine that these image regions correspond to four entity regions respectively. Alternatively, the processor 104 can divide the image corresponding to the real-world scene into three image regions: left, center, and right, and determine that these image regions correspond to three entity regions respectively.

[0028] In another embodiment, the processor 104 may also automatically identify entity regions existing in the real-world scene based on a specific image recognition algorithm. For example, after identifying one or more entity regions in the real-world scene corresponding to one or more building structures (e.g., walls, floors, and / or ceilings), the processor 104 may divide the image corresponding to the real-world scene into image regions corresponding to these building structures, but this is not limited to this.

[0029] In the first embodiment, after obtaining the above-mentioned image regions, the processor 104 may, for example, determine the number of feature points in each image region based on SLAM technology, so as to use the number of feature points corresponding to each entity region.

[0030] The processor 104 can then determine whether the number of feature points in each entity region is below a number threshold. In one embodiment, the number threshold is, for example, a number of feature points sufficient to achieve good tracking results, which can be determined by the designer as needed, but is not limited thereto.

[0031] In the first embodiment, if the number of feature points in one of the entity regions (hereinafter referred to as the first entity region) is lower than a threshold, it means that the processor 104 may not be able to perform good tracking of the first entity region. In this case, the processor 104 may determine that the tracking performance of the first entity region is in a first state (e.g., poor).

[0032] On the other hand, if the number of feature points in the first entity region is not less than a certain threshold, it means that the processor 104 can perform good tracking of the first entity region. In this case, the processor 104 can determine that the tracking performance of the first entity region is in the second state (e.g., good).

[0033] In the second embodiment, after obtaining the above-mentioned image regions, the processor 104 may, for example, determine the feature point distribution in each image region based on SLAM technology, so as to serve as the feature point distribution corresponding to each entity region.

[0034] Then, the processor 104 can determine whether the feature point distribution of the first entity region meets the preset distribution conditions. If not, the processor 104 can determine that the tracking performance of the first entity region is in the first state; if yes, the processor 104 can determine that the tracking performance of the first entity region is in the second state.

[0035] In the second embodiment, the preset distribution conditions are, for example, feature point distribution conditions sufficient to achieve good tracking results, which can be determined by the designer according to needs, but are not limited to this.

[0036] In one embodiment, the processor 104 can determine whether the feature point distribution of the first entity region indicates that the feature point density corresponding to the first entity region is higher than a density threshold. If so, the processor 104 can determine that the feature point distribution of the first entity region meets a preset distribution condition; otherwise, it can determine that the feature point distribution of the first entity region does not meet the preset distribution condition, but this is not limited to this.

[0037] In the second embodiment, the density threshold is, for example, a feature point distribution density sufficient to achieve good tracking performance, which can be determined by the designer as needed, but is not limited to this.

[0038] In step S230, the processor 104 displays a tracking performance indicator corresponding to the tracking performance in the visual content.

[0039] In one embodiment, in response to determining that the tracking performance is in a first state, the processor 104 may present the tracking performance indicator as a first visual form. Additionally, in response to determining that the tracking performance is in a second state, the processor 104 may present the tracking performance indicator as a second visual form.

[0040] Please refer to Figure 3A This is a schematic diagram illustrating a display tracking performance indicator according to an embodiment of the present invention.

[0041] exist Figure 3AIn the transparent mode, the host 100 can provide visual content 310 for the user to view, wherein the visual content 310 can correspond to a real-world scene in front of the user (such as a sofa, door, display shelf and plants).

[0042] exist Figure 3A In this scenario, assuming the real-world scene as a whole is considered as a single entity region, the processor 104 can, after determining the tracking performance of the real-world scene, present the corresponding tracking performance indicator 320 in the visual content 310.

[0043] In one embodiment, the tracking performance indicator 320 can be presented at any designated location within the visual content 310, and can be implemented, for example, as a pattern with a specific geometry. Figure 3A In the first visual state, if the tracking performance of the real-world scene is in a first state, the processor 104 may, for example, render the tracking performance indicator 320 as a first color (e.g., red) as the first visual state. On the other hand, if the tracking performance of the real-world scene is in a second state, the processor 104 may, for example, render the tracking performance indicator 320 as a second color (e.g., green) as the second visual state, but is not limited to this.

[0044] In one embodiment, the visual content may include one or more content regions corresponding to the aforementioned one or more entity regions, and the tracking performance of the real-world scene may include the specific tracking performance of each entity region. In this case, the processor 104 may display specific tracking performance indicators in the corresponding content regions based on the specific tracking performance of each entity region.

[0045] Please refer to Figure 3B It is based on Figure 3A A schematic diagram illustrating the display tracking performance indicator. Figure 3B In this context, it is assumed that the visual content 310 includes content regions 310a and 310b, which, for example, correspond to two entity regions in a real-world scene (hereinafter referred to as the first entity region and the second entity region), but are not limited to this. In this case, the processor 104 may display a specific tracking performance indicator 320a corresponding to the first entity region in content region 310a, and a specific tracking performance indicator 320b corresponding to the second entity region in content region 310b.

[0046] For example, if the tracking performance of a specific entity region is in a first state (e.g., poor), the processor 104 may, for example, render the specific tracking performance indicator 320a as a first color (e.g., red) as the first visual form. Additionally, if the tracking performance of a specific entity region is in a second state (e.g., good), the processor 104 may, for example, render the specific tracking performance indicator 320b as a second color (e.g., green) as the second visual form, but is not limited to this.

[0047] Please refer to Figure 4A and Figure 4B This is a schematic diagram illustrating a display tracking performance indicator according to another embodiment of the present invention. Figure 4A In this context, assuming the tracking performance of the real-world scene in front of host 100 is in a second state (e.g., good), host 100 may provide a tracking performance indicator 410 (e.g., a green circle) displayed as a second visual form in the visual content provided to user 499 for viewing.

[0048] exist Figure 4B In this context, assuming the tracking performance of the real-world scene in front of host 100 is in a first state (e.g., poor), host 100 may provide a tracking performance indicator 420 (e.g., a red circle) displayed as the first visual type in the visual content provided to user 499 for viewing.

[0049] Please refer to Figure 5 This is an application scenario diagram illustrated according to embodiments of the present invention. Figure 5 In the process, after the host 100 obtains the tracking performance of the real-world scene, it can provide this tracking performance to the electronic device 510 connected to the host 100, so as to trigger the electronic device 510 to display the tracking performance indicator 520 corresponding to this tracking performance.

[0050] For example, if the tracking performance of the real-world scene is in a first state, the tracking performance indicator 520 may be presented in a first visual form; if the tracking performance of the real-world scene is in a second state, the tracking performance indicator 520 may be presented in a second visual form. In this way, the user can use the host 100 as a handheld environmental scanner and determine the tracking performance corresponding to the real-world scene in front of the host 100 based on the tracking performance indicator 520 displayed on the electronic device 510, but this is not limited to this.

[0051] In summary, the method proposed in this embodiment of the invention can indicate the tracking performance corresponding to a real-world scene using tracking performance indicators with different visual forms (e.g., patterns with specific colors) within visual content. Furthermore, the method can also provide corresponding specific tracking performance indicators in content areas corresponding to different entity regions to present the specific tracking performance of different entity regions. This allows users to more intuitively understand the tracking performance of a real-world scene.

[0052] Furthermore, the method of this embodiment can also provide the tracking performance of a real-world scene to another electronic device, triggering that electronic device to display a corresponding tracking performance indicator. In this way, the user can use the host device of this embodiment as a handheld environmental scanner, thereby realizing a novel tracking performance presentation mechanism.

[0053] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A tracking performance presentation method, suitable for a host computer, characterized in that, include: Provide visual content in transparency mode, where the visual content corresponds to a real-world scene; Evaluate the tracking performance in relation to the real-world scenario; as well as Displaying a tracking performance indicator corresponding to the tracking performance in the visual content includes: In response to determining that the tracking performance is in a first state, the tracking performance indicator is presented as a first visual form; In response to determining that the tracking performance is in a second state, the tracking performance indicator is presented as a second visual form.

2. The method of claim 1, wherein the step of providing the visual content in the transparency mode comprises: The host computer uses its front-facing camera to capture the real-world scene and renders the real-world scene as the visual content.

3. The method of claim 1, wherein the step of obtaining the tracking performance associated with the real-world scene comprises: Perform inside-out tracking on the real-world scene to achieve the tracking performance.

4. The method of claim 1, wherein the real-world scene includes at least one entity region, and the step of evaluating the tracking performance associated with the real-world scene includes: Obtain the number of feature points in each of the aforementioned entity regions; The tracking performance of the first entity region is determined to be in a first state if the number of feature points in the first entity region of the at least one entity region is lower than the number threshold. In response to the determination that the number of feature points in the first entity region is not less than the number threshold, the tracking performance of the first entity region is determined to be in the second state.

5. The method of claim 1, wherein the real-world scene comprises at least one entity region, and the step of evaluating the tracking performance associated with the real-world scene comprises: The system determines that the feature point distribution of the first entity region in the at least one entity region does not meet the preset distribution conditions, and therefore determines that the tracking performance of the first entity region is in the first state. The system determines that the feature point distribution of the first entity region satisfies the preset distribution conditions, and therefore determines that the tracking performance of the first entity region is in the second state.

6. The method according to claim 5, further comprising: The reaction is that the feature point distribution of the first entity region indicates that the feature point density of the first entity region is higher than the density threshold, and the feature point distribution of the first entity region satisfies the preset distribution condition. The distribution of feature points in the first entity region indicates that the density of feature points corresponding to the first entity region is not higher than the density threshold, and therefore the distribution of feature points in the first entity region does not meet the preset distribution condition.

7. The method of claim 1, wherein the real-world scene includes at least one entity region, the visual content includes at least one content region corresponding to each of the at least one entity region, the tracking performance of the real-world scene includes specific tracking performance for each of the entity regions, and the step of displaying a tracking performance indicator corresponding to the tracking performance in the visual content comprises: Based on the specific tracking performance of each entity region, a specific tracking performance indicator is displayed in the corresponding content region.

8. The method of claim 7, wherein the at least one entity region includes a first entity region and a second entity region, the at least one content region includes a first content region and a second content region corresponding to the first entity region and the second entity region respectively, and the step of displaying a specific tracking performance indicator in the corresponding content region according to the specific tracking performance of each entity region includes: Display a first specific tracking performance indicator corresponding to the first entity region in the first content area; A second specific tracking performance indicator corresponding to the second entity region is displayed in the second content area.

9. The method of claim 8, wherein the step of displaying the first specific tracking performance indicator corresponding to the first entity region in the first content region comprises: In response to determining that the specific tracking performance corresponding to the first entity region is in a first state, the first specific tracking performance indicator is presented as a first visual form; In response to determining that the specific tracking performance corresponding to the first entity region is in a second state, the first specific tracking performance indicator is presented as a second visual form.

10. The method according to claim 1, further comprising: The tracking performance associated with the real-world scene is provided to an electronic device connected to the host, wherein the tracking performance associated with the real-world scene triggers the electronic device to display another tracking performance indicator corresponding to the tracking performance.

11. A host computer, characterized in that, include: Storage circuitry that stores program code; as well as A processor, coupled to the storage circuitry and accessing the program code for execution: Provide visual content in transparency mode, where the visual content corresponds to a real-world scene; Evaluate the tracking performance in relation to the real-world scenario; as well as Displaying a tracking performance indicator corresponding to the tracking performance in the visual content includes: In response to determining that the tracking performance is in a first state, the tracking performance indicator is presented as a first visual form; In response to determining that the tracking performance is in a second state, the tracking performance indicator is presented as a second visual form.

Images