A multi-region multi-precision AR data calling method, a storage medium and an equipment

Abstract

The application relates to a multi-region multi-precision AR data calling method, a storage medium and equipment, and the method comprises the following steps: acquiring a function selection instruction, and calling pre-stored corresponding AR data based on the function selection instruction; wherein the AR data comprises at least one group of real scene terrain data and linked virtual data; the real scene terrain data is acquired by the following mode: dividing the whole site into a plurality of operation object regions, the laser scanners arranged in each operation object region have different placement point spacings, and the real scene terrain data with different precisions is generated by scanning; and the operation object in the real scene terrain is linked with corresponding virtual data. Compared with the prior art, the application has the advantages of reducing energy consumption and the like.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of AR, and particularly relates to a multi-region and multi-precision AR data calling method, a storage medium and equipment. BACKGROUND

[0002] The ground three-dimensional laser scanning technology is a high-tech in the field of surveying and mapping, which can quickly obtain the three-dimensional coordinates of the surface of an object without contacting the measurement target, and can construct a real three-dimensional model of the measured target by using modeling software to generate real scene terrain data, and is also called as a real scene copying technology. The technology can obtain hundreds of thousands of points per second, and the measurement efficiency is greatly improved. Moreover, the operation of the related instrument is simple, and the application range and application field of the instrument are continuously expanded. According to the basic principle of the ground three-dimensional laser scanner, the error factors of scanning and imaging include the influence of target object reflection and external conditions, and the error items generated by the instrument itself (mainly including instrument zero error, laser exit point error, ranging error and angle error). The error control of scanning and imaging can be realized by adjusting the interval of the placement points during scanning of the instrument, and therefore, the interval of the placement points is set in advance according to the error requirement of the scanning object before the instrument is used for scanning.

[0003] At present, the research and development of AR glasses is in a rapid development stage, and the hardware research and development and software optimization of AR glasses are also in a rapid iteration period. The main hardware of AR glasses includes optical display, processor, sensor, storage and battery. In the use process, the energy consumption of AR glasses mainly comes from the chips such as processor and memory. The energy consumption of the chip is mainly determined by memory access and data movement. When the AR glasses maintain high computing power, the situation of lagging, uneven heat dissipation, battery heating and short battery life may occur. SUMMARY

[0004] The application aims to overcome the defects of the prior art, and provides a multi-region and multi-precision AR data calling method, a storage medium and equipment with reduced energy consumption.

[0005] The object of the application can be achieved by the following technical solutions.

[0006] A multi-region and multi-precision AR data calling method, which comprises the following steps: obtaining a function selection instruction, and calling pre-stored corresponding AR data based on the function selection instruction; wherein,

[0007] The AR data comprises at least one set of real scene terrain data and linked virtual data, and the real scene terrain data is obtained by the following method.

[0008] The whole field is divided into multiple operation object areas, and the laser scanners arranged in each operation object area have different placement point intervals, and scanning generates real terrain data with different precisions, and the operation objects in the real terrain are linked with corresponding virtual data.

[0009] Further, the placement point interval of the laser scanner is determined by the following formula:

[0010]

[0011] Wherein, L GAP is the placement point interval of the laser scanner, l high-p is the interval corresponding to the high-precision real terrain data, l low-p is the interval corresponding to the low-precision real terrain data, l min is the minimum measurement range of the laser scanner, l max is the maximum measurement range of the laser scanner.

[0012] Further, the laser scanner is a ground three-dimensional adjustment laser scanner.

[0013] Further, the real terrain data includes high-precision real terrain data of different regions, low-precision real terrain data of different regions, and global low-precision real terrain data.

[0014] Further, the virtual data includes augmented reality labels.

[0015] Further, each operation object area has real terrain data with at least one precision.

[0016] Further, the precision of the real terrain data is determined based on the size of the scanning object in the operation object area corresponding to the function selection instruction.

[0017] The application also provides a computer-readable storage medium, including one or more programs for one or more processors of an electronic device to execute, and the one or more programs include instructions for executing the multi-region multi-precision AR data calling method as described above.

[0018] The application also provides an electronic device, including one or more processors, a memory, and one or more programs stored in the memory, and the one or more programs include instructions for executing the multi-region multi-precision AR data calling method as described above.

[0019] Further, the electronic device is an AR glasses.

[0020] Compared with the prior art, the application has the following beneficial effects:

[0021] 1. Control the scanning accuracy of real-world terrain in different areas according to the functional module requirements, thereby controlling the size of the real-world terrain data;

[0022] 2. By loading real-world terrain data and linked virtual data for a specific area or several areas separately according to the functional modules, memory access and data movement are reduced, chip power consumption is reduced, the overall power consumption of AR devices is reduced, and data retrieval efficiency is improved. Attached Figure Description

[0023] Figure 1 This is a schematic diagram illustrating the data retrieval and display process of the AR device of the present invention;

[0024] Figure 2 This is a schematic diagram of data retrieval in an embodiment of the present invention. Detailed Implementation

[0025] The present invention will now be described in detail with reference to the accompanying drawings and specific embodiments. These embodiments are based on the technical solution of the present invention and provide detailed implementation methods and specific operating procedures. However, the scope of protection of the present invention is not limited to the following embodiments.

[0026] The reason existing AR devices need to maintain high computing power is due to high load. Specifically, during the "memory access and data movement" process, all real-world terrain data and virtual data such as augmented reality tags are loaded into memory, increasing the computational burden on the AR device. To address these issues in existing technologies, this invention performs regional division and scanning accuracy adjustment on the real-world terrain data in the early stages, avoiding the problem of high energy consumption caused by the chip memory constantly accessing the entire terrain data during software operation.

[0027] This invention provides a method for retrieving AR data across multiple regions and with varying precision. The method includes: obtaining a function selection instruction; and retrieving pre-stored corresponding AR data based on the function selection instruction. The AR data includes at least one set of real-world terrain data and linked virtual data. The real-world terrain data is obtained through the following methods:

[0028] The entire site is divided into multiple operation object areas. Each operation object area is equipped with a laser scanner with different placement point spacing, which scans and generates real-world terrain data of different precision. The operation objects within the real-world terrain are linked to corresponding virtual data.

[0029] The accuracy of the real-world terrain for each area is determined based on the requirements of different functional modules. The spacing between the laser scanner placement points is determined using the following formula:

[0030]

[0031] Among them, L GAPThe spacing between the placement points of the laser scanner, l high-p The spacing corresponding to high-precision real-scene terrain data, l low-p The spacing corresponding to low-precision real-scene terrain data, l min For the minimum measurement range of the laser scanner, l max This represents the maximum measurement range of the laser scanner.

[0032] In a specific embodiment, the laser scanner can be a ground-based three-dimensional adjustable laser scanner, whose measurement range is generally 0.5–20 m. According to the above formula, l high-p The value range is 0.5~1.0m,l low-p The value range is 1.0 to 20m. Generally, the accuracy of the real-scene terrain data is determined based on the size of the scanned object within the operating area. Considering that objective factors such as air temperature, air pressure, and humidity in the environment have a certain impact on the propagation of light in the air, there will be errors in the speed and direction of light propagation in the air when the measurement distance is long. When the surface of the scanned object in the area is a smooth, flat painted surface, or a small object (centimeter-level size) such as an instrument or switch, considering that the appearance is relatively regular and the surface of instruments and switches has many curved lines and few feature points, the spacing between the scanner placement points should be set to the minimum value of 0.5m to generate high-precision real-scene terrain data. In some functional modules, such as the navigation module, when the scanned object is a large object (meter-level size) such as a passageway or equipment layout, the spacing between the scanner placement points is set to 2m to enable AR glasses to quickly achieve visual recognition and positioning during navigation and to minimize the size of the real-scene terrain data, thus generating low-precision real-scene terrain data.

[0033] Different function selection commands execute different function modules, and different function modules call different real-world terrain data or combinations of real-world terrain data. The real-world terrain data includes high-precision real-world terrain data from different regions, low-precision real-world terrain data from different regions, and low-precision real-world terrain data for the entire region. Combinations of real-world terrain data include combinations of high-precision real-world terrain data from different regions, combinations of high and low-precision real-world terrain data from different regions, and combinations of low-precision real-world terrain data from different regions. Virtual data linked to the real-world terrain data includes augmented reality tags, etc., corresponding to the corresponding real-world terrain data, including virtual data such as augmented reality tags linked to high-precision real-world terrain data, virtual data such as augmented reality tags linked to low-precision real-world terrain data from different regions, and virtual data such as augmented reality tags linked to low-precision real-world terrain data for the entire region.

[0034] If the above methods are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0035] In another embodiment, an electronic device is provided, including one or more processors, a memory, and one or more programs stored in the memory, said one or more programs including instructions for executing the multi-region, multi-precision AR data retrieval method as described above. Specifically, the electronic device is an AR device such as AR glasses.

[0036] Example

[0037] like Figure 1 As shown, this embodiment provides a method for using AR glasses, which utilizes the aforementioned multi-region, multi-precision AR data retrieval method to achieve data retrieval and AR display, specifically including:

[0038] Step S1: According to the functional module requirements, set different placement point spacing for different areas, scan and generate real-world terrain data of different precision, and link virtual data such as augmented reality tags to the operation objects in the real-world terrain of different areas.

[0039] Step S2: After launching the software in the AR glasses, select a functional module and load the corresponding real-scene terrain data or a combination of real-scene terrain data according to the selected functional module.

[0040] Step S3: Load virtual data such as augmented reality tags based on real-world terrain data to achieve augmented reality (AR) display.

[0041] In this embodiment, the software to be developed comprises six functional modules: A, B, C, D, E, and F. Based on the requirements of each functional module, the entire site is divided into eight regions, generating a total of nine real-scene terrain data packages: high-precision region 1, high-precision region 2, high-precision region 3, low-precision region 4, high-precision region 5, low-precision region 6, low-precision region 7, low-precision region 8, and low-precision real-scene terrain data for the entire region. Corresponding augmented reality data is linked to each real-scene terrain data package. For comparison, this embodiment also generates terrain data with varying precision across the entire region. This varying-precision terrain data is generated by scanning regions 1, 2, 3, and 5 in high-precision mode during the full-region scan, while the remaining regions are scanned in low-precision mode, adding a high-to-low precision transition zone. In this embodiment, the size of each real-world terrain data and the size after linking the corresponding augmented reality data are shown in Table 1. According to the data in the table, the total size of the 9 real-world terrain data is 53.5MB, which is larger than the 48.9MB of real-world terrain data of different precision across the entire region. After linking the augmented reality data, the data of different precision across the entire region reaches 148.1MB, which far exceeds the data of the other 9 real-world terrain data.

[0042] Table 1

[0043]

[0044]

[0045] Launch the software within the AR glasses and select different functional modules. Each module loads high / low precision real-world terrain data for a specific area, a data package combining real-world terrain data of different precision from several areas, or low precision real-world terrain data for the entire site. Real-world terrain data for functional modules not selected will not be loaded.

[0046] After the software loads the real-world terrain data of the functional modules in the AR glasses, the AR glasses realize the 3D registration of interactive objects through visual recognition and positioning technology. The AR glasses load the augmented reality virtual data linked to the interactive objects in the real-world terrain data or the combination of real-world terrain data, including virtual tags, audio and video materials, virtual models, etc., to achieve the effect of combining virtual data with real objects in the AR glasses.

[0047] like Figure 2 The diagram shows the structure for accessing real-world terrain data based on AR glasses. In this embodiment, the workflow for each functional module of the software to access real-world terrain data is as follows:

[0048] First, launch the software in the AR glasses and select a specific function module from the many available.

[0049] The operation object of functional module A is the actual object in area 1. It is necessary to accurately locate the operation object in the area. Therefore, high-precision real-scene terrain data of area 1 is loaded, and virtual data such as augmented reality tags of area 1 are loaded to realize the link between terrain data and virtual data, so as to realize the AR display of the operation object in area 1.

[0050] The operation objects of functional module B are actual objects in regions 2 and 3. It is necessary to accurately locate the operation objects in the two regions. Therefore, high-precision real-scene terrain data of regions 2 and 3 are loaded, and virtual data such as augmented reality tags of regions 2 and 3 are loaded respectively to realize the independent link between the terrain data and virtual data of regions 2 and 3, and realize the AR display of operation objects in regions 2 and 3.

[0051] The process of implementing augmented reality display in functional modules C, D, E, and F is the same as above.

[0052] The combination of real-scene terrain data in the above embodiments is not limited to the two regions 2 and 3 mentioned above. High and low precision real-scene terrain data from multiple regions can be combined according to the functional modules.

[0053] In this embodiment, the software in the AR glasses compares the remaining battery power of the glasses after loading nine real-world terrain data points separately and loading all terrain data of different precision across the entire area at once, and runs all functions. The AR glasses are fully charged after each test. After multiple tests, the average remaining battery power of the AR glasses after software operation and the average number of stutters during the test are shown in Table 2. The results show that the method of this invention has an average remaining battery power of 52.4% and an average of 1 stutter, while the traditional method has an average remaining battery power of 43.8% and an average of 3 stutters. Compared with the traditional method, the method of this invention can reduce the energy consumption of AR glasses and improve stuttering performance while achieving the same software functions and operating conditions.

[0054] Table 2

[0055]

[0056] In addition to AR glasses, this embodiment also tested the software on a tablet computer. Compared to AR glasses, tablet computers have advantages in terms of memory space, chip data processing capabilities, and heat dissipation. Under the same software functions and operating conditions, the methods of this invention and traditional methods were tested, and no lag occurred during the tests. The average remaining battery power of the tablet computer after the software ran is shown in Table 3 below. The results show that the average remaining battery power of the method of this invention is 73.5%, while the average remaining battery power of the traditional method is 68.1%. The test results indicate that this invention is not only applicable to AR glasses but also to tablet computers, demonstrating a certain degree of versatility.

[0057] Table 3

[0058]

[0059] The preferred embodiments of the present invention have been described in detail above. It should be understood that those skilled in the art can make numerous modifications and variations based on the concept of the present invention without creative effort. Therefore, all technical solutions that can be obtained by those skilled in the art based on the concept of the present invention through logical analysis, reasoning, or limited experimentation on the basis of existing technology should be within the scope of protection defined by the claims.

Claims

1. A method for retrieving AR data across multiple regions and with varying precision, characterized in that: The method includes: obtaining a function selection instruction, and retrieving pre-stored corresponding AR data based on the function selection instruction; wherein, The AR data includes at least one set of real-world terrain data and linked virtual data. The real-world terrain data is obtained through the following methods: The entire site is divided into multiple operation object areas. Each operation object area is equipped with a laser scanner with different placement point spacing, which scans and generates real-world terrain data of different precision. The operation objects within the real-world terrain are linked to corresponding virtual data. The spacing between the placement points of the laser scanner is determined by the following formula: in, The spacing between the placement points of the laser scanner. The spacing corresponding to high-precision real-scene terrain data. The spacing corresponding to low-precision real-scene terrain data. This is the minimum measurement range for the laser scanner. This represents the maximum measurement range of the laser scanner.

2. The multi-region, multi-precision AR data retrieval method according to claim 1, characterized in that, The laser scanner is a ground-based three-dimensional adjustable laser scanner.

3. The multi-region, multi-precision AR data retrieval method according to claim 1, characterized in that, The real-world terrain data includes high-precision real-world terrain data for different regions, low-precision real-world terrain data for different regions, and low-precision real-world terrain data for the entire region.

4. The multi-region, multi-precision AR data retrieval method according to claim 1, characterized in that, The virtual data includes augmented reality tags.

5. The multi-region, multi-precision AR data retrieval method according to claim 1, characterized in that, Each of the said operational object areas has real-world terrain data of at least one level of precision.

6. The multi-region, multi-precision AR data retrieval method according to claim 1, characterized in that, The accuracy of the real-world terrain data is determined based on the size of the scanned object within the operation area corresponding to the function selection instruction.

7. A computer-readable storage medium, characterized in that, Includes one or more programs that are executed by one or more processors of an electronic device, said one or more programs including instructions for performing the multi-region multi-precision AR data retrieval method as described in any one of claims 1-6.

8. An electronic device, characterized in that, It includes one or more processors, memory, and one or more programs stored in the memory, said one or more programs including instructions for performing the multi-region multi-precision AR data retrieval method as described in any one of claims 1-6.

9. The electronic device according to claim 8, characterized in that, The electronic device is AR glasses.

Images