An information processing method for intelligent augmented reality device

Abstract

The present disclosure relates to an information processing method for an intelligent augmented reality device, the information processing method comprising: establishing a communication connection with a distance measuring device; using the intelligent augmented reality device to obtain an image of a target object in a real scene and first attribute information associated therewith; establishing a corresponding relationship between the second attribute information associated with the first attribute information obtained from the distance measuring device and the target object; calibrating the first attribute information based on the second attribute information to obtain calibration information. The information processing method according to the present disclosure can establish a communication connection between an augmented reality device and a distance measuring device, and then use the attribute information of the target object in the real scene to calibrate its attribute information in the virtual scene, thereby being able to use the distance measuring device to further enhance the ability to optimize composite AR images under AR augmented reality technology.

Description

Technical Field

[0001] The present disclosure relates to a technical field related to augmented reality, and more specifically to an information processing method for an intelligent augmented reality device. Background Art

[0002] In the existing technology, augmented reality (AR) technology integrates the virtual environment generated by the computer with the real environment around the user by means of optoelectronic display technology, interactive technology, multiple sensor technologies, and computer graphics and multimedia technology, so that the user can be convinced from the sensory effect that the virtual environment is a part of the real environment around him. Augmented reality has the new characteristics of combining virtuality and reality, real-time interaction, and three-dimensional registration.

[0003] In the process of using augmented reality AR devices, many applications can be made through augmented reality technology, such as improving the observability of real scenes, realizing the display of augmented reality information, navigation, etc. For example, the distance information of a predetermined path is calculated using an AR device, the length information or height information of a predetermined object (such as a bench on the roadside) is calculated using an AR device, or the size information of a parking space (such as the length and width information of two spaces) is calculated using an AR device, etc. However, the information calculated using the AR device is not necessarily accurate. If the data of the AR device is used to guide actions or perform construction operations, the errors caused by the AR calculation may cause deviations in actions or errors in construction. For example, the construction is guided by AR. However, the accuracy of AR-guided construction is not enough, which will cause certain errors (for example, the AR method indicates that the distance between points A and B may actually exceed 5 meters or be less than 5 meters, for example, it has actually advanced 5.05 meters, which will cause the accuracy to fail to meet the requirements. Summary of the invention

[0004] In order to solve the technical problems existing in the prior art, namely, the technical defect of the traditional navigation or display technology based on augmented reality AR technology being not precise enough, the inventors of the present disclosure innovatively conceived of connecting and optimizing the communication between the AR device and the ranging device based on augmented reality AR technology, and then calibrating the attribute data based on AR technology based on the attribute information obtained by the measuring device, thereby making the dimensional data in the AR augmented reality technology more accurate.

[0005] In order to achieve the above technical effects, the present disclosure proposes an information processing method for an intelligent augmented reality device, the information processing method comprising:

[0006] Establishing a communication connection with a distance measuring device;

[0007] Acquire an image of a target object in a real scene and first attribute information associated therewith using the intelligent augmented reality device;

[0008] establishing a corresponding relationship between the second attribute information associated with the first attribute information obtained from the distance measuring device and the target object;

[0009] The first attribute information is calibrated based on the second attribute information to obtain calibration information.

[0010] In this way, the information processing method according to the contents of the present disclosure can establish a communication connection between the augmented reality device and the ranging device, and then use the attribute information of the target object in the real scene to calibrate its attribute information in the virtual scene, thereby being able to use the ranging device to further enhance the ability to optimize the composite AR image under AR augmented reality technology.

[0011] In the technical solution according to the content of the present disclosure, the information processing method further includes: displaying the calibration information at the image of the target object in the intelligent augmented reality device. In this way, the calibration information is displayed at the image of the object in the augmented reality device, so that the user of the augmented reality device can obtain calibrated information of the target object of interest in the image, that is, more accurate information, thereby enhancing the user experience of the user of the augmented reality device, and also making the decision made by the user of the augmented reality device using the corresponding augmented reality device more based and accurate.

[0012] In the technical solution according to the present disclosure, the first attribute information and / or the second attribute information includes at least one of the following information: distance information, height information, coordinate information, fault information, and working status information. In this way, it is possible to provide a user of the augmented reality device with all-round accurate information, so that the decision made by the user of the augmented reality device using the corresponding augmented reality device is more based on facts and more accurate.

[0013] In the technical solution according to the present disclosure, displaying the calibration information at the target object in the smart augmented reality device includes: displaying map information associated with the first attribute information and / or the second attribute information on the smart augmented reality device. In this way, it is possible to provide a user of the augmented reality device with comprehensive and accurate information, such as map information, so that the decision made by the user of the augmented reality device using the corresponding augmented reality device is more based on facts and more accurate.

[0014] In the technical solution according to the present disclosure, the map information includes the track information of the distance measuring device. In this way, the user of the augmented reality device can see the track map of the distance measuring device in the image displayed by the augmented reality device, so that the decision made by the user of the augmented reality device using the corresponding augmented reality device is more based on facts and more accurate.

[0015] In the technical solution according to the present disclosure, displaying the map information associated with the first attribute information and / or the second attribute information on the intelligent augmented reality device includes: fusing and displaying the map information and the image of the real scene. In this way, the user of the augmented reality device can see the map information in the image displayed by the augmented reality device, so that the decision made by the user of the augmented reality device using the corresponding augmented reality device is more based on facts and more accurate.

[0016] In the technical solution according to the present disclosure, the target object includes the distance of the actual object or the road section of interest. In this way, the user of the augmented reality device can see the distance of the actual object or the road section of interest in the image displayed by the augmented reality device, so that the decision made by the user of the augmented reality device using the corresponding augmented reality device is more based on facts and more accurate.

[0017] In the technical solution according to the content of the present disclosure, the information processing method also includes: training the autonomous learning model based on the first attribute information and the second attribute information; and optimizing the projection of the target object in the scene based on the trained autonomous learning model. In this way, the information processing method according to the content of the present disclosure can introduce the autonomous learning model, so that the autonomous learning model can be trained based on the first attribute information and the second attribute information, and the projection of the target object in the scene can be optimized based on the trained autonomous learning model, so that the autonomous learning model can be trained based on multiple data, and the images including real scenes and virtual scenes based on augmented reality AR technology can be optimized based on the trained autonomous learning model to improve the display effect and display accuracy.

[0018] To sum up, in the technical solution based on the contents of the present disclosure, the information processing method based on the contents of the present disclosure can establish a communication connection between the augmented reality device and the ranging device, and then use the attribute information of the target object in the real scene to calibrate its attribute information in the virtual scene, so as to realize the ability to use the ranging device to further enhance the optimization of the composite AR image under the AR augmented reality technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The features, advantages and other aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings, in which several embodiments of the present disclosure are shown in an exemplary and non-limiting manner. In the accompanying drawings:

[0020] Figure 1 A connection diagram of an information processing method 100 for a smart augmented reality device according to an embodiment of the present disclosure is shown; and

[0021] Figure 2 A system block diagram of a hardware device for an information processing method for an intelligent augmented reality device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0022] The various exemplary embodiments of the present disclosure are described in detail below with reference to the accompanying drawings. Although the exemplary methods and devices described below include software and / or firmware executed on hardware among other components, it should be noted that these examples are merely illustrative and should not be considered restrictive. For example, it is considered that any or all hardware, software, and firmware components can be implemented exclusively in hardware, exclusively in software, or in any combination of hardware and software. Therefore, although exemplary methods and devices have been described below, it should be readily understood by those skilled in the art that the examples provided are not intended to limit the manner in which these methods and devices are implemented.

[0023] In addition, the flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions and operations of the methods and systems according to various embodiments of the present disclosure. It should be noted that the functions marked in the boxes may also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession may actually be executed substantially in parallel, or they may sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the flowchart and / or block diagram, and the combination of boxes in the flowchart and / or block diagram, may be implemented using a dedicated hardware-based system that performs a specified function or operation, or may be implemented using a combination of dedicated hardware and computer instructions.

[0024] As mentioned above, the following technical problems exist in the prior art, namely, the traditional navigation or display technology based on augmented reality AR technology has the technical defect of being not accurate enough. In order to solve the technical problems existing in the prior art, the inventors of the present disclosure innovatively thought of connecting and optimizing the AR device and the distance measuring device based on augmented reality AR technology, and then calibrating the attribute data based on AR technology based on the attribute information obtained by the measuring device, so as to make the dimension data in AR augmented reality technology more accurate. In summary, the inventors of the present disclosure innovatively proposed an information processing method for an intelligent augmented reality device, the information processing method comprising: establishing a communication connection with a distance measuring device; using the intelligent augmented reality device to obtain an image of a target object in a real scene and first attribute information associated therewith; establishing a corresponding relationship between the second attribute information associated with the first attribute information obtained from the distance measuring device and the target object; calibrating the first attribute information based on the second attribute information to obtain calibration information. In this way, the information processing method according to the content of the present disclosure can establish a communication connection between the augmented reality device and the distance measuring device, and then use the attribute information of the target object in the real scene to calibrate its attribute information in the virtual scene, so as to realize the use of the distance measuring device to further enhance the ability to optimize the composite AR image under the AR augmented reality technology. In other words, in layman's terms, the information processing method for the intelligent augmented reality device according to the content of the present disclosure will obtain the attribute information of the target object based on the augmented reality AR technology, such as obtaining the size information of a table, obtaining the distance information of a section of the road, or obtaining the running track information of the exerciser, etc., but such attribute information based on AR technology is not necessarily accurate. According to the content of the present disclosure, the inventor innovatively thinks of using the distance measuring device to obtain more accurate attribute information, and uses this attribute information to calibrate the attribute information associated with it, thereby making each attribute information in the AR image more accurate. For example, the information processing method for the intelligent augmented reality device according to the content of the present disclosure performs projection navigation through the augmented reality AR device and performs track guidance. The user of the augmented reality AR device can, for example, obtain accurate measurement data and trajectory information by using or carrying a distance measuring device to walk along the navigation track, and obtain the deviation data between the data measured by the distance measuring device and the AR device, and calibrate the attribute information of the target object in the scene based on the deviation data. In addition, preferably, the information processing method for an intelligent augmented reality device according to the content of the present disclosure can introduce an autonomous learning model, which can learn the deviation data and train the model, and compensate the deviation data output by the model for the attribute information of the corresponding target object in the image in the AR, so that the image in the AR has as small an error as possible or even no error.

[0025] The following will be combined Figure 1 and Figure 2 To describe the information processing method for intelligent augmented reality device disclosed in the present disclosure. Figure 1 FIG. 1 shows a connection diagram of an information processing method 100 for an intelligent augmented reality device according to an embodiment of the present disclosure. Figure 2 A system block diagram of a hardware device for an information processing method for an intelligent augmented reality device according to an embodiment of the present disclosure is shown.

[0026] from Figure 1It can be seen that the information processing method 100 for intelligent augmented reality devices according to the present disclosure includes at least the following four steps, namely: first, in method step 110, a communication connection 230 is established between the augmented reality device 210 and the distance measuring device 220. Here, the augmented reality device can be head-mounted glasses, a wearable device with a display, a smart watch, or even a smart projector, etc.; the distance measuring device 220 can be a distance measuring wheel, or other distance measuring devices based on laser technology such as a level, a projection meter, etc.; and the communication connection 230 can be a network connection based on, for example, a WiFi protocol, or a network connection based on, for example, RJ45, ZigBee, Bluetooth, ProfiBus, etc., as long as the communication connection between the augmented reality device 210 and the distance measuring device 220 can be achieved. Then, the information processing method 100 for the intelligent augmented reality device according to the content of the present disclosure includes method step 120, in which the image of the target object in the real scene and the first attribute information associated therewith are obtained by using the intelligent augmented reality device, that is, for example, the attribute information associated with the target object, such as length information, etc., can be obtained by using which target object is of interest. Next, the information processing method 100 for the intelligent augmented reality device according to the content of the present disclosure includes method step 130, in which the second attribute information associated with the first attribute information obtained from the distance measuring device is established with the target object. That is, for example, when the user can see the target object of interest in the real scene in the display of the augmented reality device 210 such as a smart wearable device, such as a parking space displayed in an empty parking lot, the size information can be obtained by using the augmented reality AR technology on the one hand, or by using a distance measuring device connected to the augmented reality AR device to obtain the size information, and of course the size information obtained by the distance measuring device will be more accurate. Next, the information processing method 100 for intelligent augmented reality devices according to the present disclosure includes method step 140, in which the first attribute information is calibrated based on the second attribute information to obtain calibration information. For example, the standard parking space usually has a length of 5.3 meters and a width of 2.5 meters, but the size information of the parking space measured based on AR technology is not necessarily exactly 5.3 meters * 2.5 meters. If the size measured by AR technology is 5.83 meters * 2.75 meters, the projected parking space line can be measured with the help of a distance measuring device such as a distance measuring wheel. If the actual size measured is 5.3 meters * 2.5 meters, then the size information obtained by AR technology can be calibrated with the more accurate information, so that the size information marked in the image of the AR device is more accurate.In this way, the information processing method 100 for an intelligent augmented reality device disclosed in the present disclosure can establish a communication connection 230 between the augmented reality device 210 and the ranging device 220, and then use the attribute information of the target object in the real scene to calibrate its attribute information in the virtual scene, thereby being able to use the ranging device 220 to further enhance the ability to optimize composite AR images under AR augmented reality technology.

[0027] After such a calibration process is performed several times, the subsequent display process of attribute information in the same construction scene can be more accurate. For example, after the size of the AR projection is calibrated using augmented reality technology, if other attribute information is displayed based on the calibrated attribute information, an optimized calibration can be made.

[0028] Preferably, in the technical solution according to the present disclosure, the information processing method 100 further includes ( Figure 1 (not shown): the calibration information is displayed at the image of the target object in the smart augmented reality device. In this way, the calibration information is displayed at the image of the object in the augmented reality device 210, so that the user of the augmented reality device 210 can obtain calibrated information of the target object of interest in the image, that is, more accurate information, thereby enhancing the user experience of the user of the augmented reality device 210, and also making the decision made by the user of the augmented reality device 210 using the corresponding augmented reality device 210 more based and accurate. For example, in order to wallpaper a wall, the area data of the wall, such as length and height, can be obtained through AR technology, but such information may not be accurate enough, resulting in either insufficient amount of wallpaper purchased or too much purchase and waste. However, using the technology based on the contents of the present disclosure, the calibrated data can be displayed in the AR augmented reality device 210, thereby providing more accurate information as a basis for user decision-making and avoiding unnecessary trouble.

[0029] Furthermore, in the technical solution according to the present disclosure, the first attribute information and / or the second attribute information includes at least one of the following information: distance information, height information, coordinate information, fault information, and working status information. In this way, it is possible to provide a user of the augmented reality device with all-round accurate information, so that the decision made by the user of the augmented reality device using the corresponding augmented reality device is more based on facts and more accurate.

[0030] Preferably, in the technical solution according to the content of the present disclosure, the map information includes the track information of the distance measuring device 220. In this way, the user of the augmented reality device 210 can see the track map of the distance measuring device 220 in the image displayed by it, so that the decision made by the user of the augmented reality device 210 using the corresponding augmented reality device 210 is more based on facts and more accurate. For example, a marathon running path of more than 40 kilometers needs to be delineated for marathon competitions in various cities. If only augmented reality technology is used to determine the path, such a path may be longer or shorter than the distance that the marathon competition should have. In this case, for example, a distance measuring wheel can be used to measure and display the track information in the augmented reality device 210, which can achieve both accurate measurement and visualization of the action track.

[0031] More preferably, in the technical solution according to the present disclosure, displaying the map information associated with the first attribute information and / or the second attribute information on the smart augmented reality device includes: fusing and displaying the map information and the image of the real scene. In this way, the user of the augmented reality device can see the map information in the image displayed by the augmented reality device, so that the decision made by the user of the augmented reality device using the corresponding augmented reality device is more based on facts and more accurate.

[0032] Preferably, in the technical solution according to the present disclosure, the target object includes the distance of the actual object or the road section of interest. In this way, the user of the augmented reality device can see the distance of the actual object or the road section of interest in the image displayed by the augmented reality device, so that the decision made by the user of the augmented reality device using the corresponding augmented reality device is more based on facts and more accurate.

[0033] Preferably, in the technical solution according to the present disclosure, the information processing method further includes: training the autonomous learning model 211 based on the first attribute information and the second attribute information; and optimizing the projection of the target object in the scene based on the trained autonomous learning model 211. In this way, the information processing method 100 according to the present disclosure can introduce the autonomous learning model 211, so that the autonomous learning model 211 can be trained based on the first attribute information and the second attribute information, and the projection of the target object in the scene can be optimized based on the trained autonomous learning model 211, so that the autonomous learning model 211 can be trained based on multiple data, and the images including real scenes and virtual scenes based on augmented reality AR technology can be optimized based on the trained autonomous learning model 211 to improve the display effect and display accuracy.

[0034] To sum up, in the technical solution based on the contents of the present disclosure, the information processing method based on the contents of the present disclosure can establish a communication connection between the augmented reality device and the ranging device, and then use the attribute information of the target object in the real scene to calibrate its attribute information in the virtual scene, so as to realize the ability to use the ranging device to further enhance the optimization of the composite AR image under the AR augmented reality technology.

[0035] The above is only an optional embodiment of the embodiment of the present disclosure, and is not intended to limit the embodiment of the present disclosure. For those skilled in the art, the embodiment of the present disclosure may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiment of the present disclosure shall be included in the protection scope of the embodiment of the present disclosure.

[0036] Although the embodiments of the present disclosure have been described with reference to several specific embodiments, it should be understood that the embodiments of the present disclosure are not limited to the specific embodiments disclosed. The embodiments of the present disclosure are intended to cover various modifications and equivalent arrangements included in the spirit and scope of the appended claims. The scope of the claims is consistent with the broadest interpretation, thereby including all such modifications and equivalent structures and functions.

Claims

1. An information processing method for an intelligent augmented reality device, characterized in that: The information processing method comprises: Establishing a communication connection with a distance measuring device; Acquire an image of a target object in a real scene and first attribute information associated therewith using the intelligent augmented reality device; establishing a corresponding relationship between the second attribute information associated with the first attribute information obtained from the distance measuring device and the target object; The first attribute information is calibrated based on the second attribute information to obtain calibration information.

2. The information processing method according to claim 1, characterized in that: The information processing method further includes: The calibration information is displayed at the image of the target object in the smart augmented reality device.

3. The information display method according to claim 1, characterized in that: The first attribute information and / or the second attribute information includes at least one of the following information: distance information, height information, coordinate information, fault information, and working status information.

4. The information display method according to claim 2, characterized in that: Displaying the calibration information at the target object in the intelligent augmented reality device includes: Map information associated with the first attribute information and / or the second attribute information is displayed on the smart augmented reality device.

5. The information processing method according to claim 4, characterized in that: The map information includes track information of the distance measuring device.

6. The information processing method according to claim 4, characterized in that: Displaying map information associated with the first attribute information and / or the second attribute information on the intelligent augmented reality device includes: The map information and the image of the real scene are fused and displayed.

7. The information processing method according to claim 1, characterized in that: The target object includes a real object or a distance of a road section of interest.

8. The information processing method according to claim 1, characterized in that: The information processing method further includes: Training an autonomous learning model based on the first attribute information and the second attribute information; and The projection of the target object in the scene is optimized based on the trained autonomous learning model.

Images