A method and system for establishing an augmented reality anchor

Abstract

The application provides an augmented reality anchor point establishment system, comprising: an anchor point device, configured to continuously send a first space information packet and a second space information packet, and send the first space information packet and the second space information packet through a first communication technology and a second communication technology; the first space information packet and the second space information packet comprise an anchor point serial number and angle information of the anchor point device; an augmented reality (AR) device, configured to receive the first space information packet and the second space information packet, and obtain a position, a horizontal distance and a vertical height of the AR device relative to the anchor point device according to the first space information packet and the second space information packet. The application also provides an augmented reality anchor point establishment method. The augmented reality anchor point establishment system provided by the application can operate without a space model when being established, and can operate normally without worrying about the space model being damaged to cause the augmented reality object to be unable to operate normally.

Description

TECHNICAL FIELD

[0001] The present application relates to augmented reality technology, in particular to a method and system for establishing an anchor point in augmented reality. BACKGROUND

[0002] In the prior art, the establishment of an anchor point in augmented reality requires a complete scan of a physical anchor point to obtain anchor point features to establish spatial information (i.e. a model) of the physical anchor point, and then bind a virtual object to the anchor point so that the virtual object can be completely presented on the anchor point. However, the image obtained during scanning is easily affected by factors such as angle, direction, light, surrounding environment, distance, and algorithm, resulting in uncertainty in the calculation results of the anchor point. SUMMARY

[0003] Therefore, the present application provides a method for establishing an anchor point in augmented reality, which uses an anchor point device to actively broadcast spatial information. The anchor point device sends spatial information packets through at least two communication technologies, and an augmented reality device calculates the distance based on the time difference between the spatial information packets received through the two communication technologies. Since the anchor point device of the present application actively provides spatial information, it is not necessary to complete a scan of a physical anchor point before establishing a virtual object. In addition, the anchor point device of the present application is portable, and thus the virtual object can still operate even if the original spatial model is destroyed.

[0004] The present application provides a method for establishing an anchor point in augmented reality, which includes the following steps: an anchor point device continuously sends first spatial information packets and second spatial information packets, wherein the anchor point device further includes a transmitter, which can include at least two transmitters for sending two types of communication technologies. The first spatial information packets and the second spatial information packets are sent through a first communication technology and a second communication technology, and both the first spatial information packets and the second spatial information packets include an anchor point number and angle information of the anchor point device. An augmented reality (AR) device receives the first spatial information packets and the second spatial information packets, wherein the AR device further includes a processing unit. The processing unit obtains the spatial relationship between the AR device and the anchor point device based on the first spatial information packets and the second spatial information packets, wherein the spatial relationship includes the position, horizontal distance, and vertical height of the AR device relative to the anchor point device.

[0005] The application also provides an augmented reality anchor point establishment system, comprising: an anchor point device for continuously sending a first space information package and a second space information package, wherein the anchor point device comprises a transmitter, and can comprise at least two transmitters for sending two communication technologies, and the first space information package and the second space information package are sent through a first communication technology and a second communication technology; the first space information package and the second space information package both comprise an anchor point serial number and angle information of the anchor point device; an augmented reality (AR) device for receiving the first space information package and the second space information package, wherein the AR device further comprises a processing unit; through the processing unit, a spatial relationship between the AR device and the anchor point device is obtained according to the first space information package and the second space information package, wherein the spatial relationship comprises a position, a horizontal distance and a vertical height of the AR device relative to the anchor point device.

[0006] The application will be described in detail below with reference to the accompanying drawings and specific embodiments, but is not limited to the application. BRIEF DESCRIPTION OF DRAWINGS

[0007] Figure 1 A schematic diagram of the augmented reality anchor point establishment system according to the application is shown.

[0008] Figure 2 A flowchart of the augmented reality anchor point establishment method according to the application is shown.

[0009] Figure 3 A schematic diagram of the space information package transmission according to the application is shown.

[0010] Figure 4 A schematic diagram of the application scenario of the augmented reality anchor point establishment system according to the application is shown.

[0011] Figure 5 A top view of the anchor point device according to the application is shown.

[0012] Figure 6 A side view of the anchor point device according to the application is shown.

[0013] Figure 7 A schematic diagram of the AR device according to the application is shown.

[0014] Explanation of main element symbols

[0015]

[0016] The following specific embodiments will further illustrate the application in combination with the above-mentioned drawings. DETAILED DESCRIPTION

[0017] To facilitate understanding and implementation of the present invention by those skilled in the art, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.

[0018] Figure 1 This diagram illustrates the augmented reality (AR) anchor point establishment system according to an embodiment of the present invention. The system includes an anchor point device 110 and an augmented reality (AR) device 120. Figure 1 As shown, the anchor device 110 sends a first spatial information packet 111 and a second spatial information packet 112 every time interval T. The anchor device 110 further includes a transmitter. Figure 1 (Not shown), the first spatial information packet 111 and the second spatial information packet 112 are sent through the first communication technology and the second communication technology. Both the first spatial information packet 111 and the second spatial information packet 112 contain the anchor point number of the anchor point device 110 and the angle information of the transmitter. The first communication technology and the second communication technology can be any combination of two of the following: radio frequency signal, ultrasound, infrared, and laser.

[0019] In one embodiment, the transmitter further includes a plurality of sub-transmitters for transmitting a first spatial information packet and a second spatial information packet respectively via a first communication technology and a second communication technology.

[0020] The augmented reality (AR) device 120 receives a first spatial information packet 111 and a second spatial information packet 112. The AR device 120 further includes a processing unit. Figure 1 (Not shown), through the processing unit, the spatial relationship between the AR device 120 and the anchor device 110 is obtained according to the contents of the first spatial information packet 111 and the second spatial information packet 112. The spatial relationship includes the orientation, horizontal distance and vertical height of the AR device 120 relative to the anchor device 110.

[0021] Figure 2 This diagram shows a flowchart of the method for establishing augmented reality anchor points according to an embodiment of the present invention.

[0022] In step S101, the anchor device sends a first spatial information packet through a first communication technology and a second spatial information packet through a second communication technology. Both the first and second spatial information packets contain angle information, which includes the azimuth angle of the transmitter in the horizontal position of the anchor device and the angle between the transmitter and the horizontal plane.

[0023] In step S102, the AR device receives a first spatial information packet sent by the anchor device through a first communication technology.

[0024] Step S103, the AR device receives the second spatial information package sent by the anchor device through the second communication technology.

[0025] Step S104, the processing unit in the AR device acquires the spatial relationship between the AR device and the anchor device according to the first spatial information package and the second spatial information package, wherein the spatial relationship includes the orientation, horizontal distance and vertical height of the AR device relative to the anchor device. The processing unit determines the orientation of the AR device relative to the anchor device according to the azimuth angle in the angle information.

[0026] Step S105, the AR device calculates the distance between the AR device and the anchor device. Since the transmission speed of the first communication technology and the second communication technology is known, the AR device can calculate the distance between the AR device and the anchor device according to the transmission speed of the first communication technology, the transmission speed of the second communication technology, the time of receiving the first spatial information package and the time of receiving the second spatial information package. For example, the anchor device sends the first spatial information package through radio frequency (RF) and the second spatial information package through ultrasound at the same time. The AR device receives the first spatial information package sent by the RF at T0 time and receives the second spatial information package sent by the ultrasound at T1 time. Since the propagation speed of the RF is approximately equal to the speed of light and the propagation speed of the ultrasound is slower, T1 > T0. The time difference between the time of receiving the first spatial information package and the time of receiving the second spatial information package is T1-T0. According to the formula distance = speed x time, the known transmission speed of the first communication technology, the known transmission speed of the second communication technology and the above-mentioned time difference, the distance between the AR device and the anchor device can be calculated.

[0027] Step S106, the AR device calculates the horizontal distance and the vertical height between the AR device and the anchor device according to the distance calculated in step S105 and the angle between the transmitter and the horizontal plane in the first spatial information package.

[0028] Figure 3 The space information package transmission schematic diagram of the embodiment of the present application is shown. As shown in FIG. 1, the anchor device 1 sends the first spatial information package through the first communication technology and the second spatial information package through the second communication technology. The AR device 2 receives the first spatial information package and the second spatial information package. The anchor device 1 and the AR device 2 are in the same space. The anchor device 1 and the AR device 2 are in the same space. Figure 3As shown, the anchor device 310 transmits the first spatial information package and the second spatial information package simultaneously at an interval time T through the first communication technology 330 and the second communication technology 340. In the embodiment, the first communication technology 330 is radio frequency (RF) and the second communication technology 340 is ultrasound, but the two communication technologies are not limited to the above. Since the transmission speed of RF is 3x108m / s and the transmission speed of ultrasound in air is about 343m / s, the AR device 302 receives the first spatial information package transmitted by the anchor device 301 through RF at time T0, and receives the second spatial information package transmitted by the anchor device 301 through ultrasound at time T1, where T1>T0. According to the time difference T1-T0 and the known transmission speeds of the first communication technology 330 and the second communication technology 340, the distance between the AR device 302 and the anchor device 301 can be calculated.

[0029] Figure 4 A schematic diagram of an application scenario of an augmented reality anchor establishment system according to an embodiment of the present application is shown. As shown, Figure 4 The anchor device 410 is arranged on the ground and periodically transmits spatial information packages through the first communication technology and the second communication technology through the transmitters arranged at various angles. When the user wearing the AR device 420 enters the application range of the anchor device 410, the AR device 420 receives the spatial information package transmitted by the transmitter 411 of the anchor device 410. The angle 430 between the transmitter 411 and the horizontal plane. Since the anchor device 410 transmits the spatial information package through the two communication technologies simultaneously, the spatial information package contains the azimuth of the transmitter 411 and the angle 430 between the transmitter 411 and the horizontal plane. Therefore, the AR device 420 can calculate the distance 440 between the anchor device 410 and the AR device 420 according to the time difference between the spatial information packages transmitted by the first communication technology and the second communication technology and the angle 430 between the transmitter 411 and the horizontal plane. After obtaining the distance 440 between the anchor device 410 and the AR device 420, the horizontal distance 450 and the vertical height 460 between the anchor device 410 and the AR device 420 can be calculated according to the angle 430 between the transmitter 411 and the horizontal plane. The spatial information package contains the anchor sequence number and the angle information. The AR device 420 determines the anchor device from which the spatial information package is received according to the anchor sequence number, and the angle information of the spatial information package contains the azimuth of the transmitter 411 of the anchor device 410 and the angle 430 between the transmitter 411 and the horizontal plane.

[0030] Figure 5 A top view of the anchor device 500 according to an embodiment of the present application is shown. As shown, Figure 5As shown, the anchor device 500 uses directional communication technology and multiple transmitters set at different azimuth angles within the anchor device 500 as a criterion for determining the relative orientation between the AR device and the anchor device 500. Based on the characteristics of directional communication technology, the AR device will only receive spatial information packets from a specific direction. Figure 5 For example, when the AR device is located at an azimuth angle of 180 degrees relative to the anchor device 500, it will only receive the signal from the fourth transmitter 540. The spatial information packet emitted by the fourth transmitter 540 contains angle information indicating that it is located at an azimuth angle of 180 degrees relative to the anchor device and has an angle of 0 degrees with the horizontal plane, thereby determining the relative orientation of the AR device and the anchor device 500. However, due to the directional limitations of directional communication technology, the azimuth angles covered by a single set of transmitters may be limited. Therefore, the anchor device 500 needs to be equipped with multiple sets of transmitters to effectively cover all angles within the entire spatial range. Figure 5 Taking a 60-degree azimuth range covered by each transmitter as an example, at least six transmitters are needed to cover all directions. This includes a first transmitter 510 pointing to a 0-degree azimuth, covering a range of 330 to 30 degrees; a second transmitter 520 pointing to a 60-degree azimuth, covering a range of 30 to 90 degrees; a third transmitter 530 pointing to a 120-degree azimuth, covering a range of 90 to 150 degrees; and a fourth transmitter 540 pointing to a 180-degree azimuth, covering a range of 150 to 210 degrees. The range covered by the fifth transmitter 550 pointing to the 240-degree azimuth angle is 210 degrees to 270 degrees, and the range covered by the sixth transmitter 560 pointing to the 300-degree azimuth angle is 270 degrees to 330 degrees. Therefore, no matter where the AR device is located on the anchor device 500, the AR device can receive the spatial information packets sent by the anchor device 500. Then, based on the angle information in the spatial information packets, it can determine which transmitter sent the received information, thereby determining the location of the AR device on the anchor device 500.

[0031] Figure 6 This shows a perspective side view of the anchor point device 600 described in an embodiment of the present invention. In different embodiments, the shape of the anchor point device 600 can be selected according to the required display angle for the application environment. The anchor point device 600 can be hemispherical, spherical, etc., but is not limited thereto, and can be determined according to the actual application environment. Here, a spherical anchor point device 600 is used as an example for illustration. Figure 6As shown, the anchor point device 600 is equipped with a plurality of transmitters with different azimuth angles, wherein the first transmitter 610 points to a 0-degree azimuth angle and makes a 0-degree angle with the horizontal plane, the second transmitter 620 points to a 60-degree azimuth angle and makes a 0-degree angle with the horizontal plane, the third transmitter 630 points to a 60-degree azimuth angle and makes a 60-degree angle with the horizontal plane, the fourth transmitter 640 points to a 0-degree azimuth angle and makes a 90-degree angle with the horizontal plane, the fifth transmitter 650 points to a 300-degree azimuth angle and makes a 60-degree angle with the horizontal plane, the sixth transmitter 660 points to a 300-degree azimuth angle and makes a 0-degree angle with the horizontal plane, the seventh transmitter 670 points to a 300-degree azimuth angle and makes a -60-degree angle with the horizontal plane, the eighth transmitter 680 points to a 0-degree azimuth angle and makes a -90-degree angle with the horizontal plane, and the ninth transmitter 690 points to a 60-degree azimuth angle and makes a -60-degree angle with the horizontal plane.

[0032] Figure 7 This diagram shows an AR device according to an embodiment of the present invention. Figure 7 As shown, since this case uses directional communication technology to identify the relative position between the anchor device and the AR device 700, multiple receivers are installed at multiple locations on the AR device 700, such as... Figure 7 The white dot in the image indicates the location where receiver 710 is set; however, Figure 7 The configuration shown is for illustrative purposes only, illustrating that the AR device 700 needs to have receivers 710 placed in various locations so that the AR device 700 can receive spatial information packets from various directions. The AR device may be any type of device: head-mounted device, smart glasses, smartphone, tablet computer, etc.

[0033] In summary, this invention meets the requirements for an invention patent, and therefore a patent application is filed in accordance with the law. However, the above description is only a preferred embodiment of the invention, and the scope of the invention is not limited to the described embodiments. All equivalent modifications or variations made by those skilled in the art in accordance with the spirit of the invention should be covered within the scope of the following patent application.

Claims

1. A method for establishing an augmented reality anchor, the method comprising: The method comprises the following steps: The anchor device continuously transmits the first spatial information packet and the second spatial information packet, wherein the anchor device further comprises a transmitter, which transmits the first spatial information packet and the second spatial information packet through the first communication technology and the second communication technology, and the first spatial information packet and the second spatial information packet both comprise an anchor sequence number and angle information of the anchor device; The AR device receives the first spatial information packet and the second spatial information packet through an augmented reality (AR) device, wherein the AR device further comprises a processing unit; The processing unit obtains a spatial relationship between the AR device and the anchor device according to the first spatial information packet and the second spatial information packet, wherein the spatial relationship comprises a position, a horizontal distance, and a vertical height of the AR device relative to the anchor device; The processing unit calculates a distance between the AR device and the anchor device according to a transmission speed of the first communication technology, a transmission speed of the second communication technology, a time of receiving the first spatial information packet, and a time of receiving the second spatial information packet, and calculates the horizontal distance and the vertical height of the AR device relative to the anchor device according to the distance and the angle information.

2. The augmented reality anchor establishment method of claim 1, wherein The first communication technology and the second communication technology are any two combinations of wireless radio frequency signals, ultrasonic waves, infrared rays, and lasers.

3. The augmented reality anchor establishment method of claim 1, wherein The angle information comprises an azimuth angle of the transmitter in a horizontal position and an included angle between the transmitter and a horizontal plane.

4. An augmented reality anchor point establishment system, comprising: An anchor device is configured to continuously transmit a first spatial information packet and a second spatial information packet, wherein The anchor device comprises a transmitter configured to transmit the first spatial information packet and the second spatial information packet through a first communication technology and a second communication technology; The first spatial information packet and the second spatial information packet both comprise an anchor sequence number and angle information of the anchor device; An augmented reality (AR) device is configured to receive the first spatial information packet and the second spatial information packet, wherein the AR device further comprises a processing unit; The processing unit obtains a spatial relationship between the AR device and the anchor device according to the first spatial information packet and the second spatial information packet, wherein the spatial relationship comprises a position, a horizontal distance, and a vertical height of the AR device relative to the anchor device; ​ The processing unit calculates the distance between the AR device and the anchor device according to the transmission speed of the first communication technology, the transmission speed of the second communication technology, the time of receiving the first spatial information packet, and the time of receiving the second spatial information packet, and calculates the horizontal distance and the vertical height of the AR device relative to the anchor device according to the distance and the angle information.

5. The augmented reality anchor point establishment system of claim 4, wherein: The first communication technology and the second communication technology are any two combinations of wireless radio frequency signals, ultrasonic waves, infrared rays, and lasers.

6. The augmented reality anchor point establishment system of claim 4, wherein: The angle information includes the azimuth angle of the horizontal position of the transmitter and the angle between the transmitter and the horizontal plane.

Images