A method and system for augmented reality based on precise user location

Abstract

The embodiment of the present invention provides an augmented reality method and system based on the precise location of the user. By calculating the precise location of the user, the AR target object at the precise location is compared and identified with the location of the AR target object in the video screen provided by the user's smart terminal device, and an image consistent with the video screen provided by the user is matched; the user's smart terminal overlays and renders the virtual information and the video screen shot by the user's smart terminal to obtain an augmented reality video screen for user interaction. Such an augmented reality method and system can greatly reduce the workload of comparison and identification, improve the matching success rate, and stably output the augmented reality screen because it is based on the precise location of the user.

Description

Technical Field

[0001] The present invention relates to the field of image recognition technology, and in particular to a reality enhancement method and system based on the precise location of a user. Background Art

[0002] Augmented Reality (AR) is simply the application of virtual information to the real world through computer technology. The real environment and virtual objects are superimposed on the same screen or space in real time, making virtual objects and real objects exist at the same time. Augmented reality provides information that is different from what humans can perceive under normal circumstances. It not only displays information from the real world, but also displays virtual information at the same time. The two types of information complement and overlap each other.

[0003] AR technology is a new human-computer exchange technology that applies virtual information to the real world through intelligent terminal devices and visualization technology, so that the virtual information and the real world are superimposed on the same screen or space to present to the user. The general workflow of AR applications is as follows: the terminal shoots video frames through the camera, identifies the video frame data, and determines the AR target object; tracks the AR target object in the video frame to determine the position of the AR target object; obtains AR virtual information associated with the AR target object, renders the video frame, and superimposes the AR virtual information on the AR target object for display, and simultaneously displays the AR target object and AR virtual content on the terminal screen for user interaction. Existing AR application technologies have defects such as large amount of calculation, unstable video enhancement effect, and low system detection accuracy.

[0004] The existing GPS navigation technology can obtain the user's accurate position by combining the user's position in the video frames captured by other nearby electronic terminals, and then determine the user's precise position (including direction) based on the video frames captured by the user's electronic device terminal. Summary of the invention

[0005] In order to solve the above problems, the present invention provides an augmented reality method and system based on the precise location of the user.

[0006] To achieve the above objectives, the present invention discloses an augmented reality method based on the precise location of a user, comprising:

[0007] 1. The user's smart terminal device collects location information and video data;

[0008] 2. According to the location information of the user's smart terminal device, collect the location information and video picture data of other electronic devices near the location;

[0009] 3. Obtaining the accurate position of the user according to the position of the user in the video screen of the other electronic device;

[0010] 4. Compare the video image captured by the user's smart terminal device with the accurate position image collected in advance to obtain the user's accurate position (including direction);

[0011] 5. Compare and identify the AR target object at the precise position with the position of the AR target object in the video image captured by the user's smart terminal device, and match it to an image that is consistent with the video image provided by the user;

[0012] 6 The user intelligent terminal overlays and renders the virtual information corresponding to the matching consistent image and the video picture taken by the user intelligent terminal to obtain an augmented reality video picture for user interaction.

[0013] Preferably, the user is a person, an animal, a vehicle, etc.

[0014] Preferably, the AR target object at the precise position is a moving object, and the virtual information corresponding to the AR target object moves along with the displacement of the AR target object.

[0015] Preferably, the AR target object at the precise position is another user, and the other user presets his or her own virtual information for interacting with other users.

[0016] Preferably, the virtual information is an image, text, sound, etc.

[0017] Preferably, in an augmented reality method based on the precise location of a user, other electronic devices near the precise location are one electronic device or multiple electronic devices.

[0018] To achieve the above objectives, the present invention discloses an augmented reality system based on the precise location of a user, including: a cloud server, a smart terminal device, and other electronic devices in the vicinity.

[0019] The cloud server is used to collect the location information and video screen data of the user's smart terminal device; to collect the location information and video screen data of other electronic devices near the location; to calculate the precise location of the user's smart device, and compare and identify the AR target object at the precise location with the location of the AR target object in the video screen provided by the user, and match it to an image consistent with the video screen provided by the user; and to send the virtual information corresponding to the consistent matching image to the user's smart terminal;

[0020] The smart terminal device is used to collect user location information and video picture data; and is used to overlay and render the virtual information corresponding to the matching consistent image with the video picture provided by the user's smart terminal device to obtain an augmented reality video picture;

[0021] The other electronic devices at nearby locations are used to collect location information and video picture data of the electronic devices.

[0022] Preferably, the intelligent terminal device is used to collect facial data of the user, and the user sets corresponding virtual information for his or her facial data to interact with other users.

[0023] Preferably, in an augmented reality system based on the precise location of the user, the other electronic devices in the nearby location are one electronic device or multiple electronic devices.

[0024] Preferably, the intelligent terminal device includes a speaker for playing the sound signal in the virtual information.

[0025] The embodiment of the present invention provides an augmented reality method and system based on the precise location of the user. By calculating the precise location of the user, the AR target object at the precise location is compared and identified with the location of the AR target object in the video picture taken by the user's smart terminal device, and an image consistent with the video picture provided by the user is matched; the user's smart terminal overlays and renders the virtual information and the video picture taken by the user's smart terminal to obtain an augmented reality video picture for user interaction. Such an augmented reality method and system can greatly reduce the workload of comparison and identification, improve the matching success rate, and stably output the augmented reality picture because it is based on the precise location of the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 is a schematic flow chart of an augmented reality method based on a user's precise location, shown in an embodiment of the present invention;

[0027] Figure 2 It is a structural schematic diagram of an augmented reality system based on the precise location of a user shown in an embodiment of the present invention. Specific implementation methods

[0028] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0029] It should be noted that in the following embodiment of the present invention, there are two other electronic devices near the precise location. This is only for the purpose of simply illustrating the method and is not intended to limit the present invention. The other electronic devices at the nearby location may be one or more. For the sake of brevity, the embodiment of the present invention will not be illustrated one by one.

[0030] Please refer to Figure 1 , Figure 2 , Figure 1 is a flow chart of an augmented reality method based on a user's precise location, shown in an embodiment of the present invention. Figure 2 is a schematic diagram of a structure of an augmented reality system based on a user's precise location shown in an embodiment of the present invention. Figure 1 , Figure 2 As shown, the following steps are included:

[0031] S1, cloud server A collects location information provided by GPS module B1 of user smart terminal device B, and cloud server A collects video image data provided by camera module B2 of user smart terminal device B;

[0032] S2, the cloud server A collects the location information and video picture data of other electronic devices C and D near the location, and obtains the accurate location of the user's smart terminal device B according to the user's location in the video frame of the other electronic devices C and D;

[0033] S3, the cloud server A compares the collected video image of the user's smart terminal device B with the accurate location image collected in advance by the system to obtain the precise location of the user's smart terminal device B;

[0034] S4, the cloud server A compares and identifies the AR target object at the precise position with the position of the AR target object in the video picture provided by the user, and matches it to an image consistent with the video picture provided by the user's smart terminal device B;

[0035] S5, the cloud server A sends the virtual information corresponding to the matching consistent image to the user smart terminal device B;

[0036] S6. The rendering module B3 of the user intelligent terminal B overlays and renders the virtual information and the video picture taken by the user intelligent terminal to obtain an augmented reality video picture for user interaction.

[0037] The device embodiments described above are merely illustrative, wherein the modules described as separate components may or may not be physically separated, and some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0038] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them. Under the concept of the present invention, the technical features in the above embodiments can also be combined, the steps can be implemented in any order, and there are many other changes in different aspects of the present invention as described above, which are not provided in detail for the sake of simplicity. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions described in the above embodiments can still be modified, or some of the technical features can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An augmented reality method based on a user's precise location, comprising: User smart terminal devices collect location information and video picture data; According to the location information of the user's intelligent terminal device, the location information and video picture data of other electronic devices near the location are collected; Determining the accurate location of the user based on the user's location in the video screen of the other electronic device; Compare the video image captured by the user's smart terminal device with the accurate position image collected in advance to obtain the user's precise position and orientation; The AR target object at the precise position and orientation is compared and identified with the position of the AR target object in the video image captured by the user's smart terminal device, and an image consistent with the video image provided by the user is matched; The user intelligent terminal overlays and renders the virtual information corresponding to the matching consistent image and the video picture shot by the user intelligent terminal to obtain an augmented reality video picture for user interaction.

2. The method according to claim 1, wherein: The user is a person, an animal, a vehicle, or the like.

3. The method according to claim 1, wherein: The AR target object at the precise position is a moving object, and the virtual information corresponding to the AR target object moves along with the displacement of the AR target object.

4. The method according to claim 1, wherein: The AR target object at the precise position is another user, and the other user presets his own virtual information for interacting with other users.

5. The method according to claim 1, wherein: The virtual information includes images, texts, sounds, etc.

6. The method according to claim 1, wherein: The other electronic devices near the location are one electronic device or multiple electronic devices.

7. An augmented reality system based on a user's precise location, comprising: Cloud servers, smart terminal devices, and other electronic devices in nearby locations; The cloud server is used to collect the location information and video screen data of the user's smart terminal device; and is used to collect the location information and video screen data of other electronic devices in the nearby location to obtain the accurate location of the user based on the user's location in the video screen of the other electronic devices; Used to calculate the precise position and orientation of the user's smart device by comparing the video image captured by the user's smart terminal device with the pre-collected accurate position image; used to compare and identify the AR target object at the precise position and orientation with the position of the AR target object in the video image captured by the user's smart terminal device, and match an image consistent with the video image provided by the user; used to send virtual information corresponding to the consistent matching image to the user's smart terminal; The user intelligent terminal device is used to collect user location information and video picture data; Used to overlay and render the virtual information with the video picture taken by the user's smart terminal device to obtain an augmented reality video picture; The other electronic devices at the nearby locations are used to collect the location information and video picture data of the electronic device.

8. The system according to claim 7, wherein the intelligent terminal device is used to collect facial data of the user, and the user sets corresponding virtual information for his or her facial data to interact with other users.

9. The system according to claim 7, wherein: The other electronic devices at the nearby location may be one electronic device or multiple electronic devices.

10. The system according to claim 7, wherein: The intelligent terminal device includes a speaker for playing the sound signal in the virtual information.

Images