A reverse vehicle search method based on AR spatial positioning

By combining AR SDK and GPS modules on mobile terminals, the integration of virtual labeling information and real environment is achieved, and the problem of the inability to use and high construction costs in existing technology in large outdoor parking lots is solved, providing an intuitive and real-time reverse Car search navigation solution.

CN115547095BActive Publication Date: 2024-11-15SHAANXI CONSTR ENG INTELLIGENT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202211137486.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-19
Publication Date
2024-11-15
Estimated Expiration
2042-09-19

AI Technical Summary

Technical Problem

The existing reverse car search technology cannot be used in large outdoor parking lots, and the construction cost is high, and real-time dynamic navigation cannot be achieved. Car owners need to remember the car search route.

Method used

Using the reverse vehicle search method based on AR spatial positioning, the reverse vehicle search system is installed on the mobile terminal, and the virtual labeling information is integrated with the real environment screen through the AR SDK module, and the mobile terminal's camera and GPS module are used to perform vehicle parking positions. Identify and locate, and realize real-time navigation.

Benefits of technology

There is no need to build a local area network and three-dimensional digital scene model, which realizes intuitive car search navigation in any scenario, improves direction recognition, reduces car search errors, and is suitable for indoor and outdoor parking lots.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure HDA0003852716780000011
    Figure HDA0003852716780000011
  • Figure HDA0003852716780000012
    Figure HDA0003852716780000012
  • Figure HDA0003852716780000021
    Figure HDA0003852716780000021
Patent Text Reader

Abstract

The present invention belongs to the technical field of reverse vehicle search, and relates to a reverse vehicle search method based on AR spatial positioning; the method comprises the following steps: an ARSDK module calls a camera of a mobile terminal, the ARSDK module scans a marker through the camera, and loads virtual annotation information of a parking position above the marker, the virtual annotation information is superimposed on a real environment picture, and displayed on a screen; a reverse vehicle search system calls a GPS module; position information is obtained from a GPS satellite as vehicle parking position information; the reverse vehicle search system obtains real-time position information of a mobile terminal in real time; when searching for a vehicle in reverse, the ARSDK module calls a camera, displays a real environment picture and virtual annotation information on a screen of a mobile terminal, and a pointing arrow appears in the real environment picture; the vehicle is searched for according to the pointing arrow on the screen of the mobile terminal; the virtual annotation information is integrated with the real environment picture by means of the reverse vehicle search system, so that the reverse vehicle search process is more intuitive and is not restricted by parking scenes.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the technical field of reverse vehicle search, and relates to a reverse vehicle search method based on AR space positioning. Background Art

[0002] There are currently two main ways to find a car in reverse, namely, reverse parking search machines and reverse car search navigation based on Bluetooth LAN. The reverse parking search machine displays the current location of the owner and the location of the vehicle parked on the query machine screen by entering the license plate number, thereby planning a route for the owner to find the vehicle. The reverse car search method based on Bluetooth LAN is that the owner enters the license plate number into the reverse car search APP or applet on the mobile phone, and the license plate recognition camera sends the location of the vehicle parked to the owner's mobile phone through the Bluetooth LAN to guide the owner to find the car.

[0003] Both of the above two reverse car search methods require a separate Bluetooth LAN to be built in the parking garage and a license plate recognition camera to be installed above the parking space, so the construction cost is relatively high. For example, in large outdoor parking lots, these two reverse car search methods cannot be used. Moreover, the parking space reverse query machine cannot realize real-time dynamic navigation, but can only display the parking location of the vehicle. The owner must force himself to remember the route to find the car. Although reverse car search based on Bluetooth LAN can realize real-time dynamic navigation, it is necessary to build a three-dimensional digital scene model of the entire parking garage. Summary of the invention

[0004] The technical problem solved by the present invention is to provide a reverse vehicle search method based on AR spatial positioning, mount the reverse vehicle search system on a mobile terminal, and use the AR SDK module in the reverse vehicle search system to integrate virtual annotation information with elements of the real environment picture, so that the reverse vehicle search process is more intuitive and its use is not restricted by the scene.

[0005] The present invention is achieved through the following technical solutions:

[0006] A reverse vehicle search method based on AR spatial positioning comprises the following steps:

[0007] S1. Start the reverse vehicle search system in the mobile terminal, control the AR SDK module through the UI module of the reverse vehicle search system to call the camera of the mobile terminal, and display the camera image at the parking position of the vehicle on the screen of the mobile terminal;

[0008] S2. Select a landmark in the camera image at the parking location of the vehicle, and the AR SDK module scans the landmark through the camera, and compares and identifies the landmark image in the camera image with the landmark image in the database of the AR SDK module;

[0009] S3. After successful scanning and recognition, the AR SDK module immediately loads virtual annotation information of the parking position above the marker in the real environment screen, and stores the virtual annotation information in the database of the AR SDK module;

[0010] Virtual annotation information is superimposed on the real environment image and displayed in real time on the screen of the mobile terminal;

[0011] S4. After the virtual annotation information is loaded successfully, the reverse vehicle search system calls the GPS module on the mobile terminal; the GPS module obtains the location information of the mobile terminal from the GPS satellite through the network communication module, and stores it as the vehicle parking location information in the database module in the reverse vehicle search system, thereby realizing the spatial positioning of the vehicle parking location;

[0012] S5. After leaving the vehicle, the reverse vehicle search system calls the GPS module, obtains the real-time location information of the mobile terminal from the GPS satellite through the network communication module, and stores the real-time location information in the database module in the reverse vehicle search system;

[0013] S6. When searching for a vehicle in reverse, the reverse vehicle search system of the mobile terminal is turned on. The reverse vehicle search system calls the virtual annotation information in the AR SDK module, and controls the AR SDK module to call the mobile terminal camera to obtain the real environment picture through the UI module of the reverse vehicle search system. The real environment picture and the virtual annotation information are superimposed and displayed on the screen of the mobile terminal. At the same time, a pointing arrow appears in the real environment picture;

[0014] If the marking information of the parking position of the vehicle is not displayed on the screen of the mobile terminal, rotate the mobile terminal in the direction of the arrow so that the marking information of the parking position of the vehicle appears on the screen of the mobile terminal;

[0015] The position calculation module in the database module feeds back the distance between the owner and the parking position of the vehicle based on the current position information and the parking position information of the vehicle; and displays the real-time distance between the owner and the parking position of the vehicle on the screen of the mobile terminal;

[0016] S7. Search for a vehicle according to the pointing arrow on the screen of the mobile terminal.

[0017] Furthermore, in S2, the marker is an artificial marker, and the artificial marker is a license plate or the car itself.

[0018] Furthermore, in S2, the AR SDK module collects the license plate or the picture of the car itself in advance and stores it in the AR SDK module database.

[0019] Furthermore, in S1, the AR SDK module is an AR navigation SDK module, that is, an augmented reality module; the AR SDK module is used to integrate virtual annotation information with elements of the real environment.

[0020] Furthermore, in S1, the mobile terminal is based on the Android operating system or the iOS operating system;

[0021] When the mobile terminal is based on the Android operating system, the AR SDK module uses the Vuforia SDK module; when the mobile terminal is based on the iOS operating system, the AR SDK module uses the ARKit SDK module.

[0022] Furthermore, in S3, virtual annotation information is pre-set in the AR SDK module, and the virtual annotation information is stored in the AR SDK module database;

[0023] Virtual annotation information is text, picture, video or three-dimensional digital model.

[0024] Compared with the prior art, the present invention has the following beneficial technical effects:

[0025] 1. The reverse car search system is mounted on a mobile terminal, and the reverse car search system is used to search for the car owner in reverse, without the need to build a local area network in the garage, or to deploy cameras in the parking spaces, or to build a three-dimensional digital scene model of the parking garage; the virtual annotation information is integrated with the elements of the real environment picture through the AR SDK module in the reverse car search system, and the AR SDK module is combined with the camera of the mobile terminal to scan and identify the markers and load the virtual annotation information. The reverse car search system is also combined with the GPS module to locate the parking position of the vehicle; after the owner leaves the vehicle, the reverse car search system can obtain the real-time location information of the mobile terminal through the GPS module in real time, and can also feedback the distance between the owner and the parking position of the vehicle through the position calculation module in the database module; when searching for the car, the camera of the mobile terminal can be called by the AR SDK module to superimpose the real environment picture and the virtual annotation information on the screen of the mobile terminal, so as to facilitate reverse car search; according to the technical solution of the present invention, the car is searched, and the virtual annotation information is integrated with the elements of the real environment picture by means of the AR SDK module in the reverse car search system, so that the reverse car search process is more intuitive and is not limited by the parking scene. Whether it is an indoor parking garage or an outdoor parking lot, any place where parking can be used can be used.

[0026] 2. The present invention utilizes the feature of integrating virtual annotation information with elements of the real environment in the AR SDK module to mark the location information of the vehicle as virtual annotation information, and superimposes it with the real environment picture to display it on the mobile terminal screen; this method of finding a vehicle is more intuitive and has a higher degree of direction recognition than other methods, especially in large outdoor parking lots. In the absence of navigation guidance for route planning, it is easier and more convenient to find the parking location of the vehicle without causing the owner to take a detour or take a detour. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 The image of the license plate scanned and recognized in Example 1;

[0028] Figure 2 The image of the license plate loaded with virtual annotation information in Example 1;

[0029] Figure 3 This is a picture in which the virtual annotation information does not appear on the screen of the mobile terminal when searching for a vehicle in reverse in Example 1;

[0030] Figure 4 This is a picture showing that the real-time distance between the vehicle owner and the parking location of the vehicle in Example 1 is 50 meters. DETAILED DESCRIPTION

[0031] The present invention is further described in detail below in conjunction with the accompanying drawings, which are intended to explain the present invention rather than to limit it.

[0032] The present invention discloses a reverse vehicle search method based on AR spatial positioning, comprising the following steps:

[0033] S1. Start the reverse vehicle search system in the mobile terminal, control the AR SDK module through the UI module of the reverse vehicle search system to call the camera of the mobile terminal, and display the camera image at the parking position of the vehicle on the screen of the mobile terminal;

[0034] Specifically, the AR SDK module is an AR navigation SDK module, i.e., an augmented reality module; the AR SDK module is used to integrate virtual annotation information with elements of the real environment;

[0035] The mobile terminal is based on the Android operating system or the iOS operating system. When the mobile terminal is based on the Android operating system, the AR SDK module uses the Vuforia SDK module; when the mobile terminal is based on the iOS operating system, the AR SDK module uses the ARKit SDK module.

[0036] S2. Select a landmark in the camera image at the parking location of the vehicle, and the AR SDK module scans the landmark through the camera, and compares and identifies the landmark image in the camera image with the landmark image in the database of the AR SDK module;

[0037] Specifically, the marker is an artificial marker, and the artificial marker is a license plate or the car itself; the AR SDK module collects the license plate or the car itself in advance and stores it in the AR SDK module database;

[0038] S3. After successful scanning and recognition, the AR SDK module immediately loads virtual annotation information of the parking position above the marker in the real environment screen, and stores the virtual annotation information in the database of the AR SDK module;

[0039] Virtual annotation information is superimposed on the real environment image and displayed in real time on the screen of the mobile terminal;

[0040] Specifically, virtual annotation information is pre-set in the AR SDK module, and the virtual annotation information is stored in the AR SDK module database; the virtual annotation information is text, picture, video or three-dimensional digital model;

[0041] S4. After the virtual annotation information is loaded successfully, the reverse vehicle search system calls the GPS module on the mobile terminal; the GPS module obtains the location information of the mobile terminal from the GPS satellite through the network communication module, and stores it as the vehicle parking location information in the database module in the reverse vehicle search system, thereby realizing the spatial positioning of the vehicle parking location;

[0042] S5. After leaving the vehicle, the reverse vehicle search system calls the GPS module, obtains the real-time location information of the mobile terminal from the GPS satellite through the network communication module, and stores the real-time location information in the database module in the reverse vehicle search system;

[0043] S6. When searching for a vehicle in reverse, the reverse vehicle search system of the mobile terminal is turned on. The reverse vehicle search system calls the virtual annotation information in the AR SDK module, and controls the AR SDK module to call the mobile terminal camera to obtain the real environment picture through the UI module of the reverse vehicle search system. The real environment picture and the virtual annotation information are superimposed and displayed on the screen of the mobile terminal. At the same time, a pointing arrow appears in the real environment picture;

[0044] If the marking information of the parking position of the vehicle is not displayed on the screen of the mobile terminal, rotate the mobile terminal in the direction of the arrow so that the marking information of the parking position of the vehicle appears on the screen of the mobile terminal;

[0045] The position calculation module in the database module feeds back the distance between the owner and the parking position of the vehicle based on the current position information and the parking position information of the vehicle; and displays the real-time distance between the owner and the parking position of the vehicle on the screen of the mobile terminal;

[0046] S7. Search for a vehicle according to the pointing arrow on the screen of the mobile terminal.

[0047] Specific examples are given below.

[0048] Example 1

[0049] The present invention was first tested in an underground parking garage in Shaanxi, as follows:

[0050] The reverse car search system is installed in a mobile terminal based on the iOS operating system; after the owner parks the vehicle in the parking space, the reverse car search system on the mobile terminal is turned on, and the following operations are performed in the UI module of the reverse car search system:

[0051] S1. Start the reverse vehicle search system in the mobile terminal based on the iOS operating system, control the ARKit SDK module to call the camera of the mobile terminal through the UI module of the reverse vehicle search system, and display the camera image at the parking position of the vehicle on the screen of the mobile terminal, as follows: Figure 1 As shown;

[0052] S2. Select a license plate as a landmark in the camera image at the parking location of the vehicle. The ARKit SDK module scans the license plate through the camera and compares and identifies the license plate image in the camera image with the landmark image in the database of the ARKit SDK module. Figure 1 As shown;

[0053] S3. After the scanning and recognition is successful, the ARKit SDK module immediately loads the virtual annotation information of the parking location above the license plate in the real environment screen, the virtual annotation information is "my vehicle", and the virtual annotation information is stored in the database of the ARKit SDK module;

[0054] The virtual annotation information is superimposed on the real environment picture and displayed in real time on the screen of the mobile terminal. Figure 2 As shown;

[0055] S4. After the virtual annotation information is loaded successfully, the reverse vehicle search system calls the GPS module on the mobile terminal; the GPS module obtains the location information of the mobile terminal from the GPS satellite through the network communication module, and stores it as the vehicle parking location information in the database module in the reverse vehicle search system, thereby realizing the spatial positioning of the vehicle parking location;

[0056] S5. After leaving the vehicle, the reverse vehicle search system calls the GPS module, obtains the real-time location information of the mobile terminal from the GPS satellite through the network communication module, and stores the real-time location information in the database module in the reverse vehicle search system;

[0057] S6. When searching for a vehicle in reverse, the reverse vehicle search system of the mobile terminal is turned on. The reverse vehicle search system calls the virtual annotation information in the ARKit SDK module, and controls the ARKit SDK module to call the mobile terminal camera to obtain the real environment picture through the UI module of the reverse vehicle search system. The real environment picture and the virtual annotation information are superimposed and displayed on the screen of the mobile terminal. At the same time, a pointing arrow appears in the real environment picture;

[0058] If the vehicle parking location marking information is not displayed on the mobile terminal screen, rotate the mobile terminal in the direction of the arrow so that the vehicle parking location marking information appears on the mobile terminal screen. Figure 3 As shown;

[0059] The location calculation module in the database module feeds back the distance between the owner and the parking location of the vehicle based on the current location information and the parking location information of the vehicle; and displays the real-time distance between the owner and the parking location of the vehicle on the screen of the mobile terminal; in this embodiment 1, the real-time distance between the owner and the vehicle displayed on the screen of the mobile terminal is 50m, as shown in detail. Figure 4 As shown;

[0060] S7, searching for a vehicle according to the pointing arrow on the screen of the mobile terminal, as follows Figure 4 shown.

[0061] The above embodiments are preferred examples for implementing the present invention, and the present invention is not limited to the above embodiments. Any non-essential additions and substitutions made by those skilled in the art based on the technical features of the technical solution of the present invention shall fall within the protection scope of the present invention.

Claims

1. A reverse vehicle search method based on AR spatial positioning, It is characterized in that The method comprises the following steps: S1. Start the reverse vehicle search system in the mobile terminal, control the AR SDK module through the UI module of the reverse vehicle search system to call the camera of the mobile terminal, and display the camera image at the parking position of the vehicle on the screen of the mobile terminal; S2. Select a landmark in the camera image at the parking location of the vehicle, and the AR SDK module scans the landmark through the camera, and compares and identifies the landmark image in the camera image with the landmark image in the database of the AR SDK module; S3. After successful scanning and recognition, the AR SDK module immediately loads virtual annotation information of the parking position above the marker in the real environment screen, and stores the virtual annotation information in the database of the AR SDK module; Virtual annotation information is superimposed on the real environment image and displayed in real time on the screen of the mobile terminal; S4. After the virtual annotation information is loaded successfully, the reverse vehicle search system calls the GPS module on the mobile terminal; the GPS module obtains the location information of the mobile terminal from the GPS satellite through the network communication module, and stores it as the vehicle parking location information in the database module in the reverse vehicle search system, thereby realizing the spatial positioning of the vehicle parking location; S5. After leaving the vehicle, the reverse vehicle search system calls the GPS module, obtains the real-time location information of the mobile terminal from the GPS satellite through the network communication module, and stores the real-time location information in the database module in the reverse vehicle search system; S6. When searching for a vehicle in reverse, the reverse vehicle search system of the mobile terminal is turned on. The reverse vehicle search system calls the virtual annotation information in the ARSDK module, and controls the AR SDK module to call the mobile terminal camera to obtain the real environment picture through the UI module of the reverse vehicle search system. The real environment picture and the virtual annotation information are superimposed and displayed on the screen of the mobile terminal. At the same time, a pointing arrow appears in the real environment picture; If the marking information of the parking position of the vehicle is not displayed on the screen of the mobile terminal, rotate the mobile terminal in the direction of the arrow so that the marking information of the parking position of the vehicle appears on the screen of the mobile terminal; The position calculation module in the database module feeds back the distance between the owner and the parking position of the vehicle based on the current position information and the parking position information of the vehicle; The real-time distance between the owner and the parking location of the vehicle is displayed on the mobile terminal screen; S7. Search for a vehicle according to the pointing arrow on the screen of the mobile terminal.

2. According to claim 1, a reverse vehicle search method based on AR spatial positioning, It is characterized in that In S2, the marker is an artificial marker, and the artificial marker is a license plate or the car itself.

3. A reverse vehicle search method based on AR spatial positioning according to claim 2, It is characterized in that In S2, the AR SDK module collects the license plate or the picture of the car itself in advance and stores it in the AR SDK module database.

4. According to claim 1, a reverse vehicle search method based on AR spatial positioning, It is characterized in that In S1, the AR SDK module is an AR navigation SDK module, that is, an augmented reality module; the AR SDK module is used to integrate virtual annotation information with elements of the real environment.

5. According to claim 1, a reverse vehicle search method based on AR spatial positioning, It is characterized in that In S1, the mobile terminal is based on the Android operating system or the iOS operating system; When the mobile terminal is based on the Android operating system, the AR SDK module uses the Vuforia SDK module; when the mobile terminal is based on the iOS operating system, the AR SDK module uses the ARKit SDK module.

6. A reverse vehicle search method based on AR spatial positioning according to claim 1, It is characterized in that In S3, virtual annotation information is pre-set in the AR SDK module, and the virtual annotation information is stored in the AR SDK module database; Virtual annotation information is text, picture, video or three-dimensional digital model.