Picture and video assisted vehicle searching guide system

Abstract

The invention belongs to the technical field of vehicle-mounted electronic equipment, and discloses a vehicle searching guide system assisted by pictures and videos, which consists of vehicle-mounted equipment and a mobile terminal application program, and is characterized in that the vehicle-mounted equipment comprises a front-facing camera, an image calculation unit, a short-distance communication module and a long-distance wireless communication module; the vehicle-mounted equipment is respectively connected with a vehicle ACC and a vehicle storage battery positive electrode through an ACC line and a normal electric line; after the vehicle is parked and flames out, the vehicle-mounted equipment sends a parking picture shot by the front camera and a video clip of the vehicle entering the parking lot to a parking space to a mobile terminal of a user through a data transmission link, and an augmented reality navigation module is arranged in an application program of the mobile terminal; a mobile terminal application program is provided with an augmented reality navigation interface through an augmented reality navigation module, and when a user needs to find a vehicle, vehicle finding is assisted in various forms. According to the invention, the task of vehicle searching guidance can be executed in a scene without a satellite positioning signal and a communication signal.

Description

Technical Field

[0001] The present invention belongs to the technical field of vehicle-mounted electronic equipment, and more specifically, relates to a vehicle-finding guide system assisted by pictures and videos. Background Art

[0002] With the continuous improvement of people's living standards, cars have become an essential tool for modern people to travel. After parking in a parking lot and leaving, car owners need to find their cars based on their memories when they return to the parking lot. When car owners are not familiar with the geographical location of the parking lot and its surrounding environment, they often spend a long time looking for their cars. At this time, a car search guide system is needed to assist in finding the car and shorten the search time. Using mobile phones and vehicle-mounted equipment based on GNSS technology for car search services is the preferred technical means, but when the vehicle is parked in an underground parking lot, it often cannot receive satellite positioning signals, and even cannot find the signal of the communication operator. At this time, conventional positioning-assisted car search systems are difficult to work.

[0003] To this end, the present invention provides a car-finding guide system assisted by pictures and videos. Summary of the invention

[0004] In view of the above problems existing in the prior art, an object of the present invention is to provide a car-finding guide system assisted by pictures and videos, which can perform the task of car-finding guide in scenarios where there are no satellite positioning signals and no communication signals.

[0005] The purpose of the present invention can be achieved by the following technical solutions:

[0006] A car-finding guide system using pictures and videos as aids is composed of an on-board device and a mobile terminal application, wherein the on-board device includes a front camera, an image computing unit, a short-distance communication module, and a long-distance wireless communication module, and the on-board device is connected to the vehicle ACC and the positive electrode of the vehicle battery through an ACC line and a normal line respectively;

[0007] After the vehicle is parked and the engine is turned off, the vehicle-mounted device sends the parking picture taken by the front camera and the video clip of the vehicle entering the parking lot to the parking space to the user's mobile terminal through a data transmission link. The mobile terminal application is provided with an augmented reality navigation module, and the mobile terminal application is provided with an augmented reality navigation interface through the augmented reality navigation module. When the user needs to find the vehicle, the user can browse pictures, watch videos and use augmented reality navigation to assist in finding the vehicle.

[0008] As a further preferred technical solution of the present invention, the picture-assisted car-finding guide system specifically includes the following steps:

[0009] S1: The vehicle-mounted device senses the vehicle's engine shutdown action through the ACC line;

[0010] S2: A static picture of the parking location taken by the front camera of the vehicle-mounted device;

[0011] S3: The vehicle-mounted device may send a static image of the parking position taken by the front camera to the user's mobile terminal through a short-distance communication module; or the vehicle-mounted device may send the static image to a network server through a long-distance wireless communication module, and the user may actively access the network server to download the static image to the user's mobile terminal;

[0012] S4: The user browses the static image through the mobile terminal application and assists in finding the car based on the scene features in the static image of the parking location taken by the front camera.

[0013] As a further preferred technical solution of the present invention, the video-assisted car-finding guide system specifically includes the following steps:

[0014] S1: The front camera on the vehicle device captures the video clip from the vehicle entering the parking lot to the parking space;

[0015] S2: The image computing unit of the vehicle-mounted device performs real-time analysis on the captured video clips, identifies the parking lot gate, and records a time stamp when the vehicle passes through the parking lot gate;

[0016] S3: The vehicle-mounted device senses the vehicle's engine shutdown action through the ACC line;

[0017] S4: The vehicle-mounted device captures a video clip from the time when the vehicle last passed through the parking lot gate to when the vehicle was turned off;

[0018] S5: The vehicle-mounted device sends the video clip taken by the front camera from the vehicle entering the parking lot to the parking space to the user's mobile terminal through the short-distance communication module; or the vehicle-mounted device sends the video clip to the network server through the long-distance wireless communication module, and the user actively accesses the network server to download the video clip to the user's mobile terminal;

[0019] S6: The user watches the video through a mobile terminal application and assists in finding the car based on the parking environment and vehicle path in the video;

[0020] S7: If it is still difficult to find the vehicle after watching the video, the user can walk from the parking lot entrance gate and open the augmented reality navigation interface in the mobile terminal application. The augmented reality navigation interface matches and analyzes the actual scene in front captured in real time by the mobile terminal's camera, and guides the user to the parking location in the form of voice and on-screen arrow prompts.

[0021] As a further preferred technical solution of the present invention, two data transmission links are set up, one is to send pictures or video data to the user's mobile terminal through a short-distance communication module, and the other is to send pictures or videos to a network server through a long-distance wireless communication module, and then the user actively downloads the data from the network server.

[0022] As a further preferred technical solution of the present invention, the short-distance communication module is one of the communication link modules based on Bluetooth technology or wireless local area network technology.

[0023] As a further preferred technical solution of the present invention, the long-distance wireless communication module is one of the communication modules based on the fourth generation mobile communication technology or the fifth generation mobile communication technology.

[0024] As a further preferred technical solution of the present invention, the vehicle-mounted device is a driving recorder, the mobile terminal application is an application platform of the driving recorder, the driving recorder is provided with a monocular camera as the front camera to shoot parking pictures and video clips, the driving recorder is provided with a Wi-Fi module and a 4G communication module as the short-distance communication module and the long-distance wireless communication module for picture and video transmission, the application platform of the driving recorder is provided with augmented reality navigation related functions, and the driving recorder is also provided with an image calculation unit.

[0025] As a further preferred technical solution of the present invention, the image calculation unit of the vehicle-mounted device or the driving recorder performs video analysis and calculation on the video clips from the vehicle entering the parking lot to the parking space based on the video processing chip of the front camera of the vehicle-mounted device or the monocular camera of the driving recorder.

[0026] As a further preferred technical solution of the present invention, the augmented reality navigation interface includes two pictures, one is a video clip of the vehicle entering the parking lot to the parking space taken by the front camera of the vehicle-mounted device, and the other is a picture of the actual scene in front taken in real time by the camera of the user's mobile terminal;

[0027] The augmented reality navigation interface uses the computing resources on the mobile terminal to perform image matching calculations, finds and displays the video frame with the highest matching degree with the current frame of the actual scene picture in front captured in real time by the camera of the mobile terminal in the vehicle path video after the vehicle enters the parking lot and reaches the parking space, and at the same time, analyzes the vehicle's movement direction in the vehicle path video, and makes directional navigation voice prompts to the user at the current position based on the subsequent driving direction of the vehicle in the vehicle path video, and also superimposes and displays a direction indicator arrow on the real-time actual scene picture captured by the mobile terminal.

[0028] As described above, the car-finding guide system using pictures and videos as aids provided by the present invention has the following beneficial effects:

[0029] 1. The present invention utilizes the above-mentioned car-finding guide system assisted by pictures and videos. Compared with the prior art, it can assist in finding a car in areas where satellite positioning signals and signals from communication operators cannot be received.

[0030] 2. The present invention utilizes the above-mentioned car-finding wizard system assisted by pictures and videos. Compared with the prior art, it is provided with different forms of assisting car-finding, such as browsing pictures, watching videos, and augmented reality navigation. It can flexibly increase the amount of information of auxiliary prompts from simple to complex according to the actual needs of users, thereby helping users to improve car-finding efficiency and reduce car-finding time to the greatest extent.

[0031] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0033] Figure 1 This is a schematic block diagram of a car-finding guide system assisted by pictures and videos according to the present invention;

[0034] Figure 2 A schematic diagram of an augmented reality navigation interface of the present invention. DETAILED DESCRIPTION

[0035] The following is a description of the implementation of the present invention by means of specific embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification.

[0036] It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings of this specification are only used to match the contents disclosed in the specification for people familiar with this technology to understand and read, and are not used to limit the limiting conditions that the present invention can be implemented, so they have no substantial technical significance. Any modification of the structure, change in the proportional relationship, or adjustment of the size should still fall within the scope of the technical content disclosed by the present invention without affecting the effects that the present invention can produce and the purposes that can be achieved. At the same time, the terms such as "upper", "lower", "left", "right", "middle" and "one" quoted in this specification are only for the convenience of description, and are not used to limit the scope of the implementation of the present invention. The change or adjustment of the relative relationship should also be regarded as the scope of the implementation of the present invention without substantial changes in the technical content. The specific structure can be described with reference to the drawings of the patent application.

[0037] The present invention provides a car-finding guide system using pictures and videos as aids. Figure 1 and Figure 2 As shown, it is composed of an on-board device and a mobile terminal application. The on-board device includes a front camera, an image computing unit, a short-distance communication module, and a long-distance wireless communication module. The on-board device is connected to the vehicle ACC and the positive electrode of the vehicle battery through an ACC line and a normal line respectively;

[0038] After the vehicle is parked and the engine is turned off, the vehicle-mounted device sends the parking picture taken by the front camera and the video clip of the vehicle entering the parking lot to the parking space to the user's mobile terminal, such as a mobile phone or a tablet, through a data transmission link. An augmented reality navigation module is provided in the mobile terminal application, and the mobile terminal application is provided with an augmented reality navigation interface through the augmented reality navigation module. When the user needs to find the vehicle, the user can browse pictures, watch videos, and use augmented reality navigation to assist in finding the vehicle.

[0039] The picture-assisted car-finding guide system specifically includes the following steps:

[0040] S1: The vehicle-mounted device senses the vehicle's engine shutdown action through the ACC line;

[0041] S2: A static picture of the parking location taken by the front camera of the vehicle-mounted device;

[0042] S3: The vehicle-mounted device may send a static image of the parking position taken by the front camera to the user's mobile terminal through a short-distance communication module; or the vehicle-mounted device may send the static image to a network server through a long-distance wireless communication module, and the user may actively access the network server to download the static image to the user's mobile terminal;

[0043] S4: The user browses the static image through the mobile terminal application and assists in finding the car based on the scene features in the static image of the parking location taken by the front camera.

[0044] The video-assisted car-finding guide system specifically includes the following steps:

[0045] S1: The front camera on the vehicle device captures the video clip from the vehicle entering the parking lot to the parking space;

[0046] S2: The image computing unit of the vehicle-mounted device performs real-time analysis on the captured video clips, identifies the parking lot gate, and records a time stamp when the vehicle passes through the parking lot gate;

[0047] S3: The vehicle-mounted device senses the vehicle's engine shutdown action through the ACC line;

[0048] S4: The vehicle-mounted device captures a video clip from the time when the vehicle last passed through the parking lot gate to when the vehicle was turned off;

[0049] S5: The vehicle-mounted device sends the video clip taken by the front camera from the vehicle entering the parking lot to the parking space to the user's mobile terminal through the short-distance communication module; or the vehicle-mounted device sends the video clip to the network server through the long-distance wireless communication module, and the user actively accesses the network server to download the video clip to the user's mobile terminal;

[0050] S6: The user watches the video through a mobile terminal application and assists in finding the car based on the parking environment and vehicle path in the video;

[0051] S7: If it is still difficult to find the vehicle after watching the video, the user can walk from the parking lot entrance gate and open the augmented reality navigation interface in the mobile terminal application. The augmented reality navigation interface matches and analyzes the actual scene in front captured in real time by the mobile terminal's camera, and guides the user to the parking location in the form of voice and on-screen arrow prompts.

[0052] The data transmission links are provided with two links, one for sending pictures or video data to the user's mobile terminal via the short-distance communication module, and the other for sending pictures or videos to the network server via the long-distance wireless communication module, and then the user actively downloads the data from the network server.

[0053] The short-distance communication module is one of the communication link modules based on Bluetooth technology or Wireless Local Area Network (Wi-Fi) technology.

[0054] The long-distance wireless communication module is one of the communication modules based on the fourth generation mobile communication technology (4G LTE) or the fifth generation mobile communication technology (5G NR).

[0055] The augmented reality navigation interface is as follows Figure 2 As shown, the augmented reality navigation interface includes two upper and lower screens, the upper screen is a video clip of the vehicle entering the parking lot to the parking space taken by the front camera of the vehicle-mounted device, and the lower screen is a screen of the actual scene in front taken in real time by the camera taken by the user's mobile terminal;

[0056] The augmented reality navigation interface uses the computing resources on the mobile terminal to perform image matching calculations, finds and displays the video frame with the highest matching degree with the current frame of the actual scene in front captured in real time by the camera of the mobile terminal in the vehicle path video from the vehicle entering the parking lot to the parking space, and at the same time, analyzes the vehicle movement direction in the vehicle path video, and makes directional navigation voice prompts to the user at the current position according to the subsequent driving direction of the vehicle in the vehicle path video, such as: "go straight", "turn left" and "turn right", and so on, and Figure 2 As shown, the direction indicator arrow is also superimposed on the real-time actual scene picture taken by the mobile terminal. When the user walks, the real scene taken by the mobile terminal at the bottom of the picture changes, and the matching picture in the video recording at the top of the picture also changes synchronously, and the sequence number of the current matching video frame and the total number of video frames (the last frame is the video picture corresponding to the vehicle being turned off) are displayed in the upper left corner of the picture to assist in prompting whether the current position is close to the parking position. Specific embodiment:

[0058] The vehicle-mounted device is a driving recorder, the mobile terminal application is an application platform of the driving recorder, the driving recorder is provided with a monocular camera as the front camera to shoot parking pictures and video clips, the driving recorder is provided with a Wi-Fi module and a 4G communication module as the short-distance communication module and the long-distance wireless communication module to transmit pictures and videos, the driving recorder is also provided with an image calculation unit, and the application platform of the driving recorder is provided with augmented reality navigation-related functions to realize all functions of the car search guide system assisted by pictures and videos.

[0059] The image calculation unit of the vehicle-mounted device or the driving recorder performs video analysis and calculation on the video segment from the vehicle entering the parking lot to the parking space based on the video processing chip of the front camera of the vehicle-mounted device or the monocular camera of the driving recorder.

[0060] Compared with the car search system that relies on location services, the technical solution of the present invention can complete the work of assisting car search in areas where satellite positioning signals or communication operator signals cannot be received. By using different forms such as picture assistance, video assistance, and augmented reality navigation interface assistance, it can flexibly increase the amount of information of auxiliary prompts from simple to complex according to the actual needs of users, and maximize the help of users to improve the efficiency of car search and shorten the time of car search.

[0061] It will be apparent to those skilled in the art that the invention is not limited to the details of the exemplary embodiments described above and that the invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is intended that all variations falling within the meaning and scope of the equivalent elements of the claims be included in the invention. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.

Claims

1. A car-finding guide system using pictures and videos, characterized in that: It is composed of an on-board device and a mobile terminal application. The on-board device includes a front camera, an image computing unit, a short-distance communication module, and a long-distance wireless communication module. The on-board device is connected to the vehicle ACC and the positive electrode of the vehicle battery through an ACC line and a normal line respectively. After the vehicle is parked and the engine is turned off, the vehicle-mounted device sends the parking picture taken by the front camera and the video clip of the vehicle entering the parking lot to the parking space to the user's mobile terminal through a data transmission link. The mobile terminal application is provided with an augmented reality navigation module, and the mobile terminal application is provided with an augmented reality navigation interface through the augmented reality navigation module. When the user needs to find the vehicle, the user can browse pictures, watch videos and use augmented reality navigation to assist in finding the vehicle.

2. A car-finding guide system using pictures and videos as claimed in claim 1, characterized in that: The picture-assisted car-finding guide system specifically includes the following steps: S1: The vehicle-mounted device senses the vehicle's engine shutdown action through the ACC line; S2: A static picture of the parking location taken by the front camera of the vehicle-mounted device; S3: The vehicle-mounted device may send a static image of the parking position taken by the front camera to the user's mobile terminal through a short-distance communication module; or the vehicle-mounted device may send the static image to a network server through a long-distance wireless communication module, and the user may actively access the network server to download the static image to the user's mobile terminal; S4: The user browses the static image through the mobile terminal application and assists in finding the car based on the scene features in the static image of the parking location taken by the front camera.

3. The car-finding guide system using pictures and videos as claimed in claim 1, characterized in that: The video-assisted car-finding guide system specifically includes the following steps: S1: The front camera on the vehicle device captures the video clip from the vehicle entering the parking lot to the parking space; S2: The image computing unit of the vehicle-mounted device performs real-time analysis on the captured video clips, identifies the parking lot gate, and records a time stamp when the vehicle passes through the parking lot gate; S3: The vehicle-mounted device senses the vehicle's engine shutdown action through the ACC line; S4: The vehicle-mounted device captures a video clip from the time when the vehicle last passed through the parking lot gate to when the vehicle was turned off; S5: The vehicle-mounted device sends the video clip taken by the front camera from the vehicle entering the parking lot to the parking space to the user's mobile terminal through the short-distance communication module; or the vehicle-mounted device sends the video clip to the network server through the long-distance wireless communication module, and the user actively accesses the network server to download the video clip to the user's mobile terminal; S6: The user watches the video through a mobile terminal application and assists in finding the car based on the parking environment and vehicle path in the video; S7: If it is still difficult to find the vehicle after watching the video, the user can walk from the parking lot entrance gate and open the augmented reality navigation interface in the mobile terminal application. The augmented reality navigation interface matches and analyzes the actual scene in front captured in real time by the mobile terminal's camera, and guides the user to the parking location in the form of voice and on-screen arrow prompts.

4. The car-finding guide system using pictures and videos as claimed in claim 1, characterized in that: The data transmission links are provided with two links, one for sending pictures or video data to the user's mobile terminal via the short-distance communication module, and the other for sending pictures or videos to the network server via the long-distance wireless communication module, and then the user actively downloads the data from the network server.

5. A car-finding guide system using pictures and videos as claimed in claim 2, 3 or 4, characterized in that: The short-distance communication module is one of the communication link modules based on Bluetooth technology or wireless local area network technology.

6. A car-finding guide system using pictures and videos as claimed in claim 2, 3 or 4, characterized in that: The long-distance wireless communication module is one of the communication modules based on the fourth generation mobile communication technology or the fifth generation mobile communication technology.

7. The car-finding guide system using pictures and videos as claimed in claim 1, characterized in that: The vehicle-mounted device is a driving recorder, the mobile terminal application is an application platform of the driving recorder, the driving recorder is provided with a monocular camera as the front camera to shoot parking pictures and video clips, the driving recorder is provided with a Wi-Fi module and a 4G communication module as the short-distance communication module and the long-distance wireless communication module for picture and video transmission, the application platform of the driving recorder is provided with augmented reality navigation related functions, and the driving recorder is also provided with an image calculation unit.

8. The car-finding guide system using pictures and videos as claimed in claim 7, characterized in that: The image calculation unit of the vehicle-mounted device or the driving recorder performs video analysis and calculation on the video segment from the vehicle entering the parking lot to the parking space based on the video processing chip of the front camera of the vehicle-mounted device or the monocular camera of the driving recorder.

9. A car-finding guide system using pictures and videos as aids according to claim 1 or 3, characterized in that: The augmented reality navigation interface includes two pictures, one is a video clip of the vehicle entering the parking lot and reaching the parking space captured by the front camera of the vehicle-mounted device, and the other is a picture of the actual scene in front captured in real time by the camera of the user's mobile terminal; The augmented reality navigation interface uses the computing resources on the mobile terminal to perform image matching calculations, finds and displays the video frame with the highest matching degree with the current frame of the actual scene picture in front captured in real time by the camera of the mobile terminal in the vehicle path video after the vehicle enters the parking lot and reaches the parking space, and at the same time, analyzes the vehicle's movement direction in the vehicle path video, and makes directional navigation voice prompts to the user at the current position based on the subsequent driving direction of the vehicle in the vehicle path video, and also superimposes and displays a direction indicator arrow on the real-time actual scene picture captured by the mobile terminal.

Images