Vehicle moving prompting method and device

Abstract

The invention discloses a vehicle moving prompting method and equipment, and belongs to the technical field of Internet of Vehicles, the method is used for the vehicle moving prompting equipment, the vehicle moving prompting equipment is arranged on a vehicle, and the method comprises the following steps: obtaining vehicle surrounding information through an image acquisition device, judging whether the obtained vehicle surrounding information meets a preset image standard, if yes, executing the step 1, and if not, executing the step 2; if yes, preliminarily judging that a vehicle moving demand exists, and controlling the vehicle to send out pre-stored voice so as to indicate related personnel to carry out preset operation items; and whether the related personnel complete the preset operation item within a first preset time range is judged, and if yes, a vehicle moving request is sent to a vehicle owner of the vehicle. According to the invention, under the condition that the vehicle owner forgets or is not willing to post the contact way, the vehicle moving request of other people can still be identified and the vehicle owner can be notified.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle networking, and more specifically, to a method and device for prompting vehicle movement. Background Art

[0002] With the continuous development of the economy, the number of motor vehicles in China has shown a rapid growth trend. While this growth has provided great convenience for people's lives, it has also caused many problems, such as traffic congestion, shortage of parking spaces, and frequent illegal parking. In this context, the demand for moving cars due to various factors is increasing. However, due to various obstacles, the party in need of moving cars often finds it difficult to quickly contact the car owner, and the car owner is unable to receive the moving information in time, which has a serious adverse impact on the daily work and life of both parties.

[0003] Currently, a common and low-cost solution is to leave the owner's contact information on the vehicle dashboard so that the party who needs to move the vehicle can directly call the owner. Although this solution is relatively simple, there are many problems in real life that make it difficult to implement effectively. Many car owners do not leave their contact information on the dashboard because they forget, are too lazy to write down their contact information, think that putting the contact information on the dashboard will damage the appearance, or think that they will not encounter such a situation but the opposite happens.

[0004] Another existing solution is to bind the target vehicle and the owner on the server side (with the help of a QR code or license plate). The party who needs to move the vehicle can obtain vehicle information by scanning the QR code or identifying the license plate information through the client, and submit the vehicle information and its own user information to the server. After confirming that the submitter is the requester of the vehicle moving request, the server generates a vehicle moving request information and notifies the owner to move the vehicle. If the QR code is posted, the party who needs to move the vehicle needs to download a specific client. If the license plate scanning method is adopted, the party who needs to move the vehicle is required to know in advance that the target vehicle has the function of scanning the license plate number to notify the owner to move the vehicle, and also needs to download the client. Therefore, this solution has certain defects and shortcomings in the actual operation process. Summary of the invention

[0005] An object of the present invention is to provide a method and device for reminding a vehicle to move, so as to solve the aforementioned problem that when the vehicle owner forgets or is unwilling to post contact information, the vehicle owner can still be identified with a request to move the vehicle and be notified.

[0006] According to a first aspect of the present invention, a vehicle moving reminder method is provided, the method being used for a vehicle moving reminder device, the vehicle moving reminder device being arranged on a vehicle, the method comprising:

[0007] Acquire the vehicle surrounding information through the image acquisition device, and determine whether the acquired vehicle surrounding information meets the preset image standard. If yes, proceed to the next step; if no, continue to acquire and determine the vehicle surrounding information;

[0008] If the acquired vehicle surrounding information meets the preset image standard, it is preliminarily determined that there is a need to move the vehicle, and the vehicle is controlled to emit a pre-stored voice to instruct relevant personnel to perform a preset operation item;

[0009] Determine whether the relevant personnel complete the preset operation items within the first preset time range, and if so, send a vehicle moving request to the owner of the vehicle, otherwise continue to process the vehicle surrounding information obtained by the image acquisition device.

[0010] Optionally, the image acquisition device is configured as four cameras, and the four cameras are respectively installed on the front side, rear side, left side and right side of the vehicle.

[0011] Optionally, in the step of determining whether the acquired vehicle surrounding information meets a preset image standard, if three cameras with consecutive positions among the four cameras collect three portrait information with a set similarity within a second preset time range, it is determined that the preset image standard is met.

[0012] Optionally, the cockpit domain controller extracts features from three portrait images captured by three consecutive cameras and compares them. When the set similarity reaches 60%, it is determined that the preset image standard is met, and it is preliminarily determined that there is a need to move the car.

[0013] Optionally, in the step of controlling the vehicle to emit a pre-stored voice to instruct relevant personnel to perform preset operation items, the relevant personnel refers to a person who has the need to move the vehicle, and the pre-stored voice includes instructing the person who has the need to move the vehicle to press a door touch switch of one of the doors of the vehicle, and the voice is played a preset number of times within the first preset time range.

[0014] Optionally, if within the first preset time range, a person who needs to move the vehicle completes the operation of pressing the door touch switch of one of the vehicle's doors, the cockpit domain controller sends a CAN signal to TBOX, and the TBOX sends information to the background server, which sends a request to move the vehicle to the owner of the vehicle through the background server.

[0015] Optionally, the background server sends the vehicle moving request to the owner of the vehicle via a text message or an APP message.

[0016] Optionally, before the step of acquiring the vehicle surrounding information by the image acquisition device and determining whether the acquired vehicle surrounding information meets the preset image standard, the method further includes:

[0017] The vehicle moving reminder function only works when the MP5 screen setting switch or the mobile phone APP setting switch of the vehicle is turned on, and it is automatically turned off when the vehicle power is lower than the set threshold.

[0018] Optionally, the vehicle moving reminder function enters a working state after the vehicle is armed, during which the relevant communication network is kept in an awake state; when the vehicle is in a non-armed state, the vehicle moving reminder function remains in standby state.

[0019] According to a second aspect of the present invention, a vehicle moving reminder device is provided, which adopts the above-mentioned vehicle moving reminder method, and the device includes a cockpit domain controller, a camera, a pedestrian warning system, a body controller, a door touch switch, a TBOX and a background server;

[0020] The cockpit domain controller is used to process the vehicle surrounding information collected by the camera, give a preliminary determination result of the need to move the vehicle by analyzing the vehicle surrounding information, and send a CAN signal to control the pedestrian warning system to emit a pre-stored voice when it is preliminarily determined that there is a need to move the vehicle; when receiving a signal from the body controller that the door touch switch is pressed, the cockpit domain controller sends a vehicle moving request to the TBOX, and the TBOX is used to send the vehicle moving request to the background server, and send the vehicle moving request to the owner of the vehicle through the background server.

[0021] The vehicle moving reminder method and device disclosed in the present invention have the following technical effects:

[0022] The MP5 screen setting switch or the mobile phone APP setting switch can be used to control the activation of the car moving need recognition function, giving the car owner the right to choose independently. The car owner can flexibly decide whether to enable this function according to his actual needs and usage scenarios. When it is determined that the car moving reminder function is not needed, it can be turned off to avoid unnecessary system resource occupation and power consumption;

[0023] Using four 360-degree panoramic cameras to collect surrounding information can fully cover the environment around the vehicle, greatly increasing the probability of collecting valid portrait information. The cockpit domain controller extracts and compares the features of the portrait images collected by three consecutive cameras. When the feature matching degree reaches a certain standard, it is preliminarily determined that there is a need to move the car. This can effectively distinguish different people and avoid misjudgment due to simple image similarities, thereby improving the accuracy of the determination of the need to move the car and reducing the occurrence of false alarms. Setting three consecutive cameras to collect three portrait information in a specific order within the second preset time range and a feature matching degree standard of 60% further optimizes the accuracy and effectiveness of the judgment;

[0024] When the cockpit domain controller initially determines that there is a need to move the car, it controls the pedestrian warning system to send out a pre-stored voice to clearly inform the party who needs to move the car, that is, to press the door touch switch. This voice prompt plays a good guiding role, allowing the party who needs to move the car to quickly understand how to further confirm the need to move the car, improving the interactivity and convenience of the entire car moving process. If a button press signal is received within the first preset time range, the system can quickly send the car moving request to the owner through the CAN signal, TBOX and the background server. The entire process is efficient and automated, achieving a quick response from confirmation of the car moving demand to notification of the owner, reducing delays in the intermediate links.

[0025] Further features and advantages of the present invention will become apparent from the following detailed description of exemplary embodiments of the present invention with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0027] Figure 1 A logical schematic diagram of a vehicle moving reminder method provided by an embodiment of the present invention;

[0028] Figure 2 A schematic diagram of a vehicle-mounted camera provided in an embodiment of the present invention.

[0029] The following are marked in the figure:

[0030] 1. Cockpit domain controller (CDC); 2. Camera; 3. BCM (body controller); 4. VSP (pedestrian warning system); 5. Door touch switch; 6. TBOX (vehicle communication terminal); 7. Backend server; 8. Mobile client. DETAILED DESCRIPTION

[0031] Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present invention unless otherwise specifically stated.

[0032] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.

[0033] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0034] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0035] The present invention proposes an embodiment of a method for prompting a vehicle to move. Specifically, Figure 1 As shown, a vehicle moving reminder device is used, the vehicle moving reminder device is set on the vehicle, and the method includes:

[0036] The vehicle surrounding information is obtained through the image acquisition device, and it is determined whether the obtained vehicle surrounding information meets the preset image standard. If yes, the next step is entered; if not, the vehicle surrounding information is continuously acquired and determined; it should be noted that the image acquisition device is four cameras, each of which is a 360-degree panoramic camera, and the four cameras are respectively installed on the front, rear, left and right sides of the vehicle. Figure 2 Cameras at different locations can capture images of people approaching the vehicle from multiple angles, reducing missed judgments due to blind spots.

[0037] If the acquired vehicle surrounding information meets the preset image standard, it is preliminarily determined that there is a need to move the vehicle, and the vehicle is controlled to issue a pre-stored voice to instruct relevant personnel to perform preset operation items; it should be noted that if three cameras in consecutive positions among the four cameras collect three portrait information with a set similarity within the second preset time range, it is judged to meet the preset image standard, wherein the second preset time range is set to 30 seconds and can be calibrated, and the preset image standard is configured as three consecutive cameras collecting three portrait information with a certain similarity within 30 seconds. Figure 2 As shown, the sequence of continuous images includes: 123, 234, 341, 321, 214, 143. The limitation of the second preset time range can prevent the collected image information from being incoherent due to too long a time or misjudging it as a need to move the car due to a short stay of people. The specific sequence of continuous images takes into account the movement path and possible behavior patterns of people around the vehicle, so that the judgment result can better reflect the real intention of moving the car, rather than the random interference of people walking. When it is initially determined that there is a need to move the car, the images collected by the camera will no longer be processed, and the processing will be started after the current work cycle is completed.

[0038] It is determined whether the relevant personnel have completed the preset operation items within the first preset time range. If yes, a vehicle moving request is sent to the owner of the vehicle, otherwise, the vehicle surrounding information obtained by the image acquisition device is continued to be processed.

[0039] In an embodiment of the present invention, the cockpit domain controller extracts features from three portrait images captured by three cameras in consecutive positions and performs feature comparison. When the set similarity reaches 60%, it is judged to meet the preset image standard, and it is preliminarily determined that there is a need to move the car. Among them, the similarity can be calibrated according to the actual project and is not limited to 60%. For example, in some public parking lots with frequent personnel flow and complex environments, the matching standard can be appropriately increased, such as set to 70% or higher, so as to avoid misjudging the need to move the car due to a large number of people and occasional similar situations; and in relatively closed private parking lots with less personnel flow, the matching standard can be appropriately lowered to about 50%, so that possible car moving needs can be captured more sensitively and the possibility of missed judgment can be reduced.

[0040] On the other hand, feature extraction of three portrait images collected by three cameras in consecutive positions is to extract the most critical information that best reflects the identity characteristics of the person in the image, and remove the information brought by irrelevant background, lighting and other interference factors, so that the subsequent comparison operation can be carried out more accurately and efficiently. After completing the feature extraction, the cockpit domain controller will compare the feature data extracted from the three portrait images with each other. For example, for facial features, the similarity of eye features will be compared to see how different they are in shape, size, relative position, etc., and similar detailed comparative analysis will be performed on other facial features such as nose and mouth, as well as facial contours, overall body shape and other extracted feature dimensions, and then the comparison results of all these feature dimensions will be combined to obtain an overall feature matching situation. Through strict feature comparison operations, it can be determined whether the characters in the three images are the same person or have a high similarity, so as to infer whether the same person is continuously active around the vehicle and may need to move the vehicle.

[0041] In an embodiment of the present invention, in the step of controlling the vehicle to issue a pre-stored voice to instruct the relevant personnel to perform a preset operation item, the relevant personnel refers to the personnel who have the need to move the vehicle, and the pre-stored voice includes instructing the personnel who have the need to move the vehicle to press the door touch switch of one of the vehicle doors, and the voice is played a preset number of times within the first preset time range. For example, the door touch switch is set to the door touch switch of the main driver's door handle, and the content of the pre-stored voice can be "If you need to move the car, please press the button of the main driver's door handle, and the vehicle will notify the owner to move the car", and the first preset time range is set to 1 minute (this time can be calibrated and adjusted according to different vehicle application scenarios, user needs, etc.), and the pre-stored voice is played 3 times within 1 minute (the number of times can be calibrated).

[0042] In an embodiment of the present invention, when the cockpit domain controller preliminarily determines that there is a need to move the vehicle, the countdown is started. If within the first preset time range, the person who has the need to move the vehicle completes the operation of pressing the door touch switch of one of the vehicle doors, indicating that the people around the vehicle have a clear and positive intention to move the vehicle, the cockpit domain controller sends a CAN (Controller Area Network) signal to TBOX, and TBOX sends information to the background server, which sends the vehicle moving request to the owner of the vehicle through the background server. Because the operation of this door touch switch button has a certain degree of initiative and clarity, it can more directly reflect the intention of the person compared to indirect judgment methods such as image recognition. The double confirmation mechanism of confirming the image information and performing the countdown door touch switch pressing signal greatly improves the accuracy of the triggering of the vehicle moving request. It avoids unnecessary vehicle moving requests caused by misjudgment or other non-vehicle moving related personnel behavior, and reduces interference to the owner. The countdown mechanism ensures that the vehicle system will not immediately start the subsequent process of sending a request to move the vehicle after initially determining the need to move the vehicle. Instead, it will only monitor the signal from the driver's door handle button while waiting for confirmation. This can reduce unnecessary consumption of system resources such as communication and data processing.

[0043] In addition, after the backend server sends the request to move the car to the owner, the current working cycle ends, and the cockpit domain controller continues to process the image information collected by the camera. If the door handle button is not pressed within 1 minute, the current working cycle ends, returns to the original working state, and continues to process the image information collected by the camera.

[0044] In an embodiment of the present invention, the backend server sends a vehicle moving request to the vehicle owner via a text message or an APP message. After receiving the vehicle moving request information, the vehicle owner can move the vehicle in person, or remotely unlock and power on the vehicle through the APP to ask the vehicle moving demander to help move the vehicle.

[0045] In an embodiment of the present invention, before obtaining the vehicle surrounding information through the image acquisition device and determining whether the obtained vehicle surrounding information meets the preset image standard, it also includes: the vehicle moving reminder function only works when the vehicle's MP5 screen setting switch or the mobile phone APP setting switch is turned on, and the user can flexibly decide whether to enable this function according to their actual needs and usage scenarios. And it is automatically turned off when the vehicle power is lower than the set threshold. Specifically, the set threshold of the vehicle power is set to 20% and can be calibrated. In this way, it is ensured that the vehicle moving reminder function operates under the appropriate power and setting on state to avoid unnecessary power consumption and false start.

[0046] In an embodiment of the present invention, the car moving reminder function enters a working state after the vehicle is armed, during which the relevant communication network is kept in an awake state, so that the surrounding environment can be monitored in time to see whether there is a need to move the vehicle after the owner leaves the vehicle, and the communication network is kept awake to ensure smooth data transmission between various components; but when a digital key such as a Bluetooth key or UWB (ultra-wideband technology) remains linked, it means that the owner is around the vehicle, and the car moving reminder function does not enter a working state but remains in standby mode, avoiding the system from performing unnecessary image acquisition, analysis and other operations, saving system resources and power; similarly, when the vehicle is in a non-armed state, the car moving reminder function also remains in standby mode, and the working state is intelligently switched based on these judgment conditions to reduce unnecessary operations.

[0047] The present invention also provides an embodiment of a vehicle moving reminder device, such as Figure 1 and Figure 2 As shown, the above-mentioned vehicle moving prompt method is adopted, and the equipment includes a cockpit domain controller, a camera, a pedestrian warning system, a body controller, a door touch switch, a TBOX and a background server;

[0048] The cockpit domain controller is used to process the vehicle surrounding information collected by the camera, and gives a preliminary judgment result on the need to move the vehicle by analyzing the vehicle surrounding information. When it is preliminarily determined that there is a need to move the vehicle, it sends a CAN signal to control the pedestrian warning system to issue a pre-stored voice. When receiving a signal from the body controller that the door touch switch is pressed, the cockpit domain controller sends a vehicle moving request to TBOX. TBOX is used to send the vehicle moving request to the background server, and the vehicle moving request is sent to the owner of the vehicle through the background server.

[0049] It should be noted that the information interaction, execution process and other contents between the above-mentioned components are based on the same concept as the method embodiment of the present application, and are devices corresponding to the above-mentioned car moving reminder method. All implementation methods in the above-mentioned method embodiment are applicable to the embodiments of the device. Its specific functions and technical effects can be found in the method embodiment part, which will not be repeated here.

[0050] The above describes in detail the structure, features and effects of the present invention based on the embodiments shown in the drawings, but the above is only a preferred embodiment of the present invention. It should be noted that the technical features involved in the above embodiments and their preferred methods can be reasonably combined and matched into a variety of equivalent schemes by those skilled in the art without departing from or changing the design ideas and technical effects of the present invention; therefore, the present invention is not limited to the scope of implementation shown in the drawings, and all changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments with equivalent changes, which still do not exceed the spirit covered by the specification and drawings, should be within the protection scope of the present invention.

Claims

1. A method for prompting a vehicle to move, characterized in that: The method is used for a vehicle moving reminder device, the vehicle moving reminder device is arranged on a vehicle, and the method comprises: Acquire the vehicle surrounding information through the image acquisition device, and determine whether the acquired vehicle surrounding information meets the preset image standard. If yes, proceed to the next step; if no, continue to acquire and determine the vehicle surrounding information; If the acquired vehicle surrounding information meets the preset image standard, it is preliminarily determined that there is a need to move the vehicle, and the vehicle is controlled to emit a pre-stored voice to instruct relevant personnel to perform a preset operation item; Determine whether the relevant personnel complete the preset operation items within the first preset time range, and if so, send a vehicle moving request to the owner of the vehicle, otherwise continue to process the vehicle surrounding information obtained by the image acquisition device.

2. The vehicle moving prompt method according to claim 1, characterized in that: The image acquisition device is configured as four cameras, and the four cameras are respectively installed on the front side, rear side, left side and right side of the vehicle.

3. The vehicle moving prompt method according to claim 2, characterized in that: In the step of determining whether the acquired vehicle surrounding information meets the preset image standard, if three cameras with consecutive positions among the four cameras collect three portrait information with a set similarity within a second preset time range, it is determined that the preset image standard is met.

4. The vehicle moving prompting method according to claim 3, characterized in that: The cockpit domain controller extracts features from the three portrait images captured by three consecutive cameras and compares them. When the set similarity reaches 60%, it is judged that the preset image standard is met and it is preliminarily determined that there is a need to move the car.

5. The vehicle moving prompting method according to claim 1, characterized in that: In the step of controlling the vehicle to emit a pre-stored voice to instruct relevant personnel to perform preset operation items, the relevant personnel refers to a person who has the need to move the vehicle, and the pre-stored voice includes instructing the person who has the need to move the vehicle to press the door touch switch of one of the doors of the vehicle, and the voice is played a preset number of times within the first preset time range.

6. The vehicle moving prompt method according to claim 5, characterized in that: If within the first preset time range, the person who needs to move the vehicle completes the operation of pressing the door touch switch of one of the vehicle doors, the cockpit domain controller sends a CAN signal to TBOX, and the TBOX sends information to the background server, which sends the vehicle moving request to the owner of the vehicle through the background server.

7. The vehicle moving prompting method according to claim 6, characterized in that: The backend server sends the vehicle moving request to the owner of the vehicle via a text message or an APP message.

8. The vehicle moving prompting method according to claim 1, characterized in that: Before the step of obtaining the vehicle surrounding information through the image acquisition device and determining whether the obtained vehicle surrounding information meets the preset image standard, the method further includes: The vehicle moving reminder function only works when the MP5 screen setting switch or the mobile phone APP setting switch of the vehicle is turned on, and it is automatically turned off when the vehicle power is lower than the set threshold.

9. The vehicle moving prompting method according to claim 8, characterized in that: After the vehicle is armed, the vehicle moving reminder function enters a working state, during which the relevant communication network is kept in an awake state; when the vehicle is in a non-armed state, the vehicle moving reminder function remains in standby state.

10. A vehicle moving reminder device, characterized in that: The vehicle moving reminder method according to any one of claims 1 to 9 is adopted, wherein the device comprises a cockpit domain controller, a camera, a pedestrian warning system, a body controller, a door touch switch, a TBOX and a background server; The cockpit domain controller is used to process the vehicle surrounding information collected by the camera, give a preliminary determination result of the need to move the vehicle by analyzing the vehicle surrounding information, and send a CAN signal to control the pedestrian warning system to emit a pre-stored voice when it is preliminarily determined that there is a need to move the vehicle; when receiving a signal from the body controller that the door touch switch is pressed, the cockpit domain controller sends a vehicle moving request to the TBOX, and the TBOX is used to send the vehicle moving request to the background server, and send the vehicle moving request to the owner of the vehicle through the background server.

Images