A method and system for reminding a driver to open a door of a vehicle

Abstract

The application belongs to the technical field of automobile safety, and discloses a method and system for reminding opening of an automobile door, which comprises the following steps: when a driver or passenger pulls a door handle to prepare for opening the door, multiple frames of images around the automobile are captured, and the collected images are analyzed and processed; whether there is a potential danger is judged according to the analysis result of the images, and different prompt levels are generated; different pop-up box prompts and voice prompts are carried out on a screen according to the different prompt levels; and then the opening state of the door is controlled according to the different prompt levels. The method can remind users according to different scenes and prompt levels, so as to bring a more safe and humanized experience to the driver or passenger, and effectively prevent accidents.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of automobile safety, and particularly relates to a method and system for reminding opening of a door of an automobile. BACKGROUND

[0002] With the development of economy and the improvement of people's living standards, automobiles have become a common means of transportation for people. With the gradual increase in the number of automobiles, the occurrence of accidents has also increased, and people's requirements and attention to automobile safety have also been increasing. Opening a door while parking is a common operation during driving; when a driver opens a door, if he or she does not carefully observe whether there are pedestrians or oncoming vehicles behind, he or she may recklessly open the door, which may cause the pedestrians or vehicles to not have enough time to react when passing by and easily be knocked down, resulting in an accident. When a driver opens a door, if he or she does not observe the ground conditions, he or she may step on accumulated water or a muddy road, which may easily cause a fall and other situations. In addition, when a driver opens a door, he or she also needs to pay attention to the distance between the door and the surrounding objects to avoid colliding with the surrounding objects when opening the door. At present, with the development of automobile intelligence, there are many studies on the opening door warning function of an automobile, but they mainly focus on detecting vehicles, bicycles, etc. approaching from behind on both sides of the adjacent lanes when the vehicle is stationary or moving at a low speed, and alarming and prompting the driver not to open the door when there is a risk of opening the door. The current door opening prompt method is relatively simple and not humanized, and mainly focuses on the scene of preventing collision warning of moving objects, and the attention to other scenes is not enough. Therefore, it is necessary to optimize the prompt method and increase the prompt of other scenes in order to provide a more safe and humanized experience for the driver and passenger. SUMMARY

[0003] The present application aims to overcome the above-mentioned deficiencies and provide a method and system for reminding opening of a door of an automobile, which can prompt users according to different scenes and prompt levels in order to provide a more safe and humanized experience for the driver and passenger.

[0004] In order to achieve the above-mentioned purpose, the present application adopts the following technical solutions:

[0005] A method for reminding opening of a door of an automobile, comprising the following steps:

[0006] When a driver pulls the door handle to prepare to open the door, multiple frames of images around the door are captured, and the images are analyzed and processed;

[0007] According to the analysis results of the images, different prompt levels are generated;

[0008] According to different prompt levels, different levels of prompts are given through pop-up windows and voice;

[0009] According to different levels of prompts, the opening state of the door is controlled.

[0010] An object detection and tracking algorithm is used to analyze the images.

[0011] If there is no moving object approaching, the prompt level is set to the first door opening state, if there is a moving object approaching, the distance from the vehicle is greater than the preset value, the prompt level is set to the second door opening state, and the distance from the vehicle is less than the preset value, the prompt level is set to the third door opening state.

[0012] When there is water on the road on the side of the door opening, or the road is muddy and uneven, and the previous prompt level is lower than the second door opening state, the prompt level is adjusted to the second door opening state; when the distance between the door opening side and the object beside it is less than the preset value, and the previous prompt level is lower than the second door opening state, the prompt level is adjusted to the second door opening state.

[0013] When the prompt level is the third door opening state, the driver or passenger cannot directly open the door by pulling the door handle, and needs to manually confirm again in the screen before opening the door; when the prompt level is the second door opening state, the door is opened after a delay of 3S, and the resistance effect of the door opening is increased; when the prompt level is the first door opening state, the door is normally opened.

[0014] A system for reminding the opening of a car door, comprising the following modules:

[0015] A panoramic surround view module for capturing multiple frames of images around the vehicle when the driver or passenger pulls the door handle to prepare to open the door, and analyzing and processing the images;

[0016] An image analysis module for generating different prompt levels according to the analysis results of the images;

[0017] A prompt module for prompting different levels through pop-up windows and voice according to different prompt levels;

[0018] A control module for controlling the opening state of the door according to different prompt levels.

[0019] The image analysis module analyzes the static environment around the vehicle, including road conditions, distance from objects beside the vehicle, people or vehicles approaching from the front or rear, wet or uneven ground, and too close to objects beside the vehicle.

[0020] The prompt module generates different voice scripts according to the analysis results and prompts the driver or passenger through voice when the door handle is pulled.

[0021] An electronic device comprising a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps of the above-mentioned car door opening reminding method.

[0022] A storage medium, which stores a computer program, the computer program is executed by a processor to realize the steps of the door opening reminding method of the automobile.

[0023] Compared with the prior art, the present application has the following beneficial effects:

[0024] The present application captures multiple frames of images around the driver or passenger when the driver or passenger pulls the door handle to prepare to open the door, analyzes and processes the collected images, determines whether there is a potential danger according to the analysis result of the images, generates different prompt levels, prompts at different levels through pop-up windows and voice according to different prompt levels, and controls the opening state of the door according to different prompt levels. The method of the present application can prompt the user according to different scenes and prompt levels, so as to bring a safer and more personalized experience to the driver or passenger. BRIEF DESCRIPTION OF DRAWINGS

[0025] Figure 1 The figure is a flowchart of the door opening reminding method of the automobile of the present application.

[0026] Figure 2 The figure is a schematic diagram of the door opening reminding system of the automobile of the present application.

[0027] Figure 3 The figure is a flowchart of the door opening reminding method of the automobile of the present application.

[0028] Figure 4 The figure is a schematic diagram of the electronic device of the door opening reminding method of the automobile of the present application. DETAILED DESCRIPTION

[0029] The present application will be further described below in conjunction with the drawings and embodiments, but should not be understood as limiting the above-mentioned subject matter of the present application to the following embodiments. Various substitutions and modifications can be made according to ordinary technical knowledge and conventional means in the art without departing from the above-mentioned technical idea of the present application, and all of them should be included in the protection scope of the present application.

[0030] As shown in Figure 1 A door opening reminding method of an automobile, comprising the following steps:

[0031] S1, when the driver or passenger pulls the door handle to prepare to open the door, multiple frames of images around the driver or passenger are captured, and the images are analyzed and processed, wherein an object detection and tracking algorithm is used to analyze the images;

[0032] S2, different prompt levels are generated according to the analysis result of the images, if there is no moving object approaching, the prompt level is set to a first door opening state, if there is a moving object approaching, the distance between the moving object and the vehicle is greater than a preset value, the prompt level is set to a second door opening state, and the distance between the moving object and the vehicle is less than the preset value, the prompt level is set to a third door opening state;

[0033] S3, according to different prompt levels, different levels of prompts are given through pop-up windows and voice, when there is accumulated water on the road surface on the side of the opening door, or the road surface is muddy and uneven, and the previous prompt level is lower than the second opening door state, the prompt level is adjusted to the second opening door state; when the distance between the opening door side and the nearby object is lower than the preset value, and the previous prompt level is lower than the second opening door state, the prompt level is adjusted to the second opening door state;

[0034] S4, according to different levels of prompts, the opening state of the vehicle door is controlled, when the prompt level is the third opening door state, the driver pulls the door handle and cannot directly open the door, and needs to manually confirm again in the screen before opening the door; when the prompt level is the second opening door state, the door is opened after a delay of 3S, and the resistance effect of opening the door is increased; when the prompt level is the first opening door state, the door is normally opened.

[0035] As shown in Figure 2 A system for reminding the opening of a vehicle door includes the following modules:

[0036] A panoramic surround view module is used to capture multiple frames of images around the vehicle when the driver pulls the door handle to prepare to open the door, and analyze and process the images;

[0037] An image analysis module is used to generate different prompt levels according to the analysis results of the images;

[0038] A prompt module is used to give different levels of prompts through pop-up windows and voice according to different prompt levels;

[0039] A control module is used to control the opening state of the vehicle door according to different levels of prompts.

[0040] Embodiment 1:

[0041] As shown in Figure 3 When the vehicle is parked on the roadside and the driver needs to get off,

[0042] S1, when the driver pulls the door handle on the left front side of the vehicle, the door lock module sends a CAN signal A;

[0043] S2, the panoramic surround view module receives the CAN signal A and collects images around the vehicle through the surround view system;

[0044] S3, the collected images around the vehicle are analyzed and processed through the image analysis module;

[0045] S4, different prompt levels are generated according to the analysis results, and the opening state of the vehicle door is controlled,

[0046] When there is a moving object approaching in the collected image of the left side of the vehicle, and the distance between the moving object and the vehicle is less than 3m, the image analysis module identifies this situation as the third door opening state "dangerous", and a pop-up box for confirming door opening immediately pops up on the main driver's screen. At this time, the main driver cannot open the door without clicking the confirmation door opening pop-up box. When the main driver clicks the confirmation door opening pop-up box appearing on the screen interface, the voice broadcasts danger when the vehicle door handle is pulled to open the door.

[0047] When there is a moving object approaching in the collected image of the left side of the vehicle, and the distance between the moving object and the vehicle is greater than 3m, or there is water, mud and unevenness on the left side of the vehicle, the image analysis module identifies this situation as the second door opening state "warning". When the vehicle door handle is pulled to open the door, the main driver is delayed for 3s, giving the main driver sufficient reaction time. At the same time, the voice broadcasts the precautions when the door is opened.

[0048] When there is no moving object approaching in the collected image of the left side of the vehicle, and the road condition on the left side of the vehicle is good, the image analysis module identifies this situation as the first door opening state "normal". When the vehicle door handle is pulled, the door is opened, and the voice broadcasts safety precautions when the door is opened, giving the driver and passenger a safe and warm reminder.

[0049] Embodiment 2:

[0050] When the vehicle is parked on the roadside, and the co-driver needs to get off the vehicle,

[0051] S1, when the co-driver pulls the right front door handle of the vehicle, the door lock module sends a CAN signal A;

[0052] S2, the panoramic view module receives the CAN signal A, and collects the surrounding image through the panoramic view system;

[0053] S3, the collected surrounding image is analyzed and processed through the image analysis module;

[0054] S4, according to the analysis result, different prompt levels are generated, and different opening states of the door are controlled,

[0055] When there is a moving object approaching in the collected image of the right side of the vehicle, and the distance between the moving object and the right front door is less than 3m, the image analysis module identifies this situation as the third door opening state "dangerous", and a pop-up box for confirming door opening immediately pops up on the main driver's screen. At this time, the co-driver cannot open the door without clicking the confirmation door opening pop-up box. When the main driver clicks the confirmation door opening pop-up box appearing on the screen interface, the voice broadcasts danger when the co-driver pulls the vehicle right front door handle to open the door.

[0056] When there is a moving object approaching in the collected image of the right side of the car, and the distance between the moving object and the right front door is greater than 3m, or there is water, muddy and uneven road surface in the right front road of the car, the image analysis module identifies such situation as the second door opening state "warning", and the copilot delays 3s when pulling the car door handle to open the door, giving the copilot sufficient reaction time, and at the same time, the voice broadcast announcements when opening the door;

[0057] When there is no moving object approaching in the collected image of the right side of the car, and the road condition of the right side of the car is good, the image analysis module identifies such situation as the first door opening state "normal", and the copilot pulls the car door handle to open the door, and at the same time, the voice broadcast announcements when opening the door, giving the driver and passenger a safe and warm reminder.

[0058] Embodiment 3:

[0059] When the car is parked on the roadside, and the rear passenger gets off from the right rear,

[0060] S1, when the rear passenger pulls the car door handle, the door lock module sends CAN signal A;

[0061] S2, the panoramic view module receives CAN signal A, and collects the surrounding image through the panoramic view system;

[0062] S3, the collected surrounding image is analyzed and processed through the image analysis module;

[0063] S4, according to the analysis result, different prompt levels are generated, and different opening states of the door are controlled,

[0064] When there is a moving object approaching in the collected image of the right side of the car, and the distance between the moving object and the right rear door of the car is less than 3m, the image analysis module identifies such situation as the third door opening state "danger", and a pop-up box for confirming opening of the door appears on the main driver screen immediately, at this time, the rear passenger cannot open the door without clicking the confirmation opening of the door pop-up box, and when the main driver clicks the confirmation opening of the door pop-up box appearing on the screen interface, the rear passenger pulls the car door handle to open the door, and the voice broadcast announcements in danger;

[0065] When there is a moving object approaching in the collected image of the right side of the car, and the distance between the moving object and the right rear door of the car is less than 3m, or there is water, muddy and uneven road surface in the right rear road of the car, the image analysis module identifies such situation as the second door opening state "warning", and the rear passenger delays 3s when pulling the car door handle to open the door, giving the rear passenger sufficient reaction time, and at the same time, the voice broadcast announcements when opening the door;

[0066] When there is no moving object close to the right side of the car in the collected image, and the road surface state of the right side of the car is good, the image analysis module identifies this situation as the first door opening state "normal", and the rear passenger pulls the right rear door handle of the car to open the door, and at the same time, the voice broadcast reminds the driver and passenger to pay attention to safety, and gives a safe and warm reminder.

[0067] Embodiment 4:

[0068] Please refer to Figure 4 The electronic device 100 comprises a memory 101, at least one processor 102, a computer program 103 stored in the memory 101 and executable on the at least one processor 102, and at least one communication bus 104.

[0069] The memory 101 can be used to store the computer program 103, and the processor 102 can realize the steps of the method for reminding the opening of the car door by running or executing the computer program stored in the memory 101 and calling the data stored in the memory 101. The memory 101 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application required by a function (such as a sound playing function, an image playing function, etc.), and the like; and the data storage area can store data (such as audio data) created according to the use of the electronic device 100. In addition, the memory 101 can include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device.

[0070] The at least one processor 102 can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 102 can be a microprocessor or any conventional processor, etc. The processor 102 is the control center of the electronic device 100, and connects all parts of the electronic device 100 through various interfaces and lines.

[0071] The memory 101 in the electronic device 100 stores a plurality of instructions to implement a method of reminding a door opening of a vehicle, and the processor 102 can execute the plurality of instructions to implement:

[0072] When a driver pulls a door handle to prepare to open a door, a plurality of images around the driver are captured, and the images are analyzed and processed;

[0073] According to the analysis result of the images, different prompt levels are generated;

[0074] According to the different prompt levels, different levels of prompts are given through a pop-up window and voice;

[0075] According to the different levels of prompts, the opening state of the vehicle door is controlled.

[0076] The modules / units of the electronic device 100, if implemented in the form of software function units and sold or used as independent products, can be stored in a computer readable storage medium. Based on this understanding, all or part of the processes in the above-mentioned embodiment methods can also be completed by a computer program instructing related hardware, and the computer program can be stored in a computer readable storage medium. When the processor executes the computer program, the steps of the above-mentioned various method embodiments can be implemented. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or some intermediate forms, etc. The computer readable medium can include any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, and read-only memory (ROM).

[0077] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program code.

[0078] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 means for functionally implementing the steps listed in the flowchart block or blocks.

[0079] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 means for functionally implementing the steps listed in the flowchart block or blocks.

[0080] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 means for functionally implementing the steps listed in the flowchart block or blocks.

[0081] The above embodiments are only used to illustrate the technical solutions of the present application but not limit the present application, and although the present application is described in detail with reference to the above embodiments, the ordinary skilled person in the art can still make modifications or equivalent replacements to the specific embodiments of the present application, and these modifications or equivalent replacements which do not depart from the spirit and scope of the present application are intended to be covered by the claims of the patent application to be granted.

Claims

1. A method of door opening reminder for a vehicle, characterized by, The method comprises the following steps: When the driver pulls the door handle to open the door, multiple frames of images around the vehicle are captured and analyzed and processed; According to the analysis results of the images, different prompt levels are generated; According to different prompt levels, different levels of prompts are given through pop-up windows and voice; According to different levels of prompts, the opening state of the door is controlled; If there is no moving object approaching, the prompt level is set to the first door opening state; if there is a moving object approaching, the distance from the vehicle is greater than a preset value, the prompt level is set to the second door opening state, and the distance from the vehicle is less than the preset value, the prompt level is set to the third door opening state; When there is water on the road on the side of the door opening, or the road is muddy and uneven, and the previous prompt level is lower than the second door opening state, the prompt level is adjusted to the second door opening state; when the distance from the object beside the door opening is lower than the preset value, and the previous prompt level is lower than the second door opening state, the prompt level is adjusted to the second door opening state; When the prompt level is the third door opening state, the driver cannot directly open the door by pulling the door handle, and needs to manually confirm again on the screen before opening the door; when the prompt level is the second door opening state, the door is opened after a delay of 3S, and the resistance effect of the door opening is increased; when the prompt level is the first door opening state, the door is normally opened.

2. The method of claim 1, wherein, The object detection and tracking algorithm is used to analyze the images.

3. A system for implementing the method of claim 1, wherein, The method comprises the following modules: A panoramic surround view module is used to capture multiple frames of images around the vehicle when the driver pulls the door handle to open the door, and analyze and process the images; An image analysis module is used to generate different prompt levels according to the analysis results of the images; A prompt module is used to give different levels of prompts through pop-up windows and voice according to different prompt levels; A control module is used to control the opening state of the door according to different levels of prompts.

4. The system for reminding of opening of a door of a vehicle according to claim 3, characterized by The image analysis module analyzes the static environment around the vehicle, including the road condition, the distance from the object beside the vehicle, the people / car coming from the front / rear, the wet / slippery / uneven ground, and the proximity to the object beside the vehicle.

5. The system for reminding of opening of a door of a vehicle according to claim 3, characterized by, The prompt module generates different voice scripts according to the analysis results and gives voice prompts when the driver pulls the door handle. 6.An electronic device comprising a memory and a processor, the memory storing a computer program, wherein, The processor executes the computer program to realize the steps of the vehicle door opening reminding method in any one of claims 1 to 2.

7. A storage medium having stored thereon a computer program, characterized in that The computer program is executed by the processor to realize the steps of the vehicle door opening reminding method in any one of claims 1 to 2.

Images