Car door opening intelligent reminding method and device based on car and car

Abstract

The invention discloses an automobile door opening intelligent reminding method and device based on an automobile and the automobile. The method comprises the steps that when an automobile pre-opening instruction is detected, an opening sensor is controlled to detect environment data of a preset range around a to-be-opened automobile door and conduct real-time analysis; when it is judged that a pedestrian or an object is within the preset range around the to-be-opened door currently, or it is judged that a pedestrian or an object enters the preset range around the to-be-opened door within preset time, a door opening risk prompt is controlled to be sent out, and the door is automatically kept in a locked state; and when it is judged that no pedestrian or object is in the preset range around the to-be-opened vehicle door currently and no pedestrian or object enters the preset range around the to-be-opened vehicle door within preset time, current safety is confirmed, locking is unlocked, and the vehicle door is allowed to be opened. According to the method and the system, the surrounding environment can be detected before the passenger tries to open the door, and the warning can be given out when potential danger exists, so that convenience is provided for the use of the user.

Description

Technical Field

[0001] The present invention relates to the field of automobile detection technology, and in particular to an automobile door opening intelligent reminder method, device, intelligent automobile and storage medium. Background Art

[0002] With the development of automobiles and the continuous improvement of people's living standards, the use of family cars is becoming more and more popular, and family cars have become a frequently used means of transportation.

[0003] With the acceleration of urbanization, urban roads are becoming increasingly crowded and parking space is becoming increasingly limited. In this environment, when a car is parked on the roadside, passengers open the door without fully observing the surrounding environment, which may easily cause collisions with passing pedestrians or bicycles, causing safety hazards.

[0004] Therefore, the existing technology still needs to be improved and developed. Summary of the invention

[0005] The technical problem to be solved by the present invention is that, in view of the problems and defects of the above-mentioned prior art, a method, device, smart car and storage medium for intelligent door opening reminder based on a car are provided, aiming to solve the problem of lack of effective safety reminder before opening the car door in the prior art, and to provide a system that can detect the surrounding environment before the passenger tries to open the door and issue a warning when there is potential danger, thereby providing convenience for users.

[0006] The technical solution adopted by the present invention to solve the problem is as follows:

[0007] A vehicle door opening intelligent reminder method based on a vehicle, comprising:

[0008] When a vehicle pre-door opening command is detected, the opening sensor is controlled to detect environmental data in a predetermined range around the door to be opened;

[0009] Perform real-time analysis on the detected environmental data of the predetermined range around the door to be opened, and determine whether there are pedestrians or objects currently within the predetermined range around the door to be opened, or determine whether they will enter the predetermined range around the door to be opened at a predetermined time;

[0010] When it is determined that there is a pedestrian or object within the predetermined range around the door to be opened, or when it is determined that a pedestrian or object enters the predetermined range around the door to be opened at a predetermined time, the control issues a door opening risk prompt and automatically keeps the door locked;

[0011] When it is determined that there are no pedestrians or objects within the predetermined range around the door to be opened, and it is determined that no pedestrians or objects will enter the predetermined range around the door to be opened within a predetermined time, the current safety is confirmed and the lock is released to allow the door to be opened.

[0012] The method for intelligently reminding a vehicle door to be opened, wherein before the step of controlling the opening sensor to detect environmental data in a predetermined range around the door to be opened when a vehicle pre-door opening instruction is detected, the method comprises:

[0013] When the vehicle is parked and unlocked, it detects that the user's hand touches the door or the door opening switch, automatically triggering the generation of a vehicle pre-door opening command.

[0014] The method for intelligently reminding a vehicle door to be opened, wherein before the step of controlling the opening sensor to detect environmental data in a predetermined range around the door to be opened when a vehicle pre-door opening instruction is detected, the method comprises:

[0015] Ultrasonic sensors are pre-installed on both sides of each door of the car to detect environmental data within a predetermined range around the door;

[0016] Pre-install radar sensors on both sides of each door and / or rear bumper of the vehicle to detect environmental data outside a predetermined range around the door;

[0017] Cameras are pre-installed on the side mirrors or doors of the car to capture long-distance image information outside a predetermined range around the door.

[0018] The method for intelligently reminding a vehicle door to be opened, wherein when a vehicle door pre-opening instruction is detected, the step of controlling the opening sensor to detect environmental data in a predetermined range around the door to be opened comprises:

[0019] When a vehicle pre-door opening command is detected, the ultrasonic sensor is controlled to be turned on to detect environmental data within a predetermined range around the door to be opened; the radar sensor is controlled to be turned on to detect environmental data outside the predetermined range around the door to be opened; and the camera is controlled to be turned on to capture long-distance image information outside the predetermined range around the door to be opened.

[0020] The method for intelligently reminding a vehicle door to be opened includes the following steps: analyzing the detected environmental data in a predetermined range around the door to be opened in real time to determine whether a pedestrian or object is currently within the predetermined range around the door to be opened, or will enter the predetermined range around the door to be opened at a predetermined time:

[0021] Receive environmental data within a predetermined range around the door to be opened detected by the ultrasonic sensor, environmental data outside the predetermined range around the door to be opened detected by the radar sensor, and long-distance image information outside the predetermined range around the door to be opened captured by the camera;

[0022] Real-time comprehensive analysis is performed on the received environmental data within the predetermined range around the door to be opened, the environmental data outside the predetermined range around the door to be opened, and the long-distance image information outside the predetermined range around the door to be opened, to determine whether there are pedestrians or objects within the predetermined range around the door to be opened, or to determine whether they will enter the predetermined range around the door to be opened at a predetermined time.

[0023] The method for intelligently reminding the vehicle door to be opened, wherein the step of controlling the issuance of a door opening risk reminder and automatically keeping the door locked when it is determined that a pedestrian or an object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or an object enters a predetermined range around the door to be opened at a predetermined time, comprises:

[0024] When it is determined that a pedestrian or object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or object enters the predetermined range around the door to be opened at a predetermined time, the vehicle's built-in speaker is controlled to issue a voice door opening risk warning, the lights inside and / or outside the vehicle are controlled to flash and / or change color to issue a door opening risk warning, the vehicle's onboard display screen is controlled to display a text door opening risk warning, and the door is automatically kept locked.

[0025] The method for intelligently reminding the vehicle door to be opened, wherein after the step of confirming that it is currently safe and unlocking the door to allow it to be opened when it is determined that there are no pedestrians or objects within a predetermined range around the door to be opened and it is determined that no pedestrians or objects will enter the predetermined range around the door to be opened within a predetermined time, the step further includes:

[0026] When the current safety is confirmed and the lock is released to allow the door to be opened, the user is reminded through voice to continue to pay more attention when opening the door.

[0027] A vehicle door opening intelligent reminder device based on a vehicle, wherein the device comprises:

[0028] The vehicle pre-door opening detection module is used to automatically trigger the generation of a vehicle pre-door opening instruction when the user touches the door or the door opening switch when the vehicle is parked and unlocked;

[0029] A door-to-open environment detection control module, which is used to control the opening sensor to detect environmental data in a predetermined range around the door to be opened when a vehicle pre-door opening instruction is detected;

[0030] An analysis and judgment module is used to perform real-time analysis on the environmental data detected in the predetermined range around the door to be opened, and to judge whether there are pedestrians or objects in the predetermined range around the door to be opened, or whether they will enter the predetermined range around the door to be opened at a predetermined time;

[0031] A risk warning control module is used to control the issuance of a door opening risk warning and automatically keep the door locked when it is determined that a pedestrian or object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or object enters the predetermined range around the door to be opened at a predetermined time;

[0032] A confirmation module is installed to confirm current safety and unlock the door to allow it to be opened when it is determined that there are no pedestrians or objects within a predetermined range around the door to be opened and that no pedestrians or objects will enter the predetermined range around the door to be opened within a predetermined time.

[0033] A smart car, comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, including the one or more programs for executing any one of the methods described.

[0034] A computer-readable storage medium, wherein when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute any one of the methods described above.

[0035] Beneficial effects of the invention: The invention provides a method, device, smart car and storage medium for intelligent door opening reminder based on a car. The invention can detect the surrounding environment before the passenger tries to open the door, and issue a warning in time when there is a potential danger, thereby greatly reducing the possibility of accidents caused by mistaken door opening and improving road traffic safety. The invention also has the following advantages:

[0036] 1) It has comprehensive environmental perception capabilities and high detection accuracy. It uses a variety of sensors (ultrasonic, infrared, and cameras) to comprehensively perceive the environment around the door to be opened to improve detection accuracy.

[0037] 2) With intelligent decision-making capabilities, the central processing unit can perform intelligent analysis based on sensor data and accurately determine whether there is potential danger.

[0038] 3) It can provide multi-modal prompts to warn passengers through sound, light, touch and other means to ensure that passengers can notice the danger in time.

[0039] 4) In high-risk situations, the doors are automatically locked to further ensure the safety of passengers and pedestrians. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0041] Figure 1 It is a flow chart of the vehicle door opening intelligent reminder method based on the vehicle provided in the first embodiment of the present invention.

[0042] Figure 2 It is a flow chart of the vehicle door opening intelligent reminder method based on the vehicle provided in the second embodiment of the present invention.

[0043] Figure 3 A principle block diagram of an embodiment of a vehicle door opening intelligent reminder device provided by the present invention.

[0044] Figure 4 It is a block diagram of the internal structure principle of a smart car provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0045] In order to make the purpose, technical solution and advantages of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0046] It should be noted that if the embodiments of the present invention involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0047] In view of the problem that there is a lack of effective safety prompts before opening a car door in the prior art, the present invention provides a system that can detect the surrounding environment before a passenger attempts to open the door and issue a warning when there is potential danger.

[0048] like Figure 1 As shown, a vehicle door opening intelligent reminder method based on a vehicle in Embodiment 1 of the present invention comprises the following steps:

[0049] Step S100: When the vehicle is in a parked and unlocked state, it is detected that a user's hand touches the door or touches the door opening switch, and a vehicle pre-door opening instruction is automatically triggered.

[0050] In the embodiment of the present invention, the car is taken as an example. In the specific implementation, it is necessary to detect the pre-door opening instruction of the vehicle, that is, to detect when the user is ready to open the door. In the embodiment of the present invention, it can be defined that when the vehicle is detected to be in a parking state and the active unlocking of the vehicle is detected at the same time, the vehicle pre-door opening instruction can be automatically triggered and enter step S200, so that the detection and prevention of the vehicle surrounding environment can be done earlier in advance.

[0051] Of course, in a further embodiment of the present invention, when the vehicle is detected to be in a parked state and unlocked, and the user's hand touches the door to be opened or the switch of the door to be opened, the vehicle pre-door opening instruction is automatically triggered. In this way, it is possible to more specifically detect which door the user is about to open, which is more conducive to further detecting the environment around the door to be opened in the subsequent steps.

[0052] Step S200: When a vehicle door pre-opening instruction is detected, the opening sensor is controlled to detect environmental data in a predetermined range around the door to be opened;

[0053] In an embodiment of the present invention, when a vehicle pre-door opening instruction is detected, that is, the vehicle is detected to be in a parking state and the vehicle is actively unlocked, and the user's hand is detected to touch the door to be opened or the switch to be opened, the present invention will immediately control the opening of the sensor to detect environmental data in a predetermined range around the door to be opened. For example, when it is detected that the current vehicle is stopped and the user's hand touches the co-pilot door or touches the door opening switch of the co-pilot door, the present invention will control the opening of the corresponding sensor to detect environmental data in a predetermined range around the co-pilot door, so as to facilitate the subsequent steps to analyze the environmental data, so as to determine whether there are pedestrians, cyclists or vehicles driving around the predetermined range around the co-pilot door, so as to facilitate the subsequent steps.

[0054] Of course, the present invention further comprises the following steps before this step is specifically implemented:

[0055] S101, pre-arranging ultrasonic sensors on both sides of each door of the vehicle to detect environmental data within a predetermined range around the door;

[0056] In the embodiment of the present invention, ultrasonic sensors installed on both sides of the vehicle door can detect obstacles within a short distance around the vehicle door, for example, obstacles within a range of 0.5-6 meters around the vehicle door.

[0057] S102, pre-installing radar sensors on both sides of each door and / or rear bumper of the vehicle to detect environmental data outside a predetermined range around the door;

[0058] In the embodiment of the present invention, obstacles within a long distance of the vehicle door can be detected by radar sensors installed on both sides of the vehicle door or the rear bumper, for example, obstacles within a range of 4-50 meters around the vehicle door.

[0059] S103, pre-installing a camera on the side mirror or each door of the car to capture long-distance image information outside a predetermined range around the door.

[0060] In the embodiment of the present invention, a camera installed on a side rearview mirror or above a door can be used to capture image information at a longer distance, for example, the camera can be used to capture image information at a distance of 10-100 from the door to be opened.

[0061] Therefore, when the present invention is implemented, when a vehicle pre-door opening command is detected, the ultrasonic sensor is controlled to be turned on to detect environmental data within a predetermined range around the door to be opened; the radar sensor is controlled to be turned on to detect environmental data outside the predetermined range around the door to be opened; and the camera is controlled to be turned on to capture long-distance image information outside the predetermined range around the door to be opened.

[0062] That is, in the embodiment of the present invention, when the vehicle detects the pre-door opening command, it will automatically control the corresponding ultrasonic sensor to detect the environmental data within a predetermined range around the door to be opened. The ultrasonic sensor of this embodiment is mainly used for close-range obstacle detection. The purpose of this step is to identify in real time whether there are other objects or people in the door opening area to avoid potential collisions or injuries. The ultrasonic sensor determines the distance information of the surrounding environment by emitting ultrasonic pulses and measuring the time of the reflected wave.

[0063] At the same time, the radar sensor is controlled to detect environmental data outside the predetermined range around the door to be opened. Among them, the radar sensor is suitable for longer distance detection and can monitor the situation within the radius outside the door. This includes detecting other vehicles or obstacles to prevent accidents when opening the door. The radar sensor uses the reflection characteristics of electromagnetic waves to calculate the distance and relative speed between objects and provide real-time environmental data.

[0064] At the same time, the camera is controlled to capture long-distance image information outside the predetermined range around the door to be opened. The camera can provide visual information to help the driver or vehicle system understand the surrounding environment more comprehensively, especially in poor viewing angles. The image information can be further analyzed through image processing technology to achieve more complex environmental understanding. The camera obtains images of the surrounding environment and can analyze the images in combination with computer vision algorithms, such as object recognition and scene understanding.

[0065] In this step embodiment, by using ultrasonic sensors, radar sensors and cameras at the same time, accidents when the vehicle door is opened can be effectively reduced. This comprehensive detection can timely identify pedestrians or other obstacles approaching the vehicle, and remind the driver or the automatic parking system to make adjustments.

[0066] The present invention can improve the driving experience through intelligent technology. For example, after the vehicle detects the door opening action, it can automatically delay the door opening until the surroundings are confirmed to be safe, reducing the driver's worries.

[0067] In a narrow parking environment, the car door may hit adjacent vehicles or obstacles when opening. Through real-time monitoring, the system can provide feedback to indicate the situation around the vehicle and prevent collision.

[0068] The application of the integrated sensor system in the embodiment of the present invention significantly improves driving safety and user experience, and is an important direction for the future development of intelligent vehicles.

[0069] Step S300, analyzing the detected environmental data of the predetermined range around the door to be opened in real time, determining whether there is a pedestrian or object currently in the predetermined range around the door to be opened, or determining whether a pedestrian or object will enter the predetermined range around the door to be opened at a predetermined time;

[0070] In the embodiment of this step, after the vehicle detects the instruction to open the door, the environmental data collected by the ultrasonic sensor, radar sensor and camera will be immediately obtained. These data include distance, speed, direction and image information. These data are processed by the algorithm to analyze the environmental conditions around the door to be opened in real time. Determine whether there are pedestrians or objects, that is, the present invention will identify and determine whether there are pedestrians or other objects in the area around the door to be opened. This involves object detection and classification algorithms, such as computer vision technology, which can identify pedestrians, vehicles or other obstacles in the image.

[0071] Through ultrasonic and radar sensors, the present invention can detect the distance and movement status of objects and determine whether they are within the danger range.

[0072] It also predicts whether a pedestrian or object will enter the area around the door to be opened within a predetermined time. That is, in addition to real-time detection, the embodiment of the present invention also predicts whether a pedestrian or object will enter the area around the door to be opened within a short period of time in the future (such as within a few seconds). This can be achieved by analyzing the movement trajectory and speed of the object.

[0073] If an object is detected moving toward the door, and its speed and distance indicate that it will enter the danger zone in a short time, it will be convenient to issue a warning or take corresponding measures (such as delaying door opening) in the subsequent steps.

[0074] For example, a driver is about to open the door of a car on a busy city street. The method embodiment of the present invention analyzes the surrounding environment data and detects that a pedestrian is walking towards the door. The present invention confirms that the distance between the pedestrian and the door is 1 meter through the ultrasonic sensor, and the radar sensor detects that the pedestrian is moving at a speed of 1.5 meters per second. Thus, the prediction algorithm determines that the pedestrian will enter the opening range of the door within the next 2 seconds.

[0075] Based on these analyses, the present invention can immediately warn the driver in the following steps, or automatically delay the opening of the door until the pedestrian passes safely. This intelligent response mechanism not only protects the safety of pedestrians, but also avoids potential losses of vehicles and drivers.

[0076] It can be seen that the vehicle intelligent system can effectively improve safety and user experience through real-time analysis and prediction of environmental data around the door to be opened, providing a solid foundation for future intelligent transportation. It also has the following advantages: through real-time analysis, the system can effectively identify potential dangers, avoid collisions with pedestrians or objects when opening the door, and significantly improve the safety of passengers and surrounding pedestrians. The prediction function can identify objects that are about to enter the dangerous area in advance, helping the driver or automatic system to respond in time and reduce the risk of accidents. This intelligent monitoring and prediction capability makes the driver feel more at ease when parking and opening the door, improving the overall driving experience, especially in busy or narrow environments.

[0077] Furthermore, the step S300 specifically includes:

[0078] S301, receiving environmental data within a predetermined range around the door to be opened detected by the ultrasonic sensor, environmental data outside the predetermined range around the door to be opened detected by the radar sensor, and long-distance image information outside the predetermined range around the door to be opened captured by the camera;

[0079] In this step embodiment, the vehicle system can receive data from multiple sensors:

[0080] 1) Ultrasonic sensor: detects environmental data within a predetermined range around the door to be opened. This data is mainly used to identify close objects next to the door, such as pedestrians, other vehicles or obstacles.

[0081] 2) Radar sensor: collects environmental data outside the predetermined range around the door to be opened. Radar can detect objects farther away and provide real-time information about the area outside the door, such as fast-approaching vehicles or other obstacles.

[0082] 3) Camera: Captures long-range image information outside the predetermined range around the door to be opened. This image data can be used to identify and analyze more complex scenes, such as pedestrians, traffic signs or other dynamic objects.

[0083] S302, conduct a real-time comprehensive analysis of the received environmental data within the predetermined range around the door to be opened, the environmental data outside the predetermined range around the door to be opened, and the long-distance image information outside the predetermined range around the door to be opened, to determine whether there are pedestrians or objects currently within the predetermined range around the door to be opened, or determine whether they will enter the predetermined range around the door to be opened at a predetermined time.

[0084] In this step, all received environmental data is comprehensively analyzed, specifically integrating the data from ultrasound, radar and camera to form a comprehensive understanding of the environment around the door to be opened. Then an algorithm is used to determine whether there are pedestrians or objects within a predetermined range around the door to be opened. This process involves object detection and classification technology, which can accurately identify different types of objects.

[0085] Then, a prediction analysis is performed, that is, in addition to judging the current state, the present invention also predicts whether a pedestrian or object will enter the surrounding area of ​​the door to be opened within a predetermined time. This prediction is based on the movement trajectory and speed of the object to ensure that the system can respond in time.

[0086] For example, a driver parks his car on a busy street and is about to open the door. At this time, the present embodiment performs the following operations:

[0087] Corresponding step S301: The ultrasonic sensor detects a pedestrian next to the door about 1 meter away from the door, the radar sensor detects a bicycle approaching quickly about 5 meters away, and the camera captures a pedestrian in the distance walking towards the vehicle.

[0088] Corresponding to step S302: the present invention integrates and analyzes these data to confirm that there are pedestrians around the door, and predicts that within the next 2 seconds, pedestrians in the distance will enter the safe range for the door to open.

[0089] Based on this information, the present invention makes it easier to decide not to open the door immediately in the subsequent steps, but to issue a warning to the driver, and the system will not allow the door to be opened until the pedestrian passes safely.

[0090] Through this intelligent sensor data reception and analysis, vehicles can operate more safely in complex environments, protecting the safety of passengers and pedestrians, reflecting the advancement and practicality of modern automotive technology.

[0091] The invention also shows that by using a combination of multiple sensors, it can more comprehensively monitor the surrounding environment and significantly reduce the risk of accidents when opening the car door. For example, if the system detects a pedestrian or vehicle nearby, it may delay the door opening to protect the pedestrian's safety.

[0092] It can also enhance responsiveness, enabling the system to quickly respond to potential dangers through real-time analysis and prediction functions, and issue warnings or take measures in a timely manner, further reducing the possibility of accidents. It also allows drivers to have higher security when opening doors, reduce concerns about the surrounding environment, and improve the overall driving experience, especially in complex urban environments.

[0093] Step S400: When it is determined that a pedestrian or an object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or an object enters the predetermined range around the door to be opened at a predetermined time, the control issues a door opening risk prompt and automatically keeps the door locked;

[0094] That is, in an embodiment of the present invention, when it is determined that a pedestrian or object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or object enters a predetermined range around the door to be opened at a predetermined time, the control issues a door opening risk prompt and automatically keeps the door locked.

[0095] Specifically, in this step embodiment, by comprehensively analyzing the data from ultrasound, radar and camera, it is determined in real time whether there are pedestrians or objects within the safe range of the door opening. If a pedestrian or object is found, or it is predicted that a pedestrian or object will enter the area in a short time, the present invention will respond.

[0096] In an embodiment of the present invention, once a potential risk is confirmed (i.e., a pedestrian or object enters the risk area where the door is to be opened), the system loaded with the method in the embodiment of the present invention will issue a warning to the driver through an audible and visual alarm (such as a buzzer sound, a dashboard warning light, or an information screen prompt), reminding him that there is a risk in currently opening the door.

[0097] In addition, in order to prevent accidents, the system will automatically keep the doors locked to prevent them from opening. This measure ensures that the safety of passengers and pedestrians is not threatened in dangerous situations.

[0098] For example, consider a driver parking his car on a busy city street and preparing to open the door.

[0099] At this time, the intelligent system of the vehicle implemented by the method of the present invention performs the following operations:

[0100] In real-time monitoring, the present invention detects a pedestrian about 1 meter away from the door through the ultrasonic sensor, and the radar sensor detects a bicycle approaching quickly. The camera also captures another pedestrian walking towards the vehicle in the distance. The embodiment of the present invention will comprehensively analyze these data, determine that there are currently pedestrians and objects within the predetermined range around the door, and predict that the pedestrian will enter the door opening area in the next few seconds.

[0101] After confirming the risk, the system of the present invention will immediately send out an audible and visual alarm to remind the driver that "opening the door is risky, please pay attention to the surrounding situation". At the same time, the present invention will automatically keep the door locked to prevent the driver from opening the door in dangerous situations.

[0102] In this way, the driver hears the alarm, realizes that there are pedestrians around, and decides to wait for the pedestrians to pass before opening the door. Through this intelligent safety mechanism, the system effectively avoids potential accidents and ensures the safety of everyone. This automated risk warning and door locking function not only improves the safety of the vehicle, but also demonstrates the advancement and effectiveness of modern automotive technology in protecting passengers and pedestrians.

[0103] In an embodiment of the present invention, when a pre-door opening command is detected, the environment around the door to be opened will be immediately detected at the millisecond level to detect whether there are obstacles such as pedestrians or objects around the door to be opened, so as to immediately provide the user with whether there is a risk in opening the door.

[0104] The embodiment of this step can effectively avoid collisions with pedestrians or objects when opening the door through real-time monitoring and automatic response, thereby protecting the safety of passengers and surrounding pedestrians. After parking, the driver knows that the system will actively monitor the surrounding environment and issue an alarm, so he can perform various operations with more confidence and reduce concerns about the surrounding situation. And by locking the door when there is a risk, accidents caused by accidental door opening are prevented, especially in busy urban environments, reducing injuries caused by negligence. This automated safety mechanism reflects the intelligence level of modern vehicles and provides users with a more advanced and safer driving experience.

[0105] In a further embodiment of the present invention, step S400 further includes:

[0106] S401. When it is determined that a pedestrian or an object is currently within a predetermined range around a door to be opened, or when it is determined that a pedestrian or an object enters a predetermined range around a door to be opened at a predetermined time, the vehicle's built-in speaker is controlled to issue a voice door opening risk warning, the lights inside and / or outside the vehicle are controlled to flash and / or change color to issue a door opening risk warning, the vehicle-mounted display screen is controlled to display a text door opening risk warning, and the door is automatically kept locked.

[0107] That is, in the embodiment of the present invention, the surrounding environment is monitored in real time, and sensors such as ultrasound, radar and camera are used to determine whether there are pedestrians or objects in the safe range around the door, or to predict that pedestrians or objects will enter the range in a short time. Once a potential risk is confirmed, the present invention will issue a voice prompt through the vehicle's built-in speaker to remind the driver "Be careful, there is a risk in opening the door, please ensure safety around you."

[0108] In the embodiment of the present invention, in order to enhance the visual warning effect, the lights inside and / or outside the vehicle may be controlled to flash or change color when the risk warning is given. For example, the turn signal outside the vehicle may flash, or the ambient light inside the vehicle may change to red to further attract the driver's attention.

[0109] Furthermore, the present invention will also control the display screen to prompt, for example, control the vehicle-mounted display screen to display text prompts, such as "Opening the door is risky, please pay attention to your surroundings", to provide clear visual information to help the driver understand the current situation. And in the present invention example, after all warnings are issued, the door will automatically remain in a locked state to prevent the driver from opening the door in dangerous situations.

[0110] For example, a driver parks his car on a busy street and is about to open the door. At this time, the intelligent system of the vehicle in the embodiment of the present invention performs the following operations:

[0111] In the embodiment of the present invention, when a pre-door opening command is detected, the sensor will detect a pedestrian about 1 meter away from the door in milliseconds, and the radar sensor will detect a bicycle approaching quickly. The present invention determines that there are pedestrians and objects within a predetermined range around the door, and predicts that the pedestrian will enter the door opening area in the next few seconds. A voice warning is immediately issued through the speaker: "Attention, there is a risk in opening the door, please ensure safety around you."

[0112] At the same time, the present invention will also control the turn signal outside the car to start flashing, and the ambient light inside the car will turn red to further remind the driver to pay attention. It will also control the text on the car display screen to display: "Opening the door is risky, please pay attention to your surroundings". The system will automatically keep the door locked to prevent the driver from opening the door in dangerous situations.

[0113] In this way, when the driver and the accompanying personnel hear the alarm and see the visual prompt, they realize that there are pedestrians around and decide to wait for the pedestrians to pass before opening the door. Through this intelligent multiple warning mechanism, potential accidents are effectively avoided and the safety of everyone is ensured.

[0114] This comprehensive warning and locking function not only improves the safety of the vehicle, but also demonstrates the advancement and effectiveness of modern automotive technology in protecting passengers and pedestrians. And by combining voice, light and text prompts, the system provides a variety of warning methods to ensure that the driver can promptly notice the potential risk of opening the door. This multiple warning mechanism greatly improves safety. And timely warnings can effectively prevent collisions with pedestrians or objects when opening the door, protecting the safety of passengers and surrounding pedestrians, especially in busy urban environments. And by automatically locking the door, the system ensures that there will be no accidental door opening in potentially dangerous situations, reducing the possibility of accidents.

[0115] Step S500: When it is determined that there are no pedestrians or objects within the predetermined range around the door to be opened, and it is determined that no pedestrians or objects will enter the predetermined range around the door to be opened within a predetermined time, it is confirmed that it is currently safe and the lock is released to allow the door to be opened.

[0116] In the embodiment of the present invention, by real-time monitoring of the surrounding environment, using sensors such as ultrasound, radar and camera, it is confirmed that there are no pedestrians or objects in the predetermined range around the door to be opened. In addition, the present invention will also analyze the movement trajectory and speed of the surrounding objects to determine that no pedestrians or objects will enter the range in the next few seconds. Once it is confirmed that there is no potential danger at present, the present invention will perform safety confirmation to ensure that the driver and passengers will not encounter accidents when opening the door.

[0117] After confirming safety, the system control will unlock the door, allowing the driver or passenger to open the door safely.

[0118] In this way, the present invention can quickly unlock the door while ensuring safety through intelligent monitoring, improving the convenience of door opening, especially when getting on and off the vehicle quickly. Before opening the door, the driver and passengers know that the system has conducted a comprehensive safety check, so they can open the door with more confidence and reduce unnecessary worries.

[0119] The present invention prevents accidental door opening due to misjudgment through automatic judgment and locking mechanism, ensuring the safety of passengers and pedestrians. This intelligent safety confirmation and unlocking mechanism not only improves the practicality and safety of the vehicle, but also demonstrates the effectiveness of modern automobile technology in improving user experience and ensuring passenger safety.

[0120] In a further embodiment, the present invention further comprises: when the current safety is confirmed and the door is unlocked to allow the door to be opened, the user is reminded by voice to continue to pay more attention when opening the door, so as to always remind the user to pay attention to safety when opening the door.

[0121] The present invention is further described in detail below through a specific application example:

[0122] like Figure 2 As shown, a vehicle door opening intelligent reminder method based on a specific application embodiment of the present invention includes the following steps:

[0123] S31: When the vehicle is in a stationary state (ie, parked state), enter S32.

[0124] S32. The vehicle door opening intelligent reminder system based on the method of the present invention is started, and the process proceeds to step S33 respectively.

[0125] S33, the sensor starts to monitor the environmental data around the door and enters step S34.

[0126] S34. The central processing unit receives the sensor data and proceeds to step S35.

[0127] S35, analyze data in real time; and proceed to step S36.

[0128] S36: If a pedestrian, bicycle or other obstacle is detected approaching, the process goes to step S37; otherwise, the process goes to step S39.

[0129] S37, assess risk groups, etc., and proceed to S38.

[0130] S38: Is the risk level high? If not, proceed to step S39; if yes, proceed to step S40.

[0131] S39. Continue monitoring.

[0132] S40, issuing a warning through the human-computer interaction interface, and then proceeding to step S41.

[0133] S41. The user confirms again whether it is safe. If no, proceed to step S42; if yes, proceed to step S43.

[0134] S42, protection lock state.

[0135] S43, manually unlock or wait for the system to automatically unlock, open the door to be opened, and end the current process.

[0136] As can be seen from the above, an embodiment of the present invention provides a car door opening intelligent reminder method, which can detect the surrounding environment before the passenger attempts to open the door and issue a warning in time when there is a potential danger, thereby greatly reducing the possibility of accidents caused by mistakenly opening the door and improving road traffic safety.

[0137] Exemplary Devices

[0138] like Figure 3 As shown, an embodiment of the present invention provides a vehicle door opening intelligent reminder device based on a vehicle, the device comprising:

[0139] The vehicle pre-door opening detection module 310 is used to automatically trigger the generation of a vehicle pre-door opening instruction when the user touches the door or the door opening switch when the vehicle is parked and unlocked;

[0140] The door-to-open environment detection control module 320 is used to control the opening sensor to detect the environment data of a predetermined range around the door to be opened when a vehicle pre-door opening instruction is detected;

[0141] The analysis and judgment module 330 is used to perform real-time analysis on the detected environmental data in the predetermined range around the door to be opened, and judge whether there is a pedestrian or object in the predetermined range around the door to be opened, or judge whether it will enter the predetermined range around the door to be opened at a predetermined time;

[0142] The risk warning control module 340 is used to control the issuance of a door opening risk warning and automatically keep the door locked when it is determined that a pedestrian or an object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or an object enters the predetermined range around the door to be opened at a predetermined time;

[0143] The confirmation module 350 is installed to confirm the current safety and unlock the door to allow it to be opened when it is determined that there are no pedestrians or objects within the predetermined range around the door to be opened, and when it is determined that no pedestrians or objects will enter the predetermined range around the door to be opened within a predetermined time, as described above.

[0144] Based on the above embodiments, the present invention further provides a smart car, whose principle block diagram can be shown as follows: Figure 4 As shown. The smart car includes a processor, a memory, a network interface, a display screen, and a database connected through a system bus. Among them, the processor of the smart car is used to provide computing and control capabilities. The memory of the smart car includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the smart car is used to communicate with an external car through a network connection. When the computer program is executed by the processor, a method for intelligent reminder of the door opening based on the car is implemented. The database of the smart car is used to store an intelligent reminder program for the door opening based on the car.

[0145] Those skilled in the art will understand that Figure 4 The principle block diagram shown in the figure is only a block diagram of a partial structure related to the solution of the present invention, and does not constitute a limitation on the smart car to which the solution of the present invention is applied. A specific smart car may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0146] In one embodiment, a smart car is provided, comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors. The one or more programs include instructions for performing the following operations:

[0147] When a vehicle pre-door opening command is detected, the opening sensor is controlled to detect environmental data in a predetermined range around the door to be opened;

[0148] Perform real-time analysis on the detected environmental data of the predetermined range around the door to be opened, and determine whether there are pedestrians or objects currently within the predetermined range around the door to be opened, or determine whether they will enter the predetermined range around the door to be opened at a predetermined time;

[0149] When it is determined that there is a pedestrian or object within the predetermined range around the door to be opened, or when it is determined that a pedestrian or object enters the predetermined range around the door to be opened at a predetermined time, the control issues a door opening risk prompt and automatically keeps the door locked;

[0150] When it is determined that there are currently no pedestrians or objects within the predetermined range around the door to be opened, and it is determined that no pedestrians or objects will enter the predetermined range around the door to be opened within a predetermined time, the current safety is confirmed and the lock is released to allow the door to be opened, as described above.

[0151] Wherein, before the step of controlling the opening sensor to detect environmental data in a predetermined range around the door to be opened when the vehicle pre-door opening instruction is detected, the following steps are included:

[0152] When the vehicle is parked and unlocked, it detects that the user's hand touches the door or the door opening switch, automatically triggering the generation of a vehicle pre-door opening command.

[0153] Wherein, before the step of controlling the opening sensor to detect environmental data in a predetermined range around the door to be opened when the vehicle pre-door opening instruction is detected, the following steps are included:

[0154] Ultrasonic sensors are pre-installed on both sides of each door of the car to detect environmental data within a predetermined range around the door;

[0155] Pre-install radar sensors on both sides of each door and / or rear bumper of the vehicle to detect environmental data outside a predetermined range around the door;

[0156] Cameras are pre-installed on the side mirrors or doors of the car to capture long-distance image information outside a predetermined range around the door.

[0157] Wherein, when the vehicle pre-door opening instruction is detected, the step of controlling the opening sensor to detect environmental data in a predetermined range around the door to be opened comprises:

[0158] When a vehicle pre-door opening command is detected, the ultrasonic sensor is controlled to be turned on to detect environmental data within a predetermined range around the door to be opened; the radar sensor is controlled to be turned on to detect environmental data outside the predetermined range around the door to be opened; and the camera is controlled to be turned on to capture long-distance image information outside the predetermined range around the door to be opened.

[0159] The step of performing real-time analysis on the detected environmental data in the predetermined range around the door to be opened to determine whether a pedestrian or object is currently within the predetermined range around the door to be opened, or will enter the predetermined range around the door to be opened at a predetermined time includes:

[0160] Receive environmental data within a predetermined range around the door to be opened detected by the ultrasonic sensor, environmental data outside the predetermined range around the door to be opened detected by the radar sensor, and long-distance image information outside the predetermined range around the door to be opened captured by the camera;

[0161] Real-time comprehensive analysis is performed on the received environmental data within the predetermined range around the door to be opened, the environmental data outside the predetermined range around the door to be opened, and the long-distance image information outside the predetermined range around the door to be opened, to determine whether there are pedestrians or objects within the predetermined range around the door to be opened, or to determine whether they will enter the predetermined range around the door to be opened at a predetermined time.

[0162] The step of controlling the door opening risk prompt and automatically keeping the door locked when it is determined that a pedestrian or an object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or an object enters a predetermined range around the door to be opened at a predetermined time, comprises:

[0163] When it is determined that a pedestrian or object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or object enters the predetermined range around the door to be opened at a predetermined time, the vehicle's built-in speaker is controlled to issue a voice door opening risk warning, the lights inside and / or outside the vehicle are controlled to flash and / or change color to issue a door opening risk warning, the vehicle's onboard display screen is controlled to display a text door opening risk warning, and the door is automatically kept locked.

[0164] Wherein, after the step of confirming that it is currently safe and unlocking the door to allow it to be opened when it is determined that there are no pedestrians or objects within the predetermined range around the door to be opened and it is determined that no pedestrians or objects will enter the predetermined range around the door to be opened within a predetermined time, the step further includes:

[0165] When the current safety is confirmed and the lock is released to allow the door to be opened, the user is reminded by voice to continue to pay more attention when opening the door, as described above.

[0166] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0167] In summary, the present invention provides a method, device, smart car and storage medium for intelligent door opening reminder based on a car. The present invention can detect the surrounding environment before the passenger attempts to open the door, and issue a warning in time when there is a potential danger, thereby greatly reducing the possibility of accidents caused by mistaken door opening and improving road traffic safety. The present invention also has the following advantages:

[0168] 1) It has comprehensive environmental perception capabilities and high detection accuracy. It uses a variety of sensors (ultrasonic, infrared, and cameras) to comprehensively perceive the environment around the door to be opened to improve detection accuracy.

[0169] 2) With intelligent decision-making capabilities, the central processing unit can perform intelligent analysis based on sensor data and accurately determine whether there is potential danger.

[0170] 3) It can provide multi-modal prompts to warn passengers through sound, light, touch and other means to ensure that passengers can notice the danger in time.

[0171] 4) In high-risk situations, the doors are automatically locked to further ensure the safety of passengers and pedestrians.

Claims

1. A vehicle door opening intelligent reminder method, characterized in that: include: When a vehicle pre-door opening command is detected, the opening sensor is controlled to detect environmental data in a predetermined range around the door to be opened; Perform real-time analysis on the detected environmental data of the predetermined range around the door to be opened, and determine whether there are pedestrians or objects currently within the predetermined range around the door to be opened, or determine whether they will enter the predetermined range around the door to be opened at a predetermined time; When it is determined that there is a pedestrian or object within the predetermined range around the door to be opened, or when it is determined that a pedestrian or object enters the predetermined range around the door to be opened at a predetermined time, the control issues a door opening risk prompt and automatically keeps the door locked; When it is determined that there are no pedestrians or objects within the predetermined range around the door to be opened, and it is determined that no pedestrians or objects will enter the predetermined range around the door to be opened within a predetermined time, the current safety is confirmed and the lock is released to allow the door to be opened.

2. The vehicle door opening intelligent reminder method according to claim 1, characterized in that: The step of controlling the opening sensor to detect environmental data in a predetermined range around the door to be opened when the vehicle pre-door opening instruction is detected comprises: When the vehicle is parked and unlocked, it detects that the user's hand touches the door or the door opening switch, automatically triggering the generation of a vehicle pre-door opening command.

3. The vehicle door opening intelligent reminder method according to claim 1, characterized in that: The step of controlling the opening sensor to detect environmental data in a predetermined range around the door to be opened when the vehicle pre-door opening instruction is detected comprises: Ultrasonic sensors are pre-installed on both sides of each door of the car to detect environmental data within a predetermined range around the door; Pre-install radar sensors on both sides of each door and / or rear bumper of the vehicle to detect environmental data outside a predetermined range around the door; Cameras are pre-installed on the side mirrors or doors of the car to capture long-distance image information outside a predetermined range around the door.

4. The vehicle door opening intelligent reminder method according to claim 3 is characterized in that: The step of controlling the opening sensor to detect environmental data in a predetermined range around the door to be opened when the vehicle pre-door opening instruction is detected comprises: When a vehicle pre-door opening command is detected, the ultrasonic sensor is controlled to be turned on to detect environmental data within a predetermined range around the door to be opened; the radar sensor is controlled to be turned on to detect environmental data outside the predetermined range around the door to be opened; and the camera is controlled to be turned on to capture long-distance image information outside the predetermined range around the door to be opened.

5. The vehicle door opening intelligent reminder method according to claim 4 is characterized in that: The step of analyzing the detected environmental data of the predetermined range around the door to be opened in real time to determine whether there is a pedestrian or object currently within the predetermined range around the door to be opened, or determining whether a pedestrian or object will enter the predetermined range around the door to be opened at a predetermined time includes: Receive environmental data within a predetermined range around the door to be opened detected by the ultrasonic sensor, environmental data outside the predetermined range around the door to be opened detected by the radar sensor, and long-distance image information outside the predetermined range around the door to be opened captured by the camera; Real-time comprehensive analysis is performed on the received environmental data within the predetermined range around the door to be opened, the environmental data outside the predetermined range around the door to be opened, and the long-distance image information outside the predetermined range around the door to be opened, to determine whether there are pedestrians or objects within the predetermined range around the door to be opened, or to determine whether they will enter the predetermined range around the door to be opened at a predetermined time.

6. The vehicle door opening intelligent reminder method according to claim 1, characterized in that: The step of controlling the door opening risk prompt and automatically keeping the door locked when it is determined that a pedestrian or an object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or an object enters the predetermined range around the door to be opened at a predetermined time, comprises: When it is determined that a pedestrian or object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or object enters the predetermined range around the door to be opened at a predetermined time, the vehicle's built-in speaker is controlled to issue a voice door opening risk warning, the lights inside and / or outside the vehicle are controlled to flash and / or change color to issue a door opening risk warning, the vehicle's onboard display screen is controlled to display a text door opening risk warning, and the door is automatically kept locked.

7. The vehicle door opening intelligent reminder method according to claim 1, characterized in that: After the step of confirming that it is safe and unlocking the door to allow it to be opened when it is determined that there are no pedestrians or objects within the predetermined range around the door to be opened and it is determined that no pedestrians or objects will enter the predetermined range around the door to be opened within a predetermined time, the step further includes: When the current safety is confirmed and the lock is released to allow the door to be opened, the user is reminded through voice to continue to pay more attention when opening the door.

8. A car door opening intelligent reminder device, characterized in that: The device comprises: The vehicle pre-door opening detection module is used to automatically trigger the generation of a vehicle pre-door opening instruction when the user touches the door or the door opening switch when the vehicle is parked and unlocked; A door-to-open environment detection control module, which is used to control the opening sensor to detect environmental data in a predetermined range around the door to be opened when a vehicle pre-door opening instruction is detected; An analysis and judgment module is used to perform real-time analysis on the environmental data detected in the predetermined range around the door to be opened, and to judge whether there are pedestrians or objects in the predetermined range around the door to be opened, or whether they will enter the predetermined range around the door to be opened at a predetermined time; A risk warning control module is used to control the issuance of a door opening risk warning and automatically keep the door locked when it is determined that a pedestrian or object is currently within a predetermined range around the door to be opened, or when it is determined that a pedestrian or object enters the predetermined range around the door to be opened at a predetermined time; A confirmation module is installed to confirm current safety and unlock the door to allow it to be opened when it is determined that there are no pedestrians or objects within a predetermined range around the door to be opened and that no pedestrians or objects will enter the predetermined range around the door to be opened within a predetermined time.

9. A smart car, characterized in that: The device comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, and the one or more programs include being used to execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method as described in any one of claims 1 to 7.

Images