Method, device and equipment for coping with door opening collision risk of new energy automobile and storage medium

Abstract

The invention discloses a new energy automobile door opening collision risk coping method, device and equipment and a storage medium, and relates to the technical field of vehicle safety control. The method for coping with the door opening collision risk of the new energy automobile comprises the steps that a state signal of the new energy automobile, an automobile door operation signal and radar detection data of a side rear moving target are obtained, and whether the door opening collision risk condition is met or not is judged based on the state signal, the automobile door operation signal and the radar detection data; when the door opening collision risk condition is met, early warning reminding is carried out, and an image acquisition device is awakened to acquire image data; fusing the image data and the detection data to generate fusion record information; and transmitting the fusion record information to a remote service platform. The capability of the new energy vehicle to cope with the door opening collision risk can be improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicle safety control, in particular to a new energy vehicle door opening collision risk response method, device, equipment and storage medium. BACKGROUND

[0002] At present, for the safety hidden trouble problem of new energy vehicle door opening collision, the blind area monitoring system based on radar or camera issues a warning to the driver when the vehicle is driving or temporarily parked. However, such a solution mainly serves the lane changing scene during driving, and its warning logic has low correlation with the passenger opening door behavior, and it usually stops working after the vehicle is parked. Moreover, even if part of the system can provide a warning after parking, it only stays at the level of instant reminder and cannot automatically and reliably record and fix the evidence after the collision actually occurs, resulting in difficult subsequent responsibility and long processing flow. It can be seen that the ability of these solutions to respond to door opening collision risk is not high. Therefore, how to improve the ability of new energy vehicles to respond to door opening collision risk is still a problem to be solved.

[0003] The above content is only used to assist in understanding the technical solutions of the present application and does not represent the acknowledgement of the above content as prior art. SUMMARY

[0004] The main purpose of the present application is to provide a new energy vehicle door opening collision risk response method, device, equipment and storage medium, aiming to solve the technical problem of how to improve the ability of new energy vehicles to respond to door opening collision risk.

[0005] To achieve the above purpose, the present application provides a new energy vehicle door opening collision risk response method, which comprises: Obtaining the state signal of the new energy vehicle, the door operation signal and the radar detection data of the side rear moving target, and judging whether the door opening collision risk condition is met based on the state signal, the door operation signal and the radar detection data; When the door opening collision risk condition is met, a warning is given and an image acquisition device is awakened to acquire image data; Fusing the image data and the detection data to generate fusion record information; Transmitting the fusion record information to a remote service platform.

[0006] In an embodiment, the step of judging whether the door opening collision risk condition is met based on the state signal, the door operation signal and the radar detection data comprises: According to the state signal, it is confirmed whether the new energy vehicle is in a parked state; According to the radar detection data, the predicted arrival time of the side rear moving target is calculated; determining whether there is an intention to open the door according to the door operation signal; When the new energy vehicle is in a parking state, the predicted arrival time is less than a preset threshold, and there is an intention to open the door, it is determined that the opening-door collision risk condition is met, otherwise it is determined that the opening-door collision risk condition is not met.

[0007] In an embodiment, the step of performing a pre-warning reminder comprises: playing a preset warning sound using a vehicle-mounted sound system to achieve auditory pre-warning; presenting a warning icon and warning text using a vehicle-mounted display interface to achieve visual pre-warning; controlling a door handle in the vehicle to vibrate to achieve tactile pre-warning.

[0008] In an embodiment, before the step of collecting image data by the wake-up image collection device, the method further comprises: determining the azimuth information of the side-rear moving target according to the radar detection data; determining a target camera as the image collection device according to the azimuth information.

[0009] In an embodiment, the step of fusing the image data and the detection data to generate fusion record information comprises: obtaining the moving distance and speed information of the side-rear moving target according to the detection data; synchronizing the moving distance and speed information with the image data in time and space to generate fusion record information in the form of a video file.

[0010] In an embodiment, before the step of transmitting the fusion record information to a remote service platform, the method further comprises: determining a retention start time and a retention end time according to whether a collision occurs; cutting the fusion record information according to the retention start time and the retention end time to obtain cut fusion record information.

[0011] In an embodiment, after the step of determining whether the opening-door collision risk condition is met, the method further comprises: if the determination result is that the opening-door collision risk condition is not met, then determining whether there is a side-rear moving target according to the radar detection data; if there is a side-rear moving target, performing initial pre-warning.

[0012] In addition, to achieve the above-mentioned purpose, the application further provides a new energy vehicle opening-door collision risk coping device, which comprises: The judgment module is configured to acquire a state signal of the new energy vehicle, a door operation signal, and radar detection data of a side rear moving target, and judge whether a door opening collision risk condition is met based on the state signal, the door operation signal, and the radar detection data. The collection module is configured to perform early warning and wake up an image collection device to collect image data when the door opening collision risk condition is met. The fusion module is configured to fuse the image data and the detection data to generate fusion record information. The transmission module is configured to transmit the fusion record information to a remote service platform.

[0013] In addition, to achieve the above-mentioned purpose, the present application also provides a device for responding to a door opening collision risk of a new energy vehicle, which comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, and the computer program is configured to implement the steps of the method for responding to a door opening collision risk of a new energy vehicle.

[0014] In addition, to achieve the above-mentioned purpose, the present application also provides a storage medium, which is a computer readable storage medium, and the storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the method for responding to a door opening collision risk of a new energy vehicle.

[0015] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which comprises a computer program, and the computer program is executed by a processor to implement the steps of the method for responding to a door opening collision risk of a new energy vehicle.

[0016] The present application provides a method for responding to a door opening collision risk of a new energy vehicle. The present application acquires a state signal of the new energy vehicle, a door operation signal, and radar detection data of a side rear moving target, and judges whether a door opening collision risk condition is met based on the state signal, the door operation signal, and the radar detection data. When the door opening collision risk condition is met, early warning is performed, and an image collection device is woken up to collect image data. The image data and the detection data are fused to generate fusion record information. The fusion record information is transmitted to a remote service platform. The present application acquires multi-source perception data and intelligently judges a door opening collision risk condition. When the risk is triggered, early warning and image collection are simultaneously performed, and then fusion spatio-temporal correlation record information is generated and remotely transmitted, so that a full-process closed-loop management from risk early warning to reliable evidence preservation is realized, and the ability of the new energy vehicle to respond to a door opening collision risk is comprehensively improved. BRIEF DESCRIPTION OF DRAWINGS

[0017] The accompanying drawings, which are incorporated herein and constitute part of the specification, illustrate embodiments consistent with the application and, together with the description, further serve to explain the principles of the application.

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, those skilled in the art can obtain other drawings from these drawings without creative effort.

[0019] Figure 1 The flowchart provided by the method for responding to the opening door collision risk of the new energy vehicle in Embodiment One of the present application; Figure 2 The flowchart provided by the method for responding to the opening door collision risk of the new energy vehicle in Embodiment Two of the present application; Figure 3 The brief flowchart of the method for responding to the opening door collision risk of the new energy vehicle provided by Embodiment One of the present application; Figure 4 The module structure diagram of the device for responding to the opening door collision risk of the new energy vehicle in the embodiment of the present application; Figure 5 The device structure diagram of the hardware running environment involved in the method for responding to the opening door collision risk of the new energy vehicle in the embodiment of the present application.

[0020] The purpose implementation, functional features and advantages of the present application will be further explained with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0021] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application, and are not used to limit the present application.

[0022] In order to better understand the technical solutions of the present application, the following will be described in detail in combination with the drawings in the specification and the specific embodiments.

[0023] The present application obtains the state signal of the new energy vehicle, the door operation signal and the radar detection data of the side rear moving target, and judges whether the opening door collision risk condition is met based on the state signal, the door operation signal and the radar detection data; when the opening door collision risk condition is met, a warning is given and an image acquisition device is awakened to collect image data; the image data and the detection data are fused to generate fusion record information; and the fusion record information is transmitted to a remote service platform.

[0024] At present, in view of the safety hidden trouble problem of new energy vehicle door opening collision, the blind area monitoring system based on radar or camera sends a warning to the driver when the vehicle is driving or temporarily parked. However, such a solution mainly serves the lane changing scene during driving, and its warning logic has low correlation with the passenger opening door behavior, and it usually stops working after the vehicle is parked. Moreover, even if part of the system can provide a warning after parking, it only stays at the level of instant reminder and cannot automatically and reliably record and fix the evidence after the collision actually occurs, leading to difficult subsequent responsibility determination and long processing flow. It can be seen that the ability of these solutions to cope with the door opening collision risk is not high. Therefore, how to improve the ability of new energy vehicles to cope with the door opening collision risk is still a problem to be solved.

[0025] The present application obtains multi-source perception data and intelligently judges the door opening collision risk condition, synchronously executes warning and image acquisition when the risk is triggered, and then generates and remotely transmits the record information fused with the space-time correlation, so as to realize the whole-process closed-loop management from risk warning to reliable evidence preservation, and comprehensively improve the ability of new energy vehicles to cope with the door opening collision risk.

[0026] Based on this, the embodiment of the present application provides a new energy vehicle door opening collision risk coping method, referring to Figure 1 , Figure 1 The flowchart of the first embodiment of the new energy vehicle door opening collision risk coping method of the present application.

[0027] In this embodiment, the new energy vehicle door opening collision risk coping method includes steps S10-S40: Step S10: Obtain the state signal of the new energy vehicle, the door operation signal and the radar detection data of the side rear moving target, and judge whether the door opening collision risk condition is met based on the state signal, the door operation signal and the radar detection data; It should be noted that the execution subject of the present embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a new energy vehicle door opening collision risk coping device, etc. Hereinafter, the new energy vehicle door opening collision risk coping device is taken as an example to describe the present embodiment and the following embodiments.

[0028] It should be noted that the state signal represents the current state of the vehicle, including the vehicle being in P gear, being in the off state, or the vehicle being unlocked and in the unlocked state. When the vehicle is in these two states, the system enters a low-power standby mode, which can be detected by the millimeter wave radar. The camera is in a dormant state to save energy and protect privacy. The domain controller of the vehicle continuously receives various signals from the vehicle network. Specifically, the gear signal (P gear) is obtained from the vehicle controller as the state signal; the trigger signal is obtained from the four door handle micro-switch or capacitive sensor as the door operation signal; the millimeter wave radar installed on the left and right rear of the vehicle continuously scans, and sends the distance, speed, and azimuth information of the detected target within a range of 70 meters to the domain controller as radar detection data. The judgment logic module in the domain controller analyzes the three types of input signals in real time to determine whether the opening door collision risk condition is met.

[0029] In a feasible manner, after the step of determining whether the opening door collision risk condition is met, the method further comprises: if the result of the determination is that the opening door collision risk condition is not met, then determining whether there is a moving target at the rear side according to the radar detection data; and if there is a moving target at the rear side, performing initial warning.

[0030] It should be noted that if the final determination result is that the opening door collision risk condition is not met, it also needs to be decided according to the specific situation whether to perform warning. If the radar detects a risk target at the rear side of the vehicle, even if the user has no intention to open the door, a reminder can still be given. Specifically, a slight flashing of the blind area warning light on the rearview mirror can be used as a gentle reminder.

[0031] Step S20: When the opening door collision risk condition is met, a warning reminder is performed and an image acquisition device is awakened to acquire image data; It should be noted that when the opening door collision risk condition is met, the controller immediately performs two parallel operations, the first is to send instructions to the execution layer to perform a preset warning program through devices such as the vehicle audio and the instrument panel. The second is to awaken the image acquisition device, such as the side rearview camera, to perform video acquisition and obtain image data.

[0032] In a feasible manner, the step of performing a warning reminder comprises: playing a preset warning sound using the vehicle audio to achieve auditory warning; presenting a warning icon and warning text using the vehicle display interface to achieve visual warning; and controlling the door handle to vibrate to achieve tactile warning.

[0033] It should be noted that the auditory pre-warning can be specifically an urgent "beep beep beep" warning sound emitted by the in-vehicle audio; the visual pre-warning can be a red warning icon and the text "be careful of the car behind!" displayed on the instrument panel or door panel screen; the tactile pre-warning can cause the door handle inside the vehicle door to vibrate slightly. Through various pre-warning methods to remind the user, the user's alertness can be improved, thereby reducing the probability of collision accidents.

[0034] In a feasible manner, before the step of collecting image data by the wake-up image collection device, the method further comprises: determining the azimuth information of the rear-side moving target according to the radar detection data; and determining the target camera as the image collection device according to the azimuth information.

[0035] It should be noted that in the process of judging the risk condition, the millimeter wave radar provides not only the distance and speed but also the horizontal azimuth angle of the target. According to the angle information, the domain controller can determine whether the risk target is located in the left rear area of the vehicle (such as the azimuth angle is positive) or the right rear area. The vehicle-mounted 360-degree surround view system usually includes side-view cameras below the left and right rearview mirrors. If the risk target is located in the left rear area, the domain controller wakes up the left rear side-view camera; if it is located in the right rear area, the domain controller wakes up the right rear side-view camera.

[0036] Step S30: fusing the image data and the detection data to generate fusion record information; It should be noted that fusing the image data and the detection data is to time and space align the two kinds of data to ensure that the various information in the finally generated video file is accurate and correct, so as to obtain more sufficient and comprehensive fusion record information. For example, the domain controller time and space synchronizes the target data (distance, speed) obtained by the radar and the video stream, and finally generates an "enhanced evidence video" with data superposition.

[0037] In a feasible manner, the step of fusing the image data and the detection data to generate fusion record information comprises: acquiring the moving distance and speed information of the rear-side moving target according to the detection data; and time and space synchronizing the moving distance and speed information with the image data to generate video file type fusion record information.

[0038] It should be noted that the real-time distance and real-time speed of the risk target can be determined from the detection data of the radar, and then the real-time distance and real-time speed are bound with the video frames collected by the camera at the same time. Specifically, these numerical values can be displayed in the form of a semi-transparent text box superimposed on the corresponding position area of the risk target in the video picture by a graphic rendering engine, and it is ensured that the numerical values in each frame of picture change in real time with the radar data update. Finally, this processed video sequence is encapsulated into an independent video file, which is the final fusion record information.

[0039] Step S40: transmitting the fusion record information to a remote service platform.

[0040] It should be noted that the encoder in the domain controller can encode and compress the video data (usually a short video of several minutes) in H.265 to minimize data traffic, and then wake up the remote information processing controller (T-Box) to package and upload the compressed video file, sensor log, vehicle status, timestamp, GPS position and other information to the cloud server through the vehicle network. After the cloud server receives the data, it immediately sends a push notification to the owner's mobile phone App, such as: "Your vehicle detects a door opening collision risk, click to view details". The owner of the vehicle that has been hit can click the mobile phone App push to immediately play or download the recorded video online. The video screen can superimpose information such as the distance of the oncoming vehicle, relative speed, time, etc., providing irrefutable evidence for accident liability determination. The owner can also share the evidence with the insurance company or traffic police through the App In a feasible manner, before the step of transmitting the fusion record information to the remote service platform, the method further includes: determining a retention start time and a retention end time according to whether a collision occurs; and intercepting the fusion record information according to the retention start time and the retention end time to obtain intercepted fusion record information.

[0041] It should be noted that the video requirements for retention are different for the two cases of collision and no collision. If the user stops opening the door after the warning, the risk target drives away. The system retains a period of video before and after the trigger (such as 10 seconds before the trigger + 5 seconds after the trigger), and marks it as a pre-warning event. If the door is still opened and a collision occurs with the oncoming vehicle despite the warning. The collision signal (which can be confirmed by the door acceleration sensor or airbag sensor) will immediately trigger the "event data recorder" function. The system will lock the video and data of the key time period before and after the collision (for example, 15 seconds before the collision to 5 seconds after the collision), preventing it from being overwritten by subsequent loop recording. This data is considered "black box" data and has the highest priority.

[0042] The embodiment obtains a state signal of a new energy vehicle, a door operation signal, and radar detection data of a side rear moving target, and determines whether a door opening collision risk condition is met based on the state signal, the door operation signal, and the radar detection data; when the door opening collision risk condition is met, a warning is given and an image acquisition device is woken up to acquire image data; the image data and the detection data are fused to generate fusion record information; and the fusion record information is transmitted to a remote service platform. The embodiment acquires multi-source perception data and intelligently determines a door opening collision risk condition, synchronously performs warning and image acquisition when the risk is triggered, and further generates and remotely transmits record information associated with fusion space and time, so that full-process closed-loop management from risk warning to reliable evidence preservation is realized, and the ability of the new energy vehicle to cope with a door opening collision risk is improved.

[0043] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as the above embodiment one can refer to the above introduction, and the subsequent will not be described in detail. On this basis, please refer to Figure 2 , step S10 further includes steps S101-S104: Step S101: determining whether the new energy vehicle is in a parking state according to the state signal; It should be noted that the scenario of collision of the vehicle door is that the driver or passenger gets off the vehicle and collides with passing pedestrians when parking, so it can be determined first whether the vehicle is in a parking state. Specifically, gear information of the vehicle can be acquired, and if the gear is P, it indicates that the vehicle is in a parking state.

[0044] Step S102: calculating the predicted arrival time of the side rear moving target according to the radar detection data; It should be noted that for each side rear moving target detected by the radar, the predicted arrival time of the moving target to arrive at the side of the vehicle is calculated according to the current relative distance and the approaching speed (radial speed) of the moving target.

[0045] Step S103: determining whether there is a door opening intention according to the door operation signal; It should be noted that whether there is a door opening intention can be detected in various ways. For example, detecting the action of the driver or passenger manually unlocking the door can be regarded as having a door opening intention; when the capacitive sensing sensor of the in-vehicle handle senses a touch signal, it can be regarded as having a door opening intention; the in-vehicle camera recognizes the action of the passenger turning around and preparing to get off the vehicle, which can be regarded as having a door opening intention.

[0046] Step S104: when the new energy vehicle is in a parking state, the predicted arrival time is less than a preset threshold, and there is a door opening intention, it is determined that the door opening collision risk condition is met, otherwise it is determined that the door opening collision risk condition is not met.

[0047] It should be noted that when all conditions are met, it is determined that the door opening collision risk condition is met, otherwise it is determined that the door opening collision risk condition is not met. In this way, the false trigger rate can be reduced and the user experience can be improved.

[0048] The embodiment determines whether the new energy vehicle is in a parking state according to the state signal; calculates the predicted arrival time of the side rear moving target according to the radar detection data; determines whether there is an intention to open the door according to the door operation signal; and when the new energy vehicle is in a parking state, the predicted arrival time is less than a preset threshold, and there is an intention to open the door, it is determined that the door opening collision risk condition is met, otherwise it is determined that the door opening collision risk condition is not met. The embodiment jointly determines whether there is a door collision risk through multiple ways, which can improve the accuracy of the determination result, thereby reducing the false trigger rate and improving the user experience.

[0049] Exemplarily, in order to facilitate understanding of the implementation process of the new energy vehicle door opening collision risk coping method obtained after the above-mentioned embodiment one, please refer to Figure 3 , Figure 3 A brief flowchart of a new energy vehicle door opening collision risk coping method is provided, specifically: the perception layer includes a door state sensor detecting a car or door lock, a side rear view camera in low-power sleep, waiting for wake-up, and a millimeter wave radar continuously detecting. The specific device of the decision layer can be a domain controller. In the decision layer, the opening intention detected by the door state sensor and the moving target detected by the millimeter wave radar are received, and risk logic judgment is performed through gear, moving target detection result, and opening intention detection result. When it is determined that there is a risk, the action of the execution and recording layer is triggered and the in-vehicle human-computer interaction in the user interaction layer is triggered synchronously to perform sound, light, and tactile warning actions. The execution and recording layer wakes up the side rear view camera and records video to obtain video data, performs data fusion based on the video data and radar data, then performs local storage and cyclic recording, and performs time locking and anti-overlap. The communication and cloud layer is transmitted to the cloud platform by the vehicle network through the vehicle remote information processing controller (T-BOX), and the cloud service platform is responsible for receiving and storing. Then the cloud service platform pushes the alarm information and video data to the mobile phone APP.

[0050] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the new energy vehicle door opening collision risk coping method of the present application. Based on this technical concept, more forms of simple transformation are within the protection scope of the present application.

[0051] The present application also provides a new energy vehicle door opening collision risk coping device, please refer to Figure 4The new energy vehicle door opening collision risk response device comprises: A judgment module 10 is configured to acquire a state signal of a new energy vehicle, a door operation signal, and radar detection data of a side rear moving target, and determine whether a door opening collision risk condition is met based on the state signal, the door operation signal, and the radar detection data. A collection module 20 is configured to perform early warning and wake up an image collection device to collect image data when the door opening collision risk condition is met. A fusion module 30 is configured to fuse the image data and the detection data to generate fusion record information. A transmission module 40 is configured to transmit the fusion record information to a remote service platform.

[0052] In this embodiment, the state signal of the new energy vehicle, the door operation signal, and the radar detection data of the side rear moving target are acquired, and whether the door opening collision risk condition is met is determined based on the state signal, the door operation signal, and the radar detection data. When the door opening collision risk condition is met, early warning is performed and the image collection device is woken up to collect image data. The image data and the detection data are fused to generate fusion record information. The fusion record information is transmitted to the remote service platform. In this embodiment, multi-source perception data is acquired and the door opening collision risk condition is intelligently determined. Early warning and image collection are simultaneously performed when the risk is triggered, and then fusion spatio-temporal correlation record information is generated and remotely transmitted. Therefore, full-process closed-loop management from risk early warning to reliable evidence preservation is realized, and the ability of the new energy vehicle to respond to the door opening collision risk is comprehensively improved.

[0053] In an embodiment, the judgment module 10 is further configured to confirm whether the new energy vehicle is in a parking state according to the state signal, calculate an estimated arrival time of the side rear moving target according to the radar detection data, determine whether there is a door opening intention according to the door operation signal, and determine that the door opening collision risk condition is met when the new energy vehicle is in the parking state, the estimated arrival time is less than a preset threshold, and there is the door opening intention, or determine that the door opening collision risk condition is not met.

[0054] In an embodiment, the collection module 20 is further configured to play a preset warning sound through a vehicle-mounted sound system to realize auditory early warning, present a warning icon and warning text through a vehicle-mounted display interface to realize visual early warning, and control a door handle in the vehicle to vibrate to realize tactile early warning.

[0055] In an embodiment, the collection module 20 is further configured to determine azimuth information of the side rear moving target according to the radar detection data, and determine a target camera as the image collection device according to the azimuth information.

[0056] In an embodiment, the fusion module 30 is further configured to acquire a moving distance and speed information of the rear-side moving target according to the detection data; and perform space-time synchronization between the moving distance and speed information and the image data to generate a fusion record information in a video file type.

[0057] In an embodiment, the transmission module 40 is further configured to determine a retention start time and a retention end time according to whether the collision occurs; and perform interception on the fusion record information according to the retention start time and the retention end time to obtain an intercepted fusion record information.

[0058] In an embodiment, the transmission module 40 is further configured to, if the judgment result is that the door opening collision risk condition is not met, further determine whether there is a rear-side moving target according to the radar detection data; and if there is a rear-side moving target, perform initial pre-warning.

[0059] The new energy vehicle door opening collision risk coping device provided in the present application adopts the new energy vehicle door opening collision risk coping method in the above embodiments, and can solve the technical problem of how to improve the ability of new energy vehicles to cope with door opening collision risks. Compared with the prior art, the new energy vehicle door opening collision risk coping device provided in the present application has the same beneficial effects as the new energy vehicle door opening collision risk coping method provided in the above embodiments, and other technical features in the new energy vehicle door opening collision risk coping device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0060] The present application provides a new energy vehicle door opening collision risk coping device, which comprises at least one processor and a memory in communication connection with the at least one processor. The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the new energy vehicle door opening collision risk coping method in the above embodiment one.

[0061] The following will be described with reference to the drawings Figure 5This document illustrates a structural schematic diagram of a device suitable for mitigating the risk of door collisions in new energy vehicles, as described in the embodiments of this application. The devices for mitigating the risk of door collisions in new energy vehicles, as described in the embodiments of this application, may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital radio receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 5 The device shown for mitigating the risk of collision when a new energy vehicle door is opened is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments in this application.

[0062] like Figure 5 As shown, the device for mitigating the risk of collisions when a new energy vehicle door is opened may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in ROM (Read Only Memory) 1002 or a program loaded from storage device 1003 into RAM (Random Access Memory) 1004. RAM 1004 also stores various programs and data required for the operation of the device for mitigating the risk of collisions when a new energy vehicle door is opened. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via bus 1005. Input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. Communication device 1009 allows the device for responding to the risk of door opening collisions in new energy vehicles to exchange data wirelessly or via wired communication with other devices. Although the figure shows a device for responding to the risk of door opening collisions in new energy vehicles with various systems, it should be understood that it is not required to implement or possess all the systems shown. More or fewer systems may be implemented alternatively.

[0063] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing program codes for executing the method shown in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network through a communication device, or installed from the storage device 1003, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiments disclosed in the present application are executed.

[0064] The new energy vehicle door opening collision risk response device provided by the present application adopts the new energy vehicle door opening collision risk response method in the above embodiment, which can solve the technical problem of how to improve the ability of new energy vehicles to respond to door opening collision risks. Compared with the prior art, the new energy vehicle door opening collision risk response device provided by the present application has the same beneficial effects as the new energy vehicle door opening collision risk response method provided by the above embodiment, and other technical features in the new energy vehicle door opening collision risk response device are the same as the features disclosed in the previous embodiment method, which will not be repeated here.

[0065] It should be understood that various parts of the present application can be realized by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0066] The above is merely a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0067] The present application provides a computer readable storage medium having stored thereon computer readable program instructions (i.e. computer program) for executing the new energy vehicle door opening collision risk response method in the above embodiment.

[0068] The computer readable storage medium provided in the application may be, for example, a U disk, but is not limited to an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, system, or device, or any combination of the above. More specific examples of the computer readable storage medium may include, but are not limited to, an electric connection with one or more conductive wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer readable storage medium can be transmitted by any suitable medium, including but not limited to an electric wire, an optical cable, an RF (Radio Frequency), and the like, or any suitable combination of the above.

[0069] The above computer readable storage medium may be included in the new energy vehicle door opening collision risk response device, or may exist separately and not be assembled into the new energy vehicle door opening collision risk response device.

[0070] The above computer readable storage medium carries one or more programs, when the one or more programs are executed by the new energy vehicle door opening collision risk response device, the new energy vehicle door opening collision risk response device: acquires a state signal of a new energy vehicle, a door operation signal, and radar detection data of a side rear moving target, and judges whether a door opening collision risk condition is met based on the state signal, the door operation signal, and the radar detection data; when the door opening collision risk condition is met, a warning is given and an image acquisition device is awakened to acquire image data; the image data and the detection data are fused to generate fusion record information; and the fusion record information is transmitted to a remote service platform.

[0071] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0072] The flow diagrams and the block diagrams in the drawings are illustrations of architectures, functionalities, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0073] The modules involved in the embodiments of the present application can be implemented in the form of software or in the form of hardware. In some cases, the name of the module does not constitute a limitation on the module itself.

[0074] The readable storage medium provided by the present application is a computer readable storage medium, which stores computer readable program instructions (i.e. computer programs) for executing the new energy vehicle door opening collision risk coping method described above, and can solve the technical problem of how to improve the ability of new energy vehicles to cope with door opening collision risks. Compared with the prior art, the computer readable storage medium provided by the present application has the same beneficial effects as the new energy vehicle door opening collision risk coping method provided by the above-mentioned embodiments, and will not be repeated here.

[0075] The application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the method for coping with the door opening collision risk of a new energy vehicle as described above.

[0076] The computer program product provided by the application can solve the technical problem of how to improve the ability of new energy vehicles to cope with the door opening collision risk. Compared with the prior art, the beneficial effects of the computer program product provided by the application are the same as those of the method for coping with the door opening collision risk of a new energy vehicle provided by the above-mentioned embodiments, and are not described here.

[0077] The above only describes some embodiments of the application, and does not limit the patent scope of the application. Any equivalent structural transformation made by using the content of the application specification and drawings, or direct / indirect application in other related technical fields is included in the patent protection scope of the application.

Claims

1. A method for dealing with the risk of door opening collision of a new energy vehicle, characterized in that, The method comprises: acquiring a state signal of a new energy vehicle, a door operation signal, and radar detection data of a side rear moving target, and determining whether a door opening collision risk condition is met based on the state signal, the door operation signal, and the radar detection data; when the door opening collision risk condition is met, performing early warning and waking up an image acquisition device to acquire image data; fusing the image data and the detection data to generate fusion record information; transmitting the fusion record information to a remote service platform.

2. The method of claim 1, wherein, The step of determining whether the door opening collision risk condition is met based on the state signal, the door operation signal, and the radar detection data comprises: determining whether the new energy vehicle is in a parking state according to the state signal; calculating an estimated arrival time of the side rear moving target according to the radar detection data; determining whether there is a door opening intention according to the door operation signal; when the new energy vehicle is in the parking state, the estimated arrival time is less than a preset threshold, and there is the door opening intention, it is determined that the door opening collision risk condition is met, otherwise it is determined that the door opening collision risk condition is not met.

3. The method of claim 1, wherein, The step of performing early warning comprises: playing a preset warning sound through a vehicle-mounted sound system to realize auditory early warning; presenting a warning icon and warning text through a vehicle-mounted display interface to realize visual early warning; controlling a door handle in the vehicle to vibrate to realize tactile early warning.

4. The method of claim 1, wherein, Before the step of waking up the image acquisition device to acquire image data, the method further comprises: determining orientation information of the side rear moving target according to the radar detection data; determining a target camera as the image acquisition device according to the orientation information.

5. The method of claim 1, wherein, The step of fusing the image data and the detection data to generate fusion record information comprises: acquiring moving distance and speed information of the side rear moving target according to the detection data; synchronizing the moving distance and speed information with the image data in time and space to generate fusion record information in a video file type.

6. The method of claim 1, wherein, Before the step of transmitting the fusion record information to the remote service platform, the method further comprises: determining a retention start time and a retention end time according to whether a collision occurs; performing interception on the fusion record information according to the retention start time and the retention end time to obtain intercepted fusion record information.

7. The method of claim 1, wherein, After the step of determining whether the door opening collision risk condition is met, the method further comprises: if the determination result is that the door opening collision risk condition is not met, then determining whether there is a side rear moving target according to the radar detection data again; if there is a side rear moving target, performing initial early warning.

8. A new energy vehicle door opening collision risk response device, characterized in that, The device comprises: a determination module configured to acquire a state signal of a new energy vehicle, a door operation signal, and radar detection data of a side rear moving target, and determine whether a door opening collision risk condition is met based on the state signal, the door operation signal, and the radar detection data; an acquisition module configured to perform early warning and wake up an image acquisition device to acquire image data when the door opening collision risk condition is met; a fusion module configured to fuse the image data and the detection data to generate fusion record information; a transmission module configured to transmit the fusion record information to a remote service platform. A transmission module is configured to transmit the fusion record information to a remote service platform.

9. A new energy vehicle door opening collision risk coping device, characterized in that, The device comprises a memory, a processor, and a computer program stored on the memory and executable on the processor, and the computer program is configured to implement the steps of the new energy vehicle door opening collision risk coping method according to any one of claims 1 to 7.

10. A storage medium, characterized by The storage medium is a computer readable storage medium, and the storage medium stores a computer program, and the computer program is executed by the processor to implement the new energy vehicle door opening collision risk coping method according to any one of claims 1 to 7.

Images