Passenger injury detection method and device, electronic equipment, vehicle, medium and product

Abstract

The invention discloses a passenger injury detection method and device, electronic equipment, a vehicle, a medium and a product, and relates to the technical field of vehicles, the method comprises the steps that under the condition that vehicle collision is detected, a first image is acquired, and the first image is acquired through a camera arranged in the vehicle; the first image is analyzed, and it is determined that the first contact part of the passenger makes contact with the first contact position of the vehicle; the pressure collected at the first contact position serves as first pressure borne by the first contact part; and determining a first injury part of the passenger and a first injury level corresponding to the first injury part according to the first contact part and the first pressure. The passenger injury detection efficiency can be improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to an occupant injury detection method, device, electronic equipment, vehicle, medium and product. Background Art

[0002] After a serious collision, if the occupants are unable to call for help or cannot accurately determine the extent of their injuries, rescue may be delayed, which in turn has a great impact on the occupants' health or even their lives. Therefore, how to quickly determine the extent of the occupants' injuries and automatically call for help has become increasingly important.

[0003] At present, there are two main methods for detecting occupant injuries: one is to use machine learning algorithms to detect the occupant's injury level, and the other is to predict occupant injuries through deep learning models. However, the computational complexity of these two methods is high, which makes the detection efficiency of occupant injury level low. Summary of the invention

[0004] The embodiments of the present application provide a method, device, electronic equipment, vehicle, medium and product for detecting occupant injury, which can improve the efficiency of detecting occupant injury.

[0005] In a first aspect, an embodiment of the present application provides a method for detecting occupant injury, the method comprising:

[0006] When a collision of the vehicle is detected, acquiring a first image, wherein the first image is collected by a camera disposed inside the vehicle;

[0007] Analyzing the first image to determine that a first contact portion of the occupant is in contact with a first contact position of the vehicle;

[0008] using the pressure collected at the first contact position as the first pressure applied to the first contact portion;

[0009] A first injury site of the occupant and a first injury level corresponding to the first injury site are determined according to the first contact site and the first pressure.

[0010] In an embodiment of the present application, determining the first injury part of the occupant and the first injury level corresponding to the first injury part according to the first contact part and the first pressure includes:

[0011] When the first pressure is greater than or equal to a preset minimum damage pressure of the first contact part, determining the first contact part as the first damage part;

[0012] Matching the first pressure with a plurality of preset pressures in a preset corresponding relationship to obtain a first injury level corresponding to the first injury site;

[0013] The corresponding relationship includes a plurality of preset pressures and a damage level corresponding to each preset pressure.

[0014] In one embodiment of the present application, at least one of the seat belt, seat, dashboard, floor, ceiling and door panel of the vehicle is provided with a pressure sensor;

[0015] The step of using the pressure collected at the first contact position as the first pressure applied to the first contact portion includes:

[0016] Determine a first pressure sensor from the plurality of pressure sensors, wherein the first pressure sensor is a pressure sensor that is closest to the first contact position, or the first pressure sensor is a pressure sensor that is within a preset range of the first contact position;

[0017] Acquire a maximum pressure value collected by the first pressure sensor within a first preset time period, where the first preset time period is determined according to a moment when a collision of the vehicle is detected;

[0018] The maximum pressure value is used as the first pressure applied to the first contact portion.

[0019] In an embodiment of the present application, after determining the first injury part of the occupant and the first injury level corresponding to the first injury part according to the first contact part and the first pressure, the method further includes:

[0020] When a secondary collision of the vehicle is detected, acquiring a second image, where the second image is collected by the camera after the secondary collision;

[0021] analyzing the second image to determine that a second contact portion of the occupant is in contact with a second contact position of the vehicle;

[0022] using the pressure collected at the second contact position as the second pressure applied to the second contact portion;

[0023] When the second contact position is the same as the first contact position, the first pressure and the second pressure are added to obtain a third pressure;

[0024] According to the third pressure, a damage level corresponding to the third pressure is determined, and the first damage level is updated using the damage level corresponding to the third pressure.

[0025] In an embodiment of the present application, when a collision of the vehicle is detected, before acquiring the first image, the method further includes:

[0026] When the change in the speed of the vehicle within the second preset time period is greater than a preset threshold, determining that the vehicle has collided; and / or

[0027] In the case where the airbag deployment signal is detected, it is determined that the vehicle has collided.

[0028] In an embodiment of the present application, after determining the first injury part of the occupant and the first injury level corresponding to the first injury part according to the first contact part and the first pressure, the method further includes:

[0029] In a case where the first injury level is greater than or equal to a preset level, a rescue request message is sent to a target object, wherein the rescue request message is used to describe the first injury site and the first injury level.

[0030] In a second aspect, an embodiment of the present application provides an occupant injury detection device, the device comprising:

[0031] An image acquisition module, used to acquire a first image when a collision of the vehicle is detected, wherein the first image is acquired by a camera arranged inside the vehicle;

[0032] an image analysis module, configured to analyze the first image to determine that a first contact portion of the occupant is in contact with a first contact position of the vehicle;

[0033] a pressure determination module, configured to use the pressure collected at the first contact position as the first pressure applied to the first contact portion;

[0034] The damage detection module is used to determine a first damage part of the occupant and a first damage level corresponding to the first damage part according to the first contact part and the first pressure.

[0035] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a processor and a memory storing computer program instructions;

[0036] When the processor executes the computer program instructions, the occupant injury detection method as described in the first aspect is implemented.

[0037] In a fourth aspect, an embodiment of the present application provides a vehicle, comprising the electronic device as described in the third aspect.

[0038] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium having computer program instructions stored thereon, and when the computer program instructions are executed by a processor, the occupant injury detection method as described in the first aspect is implemented.

[0039] In a sixth aspect, an embodiment of the present application provides a computer program product. When instructions in the computer program product are executed by an electronic device, the electronic device executes the occupant injury detection method as described in the first aspect.

[0040] The occupant injury detection method, device, electronic device, vehicle, medium and product provided in the embodiments of the present application acquire a first image when a vehicle collision is detected, and analyze the first image to determine that the first contact part of the occupant is in contact with the first contact position of the vehicle, and then use the pressure collected at the first contact position as the first pressure received by the first contact part, and finally determine the first injury part of the occupant and the first injury level corresponding to the first injury part according to the first contact part and the first pressure. Through the above steps, the occupant's injury part and injury level can be calculated through the data collected by the data collection device (e.g., camera, pressure sensor) inside the vehicle after the vehicle collision, and the injury suffered by the occupant in the collision accident can be quickly determined, thereby improving the detection efficiency of occupant injury. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0042] Figure 1 is a flow chart of a method for detecting occupant injury provided by an embodiment of the present application;

[0043] Figure 2a is a schematic diagram of a position between an occupant and a seat provided in an embodiment of the present application;

[0044] Figure 2b is another schematic diagram of the position between the occupant and the seat provided in an embodiment of the present application;

[0045] Figure 3 is another flow chart of the occupant injury detection method provided in an embodiment of the present application;

[0046] Figure 4 is a structural schematic diagram of an occupant injury detection device provided in an embodiment of the present application;

[0047] Figure 5 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0048] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0049] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0050] In each specific implementation of the present application, when it comes to the need to perform relevant processing based on data related to user identity or characteristics such as user information, user behavior data, user historical data, and user location information, the user's permission or consent will be obtained first, and the collection, use, and processing of these data will comply with relevant laws, regulations, and standards. In addition, when the embodiment of the present application needs to obtain the user's sensitive personal information, the user's separate permission or consent will be obtained through a pop-up window or by jumping to a confirmation page. After clearly obtaining the user's separate permission or consent, the necessary user-related data for the normal operation of the disclosed embodiment will be obtained.

[0051] In order to solve the problems of the prior art, the embodiments of the present application provide a method, device, electronic device, vehicle, medium and product for detecting occupant injury. The occupant injury detection method provided by the embodiments of the present application is first introduced below.

[0052] Figure 1 Schematic diagram of a process of detecting occupant injury provided by an embodiment of the present application. Figure 1As shown, the occupant injury detection method provided in the embodiment of the present application is applied to an electronic device, which may be a server or a controller, and includes the following steps 101 to 104, wherein:

[0053] Step 101 , when a vehicle collision is detected, a first image is acquired, wherein the first image is acquired by a camera disposed inside the vehicle.

[0054] One or more cameras may be provided inside the vehicle. There is no limit to the number and location of the camera, as long as it can capture images of all occupant-accessible areas inside the vehicle. In this way, when the electronic device detects that the vehicle has collided, a first image captured by the camera may be acquired. Exemplarily, the first image may be an image captured within a time period after the vehicle has collided, or an image captured at a first preset moment after the vehicle has collided. The time period and the first preset moment may be set according to actual conditions.

[0055] Step 102: Analyze the first image to determine whether a first contact part of the occupant is in contact with a first contact position of the vehicle.

[0056] The first contact part is the part of the human body that is in contact with the interior of the vehicle. The first contact position is the position of the vehicle that is in contact with the first contact part. After acquiring the first image, the electronic device can analyze the first image to determine the part of the occupant's body that is in contact with the components inside the vehicle, that is, the first contact part. For example, the first contact part and the first contact position can be identified by a pre-trained deep learning model. Alternatively, the electronic device can perform occupant feature extraction and vehicle feature extraction based on the first image. Specifically, when performing occupant feature extraction, the electronic device can identify the human body contour of the occupant in the first image through algorithms such as edge detection and contour extraction, and then identify important body parts of the occupant such as the head, shoulders, chest and abdomen, waist, hips, arms, buttocks and legs (including thighs and calves) through a human key point detection algorithm. When extracting vehicle features, the electronic device can similarly identify the outline of the vehicle in the first image through an edge detection algorithm, and identify key vehicle components such as seats, dashboards, and door panels through a vehicle component recognition algorithm, such as a target detection algorithm based on a single neural network, a Single Shot MultiBox Detector (SSD) algorithm, etc. In this way, the electronic device can further analyze the relative positional relationship between the occupant's body parts and the vehicle components to obtain a first contact part and a first contact position.

[0057] Figure 2a It is a schematic diagram of the position between an occupant and a seat provided in an embodiment of the present application. Figure 2b is another schematic diagram of the position between the occupant and the seat provided in the embodiment of the present application. Figure 2a and Figure 2b As shown, after the first image is captured by the camera 8, the first image is analyzed to obtain body parts such as the head 1, hips 2, arms 3, legs 4, buttocks 5, back 6 and / or chest and abdomen 7, and positions of vehicle components such as the ceiling 9, interior panel pillars 10 and / or seat belts 11. After analyzing the relative positional relationship between the body parts of the occupant and the vehicle components, the first contact part and the first contact position can be obtained.

[0058] In one embodiment of the present application, in order to improve the recognition accuracy of the first contact part and the first contact position, before analyzing the first image, the first image may be enhanced to improve the clarity of the first image. In addition, the electronic device may also perform denoising on the first image to remove noise in the first image, such as background clutter, shadows, etc.

[0059] Step 103: Using the pressure collected at the first contact position as the first pressure applied to the first contact portion.

[0060] The vehicle is provided with a pressure sensor. The pressure applied to various positions inside the vehicle can be collected through the pressure sensor. After the first contact portion contacts the first contact position, the pressure applied to the first contact position can be collected through the pressure sensor provided at the first contact position. It can be seen that the action of force is mutual. When it is determined that the first contact portion of the occupant is in contact with the first contact position of the vehicle, since the pressure applied to the first contact position is applied by the first contact portion, the first contact position will also apply a force to the first contact portion. At this time, the pressure at the first contact position is equal to the value of the pressure at the first contact portion. Therefore, the pressure collected at the first contact position can be used as the first pressure applied to the first contact portion. In this way, the first pressure applied to the first contact portion can be determined so that occupant injury detection can be performed subsequently based on the first pressure.

[0061] Step 104: Determine a first injury site of the occupant and a first injury level corresponding to the first injury site based on the first contact site and the first pressure.

[0062] The first damaged part is a body part damaged by a vehicle collision. The first contact part is a human body part that contacts a component inside the vehicle. There is a possibility that the first contact part is not damaged, so it is necessary to further determine whether the first contact part is damaged. Exemplarily, based on the first image, the electronic device can determine whether the first contact part is damaged. For example, through a pre-trained deep learning model, the color features, shape features, and texture features of the first contact part in the first image can be extracted to obtain a judgment result of whether there is a blood flow phenomenon in the first contact part. If there is a blood flow phenomenon in the first contact part, the first contact part can be determined as the first damaged part. In addition, it is also possible to determine whether the first contact part is damaged according to the first pressure. Specifically, the minimum damage pressure corresponding to each body part of the occupant can be predetermined. The minimum damage pressure corresponding to each body part can be determined experimentally, or it can be set according to the pressure and damage suffered by the occupant in a historical collision accident. Then, according to the first contact part, the minimum damage pressure corresponding to the first contact part can be obtained. The electronic device can compare the first pressure with the minimum damage pressure corresponding to the first contact part. If the first pressure is less than the minimum damage pressure corresponding to the first contact part, it is determined that the first contact part is not damaged. If the first pressure is greater than or equal to the minimum damage pressure corresponding to the first contact portion, the first contact portion is determined as the first damage portion.

[0063] The injury level can be divided according to the actual situation. For example, it can be divided into minor injuries, light injuries, serious injuries and critically ill. For minor injuries and serious injuries, multiple sub-levels can be further divided, such as minor injuries at level one and minor injuries at level two, or serious injuries at level one and serious injuries at level two. Alternatively, it can be divided into level one injury, level two injury, level three injury, level four injury and level five injury, and the severity of the injury decreases step by step from level one injury to level five injury. Moreover, for different parts of the body, the assessment criteria for the corresponding injury levels are also different, which can be determined in combination with the existing injury assessment criteria and the degree of injury of each part of the occupant's body when subjected to different impact forces. In this way, after determining the first injury site, the first injury level corresponding to the first injury site can be determined according to the first pressure, thereby completing the rapid detection process of occupant injuries.

[0064] Steps 101 to 104 shown in the embodiment of the present application, when a collision of the vehicle is detected, obtain a first image, analyze the first image, determine that the first contact part of the occupant is in contact with the first contact position of the vehicle, then use the pressure collected at the first contact position as the first pressure received by the first contact part, and finally determine the first injury part of the occupant and the first injury level corresponding to the first injury part based on the first contact part and the first pressure. Through the above steps, the injury part and injury level of the occupant can be calculated through the data collected by the data collection equipment (e.g., camera, pressure sensor) inside the vehicle after the vehicle collision, and the injury suffered by the occupant in the collision accident can be quickly determined, thereby improving the detection efficiency of occupant injury.

[0065] In addition, compared with the existing method of damage detection through machine learning algorithms or models, the occupant injury detection method provided in the embodiment of the present application does not require a large amount of data for model training, which not only reduces the amount of data collected, but also reduces the computational complexity.

[0066] In one embodiment of the present application, in step 101, when a collision of a vehicle is detected, before acquiring a first image, the method further includes:

[0067] When the change in the speed of the vehicle within the second preset time period is greater than a preset threshold, determining that the vehicle has collided; and / or

[0068] In the case where the airbag deployment signal is detected, it is determined that the vehicle has collided.

[0069] The vehicle is provided with an acceleration sensor, which can be used to collect the acceleration and speed of the vehicle. In addition, the vehicle includes an airbag controller, which can control the airbag to pop out when a serious collision accident occurs to protect the occupants. When the vehicle collides, a significant acceleration peak will be generated. Based on this feature, when the change value of the vehicle's speed within the second preset time period is greater than the preset threshold, that is, the acceleration is greater than the preset threshold, it can be determined that the vehicle has collided. In addition, when a serious collision accident occurs, the airbag controller can obtain the acceleration collected by the acceleration sensor, and send an airbag pop-up signal when it is determined that the vehicle has collided, so as to control the gas generator to produce a large amount of gas, so that the airbag pops out. Therefore, the electronic device can also determine that the vehicle has collided when the airbag pop-up signal is detected. In this way, it can be detected whether the vehicle has collided, so as to obtain a first image when the vehicle collides, and perform a subsequent occupant injury detection process.

[0070] The second preset time period and the preset threshold are both non-fixed values ​​and can be adjusted. The second preset time period can be set according to historical collision accident data or measured according to experimental data. Similarly, the preset threshold can also be set according to historical collision accident data or measured according to experimental data.

[0071] In one embodiment of the present application, at least one of the vehicle's seat belt, seat, dashboard, floor, ceiling, and door panel is provided with a pressure sensor. Step 103, using the pressure collected at the first contact position as the first pressure received by the first contact portion, includes:

[0072] Determine a first pressure sensor from the plurality of pressure sensors, wherein the first pressure sensor is a pressure sensor that is closest to the first contact position, or the first pressure sensor is a pressure sensor that is within a preset range of the first contact position;

[0073] Acquire a maximum pressure value collected by the first pressure sensor within a first preset time period, where the first preset time period is determined according to a moment when a collision of the vehicle is detected;

[0074] The maximum pressure value is used as the first pressure applied to the first contact portion.

[0075] In order to reduce the possibility of failing to collect the pressure at the contact position between the occupant and the vehicle, a pressure sensor may be provided in at least one component in the contactable area of ​​the occupant (e.g., the vehicle's seat belt, seat, dashboard, floor, ceiling, door panel, etc.). The pressure sensor may be a resistive pressure sensor. In addition, the number of pressure sensors provided in each component is not limited. Thus, after determining the first contact position, the first pressure sensor may be determined from a plurality of pressure sensors provided in the vehicle, that is, the pressure sensor closest to the first contact position or the pressure sensor within a preset range of the first contact position. The preset range may be set according to actual conditions. In this way, the electronic device can quickly obtain the pressure collected at the first contact position where there is contact with the occupant, without filtering invalid data in the pressure collected by multiple sensors, so that the detection efficiency and accuracy of occupant injury can be further improved.

[0076] Subsequently, the electronic device can obtain the maximum pressure value collected by the first pressure sensor within the first preset time period. Exemplarily, the first preset time period is determined according to the moment when the vehicle collision is detected. For example, the first preset time period can be from the moment when the vehicle collides to the second preset time after the collision ends. Alternatively, the first preset time period can be from the third preset time before the vehicle collides to the fourth preset time after the collision ends. In addition, the first preset time period can also be from the fifth preset time after the collision ends to the sixth preset time after the collision ends. It should be noted that the fifth preset time is less than the sixth preset time, and the second preset time, the third preset time, the fourth preset time, the fifth preset time and the sixth preset time can all be determined according to actual conditions.

[0077] The pressure sensor collects pressure according to a preset sampling period. Within the first preset time period, the first pressure sensor can collect at least one pressure. It can be seen that the greater the pressure, the higher the degree of damage caused. If the pressure collected at the end of the first preset time period is used as the first pressure, the detection accuracy of occupant injury will be reduced. In order to accurately determine the degree of injury to the occupant later, the maximum pressure value of at least one pressure can be used as the first pressure received by the first contact part. In this way, based on the first contact part and the first pressure, the first damage part and the first damage level corresponding to the first damage part can be accurately determined later.

[0078] In one embodiment of the present application, step 104, determining a first injury part of the occupant and a first injury level corresponding to the first injury part according to the first contact part and the first pressure, includes:

[0079] When the first pressure is greater than or equal to a preset minimum damage pressure of the first contact part, determining the first contact part as the first damage part;

[0080] Matching the first pressure with a plurality of preset pressures in a preset corresponding relationship to obtain a first injury level corresponding to the first injury site;

[0081] The corresponding relationship includes a plurality of preset pressures and a damage level corresponding to each preset pressure.

[0082] The minimum injury pressure corresponding to each body part of the occupant can be predetermined. Then, after determining the first contact part, the minimum injury pressure corresponding to the first contact part can be obtained. The electronic device can compare the first pressure with the minimum injury pressure corresponding to the first contact part. If the first pressure is less than the minimum injury pressure corresponding to the first contact part, it is determined that the first contact part is not injured. If the first pressure is greater than or equal to the minimum injury pressure corresponding to the first contact part, the first contact part is determined as the first injury part.

[0083] After determining the first injury site, the electronic device can match the first pressure with multiple preset pressures in the preset correspondence relationship to obtain the first injury level corresponding to the first injury site. The correspondence relationship includes multiple preset pressures and the injury level corresponding to each preset pressure. Specifically, since the pressure that each body part can withstand is different, for each body part, a corresponding relationship related to each body part can be pre-tested, for example, a first corresponding relationship for indicating the head injury level, and a second corresponding relationship for indicating the chest and abdomen injury level. Then, after determining the first injury site, the corresponding relationship related to the first injury site can be obtained from multiple corresponding relationships. Taking the first injury site as an example, the electronic device can obtain the first corresponding relationship for indicating the head injury level, and match the first pressure with multiple preset pressures in the first corresponding relationship, so as to obtain the first injury level corresponding to the first injury site, and complete the rapid detection process of occupant injury.

[0084] In one embodiment of the present application, after determining the first injury part of the occupant and the first injury level corresponding to the first injury part according to the first contact part and the first pressure in step 104, the method further includes:

[0085] When a secondary collision of the vehicle is detected, acquiring a second image, where the second image is collected by the camera after the secondary collision;

[0086] analyzing the second image to determine that a second contact portion of the occupant is in contact with a second contact position of the vehicle;

[0087] using the pressure collected at the second contact position as the second pressure applied to the second contact portion;

[0088] When the second contact position is the same as the first contact position, the first pressure and the second pressure are added to obtain a third pressure;

[0089] According to the third pressure, a damage level corresponding to the third pressure is determined, and the first damage level is updated using the damage level corresponding to the third pressure.

[0090] In a multi-vehicle collision accident, a secondary collision of the vehicles may occur, which may further aggravate the injuries suffered by the occupants. Therefore, after the last collision of the vehicle ends, the electronic device can obtain the acceleration and speed collected by the acceleration sensor. When the change value of the vehicle's speed within the second preset time period is greater than the preset threshold, it can be determined that the vehicle has a secondary collision. In addition, the electronic device can determine that the vehicle has a secondary collision when the airbag pop-up signal is detected. If the vehicle has a secondary collision, the second image collected by the camera is obtained. Referring to the analysis process of the first image mentioned above, the electronic device can analyze the second image to determine that the second contact part of the occupant is in contact with the second contact position of the vehicle. Subsequently, according to the second contact position, the second pressure sensor set at the second contact position can be determined, and the maximum pressure value collected by the second pressure sensor in the third time period is determined as the second pressure received by the second contact part. Among them, the second pressure sensor is a pressure sensor closest to the second contact position or a pressure sensor within the preset range of the second contact position. The third time period is determined according to the moment when the vehicle is detected to have a secondary collision.

[0091] After determining the second contact part, the electronic device can determine whether the second contact part is the same as the first contact part. If the second contact part is the same as the first contact part, the first pressure and the second pressure can be added to obtain a third pressure, and the first injury level can be replaced by the injury level corresponding to the third pressure. If the second contact part is different from the first contact part, when the second pressure is greater than or equal to the minimum injury pressure corresponding to the second contact part, the second contact part is determined as the second injury part, and the second injury level corresponding to the second injury part is further determined based on the second pressure.

[0092] It should be noted that the above-mentioned occupant injury detection method is not only applicable to the second collision scenario of the vehicle. In the scenario where the vehicle has multiple collisions, the above-mentioned method can also be used to detect occupant injuries. In addition, the electronic device can record the changes in the occupant's body posture, the injured parts and the corresponding injury levels caused by each collision, providing accurate information for accident analysis after the collision.

[0093] In one embodiment of the present application, after determining the first injury part of the occupant and the first injury level corresponding to the first injury part according to the first contact part and the first pressure in step 104, the method further includes:

[0094] In a case where the first injury level is greater than or equal to a preset level, a rescue request message is sent to a target object, wherein the rescue request message is used to describe the first injury site and the first injury level.

[0095] If the first injury level is greater than or equal to the preset level, it can be determined that there is a possibility that the occupant cannot request rescue on his own. At this time, the electronic device can send a rescue request message to the target object to request rescue. The rescue request message can be any information that can describe the first injury site and the first injury level. The target object can be an emergency rescue system, and can also be a rescue request object preset by the occupant. Exemplarily, taking the injury level as divided into slight injury, light injury, severe injury and dying as an example, the preset level can be severe injury, that is, when the first injury level reaches severe injury, the rescue request message is sent to the target object. Alternatively, the target object includes the emergency rescue system and the rescue request object preset by the occupant, and the preset level can be divided into a first preset level (such as severe injury) and a second preset level (such as light injury), and the first preset level is greater than the second preset level. When the first injury level reaches the first preset level, the electronic device sends a rescue request message to the emergency rescue system. When the first injury level reaches the second preset level, the electronic device sends a rescue request message to the rescue request object preset by the occupant, and outputs a prompt message, and the occupant confirms whether it is necessary to send the rescue request message to the emergency rescue system.

[0096] Figure 3 FIG. 2 is another flow chart of the occupant injury detection method provided in the embodiment of the present application. Figure 3 As shown, the following is an example of the occupant injury detection method provided in the embodiment of the present application. The occupant injury detection method may include:

[0097] Step 301, detecting a vehicle collision;

[0098] Step 302, obtaining an image captured by a camera and obtaining pressure;

[0099] Step 303, analyzing the image and the pressure to obtain the damaged part and the damage level corresponding to the damaged part;

[0100] Step 304, recording the body posture, injury location and injury level of the occupant;

[0101] Step 305, check whether the collision is over; if so, proceed to step 306, if not, it means there are multiple collisions, and return to step 302;

[0102] Step 306: When the damage level reaches a preset level, a rescue request message is sent to an emergency rescue system.

[0103] Specifically, when the electronic device detects that the vehicle has collided, it obtains the image (e.g., the first image) collected by the camera in real time to determine the posture change of the occupant caused by the collision, and the first contact position of the occupant and the vehicle. Through the pressure sensors arranged in the components such as the seat belt, seat, ceiling, door panel pillar material, etc., the electronic device can collect the pressure of the first contact position of the vehicle that contacts the first contact position. Subsequently, the electronic device can analyze and calculate according to the collected pressure and image, determine the occupant's injured part and the injury level corresponding to the injured part, and record the occupant's body posture, injured part and injury level. If a collision occurs again, the image collected by the camera and the pressure collected by the pressure sensor are re-acquired. After the collision, if the injury level after a collision reaches the preset level, a rescue request message is sent to the emergency rescue system to feedback the occupant's injury situation and allocate medical resources to rescue the occupant.

[0104] The occupant injury detection method provided in the embodiment of the present application can directly detect the body posture and force of the occupants in the car by using pressure sensors and cameras, and estimate the occupant injury site and injury level. In addition, during the detection process, the number of sampled data can be reduced, the calculation difficulty can be reduced, and the calculation accuracy can be improved. At the same time, the accumulated occupant injuries after multiple collisions can be dynamically detected, which helps to obtain an accurate injury level and provide accurate information for accident rescue and accident analysis after the collision.

[0105] Figure 4 Schematic diagram of the structure of the occupant injury detection device provided in the embodiment of the present application. Figure 4 As shown, the occupant injury detection device 400 includes:

[0106] An image acquisition module 401 is used to acquire a first image when a collision of the vehicle is detected, wherein the first image is acquired by a camera arranged inside the vehicle;

[0107] An image analysis module 402 is used to analyze the first image to determine that a first contact part of the occupant is in contact with a first contact position of the vehicle;

[0108] A pressure determination module 403, configured to use the pressure collected at the first contact position as the first pressure applied to the first contact portion;

[0109] The damage detection module 404 is used to determine a first damage part of the occupant and a first damage level corresponding to the first damage part according to the first contact part and the first pressure.

[0110] In one embodiment of the present application, the damage detection module 404 is further used to:

[0111] When the first pressure is greater than or equal to a preset minimum damage pressure of the first contact part, determining the first contact part as the first damage part;

[0112] Matching the first pressure with a plurality of preset pressures in a preset corresponding relationship to obtain a first injury level corresponding to the first injury site;

[0113] The corresponding relationship includes a plurality of preset pressures and a damage level corresponding to each preset pressure.

[0114] In an embodiment of the present application, the pressure determination module 403 is further used to:

[0115] Determine a first pressure sensor from the plurality of pressure sensors, wherein the first pressure sensor is a pressure sensor that is closest to the first contact position, or the first pressure sensor is a pressure sensor that is within a preset range of the first contact position;

[0116] Acquire a maximum pressure value collected by the first pressure sensor within a first preset time period, where the first preset time period is determined according to a moment when a collision of the vehicle is detected;

[0117] The maximum pressure value is used as the first pressure applied to the first contact portion.

[0118] In an embodiment of the present application, the occupant injury detection device 400 further includes an injury level updating module, which is used to:

[0119] When a secondary collision of the vehicle is detected, acquiring a second image, where the second image is collected by the camera after the secondary collision;

[0120] analyzing the second image to determine that a second contact portion of the occupant is in contact with a second contact position of the vehicle;

[0121] using the pressure collected at the second contact position as the second pressure applied to the second contact portion;

[0122] When the second contact position is the same as the first contact position, the first pressure and the second pressure are added to obtain a third pressure;

[0123] According to the third pressure, a damage level corresponding to the third pressure is determined, and the first damage level is updated using the damage level corresponding to the third pressure.

[0124] In an embodiment of the present application, the occupant injury detection device 400 further includes a collision detection module, which is used to:

[0125] When the change in the speed of the vehicle within the second preset time period is greater than a preset threshold, determining that the vehicle has collided; and / or

[0126] In the case where the airbag deployment signal is detected, it is determined that the vehicle has collided.

[0127] In one embodiment of the present application, the occupant injury detection device 400 further includes a rescue request module, which is used to:

[0128] In a case where the first injury level is greater than or equal to a preset level, a rescue request message is sent to a target object, wherein the rescue request message is used to describe the first injury site and the first injury level.

[0129] The occupant injury detection device 400 provided in the embodiment of the present application can implement the various processes implemented in the aforementioned occupant injury detection method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0130] Figure 5 5 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device may include a processor 501 and a memory 502 storing computer program instructions.

[0131] Specifically, the processor 501 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0132] The memory 502 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 502 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 502 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 502 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 502 is a non-volatile solid-state memory.

[0133] The memory may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk storage medium device, an optical storage medium device, a flash memory device, an electrical, optical or other physical / tangible memory storage device. Thus, typically, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to the first aspect or the second aspect of the present disclosure.

[0134] The processor 501 implements any one of the occupant injury detection methods in the above embodiments by reading and executing computer program instructions stored in the memory 502 .

[0135] In one example, the electronic device may further include a communication interface 503 and a bus 510. Figure 5 As shown, the processor 501, the memory 502, and the communication interface 503 are connected via a bus 510 and communicate with each other.

[0136] The communication interface 503 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0137] Bus 510 includes hardware, software or both, and couples the components of the occupant damage detection method or verification device to each other. For example, but not limitation, the bus may include an accelerated graphics port (AGP) or other graphics bus, an enhanced industrial standard architecture (EISA) bus, a front-end bus (FSB), a hypertransport (HT) interconnect, an industrial standard architecture (ISA) bus, an infinite bandwidth interconnect, a low pin count (LPC) bus, a memory bus, a microchannel architecture (MCA) bus, a peripheral component interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a serial advanced technology attachment (SATA) bus, a video electronics standard association local (VLB) bus or other suitable buses or a combination of two or more of these. In appropriate cases, bus 510 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the present application considers any suitable bus or interconnection.

[0138] In addition, an embodiment of the present application also provides a vehicle, comprising the above-mentioned electronic device.

[0139] The vehicle can be a private car, such as a sedan, SUV, MPV or pickup truck. The vehicle can also be an operating vehicle, such as a van, bus, small truck or large trailer. The vehicle can be a gasoline vehicle or a new energy vehicle. When the vehicle is a new energy vehicle, it can be a hybrid vehicle or a pure electric vehicle.

[0140] In addition, in combination with the occupant injury detection method in the above embodiment, the embodiment of the present application can provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when the computer program instructions are executed by a processor, any one of the occupant injury detection methods in the above embodiment is implemented.

[0141] In addition, the embodiments of the present application may provide a computer program product for implementation. When the instructions in the computer program product are executed by an electronic device, the electronic device implements any one of the occupant injury detection methods in the above embodiments.

[0142] It should be clear that the present application is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiment, several specific steps are described as examples. However, the method process of the present application is not limited to the specific steps described, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present application.

[0143] The functional blocks shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0144] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.

[0145] Aspects of the present disclosure are described above with reference to the flowchart and / or block diagram of the method, device (system) and computer program product according to the embodiment of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field programmable logic circuit. It can also be understood that each box in the block diagram and / or flowchart and the combination of boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs a specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0146] The above is only a specific implementation of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.

Claims

1. A method for detecting occupant injury, characterized in that: The method comprises: When a collision of the vehicle is detected, acquiring a first image, wherein the first image is collected by a camera disposed inside the vehicle; Analyzing the first image to determine that a first contact portion of the occupant is in contact with a first contact position of the vehicle; using the pressure collected at the first contact position as the first pressure applied to the first contact portion; A first injury site of the occupant and a first injury level corresponding to the first injury site are determined according to the first contact site and the first pressure.

2. The method according to claim 1, characterized in that The determining, according to the first contact position and the first pressure, a first injury position of the occupant and a first injury level corresponding to the first injury position includes: When the first pressure is greater than or equal to a preset minimum damage pressure of the first contact part, determining the first contact part as the first damage part; Matching the first pressure with a plurality of preset pressures in a preset corresponding relationship to obtain a first injury level corresponding to the first injury site; The corresponding relationship includes a plurality of preset pressures and a damage level corresponding to each preset pressure.

3. The method according to claim 1, characterized in that At least one of the vehicle's seat belts, seats, dashboard, floor, ceiling and door panels is provided with a pressure sensor; The step of using the pressure collected at the first contact position as the first pressure applied to the first contact portion includes: Determine a first pressure sensor from the plurality of pressure sensors, wherein the first pressure sensor is a pressure sensor that is closest to the first contact position, or the first pressure sensor is a pressure sensor that is within a preset range of the first contact position; Acquire a maximum pressure value collected by the first pressure sensor within a first preset time period, where the first preset time period is determined according to a moment when a collision of the vehicle is detected; The maximum pressure value is used as the first pressure applied to the first contact portion.

4. The method according to claim 1, characterized in that: After determining a first injury part of the occupant and a first injury level corresponding to the first injury part according to the first contact part and the first pressure, the method further includes: When a secondary collision of the vehicle is detected, acquiring a second image, where the second image is collected by the camera after the secondary collision; analyzing the second image to determine that a second contact portion of the occupant is in contact with a second contact position of the vehicle; using the pressure collected at the second contact position as the second pressure applied to the second contact portion; When the second contact position is the same as the first contact position, the first pressure and the second pressure are added to obtain a third pressure; According to the third pressure, a damage level corresponding to the third pressure is determined, and the first damage level is updated using the damage level corresponding to the third pressure.

5. The method according to claim 1, characterized in that In the case where a collision of the vehicle is detected, before acquiring the first image, the method further includes: When the change in the speed of the vehicle within the second preset time period is greater than a preset threshold, determining that the vehicle has collided; and / or In the case where the airbag deployment signal is detected, it is determined that the vehicle has collided.

6. The method according to claim 1, characterized in that After determining a first injury part of the occupant and a first injury level corresponding to the first injury part according to the first contact part and the first pressure, the method further includes: In a case where the first injury level is greater than or equal to a preset level, a rescue request message is sent to a target object, wherein the rescue request message is used to describe the first injury site and the first injury level.

7. An occupant injury detection device, characterized in that: The device comprises: An image acquisition module, used to acquire a first image when a collision of the vehicle is detected, wherein the first image is acquired by a camera arranged inside the vehicle; an image analysis module, configured to analyze the first image to determine that a first contact portion of the occupant is in contact with a first contact position of the vehicle; a pressure determination module, configured to use the pressure collected at the first contact position as the first pressure applied to the first contact portion; The damage detection module is used to determine a first damage part of the occupant and a first damage level corresponding to the first damage part according to the first contact part and the first pressure.

8. An electronic device, characterized in that: include: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, the occupant injury detection method as described in any one of claims 1-6 is implemented.

9. A vehicle, characterized in that: Comprising the electronic device as claimed in claim 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the occupant injury detection method according to any one of claims 1 to 6 is implemented.

11. A computer program product, characterized in that When the instructions in the computer program product are executed by an electronic device, the electronic device executes the occupant injury detection method as described in any one of claims 1-6.

Images