Intelligent cabin safety monitoring system and method, electronic device and storage medium

Abstract

The application provides a kind of intelligent cockpit safety monitoring system, method, electronic equipment and storage medium, belong to vehicle technical field.The monitoring process of the system is divided into two levels, the first level only opens the first sensor, judges the behavior of passenger whether abnormal according to the pressure data obtained by the first sensor.If the behavior of passenger is abnormal, the driver is reminded through the early warning module and the second sensor to be opened is determined.The second level converts the second sensor to be opened from standby state to running state, further judges the behavior of passenger whether abnormal according to the monitoring data obtained by the second sensor.If the behavior of passenger is abnormal, the emergency measures are executed through the early warning module.The above-mentioned system is monitored in two levels, different sensors are opened in different levels, different degrees of response measures are executed, which can not only accurately judge abnormal behavior, but also improve the safety of intelligent cockpit under the condition of less energy consumption.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicles, in particular to an intelligent cabin safety monitoring system and method, an electronic device and a storage medium. BACKGROUND

[0002] With the development of vehicle technology, the intelligence level of vehicles is getting higher and higher. For example, a vehicle has an intelligent cabin safety monitoring function. Through this function, the data in the intelligent cabin can be monitored by sensors. According to the monitored data, the safety condition in the intelligent cabin is analyzed in combination with artificial intelligence technology, and a warning is made according to the analysis result.

[0003] The current intelligent cabin safety monitoring system uses a large number of sensors to collect data in the intelligent cabin, and then analyzes the safety condition in the intelligent cabin according to the large amount of collected data. However, in the case that the safety condition in the intelligent cabin is normal, the function of some sensors is redundant. Using the above system to monitor the safety of the intelligent cabin will cause a large amount of unnecessary energy consumption, and it is impossible to accurately determine abnormal behavior and improve the safety of the intelligent cabin with less energy consumption. SUMMARY

[0004] The embodiments of the present application provide an intelligent cabin safety monitoring system, method, electronic device and storage medium, which are used to reduce the energy consumption of intelligent cabin safety monitoring. The technical solutions are as follows:

[0005] In a first aspect, an intelligent cabin safety monitoring system is provided. The system includes a sensor network, a data processing and analysis module, a safety function module and a warning module. The sensor network includes a first sensor and at least one second sensor. The first sensor is started after the vehicle is started and is in a running state during vehicle driving. The second sensor is in a standby state after the vehicle is started. The first sensor is a pressure sensor, which is used to obtain pressure data in the intelligent cabin during vehicle driving. The pressure data indicates the pressure on multiple seats in the intelligent cabin. The data processing and analysis module is used to determine the type of abnormal behavior of the passenger and the position of abnormal occurrence based on the pressure data if the behavior of the passenger in the intelligent cabin is abnormal, and send a warning instruction to the warning module. Based on the type of abnormal behavior and the position of abnormal occurrence, the second sensor to be started is determined, and the second sensor to be started is converted from the standby state to the running state. The second sensor is used to obtain monitoring data in the intelligent cabin. The safety function module is used to send an emergency instruction to the warning module if the behavior of the passenger is abnormal. The warning module is used to remind the driver of the intelligent cabin that the behavior of the passenger is abnormal in response to the warning instruction, and execute an emergency measure in response to the emergency instruction.

[0006] The intelligent cockpit safety monitoring system provided by the embodiments of the present application divides the process of safety monitoring of the intelligent cockpit into two levels. The first level only turns on the first sensor, and judges whether the behavior of the passenger is abnormal according to the pressure data obtained by the first sensor. If the behavior of the passenger is abnormal, the driver is reminded through the warning module, and the second sensor to be turned on is determined. The second level converts the second sensor to be turned on from the standby state to the running state, and further judges whether the behavior of the passenger is abnormal according to the monitoring data obtained by the second sensor. If the behavior of the passenger is abnormal, the emergency measures are executed through the warning module. The above system monitors in two levels, turns on different sensors at different levels, and executes different degrees of response measures, which can not only accurately judge the abnormal behavior, but also improve the safety of the intelligent cockpit under the condition of less energy consumption.

[0007] In some embodiments, the data processing and analysis module comprises: a first analysis unit configured to analyze the pressure data to obtain an abnormal occurrence position of the passenger, the abnormal occurrence position indicating a change in the seat of the passenger; and a type acquisition unit configured to, if the abnormal occurrence position indicates that the passenger moves between the first seat and the second seat, acquire the abnormal behavior type of the passenger based on the pressure data corresponding to the first seat and the pressure data corresponding to the second seat.

[0008] In some embodiments, the first analysis unit is configured to, if it is detected that the pressure data of at least two seats changes in any time period, analyze the pressure data of the at least two seats to obtain the first seat and the second seat, the first seat being a seat with reduced pressure, and the second seat being a seat with increased pressure.

[0009] In some embodiments, the type acquisition unit is configured to, if the pressure data corresponding to the first seat indicates that the pressure of the first seat does not decrease to 0, and the pressure data corresponding to the second seat indicates that the pressure of the second seat does not increase to the original pressure of the first seat, determine that the passenger does not have an abnormal behavior; if the pressure data corresponding to the first seat indicates that the pressure of the first seat decreases to 0, and the pressure data corresponding to the second seat indicates that the pressure of the second seat increases to the original pressure of the first seat, determine that the passenger has a behavior of changing seats, if the backrest pressure corresponding to the second seat increases, determine that the passenger does not have an abnormal behavior, and if the backrest pressure corresponding to the second seat does not change, determine that the abnormal behavior type of the passenger is an abnormal behavior of changing seats.

[0010] In some embodiments, the data processing and analysis module is configured to: determine, based on the abnormal behavior type, a target monitoring mode from a plurality of candidate monitoring modes, the target monitoring mode being a monitoring mode matching the abnormal behavior type and indicating a second sensor type to be turned on; determine, based on the abnormal occurrence position, a second sensor belonging to the sensor type at the abnormal occurrence position as the second sensor to be turned on, control the second sensor to be turned on to switch from a standby state to a running state, and control the collection direction of the second sensor to be turned on to be directed towards the abnormal occurrence position.

[0011] In some embodiments, the safety function module includes: a second analysis unit configured to analyze the monitoring data to obtain the behavior type of the passenger; and an emergency instruction sending unit configured to send an emergency instruction to the warning module if the behavior type of the passenger is abnormal behavior, and convert the second sensor switched to the running state to the standby state if the behavior type of the passenger is that the passenger does not have abnormal behavior.

[0012] In some embodiments, the system further includes:

[0013] The data acquisition module is configured to transmit the pressure data to the data processing and analysis module and transmit the monitoring data to the safety function module; the data storage module is configured to store the pressure data and the monitoring data; and the remote monitoring module is configured to display the pressure data, the monitoring data, the warning instruction and the emergency instruction.

[0014] In a second aspect, an intelligent cockpit safety monitoring method is provided. The method is applied to an intelligent cockpit safety monitoring system, which includes a sensor network, a data processing and analysis module, a safety function module and a warning module. The sensor network includes a first sensor and at least one second sensor. The first sensor is started after the vehicle is started and is in a running state during vehicle driving. The second sensor is in a standby state after the vehicle is started. The first sensor is a pressure sensor configured to acquire pressure data in the intelligent cockpit during vehicle driving, the pressure data indicating the pressure on a plurality of seats in the intelligent cockpit. If the behavior of the passenger in the intelligent cockpit is abnormal, the data processing and analysis module determines the abnormal behavior type and the abnormal occurrence position of the passenger based on the pressure data, and sends a warning instruction to the warning module. Based on the abnormal behavior type and the abnormal occurrence position, the second sensor to be turned on is determined, and the second sensor to be turned on is switched from the standby state to the running state. The second sensor acquires monitoring data in the intelligent cockpit. If the behavior of the passenger is abnormal, the safety function module sends an emergency instruction to the warning module. The warning module responds to the warning instruction to remind the driver of the intelligent cockpit that the behavior of the passenger is abnormal. In response to the emergency instruction, an emergency measure is performed.

[0015] In a third aspect, an electronic device is provided, which includes a processor and a memory, the memory being configured to store at least one piece of computer program, the at least one piece of computer program being loaded and executed by the processor to implement the operations performed by the intelligent cabin safety monitoring method provided in the first aspect above or various optional implementation manners of the first aspect.

[0016] In a fourth aspect, a computer readable storage medium is provided, which stores at least one piece of computer program, the at least one piece of computer program being loaded and executed by a processor to implement the operations performed by the intelligent cabin safety monitoring method provided in the first aspect above or various optional implementation manners of the first aspect.

[0017] On the basis of the implementation manners of the aspects provided above, the present application can be further combined to provide more implementation manners. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0019] Figure 1 is a flow chart of an intelligent cabin safety monitoring method provided by an embodiment of the present application;

[0020] Figure 2 is a structural block diagram of an intelligent cabin safety monitoring system provided by an embodiment of the present application;

[0021] Figure 3 is a structural block diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the drawings.

[0023] In the present application, the terms "first", "second", etc. are used to distinguish the same or similar items with basically the same function, and it should be understood that there is no logical or time sequence relationship between "first", "second", "nth", and the number and execution order are not limited.

[0024] In the present application, the term "at least one" means one or more, and the term "multiple" means two or more.

[0025] It should be noted that the information (including but not limited to user equipment information, user personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.) and signals involved in the present application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions. For example, the data involved in the present application is obtained under full authorization.

[0026] The intelligent cockpit safety monitoring method provided by the embodiment of the present application can be executed by a vehicle-mounted terminal, which is deployed with an intelligent cockpit safety monitoring system and can interact with a background server to identify potential risks in the intelligent cockpit based on data in the intelligent cockpit and take different measures according to different potential risks.

[0027] Figure 1 It is a flow chart of an intelligent cockpit safety monitoring method provided by an embodiment of the present application, which can be realized based on an intelligent cockpit safety monitoring system provided by an embodiment of the present application. The system includes a sensor network, a data processing and analysis module, a safety function module and a warning module. As shown in Figure 1 The method includes the following steps:

[0028] 101. In the process of driving the vehicle, the first sensor in the sensor network acquires pressure data in the intelligent cockpit, and sends the pressure data to the data processing and analysis module, the pressure data indicating the pressure on multiple seats in the intelligent cockpit.

[0029] The sensor network includes the first sensor and at least one second sensor, the first sensor is started after the vehicle is started and is in a running state in the process of driving the vehicle, the second sensor is in a standby state after the vehicle is started, and the first sensor is a pressure sensor. The intelligent cockpit has multiple seats, each seat is equipped with multiple pressure sensors, and the multiple pressure sensors are used to acquire the pressure on different positions of the seat, such as the pressure on the seat and the pressure on the backrest. The inner side of the door of the intelligent cockpit is also equipped with a pressure sensor for acquiring the pressure on the inner side of the door. The pressure data in the intelligent cockpit includes the pressure on each seat in the intelligent cockpit, the pressure on the backrest of each seat and the pressure on the inner side of the door, etc., which are not limited by the embodiments of the present application.

[0030] The embodiments of the present application take the first sensor as a pressure sensor as an example for description, in some embodiments, the first sensor is a sound sensor for acquiring the sound in the intelligent cockpit, or the first sensor is a camera for acquiring images and videos in the intelligent cockpit, the first sensor can also be a temperature sensor or an infrared sensor, etc., which are not limited by the embodiments of the present application.

[0031] 102、the data processing and analysis module analyzes the pressure data to obtain an abnormal occurrence position of the passenger, the abnormal occurrence position indicating a change of the seat where the passenger is located.

[0032] In the embodiment of the application, if it is detected that the pressure data of at least two seats changes in any time period, the data processing and analysis module analyzes the pressure data of the at least two seats to obtain a first seat and a second seat, the first seat being a seat with reduced pressure and the second seat being a seat with increased pressure.

[0033] 103、if the abnormal occurrence position indicates that the passenger moves between the first seat and the second seat, the data processing and analysis module obtains an abnormal behavior type of the passenger based on the pressure data corresponding to the first seat and the pressure data corresponding to the second seat.

[0034] The abnormal behavior type includes no abnormal behavior of the passenger and abnormal seat change behavior.

[0035] In the embodiment of the application, if the pressure data corresponding to the first seat indicates that the pressure of the first seat does not decrease to 0 and the pressure data corresponding to the second seat indicates that the pressure of the second seat does not increase to the original pressure of the first seat, it is determined that the passenger does not have abnormal behavior; if the pressure data corresponding to the first seat indicates that the pressure of the first seat decreases to 0 and the pressure data corresponding to the second seat indicates that the pressure of the second seat increases to the original pressure of the first seat, it is determined that the passenger has seat change behavior, if the backrest pressure of the second seat increases, it is determined that the passenger does not have abnormal behavior, and if the backrest pressure of the second seat does not change, it is determined that the abnormal behavior type of the passenger is abnormal seat change behavior.

[0036] It should be noted that, in the process of determining whether the passenger has seat change behavior, the pressure of the first seat does not necessarily decrease to 0, and the pressure of the second seat does not necessarily increase to the original pressure of the first seat, so that the data processing and analysis module can determine that the passenger has seat change behavior. If the ratio of the decrease of the pressure of the first seat to the original pressure of the first seat is greater than a first ratio threshold value, and the ratio of the increase of the pressure of the second seat to the original pressure of the first seat is greater than a second ratio threshold value, the data processing and analysis module determines that the passenger has seat change behavior.

[0037] The steps 102 to 103 above are one possible implementation manner of determining the abnormal behavior type and the abnormal occurrence position of the passenger based on the pressure data if the pressure data indicates that the behavior of the passenger in the intelligent cabin is abnormal. By determining the abnormal behavior type and the abnormal occurrence position of the passenger, potential risks can be identified, the second sensor to be started can be determined more accurately, and the monitoring accuracy can be improved.

[0038] 104、the data processing and analysis module sends a warning instruction to the warning module.

[0039] The early warning instruction carries passenger seating information, an abnormal behavior type of the passenger, and an abnormal occurrence position.

[0040] 105. The early warning module, in response to the early warning instruction, reminds a driver of the intelligent cabin that the behavior of the passenger is abnormal.

[0041] In the embodiment of the application, the early warning module, in response to the early warning instruction, reminds a driver of the intelligent cabin that the behavior of the passenger is abnormal through a display screen or voice in the intelligent cabin. After receiving the reminder, the driver can confirm the condition of the passenger to select to close the reminder and make the intelligent cabin monitoring system stop monitoring, or to select to make the intelligent cabin monitoring system continue monitoring, that is, to make the intelligent cabin monitoring system perform subsequent steps.

[0042] 106. The data processing and analysis module determines a target monitoring mode from a plurality of candidate monitoring modes based on the abnormal behavior type, the target monitoring mode being a monitoring mode matched with the abnormal behavior type and used to indicate a second sensor type to be started.

[0043] The second sensor type to be started includes a temperature sensor, an infrared sensor, a camera, and a sound sensor, etc. The temperature sensor is used to acquire the temperature in the intelligent cabin, the infrared sensor is used to acquire a thermal image in the intelligent cabin, the camera is used to acquire an image and a video in the intelligent cabin, and the sound sensor is used to monitor the sound in the intelligent cabin. The monitoring mode matched with different abnormal behavior types is set in advance according to actual risk occurrence conditions. Each monitoring mode can indicate one second sensor to be started or multiple second sensors to be started, which is not limited in the embodiment of the application.

[0044] Taking an abnormal behavior type as an abnormal behavior of changing behavior as an example, the target monitoring mode determined according to the abnormal behavior type indicates that the second sensor type to be started is a camera and a sound sensor. For another example, the abnormal behavior type is syncope of the passenger, and the target monitoring mode determined according to the abnormal behavior type indicates that the second sensor type to be started is an infrared sensor and a temperature sensor.

[0045] 107. The data processing and analysis module determines, based on the abnormal occurrence position, a second sensor belonging to the sensor type at the abnormal occurrence position as the second sensor to be started, controls the second sensor to be started to switch from a standby state to a running state, and controls the collection direction of the second sensor to be started to be toward the abnormal occurrence position.

[0046] The abnormal occurrence position is in a monitoring area of the second sensor to be started. For each type of sensor, the intelligent cabin is pre-divided into a plurality of monitoring areas, and the sensors of this type are distributed in the monitoring areas. For example, the intelligent cabin is divided into monitoring area 1 to monitoring area 4, and there are four sound sensors in the intelligent cabin, namely sound sensors 1 to 4, which are distributed in monitoring areas 1 to 4, and the sound sensor 1 is responsible for acquiring the sound in the monitoring area 1, and the position of the sound sensor 1 is in the monitoring area 1, and the rest of the sound sensors are the same.

[0047] In some embodiments, the data processing and analysis module determines, according to the type of the second sensor to be started, a plurality of monitoring areas corresponding to the type of the second sensor to be started, selects a monitoring area to which the abnormal occurrence position belongs from the plurality of monitoring areas, determines the second sensor in the monitoring area as the second sensor to be started, controls the second sensor to be started to switch from the standby state to the running state, and controls the collection direction of the second sensor to be started to be directed to the abnormal occurrence position. For example, the second sensor to be started is a camera, and the camera is controlled to turn to the abnormal occurrence position.

[0048] The above embodiments are described by taking the example of first determining the type of the second sensor to be started, and then determining the second sensor to be started according to the abnormal occurrence position. In some embodiments, different types of second sensors have the same way of dividing monitoring areas, and the data processing and analysis module can first determine the monitoring area of the second sensor to be started according to the abnormal occurrence position, and then determine the second sensor to be started according to the type of the second sensor to be started. The embodiments of the present application are not limited in this regard.

[0049] The above steps 106 to 107 are one possible implementation of the data processing and analysis module determining the second sensor to be started based on the abnormal behavior type and the abnormal occurrence position, and switching the second sensor to be started from the standby state to the running state.

[0050] 108、The second sensor switched to the running state acquires monitoring data in the intelligent cabin and sends the monitoring data to the safety function module.

[0051] If the second sensor to be started is a temperature sensor and an infrared sensor, the monitoring data includes the temperature and thermal imaging in the intelligent cabin, and if the second sensor to be started is a camera and a sound sensor, the monitoring data includes images, videos and sounds in the intelligent cabin.

[0052] 109、The safety function module analyzes the monitoring data to obtain the behavior type of the passenger.

[0053] In the embodiment of the present application, the safety function module inputs the monitoring data into the behavior recognition model, and the behavior recognition model outputs the behavior type of the passenger corresponding to the monitoring data. The behavior recognition model is pre-trained by the computer device. In the training process, the computer device inputs the collected monitoring data in the intelligent cockpit into the behavior recognition model, and the behavior recognition model outputs the predicted behavior type of the passenger and the loss value corresponding to the behavior type. The loss value indicates the gap between the predicted behavior type and the preset correct behavior type. The greater the loss value, the greater the gap between the predicted behavior type and the correct behavior type. The smaller the loss value, the smaller the gap between the predicted behavior type and the correct behavior type. If the loss value is greater than or equal to a loss value threshold, the computer device adjusts the behavior recognition model according to the loss value to reduce the loss value, and continues to train the adjusted behavior recognition model. If the loss value is less than the loss value threshold, the computer device stops training and sends the behavior recognition model to the safety function module.

[0054] It should be noted that the same behavior recognition model can be used for monitoring data corresponding to different abnormal behavior types, or different behavior recognition models can be used. If different behavior recognition models are used, the safety function module first acquires the corresponding behavior recognition model based on the abnormal behavior type corresponding to the monitoring data, and then inputs the monitoring data into the corresponding behavior recognition model, so that the behavior recognition model outputs the behavior type of the passenger corresponding to the monitoring data.

[0055] 110. If the behavior type of the passenger is an abnormal behavior, the safety function module sends an emergency instruction to the warning module.

[0056] The emergency instruction carries the passenger seating information, the abnormal behavior type of the passenger, and the abnormal occurrence position.

[0057] The above steps 109 to 110 are one possible implementation of the safety function module sending an emergency instruction to the warning module if the monitoring data indicates that the behavior of the passenger is abnormal. In some embodiments, if the behavior type of the passenger is that the passenger does not have abnormal behavior, the safety function module converts the second sensor in the running state into the standby state.

[0058] 111. The warning module responds to the emergency instruction and performs an emergency measure.

[0059] The emergency measure includes making an emergency call, automatically unlocking the vehicle, braking the vehicle, or raising a partition between the passenger and the driver.

[0060] In the embodiment of the present application, the warning module determines the emergency measure corresponding to the emergency instruction according to the emergency instruction and performs the emergency measure.

[0061] The above embodiments are descriptions of the operations performed by the abnormal action monitoring module in the safety function module, which, in some embodiments, further includes a face recognition module for recognizing faces through facial images of passengers and drivers captured by the camera to ensure that only authorized personnel can enter the intelligent cabin.

[0062] In the embodiments of the present application, the intelligent seat safety monitoring system further includes a data acquisition module, a data storage module and a remote monitoring module. The data acquisition module is used to transmit pressure data to the data processing and analysis module and transmit monitoring data to the safety function module. The data storage module is used to store the above-mentioned pressure data and monitoring data for subsequent analysis, such as accident investigation and safety analysis, to optimize system performance and improve safety strategies. The remote monitoring module is equipped with a user interface for displaying the above-mentioned pressure data, monitoring data, warning instructions and emergency instructions, which facilitates the driver to understand the safety status of the cabin in real time and also meets the requirements of remotely viewing and managing the safety status of the intelligent cabin. In some embodiments, the data acquisition module uses wireless transmission technology for data transmission, such as WiFi (Wireless Fidelity) network or Bluetooth.

[0063] The intelligent cabin safety monitoring system provided by the embodiments of the present application divides the process of safety monitoring of the intelligent cabin into two levels. The first level only turns on the first sensor, and determines whether the behavior of the passenger is abnormal according to the pressure data obtained by the first sensor. If the behavior of the passenger is abnormal, the driver is reminded through the warning module and the second sensor to be turned on is determined. The second level converts the second sensor to be turned on from standby state to running state, and further determines whether the behavior of the passenger is abnormal according to the monitoring data obtained by the second sensor. If the behavior of the passenger is abnormal, the emergency measures are executed through the warning module. The above-mentioned system monitors in two levels, turns on different sensors at different levels, and executes different degrees of response measures, which can not only accurately determine abnormal behavior, but also improve the safety of the intelligent cabin with less energy consumption.

[0064] Figure 2 is a structural block diagram of an intelligent cabin safety monitoring system provided by the embodiments of the present application. The system is used to execute the steps of the above-mentioned intelligent cabin safety monitoring method, and the intelligent cabin safety monitoring system includes a sensor network 201, a data processing and analysis module 202, a safety function module 203 and a warning module 204, as shown in Figure 2

[0065] ​The sensor network 201 comprises a first sensor and at least one second sensor, the first sensor is started after the vehicle is started and is in an operating state during vehicle driving, and the second sensor is in a standby state after the vehicle is started, the first sensor is a pressure sensor, and is configured to acquire pressure data in the intelligent cabin during vehicle driving, the pressure data indicating pressures on a plurality of seats in the intelligent cabin;

[0066] The data processing and analysis module 202 is configured to, if the pressure data indicates that the behavior of the passenger in the intelligent cabin is abnormal, determine a type of the abnormal behavior of the passenger and a position of the abnormality occurrence based on the pressure data, and send a warning instruction to the warning module; determine a second sensor to be started based on the type of the abnormal behavior and the position of the abnormality occurrence, and convert the second sensor to be started from the standby state to the operating state;

[0067] The second sensor is configured to acquire monitoring data in the intelligent cabin.

[0068] The safety function module 203 is configured to, if the monitoring data indicates that the behavior of the passenger is abnormal, send an emergency instruction to the warning module.

[0069] The warning module 204 is configured to, in response to the warning instruction, remind a driver of the intelligent cabin that the behavior of the passenger is abnormal; and in response to the emergency instruction, perform an emergency measure.

[0070] In some embodiments, the data processing and analysis module 202 comprises:

[0071] A first analysis unit is configured to analyze the pressure data to obtain the position of the abnormality occurrence of the passenger, and the position of the abnormality occurrence indicates a change in a seat where the passenger is located.

[0072] A type acquisition unit is configured to, if the position of the abnormality occurrence indicates that the passenger moves between a first seat and a second seat, acquire the type of the abnormal behavior of the passenger based on pressure data corresponding to the first seat and pressure data corresponding to the second seat.

[0073] In some embodiments, the first analysis unit is configured to:

[0074] If pressure data of at least two seats is detected to change in any time period, the first analysis unit is configured to analyze the pressure data of the at least two seats to obtain the first seat and the second seat, the first seat being a seat with reduced pressure, and the second seat being a seat with increased pressure.

[0075] In some embodiments, the type acquisition unit is configured to:

[0076] If the pressure data corresponding to the first seat indicates that the pressure of the first seat is not reduced to 0, and the pressure data corresponding to the second seat indicates that the pressure of the second seat is not increased to the original pressure of the first seat, it is determined that the passenger does not have abnormal behavior; if the pressure data corresponding to the first seat indicates that the pressure of the first seat is reduced to 0, and the pressure data corresponding to the second seat indicates that the pressure of the second seat is increased to the original pressure of the first seat, it is determined that the passenger has a behavior of changing seats, if the backrest pressure corresponding to the second seat is increased, it is determined that the passenger does not have abnormal behavior, and if the backrest pressure corresponding to the second seat is unchanged, it is determined that the type of abnormal behavior of the passenger is abnormal behavior of changing seats.

[0077] In some embodiments, the data processing and analysis module 202 is configured to:

[0078] Based on the type of abnormal behavior, a target monitoring mode is determined from a plurality of candidate monitoring modes, the target monitoring mode being a monitoring mode matching the type of abnormal behavior, and being used to indicate a second sensor type to be started; based on the position of abnormal occurrence, a second sensor belonging to the sensor type at the position of abnormal occurrence is determined as the second sensor to be started, the second sensor to be started is controlled to switch from a standby state to a running state, and the collection direction of the second sensor to be started is controlled to be directed towards the position of abnormal occurrence.

[0079] In some embodiments, the safety function module 203 includes:

[0080] The second analysis unit is configured to analyze the monitoring data to obtain the type of behavior of the passenger.

[0081] The emergency instruction sending unit is configured to send an emergency instruction to the early warning module if the type of behavior of the passenger is abnormal behavior of changing seats, and to switch the second sensor switched to the running state to the standby state if the type of behavior of the passenger is that the passenger does not have abnormal behavior.

[0082] In some embodiments, the system further includes:

[0083] The data acquisition module is configured to transmit the pressure data to the data processing and analysis module, and transmit the monitoring data to the safety function module; the data storage module is configured to store the pressure data and the monitoring data; and the remote monitoring module is configured to display the pressure data, the monitoring data, the early warning instruction and the emergency instruction.

[0084] It should be noted that the system provided in the above embodiment is only used for illustrating the division of the above functional modules when the intelligent cockpit is monitored, and in actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the system is divided into different functional modules to complete all or part of the functions described above. In addition, the system and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is described in detail in the method embodiment, which will not be repeated here.

[0085] Figure 3 is a structural block diagram of an electronic device 300 provided by an embodiment of the present application. The electronic device 300 can be a portable mobile terminal, such as a vehicle-mounted terminal, a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), a notebook computer or a desktop computer. The electronic device 300 can also be referred to as a user equipment, a portable terminal, a laptop terminal, a desktop terminal, and other names.

[0086] Generally, the electronic device 300 includes a processor 301 and a memory 302.

[0087] The processor 301 can include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 301 can be implemented in at least one of a hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 301 can also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a CPU (Central Processing Unit). The coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 301 can be integrated with a GPU (Graphics Processing Unit) for rendering and drawing the content required to be displayed by the display screen. In some embodiments, the processor 301 can also include an AI (Artificial Intelligence) processor for processing machine learning-related computing operations.

[0088] The memory 302 can include one or more computer-readable storage media. The computer-readable storage media can be non-transitory. The memory 302 can also include high-speed random access memory and non-volatile, computer-readable storage media such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile storage devices. In some embodiments, the non-transitory computer-readable storage media of the memory 302 is used for storing at least one computer program for being executed by the processor 301 to implement the intelligent cabin safety monitoring method provided by the method embodiments of the present application.

[0089] In some embodiments, the electronic device 300 can also optionally include a peripheral device interface 303 and at least one peripheral device. The processor 301, the memory 302, and the peripheral device interface 303 can be connected through a bus or a signal line. Each peripheral device can be connected to the peripheral device interface 303 through a bus, a signal line, or a circuit board. Specifically, the peripheral device includes at least one of a radio frequency circuit 304, a display screen 305, a camera assembly 306, an audio circuit 307, and a power supply 308.

[0090] The peripheral device interface 303 can be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 301 and the memory 302. In some embodiments, the processor 301, the memory 302, and the peripheral device interface 303 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 301, the memory 302, and the peripheral device interface 303 can be implemented on a separate chip or circuit board, and the present embodiment does not limit this.

[0091] The radio frequency circuit 304 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 304 communicates with a communication network and other communication devices through electromagnetic signals. The radio frequency circuit 304 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. In some embodiments, the radio frequency circuit 304 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 304 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G, and 5G), a wireless local area network, and / or a WiFi network. In some embodiments, the radio frequency circuit 304 can also include NFC (Near Field Communication) related circuitry, which is not limited by the present application.

[0092] The display screen 305 is configured to display a UI (User Interface). The UI can include graphics, text, icons, video, and any combination thereof. When the display screen 305 is a touch display screen, the display screen 305 is further configured to capture touch signals on or above the surface of the display screen 305. The touch signals can be input to the processor 301 as control signals for processing. In this case, the display screen 305 can also be configured to provide virtual buttons and / or virtual keyboard, also known as soft buttons and / or soft keyboard. In some embodiments, the display screen 305 can be one, disposed on the front panel of the electronic device 300; in other embodiments, the display screen 305 can be at least two, respectively disposed on different surfaces of the electronic device 300 or in a folding design; in other embodiments, the display screen 305 can be a flexible display screen, disposed on a curved surface or a folding surface of the electronic device 300. Even, the display screen 305 can also be disposed in an irregular shape, i.e., a special-shaped screen. The display screen 305 can be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc.

[0093] The camera assembly 306 is configured to capture images or videos. In some embodiments, the camera assembly 306 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal, and the rear camera is disposed on the back of the terminal. In some embodiments, the rear camera is at least two, which are any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, to realize the background blur function by fusing the main camera and the depth-of-field camera, the panoramic shooting and VR (Virtual Reality) shooting function by fusing the main camera and the wide-angle camera, or other fusion shooting functions. In some embodiments, the camera assembly 306 can further include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. The dual-color temperature flash refers to the combination of a warm light flash and a cold light flash, which can be used for light compensation under different color temperatures.

[0094] The audio circuit 307 can include a microphone and a speaker. The microphone is used to collect sound waves of the user and the environment, and convert the sound waves into an electrical signal input to the processor 301 for processing, or input to the radio frequency circuit 304 to realize voice communication. For the purpose of stereo sound collection or noise reduction, the microphone can be multiple, respectively arranged at different parts of the electronic device 300. The microphone can also be an array microphone or an omnidirectional collection type microphone. The speaker is used to convert the electrical signal from the processor 301 or the radio frequency circuit 304 into sound waves. The speaker can be a conventional diaphragm speaker, or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only can it convert electrical signals into sound waves that humans can hear, but it can also convert electrical signals into sound waves that humans cannot hear for ranging purposes. In some embodiments, the audio circuit 307 can also include a headphone jack.

[0095] The power supply 308 is used to supply power to various components in the electronic device 300. The power supply 308 can be alternating current, direct current, disposable battery or rechargeable battery. When the power supply 308 includes a rechargeable battery, the rechargeable battery can be a wired charging battery or a wireless charging battery. The wired charging battery is a battery charged through a wired line, and the wireless charging battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0096] In some embodiments, the electronic device 300 further includes one or more sensors 309. The one or more sensors 309 include, but are not limited to, an acceleration sensor 310, a gyroscope sensor 311, a pressure sensor 312, an optical sensor 313, and a proximity sensor 314.

[0097] The acceleration sensor 310 can detect the acceleration in three coordinate axes of the coordinate system established by the electronic device 300. For example, the acceleration sensor 310 can be used to detect the components of gravitational acceleration in three coordinate axes. The processor 301 can control the display screen 305 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 310. The acceleration sensor 310 can also be used for game or user motion data collection.

[0098] The gyroscope sensor 311 can detect the body direction and rotation angle of the electronic device 300, and the gyroscope sensor 311 can cooperate with the acceleration sensor 310 to collect 3D actions of the user on the electronic device 300. The processor 301 can realize the following functions according to the data collected by the gyroscope sensor 311: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization when shooting, game control, and inertial navigation.

[0099] The pressure sensor 312 can be disposed at the side frame of the electronic device 300 and / or the lower layer of the display screen 305. When the pressure sensor 312 is disposed at the side frame of the electronic device 300, the holding signal of the user to the electronic device 300 can be detected, and the left-hand or right-hand recognition or the shortcut operation can be performed by the processor 301 according to the holding signal collected by the pressure sensor 312. When the pressure sensor 312 is disposed at the lower layer of the display screen 305, the operability control on the UI interface can be controlled by the processor 301 according to the pressure operation of the user to the display screen 305. The operability control includes at least one of the button control, the scroll bar control, the icon control, and the menu control.

[0100] The optical sensor 313 is used to collect the ambient light intensity. In an embodiment, the processor 301 can control the display brightness of the display screen 305 according to the ambient light intensity collected by the optical sensor 313. Specifically, when the ambient light intensity is high, the display brightness of the display screen 305 is increased; when the ambient light intensity is low, the display brightness of the display screen 305 is decreased. In another embodiment, the processor 301 can also dynamically adjust the shooting parameter of the camera assembly 306 according to the ambient light intensity collected by the optical sensor 313.

[0101] The proximity sensor 314, also referred to as the distance sensor, is usually disposed at the front panel of the electronic device 300. The proximity sensor 314 is used to collect the distance between the user and the front of the electronic device 300. In an embodiment, when the proximity sensor 314 detects that the distance between the user and the front of the electronic device 300 gradually decreases, the display screen 305 is switched from the bright screen state to the off-screen state by the processor 301; when the proximity sensor 314 detects that the distance between the user and the front of the electronic device 300 gradually increases, the display screen 305 is switched from the off-screen state to the bright screen state by the processor 301.

[0102] Those skilled in the art can understand that the structure shown in the above embodiments does not constitute a limitation on the electronic device 300, and the electronic device 300 can include more or fewer components than those shown in the figure, or combine certain components, or adopt a different component arrangement. Figure 3 The structure shown in the above embodiments does not constitute a limitation on the electronic device 300, and the electronic device 300 can include more or fewer components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0103] The embodiment of the present application further provides a computer readable storage medium, at least one piece of computer program is stored in the computer readable storage medium, the at least one piece of computer program is loaded and executed by the processor of the electronic device to realize the operation of the electronic device executed in the intelligent cabin safety monitoring method of the above-mentioned embodiment. For example, the computer readable storage medium can be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk and an optical data storage device and the like.

[0104] Those skilled in the art can understand that all or part of the steps of the above-mentioned embodiments can be completed by hardware, or by program instructing relevant hardware to complete, and the program can be stored in a computer readable storage medium. The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk.

[0105] The above is only optional embodiments of the present application, and is not used to limit the present application, and any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. An intelligent cabin safety monitoring system, characterized in that, The system comprises a sensor network, a data processing and analysis module, a security function module and a warning module; The sensor network comprises a first sensor and at least one second sensor, the first sensor is started after the vehicle is started and is in a running state during the vehicle driving, the second sensor is in a standby state after the vehicle is started, the first sensor is a pressure sensor, used to acquire pressure data in the intelligent cabin during the vehicle driving, the pressure data indicating the pressure on multiple seats in the intelligent cabin; The data processing and analysis module is used to determine the type of abnormal behavior and the position of abnormal behavior of the passenger based on the pressure data if the behavior of the passenger in the intelligent cabin is abnormal, and send a warning instruction to the warning module; determine the second sensor to be started based on the type of abnormal behavior and the position of abnormal behavior, and convert the second sensor to be started from the standby state to the running state; The second sensor is used to acquire monitoring data in the intelligent cabin; The security function module is used to send an emergency instruction to the warning module if the behavior of the passenger is abnormal according to the monitoring data; The warning module is used to remind the driver of the intelligent cabin that the behavior of the passenger is abnormal in response to the warning instruction, and execute an emergency measure in response to the emergency instruction.

2. The system of claim 1, wherein, The data processing and analysis module comprises: A first analysis unit is used to analyze the pressure data to obtain the position of abnormal behavior of the passenger, and the position of abnormal behavior indicates the change of the seat where the passenger is located; A type acquisition unit is used to acquire the type of abnormal behavior of the passenger based on the pressure data corresponding to the first seat and the pressure data corresponding to the second seat if the position of abnormal behavior indicates that the passenger moves between the first seat and the second seat.

3. The system of claim 2, wherein, The first analysis unit is used to: If the pressure data of at least two seats changes in any time period is detected, analyze the pressure data of the at least two seats to obtain the first seat and the second seat, the first seat is a seat with reduced pressure, and the second seat is a seat with increased pressure.

4. The system of claim 2, wherein, The type acquisition unit is used to: If the pressure data corresponding to the first seat indicates that the pressure of the first seat does not decrease to 0, and the pressure data corresponding to the second seat indicates that the pressure of the second seat does not increase to the original pressure of the first seat, it is determined that the passenger does not have abnormal behavior; If the pressure data corresponding to the first seat indicates that the pressure of the first seat decreases to 0, and the pressure data corresponding to the second seat indicates that the pressure of the second seat increases to the original pressure of the first seat, it is determined that the passenger has a behavior of changing seats, if the backrest pressure corresponding to the second seat increases, it is determined that the passenger does not have abnormal behavior, and if the backrest pressure corresponding to the second seat does not change, it is determined that the type of abnormal behavior of the passenger is abnormal behavior of changing seats.

5. The system of claim 1, wherein, The data processing and analysis module is used to: determining, based on the abnormal behavior type, a target monitoring mode from a plurality of candidate monitoring modes, the target monitoring mode being a monitoring mode matching the abnormal behavior type and indicating a second sensor type to be turned on; based on the abnormal occurrence position, determining a second sensor belonging to the sensor type at the abnormal occurrence position as the second sensor to be turned on, controlling the second sensor to be turned on to switch from a standby state to a running state, and controlling a collection direction of the second sensor to be turned on to be towards the abnormal occurrence position.

6. The system of claim 1, wherein, The security function module comprises: a second analysis unit configured to analyze the monitoring data to obtain the behavior type of the passenger; an emergency instruction sending unit configured to send the emergency instruction to the early warning module if the behavior type of the passenger is abnormal behavior, and to switch the second sensor switched to the running state to the standby state if the behavior type of the passenger is that the passenger does not have abnormal behavior.

7. The system of claim 1, wherein, The system further comprises: a data acquisition module configured to transmit the pressure data to the data processing and analysis module and to transmit the monitoring data to the security function module; a data storage module configured to store the pressure data and the monitoring data; a remote monitoring module configured to display the pressure data, the monitoring data, the early warning instruction, and the emergency instruction.

8. An intelligent cabin safety monitoring method, characterized in that, The method is applied to an intelligent cockpit safety monitoring system, and the system comprises a sensor network, a data processing and analysis module, a security function module, and an early warning module. The sensor network comprises a first sensor and at least one second sensor. The first sensor is started after the vehicle is started and is in a running state during vehicle driving. The second sensor is in a standby state after the vehicle is started. The first sensor is a pressure sensor configured to acquire pressure data in the intelligent cockpit during vehicle driving, the pressure data indicating pressure on a plurality of seats in the intelligent cockpit. If the pressure data indicates that the behavior of a passenger in the intelligent cockpit is abnormal, the data processing and analysis module determines an abnormal behavior type and an abnormal occurrence position of the passenger based on the pressure data, sends an early warning instruction to the early warning module, and determines a second sensor to be turned on based on the abnormal behavior type and the abnormal occurrence position, and switches the second sensor to be turned on from a standby state to a running state. The second sensor acquires monitoring data in the intelligent cockpit. If the monitoring data indicates that the behavior of the passenger is abnormal, the security function module sends an emergency instruction to the early warning module. The early warning module reminds a driver of the intelligent cockpit that the behavior of the passenger is abnormal in response to the early warning instruction, and performs an emergency measure in response to the emergency instruction.

9. An electronic device, comprising: The electronic device comprises a processor and a memory, the memory is configured to store at least one computer program, the at least one computer program is loaded and executed by the processor to execute the method of claim 8.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium is configured to store at least one piece of computer program, and the at least one piece of computer program is configured to execute the method in claim 8.

Images