Cabin active health protection system and method based on passenger abnormal behaviors

Abstract

The invention relates to the technical field of automobile cabins, in particular to a cabin active health protection system and method based on passenger abnormal behaviors, and the cabin active health protection system based on the passenger abnormal behaviors comprises a behavior sensing module, a central control unit and an execution linkage module; the behavior sensing module is at least used for collecting audio signals and video signals in a vehicle cabin and identifying abnormal behaviors of passengers and position information of the passengers when the abnormal behaviors occur based on the audio signals and the video signals; the central control unit is at least used for fusing the audio signal and the video signal, judging and confirming an effective abnormal behavior of a target passenger, and generating a control instruction based on the effective abnormal behavior; and the execution linkage module at least comprises a partition air conditioning system, and the partition air conditioning system is at least used for adjusting the air conditioner working state of the target passenger position corresponding to the effective abnormal behavior based on the control instruction, so that an airflow barrier is formed around the target passenger.

Description

Technical Field

[0001] This invention relates to the field of automotive cabin technology, and more specifically to a cabin active health protection system and method based on abnormal occupant behavior. Background Technology

[0002] With increasing demand for healthy travel, air quality inside car cabins is receiving more and more attention. Most existing cabin air purification systems rely on passive responses using physical sensors such as particulate matter sensors and gas sensors. When poor air quality is detected, they automatically turn on the air purifier or switch the air conditioning's recirculation mode.

[0003] However, this type of technology has obvious drawbacks. For example, the pollutants detected by physical sensors are those that have already spread throughout the vehicle, and cannot be intervened at the first moment when virus droplets or aerosols are generated. Furthermore, since the spread has already occurred, the source of the pollutants cannot be identified, and only a general, indiscriminate purification can be performed, resulting in low purification efficiency and insufficient protection. In addition, this high-volume operation may disturb other occupants in the vehicle and cannot form intelligent linkages with other systems in the cabin to build a multi-layered, comprehensive health protection system that takes into account user experience. Summary of the Invention

[0004] In view of the shortcomings of the prior art described above, the purpose of this invention is to provide a cabin active health protection system and method based on abnormal occupant behavior, which at least solves one of the technical problems in the background art.

[0005] To achieve the above objectives, the present invention adopts the following technical solution.

[0006] The first aspect of this invention provides a cabin active health protection system based on abnormal occupant behavior, comprising: The system consists of a behavior perception module, a central control unit, and an execution linkage module. The behavior perception module is at least used to collect and identify abnormal behavior of occupants and their location information when the abnormal behavior occurs, based on audio and video signals in the vehicle cabin. The central control unit is at least used to fuse the audio signal and the video signal to determine and confirm the valid abnormal behavior of the target occupant, and to generate control commands based on the valid abnormal behavior; The execution linkage module includes at least a zoned air conditioning system; the zoned air conditioning system is at least used to adjust the air conditioning operating status of the target occupant position corresponding to the effective abnormal behavior based on the control command, so as to form an airflow barrier around the target occupant.

[0007] As an optional implementation, the execution linkage module further includes a data recording module, a local purification unit, and a global deep cleaning module; the data recording module is at least used to record in real time and determine the pollution level based on the time interval of the occurrence of the effective abnormal behavior, the target occupant location information, and the type of abnormal behavior of the target occupant; the local purification unit is at least used to purify and sterilize the air in the local area where the target occupant is located based on the pollution level; the global deep cleaning module is at least used to execute the corresponding cleaning behavior based on the pollution level.

[0008] As an optional implementation, the data recording module treats the time interval, seat position, and behavior type of each valid abnormal behavior as an event, and calculates the corresponding pollution level based on the number of events occurring in the same seat within a preset time window and the event distribution of multiple seats, in order to characterize the risk level of cabin environment pollution during the ride.

[0009] As an optional implementation, the behavior perception module includes an audio sensor array and a visual sensor; wherein: The behavior perception module collects the audio signals through an audio sensor array and performs sound spectrum analysis on the audio signals to distinguish abnormal audio signals of the occupants. The behavior perception module acquires the video signal through a visual sensor and performs visual recognition on the video signal to distinguish abnormal occupant video signals. The behavior perception module locates the abnormal behavior of the occupants and the location information corresponding to the occurrence of the abnormal behavior based on the abnormal audio signal and the abnormal video signal of the occupants.

[0010] As an optional implementation, the central control unit judges the abnormal audio signal and the abnormal video signal of the occupant, and only when the abnormal audio signal and the abnormal video signal of the occupant are consistent within a preset time window and both point to the same occupant seat, the valid abnormal behavior of the target occupant is confirmed.

[0011] As an optional implementation, the behavior perception module includes a positioning unit, which is linked with a seat pressure sensor and a facial recognition system. When the central control unit confirms the valid abnormal behavior of the target occupant, it locates the location information corresponding to the valid abnormal behavior.

[0012] A second aspect of the present invention provides a cabin active health protection method based on abnormal occupant behavior, comprising: Collect and identify abnormal occupant behavior and occupant location information when abnormal behavior occurs based on audio and video signals inside the vehicle cabin; The audio signal and the video signal are fused together to determine and confirm the valid abnormal behavior of the target occupant, and control commands are generated based on the valid abnormal behavior. Based on the control command, the air conditioning operating status of the target occupant's location corresponding to the effective abnormal behavior is adjusted so that an airflow barrier is formed around the target occupant.

[0013] As an optional implementation, the step of collecting and identifying abnormal occupant behavior and the occupant's location information at the time of the abnormal behavior based on audio and video signals within the vehicle cabin includes: The audio signals are collected and subjected to sound spectrum analysis to distinguish abnormal audio signals of the occupants, which include at least coughing and sneezing sounds. The video signals are collected and visually recognized to distinguish abnormal occupant video signals, which include at least sneezing accompanied by other actions. Based on the abnormal audio signal and video signal of the occupants, the abnormal behavior of the occupants and the location information corresponding to the occurrence of the abnormal behavior are located.

[0014] As an optional implementation, the step of fusing and determining the audio signal and the video signal to confirm the valid abnormal behavior of the target occupant, and generating control commands based on the valid abnormal behavior, includes: Only when the abnormal audio signal and the abnormal video signal of the occupant are consistent within a preset time window and both point to the same occupant seat, is the valid abnormal behavior of the target occupant confirmed and a corresponding control command generated.

[0015] As an optional implementation, adjusting the air conditioning operating status of the target occupant's location based on the control command and / or purifying and sterilizing the air in the local area where the target occupant is located includes: Adjust the blades of the air conditioning vent corresponding to the target occupant to a vertical downward or outward tilt angle, and adjust the airflow of the air conditioning vent to a preset high airflow within a preset time. The exhaust air is purified and / or sterilized using a purification and / or sterilization device installed below the corresponding position of the target occupant.

[0016] A third aspect of the present invention provides an electronic device, comprising: at least one processor; and at least one memory communicatively connected to the processor, wherein: the memory stores program instructions executable by the processor, and the processor invokes the program instructions to perform the steps of the active health protection method for cabin based on abnormal occupant behavior as described in the second aspect of the present invention.

[0017] A fourth aspect of the present invention provides a readable storage medium storing a computer program that is executed by a processor as described in the second aspect of the present invention for the active health protection method for cabin based on abnormal occupant behavior. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a block diagram of a cabin active health protection system based on abnormal occupant behavior, according to a specific embodiment of the present invention.

[0020] Figure 2 This is a block diagram of another active health protection system for cabins based on abnormal occupant behavior, according to a specific embodiment of the present invention.

[0021] Figure 3 This is a working mode diagram of a cabin active health protection system based on abnormal occupant behavior according to a specific embodiment of the present invention.

[0022] Figure 4 This is a flowchart illustrating a specific embodiment of the present invention of an active cabin health protection method based on abnormal occupant behavior.

[0023] Figure 5 This is a flowchart illustrating another active health protection method for cabin based on abnormal occupant behavior according to a specific embodiment of the present invention.

[0024] Figure 6 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0025] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application. Furthermore, it should be understood that the specific embodiments described herein are only for illustration and explanation of this application and are not intended to limit this application.

[0026] It should be noted that the order of description of the following embodiments is not intended to limit the preferred order of the embodiments of this application. Furthermore, the descriptions of each embodiment in the following embodiments have their own emphasis; for parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0027] like Figures 1-3 As shown, the first aspect of the present invention provides a cockpit active health protection system based on abnormal occupant behavior, including a behavior perception module, a central control unit and an execution linkage module, wherein the central control unit is connected to the behavior perception module and the execution linkage module is connected to the central control unit.

[0028] The behavior perception module is at least used to collect and identify abnormal occupant behavior and the occupant's location information when the abnormal behavior occurs, based on audio and video signals within the vehicle cabin.

[0029] Specifically, abnormal behavior refers to abnormal health behaviors, such as coughing and sneezing, which correspond to coughing and sneezing sounds in audio signals and coughing and sneezing actions in video signals.

[0030] Specifically, occupant location information includes the driver's seat, front passenger seat, rear left seat, or rear right seat. Methods for obtaining occupant location information include, but are not limited to, seat pressure sensors and microphone array sound source localization.

[0031] The central control unit is at least used to fuse the audio signal and the video signal to determine and confirm the valid abnormal behavior of the target occupant, and to generate control commands based on the valid abnormal behavior.

[0032] Specifically, the central control unit is either an in-vehicle domain controller or an independent ECU. It stores preset control logic and algorithms and is responsible for processing the information received from the behavior perception module and performing multimodal fusion judgment on the audio and visual recognition results.

[0033] Specifically, valid abnormal behavior is determined by judging abnormal behavior. If valid abnormal behavior is confirmed, the occupant associated with the valid abnormal behavior is the target occupant.

[0034] Specifically, the fusion judgment method aims to reduce interference from irrelevant factors and achieve a more accurate judgment of abnormal behavior by merging audio and video data.

[0035] Specifically, the control command is a proactive health protection cleaning command used by the command execution linkage module to perform rapid local isolation and overall purification.

[0036] like Figure 2As shown, the execution linkage module includes at least a zoned air conditioning system and / or a local purification unit; wherein, the zoned air conditioning system is at least used to adjust the air conditioning operating state of the target occupant position corresponding to the effective abnormal behavior based on the control command, so as to form an airflow barrier in a preset direction around the target occupant.

[0037] Specifically, the zoned air conditioning system has multiple independently controlled air outlets and ducts. The blade angle and air volume of each air outlet can be adjusted independently and quickly, thereby adjusting the air conditioning operation status of the corresponding target occupant position.

[0038] Specifically, an airflow barrier refers to an airflow area with directional flow characteristics created around a target occupant by adjusting the direction and volume of the air outlets of a zoned air conditioning system. This airflow area forms an airflow isolation zone between the target occupant and other areas of the cabin, thereby limiting the outward spread of droplets or aerosols. The airflow barrier controls the angle of the air outlet blades and the airflow volume to ensure the airflow velocity reaches a preset threshold, thus creating an airflow isolation layer with continuous flow momentum around the target occupant.

[0039] Specifically, the local area refers to the airflow control space defined by the airflow barrier and formed around the target occupant. This space at least covers the head and chest area of ​​the target occupant and forms a directional airflow path with the foot air intake channel.

[0040] This invention identifies abnormal health behaviors of occupants in the cabin through a behavior perception module, and the central control unit fuses and confirms the audio and video signals. After confirming valid abnormal behavior, the system controls the zoned air conditioning system to adjust the airflow direction and volume of the air outlet corresponding to the target occupant, forming an airflow barrier with directional flow characteristics around the target occupant. This can activate protective measures before pollutants spread to the entire cabin, reducing the time window for pollution spread and improving the timeliness of protection. By adjusting the airflow direction and volume of the target air outlet to form an airflow isolation zone between the target occupant and other areas of the cabin, the airflow around the target occupant can be directionally controlled to suppress the outward spread of droplets or aerosols, thereby reducing the exposure risk to other occupants. Compared with high airflow or full-area purification methods, this method can achieve the protection purpose while reducing ineffective treatment of risk-free areas, reducing system energy consumption and noise impact, and improving the efficiency of purification resource utilization.

[0041] In one embodiment of the present invention, the execution linkage module further includes a data recording module, a local purification unit, and a full-area deep cleaning module; the data recording module is at least used to record in real time and determine the pollution level based on the time interval of the occurrence of the effective abnormal behavior, the target occupant location information, and the type of abnormal behavior of the target occupant; the local purification unit is at least used to purify and sterilize the air in the local area where the target occupant is located based on the pollution level; the full-area deep cleaning module is at least used to execute the corresponding cleaning behavior based on the pollution level. Here, "full-area" also refers to the entire vehicle cabin.

[0042] Specifically, the data recording module treats the time interval, seat position, and behavior type of each valid abnormal behavior as an event, and calculates the corresponding pollution level based on the number of events occurring in the same seat within a preset time window and the event distribution across multiple seats, in order to characterize the risk level of cabin environment contamination during the ride.

[0043] Specifically, the data recording module records the event time period, seat, and behavior type in real time in the system memory, and can calculate the pollution level based on this.

[0044] For example, if the same seat experiences multiple incidents within a short period of time, the pollution level increases: Level 1 (low level) is defined as no incidents recorded during this trip; Level 2 (medium level) is defined as 1 to 2 isolated incidents occurring at a single seat; Level 3 (high level) is defined as frequent incidents (≥3 times) occurring at a single seat within 10 minutes, or incidents occurring at multiple seats.

[0045] Specifically, depending on the pollution level, the local purification unit can be activated simultaneously, using UVC-LED sterilization lamps and plasma generators installed under the corresponding seats and integrated into the foot air intake duct to sterilize the exhaust air.

[0046] Furthermore, the deep cleaning action based on the pollution level specifically involves linking the pollution level with the full-area deep cleaning module through the data recording module. The full-area deep cleaning module serves as the subsequent execution unit and includes a more powerful ceiling UVC lamp and a disinfectant atomizer.

[0047] For example, based on the information recorded by the data recording module, the pollution level is defined. After leaving the vehicle and the in-vehicle sensors determine that there are no occupants, the system automatically executes different intensity deep cleaning modes according to the final pollution level. If the pollution level is level 3, the system will sequentially execute the following complete process: ① Enhance ventilation inside and outside the vehicle for 5 minutes -> ② Turn on the air conditioner and start the UVC-LED+ plasma generator for 5 minutes -> ③ Trigger the roof UVC lamp and disinfectant atomizer for 5 minutes. If the pollution level is level 2, the system will sequentially execute the following process: ① Enhance ventilation inside and outside the vehicle for 5 minutes -> ② Turn on the air conditioner and start the UVC-LED+ plasma generator for 5 minutes. If the pollution level is level 1, the system will only enhance ventilation inside and outside the vehicle for 5 minutes.

[0048] This method ensures the cleanliness of the air inside the vehicle before passengers board again.

[0049] In one application scenario of this invention, if the linkage module receives a Level 2 cleaning command during vehicle operation, and a local air curtain isolation command is issued simultaneously, the local purification unit corresponding to the risk area is activated. This unit consists of a UVC-LED sterilization lamp and a plasma generator integrated into the footwell air intake duct under the seat. Simultaneously with the activation of the local air curtain isolation function, the UVC-LED lamps arranged in the air intake duct irradiate the air flowing through it. High-intensity short-wave ultraviolet light can directly destroy microorganisms, rendering them unable to replicate, achieving an inactivation efficiency of over 99.9%. This process is completed almost instantly as the air flows through. Simultaneously, the plasma generator releases a large amount of highly active substances into the air duct. These active substances actively encapsulate and penetrate the viral protein shell, oxidizing its structure and achieving chemical decomposition inactivation.

[0050] Here, the present invention records the time interval, seat position and behavior type of abnormal events through a data recording module, and calculates the pollution level; when leaving the vehicle and there are no passengers in the vehicle, a full cabin deep cleaning process of different intensities is triggered based on the pollution level, realizing a closed-loop treatment from immediate local protection at the time of the incident to full cabin cleaning afterward, thereby improving the integrity and sustainability of cabin health protection.

[0051] In one embodiment of the present invention, the behavior perception module includes an audio sensor array and a visual sensor; wherein: The behavior perception module collects the audio signals through an audio sensor array and performs sound spectrum analysis on the audio signals to distinguish abnormal audio signals of the occupants. The behavior perception module acquires the video signal through a visual sensor and performs visual recognition on the video signal to distinguish abnormal occupant video signals. The behavior perception module locates the abnormal behavior of the occupants and the location information corresponding to the occurrence of the abnormal behavior based on the abnormal audio signal and the abnormal video signal of the occupants.

[0052] In one embodiment of the present invention, the central control unit judges the abnormal audio signal and the abnormal video signal of the occupant, and confirms the valid abnormal behavior of the target occupant only when the abnormal audio signal and the abnormal video signal of the occupant are consistent within a preset time window and both point to the same occupant seat.

[0053] Specifically, the consistency criteria refer to consistency in time overlap and consistency in seat orientation.

[0054] In one application scenario of this invention, assuming the preset time window is fixed at 300ms, audio data and visual image data are simultaneously acquired within this time window unit. When the audio sensor detects an audio signal, it performs a short-time Fourier transform or Mel-frequency feature extraction on the audio signal and uses a human voice recognition model to determine if valid vocalization exists. When the short-time energy exceeds a preset threshold and the spectral envelope matches human voice audio characteristics, it is determined to be valid vocalization, and the corresponding seat area number is located. Simultaneously, the visual sensor performs target detection and lip keypoint detection on the image sequence, calculates the lip opening and closing amplitude, and when the amplitude exceeds a preset threshold, it is determined that the target is vocalizing, and the corresponding seat number is located.

[0055] In terms of temporal overlap, the overlap ratio between the time period determined by audio and the time period determined by visual means within the current time window must be ≥80%; seat orientation must be consistent: the seat number located by audio and the seat number located by visual means must be the same physical seat. If the fusion judgment result meets the above temporal overlap requirements and points to the same seat within the same preset time window, then the seat is ultimately determined to be a valid sounding seat.

[0056] In one embodiment of the present invention, the behavior perception module includes a positioning unit, which is linked with a seat pressure sensor and a face recognition system. When the central control unit confirms the valid abnormal behavior of the target occupant, it locates the location information corresponding to the valid abnormal behavior.

[0057] Specifically, the behavior perception module includes an audio sensor array, a vision sensor, and a positioning unit. The audio sensor array consists of multiple high-sensitivity microphones distributed in the cabin ceiling to collect sound signals. The built-in deep learning model analyzes the sound spectrum and can effectively distinguish coughs and sneezes from other environmental noises such as conversations and music. The vision sensor is a wide-angle in-vehicle camera located inside the rearview mirror cover. It uses computer vision algorithms to identify accompanying actions of sneezing, such as occupants covering their mouth and nose with their hands or suddenly leaning forward. The positioning unit works in conjunction with the seat pressure sensor and the facial recognition system. Once abnormal behavior is detected, it can accurately locate the specific occupant's seat, such as the driver's seat, the front passenger seat, or the left or right rear seat.

[0058] Specifically, the central control unit is either an in-vehicle domain controller or an independent ECU. It stores preset control logic and algorithms and is responsible for processing the information received from the behavior perception module. It performs multimodal fusion judgment on the audio and visual recognition results and only confirms a valid abnormal health behavior event when the two recognition results are consistent within the time window and both point to the same seat.

[0059] Here, valid abnormal behaviors are confirmed by audio and video fusion. The linkage is triggered only when the two types of signals are consistent within a preset time window and point to the same seat. This can reduce false triggering caused by in-vehicle music, conversations or occasional actions and improve the reliability of the system response. At the same time, the air supply temperature can be adjusted with reference to the cabin temperature setting to reduce discomfort such as direct cold air blowing and improve passenger comfort.

[0060] This invention achieves a shift from passive environmental perception to proactive behavior recognition and intervention, responding immediately to health risks and significantly reducing the possibility of virus transmission within the cabin, fundamentally solving the problem of delayed response. Through multimodal perception fusion, it accurately locates risk sources and constructs local airflow barriers, greatly improving purification efficiency, avoiding energy waste and disturbance to other occupants, and enhancing purification efficiency. Simultaneously, it integrates the originally independent cabin subsystems (audiovisual, air conditioning, purification and sterilization) into an intelligent and collaborative organic whole, demonstrating a high degree of system integration innovation. Furthermore, it organically combines immediate response, event recording, and deep cleaning after vehicle departure to form a complete proactive health protection system, improving the system's intelligence level and ultimate protective effect, with rigorous logic and comprehensive protection of cabin health.

[0061] like Figure 4 As shown, a second aspect of the present invention provides a cabin active health protection method based on abnormal occupant behavior, comprising: Step S100: Collect and identify abnormal occupant behavior and occupant location information when the abnormal behavior occurs based on audio and video signals in the vehicle cabin; Step S200: The audio signal and the video signal are fused and judged to confirm the valid abnormal behavior of the target occupant, and control instructions are generated based on the valid abnormal behavior; Step S300: Adjust the air conditioning operating status of the target occupant position corresponding to the effective abnormal behavior based on the control command, so as to form an airflow barrier around the target occupant.

[0062] like Figure 5 As shown, in one embodiment of the present invention, in step S100, the step of collecting and identifying abnormal occupant behavior and the occupant's location information at the time of the abnormal behavior based on audio and video signals within the vehicle cabin includes: Step S110: Collect and perform sound spectrum analysis on the audio signal to distinguish abnormal audio signals of the occupants, wherein the abnormal audio signals include at least coughing and sneezing sounds; Step S120: Acquire and perform visual recognition on the video signal to distinguish abnormal occupant video signals, wherein the abnormal occupant video signals include at least sneezing accompanied by actions; Step S130: Based on the abnormal audio signal and abnormal video signal of the occupant, locate the abnormal behavior of the occupant and the location information corresponding to the occurrence of the abnormal behavior.

[0063] In one embodiment of the present invention, the step of fusing and determining the audio signal and the video signal to confirm the valid abnormal behavior of the target occupant, and generating control instructions based on the valid abnormal behavior, includes: Only when the abnormal audio signal and the abnormal video signal of the occupant are consistent within a preset time window and both point to the same occupant seat, is the valid abnormal behavior of the target occupant confirmed and a corresponding control command generated.

[0064] In one embodiment of the present invention, adjusting the air conditioning operating status of the target occupant's location based on the control command and / or purifying and sterilizing the air in the local area where the target occupant is located includes: Adjust the blades of the air conditioning vent corresponding to the target occupant to a vertical downward or outward tilt angle, and adjust the airflow of the air conditioning vent to a preset high airflow within a preset time. The exhaust air is purified and / or sterilized using a purification and / or sterilization device installed below the corresponding position of the target occupant.

[0065] Those skilled in the art can adjust the air outlet angle or air volume according to the actual situation, but this still falls within the clear protection scope of this invention.

[0066] The active cabin health protection method based on abnormal occupant behavior of the present invention corresponds to the active cabin health protection system based on abnormal occupant behavior, and each step in the method can be executed by the corresponding functional module in the system.

[0067] Therefore, for technical details not elaborated in the method embodiments, please refer to the description of the structure, function and working process of the corresponding module in the system embodiments; similarly, for the operating logic not elaborated in the system embodiments, please refer to the step description in the method embodiments.

[0068] Those skilled in the art can implement the present invention based on the above disclosure without affecting the full disclosure of the present invention.

[0069] like Figure 6 As shown, a third aspect of the present invention provides an electronic device, comprising: at least one processor; and at least one memory communicatively connected to the processor, wherein: the memory stores program instructions executable by the processor, and the processor invokes the program instructions to perform the steps of the active health protection method for cabin based on abnormal occupant behavior as described in any of the above embodiments.

[0070] A fourth aspect of the present invention provides a readable storage medium storing a computer program that is executed by a processor as described in any of the preceding embodiments of the active health protection method for cabin based on abnormal occupant behavior.

[0071] Computer-readable storage media can include: any entity or device capable of carrying computer programs, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory, random access memory, and software distribution media, etc. Computer programs include computer program code. Computer program code can be in the form of source code, object code, executable files, or some intermediate form, etc. Computer-readable storage media can include: any entity or device capable of carrying computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory, random access memory, and software distribution media, etc.

[0072] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process, and the scope of the preferred embodiments of the invention includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as will be understood by those skilled in the art to which embodiments of the invention pertain.

[0073] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus or device (such as a computer-based system, a system including a processing module or other system that can fetch and execute instructions from, an instruction execution system, apparatus or device).

[0074] The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A cockpit active health protection system based on abnormal occupant behavior, characterized in that, include: The system consists of a behavior perception module, a central control unit, and an execution linkage module. The behavior perception module is at least used to collect and identify abnormal behavior of occupants and their location information when the abnormal behavior occurs, based on audio and video signals in the vehicle cabin. The central control unit is at least used to fuse the audio signal and the video signal to determine and confirm the valid abnormal behavior of the target occupant, and to generate control commands based on the valid abnormal behavior; The execution linkage module includes at least a zoned air conditioning system; the zoned air conditioning system is at least used to adjust the air conditioning operating status of the target occupant position corresponding to the effective abnormal behavior based on the control command, so as to form an airflow barrier around the target occupant.

2. The active health protection system for cabins based on abnormal occupant behavior according to claim 1, characterized in that, The execution linkage module further includes a data recording module, a local purification unit, and a full-area deep cleaning module; the data recording module is at least used to record in real time and determine the pollution level based on the time interval of the occurrence of the effective abnormal behavior, the target occupant location information, and the type of abnormal behavior of the target occupant; the local purification unit is at least used to purify and sterilize the air in the local area where the target occupant is located based on the pollution level; the full-area deep cleaning module is at least used to execute the corresponding cleaning behavior based on the pollution level.

3. The active health protection system for cabins based on abnormal occupant behavior according to claim 2, characterized in that, The data recording module treats the time interval, seat position, and behavior type of each valid abnormal behavior as an event, and calculates the corresponding pollution level based on the number of events occurring in the same seat within a preset time window and the event distribution of multiple seats, in order to characterize the risk level of cabin environment pollution during the ride.

4. The active health protection system for cabins based on abnormal occupant behavior according to claim 1, characterized in that, The behavior perception module includes an audio sensor array and a visual sensor; wherein: The behavior perception module collects the audio signals through an audio sensor array and performs sound spectrum analysis on the audio signals to distinguish abnormal audio signals of the occupants. The behavior perception module acquires the video signal through a visual sensor and performs visual recognition on the video signal to distinguish abnormal occupant video signals. The behavior perception module locates the abnormal behavior of the occupants and the location information corresponding to the occurrence of the abnormal behavior based on the abnormal audio signal and the abnormal video signal of the occupants.

5. The active health protection system for cabins based on abnormal occupant behavior according to claim 4, characterized in that, The central control unit judges the abnormal audio signal and the abnormal video signal of the occupant. Only when the abnormal audio signal and the abnormal video signal of the occupant are consistent within a preset time window and both point to the same occupant seat, is the valid abnormal behavior of the target occupant confirmed.

6. The active health protection system for cabins based on abnormal occupant behavior according to claim 1 or 3, characterized in that, The behavior perception module includes a positioning unit, which is linked with a seat pressure sensor and a facial recognition system. When the central control unit confirms the valid abnormal behavior of the target occupant, it locates the location information corresponding to the valid abnormal behavior.

7. A cabin active health protection method based on abnormal occupant behavior, characterized in that, include: Collect and identify abnormal occupant behavior and occupant location information when abnormal behavior occurs based on audio and video signals inside the vehicle cabin; The audio signal and the video signal are fused together to determine and confirm the valid abnormal behavior of the target occupant, and control commands are generated based on the valid abnormal behavior. Based on the control command, the air conditioning operating status of the target occupant's location corresponding to the effective abnormal behavior is adjusted so that an airflow barrier is formed around the target occupant.

8. The cabin active health protection method based on abnormal occupant behavior according to claim 7, characterized in that, The process of collecting and identifying abnormal occupant behavior and their location information at the time of the abnormal behavior based on audio and video signals within the vehicle cabin includes: The audio signals are collected and subjected to sound spectrum analysis to distinguish abnormal audio signals of the occupants, which include at least coughing and sneezing sounds. The video signals are acquired and visually recognized to distinguish abnormal occupant video signals, which include at least coughing and sneezing actions. Based on the abnormal audio signal and video signal of the occupants, the abnormal behavior of the occupants and the location information corresponding to the occurrence of the abnormal behavior are located.

9. The cabin active health protection method based on abnormal occupant behavior according to claim 7, characterized in that, The step of fusing and determining the audio signal and the video signal to confirm the valid abnormal behavior of the target occupant, and generating control commands based on the valid abnormal behavior, includes: Only when the abnormal audio signal and the abnormal video signal of the occupant are consistent within a preset time window and both point to the same occupant seat, is the valid abnormal behavior of the target occupant confirmed and a corresponding control command generated.

10. The cabin active health protection method based on abnormal occupant behavior according to claim 7, characterized in that, The adjustment of the air conditioning operating status at the target occupant's location based on the control command and / or the purification and sterilization of the air in the local area where the target occupant is located includes: Adjust the blades of the air conditioning vent corresponding to the target occupant to a vertical downward or outward tilt angle, and adjust the airflow of the air conditioning vent to a preset high airflow within a preset time. The exhaust air is purified and / or sterilized using a purification and / or sterilization device installed below the corresponding position of the target occupant.

11. An electronic device, characterized in that, include: At least one processor; And at least one memory communicatively connected to the processor, wherein: the memory stores program instructions executable by the processor, and the processor invokes the program instructions to perform the steps of the active health protection method for cabin based on abnormal occupant behavior as described in any one of claims 7-10.

12. A readable storage medium storing a computer program, characterized in that, The computer program is executed by a processor to perform the steps of the active cabin health protection method based on abnormal occupant behavior as described in any one of claims 7-10.

Images