An online monitoring and early warning system

Through a multi-sensory online monitoring system, combined with sensing equipment and an intelligent center, real-time status monitoring and early warning of equipment operators are achieved, solving the problems of detection lag and error in existing technologies and improving the safety of equipment operation.

CN114987501BActive Publication Date: 2025-10-14AI-SENSING TECH (GUANGDONG) CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202210732523.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-11-11
Filing Date
2022-06-23
Publication Date
2025-10-14
Estimated Expiration
2042-06-23

AI Technical Summary

Technical Problem

The existing technology for detecting the status of equipment operators has lags and errors, and cannot timely warn the operator of abnormal status, especially when the equipment operator is in the early stages of abnormal behavior, and cannot effectively avoid potential dangers.

Method used

A multi-sensory monitoring method is adopted. The sensory attribute signals in the environment are collected through the first sensor device, and an interactive test is generated in combination with the intelligent center. The second sensor device is used to conduct an interactive test with the operator to confirm whether the operator is within the sane value range of the operable equipment. Different response modes are generated according to the type and concentration of the substance, including voice interaction and external force intervention.

Benefits of technology

It provides timely warnings of abnormal conditions for operators, reduces potential dangers in equipment operation, improves the accuracy and timeliness of detection, and avoids safety accidents caused by errors or lags.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114987501B_ABST
    Figure CN114987501B_ABST
Patent Text Reader

Abstract

In the operation process of the device, the monitoring of the personnel operating the device in the prior art generally adopts a diode type judgment method which can or cannot operate. This judgment method has produced a large number of misjudgment examples, such as the operation personnel taking in cough syrup, lychee, fermented bean curd and other food and being mistaken for drunk driving even drunk driving. The present application relates to an online monitoring and early warning system. The system comprises a set of first sensing devices and second sensing devices. The present application detects the running device based on multiple senses, monitors the operation state of the operator on different devices through the set of small devices, and avoids the possibility of misjudgment by setting an interactive test to confirm the mental state of the operator.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of sensor technology, and in particular to an online monitoring and early warning system. Background Art

[0002] With the advancement of science, more and more auxiliary equipment is being used in our daily lives. These devices require human operators to perform production activities that cannot be accomplished directly by human operators. The operator's working state during equipment operation has a significant impact on safe operation. For example, improper operation by a driver can cause a car accident, or improper operation by a heavy crane operator can cause a crane to overturn.

[0003] In the prior art, there are two main monitoring methods for operators operating equipment: one is to detect the operating status of the equipment; the other is to detect the physiological status of the operator.

[0004] Chinese patent publication number CN111038498A relates to a driving behavior monitoring method, terminal, and computer-readable storage medium. When a monitored vehicle's speed is detected to be non-zero, the method obtains information about the driver's status and the environmental conditions outside the monitored vehicle. Based on the information, the method determines whether the driver is in a pre-determined unsafe driving environment. Detection of operator anomalies based on vehicle operating anomalies has a lag, and even if danger is detected, it may be unavoidable.

[0005] Another monitoring method is to detect the operator's physiological state. Chinese patent publication number CN106448061A relates to a monitoring system for driver fatigue driving, including a microprocessor, a heart rate monitoring module, a blood pressure monitoring module, a timing module, a seat monitoring module, and a voice prompt module. The microprocessor is responsible for setting thresholds for the driver's blood pressure, heart rate, and driving time, and receiving monitoring information. The heart rate monitoring module is responsible for transmitting the driver's heart rate information to the microprocessor. The blood pressure monitoring module is responsible for transmitting the driver's blood pressure information to the microprocessor. The timing module is responsible for timing when the driver starts driving. The seat monitoring module is a pressure sensor distributed on the driver's seat, which is responsible for monitoring the driver's position on the seat and sending the driver's seat position information to the microprocessor. The voice prompt module is responsible for receiving the deceleration and stop driving information sent by the microprocessor and broadcasting it to the driver. Detecting the operator's physiological state can promptly detect abnormal operations caused by physiological problems, but it cannot avoid detecting abnormal conditions such as the operator's mental state or the initial stage of foreign body inhalation that does not cause physiological abnormalities, resulting in a detection blank period in the early stage of detection.

[0006] Based on this, the present invention relates to an online monitoring and early warning system, which can be used to monitor abnormal operations of operators during the start of equipment operation, and obtain a variety of monitoring data through multi-sensory monitoring means, so as to warn operators of abnormal conditions of operators.

[0007] In addition, on the one hand, there are differences in understanding among those skilled in the art; on the other hand, the applicant studied a large number of documents and patents when making the present invention, but due to space limitations, not all details and contents are listed in detail. However, this does not mean that the present invention does not have the characteristics of these prior arts. On the contrary, the present invention already has all the characteristics of the prior art, and the applicant reserves the right to add relevant prior art to the background technology. Summary of the Invention

[0008] Automated or semi-automated equipment has become widespread in modern society, bringing significant convenience to daily life. While these devices serve as auxiliary tools, they still require human operation to complete production. For example, if a driver becomes unconscious due to alcohol consumption or carbon monoxide release from the vehicle, a car accident can occur. Existing technology often relies on visual sensing to detect operator status, using abnormal operator behavior to determine if a problem has occurred. On the one hand, by the time an operator exhibits abnormal behavior, serious consequences may have already occurred, resulting in delayed detection and failure to provide a warning. On the other hand, visual detection is highly prone to errors. Even in the early stages of abnormal behavior, an operator may maintain a normal operating posture, resulting in errors that are not detected by visual sensing. Furthermore, due to individual variability, some normal operator actions may be perceived as abnormal.

[0009] To address the problems of the existing technology, the present invention provides an online monitoring and early warning system. The early warning system is used to monitor the operator's status during the operation of the equipment to prevent accidents caused by dizziness, fatigue, distraction, drunkenness, etc.

[0010] The system comprises a first sensing device and a second sensing device. When the device is powered on, the smart center reads a first sensory attribute signal of the environment where the device operator is based on the first sensing device. When the first sensory attribute signal collected by the first sensing device is abnormal, it means that the environment where the device operator is based has a substance that affects the operation state of the device operator, and the smart center generates an interaction test with the device operator and completes the interaction test with the device operator through the second sensing device, so as to confirm whether the device operator is within the range of the rational value of the operable device. When the smart center confirms that the device operator is within the range of the rational value, the first sensing device arranged in the interior of the vehicle body can collect the concentration of the substance that affects the operation state of the device operator in the environment.

[0011] In actual operation, the substance (alcohol or carbon monoxide) that affects the operation state of the operator may not affect the operator's sanity below a certain concentration based on the physical differences of the operator. At the same time, alcohol volatilized in the device environment will be inhaled by the operator, causing misunderstanding of drunk driving. The first sensing device in the present application can comprise a plurality of odor sensors arranged at different positions in the device. When it is confirmed that the sanity of the operator is normal, in order to eliminate the substance in the environment that may affect the operator, the first sensing device starts to monitor the concentration of the abnormal substance in the environment. Based on the concentration difference at different positions, the source of the abnormal substance is confirmed, and the operator is warned to eliminate the problem of the source of the abnormal substance. For example, when the air conditioner in the vehicle appears abnormal and emits carbon monoxide, even if the operator does not have the problem of sanity abnormality, the existence of carbon monoxide will cause harm to the operator, so it is necessary to eliminate the source. Since the air conditioner in the vehicle generally has two, the operator cannot determine which window the carbon monoxide in the vehicle comes from. Based on the concentration detection of the first sensing device, the operator can know the source of the carbon monoxide, and find the source of the problem in time to repair or shut down. Preferably, the smart center can confirm the type of abnormal substance based on the information collected by the first sensing device, and preferentially open part of the odor sensors according to the position where the abnormal substance may occur. For example, when the abnormal substance is carbon monoxide, the smart center preferentially opens the odor sensor near the air conditioner port.

[0012] The law stipulates that driving a vehicle with a blood alcohol content greater than or equal to 80mg / 100mL is considered drunk driving; driving a vehicle with a blood alcohol content greater than or equal to 20mg / 100mL and less than 80mg / 100mL is considered driving under the influence. In the prior art, methods for detecting the driver's condition in a vehicle often refer to this setting and test the driver's breath for alcohol. However, in practice, due to individual physical differences, even if the driver's blood alcohol content does not reach the drunk driving or drunk driving standards, they may still experience dizziness, emotional confusion, and other conditions that affect driving behavior, making them unsuitable for continued driving. If a sobriety test is performed before driving, regardless of whether the driver has consumed alcohol, it will increase the workload of pre-driving preparations, causing trouble and distress for drivers in normal conditions.

[0013] The present invention further comprises a third sensor, which can be used to receive the voice of the driver in the vehicle body. Preferably, the third sensor can be a sound collection device.

[0014] The third sensor can collect sounds from the driver and the environment. The intelligent center categorizes the collected sounds into dangerous and non-dangerous categories. Dangerous sounds can include error tones that are inconsistent with the vehicle's current operating state, speech produced by an abnormal driver state, and frequent loud noises. These sounds may be caused by a driver who is intoxicated. The intelligent center determines the driver's driving status based on the detected dangerous type and the odor concentration transmitted by the first sensor.

[0015] The first and second sensing devices are powered off. When the device is turned on by the device operator, the first sensing device powers on synchronously with the device and collects first sensory attribute signals from the device operator's environment. The first sensing device transmits the collected first sensory attribute signals to the intelligent center. The intelligent center compares the collected first sensory attribute signals with a set threshold range for the first sensory attribute signals to analyze whether the device operator's environment contains substances that may affect their mental state.

[0016] According to a preferred embodiment, the driver can be divided into at least three states based on the alcohol intake status, the first state is a sober state without alcohol intake, the second state is a state of alcohol intake but no abnormal behavior, and the third state is a state of alcohol intake and abnormal behavior.

[0017] According to a preferred embodiment, the intelligent center can generate different levels based on the substance type and concentration, thereby producing different response patterns. Based on the collected substance type and concentration, the intelligent center generates at least three concentration gradients: a first concentration gradient for indicating an abnormality, a second concentration gradient for determining whether the operator is abnormal through interactive testing, and a third concentration gradient for preventing the operator from operating the equipment through external means. Substances that affect the equipment operator's mental state can be substances produced by the equipment or carried or produced by the equipment operator themselves, such as alcohol or carbon monoxide. Furthermore, according to existing practices, when a person consumes foods such as mangoes and durian, a device that detects alcohol intake through breathalyzers may detect an alcohol level that indicates a person is intoxicated or even intoxicated. Therefore, both the first and second concentration gradients collected by the first sensing device raise concerns about the driver's alcohol consumption. Direct voice interaction after entering the second concentration gradient could disrupt the driving of a conscious driver or irritate an emotionally agitated driver. Based on this, when the gas information collected by the first sensing device is in the second concentration gradient, the sound information in the environment monitored by the third sensing device becomes an important basis for judging whether the intelligent center issues a voice interaction command.

[0018] The intelligent center can further classify the sounds that have been classified as dangerous types to determine whether the driver is in a state where voice interaction is possible. Preferably, the judgment condition can be the volume or the type of sound. Specifically, when the sound of the dangerous type does not reach the third threshold, the intelligent center triggers the second sensing device to perform voice interaction. When the sound of the dangerous type reaches the third threshold, the intelligent center triggers the second sensing device to send a warning. When the sound of the dangerous type monitored by the third sensing device accompanied by a warning continues or accumulates to exceed the fourth threshold, the intelligent center processes the situation as if the environment has entered a third concentration gradient. The third threshold can include only sounds of dangerous types that are not generated by the human body in the environment, sounds generated by the human body below 40 decibels, or both of the above occurring at the same time. The fourth threshold can be no less than 1 minute.

[0019] For example, when only a vehicle error indication appears, or when a vehicle error indication is accompanied by human speech below 40 decibels, the intelligent center determines that the driver is in a communicative abnormal behavior state or a communicative awake state, at which point the intelligent center triggers the second sensor device for voice interaction. If human speech exceeds 40 decibels and lasts for more than 10 seconds, the intelligent center determines that the driver is in an uncommunicative abnormal behavior state or an uncommunicative awake state (road rage state), at which point the intelligent center continues to issue warnings. If the warning exceeds 1 minute and the situation does not improve, the intelligent center will treat the environment as entering the third concentration gradient.

[0020] The intelligent center combines information collected by the third sensor with the first sensor to determine the driver's current state and prevent an agitated driver from being further aroused by voice interaction, potentially leading to driving accidents. By combining ambient sounds and smells, the center can determine whether the driver is in a stable state after being intoxicated. This allows for alcohol testing to be performed at the appropriate time, minimizing disruption to the driver and achieving the desired effect.

[0021] The intelligent center can generate different levels and response modes based on the substance type and concentration. Specifically, when the parameters related to the substance concentration provided by the first sensor device are transmitted to the intelligent center in the form of a data packet, the intelligent center determines the concentration gradient judgment mode based on the substance type and compares the concentration parameters to determine the next stage mode.

[0022] The first substance can be divided into at least three gradients according to concentration values, namely a first concentration gradient, a second concentration gradient and a third concentration gradient.

[0023] When the substance is at the first concentration gradient, the intelligent center generates an inquiry process to inform the operator of potential dangers.

[0024] When the substance is in the second concentration gradient, the intelligent center generates an interactive test to eliminate potential hazards.

[0025] If the operator completes the interactive test, the system automatically downgrades to the first concentration gradient and informs the operator to avoid the risk of being inspected until the environment is safe. If the test is not completed, the system upgrades to the third concentration gradient.

[0026] When the substance reaches the third concentration gradient, the intelligent center generates an external warning, garnering assistance from officials or external personnel. For example, a drunk driver with an oral alcohol concentration of 80mg / 100mL would be considered unconscious and should be stopped immediately.

[0027] According to a preferred embodiment, based on the different types of substances, the external force objects used by the third-level intelligent center are also different, wherein the types of substances are at least divided into flammable substances, substances that harm the human body, and non-harmful substances. Different substances cause different damage to the environment and the human body. When the substance is flammable, the external force object can be the police, fire department, and emergency center. When the substance has the ability to harm the human body, the external force object can be the police and emergency center. When the substance is not harmful to the human body and is not harmful to the environment, the external force object is the police.

[0028] According to a preferred embodiment, if the intelligent center determines, based on the results of the first interaction test, that the equipment operator is within a sane value range where they cannot operate the equipment, the intelligent center generates a second interaction test based on the operator's past operation history of dangerous operations below the first threshold. The content of the second interaction test is different from that of the first interaction test.

[0029] According to a preferred embodiment, the smart center obtains the operator's previous operation history by sending a query request to the history database with the operator's permission, wherein the operator providing permission to send the query request to the history database includes the following steps:

[0030] The operator's facial information and / or fingerprint information on the mobile terminal is compared with the operator's identity information. If the comparison result shows that the operator sending the query request matches the identity information of the object stored in the historical database, the historical database allows the smart center to query its stored content related to the operation history. If the comparison result shows that the operator sending the query request does not match the identity information of the object stored in the historical database, the historical database rejects the smart center's query request and sends a personal information error prompt via the mobile terminal. Preferably, after the initial authorization, the smart center can maintain the authorization status and enter the detection process.

[0031] According to a preferred embodiment, the first sensing device is capable of monitoring the quantity of odor factors in the environment, that is, the odor concentration, wherein the first sensing device is circumferentially assembled with multiple odor sensors so as to be able to monitor the propagating odor in a 360° direction.

[0032] According to a preferred embodiment, the system further includes a thermal imager. When the intelligent center determines that the substance is alcohol, the thermal imager begins operating in response to the intelligent center's determination. If the direction of the alcohol's odor propagation is found to be the same as the direction of the 37°C heat source detected by the thermal imager, the alcohol is confirmed to have originated from the operator. Based on this, the intelligent center analyzes the alcohol concentration.

[0033] According to a preferred embodiment, the system is provided with different detection modes, including a first detection mode for detecting the generation of abnormal gas, a second detection mode for detecting the concentration of the generated abnormal gas, and a third detection mode for detecting the abnormal gas flow distribution.

[0034] According to a preferred embodiment, the data provided by the odor sensor received by the first sensory attribute signal can provide a basis for the smart center to analyze the type and concentration of the substance, so that the smart center can confirm the response measures that need to be taken.

[0035] According to a preferred embodiment, the second sensory attribute signal collected by the second sensing device can be the vocalization information of the device operator obtained by the intelligent center interacting with the device operator, and the intelligent center determines the rationality value of the device operator based on the vocalization information collected during the interaction.

[0036] According to a preferred embodiment, the rationality value is provided with a first threshold value, when the rationality value is lower than the second threshold value, the intelligent center confirms that the operator is in an unconscious state that is not suitable for operating the device, and switches to a third concentration gradient for stopping the operator from operating the device by external force.

[0037] According to a preferred embodiment, the detection module comprises a microphone device encapsulating the odor sensor and the sound sensor to realize the identification of the sound generated by the detected device in operation and the odor in the environment maintained by the detected device. Preferably, the intelligent center is in the same encapsulation shell as the first sensing device and the second sensing device, and an electrical signal connection is established inside the encapsulation shell. The first sensing device and the second sensing device are connected in parallel. The parallel circuit is connected with the intelligent center. The encapsulation shell is provided with air holes at positions corresponding to the first sensing device and the second sensing device on the surface of the shell in a manner that facilitates the contact of sound waves and gas with the first sensing device and the second sensing device.

[0038] According to a preferred embodiment, the intelligent center at least comprises an operational amplification module and a signal conversion module, wherein the operational amplification module and the signal conversion module can convert the signal type collected by the first sensing device and the second sensing device into the same type as the signal type processed by the backend device when the signal processing unit is enabled. Preferably, the sound sensor can be a MEMS sound pickup unit.

[0039] According to a preferred embodiment, the integrated detection system can be conveniently carried, and when the operator changes the operating device, only the integrated detection system is transferred to another operating device, and the transfer is completed. Preferably, the integrated detection system can be arranged in the mobile terminal of the device operator or other portable devices, so that the related detection system can provide an alarm for the environmental abnormalities of the operator at any time. BRIEF DESCRIPTION OF DRAWINGS

[0040] Figure 1 is an example diagram of the spread of substances in a vehicle provided by the present application. DETAILED DESCRIPTION

[0041] The following will be described in detail with reference to the accompanying drawings.

[0042] To address the problems existing in the prior art, the present invention provides an online monitoring and early warning system. The early warning system is used to monitor the operator's status during the operation of the equipment to prevent accidents caused by dizziness, fatigue, distraction, drunkenness, etc.

[0043] The system includes at least a first sensor device and a second sensor device. When the device is powered on, the intelligent center reads a first sensory attribute signal of the device operator's environment based on the first sensor device. An abnormality in the first sensory attribute signal collected by the first sensor device indicates the presence of a substance in the device operator's environment that affects the device operator's operating state, triggering the intelligent center to generate an interaction test with the device operator. The interaction test is then completed with the device operator via the second sensor device to confirm whether the device operator is within a sane value range for operating the device.

[0044] like Figure 1 As shown, when a driver is driving alone, they can place the combined system inside the car. Because the first sensing device of the system is equipped with multiple odor sensors arranged in a 360-degree direction to monitor the spread of odors, the system can be placed anywhere in the car and still monitor the amount of odor factors in the environment, that is, the odor concentration.

[0045] Specifically, the system is connected to the vehicle body via Bluetooth. Before the vehicle is started, the first sensor device and the second sensor device are in a shutdown state. When the vehicle is started by the device operator and the engine is ignited, the first sensor device starts working synchronously with the vehicle and collects the first sensory attribute signal for the driver's environment. The first sensor device sends the collected first sensory attribute signal to the intelligent center. The intelligent center is used to compare the obtained first sensory attribute signal with the set first sensory attribute signal threshold range to analyze whether the environment in which the device operator is located contains substances that affect the device operator's mental state. When carbon monoxide leaks from the air conditioner, the first sensor device sends the collected carbon monoxide odor information to the intelligent center.

[0046] According to a preferred embodiment, the intelligent center can generate different levels according to the type and concentration of the substance to produce different response modes, wherein, based on the collected type and concentration of the substance, the intelligent center generates at least three concentration gradients, including a first concentration gradient for indicating abnormalities, a second concentration gradient for determining whether the operator is abnormal through interactive testing, and a third concentration gradient for preventing the operator from operating the equipment with the help of external force. The substance that affects the mental state of the equipment operator can be a substance produced by the equipment, and it can also be carried or produced by the equipment operator himself, such as alcohol and carbon monoxide. The intelligent center obtains the concentration information of carbon monoxide in the environment. When the concentration of carbon monoxide reaches the second concentration gradient, i.e. 1.3g / L, the intelligent center generates an interactive test.

[0047] The intelligent center can generate different levels and response modes based on the substance type and concentration. Specifically, when the parameters related to the substance concentration provided by the first sensor device are transmitted to the intelligent center in the form of a data packet, the intelligent center determines the concentration gradient judgment mode based on the substance type and compares the concentration parameters to determine the next stage mode.

[0048] The first substance can be divided into at least three gradients according to concentration values, namely a first concentration gradient, a second concentration gradient and a third concentration gradient.

[0049] When the substance is at the first concentration gradient, the intelligent center generates an inquiry process to inform the operator of potential dangers.

[0050] When the substance is in the second concentration gradient, the intelligent center generates an interactive test. Preferably, the interactive test can be a Freud consciousness test for self-awareness cognition. When the concentration of carbon monoxide reaches the second concentration gradient, that is, 1.3g / L, the intelligent center that generates the interactive test generates a test voice through a second sensing device and receives the driver's answer. When the driver's answer score is less than 30 points, the intelligent center determines that the driver is in an unconscious state. The intelligent center inquires about the driver's driving history (driving license points deduction or traffic police fines) based on the driver's authorization before getting on the car. When the driver's past driving history has no history of points deduction or money deduction, the intelligent center generates a second interactive test. It should be noted that the contents of the first interactive test and the second interactive test are different. The second interactive test can be the international standard version of the Enneagram personality test.

[0051] If the operator completes the interactive test, the system automatically downgrades to the first concentration gradient and informs the operator to avoid the risk of being inspected until the environment is safe. If the test is not completed, the system upgrades to the third concentration gradient.

[0052] When the substance is in the third concentration gradient, the intelligent center generates an external warning. Get help from official personnel or equipment outside auxiliary personnel. For example, when drunk driving, the alcohol concentration in the driver's mouth is as high as 80mg / 100mL, and the driver's mind is unclear at this alcohol concentration, which should be stopped directly.

[0053] According to a preferred embodiment, since the carbon monoxide ingested by the driver belongs to a substance that can cause harm to the human body and is flammable, when the carbon monoxide concentration reaches the third gradient concentration (1.8g / L) or the interactive test fails, the intelligent center notifies the police, fire and emergency center by making a phone call.

[0054] According to a preferred embodiment, the intelligent center will obtain the operation history of the operator by sending a query request to the historical database with the permission provided by the operator, wherein the permission provided by the operator to send a query request to the historical database includes the following steps:

[0055] The comparison between the identity information of the operator and the face information and / or fingerprint information of the mobile terminal of the operator is completed; when the comparison result shows that the identity information of the operator sending the query request is consistent with the identity information of the object stored in the historical database, the historical database allows the intelligent center to query the content related to the operation history stored therein; when the comparison result shows that the identity information of the operator sending the query request is not consistent with the identity information of the object stored in the historical database, the historical database rejects the query request of the intelligent center and sends a personal information error prompt based on the mobile terminal. Preferably, after the first authorization, the intelligent center can maintain the authorized state to enter the detection process.

[0056] According to a preferred embodiment, the system is provided with different detection modes, including a first detection mode for detecting abnormal gas generation, a second detection mode for detecting the concentration and type of generated abnormal gas, and a third detection mode for detecting the flow distribution of abnormal gas. Based on different environmental factors, the system can adopt different detection modes. For example, when the operator detects the formaldehyde concentration in the vehicle body, the system can be set to the second detection mode, that is, to confirm the type of detection gas and to clearly detect the purpose.

[0057] According to a preferred embodiment, the first sensing device and the second sensing device can be separately arranged. The first sensing device comprises a plurality of odor sensors, the detection range of the plurality of odor sensors covering all the space inside the vehicle, wherein the odor sensors have names corresponding to the information of their locations in the intelligent center, so that the intelligent center obtains the accurate occurrence position of the first sensory attribute signal. Preferably, the odor sensors are arranged at positions where gas leakage hazards may exist inside the operating device and positions directly opposite to the operating personnel without hindering the field of vision of the operating personnel. The detection range of the plurality of odor sensors covers the space where the operating personnel is located. Since the odor sensors can determine the odor concentration by detecting the number of odor factors, when the intelligent center receives the first sensory attribute signal sent by no less than two odor sensors, the intelligent center confirms that the position of the odor sensor with the largest number of monitored odor factors is the source of the odor substance.

[0058] According to a preferred embodiment, the odor sensor collects odor molecules in the environment and generates different sizes of currents corresponding to different odor molecules based on the influence of the odor molecules in the environment on the current transmission thereof. The odor sensor can monitor the gas concentration, gas type or gas flow rate in the environment, so that the processing module at the back end comprehensively evaluates the odor in the environment. The odor sensor involved in the present application can achieve passive detection based on chemical catalysts, that is, only when specific odor molecules enter the first recognition module and react with specific chemical catalysts will the specific detection circuit of the first recognition module detect them, which means that the first recognition module adopted in the present scheme is very power-saving even in a long-term search mode for odor molecules. This has obvious beneficial effects on vehicle operating state detection devices that need to be long-term arranged on machines and have no one to maintain and supervise, and the self-sufficiency, endurance and maintenance-free nature of the device are greatly improved.

[0059] According to a preferred embodiment, the data provided by the odor sensor received by the first sensory attribute signal can provide the basis for the intelligent center to analyze the substance type and concentration, so that the intelligent center confirms the measures to be taken.

[0060] According to a preferred embodiment, during the interactive test, the operator's voice can be received and sent to the smart center. The smart center determines whether the information is consistent with the logic of the question provided by the smart center based on the voice content. For example, when the driver becomes unconscious due to excessive inhalation of carbon monoxide, the second sensor device provides the operator with a question in the form of sound, "What did you eat for lunch?" When the driver answers "Elephants are so beautiful", the smart center determines that the driver is not conscious and does not give points; when the driver answers "I forgot", the smart center adds 10 points to the total test, and the full score of the test content is 100 points. When the driver's test score is lower than 70 points, the smart center determines that the driver is not conscious. The score of the second interactive test is higher than the score required for the first interactive test.

[0061] According to a preferred embodiment, the sanity value is set to a first threshold. When the sanity value falls below the first threshold, the intelligent center determines that the operator is in an unconscious state and is unsuitable for operating the equipment, and switches to a third gradient concentration that uses external force to prevent the operator from operating the equipment. Specifically, the sanity value can range from 0 to 100 points. When the driver's sanity value falls below 70 points, the intelligent center can determine that the driver is in an irrational state. Sanity value is determined based on the results of interactive testing.

[0062] According to a preferred embodiment, the detection module includes a microphone device encapsulated with an odor sensor and a sound sensor to realize the recognition of the sound generated by the running detected device / the odor in the environment maintained by the detected device. Preferably, the intelligent center is in the same packaging shell as the first sensor device and the second sensor device, and an electrical signal connection is established inside the packaging shell. The first sensor device and the second sensor device circuit are connected in parallel. The parallel circuit is connected to the intelligent center. The packaging shell is provided with air holes at positions corresponding to the first sensor device and the second sensor device in a manner that facilitates sound waves and gas to contact the first sensor device and the second sensor device. The intelligent center includes at least an operational amplifier module and a signal conversion module, wherein the operational amplifier module and the signal conversion module can, when the signal processing unit is enabled, convert the signal type collected by the first sensor device and the second sensor device into the same type as the signal type processed by the back-end device. Preferably, the sound sensor can be a MEMS pickup unit.

[0063] According to a preferred embodiment, the integrated detection system is portable. When an operator changes operating equipment, they can simply transfer the integrated detection system to the other operating equipment. Preferably, the integrated detection system can be installed in the equipment operator's mobile terminal or other portable device, allowing the relevant detection system to provide the operator with timely alerts of environmental anomalies.

[0064] It should be noted that the above-mentioned embodiments are only examples, and those skilled in the art can think of various solutions under the inspiration of the disclosure of the present application, and these solutions also belong to the disclosed range of the present application and fall within the protection scope of the present application. Those skilled in the art should understand that the specification and drawings of the present application are illustrative and not limiting to the claims. The protection scope of the present application is defined by the claims and their equivalents. The specification of the present application contains multiple inventive concepts, such as "preferably", "according to a preferred embodiment" or "optionally", which all indicate that the corresponding paragraph discloses an independent concept, and the applicant reserves the right to file a divisional application according to each inventive concept. Throughout the text, the features introduced by "preferably" are only optional ways, and should not be understood as necessarily provided, therefore the applicant reserves the right to abandon or delete the relevant preferred features at any time.

Claims

1. An online monitoring and early warning system, characterized in that: The system comprises a first sensing device, a second sensing device, a third sensing device and a thermal imager. The first sensing device comprises a plurality of odor sensors arranged at different positions within the device. The second sensing device is used to generate a test voice and receive the response of the device operator. The third sensing device collects the sounds of the driver and the environment. When the device enters the power-on state, the intelligent center reads the first sensory attribute signal of the environment in which the device operator is located based on the first sensor device. The abnormality of the first sensory attribute signal collected by the first sensor device indicates that the environment in which the device operator is located has substances produced by the device that affects the operating state of the device operator and substances carried or produced by the device operator himself. The intelligent center generates different levels according to the type and concentration of the substance, which triggers the intelligent center to generate an interaction test with the device operator and complete the interaction test with the device operator through the second sensor device. The second sensory attribute signal collected by the second sensor device can be the voice information of the device operator obtained by the intelligent center interacting with the device operator. The intelligent center judges the sanity value of the device operator based on the voice information of the device operator collected during the interaction process to confirm whether the device operator is within the sanity value range for operating the device. When the smart center confirms that the equipment operator is within the sane value range, the first sensing device arranged inside the equipment collects multiple odor sensors in a circumferential manner to collect the concentration of substances in the environment that affect the operating status of the equipment operator in a manner that can monitor the propagating odor in a 360-degree direction. The smart center can confirm the source of the abnormal substance based on the concentration difference at different locations, and confirm the type of abnormal substance based on the information collected by the first sensing device, and preferentially open some odor sensors according to the location where the abnormal substance type occurs. When the smart center determines that the substance type is alcohol, the thermal imager responds to the judgment of the smart center and starts working. When it is found that the propagation direction of the alcohol odor is the same as the direction of the 37°C heat source detected by the thermal imager, it is confirmed that the alcohol comes from the operator. The sound information in the environment monitored by the third sensor device is used as the basis for determining whether the intelligent center issues a voice interaction instruction.

2. The early warning system according to claim 1, characterized in that: When the smart center determines, based on the test results of the first interaction test, that the equipment operator is within a sane value range where the equipment operator cannot operate the equipment, the smart center generates a second interaction test by analyzing the equipment operator's past operation history of dangerous operations below the first threshold.

3. The early warning system according to claim 2, characterized in that: The content of the second interactive test is different from the content of the first interactive test.

4. The early warning system according to claim 3, characterized in that: Based on the different types of substances, the external force objects used by the intelligent center in the third concentration gradient are different, wherein the types of substances are at least divided into flammable substances, substances that harm the human body, and non-harmful substances.

5. The early warning system according to claim 4, characterized in that: The system is provided with different detection modes, including a first detection mode for detecting the generation of abnormal gas, a second detection mode for detecting the concentration of the generated abnormal gas, and a third detection mode for detecting the flow distribution of abnormal gas.

6. The early warning system according to claim 5, characterized in that: The data provided by the odor sensor received by the first sensory attribute signal can provide a basis for the smart center to analyze the type and concentration of the substance, so that the smart center can confirm the response measures that need to be taken.

7. The early warning system according to claim 1, characterized in that: The early warning system is provided with a detection module, which includes a microphone device encapsulating an odor sensor and a sound sensor to realize the recognition of the sound generated by the running detected equipment / the odor in the environment maintained by the detected equipment.

8. The early warning system according to claim 1, characterized in that: The sanity value is set with a first threshold. When the sanity value is lower than the first threshold, the intelligent center confirms that the equipment operator is in an unconscious state that is not suitable for operating the equipment, and switches to a third concentration gradient that uses external force to stop the equipment operator from operating the equipment.

Citation Information

Patent Citations

  • Monitoring system for fatigue driving of driver

    CN106448061A

  • Driving behavior monitoring method, terminal and readable storage medium

    CN111038498A

  • Warning and intervention system for drunk driving of drivers and operation and control method of warning and intervention system for drunk driving of drivers

    CN102555803A

  • Automobile interior rearview mirror with drunk driving recognition and reminding functions

    CN110395183A

  • Intelligent man-machine interaction system and method based on personnel behavior data

    CN110524559A