Household intelligent security system integrating bluetooth audio and video monitoring and working method

Abstract

The application provides a household intelligent security system integrating Bluetooth audio and video monitoring and a working method, which not only has functions such as door magnetic induction, temperature and humidity induction, flammable gas and smoke induction, but also integrates a Bluetooth audio module and a video monitoring module, so that a user can check the state of home in real time through a mobile terminal such as a mobile phone and can remotely control as needed. The system is in a low-power monitoring mode in ordinary times, and when the system monitors an abnormal condition, such as a door being opened, a smoke concentration being too high, etc., the user will be immediately notified, the Bluetooth audio module can broadcast in a voice mode, and the system can be switched to a high-definition recording mode to provide real-time video stream, so that the user can quickly understand and handle the abnormal condition. Such a design can not only realize comprehensive home security monitoring, but also is more in line with the energy-saving and comfortable requirements of people on the home environment.

Description

Technical Field

[0001] This invention belongs to the field of smart home technology, and specifically relates to a home smart security system and its working method that integrates Bluetooth audio and video monitoring. Background Technology

[0002] Current home security systems primarily include video surveillance, door / window sensors, infrared alarms, and smoke alarms. Video surveillance, using cameras installed in key locations throughout the home, allows for real-time monitoring of the home's security. Door / window sensors detect the open / closed status of doors and windows to prevent unauthorized entry. Infrared alarms detect intruders by detecting infrared radiation emitted by the human body. Smoke alarms detect changes in smoke concentration to warn of fires.

[0003] In addition, these devices can typically connect to the user's mobile phone or computer via wireless network. When the security system detects an abnormal situation, it will automatically send an alarm message to the user, allowing them to be informed of the situation at home in a timely manner.

[0004] However, the existing technology has the following drawbacks:

[0005] While existing smart home security systems have improved home safety and convenience to some extent, they often focus on single sensing capabilities, such as security, and cannot provide a comprehensive understanding of the home environment. Furthermore, current technologies typically require users to remain constantly connected, even at home, necessitating continuous monitoring of their phones, and the power consumption during continuous operation is also a significant burden; thus, they conflict with people's desire for a natural and relaxed living environment.

[0006] Therefore, how to build an intelligent security system solution that integrates multiple sensing functions, is energy-saving and environmentally friendly, and has a user-friendly interface has become an urgent problem to be solved in the field of smart homes.

[0007] In addition, the technical terms in this field include:

[0008] SOC stands for System on Chip, which refers to a system-level processor chip. Summary of the Invention

[0009] To address the aforementioned issues, this application aims to propose a home intelligent security system integrating Bluetooth audio and video monitoring. This system not only features door magnetic sensing, temperature and humidity sensing, and combustible gas and smoke detection, but also integrates a Bluetooth audio module and a video monitoring module. Users can view the status of their home in real time via mobile devices such as smartphones and remotely control the system as needed. Normally, the system operates in a low-power monitoring mode. When the system detects an anomaly, such as a door being opened or excessive smoke concentration, it will immediately notify the user and broadcast a voice message via the Bluetooth audio module. It will also switch to high-definition recording mode to provide a real-time video stream, allowing the user to quickly understand and address the anomaly. This design not only achieves comprehensive home security monitoring but also better meets people's needs for energy-saving and comfortable home environments.

[0010] Specifically, the present invention provides a home intelligent security system integrating Bluetooth audio and video monitoring, comprising:

[0011] The main control chip (Ingenic T41ZM) is used to control the overall operation of the system.

[0012] A door magnetic sensor is used to detect the open / closed state of a door and output an electrical signal.

[0013] The temperature and humidity sensor (DHT11) is used to collect ambient temperature and humidity data.

[0014] CO sensors and smoke sensors, based on SnO2 semiconductor gas-sensitive material, are used to detect gas volume fraction and output analog or digital signals;

[0015] A flame sensor is used to detect the infrared signal of a flame and output an analog or digital signal.

[0016] Bluetooth audio module, used to connect to user terminal and broadcast environmental status via voice;

[0017] The video surveillance module supports 4K resolution encoding and enables switching between full-time and high-definition recording modes; the OLED display (SSD1306 driver) is used to display sensor data and system status in real time; the Wi-Fi module is used to upload monitoring data to the MQTT server for remote viewing by users; it includes: a web server that obtains data from the MQTT server and displays the information to the user terminal via the network; the user terminal interacts with the web server or directly with the MQTT server to achieve remote control and status viewing of the system;

[0018] The door magnetic sensor, temperature and humidity sensor, CO sensor, smoke sensor, and flame sensor are connected to the main control chip via wired or wireless means (I2C, UART, GPIO, etc.) to transmit environmental data in real time.

[0019] The OLED display is directly connected to the main control chip;

[0020] The Bluetooth audio module and the video monitoring module achieve data transmission through the main control chip; the Bluetooth audio is used for voice interaction or alarm prompts, and the video monitoring is used for capturing images or video streams.

[0021] The main control chip uploads the processed data to the cloud via the MQTT server to achieve remote monitoring.

[0022] The video surveillance module employs AOV (Always-On Vision) full-time recording technology, including:

[0023] Low-power monitoring mode records video at a frame rate of 1 frame / second, with power consumption ≤50mW;

[0024] Ultra-HD recording mode: When an abnormal event is detected, it switches to 30 frames per second ultra-HD recording with power consumption ≤300mW and saves the video clips before and after the trigger to the cloud;

[0025] The video surveillance module has a built-in AI algorithm that can capture and analyze images at regular intervals when there are no events, and automatically switch to high-definition recording mode when an event is detected.

[0026] The system has two working modes: low-power monitoring and ultra-high-definition recording. Users can switch modes via buttons, mobile APP, or voice commands. The system also allows users to remotely view real-time data and images and receive alarm notifications via mobile APP.

[0027] When the system detects that a door has been opened, the gas volume fraction exceeds the standard, or a flame signal, it triggers an audible and visual alarm and sends an alarm message to the user's mobile phone via Wi-Fi, while simultaneously broadcasting the status via a Bluetooth audio module.

[0028] The output signals of the CO sensor, smoke sensor, and flame sensor are detected by the ADC channel or digital input pin of the main control chip, and an alarm is triggered based on a set threshold.

[0029] The Bluetooth audio module includes a Bluetooth audio SOC, an audio codec, and an audio amplifier, and supports the conversion of digital audio signals into analog signals and their playback via a speaker.

[0030] The temperature and humidity sensor adopts a single-bus bidirectional serial communication protocol. After the main control chip initiates the acquisition signal, it receives 40-bit data frames, including integer and decimal data of temperature and humidity.

[0031] The system automatically resumes low-power monitoring mode based on AI detection results after 120 seconds of no user operation.

[0032] It also involves the working method of a home smart security system integrating Bluetooth audio and video monitoring, including the switching of working modes, and the method includes the following steps:

[0033] S1, System Initialization Phase:

[0034] After the main control chip SOC starts up, it performs self-tests on each sensor module, Bluetooth audio module, and video monitoring module; the sensor modules include door magnetic sensor, temperature and humidity sensor, CO sensor, smoke sensor, and flame sensor;

[0035] After passing the self-test, it enters the AOV low-power monitoring mode, which is 1 frame / second with power consumption ≤50mW.

[0036] S2, Low Power Monitoring Phase:

[0037] It collects and processes data from various sensors in real time, including door status, temperature and humidity values, gas concentration, and flame signals; that is, it collects data from door magnetic sensors, temperature and humidity sensors, CO sensors, smoke sensors, and flame sensors in real time; and displays the monitoring data on an OLED display screen in real time.

[0038] Data is uploaded to the MQTT server in real time via the Wi-Fi module;

[0039] S3, Anomaly Detection and Mode Switching Phase:

[0040] Mode switching is triggered when any of the following abnormal events are detected:

[0041] a) Sensor alarm signals: including abnormal door magnetic field, excessive gas concentration, or flame detection; that is, detecting a source of fire, gas accumulation, or abnormal door opening;

[0042] b) Voice control commands; that is, receiving voice control commands;

[0043] c) Remote commands from a mobile app; that is, receiving remote commands from a mobile app.

[0044] d) The AI ​​algorithm identified the abnormal event;

[0045] Immediately activate the audible and visual alarm and switch to ultra-high-definition recording mode, i.e., 30 frames / second, power consumption ≤300mW; S4, ultra-high-definition recording processing stage:

[0046] Retrieve the low frame rate video from the circular buffer 15 seconds prior to the trigger;

[0047] Merge historical videos with the current video stream and then upload them to the cloud;

[0048] Simultaneously push alarm information and ultra-high definition recording notifications to user terminals;

[0049] S5, Mode Recovery Phase:

[0050] Restore low-power monitoring mode using one of the following methods:

[0051] a) Automatic recovery after the abnormal event is resolved;

[0052] b) Restore via voice, app, or manual method;

[0053] c) Recovery is determined by AI algorithm after 120 seconds of inactivity;

[0054] The system adopts the H.265 / H.264 video encoding standard to maintain video data continuity during mode switching. The gas sensor is connected to the SOC through the ADC channel, and mode switching is triggered by an interrupt.

[0055] In step S5, the system connects the analog output voltage of the gas sensor to the analog signal input channel of the SOC's ADC to detect the gas volume fraction; the falling edge of the button triggers the SOC's interrupt, and the value of the control mode variable is flipped in the interrupt function to achieve system mode switching.

[0056] Therefore, the advantage of this solution is:

[0057] 1) By integrating multiple sensors, it can monitor the home environment in all aspects, and at the same time transmit the monitoring data in real time via WiFi, ensuring that users can always have accurate information about their home environment;

[0058] 2) By using a Bluetooth audio module, the system can report environmental monitoring data to the user in real time via voice, enhancing the user-friendliness of human-computer interaction;

[0059] 3) By using the video monitoring module, users can view real-time images of their homes anytime, anywhere. They can also receive timely alarms when abnormal events occur and view high-definition images of their homes, meeting the needs of users in different scenarios.

[0060] 4) The system intelligently switches between low-power monitoring mode (1 frame / second) and ultra-high-definition recording mode (30 frames / second), solving the problem of excessive power consumption during continuous operation of the smart home security system. Attached Figure Description

[0061] The accompanying drawings, which are provided to further illustrate the invention and form part of this application, are not intended to limit the scope of the invention.

[0062] Figure 1 This is a schematic diagram of the system block diagram in this application.

[0063] Figure 2 This is a schematic diagram of the smoke sensor, flame sensor, CO sensor, and door magnetic sensor circuits in this application.

[0064] Figure 3 This is the circuit diagram of the temperature and humidity sensor and the audible and visual alarm in this application.

[0065] Figure 4 This is a flowchart of the AOV working state transition in this application. Detailed Implementation

[0066] To better understand the technical content and advantages of the present invention, the present invention will now be described in further detail with reference to the accompanying drawings.

[0067] This invention provides a home smart security system integrating Bluetooth audio and video monitoring and its working method. Based on the rapid development of the smart home field and the upgrading of living safety and comfort needs, it provides detailed environmental information in a convenient, intuitive and energy-saving manner by integrating Bluetooth audio and video monitoring, which greatly improves the efficiency and convenience of home security.

[0068] The following description, in conjunction with the accompanying drawings and specific embodiments, provides further details.

[0069] The system uses the Ingenic T41ZM as the main control chip, and is equipped with a door magnetic sensor, temperature and humidity sensor, CO sensor, smoke sensor, flame sensor, Bluetooth audio module, and video monitoring module. It is used to detect the door's open / closed status, temperature and humidity values, and the volume fraction of CO and smoke. Specific functions are as follows:

[0070] 1. Data such as ambient temperature and humidity, door open / close status, and gas sensor readings are displayed on an OLED screen and uploaded to an MQTT server via WiFi. Users can view home environment parameters on their mobile phones.

[0071] 2. When the door is opened or the volume fraction of the gas being measured exceeds the set value, the alarm circuit generates an audible and visual alarm, and at the same time the system sends a message to the user's mobile phone to alert the user that there is an abnormality in the home environment.

[0072] 3. The system has two working modes: low-power monitoring and ultra-high-definition recording. The mode can be switched by button operation, or by voice or remote operation via mobile APP.

[0073] 4. It can connect to user terminals such as mobile phones and tablets via Bluetooth audio module, transmit the status of the entire room to the user terminal, and broadcast it on the user terminal via voice.

[0074] 5. The video monitoring module can provide whole-house video monitoring.

[0075] like Figure 1 As shown in the figure, a system block diagram of a home intelligent security system integrating Bluetooth audio and video monitoring provided by the present invention includes:

[0076] The main control chip (Ingenic T41) is used to coordinate and control the various modules of the system.

[0077] Temperature and humidity sensors are used to collect ambient temperature and humidity data;

[0078] Door magnetic sensors are used to detect the open / closed status of doors.

[0079] CO sensors and smoke sensors are used to monitor smoke and CO concentrations;

[0080] Flame sensor, used to identify flame signals;

[0081] OLED displays are used to display data collected by sensors and system status in real time;

[0082] Bluetooth audio module, used to connect to user terminal and broadcast environmental information via voice;

[0083] The video surveillance module is used to provide whole-house video surveillance functionality;

[0084] MQTT server and web server are used to receive and store monitoring data uploaded by the system, which can be accessed remotely by users through terminal devices;

[0085] The user terminal is used to receive alarm information, view real-time data, and control the system's operating mode.

[0086] Further includes:

[0087] Intelligent Video Surveillance SOC: Utilizing the Ingenic T41ZM chip, based on a 12nm process, this video SOC supports 4K resolution (2160P) H.264 / H.265 / JPEG encoding, enabling high-performance video processing. It can be widely used in IoT fields such as smart homes, smart surveillance, and smart wearables. Through AOV (Always-On Vision) recording technology, it records at a low frame rate of 1 frame / second in standby mode with a power consumption of only 10mW; in active mode, it switches to high-definition recording at 30 frames / second with a power consumption of ≤300mW. Simultaneously, it receives activation signals from Bluetooth or video surveillance to achieve mode switching and synchronously saves video clips to the cloud.

[0088] Door magnetic sensor: also known as a door magnetic switch, it is used to detect the open / closed state of a door. It typically consists of two magnets and a switch. When the door is closed, the two magnets approach each other, and the switch is activated; when the door is open, the two magnets move away from each other, and the switch is deactivated. When the door is open, A is at a high level; when the door is closed, A is at a low level. The SOC determines the door's open / closed state by detecting changes in the level of A, thus enabling monitoring and alarm functions.

[0089] CO sensors and smoke sensors are both gas sensors designed based on SnO2 semiconductor gas-sensitive material. When the sensor comes into contact with the gas being measured, its conductivity increases with the volume fraction of the gas. By connecting the sensor in series with a resistor and applying an external voltage, the voltage across the resistor increases as the gas volume fraction increases. By measuring the change in output voltage, the volume fraction of the gas being measured can be obtained. Common gas sensor modules have four pins: VCC and GND are connected to power and ground, respectively; AO is an analog voltage output pin, where the output voltage increases as the volume fraction of the gas being measured increases; DO is a digital output pin, which outputs a low level when the volume fraction of the gas being measured exceeds a set value.

[0090] Flame sensors typically employ infrared receivers, which are highly sensitive to the infrared radiation emitted by flames. The brighter the flame, the more infrared radiation it emits, resulting in lower impedance between the flame sensor pins; conversely, the smaller the flame, the less infrared radiation it emits, leading to higher impedance between the flame sensor pins. Common flame sensor modules have four pins: VCC and GND are connected to power and ground respectively; AO is the voltage output pin; and DO is the digital output pin. The larger the flame surrounding the sensor, the lower the analog voltage output at the AO pin. When the flame intensity exceeds a set value, the DO pin outputs a low level. Adjusting the potentiometer changes the sensitivity of the flame sensor's digital output pin, DO.

[0091] The DHT11 digital temperature and humidity sensor features an internal automatic calibration module that integrates and processes collected temperature and humidity data. It boasts advantages such as fast response, strong data processing capabilities, and high anti-interference performance. The DHT11 employs a single-bus bidirectional serial communication protocol. Each data acquisition begins with a start signal from the main control chip, followed by a response from the DHT11 transmitting a 40-bit data frame. The data format is: 8-bit integer humidity data + 8-bit decimal humidity data + 8-bit integer temperature data + 8-bit decimal temperature data + 8-bit checksum. The decimal values ​​for temperature and humidity are typically set to 0 by default.

[0092] LCD Display: The OLED is used to display temperature, humidity, door status, and detection results from various sensors. This system uses an OLED LCD screen driven by an SSD1306, which supports multiple display modes such as dot matrix image display, character display, and graphic display. It can be controlled via I2C, SPI, and parallel port communication. The OLED screen (SSD1306 driver chip) in this system communicates with the SOC using the I2C protocol, has a resolution of 128×64, provides a clear display effect, and can display 4 rows and 16 columns of text information.

[0093] Bluetooth audio module: Typically includes a Bluetooth audio SOC, audio codec, and audio amplifier. The Bluetooth audio SOC is responsible for the processing and control of the Bluetooth communication protocol stack, including physical layer radio frequency signal processing, link layer data packet processing, and core configuration layer device link management and security control. The audio codec is responsible for converting digital audio signals into analog signals and driving the analog signals to devices such as speakers through the audio amplifier.

[0094] The video surveillance module consists of a camera, a video encoder, and an image processing unit. The camera captures visual information about the environment, while the video encoder compresses and encodes the image data to reduce bandwidth requirements. The image processing unit performs necessary image optimization, such as brightness enhancement and noise reduction.

[0095] In addition, the video surveillance module allows the camera to take high-frequency timed snapshots when no event occurs, and uses the device's built-in AI algorithm to detect and analyze the captured images. Once an event is detected, it switches to normal recording, thus achieving all-weather recording under long battery life.

[0096] Specifically, such as Figure 2 As shown, the intelligent security system's sensors, including smoke sensors, flame sensors, CO sensors, and door magnetic sensors, have the following circuit connection schemes:

[0097] (1) Smoke sensor circuit:

[0098] Connect the power supply to a 3.3V voltage (VCC);

[0099] The ground terminal is connected to GND;

[0100] The signal output terminal is connected to the GPIO34 pin of the main control chip;

[0101] (2) Flame sensor circuit:

[0102] Connect the power supply to a 3.3V voltage (VCC);

[0103] The ground terminal is connected to GND;

[0104] The signal output terminal is connected to the GPIO35 pin of the main control chip;

[0105] (3) CO sensor circuit:

[0106] Connect the power supply to a 3.3V voltage (VCC);

[0107] The ground terminal is connected to GND;

[0108] The signal output terminal is connected to the GPIO32 pin of the main control chip through a 1kΩ current-limiting resistor (R6); a 4-pin connector interface (pins 1-4) is used.

[0109] (4) Door magnetic sensor circuit:

[0110] Connect the power supply to a 5V voltage (VCC);

[0111] The ground terminal is connected to GND;

[0112] The dual signal output terminals are connected to the GPIO18 and GPIO23 pins of the main control chip, respectively;

[0113] (5) OLED display module:

[0114] It uses a 4-pin connector interface (pins 1-4) to connect to the main control system;

[0115] The power supply voltage for each sensor is 3.3V or 5V, depending on the characteristics of the device. The signal output terminal communicates with the main control chip through a specific GPIO pin.

[0116] Specifically, such as Figure 3 As shown, the peripheral circuitry of the intelligent security system, including the temperature and humidity sensor and the audible and visual alarm circuit connection scheme, includes:

[0117] (1) Temperature and humidity sensor circuit:

[0118] Connect the power supply to a 3.3V voltage (VCC);

[0119] The ground terminal is connected to GND;

[0120] The signal output terminal is connected to the GPIO4 pin of the main control chip through a 1kΩ pull-up resistor (R7); a 4-pin connector interface (pins 1-4) is used.

[0121] (2) System control circuit:

[0122] The reset / programming circuit includes:

[0123] The EN enable pin is directly connected to the reset circuit.

[0124] The GPIO0 pin is connected to the control terminal via a 470Ω resistor (R1);

[0125] RST reset pin;

[0126] BOOT mode selection pin;

[0127] (3) Audible and visual alarm circuit:

[0128] The alarm signal input terminal includes:

[0129] The GPIO16 pin drives the alarm circuit through a 470Ω resistor (R4);

[0130] The GPIO17 pin drives the alarm circuit through a 470Ω resistor (R5);

[0131] The buzzer (Bell) is driven by a PNP transistor;

[0132] The operating voltage is 3.3V (VCC);

[0133] (4) Power supply configuration:

[0134] The main control system operates at 3.3V (VCC).

[0135] All functional modules share the GND ground terminal;

[0136] Among them, key signal lines are equipped with 470Ω current-limiting resistors, temperature and humidity sensors use 1kΩ pull-up resistors to ensure signal stability, and alarm circuits use PNP transistor drive design.

[0137] like Figure 4 The diagram shown is a flowchart of the T41ZM AOV's operating state transition (logic for switching between low-power monitoring mode and ultra-high-definition recording mode), including:

[0138] The system defaults to operating in AOV low-power monitoring mode (1 frame / second);

[0139] When an abnormal event is detected, the system automatically switches to ultra-high-definition recording mode (30 frames per second) and starts ultra-high-definition recording.

[0140] Abnormal events include: abnormal sensor data, voice, remote commands from the APP, or AI detection results; after the abnormal event ends, the system will automatically exit the ultra-high-definition recording mode and restore the AOV low-power monitoring mode.

[0141] The video encoding uses the H.265 / H.264 standard, and maintains continuous storage of video data during mode switching.

[0142] The specific implementation method is as follows:

[0143] I. System Initialization: After the system starts, the main control chip SOC begins to test each module, including the door magnetic sensor, temperature and humidity sensor, CO sensor, smoke sensor, flame sensor, Bluetooth audio module, video monitoring module, etc. If all modules are normal, the system enters low-power monitoring mode (1 frame / second, power consumption ≤50mW).

[0144] II. Low-Power Monitoring Mode: In this mode, the system begins to read sensor data in real time, including door status, room temperature and humidity information, CO and smoke volume fractions, etc., and displays this data on the OLED screen in real time; it provides comprehensive monitoring of the overall environment, focusing on detecting abnormal events. Simultaneously, this data is uploaded to the MQTT server via the built-in Wi-Fi module, and users can view this information through a mobile app.

[0145] III. Triggering Conditions for Ultra-HD Recording Mode: If the system detects an abnormal situation such as a fire source, gas accumulation, or a door being suddenly opened, it will immediately activate an audible and visual alarm and trigger the system to switch to high-definition recording mode. Alarm information is uploaded to the MQTT server via Wi-Fi, and the user's mobile phone receives the warning; simultaneously, status information is broadcast via Bluetooth audio module, allowing users to receive information immediately even when they are slightly away from home.

[0146] IV. Ultra-HD Recording Mode: Upon receiving instructions from the video monitoring module, the main control SOC switches from low-power monitoring mode to ultra-HD recording mode (30 frames / second, power consumption ≤300mW). It extracts the 15 seconds of video prior to the trigger from the circular buffer, merges it into the current HD stream, and uploads it to the cloud. Simultaneously, the mobile app pushes a notification to the user: "Ultra-HD recording has started."

[0147] V. Mode Switching and Recovery: Based on the above analysis, the system's circuit principle is as follows: Figure 3 As shown, as Figure 4 As shown, the system connects the analog output voltage of the gas sensor to the analog signal input channel of the SOC's ADC to detect the gas volume fraction. The system mode switching is achieved by triggering an interrupt on the SOC using the falling edge of a button and controlling the toggling of a mode variable within the interrupt function. Users can switch system modes via voice commands or a mobile app; or, after 120 seconds of inactivity, an AI algorithm determines whether to revert to low-power monitoring mode.

[0148] In summary, the working method and mode switching of the intelligent security system based on the T41ZM chip include the following steps:

[0149] S1, System Initialization Phase:

[0150] When the main control SOC starts up, it performs self-tests on the door magnetic sensor, temperature and humidity sensor, CO sensor, smoke sensor, flame sensor, Bluetooth audio module and video monitoring module;

[0151] After passing the self-test, it enters the AOV low-power monitoring mode (1 frame / second, power consumption ≤50mW); S2, low-power monitoring stage:

[0152] Real-time acquisition and processing of data from various sensors, including door status, temperature and humidity values, gas concentration, and flame signals;

[0153] Monitoring data is dynamically displayed on an OLED screen;

[0154] Data is uploaded to the MQTT server in real time via the Wi-Fi module;

[0155] S3, Anomaly Detection and Mode Switching Phase:

[0156] Mode switching is triggered when any of the following abnormal events are detected:

[0157] a) Sensor alarm signals: including abnormal door magnetic field, excessive gas concentration, or flame detection; that is, detecting a source of fire, gas accumulation, or abnormal door opening;

[0158] b) Voice control commands; that is, receiving voice control commands;

[0159] c) Remote commands from a mobile app; that is, receiving remote commands from a mobile app.

[0160] d) The AI ​​algorithm identified the abnormal event;

[0161] Immediately activate the audible and visual alarm and switch to ultra-high-definition recording mode (30 frames / second, power consumption ≤300mW); S4, ultra-high-definition recording processing stage:

[0162] Automatically extract the video data from the circular buffer before the trigger;

[0163] Merge historical videos with the current video stream and then upload them to the cloud;

[0164] Simultaneously push alarm information and ultra-high definition recording status notifications to user terminals;

[0165] S5, Mode Recovery Phase:

[0166] Restore low-power mode using one of the following methods:

[0167] a) Automatic recovery after the anomaly is eliminated;

[0168] b) Restore via voice, app, or manual method;

[0169] c) Recovery is determined by AI algorithm after 120 seconds of inactivity;

[0170] The system adopts the H.265 / H.264 video encoding standard to maintain video data continuity during mode switching. The gas sensor is connected to the SOC through the ADC channel, and mode switching is triggered by an interrupt.

[0171] In step S5, the system connects the analog output voltage of the gas sensor to the analog signal input channel of the SOC's ADC to detect the gas volume fraction; the falling edge of the button triggers the SOC's interrupt, and the value of the control mode variable is flipped in the interrupt function to achieve system mode switching.

[0172] In summary, the present invention can achieve the following:

[0173] 1) Integrating Bluetooth audio and video monitoring functions into a single intelligent security system, it covers comprehensive monitoring of environmental parameters, door and window status, gas concentration and fire situation, and transmits monitoring data in real time via WiFi and broadcasts it in voice form;

[0174] 2) Implementation methods of AOV full-time recording technology in video surveillance, including low-power full-time recording and triggering and exiting mechanisms for ultra-high-definition recording events.

[0175] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, various modifications and variations can be made to the embodiments of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A home intelligent security system integrating Bluetooth audio and video monitoring, characterized in that, include: The main control chip is used to control the overall operation of the system; A door magnetic sensor is used to detect the open / closed state of a door and output an electrical signal. Temperature and humidity sensors are used to collect ambient temperature and humidity data. CO sensors and smoke sensors, based on SnO2 semiconductor gas-sensitive material, are used to detect gas volume fraction and output analog or digital signals; A flame sensor is used to detect the infrared signal of a flame and output an analog or digital signal. Bluetooth audio module, used to connect to user terminal and broadcast environmental status via voice; The video surveillance module supports 4K resolution encoding and enables switching between full-time recording and high-definition recording modes; OLED displays are used to show sensor data and system status in real time; The Wi-Fi module is used to upload monitoring data to the MQTT server for remote viewing by users; it includes: the web server obtaining data from the MQTT server and displaying the information to the user terminal via the network; User terminals can remotely control and view the status of the system by interacting with the web server or directly with the MQTT server. The door magnetic sensor, temperature and humidity sensor, CO sensor, smoke sensor, and flame sensor are connected to the main control chip via wired or wireless means to transmit environmental data in real time. The OLED display is directly connected to the main control chip; The Bluetooth audio module and the video monitoring module achieve data transmission through the main control chip; the Bluetooth audio is used for voice interaction or alarm prompts, and the video monitoring is used for capturing images or video streams. The main control chip uploads the processed data to the cloud via the MQTT server to achieve remote monitoring.

2. The home intelligent security system according to claim 1, characterized in that, The video surveillance module employs AOV full-time recording technology, including: Low-power monitoring mode records video at a frame rate of 1 frame / second, with power consumption ≤50mW; Ultra-HD recording mode: When an abnormal event is detected, it switches to 30 frames per second ultra-HD recording with power consumption ≤300mW and saves the video clips before and after the trigger to the cloud; The video surveillance module has a built-in AI algorithm that can capture and analyze images at regular intervals when there are no events, and automatically switch to ultra-high-definition recording mode when an event is detected.

3. The home intelligent security system according to claim 1, characterized in that, The system has two working modes: low-power monitoring and ultra-high-definition recording. Users can switch modes via buttons, mobile APP, or voice commands. The system also allows users to remotely view real-time data and images and receive alarm notifications via mobile APP.

4. The home intelligent security system according to claim 1, characterized in that, When the system detects that a door has been opened, the gas volume fraction exceeds the standard, or a flame signal, it triggers an audible and visual alarm and sends an alarm message to the user's mobile phone via Wi-Fi, while simultaneously broadcasting the status via a Bluetooth audio module.

5. The home intelligent security system according to claim 1, characterized in that, The output signals of the CO sensor, smoke sensor, and flame sensor are detected through the ADC channel or digital input pin of the main control chip, and an alarm is triggered based on a set threshold.

6. The home intelligent security system according to claim 1, characterized in that, The Bluetooth audio module includes a Bluetooth audio SOC, an audio codec, and an audio amplifier, and supports the conversion of digital audio signals into analog signals and their playback via a speaker.

7. The home intelligent security system according to claim 1, characterized in that, The temperature and humidity sensor adopts a single-bus bidirectional serial communication protocol. After the main control chip initiates the acquisition signal, it receives 40-bit data frames, including integer and decimal data of temperature and humidity.

8. The home intelligent security system according to claim 1, characterized in that, After 120 seconds of no user operation, the system automatically resumes low-power monitoring mode based on the detection results of the AI ​​algorithm.

9. A method for operating a home intelligent security system integrating Bluetooth audio and video monitoring, characterized in that, Including switching work modes, the method involves the following steps: S1, System Initialization Phase: After the main control chip SOC starts up, it performs self-tests on each sensor module, Bluetooth audio module, and video monitoring module; the sensor modules include door magnetic sensor, temperature and humidity sensor, CO sensor, smoke sensor, and flame sensor; After passing the self-test, it enters the AOV low-power monitoring mode, which is 1 frame / second with power consumption ≤50mW. S2, Low Power Monitoring Phase: It collects and processes data from various sensors in real time, including door status, temperature and humidity values, gas concentration, and flame signals; that is, it collects data from door magnetic sensors, temperature and humidity sensors, CO sensors, smoke sensors, and flame sensors in real time; and displays the monitoring data on an OLED display screen in real time. Data is uploaded to the MQTT server in real time via the Wi-Fi module; S3, Anomaly Detection and Mode Switching Phase: Mode switching is triggered when any of the following abnormal events are detected: a) Sensor alarm signals: including abnormal door magnetic field, excessive gas concentration, or flame detection; that is, detecting a fire source, gas accumulation, or abnormal door opening; b) Voice control commands; that is, receiving voice control commands; c) Remote commands from a mobile app; that is, receiving remote commands from a mobile app. d) The AI ​​algorithm identifies abnormal events; Immediately activate the audible and visual alarm and switch to ultra-high-definition recording mode, i.e., 30 frames / second, power consumption ≤300mW; S4, Ultra-HD video processing stage: Retrieve the low frame rate video from the circular buffer 15 seconds prior to the trigger; Merge historical videos with the current video stream and then upload them to the cloud; Simultaneously push alarm information and high-definition recording notifications to user terminals; S5, Mode Recovery Phase: Restore low-power monitoring mode using one of the following methods: a) Automatic recovery after the anomaly is eliminated; b) Restore via voice, app, or manual method; c) Recovery is determined by AI algorithm after 120 seconds of inactivity; The system adopts the H.265 / H.264 video encoding standard to maintain video data continuity during mode switching. The gas sensor is connected to the SOC through the ADC channel, and mode switching is triggered by an interrupt.

10. The method for operating a home intelligent security system integrating Bluetooth audio and video monitoring according to claim 1, characterized in that, In step S5, the system connects the analog output voltage of the gas sensor to the analog signal input channel of the SOC's ADC to detect the gas volume fraction; the falling edge of the button triggers the SOC's interrupt, and the value of the control mode variable is flipped in the interrupt function to achieve system mode switching.

Images