Device, control method and terminal for automatic screen awakening and sleep

Abstract

The present invention provides a device, control method and terminal for automatic screen wake-up and sleep, which transmits a frequency modulated continuous wave signal to a designated area through a radar system module, and mixes the received echo signal reflected by an object with the transmitted signal to obtain an intermediate frequency signal; then the main controller detects the presence of a human body in the designated area according to the intermediate frequency signal, and sends a screen wake-up command or a screen sleep command based on the human presence detection result and the current state of the screen to control the screen to wake up or sleep. The present invention realizes intelligent control of the screen of an electronic device through millimeter wave radar human presence detection technology, solves the energy consumption caused by the screen being on for a long time when no one is around, and avoids the problem of user privacy leakage, and at the same time automatically turns on the screen before the person returns to the screen to improve the intelligence of the device and the user experience.

Description

Technical Field

[0001] The present invention relates to the technical field of millimeter wave radars, and in particular to a device, a control method and a terminal for automatically waking up and sleeping a screen. Background Art

[0002] With the advancement of science and technology, modern electronic devices tend to be intelligent, and human-computer interaction methods are becoming more and more abundant. Among the many interaction methods, screen wake-up technology provides users with a convenient operation method and improves the practicality of the device. At present, the screen wake-up of many devices is mainly achieved by infrared sensors or cameras, but these methods may have limitations in certain specific environments. For example, CN109766136A discloses a screen wake-up method, which detects the movement sequence of objects by two infrared sensors set on the screen to determine the wake-up state of the target screen. However, the infrared sensor is greatly affected by the ambient temperature and lighting conditions. In environments such as high temperature and strong light, the performance of the infrared sensor will be affected, resulting in inaccurate or invalid detection. In addition, the infrared sensor has limited detection ability for moving objects. The infrared sensor can usually only detect the surface temperature of the object. For the internal structure and temperature change of the moving object, its detection ability is limited and is easily interfered by other heat sources. CN 106484113B discloses a screen wake-up device and method, which collects an eyeball image and a preset image through a camera for comparison, and realizes screen wake-up when the similarity is greater than or equal to the preset value. However, this method faces the challenges of high computational complexity and high energy consumption, which affects the battery life and performance of the device. At the same time, the ambient light intensity and obstructions may interfere with the accuracy of image recognition, resulting in wake-up failure or false triggering. Furthermore, image recognition technology has high requirements for hardware configuration, requiring high-performance processors and sufficient memory support, which increases the cost of the device and limits its application in low-cost scenarios. In addition, this technology also involves user privacy and security issues, and strict security measures must be taken to protect user information. At the same time, CN 109766136 A and CN 106484113 B only have a screen wake-up function, and the screen does not automatically turn off when people leave. The screen needs to be turned off manually or by timing, which may cause the device to work for a long time when people leave, increasing energy waste. Summary of the invention

[0003] In view of the shortcomings of the prior art mentioned above, the purpose of the present invention is to provide a device, a control method and a terminal for automatic screen wake-up and sleep, so as to solve the problem that the prior art screen wake-up mostly relies on infrared sensors or cameras, but they are limited in specific environments. For example, infrared sensors are greatly affected by environmental factors, and the camera method faces high energy consumption, susceptibility to light interference, high hardware requirements and privacy and security issues, and both lack an automatic screen-off function, resulting in energy waste.

[0004] To achieve the above-mentioned purpose and other related purposes, the present invention provides a device for automatically waking up and sleeping a screen, which is communicatively connected to the screen, and includes: a radar system module, which is used to transmit a frequency-modulated continuous wave signal to a designated area, and mix the received echo signal reflected by an object with the transmitted signal to obtain an intermediate frequency signal; a main controller, connected to the radar system module, which is used to detect the presence of a human body in the designated area according to the intermediate frequency signal, and send a screen wake-up instruction or a screen sleep instruction based on the human presence detection result and the current state of the screen to control the screen to wake up or sleep.

[0005] In one embodiment of the present invention, the radar system module is used to transmit a frequency modulated continuous wave signal to a designated area based on a preset radar detection area and radar waveform generator parameters, and to receive an echo signal reflected by an object when the frequency modulated continuous wave signal is reflected, and to mix the echo signal with the transmitted signal, and then perform preliminary signal processing to obtain an intermediate frequency signal in the form of a digital signal.

[0006] In one embodiment of the present invention, the detection of human presence in a designated area based on the intermediate frequency signal includes: measuring the signal frequency offset and phase change caused by human movement according to the intermediate frequency signal, and determining whether there is a human body in the designated area based on the movement and position parameters of the human body extracted based on the measured signal frequency offset and phase change.

[0007] In one embodiment of the present invention, the signal frequency offset and phase change caused by human body movement is measured according to the intermediate frequency signal, and determining whether there is a human body in the designated area according to the movement and position parameters of the human body extracted based on the measured signal frequency offset and phase change includes: processing and analyzing the intermediate frequency signal, measuring the signal frequency offset and phase change caused by human body movement; wherein human body movement includes: small movement and obvious movement; the small movement includes heartbeat and breathing movement; if the signal frequency offset and phase change caused by human body movement are measured, the distance, speed and angle of the human body are extracted according to the signal frequency offset and phase change, and the distance, speed and angle of the human body are compared with the position information of the designated area to further determine whether there is a human body in the designated area; if the signal frequency offset and phase change caused by human body movement are not measured, it is determined that there is no human body in the designated area.

[0008] In one embodiment of the present invention, the sending of a screen wake-up instruction or a screen sleep instruction based on the human presence detection result and the current state of the screen to control screen wake-up or sleep includes: if a human body is detected in a designated area and the current state of the screen is in an off-screen state, sending a screen wake-up instruction according to a preset screen wake-up method, and setting the current state of the screen to a bright-screen state; the types of screen wake-up methods include: wired method and wireless method; if no human body is detected in the designated area and the current state of the screen is in a bright-screen state, sending a screen sleep instruction according to a preset screen wake-up method, and setting the current state of the screen to an off-screen state; if a human body is detected in the designated area and the current state of the screen is in a bright-screen state or if no human body is detected in the designated area and the current state of the screen is in an off-screen state, no instruction is sent and the screen remains in the same state.

[0009] In one embodiment of the present invention, the main controller is provided with a wired interface; the main controller is used to generate a screen wake-up instruction or a screen sleep instruction adapted to the wired interface when the screen wake-up mode is a wired mode, and send it to the screen through the wired interface.

[0010] In one embodiment of the present invention, the device for automatically waking up and sleeping the screen also includes: a BLE+2.4G wireless transceiver module, connected to the main controller; the main controller is used to generate a screen wake-up instruction or a screen sleep instruction of a standard protocol or a custom protocol when the screen wake-up method is wireless, and send it to the screen through the BLE+2.4G wireless transceiver module; when the screen is a screen of a standard device, the standard protocol is a protocol that simulates a HID keyboard device, so as to wake up the screen by sending specific keys.

[0011] In one embodiment of the present invention, the device for automatically waking up and sleeping the screen also includes: a storage module, connected to the radar system module and the main controller, for storing the intermediate frequency signal obtained by the radar system module, and sending the intermediate frequency signal to the main controller for processing.

[0012] To achieve the above-mentioned purpose and other related purposes, the present invention provides a system for automatic screen awakening and sleeping, which is applied to a device for automatic screen awakening and sleeping, and includes: a radar system module, wherein the method includes: obtaining an intermediate frequency signal obtained by mixing an echo signal reflected by an object received by the radar system module with a frequency modulated continuous wave signal transmitted to a designated area; The human presence detection is performed on the designated area according to the intermediate frequency signal, and a screen wake-up instruction or a screen sleep instruction is sent based on the human presence detection result and the current state of the screen to control the screen to wake up or sleep.

[0013] To achieve the above-mentioned purpose and other related purposes, the present invention provides an electronic terminal, comprising: one or more memories and one or more processors; the one or more memories are used to store computer programs; the one or more processors are connected to the memories and are used to run the computer programs to execute the device for automatically waking up and sleeping the screen.

[0014] As described above, the present invention is a device, control method and terminal for automatic screen wake-up and sleep, which has the following beneficial effects: the present invention transmits a frequency modulated continuous wave signal to a designated area through a radar system module, and mixes the received echo signal reflected by an object with the transmitted signal to obtain an intermediate frequency signal; then the main controller detects the presence of a human body in the designated area according to the intermediate frequency signal, and sends a screen wake-up instruction or a screen sleep instruction based on the human presence detection result and the current state of the screen to control the screen to wake up or sleep. The present invention realizes intelligent control of the screen of an electronic device through millimeter wave radar human presence detection technology, solves the energy consumption caused by the screen being on for a long time when no one is around, and avoids the problem of user privacy leakage. At the same time, the screen is automatically turned on before a person returns to the screen to improve the intelligence of the device and the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 Shown is a schematic diagram of the structure of a device for automatically waking up and sleeping a screen in an embodiment of the present invention.

[0016] Figure 2 Shown is a schematic diagram of the structure of a device for automatically waking up and sleeping the screen applied to the AT6010 chip in one embodiment of the present invention.

[0017] Figure 3 Shown is a schematic diagram of the software flow of the device for automatic screen awakening and sleep in one embodiment of the present invention.

[0018] Figure 4 Shown is a flow chart of a method for controlling automatic screen wake-up and sleep in one embodiment of the present invention.

[0019] Figure 5 FIG. 4 is a schematic diagram showing the structure of an electronic terminal in an embodiment of the present invention. DETAILED DESCRIPTION

[0020] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0021] It should be noted that in the following description, reference is made to the accompanying drawings, which describe several embodiments of the present invention. It should be understood that other embodiments may also be used, and that mechanical composition, structural, electrical and operational changes may be made without departing from the spirit and scope of the present invention. The following detailed description should not be considered restrictive, and the scope of the embodiments of the present invention is limited only by the claims of the published patents. The terms used herein are only for describing specific embodiments and are not intended to limit the present invention. Spatially related terms, such as "upper", "lower", "left", "right", "below", "below", "lower", "above", "upper", etc., may be used in the text to facilitate the description of the relationship between an element or feature shown in the figure and another element or feature.

[0022] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case of "direct connection" but also the case of "indirect connection" by placing other elements therebetween. In addition, when a part is said to "include" a certain constituent element, unless otherwise stated, it does not exclude other constituent elements, but means that other constituent elements may be included.

[0023] The terms first, second and third mentioned herein are used to describe various parts, components, regions, layers and / or segments, but are not limited thereto. These terms are only used to distinguish a certain part, component, region, layer or segment from other parts, components, regions, layers or segments. Therefore, the first part, component, region, layer or segment described below may refer to the second part, component, region, layer or segment within the scope of the present invention.

[0024] Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless there is an indication to the contrary in the context. It should be further understood that the terms "comprise", "include" indicate the presence of the described features, operations, elements, components, items, kinds, and / or groups, but do not exclude the presence, occurrence or addition of one or more other features, operations, elements, components, items, kinds, and / or groups. The terms "or" and "and / or" used herein are interpreted as inclusive, or mean any one or any combination. Therefore, "A, B or C" or "A, B and / or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B and C". Exceptions to this definition will only occur when the combination of elements, functions or operations is inherently mutually exclusive in some way.

[0025] The present invention provides a device for automatic screen wake-up and sleep, which transmits a frequency modulated continuous wave signal to a designated area through a radar system module, and mixes the received echo signal reflected by an object with the transmitted signal to obtain an intermediate frequency signal; then the main controller detects the presence of a human body in the designated area according to the intermediate frequency signal, and sends a screen wake-up command or a screen sleep command based on the human presence detection result and the current state of the screen to control the screen to wake up or sleep. The present invention realizes intelligent control of the screen of an electronic device through millimeter wave radar human presence detection technology, solves the energy consumption caused by the screen being on for a long time when no one is around, and avoids the problem of user privacy leakage, and at the same time automatically turns on the screen before a person returns to the screen to improve the intelligence of the device and the user experience.

[0026] The following is a detailed description of the embodiments of the present invention with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention. The present invention can be embodied in many different forms and is not limited to the embodiments described herein.

[0027] like Figure 1 A schematic diagram showing the structure of a device for automatically waking up and sleeping a screen in an embodiment of the present invention.

[0028] It is connected to the screen for communication, and the screen is an electronic device screen. The electronic device can be various smart homes and smart devices, such as smart TVs, smart refrigerators, smart air conditioners, etc. Applying the device to smart homes and smart devices improves the intelligence level of the devices and user experience.

[0029] This solution is based on frequency modulated continuous wave (FMCW) radar technology, and the device includes: The radar system module 1 uses a frequency modulated continuous wave radar, which is used to transmit a continuous frequency modulated continuous wave signal to a designated area in front of the screen. The signal encounters an object and reflects an echo signal. The radar system module 1 will receive the echo signal and mix it with the transmitted signal to obtain an intermediate frequency signal; The main controller 2 is connected to the radar system module 1, and is used to detect the presence of human beings in a designated area according to the intermediate frequency signal, and send a screen wake-up command or a screen sleep command based on the human presence detection result and the current state of the screen to control the screen to wake up or sleep.

[0030] The present invention uses millimeter wave radar technology to automatically wake up the device screen when the presence and movement of a human body is detected, and automatically turn off the screen when the person leaves, thereby improving the intelligence level of the device and the user experience, and improving the efficiency of energy utilization. In addition, the device does not need to collect human images, but realizes the screen lighting and screen turning off functions by detecting human body movements, which effectively solves the problem of user privacy.

[0031] In one embodiment, the radar system module 1 first generates and transmits a frequency modulated continuous wave signal to a specified area according to a preset radar detection area and radar waveform generator parameters. The frequency of these signals changes linearly over time, forming a unique waveform for subsequent distance measurement and speed measurement. When the transmission signal of the FMCW radar encounters a human body or other object, part of the signal will be reflected back to form an echo signal. These echo signals carry the distance and speed information of the moving object. The echo signal received by the radar system module 1 is mixed with the original transmission signal. The purpose of mixing is to convert the frequency difference between the echo signal and the transmission signal into an intermediate frequency signal. This step is the key to extracting the distance and speed information of the human body. Subsequently, the radar system module 1 will perform preliminary signal processing on the mixed signal, including signal filtering and conversion to digital signals. Signal filtering helps to remove noise and interference and improve the signal-to-noise ratio of the signal. Conversion to digital signals is for subsequent digital signal processing and analysis.

[0032] For example, the radar system module 1 uses a 60GHz millimeter wave radar chip. The signal generated by the waveform generator is transmitted through the radar antenna in a linear frequency modulation manner to form a frequency modulated continuous wave signal. When encountering an object, it is transmitted and received by the receiving module and mixed with the transmitted signal to generate an intermediate frequency signal. In addition to valid signals, the raw data received by the radar also includes invalid signals including various interferences. The signal can be filtered through the high and low pass filters of the analog front end for preliminary signal processing. The filtered intermediate frequency signal is converted into a digital signal through the ADC module for subsequent digital signal processing.

[0033] In one embodiment, the main controller 2 performs human presence detection in a designated area based on the intermediate frequency signal, including: the main controller 2 first receives the intermediate frequency signal from the radar system module 1. During the propagation of these signals, if the human body moves, the frequency offset and phase change of the signal will be caused. The main controller 2 performs spectrum and phase analysis on the received intermediate frequency signal, and can measure the signal frequency offset and phase change caused by human body movement. Based on the measured signal frequency offset and phase change, the main controller 2 will use a specific algorithm to extract the movement and position parameters of the human body. The extracted movement and position parameters will be used to determine whether there is a human body in the designated area.

[0034] In a specific embodiment, the measuring of the signal frequency offset and phase change caused by human motion according to the intermediate frequency signal, and determining whether a human body exists in the designated area according to the motion and position parameters of the human body extracted based on the measured signal frequency offset and phase change includes: The intermediate frequency signal is processed and analyzed to measure the signal frequency offset and phase change caused by human body movement; specifically, the received intermediate frequency signal is preprocessed, including steps such as amplification and filtering; a specific detection algorithm is used to measure the signal frequency offset and phase change caused by human body movement. According to the amplitude and frequency of the phase change, small movements (heartbeat, breathing) and obvious movements (such as large movements of limbs) can be determined. If the human body performs large limb movements, the presence of the human body can be judged by obvious phase changes; if the human body remains still, small movements such as human breathing and heartbeat will cause vibrations of the surrounding air molecules, and these small vibrations will further affect the echo signal of the FMCW radar. By detecting these small phase changes, it can be determined whether the human body exists.

[0035] The principle of FMCW radar is that it transmits a frequency modulated continuous wave signal whose frequency changes linearly with time and receives its echo signal. By comparing the frequency difference (or phase difference) between the transmitted signal and the echo signal, the distance, speed and other information of the target object can be calculated.

[0036] If the signal frequency offset and phase change caused by human body movement are measured, the FMCW radar principle will extract the distance, speed and angle of the human body according to the signal frequency offset and phase change, and compare the distance, speed and angle of the human body with the location information of the designated area to further determine whether there is a human body in the designated area; Specifically, if the signal frequency offset and phase change caused by human motion are measured, the signal after signal filtering is subjected to a fast Fourier transform (FFT), whether 1D-FFT or 2D-FFT, to obtain the spectrum information of the signal. Next, the distance measurement algorithm is used to calculate the distance between the human body and the signal transmitting / receiving device. By analyzing the signal frequency offset and phase change at consecutive time points, the moving speed of the human body can be calculated. At the same time, the moving direction (angle) of the human body can be estimated by combining the signal phase information of multiple receiving channels. Since the radar detection area is relatively large and can cover the specified area, even if the presence of a human body is detected from the intermediate frequency signal, it is necessary to further confirm whether the human body exists in the specified area. The distance, speed and angle of the human body are compared with the position information of the specified area, and the position information of the specified area is used to define the range of the area to be monitored. If the motion and position parameters of the human body detected by the radar meet the requirements of the specified area, it can be confirmed that the human body does exist in the specified area. If the requirements are not met, the human body is not in the specified area.

[0037] If the signal frequency offset and phase change caused by human motion are not measured, it can be considered that there is not enough human motion within the radar's line of sight during the detection time period to cause detectable phase changes, and it is determined that there is no human body in the specified area.

[0038] In one embodiment, sending a screen wake-up instruction or a screen sleep instruction based on a human presence detection result and a current state of the screen to control screen wake-up or sleep includes: If a human body is detected in the designated area and the screen is currently in an off state, a screen wake-up instruction is sent according to a preset screen wake-up method, and the current screen state is set to a bright screen state; the types of screen wake-up methods include: wired method and wireless method; If it is detected that there is no human body in the designated area and the screen is currently in the on state, a screen sleep command is sent according to the preset screen wake-up method, and the current screen state is set to the off state; If a human body is detected in the specified area and the screen is currently in the on state, or if no human body is detected in the specified area and the screen is currently in the off state, no command is sent and the screen remains in the same state.

[0039] In one embodiment, the main controller 2 is provided with a wired interface, which may be a standard physical connection interface, such as USB (Universal Serial Bus), HDMI (High Definition Multimedia Interface), RS232 (a serial communication interface), etc., or a communication interface such as SPI (Serial Peripheral Interface) and I2C (Two-wire Serial Bus). When the screen wake-up mode is a wired mode, the main controller generates a screen wake-up instruction or a screen sleep instruction adapted to the wired interface, and sends it to the screen through the wired interface. Specifically, if a USB interface is used, the main controller may generate a wake-up or sleep instruction that complies with the USB communication protocol; if an HDMI interface is used, the generation and sending of the instruction will follow the HDMI specification. Similarly, for interfaces such as SPI and I2C, there are also their own unique instruction formats and communication methods.

[0040] In one embodiment, if Figure 1 The device for automatically waking up and sleeping the screen also includes: a BLE+2.4G wireless transceiver module 3, which integrates Bluetooth low energy (BLE) and 2.4GHz wireless communication technology and can support both wireless communication modes at the same time. The BLE+2.4G wireless transceiver module 3 is connected to the main controller for communication. When the screen wake-up mode is set to wireless mode, the main controller will generate a corresponding screen wake-up instruction or screen sleep instruction according to a preset standard protocol or a custom protocol.

[0041] Standard protocol: When the screen is a standard device screen (such as a computer monitor, smart TV, etc.), the main controller may use the protocol of simulating HID (Human Interface Device) keyboard device to generate screen wake-up instructions. In this way, the main controller will simulate keyboard input and send a specific key sequence (such as "space bar", "power key", etc.) to wake up the screen. The advantage of this protocol is good compatibility, because most standard devices support HID keyboard devices.

[0042] Custom protocol: For non-standard devices or screens that require special control, the main controller can use a custom protocol to generate screen wake-up instructions or screen sleep instructions. The custom protocol requires prior agreement between the screen and the main controller to ensure that both parties can correctly parse and execute the instructions.

[0043] The BLE+2.4G wireless transceiver module 3 is suitable for various scenarios that require wireless control of screen wake-up and sleep, such as smart home, smart office, smart security, etc. The wireless control method reduces the complexity of wiring and improves the flexibility and scalability of the system. BLE technology has the characteristics of low power consumption and is suitable for devices that run for a long time. 2.4GHz wireless communication technology has the advantages of fast transmission speed and strong anti-interference ability. By simulating the HID keyboard device protocol or custom protocol, the device can be compatible with a variety of screen devices, improving the versatility and compatibility of the system.

[0044] In one embodiment, the main controller may be equipped with a response device that supports wireless communication technologies such as Bluetooth, Wi-Fi, infrared, etc. to achieve wireless control. These devices may be built-in wireless communication modules or external wireless communication adapters.

[0045] In one embodiment, the device for automatically waking up and sleeping the screen further includes: a storage module, connected to the radar system module 1 and the main controller 2, for storing the intermediate frequency signal obtained by the radar system module 1, and sending the intermediate frequency signal to the main controller 2 for processing. The storage module is connected to the radar system module and the main controller through an appropriate interface and communication protocol to ensure smooth data transmission. It is responsible for receiving the intermediate frequency signals obtained by the radar system module and temporarily storing these signals in the internal storage medium.

[0046] In order to better explain the device for automatically waking up and sleeping the screen, a specific embodiment is now described.

[0047] Embodiment: A device for automatically waking up and sleeping a screen.

[0048] The automatic screen wake-up and sleep device is verified based on the self-developed millimeter-wave radar sensor chip AT6010. AT6010 adopts mature CMOS technology and makes full use of digital-analog hybrid technology to integrate the processor, millimeter-wave transceiver module, radar intermediate frequency module and radar signal processing on a single chip. Figure 2 This is a simple block diagram of the AT6010 chip, including: data receiving and acquisition module, storage system and CPU. First, the air signal is received by the RF part of the data receiving and acquisition module. This module is responsible for capturing and preliminarily processing these signals and converting them into intermediate frequency signals. This conversion process is crucial to reducing the complexity of signal processing and improving the overall performance of the system. Then, the converted intermediate frequency signals are further processed by the internal high-precision ADC (analog-to-digital converter). The ADC converts these analog intermediate frequency signals into digital signals and outputs them to the storage system. This step provides the necessary data basis for subsequent digital signal processing. After the storage system receives the digital signals from the data receiving and acquisition module, it will save these signals in the system's memory. This design not only ensures the integrity of the data, but also provides a convenient data access path for subsequent algorithm processing. Finally, the CPU begins to play its core role. It reads the stored radar intermediate frequency data from the system memory and performs a series of complex algorithm processing. These processes include but are not limited to filtering operations to remove noise and interference; 1D-FFT and 2D-FFT conversions to analyze signal characteristics in the frequency domain; and distance measurement algorithms to accurately calculate the distance of the target object.

[0049] Software processing flow such as Figure 3 The process includes: 1. System and radar initialization: including screen wake-up mode, radar detection area setting and radar waveform generator parameter initialization. The screen wake-up mode supports wired and wireless modes. The wired mode can communicate with the screen device through communication interfaces such as USB, SPI and I2C. The wireless mode can communicate with the screen device through wireless modes such as BLE and 2.4G. The radar detection area is set to set a specific detection area within the monitoring range of the radar according to the specified area. The radar waveform generator parameter initialization is to configure the parameters of the radar waveform generator, such as frequency, pulse width, repetition period, etc., to meet different detection requirements.

[0050] 2. Radar human body detection FMCW radar: Sends a continuous frequency modulated signal to measure the distance and speed of the target. In FMCW radar, the frequency of the transmitted signal changes linearly with time. When the transmitted signal of the FMCW radar encounters the human body, a part of the signal will be reflected back to form an echo signal. By mixing the echo signal with the transmitted signal, an intermediate frequency signal can be obtained. The signal received by the radar is processed and analyzed to detect the presence of human body in the specified area, and further processing is performed based on the detection results.

[0051] 3. Control the screen off and on: When the radar detects the presence of a person and the current screen is off, a screen wake-up command is sent and the screen is set to the on state. When the radar does not detect the presence of a person and the current screen is on, a screen lock command is sent and the current state is set to the off state. Controlling the screen off and on can notify the device with the screen to wake up or sleep through a custom command format. For standard devices such as computers, the screen can be woken up by simulating the protocol of the HID keyboard device to send a specific key. The screen is turned off by sending a lock screen command. Under normal circumstances, the computer will automatically enter a black screen state in a short time after the screen is locked.

[0052] Similar to the principle of the above embodiment, the present invention provides a control method for automatic screen awakening and sleep.

[0053] The following provides specific embodiments in conjunction with the accompanying drawings: like Figure 4 A schematic diagram showing the structure of a system for automatic screen wake-up and sleep in an embodiment of the present invention.

[0054] The device for automatic screen awakening and sleep includes: a radar system module, and the method includes: Step S1: obtaining an intermediate frequency signal obtained by mixing an echo signal reflected by an object and a frequency modulated continuous wave signal transmitted to a designated area by a radar system module.

[0055] In one embodiment, the radar system module is used to transmit a frequency modulated continuous wave signal to a designated area based on a preset radar detection area and radar waveform generator parameters, receive an echo signal reflected by an object when the frequency modulated continuous wave signal is reflected, mix the echo signal with the transmitted signal, and perform preliminary signal processing to obtain an intermediate frequency signal in the form of a digital signal.

[0056] Step S2: Performing human presence detection on a designated area according to the intermediate frequency signal, and sending a screen wake-up command or a screen sleep command based on the human presence detection result and the current state of the screen to control the screen to wake up or sleep.

[0057] In one embodiment, the human presence detection in the designated area according to the intermediate frequency signal includes: measuring the signal frequency offset and phase change caused by human movement according to the intermediate frequency signal, and determining whether there is a human body in the designated area according to the human body movement and position parameters extracted based on the measured signal frequency offset and phase change.

[0058] In one embodiment, the measuring of the signal frequency offset and phase change caused by human body movement according to the intermediate frequency signal, and determining whether there is a human body in the designated area according to the human body movement and position parameters extracted based on the measured signal frequency offset and phase change includes: processing and analyzing the intermediate frequency signal, measuring the signal frequency offset and phase change caused by human body movement; wherein human body movement includes: small movement and obvious movement; the small movement includes heartbeat and breathing; if the signal frequency offset and phase change caused by human body movement are measured, the distance, speed and angle of the human body are extracted according to the signal frequency offset and phase change, and the distance, speed and angle of the human body are compared with the position information of the designated area to further determine whether there is a human body in the designated area; if the signal frequency offset and phase change caused by human body movement are not measured, it is determined that there is no human body in the designated area.

[0059] In one embodiment, the sending of a screen wake-up instruction or a screen sleep instruction based on the human presence detection result and the current state of the screen to control screen wake-up or sleep includes: if a human body is detected in a designated area and the current state of the screen is in an off-screen state, sending a screen wake-up instruction according to a preset screen wake-up method, and setting the current state of the screen to a bright-screen state; the types of screen wake-up methods include: a wired method and a wireless method; if no human body is detected in the designated area and the current state of the screen is in a bright-screen state, sending a screen sleep instruction according to a preset screen wake-up method, and setting the current state of the screen to an off-screen state; if a human body is detected in the designated area and the current state of the screen is in a bright-screen state or if no human body is detected in the designated area and the current state of the screen is in an off-screen state, no instruction is sent and the screen remains in the same state.

[0060] In one embodiment, when the screen wake-up mode is a wired mode, a screen wake-up instruction or a screen sleep instruction adapted to a wired interface provided on the main controller is generated to be sent to the screen through the wired interface.

[0061] In one embodiment, when the screen wake-up method is wireless, a screen wake-up instruction or a screen sleep instruction of a standard protocol or a custom protocol is generated and sent to the screen through a set BLE+2.4G wireless transceiver module; when the screen is a screen of a standard device, the standard protocol is a protocol that simulates a HID keyboard device, so as to wake up the screen by sending specific keys.

[0062] In one embodiment, the intermediate frequency signal obtained by the radar system module is stored in a storage module, and the intermediate frequency signal stored in the storage module is obtained for processing.

[0063] Since the implementation principle of the method for automatically waking up and sleeping the screen has been described in the aforementioned embodiment, it will not be repeated here.

[0064] The method for automatically waking up and sleeping the screen provided in the embodiment of the present invention can be implemented on the terminal side or the server side. As for the hardware structure of the electronic terminal, please refer to Figure 5 , is an optional hardware structure diagram of a terminal 1000 for automatic screen wake-up and sleep provided in an embodiment of the present invention. The terminal 1000 may be a mobile phone, a computer device, a tablet device, a personal digital processing device, a factory background processing device, etc. The terminal 1000 includes: at least one processor 1001, a memory 1002, at least one network interface 10010 and a user interface 1009. The various components in the device are coupled together through a bus system 1005. It can be understood that the bus system 1005 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 1005 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, in Figure 5 In the specification, various buses are labeled as bus systems.

[0065] The user interface 1009 may include a display, a keyboard, a mouse, a trackball, a click gun, keys, buttons, a touch pad or a touch screen.

[0066] It is understood that the memory 1002 can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), which is used as an external cache. By way of exemplary but not limiting explanation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM). The memory described in the embodiments of the present invention is intended to include but is not limited to these and any other suitable categories of memory.

[0067] The memory 1002 in the embodiment of the present invention is used to store various categories of data to support the operation of the terminal 1000. Examples of these data include: any executable program for operating on the terminal 1000, such as an operating system 10021 and an application 10022; the operating system 10021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application 10022 may include various applications, such as a media player (MediaPlayer), a browser (Browser), etc., for implementing various application services. The device for implementing the automatic screen wake-up and sleep provided in the embodiment of the present invention may be included in the application 10022.

[0068] The method disclosed in the above embodiment of the present invention can be applied to the processor 1001, or implemented by the processor 1001. The processor 1001 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 1001 or the instruction in the form of software. The above processor 1001 may be a general processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 1001 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiment of the present invention. The general processor 1001 can be a microprocessor or any conventional processor, etc. In combination with the steps of the accessory optimization method provided in the embodiment of the present invention, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0069] In an exemplary embodiment, the terminal 1000 may be implemented by one or more application specific integrated circuits (ASIC), DSP, programmable logic device (PLD), complex programmable logic device (CPLD) to execute the aforementioned method.

[0070] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to the computer program. The aforementioned computer program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other media that can store program codes.

[0071] In the embodiments provided in the present application, the computer readable and writable storage medium may include a read-only memory, a random access memory, an EEPROM, a CD-ROM or other optical disk storage device, a disk storage device or other magnetic storage device, a flash memory, a USB flash drive, a mobile hard disk, or any other medium that can be used to store the desired program code in the form of an instruction or data structure and can be accessed by a computer. In addition, any connection can be appropriately referred to as a computer-readable medium. For example, if the instruction is sent from a website, a server or other remote source using a coaxial cable, an optical fiber cable, a twisted pair, a digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwaves, the coaxial cable, optical fiber cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwaves are included in the definition of the medium. However, it should be understood that computer readable and writable storage media and data storage media do not include connections, carriers, signals, or other temporary media, but are intended to be non-temporary, tangible storage media. Disk and disc, as used in this application, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers.

[0072] Compared with the prior art, the present invention has the following advantages: (1) Accurate detection capability: Millimeter-wave radar can accurately capture tiny movements and position changes of the human body. Even in low light, complex backgrounds, or obstacles, it can effectively distinguish between the human body and other objects, thereby greatly reducing the probability of false awakening and missed awakening. This technology does not require users to directly touch the device. It can achieve detection by transmitting and receiving reflected millimeter-wave signals, which is both hygienic and convenient.

[0073] (2) Stable performance: Millimeter-wave radar technology has stable performance and is not affected by external factors such as light, color, and material. It can maintain stable detection performance under various lighting conditions, indoor layouts, and weather conditions. Whether it is day or night, millimeter-wave radar can continue to work, ensuring that the device responds to human activities around the clock.

[0074] (3) Flexible application: Millimeter-wave radar technology can be easily integrated into various smart home devices, such as smart TVs, smart refrigerators, and smart air conditioners, to achieve a smarter interactive experience, such as automatically lighting up the screen or adjusting to a suitable working mode when the user approaches.

[0075] (4) Ensuring user privacy and security: Since millimeter-wave radar mainly relies on the reflected signals generated by human movements for detection rather than directly collecting image information, it can better protect user privacy and security while providing convenient services.

[0076] (5) Improve the energy efficiency of equipment: Through precise human body detection, millimeter wave radar technology wakes up the screen or adjusts the device status only when necessary, effectively reducing unnecessary energy consumption and complying with the concept of green and sustainable development.

[0077] From this we can see that waking up the screen through millimeter-wave radar technology can realize the automation and intelligence of the equipment, improve energy utilization efficiency, and provide a better user experience.

[0078] In summary, the device, control method and terminal for automatic screen wake-up and sleep of the present invention transmit a frequency modulated continuous wave signal to a designated area through a radar system module, and mix the received echo signal reflected by an object with the transmitted signal to obtain an intermediate frequency signal; then the main controller detects the presence of a human body in the designated area according to the intermediate frequency signal, and sends a screen wake-up instruction or a screen sleep instruction based on the human presence detection result and the current state of the screen to control the screen to wake up or sleep. The present invention realizes intelligent control of the screen of an electronic device through millimeter wave radar human presence detection technology, solves the energy consumption caused by the screen being on for a long time when no one is around, and avoids the problem of user privacy leakage, and at the same time automatically lights up the screen before a person returns to the screen to improve the intelligence of the device and the user experience. Therefore, the present invention effectively overcomes the various shortcomings of the prior art and has a high industrial utilization value.

[0079] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present invention. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. A device for automatically waking up and sleeping a screen, characterized in that: The device is connected to the screen for communication, and includes: A radar system module, used to transmit a frequency modulated continuous wave signal to a designated area, and mix the received echo signal reflected by the object with the transmitted signal to obtain an intermediate frequency signal; The main controller is connected to the radar system module and is used to detect the presence of human beings in a designated area according to the intermediate frequency signal, and to send a screen wake-up instruction or a screen sleep instruction based on the human presence detection result and the current state of the screen to control the screen to wake up or sleep.

2. The device for automatically waking up and sleeping the screen according to claim 1, characterized in that: The radar system module is used to transmit a frequency modulated continuous wave signal to a designated area based on a preset radar detection area and radar waveform generator parameters, receive an echo signal reflected by an object when the frequency modulated continuous wave signal is reflected, mix the echo signal with the transmitted signal, and perform preliminary signal processing to obtain an intermediate frequency signal in the form of a digital signal.

3. The device for automatically waking up and sleeping the screen according to claim 1, characterized in that: The detecting of human presence in a designated area according to the intermediate frequency signal comprises: The signal frequency offset and phase change caused by human body movement are measured according to the intermediate frequency signal, and whether there is a human body in the designated area is determined according to the human body movement and position parameters extracted based on the measured signal frequency offset and phase change.

4. The device for automatically waking up and sleeping the screen according to claim 2, characterized in that: The step of measuring the signal frequency offset and phase change caused by human body motion according to the intermediate frequency signal, and determining whether a human body exists in the designated area according to the human body motion and position parameters extracted based on the measured signal frequency offset and phase change comprises: Processing and analyzing the intermediate frequency signal, measuring the signal frequency deviation and phase change caused by human body movement; wherein human body movement includes: micro movement and obvious movement; the micro movement includes heartbeat and breathing movement; If the signal frequency offset and phase change caused by human body movement are measured, the distance, speed and angle of the human body are extracted according to the signal frequency offset and phase change, and the distance, speed and angle of the human body are compared with the position information of the designated area to further determine whether there is a human body in the designated area; If the signal frequency shift and phase change caused by human body movement are not measured, it is determined that there is no human body in the designated area.

5. The device for automatically waking up and sleeping the screen according to claim 1, characterized in that: The sending of a screen wake-up instruction or a screen sleep instruction based on the human presence detection result and the current state of the screen to control screen wake-up or sleep includes: If a human body is detected in the designated area and the screen is currently in an off state, a screen wake-up instruction is sent according to a preset screen wake-up method, and the current screen state is set to a bright screen state; the screen wake-up method includes: a wired method and a wireless method; If it is detected that there is no human body in the designated area and the screen is currently in the on state, a screen sleep command is sent according to the preset screen wake-up method, and the current screen state is set to the off state; If a human body is detected in the specified area and the screen is currently in the on state, or if no human body is detected in the specified area and the screen is currently in the off state, no command is sent and the screen remains in the same state.

6. The device for automatically waking up and sleeping the screen according to claim 5, characterized in that: The main controller is provided with a wired interface; the main controller is used to generate a screen wake-up instruction or a screen sleep instruction adapted to the wired interface when the screen wake-up mode is a wired mode, so as to send the instruction to the screen through the wired interface.

7. The device for automatically waking up and sleeping the screen according to claim 6, characterized in that: The device for automatically waking up and sleeping the screen also includes: a BLE+2.4G wireless transceiver module, connected to the main controller; the main controller is used to generate a screen wake-up instruction or a screen sleep instruction of a standard protocol or a custom protocol when the screen wake-up method is wireless, and send it to the screen through the BLE+2.4G wireless transceiver module; when the screen is a screen of a standard device, the standard protocol is a protocol that simulates a HID keyboard device, so as to wake up the screen by sending specific keys.

8. The device for automatically waking up and sleeping the screen according to claim 1, characterized in that: The device for automatically waking up and sleeping the screen also includes: a storage module, connected to the radar system module and the main controller, used to store the intermediate frequency signal obtained by the radar system module and send the intermediate frequency signal to the main controller for processing.

9. A method for controlling automatic screen wake-up and sleep, characterized in that: The device for automatic screen awakening and sleep includes: a radar system module, and the method includes: Acquire an intermediate frequency signal obtained by mixing the received echo signal reflected by the object with the frequency modulated continuous wave signal transmitted to the designated area by the radar system module; The human presence detection is performed on the designated area according to the intermediate frequency signal, and a screen wake-up instruction or a screen sleep instruction is sent based on the human presence detection result and the current state of the screen to control the screen to wake up or sleep.

10. An electronic terminal, characterized in that: include: one or more memories and one or more processors; The one or more memories are used to store computer programs; The one or more processors, connected to the memory, are configured to run the computer program to perform the method as claimed in claim 9.

Images