Television control system and method based on non-contact perception detection

Abstract

The invention discloses a television control system and method based on non-contact perception detection. The system comprises a millimeter wave radar sensor, a signal processing unit and an interaction control engine unit which are arranged in a smart television. The millimeter wave radar sensor is used for capturing gestures and postures of a user; the signal processing unit is used for analyzing sensor data and extracting gesture features; and the interaction control engine unit is used for analyzing the gesture features to convert the gesture features into control commands and transmitting the control commands to a controller of the smart television. According to the invention, the gesture action of the user is captured through the millimeter wave radar sensor, the advanced signal processing technology is utilized to generate 3D gesture mapping, and the 3D gesture mapping is converted into the control signal of the television, so that natural interaction and linkage between the user and the television are realized, and a personalized intelligent application scene is created. The method is not only suitable for home entertainment scenes, but also can be expanded to multiple fields such as education, medical treatment and safety monitoring, and a more visual and natural man-machine interaction mode is provided for users.

Description

Technical Field

[0001] The present invention relates to the technical field of smart home appliances, and in particular to a television control system and method based on non-contact sensing detection. Background Art

[0002] Existing TV control methods mainly include the following: 1. Physical remote control: As the most traditional control method, it communicates with the TV through infrared or radio frequency signals to achieve basic channel switching and volume adjustment functions. 2. Smart remote control: With the popularization of smart homes, smart remote controls are integrated with voice recognition technology, allowing users to perform operations such as program search and volume adjustment through voice commands. 3. Mobile application control: Many TV brands have launched dedicated mobile applications, allowing users to turn their mobile phones into remote controls via Wi-Fi or Bluetooth to achieve remote control of the TV. 4. Voice assistant integration: Smart TVs can now be integrated with voice assistants such as Amazon Alexa and Google Assistant, allowing users to control playback, query information, etc. through conversations.

[0003] Although TV control technology has developed rapidly and provides a variety of operation methods, there are still some technical challenges and room for improvement. First, the complexity of the user interface is a problem, especially for the elderly or children who are not familiar with technology. The interface design of some smart remote controls or applications is not intuitive enough, which increases the difficulty of use. Secondly, although voice recognition technology has made significant progress, its accuracy in noisy environments or when facing accents of different regional dialects still has room for improvement. These challenges need to be solved through further technological innovation and user interface optimization to ensure that TV control technology is easier to use and can adapt to the needs and environments of different users. Summary of the invention

[0004] The purpose of the present invention is to provide a TV control system and method based on non-contact sensing detection, which uses a 60GHz millimeter wave radar sensor to achieve high-precision 3D detection of user gestures and postures, thereby achieving non-contact control and interaction of smart TVs, and enhancing the interactive experience between the TV and the user.

[0005] The technical solution adopted by the present invention is: A television control system based on non-contact sensing detection includes a millimeter wave radar sensor, a signal processing unit and an interactive control engine unit arranged inside a smart TV; the millimeter wave radar sensor is used to capture the user's gestures and postures; the signal processing unit is used to analyze sensor data and extract gesture features; the interactive control engine unit is used to parse the gesture features to convert them into control commands, and transmit the control commands to the controller of the smart TV.

[0006] Furthermore, the millimeter-wave radar sensor is integrated inside the front frame of the smart TV and is set toward the user; a miniature radar antenna is provided on the millimeter-wave radar sensor, and the millimeter-wave radar sensor covers the user area in front of the smart TV through the millimeter waves emitted by the miniature radar antenna; the millimeter-wave radar sensor compares and analyzes the electromagnetic waves emitted by the radar and the reflected electromagnetic waves to further detect the human body.

[0007] Furthermore, the millimeter wave radar sensor, the signal processing unit and the interactive control engine unit are all powered by the power supply unit of the smart TV.

[0008] Furthermore, the micro radar antenna adopts a three-transmit and four-receive PCB circuit board printed antenna layout architecture.

[0009] Furthermore, human body detection includes detecting the distance, speed, angle, fall, breathing, and heartbeat data of the target. A television control method based on non-contact sensing detection comprises the following steps: Step 1: The millimeter wave radar sensor works in the smart TV power-on mode, sends high-frequency electromagnetic wave signals and receives reflected signals to obtain human body posture information; Specifically, the 60GHZ millimeter-wave radar sensor works in the smart TV power-on mode, sending high-frequency electromagnetic wave signals and receiving reflected signals to detect whether there is a human body in front. By continuously tracking and calculating the distance and direction of the human body, the radar module obtains the posture information of the human body and calculates the human body's movement trajectory based on the posture changes. The millimeter-wave system with an operating frequency of 60 GHz can detect movements as small as a fraction of a millimeter; Step 2: The signal processing unit extracts key features of gestures from the collected human posture information data; the key features of gestures include speed, direction and shape; Step 3: Classify the extracted gesture key features using a machine learning algorithm to identify the user's gesture intention; Specifically, the machine learning algorithm adopted is an existing mature gesture classification algorithm.

[0010] Step 4, determine whether the gesture recognition is successful; if so, convert the recognized gesture intention into a corresponding control command and execute step 5; otherwise, feedback the gesture recognition failure to the user and execute step 2; In step 5, the controller of the smart TV feeds back the execution result to the user through the user interface based on the control command.

[0011] Furthermore, visual and auditory feedback is provided to inform the user of gesture recognition failure.

[0012] The present invention adopts the above technical solution and uses a 60GHz millimeter wave radar sensor to achieve high-precision 3D detection of human posture and air gesture operations, thereby improving the accuracy of user intention recognition. The present invention uses advanced signal processing technology and specific algorithms to analyze human motion trajectories, which is not only suitable for simple viewing intention judgments, but also can identify more complex user behavior patterns. The present invention can handle multi-person scenes, accurately distinguish users who are actually watching TV, and provide a more personalized interactive experience. The present invention provides a contactless TV interactive experience by converting 3D gesture mapping into control signals, allowing users to interact with smart TVs in a more natural and intuitive way. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The present invention is further described in detail below with reference to the accompanying drawings and specific embodiments; Figure 1 This is a schematic diagram of the principle structure of a television control system based on non-contact sensing detection according to the present invention; Figure 2 The present invention is a flowchart of a television control method based on non-contact sensing detection. Implementation

[0014] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0015] like Figure 1 As shown in or 2, the present invention discloses a television control system based on non-contact sensing detection, which includes a millimeter-wave radar sensor, a signal processing unit and an interactive control engine unit arranged inside a smart TV; the millimeter-wave radar sensor is used to capture the user's gestures and postures; the signal processing unit is used to analyze sensor data and extract gesture features; the interactive control engine unit is used to parse gesture features to convert them into control commands, and transmit the control commands to the controller of the smart TV.

[0016] Furthermore, the millimeter-wave radar sensor is integrated inside the front frame of the smart TV and is set toward the user; a miniature radar antenna is provided on the millimeter-wave radar sensor, and the millimeter-wave radar sensor covers the user area in front of the smart TV through the millimeter waves emitted by the miniature radar antenna; the millimeter-wave radar sensor compares and analyzes the electromagnetic waves emitted by the radar and the reflected electromagnetic waves to further detect the human body.

[0017] Furthermore, the millimeter wave radar sensor, the signal processing unit and the interactive control engine unit are all powered by the power supply unit of the smart TV.

[0018] Furthermore, the micro radar antenna adopts a three-transmit and four-receive PCB circuit board printed antenna layout architecture.

[0019] Furthermore, human body detection includes detecting the distance, speed, angle, fall, breathing, and heartbeat data of the target. A television control method based on non-contact sensing detection comprises the following steps: Step 1: The millimeter wave radar sensor works in the smart TV power-on mode, sends high-frequency electromagnetic wave signals and receives reflected signals to obtain human body posture information; Specifically, the 60GHZ millimeter-wave radar sensor works in the smart TV power-on mode, sending high-frequency electromagnetic wave signals and receiving reflected signals to detect whether there is a human body in front. By continuously tracking and calculating the distance and direction of the human body, the radar module obtains the posture information of the human body and calculates the human body's movement trajectory based on the posture changes. The millimeter-wave system with an operating frequency of 60 GHz can detect movements as small as a fraction of a millimeter; Step 2: The signal processing unit extracts key features of gestures from the collected human posture information data; the key features of gestures include speed, direction and shape; Step 3: Classify the extracted gesture key features using a machine learning algorithm to identify the user's gesture intention; Specifically, the machine learning algorithm adopted is an existing mature gesture classification algorithm.

[0020] Step 4, determine whether the gesture recognition is successful; if so, convert the recognized gesture intention into a corresponding control command and execute step 5; otherwise, feedback the gesture recognition failure to the user and execute step 2; In step 5, the controller of the smart TV feeds back the execution result to the user through the user interface based on the control command.

[0021] Furthermore, visual and auditory feedback is provided to inform the user of gesture recognition failure.

[0022] The specific principle of the present invention is described in detail below: The system of the present invention captures the user's gestures through the millimeter wave radar sensor, and the signal processing unit analyzes the captured data to extract key gesture features. The interactive algorithm engine recognizes the user's intention based on these features and converts the gestures into corresponding control commands to achieve non-contact control of the smart TV.

[0023] The present invention integrates a 60GHz millimeter-wave radar sensor inside the front frame of the smart TV: the module is installed at the front end of the TV housing, facing the user, to ensure that the millimeter waves it emits can cover the area in front of the smart TV.

[0024] The micro radar antenna part adopts a three-transmit and four-receive PCB printed antenna layout scheme. It uses the principle that the electromagnetic signal emitted by the radar system is blocked by an object on its transmission path and then reflected. By comparing and analyzing the electromagnetic waves emitted by the radar and the electromagnetic waves reflected back, the distance, speed, angle, fall, breathing, heartbeat and other data of the object are detected to realize human body detection technology; Form factor: Package size is an important issue for many sensor designers. Minimizing the size of the printed circuit board (PCB) is a challenge, whether the available physical space is limited or the sensor needs a slim and compact design so that it can be better hidden in the room. Smaller PCBs make it easier to design inconspicuous sensor housings, whether they need to be mounted on the wall or ceiling, placed next to the camera, or installed in limited space, such as inside the machine bumper. Millimeter wave radar sensor technology: Use 60GHz millimeter wave radar sensors for high-precision 3D detection to achieve real-time capture of human gestures and postures.

[0025] One of the largest parts of a PCB in a radar detection design is the antenna array. The antenna array is designed to meet specifications such as FoV and gain, and part of the design needs to take into account the wavelength of the radar signal. Longer wavelengths will require larger antenna arrays. However, as the wavelength shortens, the size of the antenna array can be minimized and achieve the same performance.

[0026] As an example, compare the size of an antenna array as it shrinks from 24 GHz to 60 GHz. Due to the longer wavelength, this 24 GHz antenna will consume approximately 6 times the total area of ​​the 60 GHz antenna. This smaller form factor enables 60 GHz and 77 GHz radar sensors to fit into applications that existing 24 GHz radar sensors cannot fit into. In addition, the smaller antenna size requirements now enable the antenna patch to be built directly on top of the device package.

[0027] The process of human body detection and intention judgment is as follows: the 60GHZ millimeter wave radar sensor works in the smart TV power-on mode, sending high-frequency electromagnetic wave signals and receiving reflected signals to detect whether there is a human body in front. By continuously tracking and calculating the distance and direction of the human body, the radar module obtains the posture information of the human body and calculates the human body's movement trajectory based on the posture changes. The millimeter wave system with an operating frequency of 60 GHz can detect movements as small as a fraction of a millimeter.

[0028] The present invention uses a specific algorithm to analyze the human body's motion trajectory, which can detect the position of the hand in three-dimensional space and realize 3D detection, which is suitable for gestures in the air. In addition, detection of falls, breathing, heartbeat, etc. can give the product richer functions. The gesture recognition algorithm uses machine learning and pattern recognition technology to classify and identify the user's gestures.

[0029] Control command mapping: Associate recognized gestures with predefined control commands to implement intuitive control logic.

[0030] Interaction algorithm details: 1 Signal and volume control; Volume increase: user's palm is up, push forward. Volume decrease: user's palm is down, push forward. Signal switching: user waves left and right. 2 Brightness control: Brightness increase: user's hands rotate upward. Brightness decrease: user's hands rotate downward. 3 Motion sensing game control: Game start / pause: user's hands are put together, then separated. Game control: according to the game requirements, realize actions such as moving up, down, left, right, jumping, attacking, etc.

[0031] The present invention adopts the above technical solution and uses a 60GHz millimeter wave radar sensor to achieve high-precision 3D detection of human posture and air gesture operations, thereby improving the accuracy of user intention recognition. The present invention uses advanced signal processing technology and specific algorithms to analyze human motion trajectories, which is not only suitable for simple viewing intention judgments, but also can identify more complex user behavior patterns. The present invention can handle multi-person scenes, accurately distinguish users who are actually watching TV, and provide a more personalized interactive experience. The present invention provides a contactless TV interactive experience by converting 3D gesture mapping into control signals, allowing users to interact with smart TVs in a more natural and intuitive way.

[0032] The present invention uses a millimeter-wave radar sensor to capture user gestures, uses advanced signal processing technology to generate 3D gesture mapping, and converts it into a TV control signal, enabling natural interaction between the user and the TV game APP, and creating a personalized smart application scenario. The present invention is not only suitable for home entertainment scenarios, but may also be extended to education, medical care, security monitoring and other fields, providing users with a more intuitive and natural human-computer interaction method.

[0033] Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. In the absence of conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The components of the embodiments of the present application generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the detailed description of the embodiments of the present application is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians of the art without making creative work are within the scope of protection of the present application.

Claims

1. A TV control system based on non-contact sensing detection, characterized in that: It includes a millimeter wave radar sensor, a signal processing unit and an interactive control engine unit arranged inside the smart TV; the millimeter wave radar sensor is used to capture the user's gestures and postures; The signal processing unit is used to analyze the sensor data and extract gesture features; The interactive control engine unit is used to analyze gesture features to convert them into control commands, and transmit the control commands to the controller of the smart TV.

2. A TV control system based on non-contact sensing detection according to claim 1, characterized in that: The millimeter-wave radar sensor is integrated inside the front frame of the smart TV and is set toward the user. A miniature radar antenna is provided on the millimeter-wave radar sensor, and the millimeter-wave radar sensor covers the user area in front of the smart TV through the millimeter waves emitted by the miniature radar antenna. The millimeter-wave radar sensor compares and analyzes the electromagnetic waves emitted by the radar with the reflected electromagnetic waves to detect the human body.

3. A TV control system based on non-contact sensing detection according to claim 1, characterized in that: The micro radar antenna adopts a three-transmit and four-receive PCB circuit board printed antenna layout architecture.

4. A TV control system based on non-contact sensing detection according to claim 1, characterized in that: Human body detection includes detecting the target’s distance, speed, angle, fall, breathing, and heartbeat data.

5. A TV control system based on non-contact sensing detection according to claim 1, characterized in that: The millimeter wave radar sensor, signal processing unit and interactive control engine unit are all powered by the smart TV's power supply unit.

6. A TV control method based on non-contact sensing detection, according to a TV control system based on non-contact sensing detection according to any one of claims 1 to 5, characterized in that: The control method comprises the following steps: Step 1: The millimeter wave radar sensor works in the smart TV power-on mode, sends high-frequency electromagnetic wave signals and receives reflected signals to obtain human body posture information; Step 2: The signal processing unit extracts key features of gestures from the collected human posture information data; the key features of gestures include speed, direction and shape; Step 3: Classify the extracted gesture key features using a machine learning algorithm to identify the user's gesture intention; Step 4, determine whether the gesture recognition is successful; if so, convert the recognized gesture intention into a corresponding control command and execute step 5; otherwise, feedback the gesture recognition failure to the user and execute step 2; In step 5, the controller of the smart TV feeds back the execution result to the user through the user interface based on the control command.

7. The TV control method based on non-contact sensing detection according to claim 6, characterized in that: In step 1, the millimeter wave radar sensor continuously tracks and calculates the distance and direction of the human body to obtain the human body's posture information.

8. The TV control method based on non-contact sensing detection according to claim 6, characterized in that: In step 1, the millimeter wave radar sensor transmits millimeter waves with an operating frequency of 60 GHz.

9. The TV control method based on non-contact sensing detection according to claim 6, characterized in that: In step 4, visual and auditory feedback is provided to the user to inform him that the gesture recognition failed.

Images