Smart home device and control terminal pairing method and smart home device

Abstract

The invention provides a pairing method of smart home equipment and a control terminal and the smart home equipment. According to the method, user figure data, user hand data and hand holder data in a target room are obtained by adopting a millimeter wave detection technology, and the data are processed by adopting a neural network model technology to determine whether a target control terminal exists in the target room; compared with the prior art, the pertinence of wireless communication pairing between the smart home device and the control terminal is improved, so that the pairing result conforms to the user expectation, and the problem that the pairing result does not conform to the user expectation due to the poor pertinence of wireless communication pairing between the smart home device and the control terminal in the prior art is solved.

Description

Technical Field

[0001] The present application relates to the field of control technology of smart home devices, and in particular to a pairing method of a smart home device and a control terminal, a smart home device, a computer-readable storage medium and a system. Background Art

[0002] With the popularity of smart devices in modern homes, air conditioners, as one of the main home appliances, increasingly support remote control with remote controllers. Traditional air conditioner control relies on infrared remote controllers, through which users can send signals to adjust the temperature, turn on and off the air conditioner, and other functions. However, with the increase in home air conditioner equipment, especially when there are different air conditioners in multiple rooms in the home, users may need to use the same remote controller to pair and control multiple air conditioners. In this case, mispairing or miscontrol may occur, that is, the user may inadvertently control the air conditioner in other rooms instead of the current room, causing inconvenience to use.

[0003] Current air conditioner pairing and control systems usually rely on short-range wireless communication technologies such as infrared or Bluetooth for remote control. However, the signal coverage of these traditional technologies is unclear, and it is impossible to accurately distinguish in which room the user is issuing the control command. Therefore, in an environment with multiple air conditioners, if there is no clear mechanism to distinguish between devices and rooms, the remote control signal may control the air conditioners in other rooms, causing inconvenience and misoperation.

[0004] That is, the wireless communication pairing between the smart home device and the control terminal in the existing solution is poorly targeted, resulting in the pairing result not meeting the user's expectations. Summary of the invention

[0005] The main purpose of the present application is to provide a pairing method for a smart home device and a control terminal, a smart home device, a computer-readable storage medium and a system, so as to at least solve the problem that the wireless communication pairing between the smart home device and the control terminal in the existing solution is poorly targeted, resulting in the pairing result not meeting the user's expectations.

[0006] In order to achieve the above object, according to one aspect of the present application, a method for pairing a smart home device and a control terminal is provided, the method comprising:

[0007] Using millimeter wave detection technology to obtain object information in the target room, the object information includes user body shape data, user hand data and hand-held object data, the user body shape data, the user hand data and the hand-held object data respectively represent the position and shape of the user body shape, the user hand and the user hand-held object;

[0008] Using a neural network model technology to at least process the object information to determine whether a target control terminal exists in the target room;

[0009] When it is determined that the target control terminal exists in the target room, pairing is performed with the target control terminal.

[0010] Optionally, using a neural network model technology to process at least the object information to determine whether a target control terminal exists in the target room includes:

[0011] Using the millimeter wave detection technology to determine whether a preset condition is met, the preset condition indicates that the user's finger is performing a pressing action;

[0012] In the case where it is determined that the preset condition is met, determining that the target control terminal exists in the target room;

[0013] When it is determined that the preset condition is not satisfied, it is determined that the target control terminal does not exist in the target room.

[0014] Optionally, pairing with the target control terminal includes:

[0015] Receiving a target unique identifier sent by the target control terminal;

[0016] Based on the target unique identifier, a corresponding wireless communication protocol is used to pair with the target control terminal.

[0017] Optionally, after pairing with the target control terminal, the method further includes:

[0018] Determining a pairing method includes a mapping relationship between the target unique identifier and a corresponding wireless communication protocol;

[0019] The pairing method is stored in a database.

[0020] Optionally, using a neural network model technology to process at least the object information to determine whether a target control terminal exists in the target room includes:

[0021] When the wireless communication mode of the target control terminal is WIFI communication, obtaining the current WIFI strength;

[0022] The object information and the current WIFI strength are processed using a neural network model technology to determine whether a target control terminal exists in the target room.

[0023] Optionally, using a neural network model technology to process at least the object information to determine whether a target control terminal exists in the target room includes:

[0024] When the wireless communication mode of the target control terminal is WIFI communication, obtaining the current WIFI strength and the current signal direction;

[0025] The object information, the current WIFI strength and the current signal direction are processed using a neural network model technology to determine whether a target control terminal exists in the target room.

[0026] Optionally, after pairing with the target control terminal, the method further includes:

[0027] When it is determined that the user in the target room no longer holds the target control terminal, the millimeter wave detection technology is used to determine multiple times whether a preset condition is satisfied to obtain a determination result, wherein the determination result indicates the number of times the preset condition is satisfied, and the preset condition indicates that the user's finger is performing a pressing action;

[0028] When the number of determination results is greater than or equal to a preset number of times, maintaining the matching state with the target control terminal;

[0029] When the number of the determination results is less than the preset number, the matching state with the target control terminal is exited.

[0030] According to another aspect of the present application, a smart home device is provided, the smart home device comprising:

[0031] a first processing unit, configured to acquire object information in a target room by using a millimeter wave detection technology, wherein the object information includes user body shape data, user hand data, and hand-held object data, wherein the user body shape data, the user hand data, and the hand-held object data respectively represent the position and shape of the user body shape, the user hand, and the hand-held object;

[0032] A second processing unit is used to process at least the object information using a neural network model technology to determine whether a target control terminal exists in the target room;

[0033] The third processing unit is configured to pair with the target control terminal when it is determined that the target control terminal exists in the target room.

[0034] According to another aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute any one of the methods described.

[0035] According to another aspect of the present application, a pairing system for a smart home device and a control terminal is provided, the system comprising: a smart home device and a control terminal, the smart home device being used to establish a communication connection with the control terminal, and the smart home device being also used to execute any one of the described methods.

[0036] By applying the technical solution of the present application, millimeter wave detection technology is used to obtain user body shape data, user hand data and hand holding data in the target room, and neural network model technology is used to process these data to determine whether there is a target control terminal in the target room. Compared with the existing solution, the targeted pairing of the wireless communication between the smart home device and the control terminal is improved, so that the pairing result meets the user's expectations, thereby solving the problem that the wireless communication pairing between the smart home device and the control terminal in the existing solution is poorly targeted, resulting in the pairing result not meeting the user's expectations. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The drawings constituting part of the present application are used to provide a further understanding of the present application. The exemplary embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0038] Figure 1 A schematic diagram of a flow chart of a method for pairing a smart home device and a control terminal provided according to an embodiment of the present application is shown;

[0039] Figure 2 A schematic diagram of a flow chart of another method for pairing a smart home device and a control terminal provided according to an embodiment of the present application is shown;

[0040] Figure 3 A structural block diagram of a smart home device provided according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0041] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0042] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0043] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0044] For the convenience of description, some nouns or terms involved in the embodiments of the present application are explained below:

[0045] Millimeter wave detection technology: Millimeter wave radar captures objects in the environment and measures distance, speed and angle by emitting millimeter wave signals and using the reflection characteristics of the signal on the surface of objects.

[0046] Automatic pairing: When a smart home device detects that a user is holding a remote control in the room, it can automatically pair with the remote control without the user having to manually select a specific device.

[0047] As introduced in the background technology, current air conditioning pairing and control systems usually rely on short-range wireless communication technologies such as infrared or Bluetooth for remote control. However, the signal coverage of these traditional technologies is unclear, and it is impossible to accurately distinguish in which room the user issues the control command. Therefore, in an environment with multiple air conditioning devices, if there is no clear device and room distinction mechanism, the remote control signal may control the air conditioners in other rooms, causing inconvenience and misoperation. In order to solve the problem that the wireless communication pairing between smart home devices and control terminals in the existing solutions is poorly targeted, resulting in pairing results that do not meet user expectations, the embodiments of the present application provide a pairing method for a smart home device and a control terminal, a smart home device, a computer-readable storage medium and a system.

[0048] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0049] In this embodiment, a method for pairing a smart home device and a control terminal is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0050] Figure 1FIG. 1 is a flow chart of a method for pairing a smart home device and a control terminal according to an embodiment of the present application. Figure 1 As shown, the method comprises the following steps:

[0051] Step S101, using millimeter wave detection technology to obtain object information in the target room, the object information includes user body shape data, user hand data and hand-held object data, the user body shape data, the user hand data and the hand-held object data respectively represent the position and shape of the user body shape, the user hand and the hand-held object;

[0052] Millimeter-wave radar can accurately detect the movement, position, and shape characteristics of objects, with enough accuracy to detect user hand movements and position changes of small objects (such as remote controls).

[0053] It is impossible to directly determine whether the user is holding the remote control by only capturing the reflected signal of the millimeter wave radar. Therefore, a data processing module is required in this application to process the raw data obtained from the millimeter wave radar. The specific steps are as follows:

[0054] Raw data collection: The millimeter wave radar module continuously transmits millimeter wave signals and receives reflected signals. The system obtains a three-dimensional data point cloud (Point Cloud) based on the delay, frequency change and signal strength of the echo. The data represents the location, movement status and other information of objects in the room.

[0055] Signal preprocessing: After receiving the raw data, the data is first preprocessed, including removing noise, enhancing signal features, etc. This step uses signal processing algorithms (such as low-pass filters and noise suppression algorithms) to extract useful signals and remove noise interference in the environment.

[0056] A smart home device can be an air conditioner.

[0057] Step S102, using a neural network model technology to process at least the object information to determine whether there is a target control terminal in the target room;

[0058] In one embodiment of the present application, a neural network model technology is used to process at least the object information to determine whether there is a target control terminal in the target room, including:

[0059] The millimeter wave detection technology is used to determine whether a preset condition is met, and the preset condition indicates that the user's finger is performing a pressing action;

[0060] In the case where it is determined that the preset conditions are met, determining that the target control terminal exists in the target room;

[0061] When it is determined that the preset condition is not met, it is determined that the target control terminal does not exist in the target room.

[0062] Specifically, the preset condition may also represent that the user's finger is performing a sliding screen operation. If it is determined that the above preset condition is met, it is determined that the target control terminal exists in the above target room; if it is determined that the above preset condition is not met, it is determined that the above target control terminal does not exist in the above target room.

[0063] Through millimeter wave detection technology and subsequent preprocessing, it can be known whether the above-mentioned target control terminal exists in the target room.

[0064] User body recognition: By analyzing the point cloud data, the system can identify the user's position and body outline (i.e., user body shape data) in the room. This is done by analyzing the data points collected by the millimeter wave radar through machine learning or pattern recognition algorithms (such as K-means clustering or feature extraction-based classification algorithms) to determine the position of the human body in the room.

[0065] Hand movement analysis: The system further analyzes the user's hands to determine their hand position and movement trajectory. Hand recognition can be achieved through the following methods:

[0066] Micro-motion analysis: Through the high-precision detection of millimeter-wave radar, the system can capture the tiny movements of the user's hands and analyze the relative movement of the hands and other parts of the body.

[0067] Trajectory tracking: Based on continuous measurement of radar echoes, the system can track the hand movement trajectory. If the hand movement trajectory conforms to the typical pattern of holding and operating the remote control (such as the hand moving toward the air conditioner, staying at a height, and typical control actions), it can be determined that the user is operating the remote control.

[0068] Object recognition and remote control confirmation: The system further analyzes objects near the hand to determine whether the user is holding the remote control. The specific implementation is as follows:

[0069] Object material detection: Millimeter wave signals will produce different reflection characteristics depending on the material of the object (such as metal, plastic). Remote controls usually contain batteries and other metal parts. The system can identify whether the user is holding the remote control by analyzing the strength and characteristics of the reflected signal.

[0070] Shape matching: The system can use pattern recognition technology to pre-set the geometric shape features of the remote control (such as rectangle, strip, etc.), and further confirm whether it is a remote control by matching it with the shape of objects near the hand.

[0071] Data fusion and judgment: Finally, the data processing module combines the above analysis results (which can be input into the neural network model to let the model output the judgment conclusion) and makes a logical judgment: if the system detects that the user is holding an object that meets the characteristics of the remote control, and the object meets the operation mode (such as operating in the direction of the air conditioner), then it is judged that the user is using the remote control. If these conditions are not met, the system does not think that the current user is holding the remote control, and the air conditioner ignores the signal sent by the remote control.

[0072] In one embodiment of the present application, a neural network model technology is used to process at least the object information to determine whether there is a target control terminal in the target room, including:

[0073] When the wireless communication mode of the target control terminal is WIFI communication, obtaining the current WIFI strength;

[0074] The object information and the current WIFI strength are processed using a neural network model technology to determine whether a target control terminal exists in the target room.

[0075] Specifically, by combining the WIFI strength with the object information to make a judgment, it is known whether the control terminal is a terminal device in the target room.

[0076] Integration with the pairing process:

[0077] Initial pairing: When the system detects that the user is holding the remote control and is ready to operate, the system performs pairing through the signal (such as infrared or Bluetooth) sent by the remote control. The pairing process needs to be matched with the remote control's unique identification information (such as the device ID, i.e., the unique identification) and the air conditioner's control module. The system confirms through data processing that the pairing process will only be executed when the user is holding the remote control.

[0078] Signal validity confirmation: Once pairing is complete, the system will re-verify whether the signal comes from the remote control held by the user each time it receives a remote control signal. The air conditioner will only respond to the signal command if the millimeter wave data processing module confirms that the user is still holding the remote control and performing an operation.

[0079] In one embodiment of the present application, a neural network model technology is used to process at least the object information to determine whether there is a target control terminal in the target room, including:

[0080] When the wireless communication mode of the target control terminal is WIFI communication, obtaining the current WIFI strength and the current signal direction;

[0081] The object information, the current WIFI strength and the current signal direction are processed using a neural network model technology to determine whether a target control terminal exists in the target room.

[0082] When the system confirms that the user is holding the remote control, the remote control signal receiving module of the air conditioning system starts to monitor the control signals sent from the user's remote control. These signals can be command information sent by infrared, Bluetooth or other wireless technologies. At this time, the system receives the unique identification information of the remote control (such as infrared signal code or Bluetooth device ID) and establishes a communication connection based on this unique identification information.

[0083] Step S103: When it is determined that the target control terminal exists in the target room, pairing is performed with the target control terminal.

[0084] In the above-mentioned device, millimeter wave detection technology is used to obtain user body shape data, user hand data and hand holding data in the target room, and neural network model technology is used to process these data to determine whether there is a target control terminal in the above-mentioned target room. Compared with the existing solution, the targeted pairing of the wireless communication between the smart home device and the control terminal is improved, so that the pairing result meets the user's expectations, thereby solving the problem that the wireless communication pairing between the smart home device and the control terminal in the existing solution is poorly targeted, resulting in the pairing result not meeting the user's expectations.

[0085] In actual use, the air conditioner or remote control may have hardware failures or communication anomalies, such as remote control battery exhaustion, air conditioner control board failure, etc. In order to ensure that the system can still operate stably when encountering equipment failures, the following technical features are designed:

[0086] Self-detection and fault alarm: The system is designed with a self-detection function that can regularly check the working status of the millimeter wave detection module, remote control signal receiving module, and air conditioning control unit. If a module abnormality is detected, the system will promptly alert the user through sound and light prompts or mobile phone APP to remind the user to check the device. The system will also record fault information and automatically store it in the device's memory to facilitate subsequent maintenance personnel to troubleshoot.

[0087] Fault automatic switching mode: When a device failure is detected (such as complete loss of remote control signal or failure of the air conditioning control module), the system automatically switches to manual control mode, allowing the user to operate the air conditioner through the air conditioner control panel. This fault switching mode ensures that the user can still use the air conditioner even in the event of a remote control or communication failure.

[0088] Abnormal operation handling: Users may sometimes perform operations under abnormal circumstances, such as quickly switching remote control commands or pressing multiple buttons at the same time. This may cause the system to receive multiple conflicting operation commands. To deal with such situations, the system has designed an abnormal operation handling mechanism:

[0089] Command priority sorting mechanism: The system has designed a command priority sorting mechanism based on the logic of the operation. For fast and repeated operations (such as multiple power on and off) or multiple conflicting commands, the system will execute them according to the pre-set priority. For example, the temperature adjustment command may take precedence over the wind speed adjustment to avoid slow system response or errors caused by multiple command conflicts.

[0090] Command deduplication and filtering: When the system detects repeated commands in a short period of time (for example, the user quickly presses the same key multiple times), the system will automatically deduplicate and only execute the last valid command to avoid repeated operations from interfering with the system.

[0091] In one embodiment of the present application, pairing with the target control terminal includes:

[0092] Receiving the target unique identifier sent by the target control terminal;

[0093] Based on the above target unique identifier, a corresponding wireless communication protocol is used to pair with the above target control terminal.

[0094] In one embodiment of the present application, after pairing with the target control terminal, the method further includes:

[0095] Determining the pairing method includes a mapping relationship between the above-mentioned target unique identifier and the corresponding wireless communication protocol;

[0096] The above pairing method is stored in the database.

[0097] Specifically, the pairing method is stored in a database to reduce the processing time of the next pairing.

[0098] When the millimeter wave technology detects that there is no user holding the remote control in the current room, the air conditioner will automatically ignore the remote control signal and will not operate. This can effectively avoid the problem of miscontrol from other rooms and significantly reduce signal interference. By detecting the holding status of the remote control in this way, the system can intelligently distinguish the control intention of the current room from the interference signals of other rooms.

[0099] Reduce system energy consumption and extend device life: By accurately identifying whether there is a user holding a remote control in the room, this application can prevent the air conditioner in an unrelated room from being incorrectly controlled, reduce unnecessary air conditioner startup or adjustment operations, and thus reduce energy consumption. In addition, the air conditioner only responds to commands when valid control is detected, reducing ineffective operation of the device and helping to extend the life of the device. This effect is achieved through the millimeter wave's ability to accurately sense the user holding the remote control.

[0100] Enhanced intelligent management in a home with multiple devices: In a home environment with multiple air conditioners in multiple rooms, millimeter wave detection technology can effectively distinguish which room has a user holding a remote control, thereby achieving independent management of the air conditioner in each room. This avoids confusion of remote control signals from multiple air conditioners, improves the intelligence level of the entire system, makes this application suitable for use in homes with multiple air conditioners or smart home scenarios, and simplifies the user's air conditioner management operations.

[0101] In one embodiment of the present application, after pairing with the target control terminal, the method further includes:

[0102] When it is determined that the user in the target room no longer holds the target control terminal, the millimeter wave detection technology is used to determine multiple times whether a preset condition is satisfied to obtain a determination result, wherein the determination result indicates the number of times the preset condition is satisfied, and the preset condition indicates that the user's finger is performing a pressing action;

[0103] When the number of the above determination results is greater than or equal to the preset number of times, maintaining the matching state with the above target control terminal;

[0104] When the number of the above determination results is less than the above preset number, the matching state with the above target control terminal is exited.

[0105] In order to avoid system misjudgment due to single signal interference, this application will perform multiple continuous detection confirmation mechanisms before switching key states (such as pairing, signal ignoring, etc.). For example, when the system determines that "no user is detected", it must detect no user or remote control signal in multiple set detection cycles (such as 3-5 consecutive detections within 10 seconds) before it can finally confirm that the user is not there or is no longer holding the remote control. This multiple detection mechanism effectively reduces misjudgment caused by signal interference and ensures the robustness of the system.

[0106] Combination of millimeter wave data and signal strength: The system combines the user location data captured by the millimeter wave radar to determine whether the signal is a valid remote control signal in the current room. If the signal comes from another room (based on signal strength and direction), the system will ignore the signal to avoid incorrect pairing.

[0107] Multiple device ID distinction: The system can manage the unique identification of multiple remote controllers at the same time, and ensure that each remote controller only matches the air conditioning device it is bound to by distinguishing the device ID.

[0108] The system relies on the following algorithms during the pairing process to ensure the accuracy of the pairing process:

[0109] Signal processing and source verification algorithm: By combining the user detection of the millimeter wave radar with the data of the remote control signal receiving module, the system can determine whether the source of the signal is consistent with the handheld remote control in the current room. This avoids cross-room pairing errors.

[0110] Device ID matching algorithm: By comparing the received remote control unique identifier with the air conditioner equipment history, the system can quickly confirm whether the remote control has been paired with the air conditioner. If it is a new device, the system automatically records and binds the new device ID.

[0111] Time and motion matching algorithm: The system will determine whether the user is using the remote control based on the matching of the user's hand movements and signal strength, and start or cancel pairing accordingly.

[0112] The pairing process is:

[0113] User enters the room: The millimeter-wave radar starts working, collects data of the user entering the room, and identifies the user's position and posture through the data processing module;

[0114] Handheld remote control recognition: The system detects the user's hand movement through micro-motion analysis and trajectory tracking, and confirms that the user is holding the remote control through object recognition technology;

[0115] Automatic pairing: After the system detects that the user is holding the remote control, it automatically pairs the remote control with the air conditioner and stores the device ID of the remote control;

[0116] Signal processing: Whenever the user sends a remote control signal, the system uses millimeter-wave radar to confirm whether the user is holding the remote control and performs corresponding operations based on the confirmation result;

[0117] Unpairing: When the user puts down the remote control or leaves the room, the millimeter-wave radar detects that the user is no longer operating, and the smart home device automatically unpairs and enters standby mode.

[0118] In addition, regarding millimeter wave detection:

[0119] Setting the detection cycle: The system performs periodic detection through the millimeter wave radar module, that is, it transmits a millimeter wave signal and collects the reflected signal at a fixed time interval. This time interval (also called the detection cycle) can be adjusted according to the specific application scenario, and is usually set to detect 1 to 5 times per second.

[0120] During each detection cycle, the system collects point cloud data in the room and uses the data processing module to analyze whether there is a user and the remote control he is holding.

[0121] User status determination logic:

[0122] The system will set a time threshold (e.g. 10 seconds) to determine whether a user exists. That is, within multiple consecutive detection cycles (e.g. 10 seconds), if no signal reflection characteristics of a user or a handheld remote control are detected in each cycle, the system determines that there is no user in the room or the user is not holding the remote control.

[0123] User detected: Within a certain detection cycle, if the point cloud data reflected by the millimeter wave signal is confirmed to have human contour features after data processing, and the hand detection and object recognition technology confirms that the user is holding the remote control, the system determines that the user is holding the remote control. The system enters the air conditioner pairing or signal processing state.

[0124] No user detected: If the user's presence is not detected within the set time threshold (for example, a continuous detection cycle within 10 seconds) or the remote control is not detected, the system determines that there is no user in the room or the user is not holding the remote control, enters low-power standby mode, and ignores all remote control signals.

[0125] The specific judgment process of detection and non-detection:

[0126] How to count detected:

[0127] In each detection cycle, the system obtains environmental point cloud data through millimeter wave radar. The data processing module analyzes these point cloud data and determines whether they meet human characteristics through pattern recognition, such as the specific position and movement trajectory of the head, torso, hand and other areas. If these characteristics are detected and it is confirmed that there is a reflection signal near the hand that meets the characteristics of the remote control (such as judging by the reflection intensity and shape), the system will assume that the user is present and holding the remote control. Once the above conditions are detected, the system immediately enters the signal processing mode and maintains this state until the next confirmation of the user status.

[0128] How to count as not detected:

[0129] Time threshold mechanism: If the millimeter wave signal fails to detect the presence of the user within a set detection cycle (for example, multiple detections within 10 seconds), or detects the user but fails to confirm that the user is holding the remote control, the system automatically determines that the user is not detected or the user is not holding the remote control.

[0130] In the case of no user detected, the air conditioning system will automatically enter standby mode and ignore all received remote control signals. This avoids the possibility of misoperation of the air conditioning.

[0131] Abnormal situation handling mechanism: If the signal detection is lost for a preset time (e.g. 10 seconds) at a certain moment (for example, the user is blocked by an object or the signal is temporarily interfered with), the system will eliminate the possibility of temporary misjudgment through multiple consecutive detections.

[0132] For example, if there is a period within 10 seconds where no user signal is detected, but the user holding the remote control is detected in other detection periods, the system will not immediately determine that "no user is detected". Only when the user is not detected for multiple consecutive times within the set time threshold will the system confirm that there is no user in the room or the user is not holding the remote control.

[0133] For example:

[0134] Example of user detection: When a user enters a room and holds a remote control, the system detects once a second. In all detection cycles within 5 seconds, the millimeter-wave radar successfully detects the user's head, torso, and hand positions, confirming that the user is holding the remote control. At this time, the system determines that the user exists and holds the remote control, and enters the signal processing state.

[0135] Example of no user detection: When the user leaves the room or does not hold the remote control, the millimeter wave radar fails to detect the reflected signal of the user or remote control in the next 10 seconds of continuous detection cycle. At this time, the system determines that there is no user in the room or the user does not hold the remote control, automatically ignores all control signals and enters standby mode.

[0136] Flexibility of time threshold: The 10-second time threshold can be adjusted according to specific application scenarios. In some environments that require rapid response (such as smart home systems with high frequency of operation), the time threshold can be reduced to 5 seconds or even shorter. In the case of longer response requirements, the time threshold can be set to 20 seconds to reduce the possibility of misjudgment.

[0137] In order to enable those skilled in the art to more clearly understand the technical solution of the present application, the implementation process of the pairing method of the smart home device and the control terminal of the present application will be described in detail below in combination with specific embodiments.

[0138] This embodiment relates to a specific method for pairing a smart home device and a control terminal. Figure 2 As shown, including:

[0139] The millimeter wave detection technology is used to obtain the object information in the target room. The object information includes the user's body shape data, the user's hand data and the hand's object data. The user's body shape data, the user's hand data and the hand's object data respectively represent the position and shape of the user's body shape, the user's hand and the user's hand's object;

[0140] When the wireless communication mode of the target control terminal is WIFI communication, obtaining the current WIFI strength and the current signal direction;

[0141] The neural network model technology is used to process the object information, current WiFi strength and current signal direction to determine whether there is a target control terminal in the target room;

[0142] When it is determined that the target control terminal exists in the target room, receiving the target unique identifier sent by the target control terminal; based on the target unique identifier, pairing with the target control terminal using a corresponding wireless communication protocol;

[0143] Determine a pairing method including a mapping relationship between a target unique identifier and a corresponding wireless communication protocol; store the pairing method in a database;

[0144] When it is determined that the user in the target room no longer holds the target control terminal, the millimeter wave detection technology is used to determine whether the preset condition is met for multiple times to obtain a determination result, the determination result represents the number of times the preset condition is met, and the preset condition represents that the user's finger is performing a pressing action;

[0145] When the number of determination results is greater than or equal to the preset number of times, the matching state with the target control terminal is maintained; when the number of determination results is less than the preset number of times, the matching state with the target control terminal is exited.

[0146] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0147] The embodiment of the present application also provides a smart home device. It should be noted that the smart home device of the embodiment of the present application can be used to execute the pairing method for the smart home device and the control terminal provided in the embodiment of the present application. The smart home device is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the smart home devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0148] The following is an introduction to the smart home device provided in the embodiments of the present application.

[0149] Figure 3 is a structural block diagram of a smart home device provided according to an embodiment of the present application. Figure 3 As shown, smart home devices include:

[0150] The first processing unit 31 is used to obtain object information in the target room by using millimeter wave detection technology, wherein the object information includes user body shape data, user hand data and hand-held object data, wherein the user body shape data, the user hand data and the hand-held object data respectively represent the position and shape of the user body shape, the user hand and the hand-held object;

[0151] The second processing unit 32 is used to process at least the object information by using a neural network model technology to determine whether there is a target control terminal in the target room;

[0152] The third processing unit 33 is configured to pair with the target control terminal if it is determined that the target control terminal exists in the target room.

[0153] The above-mentioned smart home device obtains the user's body shape data, user hand data and hand holding data in the target room by adopting millimeter wave detection technology, and processes these data by adopting neural network model technology to determine whether there is a target control terminal in the above-mentioned target room. Compared with the existing solution, the targeted pairing of the wireless communication between the smart home device and the control terminal is improved, so that the pairing result meets the user's expectations, thereby solving the problem that the wireless communication pairing between the smart home device and the control terminal in the existing solution is poorly targeted, resulting in the pairing result not meeting the user's expectations.

[0154] In one embodiment of the present application, the second processing unit includes a first determining module, a second determining module and a third determining module.

[0155] The first determination module is used to use the above-mentioned millimeter wave detection technology to determine whether a preset condition is met, and the above-mentioned preset condition indicates that the user's finger is performing a pressing action;

[0156] The second determining module is used to determine that the target control terminal exists in the target room when it is determined that the preset condition is met;

[0157] The third determination module is used to determine that the target control terminal does not exist in the target room when it is determined that the preset condition is not met.

[0158] In one embodiment of the present application, the third processing unit includes a receiving module and a first processing module;

[0159] The receiving module is used to receive the target unique identifier sent by the target control terminal;

[0160] The first processing module is used for pairing with the target control terminal based on the target unique identifier by using a corresponding wireless communication protocol.

[0161] In one embodiment of the present application, the smart home device further includes a determination unit and a storage unit.

[0162] The determination unit is used to determine, after pairing with the target control terminal, a pairing method including a mapping relationship between the target unique identifier and the corresponding wireless communication protocol;

[0163] The storage unit is used to store the above pairing method in a database.

[0164] In one embodiment of the present application, the second processing unit includes a first acquisition module and a fourth determination module.

[0165] The first acquisition module is used to acquire the current WIFI strength when the wireless communication mode of the target control terminal is WIFI communication;

[0166] The fourth determination module is used to process the above-mentioned object information and the above-mentioned current WIFI strength using a neural network model technology to determine whether there is a target control terminal in the above-mentioned target room.

[0167] In one embodiment of the present application, the second processing unit includes a second acquisition module and a second processing module.

[0168] The second acquisition module is used to acquire the current WIFI strength and the current signal direction when the wireless communication mode of the target control terminal is WIFI communication;

[0169] The second processing module is used to process the above-mentioned object information, the above-mentioned current WIFI strength and the above-mentioned current signal direction using a neural network model technology to determine whether there is a target control terminal in the above-mentioned target room.

[0170] In one embodiment of the present application, the smart home device further includes a fourth processing unit, a fifth processing unit and a sixth processing unit.

[0171] The fourth processing unit is used for, after pairing with the target control terminal, when it is determined that the user in the target room no longer holds the target control terminal, using the millimeter wave detection technology to determine multiple times whether a preset condition is satisfied, and obtaining a determination result, wherein the determination result indicates the number of times the preset condition is satisfied, and the preset condition indicates that the user's finger is performing a pressing action;

[0172] The fifth processing unit is used to maintain the matching state with the target control terminal when the number of the determination results is greater than or equal to the preset number of times;

[0173] The sixth processing unit is used to exit the matching state with the target control terminal when the number of the determination results is less than the preset number.

[0174] The above-mentioned smart home device includes a processor and a memory, and the above-mentioned first processing unit, second processing unit and third processing unit are all stored in the memory as program units, and the processor executes the above-mentioned program units stored in the memory to realize corresponding functions. The above-mentioned modules are all located in the same processor; or, the above-mentioned modules are located in different processors in any combination.

[0175] The processor includes a kernel, which retrieves the corresponding program unit from the memory. One or more kernels can be set, and the kernel parameters can be adjusted to solve the problem that the wireless communication pairing between the smart home device and the control terminal in the existing solution is poorly targeted, resulting in the pairing result not meeting the user's expectations.

[0176] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0177] An embodiment of the present invention provides a computer-readable storage medium, which includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute the pairing method between the smart home device and the control terminal.

[0178] An embodiment of the present invention provides a processor, which is used to run a program, wherein the program executes the pairing method of the smart home device and the control terminal when running.

[0179] The embodiment of the present invention provides a device, the device includes a processor, a memory and a program stored in the memory and can be run on the processor, and the processor implements at least the following steps when executing the program: using millimeter wave detection technology to obtain object information in the target room, the object information includes user body shape data, user hand data and hand-held object data, the user body shape data, the user hand data and the hand-held object data respectively represent the position and shape of the user body shape, the user hand and the user hand-held object; using neural network model technology to at least process the object information to determine whether there is a target control terminal in the target room; when it is determined that the target control terminal exists in the target room, pairing with the target control terminal is performed. The device in this article can be a server, PC, PAD, mobile phone, etc.

[0180] The present application also provides a computer program product, which, when executed on a data processing device, is suitable for executing a program that is initialized with at least the following method steps: using millimeter wave detection technology to obtain object information in a target room, the above object information includes user body shape data, user hand data and hand-held object data, the above user body shape data, the above user hand data, and the above hand-held object data respectively represent the position and shape of the user's body shape, the user's hand, and the user's hand-held object; using neural network model technology to at least process the above object information to determine whether there is a target control terminal in the above target room; when it is determined that the above target control terminal exists in the above target room, pairing with the above target control terminal is performed.

[0181] The present application also provides a pairing system for smart home devices and control terminals, the system comprising: smart home devices and control terminals, the smart home devices are used to communicate with the control terminals, and the smart home devices are also used to execute any of the above methods. By using millimeter wave detection technology to obtain user body shape data, user hand data, and hand-held object data in the target room, and using neural network model technology to process these data, it is determined whether there is a target control terminal in the target room. Compared with the existing solution, the wireless communication pairing of smart home devices and control terminals is more targeted, so that the pairing results meet the user's expectations, thereby solving the problem that the wireless communication pairing of smart home devices and control terminals in the existing solution is less targeted, resulting in the pairing results not meeting the user's expectations.

[0182] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order than here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0183] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0184] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0185] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0186] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0187] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0188] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0189] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0190] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0191] From the above description, it can be seen that the above embodiments of the present application achieve the following technical effects:

[0192] 1) The pairing method of the smart home device and the control terminal of the present application adopts millimeter wave detection technology to obtain the user's body shape data, user hand data and hand holding data in the target room, and uses neural network model technology to process these data to determine whether there is a target control terminal in the above target room. Compared with the existing solution, the wireless communication pairing of the smart home device and the control terminal is more targeted, so that the pairing result meets the user's expectations, thereby solving the problem that the wireless communication pairing of the smart home device and the control terminal in the existing solution is poorly targeted, resulting in the pairing result not meeting the user's expectations.

[0193] 2) The smart home device of the present application adopts millimeter wave detection technology to obtain the user's body shape data, user hand data and hand holding data in the target room, and uses neural network model technology to process these data to determine whether there is a target control terminal in the above-mentioned target room. Compared with the existing solution, the targeted pairing of the wireless communication between the smart home device and the control terminal is improved, so that the pairing result meets the user's expectations, thereby solving the problem that the wireless communication pairing between the smart home device and the control terminal in the existing solution is poorly targeted, resulting in the pairing result not meeting the user's expectations.

[0194] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A method for pairing a smart home device and a control terminal, characterized in that: include: Using millimeter wave detection technology to obtain object information in the target room, the object information includes user body shape data, user hand data and hand-held object data, the user body shape data, the user hand data and the hand-held object data respectively represent the position and shape of the user body shape, the user hand and the user hand-held object; Using a neural network model technology to at least process the object information to determine whether a target control terminal exists in the target room; When it is determined that the target control terminal exists in the target room, pairing is performed with the target control terminal.

2. The method according to claim 1, characterized in that Using a neural network model technology to at least process the object information to determine whether a target control terminal exists in the target room includes: The millimeter wave detection technology is used to determine whether a preset condition is met, and the preset condition indicates that the user's finger is performing a pressing action; In the case where it is determined that the preset condition is met, determining that the target control terminal exists in the target room; When it is determined that the preset condition is not satisfied, it is determined that the target control terminal does not exist in the target room.

3. The method according to claim 1, characterized in that Pairing with the target control terminal includes: Receiving a target unique identifier sent by the target control terminal; Based on the target unique identifier, a corresponding wireless communication protocol is used to pair with the target control terminal.

4. The method according to claim 3, characterized in that After pairing with the target control terminal, the method further includes: Determining a pairing method includes a mapping relationship between the target unique identifier and a corresponding wireless communication protocol; The pairing method is stored in a database.

5. The method according to claim 1, characterized in that: Using a neural network model technology to at least process the object information to determine whether a target control terminal exists in the target room includes: When the wireless communication mode of the target control terminal is WIFI communication, obtaining the current WIFI strength; The object information and the current WIFI strength are processed using a neural network model technology to determine whether a target control terminal exists in the target room.

6. The method according to claim 1, characterized in that Using a neural network model technology to at least process the object information to determine whether a target control terminal exists in the target room includes: When the wireless communication mode of the target control terminal is WIFI communication, obtaining the current WIFI strength and the current signal direction; The object information, the current WIFI strength and the current signal direction are processed using a neural network model technology to determine whether a target control terminal exists in the target room.

7. The method according to any one of claims 1 to 6, characterized in that After pairing with the target control terminal, the method further includes: When it is determined that the user in the target room no longer holds the target control terminal, the millimeter wave detection technology is used to determine multiple times whether a preset condition is satisfied to obtain a determination result, wherein the determination result indicates the number of times the preset condition is satisfied, and the preset condition indicates that the user's finger is performing a pressing action; When the number of determination results is greater than or equal to a preset number of times, maintaining the matching state with the target control terminal; When the number of the determination results is less than the preset number, the matching state with the target control terminal is exited.

8. A smart home device, characterized in that: include: a first processing unit, configured to acquire object information in a target room by using a millimeter wave detection technology, wherein the object information includes user body shape data, user hand data, and hand-held object data, wherein the user body shape data, the user hand data, and the hand-held object data respectively represent the position and shape of the user body shape, the user hand, and the hand-held object; A second processing unit is used to process at least the object information using a neural network model technology to determine whether a target control terminal exists in the target room; The third processing unit is configured to pair with the target control terminal when it is determined that the target control terminal exists in the target room.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 7.

10. A pairing system for smart home devices and control terminals, characterized in that: include: A smart home device and a control terminal, wherein the smart home device is used to establish a communication connection with the control terminal, and the smart home device is also used to execute the method described in any one of claims 1 to 7.

Images