A context panel control method and apparatus based on fingerprint recognition

Abstract

The application discloses a scene panel control method and device based on fingerprint identification and belongs to the field of Internet of Things control. In view of the problems of high cost and complex design of the existing scene panel in the prior art, the application provides a scene panel control method and device based on fingerprint identification, which performs fingerprint identification on a user, and otherwise, scene information is sent to a gateway according to a default scene; when the fingerprint identification is performed, the scene panel queries the fingerprint information from a database, and if the fingerprint information does not exist, no action is performed, and if the fingerprint information exists, scene information corresponding to the fingerprint is displayed on the scene panel; at this time, a key of the scene panel is pressed to send a trigger instruction, the trigger instruction sends the scene information corresponding to the fingerprint information to an Internet of Things gateway, and the Internet of Things gateway triggers a scene. The application can realize setting of multiple scenes at a lower cost, is simple to operate and has good stability.

Description

Technical Field

[0001] This invention relates to the field of Internet of Things (IoT) control, and more specifically, to a fingerprint-based scene panel control method and device. Background Technology

[0002] Existing scene panels are divided into button-type scene panels and touchscreen-type scene panels. Button-type scene panels control scenes using physical buttons. These panels are relatively inexpensive. However, since the physical buttons are unlabeled, it can be confusing to identify which button controls which scene when there are multiple buttons on the panel. Furthermore, the number of scenes that can be configured on this type of panel cannot exceed the number of physical buttons; adding additional scenes requires adding more scene panels. Touchscreen-type scene panels, on the other hand, are more expensive and less convenient to operate than physical buttons.

[0003] For example, the invention patent CN216351857U, concerning a smart scene panel controller, only relates to the field of smart switch technology, specifically a smart scene panel controller; it optimizes the control of the scene panel but does not integrate fingerprint recognition with it. The invention patent CN113011215A, concerning a fingerprint recognition panel and its control method, describes an optical fingerprint implementation method and principle, but does not involve scene panel-related equipment. In summary, existing scene panels are either complex or excessively expensive. For scenarios with cost constraints, it is difficult to find suitable methods and equipment. Summary of the Invention

[0004] 1. Technical problems to be solved

[0005] To address the issues of high cost and complex design of existing scene panels, this invention provides a fingerprint recognition-based scene panel control method and device. This method enables the setting of multiple scenes at a lower cost, is simple to operate, and has good stability.

[0006] 2. Technical Solution

[0007] The objective of this invention is achieved through the following technical solutions.

[0008] A fingerprint recognition-based scene panel control method comprises the following steps:

[0009] The user is identified by fingerprint; otherwise, context information is sent to the gateway according to the default scenario.

[0010] When fingerprint recognition is performed, the scene panel queries the database for the fingerprint information. If the information is not found, no action is taken. If the information is found, the scene information for the fingerprint is displayed on the scene panel.

[0011] Pressing the scene panel button at this time will send a trigger command, which will send the scene message corresponding to the fingerprint information to the IoT gateway, and the IoT gateway will trigger the scene.

[0012] Furthermore, when the IoT gateway triggers a scenario, pressing the scenario button will restore the scenario panel to the default scenario state.

[0013] Furthermore, if the scene button is not pressed after successful fingerprint recognition, the scene panel will trigger a built-in timed task, which will force the scene panel to update to the default state after a period of time.

[0014] Furthermore, before recognition, there is also a fingerprint enrollment and scene binding process. The gateway sends a message to enable fingerprint enrollment on the scene panel via the network. At this time, the scene panel will open the fingerprint enrollment function of the fingerprint recognition module. During this period, the user enrolls his fingerprint into the scene panel. After successful enrollment, the scene panel stores the fingerprint information in the scene panel. The scene panel contains a fingerprint table and a scene table. The number of scene button fields is the same as the actual buttons on the device.

[0015] The gateway sends two commands to the scene panel to obtain fingerprint information and scene information. The gateway sends commands to perform add, delete and modify operations on the scene table of the scene panel, and bind a scene to each button; select the corresponding fingerprint to bind to the scene, bind the scene ID in the scene table to the scene ID field of the fingerprint table, and match the fingerprint with the scene. One fingerprint corresponds to a set of scenes, and a set of scenes is bound by multiple fingerprints.

[0016] Furthermore, it also includes setting default commands to configure default scenarios, which are triggered when a scenario button is pressed in a state where fingerprint recognition is not available.

[0017] A device based on the above-described fingerprint recognition scene panel control method includes a scene panel, which comprises the following modules: a central processing unit, a wireless communication module, physical buttons, a fingerprint recognition module, and a display module. The central processing unit receives and processes information from the physical buttons and the fingerprint recognition module, displays it through the display module, and performs communication control through the wireless communication module. The wireless communication module sends signals to an Internet of Things (IoT) gateway and receives signals sent from the IoT gateway.

[0018] Furthermore, the physical buttons are used to control the scene, and the corresponding physical buttons are set as scene buttons, excluding page turning buttons; the display module only displays text and is not touch-sensitive, and is used to identify the scene of the IoT button to distinguish the function of each button; the fingerprint recognition module confirms the identity of the user of the scene panel; the IoT gateway controls the entire IoT device, and the central processing unit is used to perform related logical operations and operation control on the scene panel.

[0019] Furthermore, it also includes an IoT control system, which includes branch equipment, edge gateways, and an IoT management and control platform; the branch equipment connects to the edge gateway host via communication, and the IoT management and control platform displays the branch equipment data.

[0020] Furthermore, the network equipment includes a monitoring terminal, an execution terminal, and a control terminal. The monitoring terminal collects sensor data and is connected to multiple different sensors simultaneously. The node master controller processes the sensor data and assembles it according to the protocol, and then sends the data to the edge gateway according to the designed protocol.

[0021] The execution terminal is used to perform device operations, detect the execution of feedback instructions from the terminal, or control the execution of control instructions from the terminal.

[0022] A control terminal is a device used for human-machine interaction. It sends control commands to the Internet of Things (IoT) control system, and then the edge gateway controls the corresponding device of the execution terminal to perform operations, including one or more of the following: opening and closing windows, turning off lights, turning on fans, and turning on air conditioners.

[0023] Furthermore, the execution terminal is one or more of the following: curtain controller, fan, door lock controller, roller blind motor, dimming module, and socket.

[0024] 3. Beneficial effects

[0025] Compared with the prior art, the advantages of this invention are:

[0026] This solution is specifically designed for scenario control systems with strict cost constraints. Using physical buttons for scenario control is more convenient than touchscreens. By replacing fragile screens with physical buttons, security and reliability are improved. Scenario panels with touchscreens are generally expensive. The scenario panel described in this method only adds a fingerprint recognition module and a small display screen compared to ordinary button-based panels. Compared to traditional button-based panels, the scenario panel described in this method can set more scenarios. Assuming the panel has n scenario buttons and x fingerprint records, theoretically, n*x scenarios can be set without a default scenario, and n*(x+1) scenarios can be set after setting a default scenario. This allows for the control and selection of multiple scenarios at a low cost, making it particularly suitable for IoT control in large venues. Attached Figure Description

[0027] Figure 1 This is a schematic diagram of the overall structure of the scene panel of the present invention;

[0028] Figure 2 Flowchart for configuring fingerprint scenarios on the scenario panel;

[0029] Figure 3 This is a schematic diagram of the scenario panel control process;

[0030] Figure 4 This is a diagram illustrating the message flow in the scenario panel. Detailed Implementation

[0031] The present invention will now be described in detail with reference to the accompanying drawings and specific embodiments.

[0032] Example 1

[0033] The scenario panel described in this patent is an Internet of Things (IoT) control device used to control other IoT devices, configure multiple IoT devices into a scenario, and control multiple IoT devices simultaneously through a single button on the scenario panel.

[0034] This solution is suitable for applications with high cost constraints. Unlike large screens or highly integrated panels, this solution uses small screens, such as those displaying only text, digital tubes, or indicator lights. The screen size may be similar to or smaller than the button width, integrated onto each button. For example, a 6-button scene panel would have 6 small screens displaying only text, indicating the scene for each button. The significance of adding screens lies in the fact that traditional button-based scene panels, like in-wall switches, lack any text prompts. Triggering a scene relies entirely on memory or pressing buttons one by one. Small screen prompts allow for more accurate triggering of the desired scene. This solution is limited to applications with strict cost requirements because our solution provides sufficient functionality for users and is cost-effective, offering excellent commercial prospects.

[0035] The scenario panel described in this invention is applicable to IoT control systems. The IoT control system consists of point-of-sale (POS) devices, edge gateways, and an IoT control platform. POS devices connect to the edge gateway host via ZIBGEE, and the IoT control platform displays POS device data, such as environmental monitoring, fire alarms, power monitoring, pedestrian detection, and equipment control. The scenario panel is proposed under the premise of a complete set of IoT devices and systems. Typically, a complete IoT device includes a gateway and terminal devices (lights, switches, etc.). The scenarios described are formed by combinations of different actions of the terminal devices. Communication between us and the terminal devices is through the gateway. The methods described in this patent are all about configuring the gateway, and only the methods are described. The specific configuration interface can be a mobile app or a PC webpage. POS devices are generally monitoring terminals, execution terminals, and control terminals. Monitoring terminals collect various sensor data, such as smoke detectors, temperature and humidity sensors, water immersion sensors, door and window sensors, and light sensors. These sensor acquisition interfaces include ADC, I2C, SPI, and UART interfaces. The monitoring terminal can be connected to multiple different sensors simultaneously. The node master controller processes these values ​​and assembles them according to a certain protocol. Then, according to the designed protocol, the data is sent to the edge gateway via LoRa / ZIGBEE.

[0036] An execution terminal is used to perform equipment operations, detect the execution of feedback commands from the terminal, or control the execution of control commands from the terminal. Execution terminals include curtain controllers, fans, door lock controllers, roller blind motors, dimming modules, sockets, etc. When the temperature is high, the fan turns on; when the temperature is low, the cooler turns on; when the light is low, the lights turn on or the curtains open; when the light is high, the lights turn off and the curtains close; to prevent electric shock, the air circuit breaker automatically cuts off the power; in the event of a fire, the fire alarm sounds and the fire hydrant nozzles open.

[0037] The control terminal is a device used for human-computer interaction, such as a lobby manager's tablet, a voice recognition device, a server robot, or a multi-screen display. Users converse with the robot, which issues control commands to the IoT control system via voice chat. The edge gateway then controls the corresponding devices on the execution terminal to perform operations such as opening and closing windows, turning off lights, turning on fans, and turning on air conditioning.

[0038] The scenario panel described in this patent is mainly for interaction with the execution terminal. It sends scenarios to the gateway via buttons, and the gateway then performs corresponding operations on the execution terminal.

[0039] Specifically, the scene panel described in this method mainly includes the following modules: central processing unit, wireless communication module, physical buttons, fingerprint recognition module, and display module. (See attached image) Figure 1 A schematic diagram of the overall structure of the scene panel is shown. The scene panel shown (a 6-key scene panel) has a fingerprint recognition module on the left for fingerprint recognition, a display module above for displaying the scene name for each key, and physical scene keys below. This scene panel is wall-mounted and powered by live and neutral wires. The specific design can be adjusted according to requirements, as long as fingerprint recognition, keypad, display, and communication are supported. An IoT gateway is also included for use with the scene panel. The physical keys are used to control the scenes, and the number of physical keys can vary. These physical keys are also designated as scene keys, excluding page-turning buttons. This is because the screen is small, only displays text, and is not touch-sensitive. Page turning would require additional page-turning buttons or combinations of scene key presses, increasing operational complexity and potentially limiting the number of scene keys available, leading to insufficient control.

[0040] The fingerprint recognition module verifies the user's identity on the scene panel. The display module identifies the scene of each IoT button, distinguishing its function. The IoT gateway controls the entire IoT device; all fingerprint and scene information from the scene panel is stored there. The central processing unit (CPU) performs related logic operations and controls on the scene panel. The CPU receives and processes information from the physical buttons and fingerprint recognition module, displays it on the display module, and performs corresponding communication control via the wireless communication module. The wireless communication module can send signals to and receive signals from the IoT gateway via LoRa and ZigBee.

[0041] The environment and communication principles required for this invention:

[0042] The scenario panel and IoT devices described in this invention communicate with the IoT gateway via ZigBee. ZigBee is widely used in the IoT field due to its low cost, large network capacity (up to 65,000 devices), low power consumption, and low latency. The networking methods for the IoT gateway and IoT devices described in this method are as follows: Star topology: The IoT gateway is the central node, and each IoT device communicates directly with the gateway via ZigBee. Its advantage is fast message sending and receiving speed. However, since all devices communicate directly with the gateway, it places high demands on the gateway's performance, such as message processing speed, storage capacity, and signal strength. Cluster topology: The gateway is the central parent node, and IoT devices (with relay routing capabilities) are descendant nodes. In this case, message sending and receiving are forwarded through IoT devices (with relay routing capabilities), reducing the number of devices directly connected to the gateway and increasing the dedicated signal range. Mesh networking uses a gateway as the central node and IoT devices (with relay routing capabilities) as routing devices. When devices join the network, they form a mesh structure themselves. Through dynamic networking, the location relationships and distances between them are analyzed, and then a path is selected for data transmission.

[0043] Of course, we can also choose a suitable communication method for communication control. Through the corresponding IoT gateway, we can control the corresponding devices to achieve IoT control and scenario control.

[0044] The specific implementation steps of this invention are as follows: Figure 2 , 3 As shown in Figure 4.

[0045] The gateway sends a message to activate fingerprint enrollment on the scene panel via the ZigBee network. At this time, the scene panel will enable fingerprint enrollment via its fingerprint recognition module, allowing the user to enroll their fingerprint in the scene panel. Fingerprint settings are configured through the app or PC-based backend system, and are generally intended for staff or backend personnel.

[0046] After successful enrollment, the fingerprint information is stored in the scene panel. The scene panel contains a fingerprint table (fingerprint information, fingerprint name, scene ID corresponding to the fingerprint) to store the user's fingerprint information, where fingerprint information is the primary key; there is also a scene table (scene ID, scene button 1, scene button 2, ...), where scene ID is the primary key, the number of "scene button" fields is the same as the actual number of buttons on the device (e.g., if there are 6 scene buttons, then there are 6 scene button fields), and scene ID is a foreign key for fingerprint information, used to distinguish a group of scenes. Each scene button field corresponds to the scene information of that button.

[0047] The gateway can send two commands to the scene panel to retrieve fingerprint and scene information: SCENE_SELECT and FINGERPRINT_SELECT. SCENE_SELECT returns all scene information in the scene table. We can use the gateway to send the SCENE_CHANGE command to add, delete, and modify scenes in the scene panel's scene table, binding each button to a scene. The FINGERPRINT_SELECT command returns all entered fingerprint information. The FINGERPRINT_CHANGE command can add, delete, and modify fingerprints in the scene panel's fingerprint table. We can select a corresponding fingerprint to bind to a scene, that is, bind the scene ID in the scene table to the scene ID field of the fingerprint table. This allows us to associate fingerprints with scenes; one fingerprint corresponds to one set of scenes, and one set of scenes can be bound to multiple fingerprints. The scene table has a scene ID attribute. Users can add scene groups. A scene group can bind a maximum number of scenes corresponding to the scene panel buttons, and there is a one-to-one correspondence between scenes and buttons. One scene group corresponds to one scene ID, which corresponds to one record in the scene table. The number of scene attributes corresponding to each record (row) in the scene table is the same as the number of scene panel buttons. After fingerprint registration, the fingerprint is bound to a scene group. My fingerprint is then associated with all the scenes in that group. Fingerprint verification maps the corresponding scene to a button on the scene panel. This means that each fingerprint recognition session corresponds to a different scene. Theoretically, n scenes can be created, and these n scenes can be combined to generate m scene groups. Each fingerprint is bound to one scene group. Since each person has 10 fingers (10 fingerprints), each person can access 10 * the number of scene panel buttons. Therefore, we need to select the corresponding scene by using the corresponding finger and button.

[0048] Sending the FINGERPRINT_SELECT command returns a default fingerprint, which is used to configure the default scenario—the scenario triggered when the scenario button is pressed without fingerprint recognition. After setting the default scenario, the scenario can be triggered even without fingerprint recognition, but only the scenario number corresponding to the scenario panel buttons can be triggered. This function can be set up in public places to allow others to trigger scenarios. If you don't want others to trigger scenarios, you can disable the default scenario; in this case, pressing the scenario panel will have no effect unless staff members perform fingerprint recognition to trigger the scenario. In practical use, in public places, the only difference is whether or not others can trigger the scenario. Ordinary scenario panels can be pressed by anyone unless installed in a location inaccessible to outsiders, which places requirements on installation location and is sometimes inconvenient for staff operation. The scenario panel described in this method has no requirements on installation location; even if installed in a crowded place, the scenario will not be triggered without a fingerprint.

[0049] When in use, the user's fingerprint is first recognized. Otherwise, the default scenario information is sent to the gateway. During fingerprint recognition, the scenario panel will query the database for the fingerprint information. If it is not found, no action is taken. If it is found, the scenario information of the fingerprint is displayed on the scenario panel. At this time, pressing the scenario panel button will send a SCENE command, which will send the scenario message corresponding to the fingerprint information to the IoT gateway. The IoT gateway will trigger the scenario. In this state, pressing the scenario button will restore the scenario panel to the default scenario state. If the scenario button is not pressed after successful fingerprint recognition, the scenario panel will trigger a built-in timed task, which will force the scenario panel state to be updated to the default state after a period of time.

[0050] In practice, you typically configure the scene first, then add a set of button scenes (adding data to the scene table). This set of button scenes is designed to bind a scene to each button. For example, a six-button scene panel can bind a scene to each button. After adding a set of button scenes, select an entered fingerprint and bind the fingerprint to the set of button scenes (modifying the scene ID field in the fingerprint table). This completes the binding of the fingerprint and the scene button. If the scene panel is not pressed after successful fingerprint verification, it will revert to the default scene state after a period of time.

[0051] This solution is specifically designed for scene control systems with strict cost constraints. Using physical buttons for scene control is more convenient than touchscreens. By replacing fragile screens with physical buttons, security and reliability are improved. Scene panels with touchscreens are generally expensive. The scene panel described in this method only adds a fingerprint recognition module and a small display screen compared to ordinary button-based scene panels. Compared to traditional button-based scene panels, the scene panel described in this method can set more scenes. Assuming the scene panel has n scene buttons and x fingerprints, theoretically, n*x scenes can be set without a default scene, and n*(x+1) scenes can be set after setting a default scene. This allows for the control and selection of multiple scenes at a low cost, making it particularly suitable for IoT control in large venues. Furthermore, in traditional button-based systems, each scene's corresponding button is unlabeled, making it difficult to distinguish which scene each button controls. The scene panel described in this method adds a display module to identify the scene controlled by each button.

[0052] The invention and its embodiments have been described above illustratively. This description is not restrictive, and the invention can be implemented in other specific forms without departing from its spirit or essential characteristics. The accompanying drawings are only one embodiment of the invention, and the actual structure is not limited thereto. No reference numerals in the claims should limit the scope of the claims. Therefore, if a person skilled in the art is inspired by this description and designs a similar structure and embodiment without departing from the spirit of the invention, such design should fall within the scope of protection of this patent. Furthermore, the word "comprising" does not exclude other elements or steps, and the word "a" preceding an element does not exclude the inclusion of "a plurality" of that element. Multiple elements stated in the product claims may also be implemented by a single element through software or hardware. The terms "first," "second," etc., are used to indicate names and do not indicate any specific order.

Claims

1. A scene panel control method based on fingerprint identification, the steps are as follows, Fingerprint identification is performed on the user, and the fingerprint has the dual functions of identity authentication and scene group selection. When fingerprint identification is not performed or fingerprint identification is not matched, scene information is sent to the gateway according to a default scene; When fingerprint identification is performed, the scene panel queries the fingerprint information from a database, the database includes a fingerprint table and a scene table, the fingerprint table includes fingerprint information, a fingerprint name and a scene ID field, the scene table includes a scene ID field and a scene key field with the same number of actual keys of the device, and the scene ID of the scene table is a foreign key of the scene ID of the fingerprint table; if the fingerprint information is not queried, no action is performed, and if the fingerprint information is queried, scene information text in a scene group bound by the fingerprint is displayed on the scene panel; the scene panel is a non-touch screen scene panel; At this time, pressing a scene panel key sends a trigger instruction, the instruction sends scene information corresponding to the fingerprint information to an Internet of Things gateway, and the Internet of Things gateway triggers a corresponding scene in a scene group bound by the fingerprint; Before identification, a fingerprint input and scene binding process is further included, the gateway sends a scene panel fingerprint input opening message through a network, at this time, the scene panel opens a fingerprint input function of a fingerprint identification module, and during the period, a user inputs his own fingerprint into the scene panel; After successful input, the scene panel stores the fingerprint information in the scene panel; The gateway sends two instructions SCENE_SELECT and FINGERPRINT_SELECT to the scene panel to obtain fingerprint information and scene information, sends a SCENE_CHANGE instruction through the gateway to perform addition, deletion and modification operations on the scene table of the scene panel, binds scenes to each key, sends a FINGERPRINT_CHANGE instruction through the gateway to select a corresponding fingerprint to bind scenes, binds scene IDs in the scene table to the scene ID field of the fingerprint table, and corresponds the fingerprint to the scenes, one fingerprint corresponds to a group of scenes, and a group of scenes is bound by multiple fingerprints; A default instruction is further included, which is used for configuring a default scene, and is configured as a scene triggered by pressing a scene key in a state without fingerprint identification. 2.The scenario panel control method based on fingerprint identification according to claim 1, characterized in that, In a state in which the Internet of Things gateway triggers a scene, after pressing a scene key, the scene panel is restored to a default scene state again.

3. The method according to claim 1 or 2, characterized in that, If the fingerprint identification is successful and the scene key is not pressed, the scene panel triggers a built-in timing task, and after a period of time, the state of the scene panel is forcibly updated to a default state.

4. A device for context panel control based on the method of fingerprinting according to any of claims 1-3, characterized in that, The scene panel includes the following modules: a central processor, a wireless communication module, physical keys, a fingerprint identification module and a display module, the central processor receives information of the physical keys and the fingerprint identification module, processes the information, displays the information through the display module, and controls communication through the wireless communication module, and the wireless communication module sends signals to an Internet of Things gateway and receives signals sent by the Internet of Things gateway. 5.The apparatus of claim 4, wherein, The physical key is used for controlling the scene, the corresponding physical key is set as a scene key, and a page turning key is not included; the display module only displays text and cannot be touched, and is used for identifying the scene of the Internet of Things key and distinguishing the function of each key; the fingerprint identification module confirms the identity of the user of the scene panel; the Internet of Things gateway controls the entire Internet of Things device, and the central processor is used for logical operation and operation control of the scene panel.

6. The apparatus of claim 4 or 5, wherein, Also includes an Internet of Things control system, the Internet of Things control system includes a network point device, an edge gateway and an Internet of Things management and control platform; the network point device accesses the edge gateway host through communication, and the network point device data is displayed by the Internet of Things management and control platform.

7. The apparatus of claim 6, wherein, The network point device includes a monitoring terminal, an execution terminal and a control terminal, the monitoring terminal realizes collection of sensing data, and is connected with multiple different sensors at the same time, the sensing data is processed by a node host, and is assembled according to a protocol, and then the data is sent to the edge gateway according to the designed protocol; The execution terminal is used for executing device operation, and is used for detecting the execution of the feedback instruction of the terminal or controlling the execution of the control instruction of the control terminal; The control terminal is a device for human-computer interaction, gives a control instruction to the Internet of Things control system, and then the corresponding device of the execution terminal is controlled by the edge gateway to execute operation, including one or more of opening a window, turning off a lamp, turning on a fan and turning on an air conditioner. 8.The apparatus of claim 7, wherein, The execution terminal is one or more of a curtain controller, a fan, a door lock controller, a roller shutter motor, a dimming module and a socket.

Images