Intelligent all-scene central control system and control method

Through the intelligent full-scenario central control system, the operation process of IoT devices is simplified by using light spot recognition and frequency control, which solves the problems of complex operation and high learning cost in existing technologies, and realizes fast and accurate device control and user-friendly experience.

CN117130313BActive Publication Date: 2026-06-26HARBIN ENG UNIV

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
HARBIN ENG UNIV
Filing Date
2023-09-20
Publication Date
2026-06-26

AI Technical Summary

Technical Problem

Existing IoT products are complex to operate, require multiple apps for control, have high learning costs, and are especially unsuitable for the elderly and children. Furthermore, the wide variety of devices makes mobile phone operation inconvenient.

Method used

It adopts an intelligent full-scene central control system, including a main control system and a handheld controllable flashing light device. The device is operated through light spot recognition and frequency control. Combined with a multi-core CPU and wireless communication module, the human-machine interface is simplified.

Benefits of technology

It enables fast and precise equipment control, reduces learning costs, and is suitable for various smart ecosystem scenarios, especially smart homes and smart workshops, improving ease of operation and user-friendly experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117130313B_ABST
    Figure CN117130313B_ABST
Patent Text Reader

Abstract

The application belongs to the technical field of embedded technology and the technical field of small target recognition and tracking, and particularly relates to an intelligent full-scene central control system and a control method, which comprises a main control system and a handheld controllable flashing light emitting device, the handheld controllable flashing light emitting device is an external holding device for user operation; the main control system comprises a case shell, a central processing module, an image acquisition module, a weak and small target recognition module, a target tracking projection module, a first wireless communication module and a power supply module, the image acquisition module, the weak and small target recognition module, the target tracking projection module, the first wireless communication module and the power supply module are all connected to the central processing module, and the handheld controllable flashing light emitting device comprises a light source switch, a second wireless communication module and a flashing frequency control module. The application provides an intelligent full-scene central control system and a control method which are simple to use, accurate and fast to control, low in learning cost, good in compatibility and capable of adapting to most complex scenes, so as to overcome the shortcomings of the prior art and provide a new solution for the construction of an Internet of Things intelligent ecological scene.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention belongs to the fields of embedded technology and small target recognition and tracking technology, specifically relating to an intelligent full-scene central control system and control method. Background Technology

[0002] With the rapid development of IoT technology, smart home, smart factory and other smart ecosystem application scenarios are becoming more diversified and complete, and are developing rapidly. All kinds of IoT products are emerging, greatly enriching and facilitating people's lives and changing their lifestyles.

[0003] However, some problems still exist in the current intelligent ecosystem:

[0004] First, most IoT products cannot be operated and used without the support of mobile terminals, so they cannot be truly convenient.

[0005] Secondly, in most smart ecosystem scenarios, a large number of IoT devices are connected. Different companies' products often require us to download different apps for control. Even with products from the same company, the operation can be extremely complicated when faced with a large number of IoT devices to choose from and control.

[0006] Third, the learning curve for existing IoT devices remains high, making them unfriendly to the elderly and children. Summary of the Invention

[0007] The purpose of this invention is to provide an intelligent full-scenario central control system and control method, which is simple to use, provides precise and fast control, has low learning cost, good compatibility, and can be adapted to most complex scenarios, so as to overcome the shortcomings of the prior art and provide a new solution for the construction of IoT intelligent ecosystem scenarios.

[0008] The specific technical solution adopted by this invention is as follows:

[0009] A smart full-scene central control system and control method includes a main control system and a handheld controllable flashing light device, wherein the handheld controllable flashing light device is an external device for user operation;

[0010] The main control system includes a chassis shell, a central processing module, an image acquisition module, a weak target recognition module, a target tracking and projection module, a first wireless communication module, and a power supply module. The image acquisition module, the weak target recognition module, the target tracking and projection module, the first wireless communication module, and the power supply module are all connected to the central processing module. The central processing module can communicate and control other IoT devices in the scene through the wireless communication module.

[0011] The handheld controllable flashing light device primarily functions to emit a fine beam of light to form a light spot at a distance. The device is compact and simple in function. It features three buttons on the outside: one button switches the light beam emission on and off, while the other two buttons control the light to flash at different frequencies to indicate confirmation and cancellation commands. The device includes a light source switch, a second wireless communication module, and a flashing frequency control module, allowing for the setting of various flashing frequencies according to specific needs. When the beam switch is turned on, the device sends a command to the main control system via the second wireless communication module, activating the dormant image acquisition module. This device can consist of a light source switch capable of accurately generating a fine light spot at a long distance (such as a high-power light source or laser light source), a wireless communication module capable of sending commands to the main control system, and a flashing frequency control module.

[0012] The central processing module can use a motherboard based on a multi-core high-speed CPU chip, or a motherboard based on an embedded processor chip with an integrated operating system. It includes storage components such as SD cards and computing units such as DSPs, enabling control and operation of the entire system.

[0013] The human-machine interface can be directly sent from the IoT device to the central processing module for storage and retrieval, or it can be automatically generated by the central processing module according to the adjustable parameters of the IoT device and a template. If the connected IoT device is a light, and only the on / off state needs to be controlled, the user interface can be simplified to a single on / off button. If the brightness also needs to be controlled, the user interface will display the current brightness and controls to increase or decrease the brightness, allowing the user to perform the corresponding operations as needed.

[0014] The image acquisition module can employ a visible light camera or an infrared camera to acquire images in the smart ecosystem application scenario. It can use one or more cameras, requiring a sufficiently large imaging range to capture image information of all IoT devices within the space. Alternatively, a CNC three-dimensional rotating structure can be used to scan the entire environment and acquire image data upon receiving a command.

[0015] The weak target recognition module can be implemented using a high-performance FPGA chip-based motherboard or a heterogeneous development platform such as ZYNQ to ensure real-time image recognition. Alternatively, it can be implemented directly using CPU, DSP, or other modules to implement the algorithm. The weak target recognition algorithm mainly involves preprocessing, segmenting, and recognizing image information. By analyzing local grayscale values ​​and gradients, the position of the light spot is located. Simultaneously, this module analyzes the flickering frequency of the light spot based on the image acquisition frame rate and transmits this necessary information to the central processing module.

[0016] The target tracking projection module adopts a CNC three-dimensional four-axis structure and a projection device, enabling the projection device to project omnidirectionally within the intelligent ecological scene. The CNC three-dimensional four-axis structure includes a first axis, a second axis, an outer ring, and a third axis. The inner ring is fixed to the lower surface of the chassis shell via the first axis. The outer ring is connected to the support shaft via the second axis. The outer ring is fixed to the projection device on its tangential plane via the third axis. The projection device achieves 180-degree angle control within the plane via the fourth axis, allowing the projection device to rotate freely within a certain angle within the tangential plane. The combination of these features enables omnidirectional projection. The specific rotation angles of the four axes are calculated by the central processing module and controlled by sending commands.

[0017] The first wireless communication module includes technologies such as Bluetooth communication module and WIFI communication module. Both the Bluetooth communication module and the WIFI communication module are connected to the IoT device and the control system to ensure that the IoT device and the control system can achieve interconnection and communication.

[0018] A smart, full-scene central control method, the control method comprising the following steps:

[0019] Step S1, System Startup: The user installs the new IoT device at a specific location in the smart ecosystem scenario. The IoT device sends its basic information to the main control system of this invention through wireless communication technology. The main control system processes and stores the corresponding information to achieve initialization.

[0020] Step S2: Create a database: The main control system adds the location information of the IoT devices in the area to the regional database for easy access at any time;

[0021] Step S3, Production Interface: The main control system generates a human-machine interface based on the adjustable parameters of the IoT devices;

[0022] Step S4, Signal Identification: When a user wants to control the IoT device, they only need to use a handheld controllable flashing light device to emit a beam of light and place the light spot on the device's location. The main control system will automatically identify the location of the light spot through the weak target identification module.

[0023] Step S5, Human-computer interaction: The human-computer interaction interface is projected onto the corresponding area in real time. Then, the handheld controllable flashing light device is moved to control the flashing frequency of the light spot to achieve the functions of confirming and canceling. The parameters can be adjusted at specific positions on the human-computer interaction interface.

[0024] Step S6: Controlling the equipment: The main control system will automatically detect the interface function corresponding to the location of the light spot and the operation being performed by the user, so as to control the corresponding equipment.

[0025] The technical effects achieved by this invention are as follows:

[0026] This invention discloses an intelligent full-scene central control system. This intelligent control system replaces the currently widely used solution of controlling IoT devices via smartphone software. It avoids the inconvenience of searching and operating on a mobile phone due to the large number and variety of IoT devices. Instead, it can directly locate the target to be controlled and perform the required operations, leaving all other tasks to the machine. The more IoT devices connected, the more the advantages of this solution become apparent. This system is convenient, fast, and has a low learning cost, making the operating experience more suitable for people's daily habits, and is more user-friendly and intelligent.

[0027] This invention discloses an intelligent full-scene central control system, suitable for various intelligent ecosystem application scenarios, such as smart homes, smart factories, and many other intelligent ecosystem applications. The market is broad and the prospects are promising.

[0028] This invention provides a weak target recognition algorithm that ensures the module can identify target information in real time and accurately. Furthermore, it can operate stably in various complex environments, guaranteeing the effective communication of user needs.

[0029] The target tracking projection module of this invention adopts a CNC three-dimensional rotating shaft structure, enabling the projection device to project omnidirectionally within a smart ecological scene. This module can project in real time onto the area corresponding to the target, and, in combination with other modules, achieves real-time and precise command control. Attached Figure Description

[0030] Figure 1 This is a schematic diagram illustrating the principle of the present invention.

[0031] Figure 2 This is a schematic diagram of the central processing module of the present invention.

[0032] Figure 3 This is a schematic diagram of the main structure of the central control system of the present invention.

[0033] Figure 4 for Figure 4 A schematic diagram of the rear view structure.

[0034] Figure 5 for Figure 4 A schematic diagram of the right-side structure.

[0035] Figure 6 for Figure 4 A top-view structural diagram.

[0036] Figure 7 This is a schematic diagram illustrating the principle of the control method of the present invention.

[0037] Figure 8This is a schematic diagram of the method flow of the control method of the present invention.

[0038] The attached diagram lists the components represented by each number as follows:

[0039] 1. Chassis shell; 2. Image acquisition module; 3. First rotating shaft; 4. Outer ring; 5. Third rotating shaft; 6. Projection device. Detailed Implementation

[0040] To make the objectives and advantages of this invention clearer, the invention will be specifically described below with reference to embodiments. It should be understood that the following text is merely used to describe one or more specific embodiments of the invention and does not strictly limit the scope of protection specifically claimed by the invention.

[0041] like Figure 1-6 As shown, an intelligent full-scene central control system includes a main control system and a handheld controllable flashing light device. The handheld controllable flashing light device is an external device for user operation.

[0042] The main control system includes a chassis shell 1, a central processing module, an image acquisition module 2, a weak target recognition module, a target tracking and projection module, a first wireless communication module, and a power supply module. The image acquisition module, the weak target recognition module, the target tracking and projection module, the first wireless communication module, and the power supply module are all connected to the central processing module. The central processing module can communicate and control other IoT devices in the scene through the wireless communication module.

[0043] The handheld controllable flashing light device primarily functions to emit a thin beam of light to form a light spot at a distance. The device is compact and simple in function, featuring three buttons: one to turn the beam emission on and off, and the other two to control the light's flashing frequency, indicating confirmation and cancellation commands. More flashing frequencies can be set according to specific needs. The handheld controllable flashing light device includes a light source switch, a second wireless communication module, and a flashing frequency control module. When the beam switch is turned on, the device sends a command to the main control system via wireless communication, activating the dormant image acquisition module. This device can consist of a high-power light source or laser light source capable of accurately producing a thin light spot at a long distance, a wireless communication module capable of sending commands to the main control system, and a flashing frequency control module.

[0044] like Figure 1 and Figure 2As shown, the central processing module (CPU) includes a computing unit, an information processing unit, and a storage unit. The CPU integrates a human-computer interaction system and a control unit, implemented using equipment capable of meeting computing and information processing requirements. The CPU can use a motherboard based on a multi-core high-speed CPU chip, or a motherboard based on an embedded processor chip with an integrated operating system. It includes storage components such as SD cards and computing units such as DSPs to control the entire system.

[0045] like Figure 2 and Figure 1 As shown, the human-computer interaction interface can be directly sent from IoT devices to the central processing module for storage and retrieval, or it can be automatically generated by the central processing module according to the adjustable parameters of the IoT devices and a template. If the connected IoT device is a light, and only the on / off state needs to be controlled, the user interface can be simplified to a single on / off button. If further control of the light's brightness is required, the user interface will display the current brightness and controls for increasing or decreasing the brightness, allowing the user to perform the corresponding operations as needed.

[0046] like Figure 3 , Figure 4 and Figure 5 As shown, the image acquisition module 2 can use a visible light camera or an infrared camera to acquire images in the smart ecosystem application scenario. It can employ one or more cameras, requiring the camera's imaging range to be large enough to capture image information of all IoT devices within the space. Alternatively, a CNC three-dimensional rotating structure can be used to scan the entire environment and acquire image data upon receiving a command.

[0047] like Figure 1 , Figure 5 and Figure 6 As shown, the weak target recognition module can be implemented using a high-performance FPGA chip-based motherboard or a heterogeneous development platform such as ZYNQ to ensure real-time image recognition. Alternatively, the algorithm can be implemented directly using modules such as CPU and DSP. The weak target recognition algorithm mainly involves preprocessing, segmenting, and recognizing image information. By analyzing local grayscale values ​​and gradients, the position of the light spot is located. This module also analyzes the flickering frequency of the light spot based on the image acquisition frame rate and transmits the necessary information to the central processing module.

[0048] Among them, the weak target recognition module combines a weak target recognition algorithm to ensure that the module can identify target information in real time and accurately, and can work stably in various complex environments, ensuring the effective communication of user needs.

[0049] like Figure 3 , Figure 4 and Figure 5 As shown, the target tracking projection module includes a CNC three-dimensional four-axis structure and a projection device. The projection device can project omnidirectionally within a smart ecological scene. The CNC three-dimensional four-axis structure includes an inner ring, a first axis 3, a second axis, an outer ring 4, and a third axis 5. The inner ring is fixed to the lower surface of the housing 1 via the first axis 3. The outer ring 4 is connected to the support shaft via the second axis. The projection device 6 is fixed to the tangential plane of the outer ring 4 via the third axis 5. The projection device 6 can be controlled at a 180-degree angle within the plane via the fourth axis. The outer ring 4 can rotate one revolution within the ring plane (vertical plane) via the second axis. The projection device 6 is fixed to the tangential plane of the outer ring 4 via the third axis 5, allowing the projection device to rotate freely within a certain angle within the tangential plane. The combination of these features enables omnidirectional projection. The specific rotation angles of the four axes are calculated by the central processing module, which then sends commands for control. This module can project in real-time onto the corresponding area of ​​the target, achieving real-time and precise command control in conjunction with other modules.

[0050] like Figure 1 As shown, the first wireless communication module includes technologies such as a Bluetooth communication module and a Wi-Fi communication module. Both the Bluetooth and Wi-Fi communication modules are connected to the IoT device and the control system, ensuring interconnection and communication between the IoT device and the control system. This invention is suitable for various smart ecosystem application scenarios, such as smart homes, smart factories, and many other smart ecosystem application scenarios. The market is broad and the prospects are wide.

[0051] like Figure 7-8 As shown, an intelligent full-scene central control method includes the following steps:

[0052] Step S1, System Startup: The user installs the new IoT device at a specific location in the smart ecosystem scenario. The IoT device sends its basic information to the main control system of this invention through wireless communication technology. The main control system processes and stores the corresponding information to achieve initialization.

[0053] Step S2: Create a database: The main control system adds the location information of the IoT devices in the area to the regional database for easy access at any time;

[0054] Step S3, Production Interface: The main control system generates a human-machine interface based on the adjustable parameters of the IoT devices;

[0055] Step S4, Signal Identification: When a user wants to control the IoT device, they only need to use a handheld controllable flashing light device to emit a beam of light and place the light spot on the device's location. The main control system will automatically identify the location of the light spot through the weak target identification module.

[0056] Step S5, Human-Computer Interaction: The human-computer interaction interface is projected onto the corresponding area in real time. Then, a handheld, controllable flashing light device is moved, and the flashing frequency of the light spot is controlled to achieve the "confirm" and "cancel" functions. Parameters can be adjusted at specific locations on the human-computer interaction interface. This invention is suitable for various intelligent ecosystem application scenarios, such as smart homes, smart factories, and many other intelligent ecosystem application scenarios. The market is broad and the prospects are wide.

[0057] Step S6: Controlling the device: The main control system automatically detects the interface function corresponding to the location of the light spot and the operation being performed by the user to control the corresponding device. The intelligent control system in this invention replaces the currently widely used solution of controlling IoT devices with smartphone software. It avoids the inconvenience of searching and operating on a mobile phone due to the large number and variety of IoT devices. Instead, it can directly find the target to be controlled and perform the required operation, leaving all other work to be performed by the machine. The more IoT devices connected, the more the advantages of this solution will be demonstrated. This system is convenient, fast, and has a low learning cost, making the operating experience more suitable for people's daily habits, and more humanized and intelligent.

[0058] The above description is merely a preferred embodiment of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention. Structures, devices, and operating methods not specifically described or explained in this invention are implemented according to conventional methods in the art unless otherwise specified or limited.

Claims

1. An intelligent full-scenario central control system and control method, characterized in that: It includes a main control system, an intelligent full-scene central control method, and a handheld controllable flashing light device, wherein the handheld controllable flashing light device is an external device; The main control system includes a chassis shell (1), a central processing module, an image acquisition module (2), a weak target recognition module, a target tracking and projection module, a first wireless communication module, and a power supply module. The image acquisition module, the weak target recognition module, the target tracking and projection module, the first wireless communication module, and the power supply module are all connected to the central processing module. The central processing module communicates and controls other IoT devices in the scene through the wireless communication module. The handheld controllable flashing light device has three buttons on the outside. One button is a switch for emitting a light beam, and the other two buttons are for confirming and canceling commands, respectively. The handheld controllable flashing light device includes a light source switch, a second wireless communication module, and a flashing frequency control module. The central processing module includes a computing unit, an information processing unit, a storage unit, a human-computer interaction system, and a control unit; When the central processing module is initialized, it divides the entire smart ecosystem scenario into several regions and stores them in the storage unit. The central processing module obtains the location information and device information of IoT devices in the smart ecosystem scenario and stores them to establish a database. The intelligent full-scenario central control method includes the following steps: Step S1, System Startup: The user installs the new IoT device at a specific location in the smart ecosystem scenario. The IoT device sends its basic information to the main control system through wireless communication technology. The main control system processes and stores the corresponding information to complete the initialization. Step S2: Create a database: The main control system adds the location information of the IoT devices in the area to the regional database for easy access at any time; Step S3, Production Interface: The main control system generates a human-machine interface based on the adjustable parameters of the IoT devices; Step S4, Signal Identification: When a user wants to control the IoT device, they simply need to hold a controllable flashing light device and emit a beam of light, directing the light spot onto the device's location. The main control system will automatically identify the location of the light spot through the weak target recognition module. Step S5, Human-computer interaction: The human-computer interaction interface is projected onto the corresponding area in real time. Then, the handheld controllable flashing light device is moved to control the flashing frequency of the light spot to achieve the functions of confirming and canceling. Step S6: Controlling the device: The main control system will automatically detect the interface function corresponding to the location of the light spot, as well as the operation being performed by the user, in order to control the corresponding device.

2. The intelligent full-scene central control system and control method according to claim 1, characterized in that: The human-computer interaction interface is either sent directly from the IoT device to the central processing module for storage and retrieval, or automatically generated by the central processing module according to the parameters of the IoT device and a template.

3. The intelligent full-scene central control system and control method according to claim 1, characterized in that: The image acquisition module (2) uses several sets of cameras to acquire images in the smart ecological application scenario. The image acquisition module (2) also includes a CNC three-dimensional rotating shaft structure.

4. The intelligent full-scene central control system and control method according to claim 1, characterized in that: The weak target recognition module is composed of a microprocessor, including an FPGA, ZYNQ, CPU, or DSP module. The algorithm for weak target recognition preprocesses, segments, and recognizes image information and transmits it to the central processing module.

5. The intelligent full-scene central control system and control method according to claim 1, characterized in that: The target tracking projection module includes a CNC three-dimensional four-axis rotating structure and a projection device (6).

6. The intelligent full-scene central control system and control method according to claim 5, characterized in that: The CNC three-dimensional four-axis structure includes an inner ring, a first axis (3), a second axis, an outer ring (4), and a third axis. (5) The inner ring is fixed to the lower surface of the chassis shell (1) via the first rotating shaft (3), the outer ring (4) is connected to the support shaft via the second rotating shaft, the outer ring (4) is fixed to the projection device (6) via the third rotating shaft (5) on the tangent plane, the projection device (6) achieves 180-degree angle control in the plane via the fourth rotating shaft, and the CNC three-dimensional four-axis rotating structure is controlled by the central processing module.

7. The intelligent full-scene central control system and control method according to claim 1, characterized in that: The first wireless communication module includes a Bluetooth communication module and a WIFI communication module, both of which are connected to the Internet of Things (IoT) device and the control system.