Control method of distributed system, terminal device, distributed system, and medium

Abstract

The application provides a control method of a distributed system, a terminal device, a distributed system and a medium. The system comprises an image acquisition device, a terminal device and a plurality of controlled devices. The terminal device, the image acquisition device and the controlled devices are connected through a distributed software bus. The terminal device stores a plurality of image processing modules. Different image processing modules correspond to different image processing algorithms and preset scene information. The method acquires image information collected by the image acquisition device and running scene information of the image acquisition device through the terminal device, determines a target image processing module according to the running scene information, and processes the image information through the target image processing module to obtain processing result information. The terminal device generates first control information according to the processing result information, forms a first control signal according to the first control information and sends the first control signal to the controlled devices to control the controlled devices. In this way, the controlled devices in multiple scenes can be controlled simultaneously.

Description

Technical Field

[0001] This application relates to the field of control engineering technology, and in particular to a control method, terminal equipment, distributed system, and medium for a distributed system. Background Technology

[0002] With the rise of automation reform and intelligent manufacturing, image processing and recognition technologies are being widely applied in various scenarios in life. Existing image processing methods build corresponding platforms and deploy relevant code based on the scenarios they are working with, thereby combining image processing with practical engineering applications.

[0003] However, with the increasing demand for vision system technology from fields such as artificial intelligence and the Internet of Things, product requirements are also becoming more convenient, integrated, and efficient. Existing image processing systems, being built for specific scenarios, prevent technicians from quickly distributing these systems, and their adaptability and portability still urgently need improvement. Summary of the Invention

[0004] This application relates to a control method, terminal device, distributed system, and medium for a distributed system, aiming to solve the problem that existing image processing systems cannot perform distributed applications.

[0005] Firstly, this application provides a control method for a distributed system. The distributed system includes an image acquisition device, a terminal device, and multiple controlled devices. The terminal device, the image acquisition device, and the controlled devices are connected via a distributed soft bus. The terminal device stores multiple image processing modules, each corresponding to a different image processing algorithm, and preset scene information corresponding to each image processing module. The method includes:

[0006] The terminal device acquires image information collected by the image acquisition device and information about the operating scene of the image acquisition device.

[0007] The terminal device matches the running scene information with the preset scene information, and the terminal device determines the image processing module corresponding to the successfully matched preset scene information as the target image processing module;

[0008] The terminal device inputs image information into the target image processing module, and the terminal device processes the image information through the target image processing module to obtain the processing result information;

[0009] The terminal device generates the first control information based on the processing result information;

[0010] The terminal device generates a first control signal based on the first control information and sends it to the controlled device to control the controlled device.

[0011] In some embodiments, the operating scenario information includes a smart access control scenario, the controlled device includes a door lock, the target image processing module includes a face image processing module, the face image processing module stores multiple preset face image information, and the processing result information includes a matching result obtained by matching the face image information acquired by the image acquisition device with the preset face image information through the face image processing module; the terminal device generates first control information based on the processing result information, including: if the matching result between the face image information and the preset face image information is successful, the terminal device generates access control information to open the door lock.

[0012] In some embodiments, the running scenario information is an automatic sorting scenario, which is used to sort target items. The controlled equipment includes a conveyor belt, and the target image processing module includes an item image processing module. The item image processing module stores preset item image information of the target items. The processing result information includes a similarity coefficient obtained by comparing the item image information acquired by the image acquisition device with the preset item image information through the item image processing module. The terminal device generates first control information based on the processing result information, including: if the similarity coefficient is greater than a preset threshold, the terminal device generates sorting control information. The sorting control information is used to control the conveyor belt to transport the target items to the first track, and the first track is used to transport sorted and qualified target items.

[0013] In some embodiments, the running scenario information is an autonomous driving scenario, the controlled device includes a car, the target image processing module includes a lane image recognition module, and the processing result information includes the lane trajectory obtained by the lane image recognition module by recognizing the lane image information collected by the image acquisition device; the terminal device generates first control information based on the processing result information, including: the terminal device generates driving control information based on the lane trajectory, and the driving control information is used to control the vehicle to drive according to the lane trajectory.

[0014] In some embodiments, the running scenario information is a health monitoring scenario, the controlled device includes an alarm, the target image processing module is a face image recognition module, and the processing result information includes the heart rate obtained by the face image recognition module from the face image information collected by the image acquisition device; the terminal device generates first control information based on the processing result information, including: if the heart rate is greater than a preset heart rate, the terminal device generates alarm control information, and the alarm control information is used to activate the alarm.

[0015] In some embodiments, the terminal device and the multimedia interactive device are connected via a distributed soft bus. The multimedia interactive device stores multiple display interface information, which includes display interfaces and corresponding display scene information. The method further includes: the terminal device generating display information and sending it to the multimedia interactive device, the display information including image information and running scene information; the multimedia interactive device matching the running scene information with the display scene information, and determining the display interface corresponding to the successfully matched display scene information as the target display interface; and the multimedia interactive device displaying the target display interface, the first area of ​​which is used to display image information.

[0016] In some embodiments, the displayed information further includes processing result information, and a second area of ​​the target display interface is used to display the processing result information. After the terminal device processes the image information through the target image processing module, the method further includes: the multimedia interactive device acquiring second control information selected by the user based on the image information and the processing result information; the multimedia interactive device sending the second control information to the terminal device; and the terminal device generating a second control signal based on the second control information and sending it to the controlled device to control the controlled device.

[0017] Secondly, embodiments of this application also provide a terminal device, which includes a processor, a memory, and a computer program stored in the memory and executable by the processor. The memory stores a strategy model, wherein when the computer program is executed by the processor, it implements the control method of the distributed system provided in the corresponding embodiment of this application, or cooperates with a multimedia interactive device to complete the control method of the distributed system provided in the corresponding embodiment of this application.

[0018] Thirdly, embodiments of this application provide a distributed system, including: multiple image acquisition devices, a terminal device, and multiple controlled devices. The terminal device, image acquisition devices, and controlled devices are connected via a distributed soft bus. The terminal device stores multiple image processing modules, each corresponding to a different image processing algorithm, and preset scene information corresponding to each image processing module. The terminal device is used to implement the control method of the distributed system provided in the corresponding embodiment of this application. The terminal device is connected to a multimedia interactive device via a distributed soft bus. The multimedia interactive device stores multiple display interface information, including display interfaces and corresponding display scene information. The terminal device and the multimedia interactive device can cooperate to complete the control method of the distributed system provided in the corresponding embodiment of this application.

[0019] Fourthly, embodiments of this application also provide a computer-readable storage medium for storing a computer program. When the computer program is executed by a processor, it enables the processor to implement the control method of the distributed system provided in the corresponding embodiments of this application, or to cooperate with a multimedia interactive device to complete the control method of the distributed system provided in the corresponding embodiments of this application.

[0020] This application provides a control method, terminal device, distributed system, and medium for a distributed system. The provided distributed system includes an image acquisition device, a terminal device, and multiple controlled devices. The terminal device, image acquisition device, and controlled devices are connected via a distributed soft bus. The terminal device stores multiple image processing modules, each corresponding to a different image processing algorithm, and preset scene information for each image processing module. The provided control method acquires image information and the operating scene information of the image acquisition device through the terminal device. Based on the operating scene information, a target image processing module is determined, and the target image processing module processes the image information to obtain processing result information. The terminal device then generates first control information based on the processing result information, forms a first control signal based on the first control information, and sends it to the controlled devices to control the controlled devices. Thus, through the control method provided in this application, the corresponding target image processing module can be determined based on the operating scene information of the image acquisition device, enabling simultaneous control of controlled devices in multiple scenes. Attached Figure Description

[0021] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This is a schematic block diagram of the distributed soft bus provided in the embodiments of this application;

[0023] Figure 2 This is a schematic block diagram of a distributed system provided in an embodiment of this application;

[0024] Figure 3 This is a schematic block diagram of another distributed system provided in an embodiment of this application;

[0025] Figure 4 This is a schematic block diagram of another distributed system provided in an embodiment of this application;

[0026] Figure 5 This is a schematic block diagram of another distributed system provided in an embodiment of this application;

[0027] Figure 6 This is a schematic block diagram of another distributed system provided in an embodiment of this application;

[0028] Figure 7 This is a schematic flowchart illustrating the steps of a control method for a distributed system provided in an embodiment of this application;

[0029] Figure 8 This is a schematic flowchart illustrating the steps of another control method for a distributed system provided in an embodiment of this application;

[0030] Figure 9 This is a schematic flowchart illustrating the steps of another control method for a distributed system provided in an embodiment of this application;

[0031] Figure 10 This is a schematic flowchart illustrating the steps of another control method for a distributed system provided in an embodiment of this application;

[0032] Figure 11 This is a schematic flowchart illustrating the steps of another control method for a distributed system provided in an embodiment of this application;

[0033] Figure 12 This is a schematic flowchart illustrating the steps of a display method for a distributed system provided in an embodiment of this application;

[0034] Figure 13 This is a schematic block diagram of a terminal device provided in an embodiment of this application.

[0035] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Detailed Implementation

[0036] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0037] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0038] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0039] It should be understood that, in order to clearly describe the technical solutions of the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with essentially the same function and effect. For example, "first control information" and "second control information" are only used to distinguish different control information and do not limit their order. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and the terms "first" and "second" are not necessarily different.

[0040] It should also be understood that the term "and / or" as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0041] To facilitate understanding of the embodiments of this application, some terms involved in the embodiments of this application will be briefly explained below.

[0042] 1. Distributed soft bus: such as Figure 1 As shown, Figure 1 This is a schematic block diagram of the distributed soft bus provided in the embodiments of this application. The distributed soft bus is a virtual, "invisible" bus. It can connect all system devices developed based on the KaihongOS system within the same local area network, and has the characteristics of self-discovery, self-organizing network, high bandwidth and low latency. In addition to connecting hardware devices using the same network protocol, the soft bus technology also supports networking heterogeneous networks with different protocols.

[0043] The open-source HarmonyOS is a brand-new system designed for the era of the Internet of Everything. Building upon the capabilities of traditional single-device systems, the open-source HarmonyOS provides new distributed integrated capabilities to better adapt to next-generation application scenarios involving multiple devices, multiple tasks, and multiple data.

[0044] The distributed soft bus, based on the hardware and software collaboration of Ethernet, Wi-Fi, and Bluetooth, provides device discovery and connectivity. After devices discover and connect to each other, the distributed soft bus manages the self-organizing network and topology relationships between devices. The distributed soft bus achieves unified distributed communication management capabilities among near-field devices, providing link-independent device discovery, connection, networking, and transmission capabilities. Its main functions are as follows:

[0045] 1) Discovery and Connection: Provides device discovery and connection capabilities based on communication methods such as WIFI and Bluetooth.

[0046] 2) Device networking: Provides unified device networking and topology management capabilities, and provides information on networked devices for data transmission.

[0047] 3) Data transmission: Provides data transmission channels and supports message and byte data transmission capabilities.

[0048] 2. MQTT Protocol: Message Queuing Telemetry Transport (MQTT) is an instant messaging protocol developed by International Business Machines (IBM). This protocol supports all platforms and can connect almost all networked devices and external devices. It is used as a communication protocol for sensors and actuators (such as connecting homes to the internet via Twitter).

[0049] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0050] With the increasing demand for vision system technology from fields such as artificial intelligence and the Internet of Things, product requirements are also trending towards convenience, integration, and efficiency. Existing image processing systems, being built for specific scenarios, prevent technicians from quickly distributing these systems, and their adaptability and portability still urgently need improvement.

[0051] To resolve the above issues, please refer to [link / reference]. Figure 2 , Figure 2 This is a schematic block diagram of a distributed system 10 provided in an embodiment of this application. Figure 2 In the distributed system, there are image acquisition devices 11, terminal devices 12 and multiple controlled devices 13. The terminal devices 11, the image acquisition devices 12 and the controlled devices 13 are connected through a distributed soft bus. The terminal devices 11 store multiple image processing modules, different image processing modules correspond to different image processing algorithms, and the image processing modules also correspond to preset scene information. The terminal devices 11 are used to implement the control method of the distributed system 10 provided in the corresponding embodiment of this application.

[0052] Specifically, such as Figure 2As shown, the provided distributed system 10 corresponds to multiple scenarios, each scenario has a corresponding image acquisition device 12 and controlled device 13. The terminal device 11 is connected to the image acquisition device 12 and controlled device 13 of each scenario through a distributed soft bus. Therefore, based on the image information acquired by the image acquisition device 11 of each scenario through multiple image processing modules stored within the terminal device 11, it can control the corresponding controlled device 13. The scalability of the provided distributed system 10 is significantly improved.

[0053] It should be noted that in some embodiments, the preset scene information corresponding to the image processing module can be a smart access control scene, an automatic sorting scene, an autonomous driving scene, or a health monitoring scene. The type of preset scene corresponding to the image processing module can be any scene that enables control of the controlled device based on image information. Developers only need to write the corresponding image processing algorithm for the scene to be constructed to complete the construction of the image processing module for that scene. This application does not limit the preset scene corresponding to the image processing module.

[0054] In some embodiments, such as Figure 2 As shown, the distributed system 10 also includes a multimedia interactive device 14. The terminal device 11 is connected to the multimedia interactive device 14 via a distributed soft bus. The multimedia interactive device 14 stores multiple display interface information, including the display interface and the corresponding display scene information. The terminal device 11 and the multimedia interactive device 14 can cooperate to complete the control method of the distributed system 10 provided in the corresponding embodiment of this application.

[0055] By configuring the multimedia interactive device 14, the provided distributed system 10 can integrate device resources, enabling users to control the controlled device 13 based on the processed information from the image processing module 12. This gives the provided distributed system 10 strong interactivity.

[0056] It should be noted that in some embodiments, the multimedia interactive device 14 may include a display screen, the multimedia interactive device 14 may include an audio device, or the multimedia interactive device 14 may include both a display screen and an audio device. The multimedia interactive device 14 is configured according to the needs of the actual scenario; therefore, this application embodiment does not limit the type of the multimedia interactive device 14.

[0057] It should be noted that in some embodiments, the terminal device 11 can also be connected to a user terminal via a distributed soft bus, such as a user's mobile phone. This allows the user to control the controlled device 13 based on the processed information from the image processing module 12 through the user terminal. This makes the provided distributed system 10 highly interactive.

[0058] In some embodiments, the terminal device 11 is equipped with a first-level operating system, and the image acquisition device 12 and the controlled device 13 are equipped with a second-level operating system, wherein the first level is higher than the second level. The operating system can be any operating system; this application uses KaihongOS as an example for description.

[0059] It should be noted that KaihongOS divides devices into 6 levels, from L0 to L5, with L5 being the highest level and L0 being the lowest level, i.e., a lightweight system. The level of KaihongOS on the terminal device 11 is higher than that of the image acquisition device 12 and the controlled device 13. Thus, the terminal device 11 can obtain the image information acquired by the image acquisition device 12 to control the controlled device 13.

[0060] For example, terminal device 11 can be a laptop, a server, or a tablet computer. Terminal device 11 only needs to support KaihongOS to implement the control method provided in this application embodiment. Therefore, this application embodiment does not limit the type of terminal device.

[0061] It should be noted that in some embodiments, the terminal device 11 is connected to the image acquisition device 12 and the controlled device 13 via the MQTT protocol. In some embodiments, the terminal device 11 is connected to the image acquisition device 12 and the controlled device 13 via the Bluetooth protocol. In some embodiments, the image acquisition device 12 and the controlled device 13 are connected via the WIFI protocol. Since the terminal device 11 only needs to connect via a connection protocol adapted to KaihongOS to complete data interaction between the terminal device 11 and the image acquisition device 12 and the controlled device 13, this application embodiment does not limit the type of connection protocol between the terminal device 11 and the image acquisition device 12 and the controlled device 13.

[0062] In some embodiments, the image acquisition device 12 stores operating scene information, which is the working scene of the image acquisition device 12, and is used to quickly identify the target image processing module corresponding to the operating scene information.

[0063] For example, in a smart access control scenario, such as Figure 3 As shown, Figure 3This is a schematic block diagram of another distributed system 10 provided in an embodiment of this application. Figure 3 In this system, the image acquisition device 12 is a camera on the door, the controlled device 13 is a door lock, and the terminal device 11 stores a face image processing module containing multiple preset face image information. The face image processing module matches the face image information acquired by the image acquisition device 12 with the preset face image information, and uses the matching result as the processing result information to control the door lock's opening and closing.

[0064] It should be noted that in smart access control scenarios, terminal device 11 can be an external terminal device or a processing terminal installed inside the door lock, thereby enabling rapid control of the door lock opening and closing.

[0065] For example, when the operating scenario is an automated sorting scenario, such as Figure 4 As shown, Figure 4 This is a schematic block diagram of another distributed system 10 provided in an embodiment of this application. Figure 4 In this system, the image acquisition device 12 is a camera used in the intelligent sorting scenario, the controlled device 13 is a conveyor belt, and the terminal device 11 stores an item image processing module. This module stores preset item image information for multiple items; for example, in shoe sorting, it stores image information of qualified items. The item image processing module compares the item image information acquired by the image acquisition device 12 with the preset item image information to obtain a similarity coefficient, which serves as the processing result, enabling control of the conveyor belt.

[0066] For example, when the operating scenario is an autonomous driving scenario, such as Figure 5 As shown, Figure 5 This is a schematic block diagram of another distributed system 10 provided in an embodiment of this application. Figure 5 In this system, the image acquisition device 12 is a camera on the car, the controlled device 13 is the car, and the terminal device 11 stores a lane image recognition module. The lane image recognition module identifies the lane image information acquired by the image acquisition device 12, obtaining the lane trajectory as the processing result information, thus enabling vehicle control.

[0067] It should be noted that in autonomous driving scenarios, the terminal device 11 can be an external terminal device or an in-vehicle terminal with processing capabilities, thereby enabling rapid control of the vehicle.

[0068] It should be noted that the lane image recognition module can not only identify the lane trajectory, but also the distance of objects in front of the vehicle, thereby preventing vehicle collisions.

[0069] For example, when the operating scenario is a health monitoring scenario, such as Figure 6 As shown, Figure 6 This is a schematic block diagram of another distributed system 10 provided in an embodiment of this application. Figure 6 In this system, the image acquisition device 12 is a camera above the monitored object, the controlled device 13 is an alarm, and the terminal device 11 stores a facial image recognition module. The heart rate of the monitored object is obtained by recognizing the facial image information acquired by the image acquisition device 12 through the facial image recognition module, which enables control of the alarm.

[0070] Thus, the provided distributed system can determine the corresponding target image processing module based on the operating scene information of the image acquisition device, and can simultaneously control the controlled devices in multiple scenes, exhibiting strong adaptability and portability.

[0071] Please see Figure 7 , Figure 7 This is a schematic flowchart illustrating the steps of a control method for a distributed system provided in an embodiment of this application. The provided control method for a distributed system can be applied to any distributed system provided in any embodiment of this application.

[0072] like Figure 7 As shown, the provided control method includes steps S101 to S105.

[0073] S101. The terminal device acquires image information collected by the image acquisition device and the operating scene information of the image acquisition device.

[0074] Specifically, when the terminal device connects to the image acquisition device via a distributed soft bus, it also needs to acquire the operating scene information of the image acquisition device in addition to obtaining the image information acquired by the image acquisition device. For example... Figure 1 As shown, the image acquisition device can operate in multiple scenarios. By sending the operating scenario information stored in the image acquisition device to the terminal device, the terminal device can confirm the corresponding control method to complete the control of the controlled device in that scenario.

[0075] S102. The terminal device matches the running scene information with the preset scene information, and the terminal device determines the image processing module corresponding to the successfully matched preset scene information as the target image processing module.

[0076] Specifically, the terminal device matches the operating scene information of the image acquisition device with multiple preset scene information corresponding to the image acquisition module. It can determine the target image processing module corresponding to the image acquisition device among multiple image processing modules, thereby enabling the rapid processing of image information acquired by the image acquisition device in different scenes to complete the control of the controlled device in that scene.

[0077] S103. The terminal device inputs image information to the target image processing module, and the terminal device processes the image information through the target image processing module to obtain the processing result information.

[0078] Specifically, after the terminal device confirms the target image processing module corresponding to the image acquisition device, it inputs the image information acquired by the image acquisition device into the target image processing module, thereby obtaining the processing result of the target image processing module on the image information. Based on the processing result, a control strategy for the controlled device can then be selected.

[0079] S104. The terminal device generates the first control information based on the processing result information.

[0080] Specifically, the terminal device can generate first control information based on the processing result. For example, in an autonomous driving scenario, if the processing result is a lane trajectory, the first control signal is a control signal that can control the vehicle to drive along the lane trajectory.

[0081] S105. The terminal device generates a first control signal based on the first control information and sends it to the controlled device to control the controlled device.

[0082] Specifically, after the terminal device sends the first control signal to the controlled device, it can control the controlled device based on the control signal. Thus, through the control method provided in this application embodiment, the corresponding target image processing module can be determined according to the operating scene information of the image acquisition device, and the controlled devices in multiple scenes can be controlled simultaneously.

[0083] In some embodiments, the operating scenario information includes a smart access control scenario, the controlled device includes a door lock, the target image processing module includes a face image processing module, the face image processing module stores multiple preset face image information, and the processing result information includes a matching result obtained by matching the face image information acquired by the image acquisition device with the preset face image information through the face image processing module. Please refer to... Figure 3 and Figure 8 , Figure 8 This is a schematic flowchart illustrating the steps of another control method for a distributed system provided in an embodiment of this application. Figure 7 The control methods provided for distributed systems differ in that Figure 8 The provided control method also includes S104a.

[0084] S104a. If the matching result between the face image information and the preset face image information is successful, the terminal device generates access control information to unlock the door.

[0085] The face image processing module matches the face image information captured by the image acquisition device with the stored preset face image information. When the match is successful, the terminal device can generate access control information to unlock the door. Similarly, when the match fails, the terminal device will store the face image information of the failed match, which can be stored in the face image processing module after subsequent confirmation by the administrator.

[0086] In some embodiments, the running scenario information is an automatic sorting scenario, which is used to sort target items. The controlled equipment includes a conveyor belt, and the target image processing module includes an item image processing module. The item image processing module stores preset item image information of the target items, and the processing result information includes a similarity coefficient obtained by comparing the item image information acquired by the image acquisition device with the preset item image information through the item image processing module. Please refer to... Figure 4 and Figure 9 , Figure 9 This is a schematic flowchart illustrating the steps of another control method for a distributed system provided in an embodiment of this application. Figure 7 The control methods provided for distributed systems differ in that Figure 9 The provided control method also includes S104b.

[0087] S104b. If the similarity coefficient is greater than the preset threshold, the terminal device generates sorting control information. The sorting control information is used to control the conveyor belt to transport the target item to the first track. The first track is used to transport the sorted target item.

[0088] The item image processing module calculates a similarity coefficient between the target item image information acquired by the image acquisition device and the stored preset item image information. For example, if the target item is shoes, and the preset item image information is an image of a qualified product, the similarity coefficient between the shoe image information acquired by the image acquisition device and the preset item image information is calculated. If the similarity coefficient is greater than a preset threshold, it indicates that the target item corresponding to the image information is qualified. At this time, the terminal device generates sorting control information to control the conveyor belt to transport the target item to the first track. Similarly, if the similarity coefficient is less than or equal to the preset threshold, it indicates that the target item corresponding to the image information is unqualified. At this time, the terminal device generates control information to control the conveyor belt to transport the target item to the second track for transporting unqualified target items.

[0089] In some embodiments, the operating scenario information is an autonomous driving scenario, the controlled device includes a car, the target image processing module includes a lane image recognition module, and the processing result information includes the lane trajectory obtained by the lane image recognition module from the lane image information collected by the image acquisition device. Please refer to... Figure 5 and Figure 10 , Figure 10This is a schematic flowchart illustrating the steps of another control method for a distributed system provided in an embodiment of this application. Figure 7 The control methods provided for distributed systems differ in that Figure 10 The provided control method also includes S104c.

[0090] S104c. The terminal device generates driving control information based on the lane trajectory, and the driving control information is used to control the vehicle to drive according to the lane trajectory.

[0091] The lane image recognition module identifies the lane trajectory by recognizing the lane image information collected by the image acquisition device. The terminal device then generates driving control information to control the vehicle to drive according to the lane trajectory.

[0092] For example, the lane image recognition module also obtains the distance to objects ahead by collecting lane image information from the image acquisition device. When the distance is less than a preset distance, the generated lane trajectory will be modified to improve the safety of the provided control method in autonomous driving scenarios.

[0093] In some embodiments, the operating scenario information is a health monitoring scenario, the controlled device includes an alarm, the target image processing module is a face image recognition module, and the processing result information includes the heart rate obtained by the face image recognition module from the face image information acquired by the image acquisition device. Please refer to... Figure 6 and Figure 11 , Figure 11 This is a schematic flowchart illustrating the steps of another control method for a distributed system provided in an embodiment of this application. Figure 7 The control methods provided for distributed systems differ in that Figure 11 The provided control method also includes S104d.

[0094] S104d. If the heart rate is greater than the preset heart rate, the terminal device generates alarm control information, which is used to activate the alarm.

[0095] The heart rate of the monitored face is obtained through the facial image recognition module. When the heart rate is greater than the preset heart rate, the terminal device can generate alarm control information in time and start the alarm to protect the user's personal safety.

[0096] In some embodiments, the terminal device and the multimedia interactive device are connected via a distributed soft bus. The multimedia interactive device stores multiple display interface information, which includes the display interface and the corresponding display scene information. Please refer to... Figure 1 and Figure 12 , Figure 12 This is a schematic flowchart illustrating the steps of a display method for a distributed system provided in an embodiment of this application.

[0097] like Figure 12 As shown, the provided display method includes steps S101 to S203.

[0098] S101. The terminal device acquires image information collected by the image acquisition device and the operating scene information of the image acquisition device.

[0099] S201. The terminal device generates display information and sends it to the multimedia interactive device. The display information includes image information and running scene information.

[0100] S202. The multimedia interactive device matches the running scene information with the display scene information, and determines the display interface corresponding to the successfully matched display scene information as the target display interface.

[0101] S203. The multimedia interactive device displays a target display interface, and the first area of ​​the target display interface is used to display image information.

[0102] Multimedia interactive devices allow users to view captured image information. Since the layout of the display interface varies depending on the scenario, when the multimedia interactive device receives the operating scenario information of the image acquisition device from the terminal device, it displays the target display interface corresponding to that operating scenario. Displaying this image information on the display interface enhances the user's interactive experience.

[0103] For example, the displayed information also includes processing result information, and the second area of ​​the target display interface is used to display the processing result information. After the terminal device processes the image information through the target image processing module, the method further includes: the multimedia interactive device acquiring second control information selected by the user based on the image information and the processing result information; the multimedia interactive device sending the second control information to the terminal device; the terminal device forming a second control signal based on the second control information and sending it to the controlled device to control the controlled device.

[0104] By displaying image processing results on a multimedia interactive device and showing these results on the device's interface, users can select corresponding secondary control information. For example, in a health monitoring scenario, a user might activate an alarm when a high heart rate is detected. This allows the provided control method to integrate device resources, enabling users to control the device based on the image processing module's information. The provided method offers strong interactivity.

[0105] This application provides a control method for a distributed system. A terminal device acquires image information and the operating scene information of an image acquisition device. Based on the operating scene information, a target image processing module is determined, and the target image processing module processes the image information to obtain processing results. The terminal device then generates first control information based on the processing results, forms a first control signal based on the first control information, and sends it to the controlled device to control the controlled device. Thus, the control method provided by this application can determine the corresponding target image processing module based on the operating scene information of the image acquisition device, and can simultaneously control controlled devices in multiple scenes.

[0106] This application provides a terminal device. For example... Figure 13 As shown, Figure 13 This is a schematic block diagram of a terminal device provided in an embodiment of this application.

[0107] The terminal device may include a processor, memory, and a network interface. The processor, memory, and network interface are connected via a system bus, such as an I2C (Inter-integrated Circuit) bus.

[0108] Specifically, the processor can be a microcontroller unit (MCU), a central processing unit (CPU), or a digital signal processor (DSP), etc.

[0109] Specifically, the storage device can be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a portable hard drive, etc.

[0110] This network interface is used for network communication, such as sending assigned tasks. Those skilled in the art will understand that... Figure 13 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the controller to which the present application is applied. Specific terminal devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0111] The processor is used to run a computer program stored in the memory, and when executing the computer program, implement the control method of the distributed system provided in the corresponding embodiment of this application, or cooperate with a multimedia interactive device to complete the control method of the distributed system provided in the corresponding embodiment of this application.

[0112] The provided terminal device, as an example, is used for the following steps:

[0113] The terminal device acquires image information collected by the image acquisition device and information about the operating scene of the image acquisition device.

[0114] The terminal device matches the running scene information with the preset scene information, and the terminal device determines the image processing module corresponding to the successfully matched preset scene information as the target image processing module.

[0115] The terminal device inputs image information into the target image processing module, and the terminal device processes the image information through the target image processing module to obtain the processing result information.

[0116] The terminal device generates the first control information based on the processing result information.

[0117] The terminal device generates a first control signal based on the first control information and sends it to the controlled device to control the controlled device.

[0118] In some embodiments, the operating scenario information includes a smart access control scenario, the controlled device includes a door lock, the target image processing module includes a face image processing module, the face image processing module stores multiple preset face image information, and the processing result information includes a matching result obtained by matching the face image information acquired by the image acquisition device with the preset face image information through the face image processing module; the terminal device generates first control information based on the processing result information, which is used to: if the matching result between the face image information and the preset face image information is successful, the terminal device generates access control information to open the door lock.

[0119] In some embodiments, the running scenario information is an automatic sorting scenario, which is used to sort target items. The controlled equipment includes a conveyor belt, and the target image processing module includes an item image processing module. The item image processing module stores preset item image information of the target items. The processing result information includes a similarity coefficient obtained by comparing the item image information acquired by the image acquisition device with the preset item image information through the item image processing module. The terminal device generates first control information based on the processing result information, which is used to: if the similarity coefficient is greater than a preset threshold, the terminal device generates sorting control information. The sorting control information is used to control the conveyor belt to transport the target items to the first track, and the first track is used to transport sorted and qualified target items.

[0120] In some embodiments, the running scenario information is an autonomous driving scenario, the controlled device includes a car, the target image processing module includes a lane image recognition module, and the processing result information includes the lane trajectory obtained by the lane image recognition module by recognizing the lane image information collected by the image acquisition device; the terminal device generates first control information based on the processing result information, which is used to realize: the terminal device generates driving control information based on the lane trajectory, and the driving control information is used to control the vehicle to drive according to the lane trajectory.

[0121] In some embodiments, the running scenario information is a health monitoring scenario, the controlled device includes an alarm, the target image processing module is a face image recognition module, and the processing result information includes the heart rate obtained by the face image recognition module from the face image information collected by the image acquisition device; the terminal device generates first control information based on the processing result information to implement: if the heart rate is greater than the preset heart rate, the terminal device generates alarm control information, and the alarm control information is used to activate the alarm.

[0122] In some embodiments, the terminal device and the multimedia interactive device are connected via a distributed soft bus. The multimedia interactive device stores multiple display interface information, which includes display interfaces and corresponding display scene information. The device is further configured to: generate display information from the terminal device and send it to the multimedia interactive device; the display information includes image information and running scene information; the multimedia interactive device matches the running scene information with the display scene information, and determines the display interface corresponding to the successfully matched display scene information as the target display interface; the multimedia interactive device displays the target display interface, and the first area of ​​the target display interface is used to display image information.

[0123] In some embodiments, the displayed information further includes processing result information, and the second area of ​​the target display interface is used to display the processing result information. After the terminal device processes the image information through the target image processing module, it is also used to: acquire second control information selected by the user based on the image information and the processing result information; send the second control information to the terminal device; and generate a second control signal based on the second control information and send it to the controlled device to control the controlled device.

[0124] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the computer equipment described above can be referred to the corresponding process in the aforementioned operation control method, and will not be repeated here.

[0125] This application also provides a computer-readable storage medium storing a computer program, which includes program instructions. A processor executes these program instructions to implement the steps of the operation control method provided in the above embodiments. For example, when the computer program is loaded by a processor, it can perform the following steps:

[0126] The terminal device acquires image information collected by the image acquisition device and information about the operating scene of the image acquisition device.

[0127] The terminal device matches the running scene information with the preset scene information, and the terminal device determines the image processing module corresponding to the successfully matched preset scene information as the target image processing module.

[0128] The terminal device inputs image information into the target image processing module, and the terminal device processes the image information through the target image processing module to obtain the processing result information.

[0129] The terminal device generates the first control information based on the processing result information.

[0130] The terminal device generates a first control signal based on the first control information and sends it to the controlled device to control the controlled device.

[0131] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0132] The computer-readable storage medium can be an internal storage unit of the computer device described in the foregoing embodiments, such as a hard disk or memory of the computer device. Alternatively, it can be an external storage device of the computer device, such as a plug-in hard disk, smart media card (SMC), secure digital card (SD), flash card, etc., provided on the computer device.

[0133] Since the computer program stored in the computer-readable storage medium can execute any of the control methods of the distributed system provided in the embodiments of this application, the beneficial effects that the control methods of the distributed system provided in the embodiments of this application can achieve can be realized. For details, please refer to the previous embodiments, which will not be repeated here.

[0134] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments. The above are merely specific implementations of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A control method for a distributed system, characterized in that, The distributed system includes multiple image acquisition devices, terminal devices, and multiple controlled devices. The terminal devices, image acquisition devices, and controlled devices are connected via a distributed soft bus. The terminal devices store multiple image processing modules, each corresponding to a different image processing algorithm, as well as preset scene information for each image processing module. The method includes: The terminal device acquires image information acquired by the image acquisition device and operating scene information of the image acquisition device; The terminal device matches the running scene information with the preset scene information, and the terminal device determines the image processing module corresponding to the successfully matched preset scene information as the target image processing module; The terminal device inputs the image information to the target image processing module, and the terminal device processes the image information through the target image processing module to obtain processing result information; The terminal device generates first control information based on the processing result information; The terminal device generates a first control signal based on the first control information and sends it to the controlled device to control the controlled device; the operating scenario information includes a smart access control scenario, the controlled device includes a door lock, the target image processing module includes a face image processing module, the face image processing module stores multiple preset face image information, and the processing result information includes a matching result obtained by matching the face image information acquired by the image acquisition device with the preset face image information through the face image processing module; the terminal device generates first control information based on the processing result information, including: if the face image information matches the preset face image information... If the facial image matching result is successful, the terminal device generates access control information to unlock the door. The operating scenario information is an automatic sorting scenario, which is used to sort target items. The controlled equipment includes a conveyor belt, and the target image processing module includes an item image processing module that stores preset item image information of the target items. The processing result information includes a similarity coefficient obtained by comparing the item image information acquired by the image acquisition device with the preset item image information through the item image processing module. The terminal device then... The processing result information generates first control information, including: if the similarity coefficient is greater than a preset threshold, the terminal device generates sorting control information, which controls the conveyor belt to transport the target item to a first track, the first track being used to transport the sorted and qualified target item; the operating scenario information is an autonomous driving scenario, the controlled device includes a car, the target image processing module includes a lane image recognition module, and the processing result information includes the lane trajectory obtained by the lane image recognition module from the lane image information collected by the image acquisition device; the terminal device generates the first control information based on the processing result information. The system includes: the terminal device generating driving control information based on the lane trajectory, the driving control information being used to control the vehicle to travel along the lane trajectory; the operating scenario information being a health monitoring scenario, the controlled device including an alarm, the target image processing module being a face image recognition module, and the processing result information including the heart rate obtained by the face image recognition module from the face image information collected by the image acquisition device; the terminal device generating first control information based on the processing result information, including: if the heart rate is greater than a preset heart rate, the terminal device generating alarm control information, the alarm control information being used to activate the alarm.

2. The control method according to claim 1, characterized in that, The terminal device and the multimedia interactive device are connected via a distributed soft bus. The multimedia interactive device stores multiple display interface information, which includes the display interface and the display scene information corresponding to the display interface. The method further includes: The terminal device generates display information and sends it to the multimedia interactive device. The display information includes the image information and the running scene information. The multimedia interactive device matches the running scene information with the display scene information, and determines the display interface corresponding to the successfully matched display scene information as the target display interface; The multimedia interactive device displays the target display interface, and the first area of ​​the target display interface is used to display the image information.

3. The control method according to claim 2, characterized in that, The display information also includes the processing result information, and the second area of ​​the target display interface is used to display the processing result information; After the terminal device processes the image information through the target image processing module, the method further includes: The multimedia interactive device acquires second control information selected by the user based on the image information and the processing result information; The multimedia interactive device sends the second control information to the terminal device; The terminal device generates a second control signal based on the second control information and sends it to the controlled device to control the controlled device.

4. A terminal device, characterized in that, The terminal device includes a processor, a memory, and a computer program stored in the memory and executable by the processor. The memory stores a strategy model. When the computer program is executed by the processor, it implements the control method of the distributed system as described in claim 1, or collaborates with a multimedia interactive device to complete the control method of the distributed system as described in any one of claims 2-3.

5. A distributed system, characterized in that, include: The system comprises multiple image acquisition devices, terminal devices, and multiple controlled devices. The terminal devices, image acquisition devices, and controlled devices are connected via a distributed soft bus. The terminal devices store multiple image processing modules, each corresponding to a different image processing algorithm, and preset scene information corresponding to each image processing module. The terminal devices are used to implement the control method of the distributed system as described in claim 1. The terminal device and the multimedia interactive device are connected via a distributed soft bus. The multimedia interactive device stores multiple display interface information, which includes display interfaces and corresponding display scene information. The terminal device and the multimedia interactive device can cooperate to complete the control method of the distributed system as described in any one of claims 2-3.

6. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, causes the processor to implement the control method of the distributed system as described in claim 1, or to cooperate with a multimedia interactive device to complete the control method of the distributed system as described in any one of claims 2-3.

Images