A method and apparatus for cooperative control of intelligent devices, a storage medium, and a device

Abstract

The specification discloses a cooperative control method and device of intelligent equipment, a storage medium and equipment. The method comprises the following steps: receiving equipment data of a first intelligent equipment; determining at least one second intelligent equipment associated with the first intelligent equipment in a service scenario corresponding to the equipment data, and querying equipment data of the second intelligent equipment in a preset database; analyzing the equipment data of the first intelligent equipment and the equipment data of the second intelligent equipment to generate a control instruction adaptive to linkage logic between the first intelligent equipment and the second intelligent equipment, and sending the control instruction to the corresponding intelligent equipment. The scheme realizes accurate linkage of multiple intelligent equipments, and significantly improves the cooperation capability among the intelligent equipments.

Description

Technical Field

[0001] This specification relates to the field of Internet of Things (IoT) technology, and in particular to a collaborative control method, apparatus, storage medium, and device for smart devices. Background Technology

[0002] With the rapid development of the Internet of Things (IoT) and communication technologies, various smart devices, such as kitchen appliances and smart home appliances, have been widely used. The ease of controlling smart devices has become crucial for improving user experience and the level of device intelligence.

[0003] However, currently, different smart devices can only achieve simple data interaction and operate in a relatively independent state. This results in fragmented control logic, poor collaboration between devices, and an inability to adapt to the comprehensive control needs of complex scenarios. Summary of the Invention

[0004] This specification provides a method, apparatus, storage medium, and device for collaborative control of intelligent devices. Based on device data from the intelligent device and other associated intelligent devices, control commands adapted to the inter-device linkage logic are generated to achieve collaborative control between intelligent devices.

[0005] The following technical solution is adopted in this specification: This specification provides a collaborative control method for intelligent devices, including: Receive device data from the first smart device; Identify the second smart device associated with the first smart device in the business scenario corresponding to the device data, and query the device data of the second smart device in a preset database; The device data of the first smart device and the device data of the second smart device are parsed to generate control instructions adapted to the linkage logic between the first smart device and the second smart device, and the control instructions are sent to the corresponding smart devices.

[0006] Optionally, the method is applied to an intelligent agent, and before receiving current device data from the first intelligent device, the method further includes: Receive verification information sent by the first smart device; wherein, the verification information is uploaded by the first smart device after calling the session establishment interface with the smart agent and establishing a session in the session establishment interface; Based on the verification information, the identity of the first smart device is verified, and if the verification is successful, its corresponding session identifier is returned to the first smart device, so that the first smart device can upload device data to the smart agent based on the session identifier.

[0007] This step ensures the legitimacy of the smart device's identity and establishes a dedicated communication link between the smart agent and the device, guaranteeing the security and relevance of the device's data uploads.

[0008] Optionally, receiving current device data from the first smart device specifically includes: If a preset event triggering condition is detected, device data from the first smart device is received; The event triggering conditions include: the amount of data change of specified data in the first smart device exceeds a preset threshold, and / or the device state of the first smart device switches to a preset state.

[0009] This step enables precise triggering of collaborative control logic.

[0010] Optionally, before determining the second smart device associated with the first smart device in the business scenario, the method further includes: The device data of the first smart device is verified by determining whether the data format of the device data conforms to a preset parsable data format and whether the device data of the first smart device contains all the preset fields required to generate the control command. If the device data of the first smart device passes the verification, the device data of the first smart device is associated with the session identifier and stored in the database.

[0011] This step allows data to be stored while ensuring compliance, thus providing historical device data for the generation of subsequent control commands.

[0012] Optionally, the database pre-stores the mapping relationship between each smart device and its corresponding session identifier, as well as the association relationship between each smart device in different business scenarios; Identify a second intelligent device associated with the first intelligent device within the business scenario corresponding to the device data, specifically including: Based on the session identifier corresponding to the first smart device and the mapping relationship, the device identifier corresponding to the first smart device is determined; The second smart device is determined based on the device identifier, the task identifier of the business scenario, and the association relationship.

[0013] This step allows for the precise identification of smart devices associated with the current business scenario.

[0014] Optionally, the device data of the second smart device includes: the current device data and historical device data of the second smart device; The device data of the first smart device and the device data of the second smart device are parsed, specifically including: Query the historical device data of the first smart device in the preset database; The control command is generated by parsing the current and historical device data of the first smart device and the current and historical device data of the second smart device.

[0015] This step allows the device's current and historical data to be correlated, providing richer information for generating control commands and thus enabling more precise control.

[0016] Optionally, the control command includes a first sub-control command for the first smart device and a second sub-control command for the second smart device; Sending the control command to the corresponding smart device specifically includes: The first sub-control command and the second sub-control command are sent synchronously to the first smart device and the second smart device. The device status of the first intelligent device after executing the first sub-control instruction and the device status of the second intelligent device after executing the second sub-control instruction are obtained, and the historical device status is updated. Alternatively, the first sub-control instruction can be sent to the first smart device, and the device status after the first smart device executes the first sub-control instruction can be obtained; If the device status matches the trigger status corresponding to the second sub-control command, then the second sub-control command is sent to the corresponding second smart device.

[0017] This step enables the updating and reporting of the status of smart devices, thereby achieving precise and coordinated control of each smart device based on its status.

[0018] Optionally, the control command includes a first sub-control command for the first smart device and a second sub-control command for the second smart device; Sending the control command to the corresponding smart device specifically includes: Send the first sub-control command and the second sub-control command to the first smart device. The first smart device transmits the second sub-control command to the second smart device via Bluetooth broadcast.

[0019] This step enables status linkage between devices through Bluetooth broadcast pass-through.

[0020] This specification provides a collaborative control device for intelligent devices, including: A receiving module is used to receive device data from the first smart device; The query module is used to determine the second smart device associated with the first smart device in the business scenario corresponding to the device data, and to query the device data of the second smart device in a preset database; The control module is used to parse the device data of the first smart device and the device data of the second smart device to generate control instructions adapted to the linkage logic between the first smart device and the second smart device, and send the control instructions to the corresponding smart device.

[0021] This specification provides an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor implements the steps of the above-described method by executing the executable instructions.

[0022] This specification provides a computer-readable storage medium having computer instructions stored thereon that, when executed by a processor, implement the steps of the method described above.

[0023] This specification provides a computer program product, including a computer program / instructions that, when executed by a processor, implement the steps of the above-described method.

[0024] The above-mentioned technical solutions adopted in this specification can achieve the following beneficial effects: In the collaborative control method for smart devices provided in this specification, device data of a first smart device is received; a second smart device associated with the first smart device in the business scenario corresponding to the device data is determined, and device data of the second smart device is queried in a preset database; the device data of the first smart device and the device data of the second smart device are parsed to generate control instructions adapted to the linkage logic between the first smart device and the second smart device, and the control instructions are sent to the corresponding smart devices.

[0025] As can be seen from the above method, this solution receives device data from the first smart device, accurately matches the associated second smart device in the business scenario, integrates and queries the associated data of multiple devices, and then generates control instructions adapted to the linkage logic between devices based on these data. This breaks the limitations of the existing independent operation of devices and the dispersed control logic, enabling multiple devices to achieve precise linkage according to scenario requirements, and significantly improving the collaboration capabilities between smart devices. Attached Figure Description

[0026] The accompanying drawings, which are included to provide a further understanding of this specification and form part of this specification, illustrate exemplary embodiments and are used to explain this specification, but do not constitute an undue limitation thereof. In the drawings: Figure 1 This is a flowchart illustrating a collaborative control method for an intelligent device provided in this specification. Figure 2 This specification provides a schematic diagram of a collaborative control system. Figure 3 This specification provides a schematic diagram of a system control system applied in a cooking scenario; Figure 4 This is a schematic diagram of a collaborative control device for an intelligent device provided in this specification; Figure 5 This specification provides a corresponding Figure 1 A schematic diagram of an electronic device. Detailed Implementation

[0027] To make the objectives, technical solutions, and advantages of this specification clearer, the technical solutions of this specification will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this specification, and not all of them. Based on the embodiments in this specification, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this specification.

[0028] With the deep integration and rapid development of the Internet of Things, artificial intelligence, and communication technologies, smart living has become a mainstream trend in modern society. Various smart devices, such as kitchen appliances, smart home devices, environmental monitoring equipment, and security equipment, have been widely integrated into various scenarios. Furthermore, as users' demands for multi-device collaboration continue to increase, these smart devices are no longer isolated functional carriers.

[0029] For example, in a kitchen cooking scenario, the range hood needs to be automatically turned on and the corresponding airflow matched after the cooking equipment is started. After the oven finishes preheating, it sends a countdown signal to the rice cooker. The rice cooker then automatically adjusts its keep-warm status based on the oven's cooking time. In a smart home scenario, users expect to achieve coordinated responses for lighting adjustment, curtain control, air conditioning temperature adaptation, and security system arming through a single trigger condition. In an industrial control scenario, production equipment, testing instruments, and logistics devices need to work together to complete automated operation processes.

[0030] However, existing smart devices can only perform simple data interactions, such as transmitting basic on / off states and operating modes, which cannot support multi-device collaborative decision-making in complex business scenarios, nor can they achieve precise timing linkage and adaptive matching of device actions.

[0031] Based on this, this specification provides a collaborative control method for intelligent devices. The technical solutions provided by the various embodiments of this specification are described in detail below with reference to the accompanying drawings.

[0032] Figure 1 This is a flowchart illustrating a collaborative control method for an intelligent device provided in this specification, including the following steps: S101: Receive device data from the first smart device.

[0033] In this specification, the entity executing the collaborative control method for smart devices can be a control device independent of each smart device. This control device can be a cloud-based control device that establishes a communication connection with each smart device via a network. Alternatively, the control device can be deployed in the real environment where the smart devices operate. When deployed in a real environment, all the data required for executing collaborative control can be pre-stored therein.

[0034] In a specific embodiment, the entity executing the collaborative control method for intelligent devices provided in this specification is an intelligent agent. It can be deployed in the cloud.

[0035] The smart devices mentioned in this manual can be smart cooking appliances such as smart rice cookers, automatic ovens, induction cookers, high-speed blenders, and smart steamers, or other smart devices such as smart lights, electric curtains, security cameras, environmental sensors, and smart air conditioners. This manual does not make any specific limitations on these.

[0036] To ensure the security of smart device access, the control device can complete access verification and establish a dedicated communication link through pre-deployed intelligent agents.

[0037] Specifically, the control device can establish a communication link with the intelligent device by providing standardized device access verification and communication functions through the intelligent agent. When the intelligent device initiates an access request, it can call the session establishment interface with the intelligent agent and establish a session in the session establishment interface, thereby realizing the device's identity verification.

[0038] The access request can carry verification information corresponding to the smart device. The smart agent can verify the smart device based on the received verification information. After successful verification, a dedicated session channel is established between the smart agent and the smart device, and a session identifier is returned to the smart device. This session identifier can serve as a unique identifier for the smart device to transmit data subsequently, thereby ensuring the exclusivity and security of the communication link.

[0039] In this specification, the verification information may include the device identifier corresponding to the smart device and the key stored in the smart device. If the device identifier is stored in the preset device whitelist and the key sent by the first smart device matches the key maintained by the smart agent, it indicates that the smart device is legitimate and has collaborative control authority. At this time, it can be determined that the smart device has passed the verification.

[0040] There are several ways to match the key sent by the smart device with the key maintained by the smart agent, for example: The key in the smart device and the key maintained by the smart agent can be a unique symmetric key preset at the factory and stored in the control device in advance. When the smart device initiates access verification, it sends the key to the smart agent. The smart agent compares it with the unique symmetric key of the same device maintained locally. If the two are completely consistent, the key matching is completed. The keys in the smart device and the keys maintained by the smart agent can be public-private key pairs generated based on asymmetric encryption algorithms. The smart device stores the private key, and the smart agent maintains the corresponding public key. The smart device sends the information to the smart agent after signing and verifying it with the private key. The smart agent verifies the signature using the public key, thus achieving key matching and verification.

[0041] In practical applications, any connected smart device (hereinafter referred to as the first smart device) can send its current device data to the control device when it meets the preset event triggering conditions.

[0042] The first intelligent device can send device data to the intelligent agent in the control device through a pre-built dedicated session channel. The aforementioned event triggering conditions may include: The amount of data change of the specified data in the first smart device exceeds a preset threshold and / or the device state of the first smart device switches to a preset state.

[0043] For example, when the temperature change inside a smart rice cooker exceeds a preset threshold, it indicates that the cooking process has entered a new stage, requiring the cooperation of related devices to complete subsequent operations. Therefore, it can trigger the coordinated control of related devices. When a smart air conditioner switches from standby to cooling mode, it indicates that the user has an environmental temperature adjustment need, requiring the linkage of surrounding devices to adapt to the usage scenario. Therefore, it can trigger the coordinated control of related devices.

[0044] Of course, other triggering conditions can be set in practical applications, such as the data value of specified data reaching a preset value, or the preset data reporting time being reached. This manual does not make specific limitations on this.

[0045] The device data of the first smart device may include: The smart device's corresponding device status data (such as operating mode, working level, start / stop status, etc.) and the environmental sensing data collected by the smart device (such as temperature, humidity, oil fume concentration, light intensity, etc.).

[0046] In addition, after receiving the device data from the first intelligent device, the control device can first determine whether the data format of the device data conforms to the preset parsable data format, and whether the device data contains all the preset fields required to generate control instructions, so as to verify the device data. If the device data passes verification, the device data is associated with the session identifier of the first smart device and stored in the database.

[0047] For example, for smart cooking devices, the default format is JSON, and the fields for collaborative control include: device identifier, operating status, pot temperature, cooking mode, and remaining time. If the received device data is in JSON format and contains all of the above fields, then the device data is considered to have passed validation.

[0048] S102: Determine at least one second smart device associated with the first smart device in the business scenario corresponding to the device data, and query the device data of the second smart device in a preset database.

[0049] After receiving the device data from the first device, the control device can further determine the business scenario corresponding to the device data.

[0050] In this specification, different smart devices can perform different business scenarios, and therefore different smart devices can send device data belonging to different business scenarios.

[0051] For example, a smart range hood can send data such as the concentration of oil fumes and the fan speed in a kitchen exhaust scenario; a smart steam oven can send data such as the internal temperature, cooking mode, and remaining cooking time in a kitchen baking scenario; and a smart fruit and vegetable washing machine can send data such as the washing speed and water quality monitoring in a food washing scenario.

[0052] Furthermore, for smart devices with multiple functions, the same smart device can also execute multiple business scenarios, and therefore the same smart device can also send device data belonging to different business scenarios.

[0053] For example, a multi-functional rice cooker can send device data such as the temperature inside the pot, the heat preservation status, and the cooking progress for cooking rice; it can also send device data such as the heating power and cooking time for making soup; and it can also send device data such as the constant temperature setting and heat preservation time for keeping food warm.

[0054] Furthermore, there are several methods for determining the business scenario corresponding to device data. One method is for the control device to perform field matching on the device data based on preset field matching rules. If a field in the device data matches a preset field set corresponding to a business scenario, the business scenario corresponding to the device data can be directly determined. Alternatively, the control device can use an intelligent agent to call a pre-trained semantic parsing model to perform comprehensive semantic parsing and feature extraction on the device data. Combining the extracted data features, it can further infer the current operational requirements of the intelligent device, thereby determining the corresponding business scenario.

[0055] At the same time, the control device can identify one or more second intelligent devices associated with the first intelligent device in the business scenario corresponding to the device data.

[0056] The database can pre-store the relationships between various smart devices under different business scenarios. The relationships between smart devices will also differ for different business scenarios.

[0057] For example, in a business scenario involving high-temperature stir-frying in a kitchen, when the gas stove is in stir-fry mode (high temperature, large amount of oil fumes), the range hood needs to start high-speed smoke extraction simultaneously, and the fire alarm needs to improve its sensitivity to monitor open flame safety. Therefore, in this business scenario, the second intelligent device associated with the smart gas stove (the first intelligent device) can be a smart range hood and a smart fire alarm. For example, in a smart home scenario, after the smart door lock (the first smart device) detects the user's fingerprint unlocking action, the smart entryway light needs to automatically turn on and adjust to a soft brightness, the smart curtains need to remain closed to ensure privacy, and the smart air conditioner needs to automatically switch to a preset comfort mode based on the current indoor temperature. Therefore, in this business scenario, the second smart device associated with the smart door lock can be a smart entryway light, smart curtains, or a smart air conditioner. For example, in an industrial control scenario, after the intelligent robotic arm (the first intelligent device) grasps the parts to be assembled and moves them to the designated workstation, the intelligent conveyor belt needs to pause operation to ensure assembly accuracy, the intelligent torque wrench needs to start and complete the tightening operation of the parts according to preset parameters, and the intelligent quality inspection sensor needs to simultaneously enter the inspection state. Therefore, in this business scenario, the second intelligent device associated with the intelligent robotic arm can be the intelligent conveyor belt, the intelligent torque wrench, and the intelligent quality inspection sensor.

[0058] In this specification, the database may also pre-store the mapping relationship between each smart device and its corresponding session identifier.

[0059] After receiving the current device data, the control device can determine the device identifier corresponding to the first intelligent device based on its corresponding session identifier and the mapping relationship between each intelligent device and its corresponding session identifier. Then, based on the device identifier, the task identifier of the business scenario corresponding to the current device data, and the association relationship of each intelligent device in different business scenarios, the control device can determine the second intelligent device associated with the first intelligent device.

[0060] Furthermore, the control device can query the device data of the second smart device in the database. This second smart device may include multiple devices, and its device data may include historical device data sent by the second smart device in the past, as well as current device data uploaded by these associated devices at the same time.

[0061] In addition to querying the device data of the second intelligent device from the database, the control device can also query the historical device data of the first intelligent device to provide more accurate data support for the generation of control commands.

[0062] Furthermore, to ensure the timeliness and accuracy of decision-making in business scenarios, smart devices can generate a timestamp of the data collection time during the data upload process. This timestamp is then associated with and stored in the database. In this way, when the control device queries historical device data in the database, it can select historical device data whose time interval from the current moment is less than a preset time threshold based on the corresponding timestamp, thus avoiding the impact of outdated and invalid historical data on the final control commands.

[0063] The aforementioned preset time threshold can be set according to actual conditions, and this manual does not impose specific limitations on it.

[0064] S103 parses the device data of the first smart device and the device data of the second smart device to generate control instructions adapted to the linkage logic between the first smart device and the second smart device, and sends the control instructions to the corresponding smart device.

[0065] After obtaining the device data of the second smart device, the control device can integrate and parse the device data of the first smart device and the device data of the second smart device, thereby generating control instructions adapted to the linkage logic between the first smart device and the second smart device.

[0066] Furthermore, when both the device data of the first smart device and the device data of the second smart device contain current device data and historical device data, the control device can parse the current device data and historical device data of the first smart device, as well as the current device data and historical device data of the second smart device, to generate the aforementioned control instructions.

[0067] The aforementioned linkage logic is used to characterize the collaborative operation rules, action execution timing, and state matching requirements of the first and second intelligent devices in corresponding business scenarios. The control device can perform multi-dimensional feature extraction and fusion analysis on current device data, associated device data, and recent historical device data. Combined with preset device collaborative control strategies and the execution requirements of corresponding business scenarios, it generates control commands that conform to the inter-device linkage logic, have accurate timing, and are adapted to the actual business scenario.

[0068] Furthermore, the aforementioned control commands may include a first sub-control command for the first smart device and a second sub-control command for the second smart device.

[0069] The control device can send the first sub-control command and the second sub-control command to the first intelligent device and the second intelligent device through the intelligent agent. Then, it can obtain the device status after the first intelligent device executes the first sub-control command and the device status after the second intelligent device executes the second sub-control command, and update the historical device status (i.e. the device status stored in the local database of the control device).

[0070] The intelligent agent can simultaneously send the first sub-control command and the second sub-control command to the first intelligent device and the second intelligent device, respectively.

[0071] After the first intelligent device executes the first sub-control command, it can send its device status after executing the first sub-control command to the control device. After receiving the latest device status, the control device can update the previously stored historical device status of the first intelligent device.

[0072] Similarly, after the second intelligent device executes the second sub-control command, it can send its device status after executing the second sub-control command to the control device. After receiving the latest device status, the control device can update the previously stored historical device status of the second intelligent device.

[0073] In addition, in order to achieve the timing accuracy and action matching of the coordinated execution between devices, during the process of coordinating the control of each smart device, the control device can first send the first sub-control command to the first smart device. After the first smart device executes the first sub-control command, it can upload its corresponding device status to the control device to update its real-time operating status information in the database.

[0074] After determining its latest device status, the control device can further verify the consistency between the device status and the trigger status of the second sub-control command. If the device status matches the trigger status corresponding to the second sub-control command, it indicates that the first intelligent device has completed the preset action, meeting the prerequisite for the second intelligent device to execute in conjunction. At this time, the second sub-control command can be sent to the corresponding second intelligent device, thereby enabling the first and second intelligent devices to execute orderly coordinated actions according to the preset linkage logic.

[0075] Furthermore, in some smart device application scenarios, the control device is located in the cloud. To balance the need for network control capabilities with low-power, short-range linkage, two types of smart devices are typically used: dual-mode smart devices with both internet and Bluetooth communication capabilities, and single-mode smart devices with only Bluetooth communication capabilities. Since single-mode smart devices cannot directly access the internet to receive remote control commands, dual-mode smart devices are needed as relays to achieve indirect control of single-mode smart devices.

[0076] In this scenario, the control device can send the first sub-control command and the second sub-control command to the first smart device, and the first smart device can then transmit the second sub-control command to the second smart device via Bluetooth broadcast.

[0077] Specifically, when the first intelligent device is a dual-mode intelligent device and the second intelligent device is a single-mode intelligent device, the intelligent agent of the control device can first send a data packet carrying the first sub-control instruction and the second sub-control instruction to the first intelligent device. After receiving the data packet, the first intelligent device can parse out the first sub-control instruction and the second sub-control instruction from it.

[0078] The first smart device can then execute the first sub-control command and send its device status after executing the first sub-control command to the smart agent. After receiving its device status, if the smart agent determines that its device status matches the trigger status corresponding to the second sub-control command, the first smart device will transmit the second control command to the second smart device via Bluetooth broadcast, so that the smart device can execute the second sub-control command.

[0079] It should be added that before sending the sub-control command to the second intelligent device, the control device can send control prompts to the user terminal through pop-up reminders, APP push messages, voice broadcasts, etc., such as "The intelligent gas stove has been detected to be in high-heat mode. The intelligent range hood can be activated to exhaust smoke at high speed and the fire alarm sensitivity can be increased. Do you confirm to execute the linkage operation?" When the user confirms the operation, the corresponding control command is sent to the second intelligent device, thereby ensuring that the linkage operation of the device conforms to the user's true intention and avoiding unexpected linkage actions that may cause interference or safety hazards to the user.

[0080] To further ensure the real-time nature of device linkage, the control device can predict status trends based on the real-time operating data of the first intelligent device. When it is calculated from the device data of the first intelligent device that it will reach the trigger state of the second sub-control command after a preset time (which can be set according to actual conditions), a control prompt can be sent to the user terminal in advance. When the user performs a confirmation operation and the first intelligent device reaches the preset trigger state, the second sub-control command is automatically issued to the corresponding second intelligent device. In this way, user operation authorization can be obtained in advance, avoiding user confirmation delays caused by real-time triggering, while ensuring the precise timing of device linkage actions, improving the smoothness of overall collaborative control and user experience.

[0081] Furthermore, when there are no prerequisite execution timing requirements for the first and second sub-control commands, the corresponding sub-control commands can be sent to the first and second intelligent devices simultaneously to achieve synchronous control of multiple devices.

[0082] In addition, when there are multiple second intelligent devices, the control device can issue corresponding second sub-control commands to each second intelligent device sequentially or synchronously according to the preset linkage priority and the device status of each second intelligent device, so as to ensure that multiple related devices cooperate in an orderly manner according to the linkage logic.

[0083] In practical applications, there are some second intelligent devices that need to maintain their original state. In this case, not all associated second intelligent devices need to perform action adjustments. Therefore, the aforementioned second sub-control command can be a control command for some second intelligent devices. The control device can determine the intelligent devices that need to perform collaborative actions among the second devices based on the device status of each second intelligent device and the parsing results of each device's data, and then issue the corresponding second sub-control command to these second intelligent devices. The remaining second intelligent devices that do not receive the second sub-control command maintain their current operating state.

[0084] Furthermore, this specification also provides a schematic diagram of a cooperative control system, such as... Figure 2 As shown.

[0085] Figure 2 This is a schematic diagram of a collaborative control system provided in this specification.

[0086] The collaborative control system may include intelligent devices and control devices, with intelligent agents and databases deployed in the control devices.

[0087] A smart device can first establish a session by calling the session establishment interface with the smart agent, thereby sending an access request. After receiving the access request, the smart agent can verify the identity of the smart device based on the device identifier and key carried in the request, and return a unique session identifier to the smart device after successful verification.

[0088] During the execution of actual tasks by a smart device, when the event triggering conditions are met, the device can send current device data to the smart agent. After receiving the data, the smart agent can perform compliance verification, and after the verification is successful, it can associate the device data with the smart device's session identifier and store it in the database.

[0089] At the same time, the intelligent agent can identify other intelligent devices associated with the intelligent device in the business scenario corresponding to the data of the intelligent device, and query the relevant device data in the database. This device data is then integrated and parsed to generate collaborative control commands.

[0090] After generating the collaborative control command, the intelligent agent can send it to the corresponding intelligent device. After receiving and executing the control command, the intelligent device uploads the execution result and its own status information to the intelligent agent, and the intelligent agent updates the device status stored in the database.

[0091] To further understand the solution, the following will use a kitchen cooking scenario as an example to illustrate the aforementioned intelligent control system. Figure 3 As shown.

[0092] Figure 3 This manual provides a schematic diagram of a system control system applied in a cooking scenario.

[0093] The collaborative control process of this control system for intelligent devices includes the following steps: Dialogue Establishment: After the oven starts, it sends an access request to the agent through the dialogue establishment interface. The access request contains the oven's unique identifier and device key. The agent queries the device whitelist, confirms that the identifier is valid and the key matches, completes the identity verification, establishes a dedicated communication dialogue, and returns the session ID "SESSION001" to the oven.

[0094] Device data reporting: The oven reports real-time data according to a preset mechanism. When the temperature inside the oven reaches the preset cooking temperature of 180℃, an event is triggered to report the data, which includes: Session ID "SESSION001", Device type "Oven", Data type "Current temperature", Value "180℃", and Timestamp "xxx".

[0095] Data storage and data linkage: After receiving data, the intelligent agent verifies that the required fields are complete and the format is compliant, and stores the associated session ID in the database. At the same time, based on the business scenario of kitchen cooking, it queries the real-time data of the associated devices refrigerator and rice cooker in the database to obtain information such as "the steak ingredients have been thawed" in the refrigerator and "the rice cooker is in standby mode". After integrating the above data, it generates a collaborative control command: "Maintain a constant temperature of 180℃ for 20 minutes, and notify the rice cooker to start the keep-warm program after heating is completed", and sends it to the oven.

[0096] Command execution and status feedback: After receiving the collaborative command, the oven performs constant temperature heating. After 20 minutes, heating is completed, and then it reports its status information and execution result to the agent: "Command executed successfully, current oven temperature 180℃, heating has stopped", with a timestamp "xxx"; After receiving the feedback, the agent updates the oven status to "standby" in the database and sends a start keep-warm command to the rice cooker. After the rice cooker executes the command, it reports "Keep-warm program started successfully, current temperature 60℃". The agent updates the rice cooker status synchronously, completing the closed-loop control.

[0097] In addition, if the oven malfunctions during constant temperature heating and cannot maintain a temperature of 180°C, the feedback result will be "Command execution failed, reason for failure: heating element failure, current oven temperature is 150°C, has stopped running". After receiving the information, the intelligent agent will update the database status, generate a correction command and send it to the oven (prompting a fault), adjust the collaborative logic, and send a fault reminder to the user terminal to prevent the rice cooker from accidentally starting the keep-warm program.

[0098] As can be seen from the above method, this solution can accurately match the associated smart devices corresponding to the business scenario, synchronously query the device data of the relevant smart devices, and then generate control commands adapted to the linkage logic between devices based on these data. This solution breaks through the industry pain points of independent operation of existing smart devices and fragmented control logic, realizes intelligent and precise linkage of multiple devices according to actual scenario needs, and greatly improves the collaborative operation capability of smart device clusters.

[0099] Following the same approach, this manual also provides corresponding collaborative control devices for intelligent devices, such as... Figure 4 As shown.

[0100] Figure 4 This specification provides a schematic diagram of a collaborative control device for an intelligent device, including: Receiver module 401 is used to receive device data from the first smart device; The query module 402 is used to determine at least one second smart device associated with the first smart device in the business scenario corresponding to the device data, and to query the device data of the second smart device in a preset database. The control module 403 is used to parse the device data of the first smart device and the device data of the second smart device to generate control instructions adapted to the linkage logic between the first smart device and the second smart device, and send the control instructions to the corresponding smart device.

[0101] Optionally, the receiving module 401 is further configured to receive verification information sent by the first smart device; wherein the verification information is uploaded by the first smart device through establishing a session in the session establishment interface after calling the session establishment interface with the smart agent; according to the verification information, the first smart device is verified for identity, and if the verification is successful, the corresponding session identifier is returned to the first smart device, so that the first smart device uploads device data to the smart agent based on the session identifier.

[0102] Optionally, the receiving module 401 is specifically used to receive device data from the first smart device when a preset event triggering condition is detected; wherein the event triggering condition includes: the amount of data change of specified data in the first smart device exceeds a preset threshold, and / or the device state of the first smart device switches to a preset state.

[0103] Optionally, the query module 402 is further configured to determine whether the data format of the device data of the first smart device conforms to a preset parsable data format, and whether the device data of the first smart device contains all the preset fields required to generate the control command, so as to verify the device data of the first smart device; if the device data of the first smart device passes the verification, the device data of the first smart device is associated with the session identifier and stored in the database.

[0104] Optionally, the database pre-stores the mapping relationship between each smart device and its corresponding session identifier, as well as the association relationship between each smart device in different business scenarios; The query module 402 is specifically used to: determine the device identifier corresponding to the first smart device based on the session identifier corresponding to the first smart device and the mapping relationship; and determine the second smart device based on the device identifier, the task identifier of the business scenario, and the association relationship.

[0105] Optionally, the device data of the second smart device includes: the current device data and historical device data of the second smart device; The control module 403 is specifically used to query the historical device data of the first smart device in a preset database; and to parse the current device data and historical device data of the first smart device, as well as the current device data and historical device data of the second smart device, to generate the control command.

[0106] Optionally, the control command includes a first sub-control command for the first smart device and a second sub-control command for the second smart device; The control module 403 is specifically used to synchronously send the first sub-control command and the second sub-control command to the first smart device and the second smart device. The device status of the first intelligent device after executing the first sub-control instruction and the device status of the second intelligent device after executing the second sub-control instruction are obtained, and the historical device status is updated. Alternatively, the first sub-control instruction can be sent to the first smart device, and the device status after the first smart device executes the first sub-control instruction can be obtained; If the device status matches the trigger status corresponding to the second sub-control command, then the second sub-control command is sent to the corresponding second smart device.

[0107] Optionally, the control command includes a first sub-control command for the first smart device and a second sub-control command for the second smart device. The control module 403 is specifically used to send the first sub-control command and the second sub-control command to the first smart device, and the first smart device transmits the second sub-control command to the second smart device via Bluetooth broadcast.

[0108] This specification also provides a computer-readable storage medium storing a computer program that can be used to execute the above-described... Figure 1 The provided method for collaborative control of intelligent devices.

[0109] This instruction manual also provides Figure 5 One of the corresponding Figure 1 A schematic diagram of the structure of an electronic device. (e.g.) Figure 5 At the hardware level, the electronic device includes a processor, internal bus, network interface, memory, and non-volatile memory, and may also include other hardware required for the business operations. The processor reads the corresponding computer program from the non-volatile memory into memory and then runs it to achieve the above-mentioned functions. Figure 1 The method for collaborative control of intelligent devices is described above. Of course, besides software implementation, this specification does not exclude other implementation methods, such as logic devices or a combination of hardware and software, etc. That is to say, the execution entity of the following processing flow is not limited to individual logic units, but can also be hardware or logic devices.

[0110] The systems, devices, modules, or units described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, a computer can be, for example, a personal computer, laptop computer, cellular phone, camera phone, smartphone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or any combination of these devices.

[0111] For ease of description, the above devices are described in terms of function, divided into various units. Of course, in implementing this specification, the functions of each unit can be implemented in one or more software and / or hardware components.

[0112] Those skilled in the art will understand that embodiments of this specification can be provided as methods, systems, or computer program products. Therefore, this specification may take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this specification may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0113] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0114] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0115] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0116] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0117] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0118] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0119] Those skilled in the art will understand that the embodiments of this specification can be provided as methods, systems, or computer program products. Therefore, this specification may take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this specification may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0120] This specification can be described in the general context of computer-executable instructions that are executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform a specific task or implement a specific abstract data type. This specification can also be practiced in distributed computing environments, where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0121] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to interchangeably. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0122] The above description is merely an embodiment of this specification and is not intended to limit this specification. Various modifications and variations can be made to this specification by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this specification should be included within the scope of the claims of this specification.

Claims

1. A collaborative control method for intelligent devices, characterized in that, include: Receive device data from the first smart device; Identify at least one second smart device associated with the first smart device in the business scenario corresponding to the device data, and query the device data of the second smart device in a preset database; The device data of the first smart device and the device data of the second smart device are parsed to generate control instructions adapted to the linkage logic between the first smart device and the second smart device, and the control instructions are sent to the corresponding smart devices.

2. The method as described in claim 1, characterized in that, The method is applied to an intelligent agent, and before receiving device data from the first intelligent device, the method further includes: Receive verification information sent by the first smart device; wherein, the verification information is uploaded by the first smart device through the session establishment interface after calling the session establishment interface with the smart agent; Based on the verification information, the identity of the first smart device is verified, and if the verification is successful, its corresponding session identifier is returned to the first smart device, so that the first smart device can upload device data to the smart agent based on the session identifier.

3. The method as described in claim 1, characterized in that, Receive device data from the first smart device, specifically including: If a preset event triggering condition is detected, device data from the first smart device is received; The event triggering conditions include: the amount of data change of specified data in the first smart device exceeds a preset threshold, and / or the device state of the first smart device switches to a preset state.

4. The method as described in claim 1, characterized in that, Before determining the second smart device associated with the first smart device in the business scenario, the method further includes: The device data of the first smart device is verified by determining whether the data format of the device data conforms to a preset parsable data format and whether the device data of the first smart device contains all the preset fields required to generate the control command. If the device data of the first smart device passes the verification, the device data of the first smart device is associated with the session identifier of the first smart device and stored in the database.

5. The method as described in claim 1, characterized in that, The database pre-stores the mapping relationship between each smart device and its corresponding session identifier, as well as the association relationship between each smart device in different business scenarios. Identify a second intelligent device associated with the first intelligent device within the business scenario corresponding to the device data, specifically including: Based on the session identifier corresponding to the first smart device and the mapping relationship, the device identifier corresponding to the first smart device is determined; The second smart device is determined based on the device identifier, the task identifier of the business scenario, and the association relationship.

6. The method as described in claim 1, characterized in that, The device data of the second smart device includes: the current device data and historical device data of the second smart device; The device data of the first smart device and the device data of the second smart device are parsed, specifically including: Query the historical device data of the first smart device in the preset database; The control command is generated by parsing the current and historical device data of the first smart device and the current and historical device data of the second smart device.

7. The method according to any one of claims 1 to 6, wherein the control command includes a first sub-control command for the first intelligent device and a second sub-control command for the second intelligent device; Sending the control command to the corresponding smart device specifically includes: The first sub-control command and the second sub-control command are sent synchronously to the first smart device and the second smart device. The device status of the first intelligent device after executing the first sub-control instruction and the device status of the second intelligent device after executing the second sub-control instruction are obtained, and the historical device status is updated. Alternatively, the first sub-control instruction can be sent to the first smart device, and the device status after the first smart device executes the first sub-control instruction can be obtained; If the device status matches the trigger status corresponding to the second sub-control command, then the second sub-control command is sent to the corresponding second smart device.

8. The method according to any one of claims 1-6, wherein the control command includes a first sub-control command for the first smart device and a second sub-control command for the second smart device; Sending the control command to the corresponding smart device specifically includes: Send the first sub-control command and the second sub-control command to the first smart device. The first smart device transmits the second sub-control command to the second smart device via Bluetooth broadcast.

9. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the method described in any one of claims 1 to 8.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the method described in any one of claims 1 to 8.

Images