Intelligent equipment control method, cloud server, equipment and storage medium

By using a cloud server to determine the target device based on the smart device's operating mode information and sending control commands, the distance and stability issues of existing smart device control methods are resolved, achieving greater flexibility and intelligence and improving the user experience.

CN119270737APending Publication Date: 2025-01-07SHANGHAI XIAODU TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411480948.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-22
Publication Date
2025-01-07

AI Technical Summary

Technical Problem

Existing intelligent device control methods suffer from problems such as short control distance, poor stability, and limited control capabilities, which reduce the user experience.

Method used

The target device is determined by the cloud server based on the working mode information of the first device, and control commands are sent to control it. It supports arbitrary control commands and achieves more flexible and intelligent control.

Benefits of technology

It enhances the flexibility, intelligence, and system stability of intelligent device control, meets users' diverse control needs, and significantly improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119270737A_ABST
    Figure CN119270737A_ABST
Patent Text Reader

Abstract

The invention provides an intelligent equipment control method, a cloud server, equipment and a storage medium, and relates to the technical field of data processing, in particular to the technical fields of artificial intelligence, Internet of Things and the like. According to the specific implementation scheme, the method comprises the steps of determining mode information of a current working mode of first equipment based on control data uploaded by the first equipment; determining a target device needing to be controlled according to the mode information of the current working mode of the first device; and sending a control instruction determined based on the control data to the target device to control the target device to execute the control instruction.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to technical fields such as artificial intelligence and the Internet of Things. Background Art

[0002] With the development of Internet of Things technology, intelligent control has become an important development direction. For example, in smart home scenarios, smart speakers can simulate infrared codes or Bluetooth technologies to control TVs. However, existing control methods have problems such as short control distance, poor stability, and single control capabilities, which reduce user experience. Summary of the invention

[0003] The present disclosure provides a smart device control method, a cloud server, a device and a storage medium.

[0004] According to one aspect of the present disclosure, there is provided a smart device control method, comprising:

[0005] Determine, based on the control data uploaded by the first device, mode information of the current working mode of the first device;

[0006] Determining a target device to be controlled according to mode information of a current working mode of the first device; and

[0007] The control instruction determined based on the control data is sent to the target device to control the target device to execute the control instruction.

[0008] According to another aspect of the present disclosure, there is provided a cloud server, comprising:

[0009] a mode determination unit, configured to determine mode information of a current working mode of the first device based on the control data uploaded by the first device;

[0010] a device determining unit, configured to determine a target device to be controlled according to mode information of a current working mode of the first device; and

[0011] The instruction sending unit sends the control instruction determined based on the control data to the target device to control the target device to execute the control instruction.

[0012] According to another aspect of the present disclosure, there is provided an electronic device, comprising:

[0013] at least one processor; and

[0014] a memory communicatively connected to the at least one processor; wherein,

[0015] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute any method in the embodiments of the present disclosure.

[0016] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute any method according to the embodiments of the present disclosure.

[0017] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, which implements any method according to the embodiments of the present disclosure when executed by a processor.

[0018] The disclosed solution can utilize the mode information of the current working mode of the acquired first device to determine the smart device to be controlled (i.e., the target device), and then send a control instruction to the smart device to control the smart device to execute the control instruction. In this way, the cloud is used to control the smart device. Compared with the existing control method, this method has higher flexibility, intelligence and system stability.

[0019] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0021] Figure 1 This is a schematic flow chart of a smart device control method according to an embodiment of the present application. Figure 1 ;

[0022] Figure 2 This is a schematic flow chart of a smart device control method according to an embodiment of the present application. Figure 2 ;

[0023] FIG3( a ) is a schematic diagram of a scenario in which the Lingxi mode of the smart speaker is enabled according to an embodiment of the present application;

[0024] FIG. 3( b ) and FIG. 3( c ) are schematic diagrams of the Lingxi mode usage scenario interface according to an embodiment of the present application;

[0025] FIG3( d ) is a schematic diagram of a scenario in a specific example of a smart device control method according to an embodiment of the present application;

[0026] Figure 4 is a schematic diagram of an interaction scenario of a smart device according to an embodiment of the present application;

[0027] Figure 5 is a schematic flowchart of a smart device control method according to an embodiment of the present application;

[0028] FIG6( a ) is a schematic diagram of a scenario of exiting a target mode of a smart speaker according to an embodiment of the present application;

[0029] FIG6( b ) is a flowchart of controlling resource playback in Lingxi mode according to an embodiment of the present application;

[0030] Figure 7 is a schematic diagram of the structure of a cloud server according to an embodiment of the present application;

[0031] Figure 8 It is a block diagram of an electronic device used to implement the intelligent device control method of the embodiment of the present disclosure. DETAILED DESCRIPTION

[0032] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope of the present disclosure. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0033] The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there may be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The term "at least one" in this article means any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C. The terms "first" and "second" in this article refer to multiple similar technical terms and distinguish them. They do not mean to limit the order or to limit them to only two. For example, the first feature and the second feature refer to two types / two features. The first feature can be one or more, and the second feature can also be one or more.

[0034] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the specific embodiments below. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the main purpose of the present disclosure.

[0035] The disclosed solution provides a smart device control method, which can make the smart control between different devices more stable without being limited by distance requirements, so as to meet the user's diverse needs for smart control, thereby effectively improving the user experience.

[0036] Specifically, Figure 1 This is a schematic flow chart of a smart device control method according to an embodiment of the present application. Figure 1 The method may be optionally applied to electronic devices, such as personal computers, servers, server clusters, and other electronic devices.

[0037] Further, the method includes at least part of the following contents. Figure 1 As shown, the smart device control method is applied to the cloud, including:

[0038] Step S101: The cloud determines mode information of the current working mode of the first device based on the control data uploaded by the first device.

[0039] For example, in one example, the control data uploaded by the first device may be obtained based on input from the target object, such as voice data, gesture operation or text information of the target object.

[0040] Further, in one example, the control data carries mode information for describing the current working mode of the first device. Alternatively, in another example, the cloud can obtain the mode information of the current working mode of the first device based on the control data uploaded by the first device. The disclosed solution does not impose specific restrictions on this.

[0041] Step S102: The cloud determines the target device to be controlled according to the mode information of the current working mode of the first device.

[0042] Step S103: The cloud sends the control instruction determined based on the control data to the target device to control the target device to execute the control instruction.

[0043] That is to say, in this example, after the first device uploads the control data to the cloud corresponding to the first device, the cloud determines the mode information of the current working mode of the first device based on the control data, and then determines the target device to be controlled, so as to send the control instructions determined based on the control data to the target device. In other words, in this example, the cloud can be used to achieve intelligent control. Compared with the existing control method, this method has higher flexibility and system stability, and is not limited to distance limitations.

[0044] In this way, the disclosed solution can utilize the mode information of the current working mode of the first device to determine the smart device to be controlled (i.e., the target device), and then send a control instruction to the smart device to control the smart device to execute the control instruction. In this way, the cloud is used to control the smart device. Compared with the existing control method, this method has higher flexibility, intelligence and system stability.

[0045] In addition, since the disclosed solution does not restrict control instructions, in other words, it can be any control instruction, so the disclosed solution can support more and more complex control operations, and the control is more diversified, thus meeting the user's high standards and diversified needs for intelligent control, thereby effectively improving the user experience.

[0046] Furthermore, since the disclosed solution can upload the control requirements obtained by the first device to the corresponding cloud, and send the determined control instructions to the target device to be controlled through the cloud, the control distance between different devices (such as the first device and the target device) is no longer limited, the control method is more flexible, and the user experience is further improved.

[0047] Furthermore, in a specific example, the control instruction can also be obtained in the following manner: specifically, before the cloud sends the control instruction determined based on the control data to the target device, for example, before the above step S103, the method further includes: performing intent recognition on the control data, obtaining the intent recognition result corresponding to the control data, and generating the control instruction according to the intent recognition result. In this way, the user's control needs are accurately understood, which provides technical support for the subsequent accuracy and timeliness of intelligent control, and thus lays the foundation for improving the user experience.

[0048] It should be pointed out that in actual applications, the intent of control data can be identified based on a natural language model, or based on preset rules, etc. The present disclosure does not impose any specific restrictions on this.

[0049] In a specific example of the disclosed solution, the target device is the first device, or a second device associated with the first device. In this way, the flexibility and intelligence of the control method in the disclosed solution are improved, and the user experience is enhanced.

[0050] Furthermore, in one example, the first device may be a smart speaker, for example, a smart screen speaker. At this time, in one example, in a smart home scenario, the voice data collected by the smart speaker may be used as control data.

[0051] Furthermore, in another example, the second device is a television control device capable of adjusting television channels.

[0052] In other words, in one example, in a scenario where a smart speaker controls a TV control device, the first device is a smart speaker. In this case, the target device may be the smart speaker or may be a TV control device (e.g., a set-top box) associated with the smart speaker and capable of adjusting TV channels.

[0053] That is to say, the disclosed solution can be applied to the scenario where a smart speaker controls a TV control device. In this scenario, the target object can control the TV control device based on the smart speaker and through voice and other means, and then control the adjustment of the TV channel. Compared with the existing control methods such as infrared code or Bluetooth, the control method provided by the disclosed solution has higher flexibility, convenience, and system stability, and is not limited to distance limitations.

[0054] Moreover, the disclosed solution can also take into account the scenario of cloud-controlled smart speakers. In other words, it can control the TV control device without changing the cloud-controlled smart speakers. This further meets the user's diverse control needs and further improves the user experience.

[0055] Furthermore, in a specific example, Figure 2 As shown, the smart device control method may specifically include:

[0056] Step S201: The cloud determines mode information of the current working mode of the first device based on the control data uploaded by the first device.

[0057] For example, in one example, the cloud determines the mode information of the current working mode of the smart speaker based on the control data uploaded by the smart speaker (such as a smart screen speaker, corresponding to the first device described above).

[0058] Here, the relevant content about the control data can refer to the above examples, which will not be repeated here.

[0059] For example, in one example, taking the example of controlling a TV control device (such as a set-top box) through a smart speaker, the target object can turn on the working mode of the smart speaker through voice or other gesture operations. For example, in one example, as shown in FIG3(a), the smart speaker can be triggered to enter the Lingxi mode (that is, the target mode described above) in a variety of ways; specifically:

[0060] Method 1: Application (Application, App) external command trigger; that is, the target object sends a voice command "Watch XXX on TV" (also known as a channel control command) to the smart speaker. At this time, the smart speaker responds to the voice command and generates an opening request to open the Lingxi Time App (also known as the TV control APP), and initiates the opening request to the cloud to request to open the Lingxi Time App and enter the Lingxi mode; further, if the request is successful, the smart speaker opens the Lingxi Time App and pops up a window to prompt to enter the Lingxi mode. Furthermore, after entering the Lingxi mode, the smart speaker can further respond to the voice command "Watch XXX on TV", for example, further switch to the "XXX" channel or "XXX" program.

[0061] Method 2: Triggered by internal instructions of the application (Application, App); that is, in the scenario where the smart speaker opens the Lingxi Time App, it responds to the startup instruction of "turn on Lingxi mode" (which can be a voice command or a gesture command, etc.). At this time, the smart speaker responds to the startup instruction and generates a mode request to enter Lingxi mode, and initiates the mode request to the cloud to request to enter Lingxi mode.

[0062] Method three: triggered by a click inside the application (Application, App); that is, in the scenario where the smart speaker opens the Lingxi Time App, as shown in Figure 3(b), a start button for "Lingxi Mode" (or prompt information such as "TV Watching") is set. At this time, the smart speaker responds to the touch operation of the start button, and generates a mode request to enter the Lingxi mode, and initiates the mode request to the cloud to request to enter the Lingxi mode.

[0063] It should be noted that the terminal status can also be recorded on the smart speaker to record the current working mode; for example, after the smart speaker enters the Lingxi mode, the terminal status can be modified accordingly to record that it is currently in the Lingxi mode.

[0064] Furthermore, it should be noted that, in one example, the control data uploaded by the smart speaker may carry the terminal status, so that the cloud can determine the current working mode of the smart speaker based on the terminal status. For example, in one example, when the smart speaker enters the Lingxi mode and the smart speaker marks the terminal status as "Lingxi mode", the control data uploaded by the smart speaker thereafter will carry the terminal status. In this way, the cloud can determine the working mode of the smart speaker based on the terminal status uploaded by the smart speaker, such as whether it is in the target mode, and then accurately identify the smart devices that need to be controlled, thereby improving the system's response speed and operation accuracy.

[0065] Alternatively, in another example, when the smart speaker enters Lingxi mode and the smart speaker marks the end state as "Lingxi mode", and at the same time, does not exit "Lingxi mode", the smart speaker can carry the end state in the uploaded control data when the end state changes. In other words, when the end state does not change, there is no need to carry the end state in the uploaded control data.

[0066] Furthermore, for the receiving end, that is, the cloud, the smart speaker may initiate a request, for example, after the three types of requests described above are successful, the terminal status of the smart device will be marked on the cloud. At this time, after the smart speaker subsequently uploads control data, the current working mode of the smart speaker can be determined from the terminal status recorded by itself.

[0067] Furthermore, it should be noted that after entering the Lingxi mode, the cloud can further detect the communication link with the TV control device to ensure that the control instructions can be sent to the TV control device in a timely manner, thereby controlling the regulation of the TV channels.

[0068] It should be pointed out that the above is only an example. In actual application, it can also be set based on actual needs, and the present disclosure does not impose specific limitations on this.

[0069] Step S202: The cloud determines whether the first device is in the target mode based on the mode information of the current working mode of the first device. If so, it proceeds to step S203, otherwise it proceeds to step S204.

[0070] For example, in one example, the cloud determines whether the smart speaker (corresponding to the first device described above) is in the target mode based on the mode information of the current working mode of the smart speaker. If so, it goes to step S203, otherwise it goes to step S204.

[0071] For example, taking the example of controlling a TV control device (such as a set-top box) through a smart speaker, the cloud can also determine whether the smart speaker (such as a smart screen speaker) is in Lingxi mode by judging whether the Lingxi mode pop-up window is visible. For example, if the Lingxi mode pop-up window on the smart speaker is visible, it is determined that the smart speaker is in Lingxi mode, otherwise the smart speaker is not in Lingxi mode.

[0072] Here, in this example, the target mode represents the mode in which the first device needs to control the second device. Furthermore, for example, in the scenario where the smart speaker controls the TV control device, the target mode can be specifically expressed as the mode in which the smart speaker needs to control the TV control device. In this case, the target mode can also be called the TV control mode.

[0073] It should be noted that in the above example, in order to support the target mode, it is also necessary to establish a link between the cloud and the TV control device, for example, the TV control device is bound to the cloud through a smart speaker in advance, so that the cloud can send control instructions to the TV control device. In this way, the target mode does not need to rely on communication technologies such as local area network, infrared remote control and Bluetooth, thereby providing a more flexible and stable intelligent control method.

[0074] It should be noted that in actual scenarios, if you want to use the target mode described above, you also need to meet the following conditions:

[0075] (1) The cloud is bound to the device information (such as account) of the TV control device.

[0076] (2) The bound TV control device and the TV controlled by the TV control device are turned on.

[0077] (3) After the target mode is turned on, the target mode pop-up window on the smart speaker (e.g., smart screen speaker) needs to be kept displayed in the foreground. For example, as shown in FIG3(c), the Lingxi mode pop-up window is always displayed on the smart speaker screen. In other words, the target mode is currently at the top layer of all applications.

[0078] Step S203: When the cloud determines that the first device is in the target mode, the second device is used as the target device, and the process proceeds to step S205.

[0079] For example, in one example, when the cloud determines that the smart speaker is in target mode, the TV control device is used as the target device, and the process proceeds to step S205.

[0080] Step S204: When the cloud determines that the first device is not in the target mode, the first device is used as the target device, and the process proceeds to step S205.

[0081] For example, in one example, when the cloud determines that the smart speaker is not in the target mode, the smart speaker is used as the target device, and the process proceeds to step S205.

[0082] Step S205: The cloud sends the control instruction determined based on the control data to the target device to control the target device to execute the control instruction.

[0083] For example, continuing to take the example of controlling a TV control device (such as a set-top box) through a smart speaker, as shown in Figure 3(d), after the smart speaker uploads the control data to the cloud, the cloud determines the mode information of the current working mode of the smart speaker based on the received control data. For example, the cloud determines the current working mode of the smart speaker based on the received terminal status of the smart speaker, and then determines whether the smart speaker is in Lingxi mode (that is, corresponding to the target mode described above); further, when the smart speaker is in Lingxi mode, it is determined that the device to be controlled is the TV control device (such as a set-top box) associated with the smart speaker. At this time, the control instruction determined based on the control data will be sent to the TV control device to control the TV control device to execute the control instruction, thereby realizing the regulation of the TV channel.

[0084] Alternatively, when the smart speaker is not in Lingxi mode, it is determined that the device to be controlled is the smart speaker, and then the control instruction determined based on the control data is sent to the smart speaker to control the smart speaker to execute the control instruction.

[0085] It should be noted that the control instructions can be used to control the TV to perform at least one of the following operations: switching TV channels, searching TV channels, adjusting the playback progress (such as fast forward, fast rewind), pausing, adjusting the volume, etc.

[0086] The above is only an example. In actual application, the control instruction can be any instruction that can control the TV, and the disclosed solution is not limited to this.

[0087] In this way, the disclosed solution can determine the smart device to be controlled (i.e., the target device) according to the mode information of the current working mode of the first device (e.g., smart speaker), and then send the control command to the smart device. In this way, the cloud is used to control the smart device. Compared with the existing control method, this method has higher flexibility, intelligence, and system stability, and is not limited by the control distance. In addition, the disclosed solution does not restrict the control command, and thus supports more and more complex control operations, meeting the user's high standards and diversified needs for intelligent control, thereby significantly improving the user experience.

[0088] For example, take the example of controlling a TV control device (such as a set-top box) through a smart speaker. Figure 4As shown, first, the device information of the TV control device is pushed to the cloud (such as the Lingxi Time service in the cloud) through the smart speaker end to bind the TV control device to the cloud corresponding to the smart speaker end; the TV control device can also push relevant data to the cloud. Secondly, after the smart speaker end (such as the Lingxi Time App) uploads the control data to the cloud, the cloud determines whether the smart speaker end is in Lingxi mode based on the end status of the smart speaker. If the smart speaker is in Lingxi mode, the cloud sends the control command to the TV control device on the TV end. Further, the TV control device sends the internal command corresponding to the control command to the TV to adjust the TV channel. If the smart speaker end is not in Lingxi mode, the cloud sends the control command to the smart speaker end. In this way, the disclosed solution can effectively use the cloud to control smart devices, thus effectively improving the flexibility, intelligence and system stability of smart control, and is no longer constrained by the control distance, thereby significantly improving the user experience.

[0089] Figure 5 FIG3 is a schematic flow chart of a method for controlling an intelligent device according to an embodiment of the present application. The method can optionally be applied to electronic devices, such as personal computers, servers, server clusters, and other electronic devices. It can be understood that the above Figures 1 to 4 The relevant contents of the method shown can also be applied to this example, and the relevant contents will not be described in detail in this example.

[0090] Further, the method includes at least part of the following contents. Specifically, Figure 5 As shown, the intelligent control method is applied in the cloud, including:

[0091] Step S501: The cloud determines mode information of the current working mode of the first device based on the control data uploaded by the first device.

[0092] For example, in one example, the cloud determines the mode information of the current working mode of the smart speaker (such as a smart screen speaker) based on the control data uploaded by the smart speaker.

[0093] Here, the relevant content about the control data can refer to the above examples, which will not be repeated here.

[0094] Step S502: The cloud determines whether the first device is in the target mode based on the mode information of the current working mode of the first device. If so, it proceeds to step S503, otherwise it proceeds to step S505.

[0095] For example, in one example, the cloud determines whether the smart speaker is in the target mode based on the mode information of the current working mode of the smart speaker. If so, it goes to step S503, otherwise it goes to step S505.

[0096] Here, in this example, the target mode indicates the mode in which the first device needs to control the second device. For example, in a scenario in which a smart speaker controls a TV control device, the target mode indicates the mode in which the smart speaker needs to control the TV control device. In this case, the target mode can also be called a TV control mode.

[0097] Step S503: When the cloud determines that the first device is in the target mode, it determines whether the first device meets the exit condition for exiting the target mode. If so, it proceeds to step S505; otherwise, it proceeds to step S504.

[0098] For example, in one example, when the cloud determines that the smart speaker is in the target mode, it determines whether the smart speaker meets the exit conditions for exiting the target mode. If so, it goes to step S505; otherwise, it goes to step S504.

[0099] Here, in this example, the exit condition for exiting the target mode may be a request instruction to exit the target mode issued by the target object on the smart speaker through a voice command (such as "exit target mode") or a click operation (such as clicking the exit button on the smart screen speaker) (also referred to as an active exit condition), or, it may also be that the priority of the non-target mode of the smart speaker (such as a call mode, other modes that cause the pop-up window of the target mode to be covered, etc.) is greater than the priority of the target mode (also referred to as a passive exit condition), and the present disclosure does not impose specific restrictions on this.

[0100] Step S504: When the cloud determines that the first device does not meet the exit condition for exiting the target mode, the second device is used as the target device, and the process proceeds to step S506.

[0101] For example, in one example, when the cloud determines that the smart speaker does not meet the exit condition for exiting the target mode, the TV control device is used as the target device, and the process proceeds to step S506.

[0102] Step S505: When the cloud determines that the first device meets the exit condition for exiting the target mode, the first device is used as the target device, and the process proceeds to step S506.

[0103] For example, in one example, when the cloud determines that the smart speaker meets the exit condition for exiting the target mode, the smart speaker is used as the target device, and the process proceeds to step S506.

[0104] It should be noted that, in actual applications, when the cloud determines that the smart speaker meets the exit conditions for exiting the target mode, the cloud can force the smart speaker to exit the target mode.

[0105] That is to say, in this example, when the cloud determines that the smart speaker is in the target mode, it can further determine whether the smart speaker meets the exit condition of the target mode, such as determining whether the smart speaker receives the exit instruction issued by the target object through voice command or click operation, or determining whether there is a program with a higher priority than the "target mode" on the smart speaker that needs to be executed. If so, it means that the smart speaker meets the exit condition. At this time, the smart speaker can be forced to exit the target mode. Accordingly, the cloud uses the smart speaker as the target device. Otherwise, that is, the smart speaker does not meet the exit condition, the cloud uses the TV control device as the target device.

[0106] In actual applications, as shown in FIG6(a), the target object can also close the target mode by clicking, for example, sending a close request to the cloud to close the target mode. Accordingly, if the request is successful, the smart speaker closes the target mode, for example, closes the pop-up window of the target mode, and accordingly, modifies the terminal state or clears the terminal state. Alternatively, in another example, the target object initiates a voice command to close the target mode, and accordingly, the smart speaker generates a close request to close the target mode and sends it to the cloud. Accordingly, if the request is successful, the smart speaker closes the target mode, for example, closes the pop-up window of the target mode, and accordingly, modifies the terminal state or clears the terminal state.

[0107] Alternatively, in another example, as shown in FIG6(b), the target object may also send a "pause" request to the smart speaker. After the smart speaker uploads the control data for "pause" to the cloud, the cloud determines whether the smart speaker is in Lingxi mode; if it is determined that it is not in Lingxi mode, the cloud sends a "pause" control instruction to the smart speaker to control the smart speaker to execute the control instruction.

[0108] Alternatively, when it is determined that the smart speaker is in Lingxi mode, the cloud sends the "pause" control command to the TV control device, and returns the determined execution result to the smart speaker; the TV control device executes the received "pause" control command to pause the current operation of the TV screen; in addition, after the TV control device executes the "pause" control command, the TV control device can also return the execution result (for example, message receipt) to the cloud, and the cloud determines whether the execution is successful based on the execution result. If it is determined that the execution fails, it generates a prompt message and sends the prompt message to the smart speaker. In this way, the intelligence level of smart control is significantly improved, so that users can know the current operation status in real time, avoiding users waiting for the response result for a long time, thereby improving the user experience.

[0109] Step S506: The cloud sends the control instruction determined based on the control data to the target device to control the target device to execute the control instruction.

[0110] In this way, after completing the judgment on whether the first device (such as a smart speaker) is in the target mode, the disclosed solution can further judge whether the first device meets the exit condition of exiting the target mode, thereby accurately identifying the target device to be controlled, thus effectively avoiding control conflicts caused by different modes, and improving the flexibility, intelligence and system stability of intelligent control. Moreover, when executing high-priority tasks (such as video calls, etc.) and responding to specific needs of users, the disclosed solution ensures the smoothness and efficiency of operations, thereby significantly improving the user experience.

[0111] The disclosed solution also provides a cloud server, such as Figure 7 As shown, including:

[0112] A mode determination unit 701 is used to determine mode information of a current working mode of the first device based on control data uploaded by the first device;

[0113] A device determining unit 702 is configured to determine a target device to be controlled according to mode information of a current working mode of the first device; and

[0114] The instruction sending unit 703 sends the control instruction determined based on the control data to the target device to control the target device to execute the control instruction.

[0115] In a specific example of the disclosed solution,

[0116] The target device is the first device, or a second device associated with the first device.

[0117] In a specific example of the present disclosure, the first device is a smart speaker, and the second device is a TV control device capable of adjusting TV channels.

[0118] In a specific example of the disclosed solution, the device determination unit is specifically used to:

[0119] When it is determined, according to the mode information of the current working mode of the first device, that the first device is in the target mode, the second device is used as the target device;

[0120] The target mode indicates a mode in which the first device needs to control the second device.

[0121] In a specific example of the disclosed solution, the device determination unit is further used to:

[0122] When it is determined according to the mode information of the current working mode of the first device that the first device is not in the target mode, the first device is used as the target device.

[0123] In a specific example of the disclosed solution, the device determination unit is specifically used to:

[0124] When it is determined that the first device is in a target mode according to the mode information of the current working mode of the first device, determining whether the first device meets an exit condition for exiting the target mode;

[0125] In a case where it is determined that the exit condition for exiting the target mode is not satisfied, the second device is used as the target device.

[0126] In a specific example of the disclosed solution, the device determination unit is specifically used to:

[0127] In a case where it is determined that an exit condition for exiting the target mode is satisfied, the first device is used as the target device.

[0128] In a specific example of the disclosed solution, the instruction sending unit is further used to:

[0129] Performing intent recognition on the control data to obtain an intent recognition result corresponding to the control data;

[0130] The control instruction is generated according to the intention recognition result.

[0131] For the description of the specific functions and examples of each unit of the device in the embodiment of the present disclosure, reference can be made to the relevant description of the corresponding steps in the above method embodiment, which will not be repeated here.

[0132] In the technical solution disclosed herein, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0133] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0134] Figure 8 A schematic block diagram of an example electronic device 800 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0135] like Figure 8 As shown, the device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0136] A number of components in the device 800 are connected to the I / O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0137] The computing unit 801 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above, such as the intelligent device control method. For example, in some embodiments, the intelligent device control method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 800 via ROM 802 and / or communication unit 809. When the computer program is loaded into RAM 803 and executed by the computing unit 801, one or more steps of the intelligent device control method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the intelligent device control method in any other appropriate manner (e.g., by means of firmware).

[0138] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0139] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0140] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0141] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0142] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0143] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0144] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0145] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the principles of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for controlling an intelligent device, comprising: Determine, based on the control data uploaded by the first device, mode information of the current working mode of the first device; Determining a target device to be controlled according to mode information of a current working mode of the first device; as well as The control instruction determined based on the control data is sent to the target device to control the target device to execute the control instruction.

2. The method according to claim 1, wherein: The target device is the first device, or a second device associated with the first device.

3. The method according to claim 2, wherein: The first device is a smart speaker, and the second device is a TV control device capable of adjusting TV channels.

4. The method according to claim 2 or 3, wherein: The step of determining a target device to be controlled according to the mode information of the current working mode of the first device includes: When it is determined, according to the mode information of the current working mode of the first device, that the first device is in the target mode, the second device is used as the target device; The target mode indicates a mode in which the first device needs to control the second device.

5. The method according to claim 4, further comprising: When it is determined according to the mode information of the current working mode of the first device that the first device is not in the target mode, the first device is used as the target device.

6. The method according to claim 4 or 5, wherein: The determining, based on the mode information of the current working mode of the first device, that the first device is in the target mode, taking the second device as the target device includes: When it is determined that the first device is in a target mode according to the mode information of the current working mode of the first device, determining whether the first device meets an exit condition for exiting the target mode; In a case where it is determined that the exit condition for exiting the target mode is not satisfied, the second device is used as the target device.

7. The method according to claim 5, wherein: The determining, based on the mode information of the current working mode of the first device, that the first device is not in the target mode, taking the first device as the target device includes: In a case where it is determined that an exit condition for exiting the target mode is satisfied, the first device is used as the target device.

8. The method according to any one of claims 1 to 3, further comprising: Performing intent recognition on the control data to obtain an intent recognition result corresponding to the control data; The control instruction is generated according to the intention recognition result.

9. A cloud server, comprising: a mode determination unit, configured to determine mode information of a current working mode of the first device based on the control data uploaded by the first device; A device determining unit, configured to determine a target device to be controlled according to mode information of a current working mode of the first device; as well as The instruction sending unit sends the control instruction determined based on the control data to the target device to control the target device to execute the control instruction.

10. The cloud server according to claim 9, wherein: The target device is the first device, or a second device associated with the first device.

11. The cloud server according to claim 10, wherein: The first device is a smart speaker, and the second device is a TV control device capable of adjusting TV channels.

12. The cloud server according to claim 10 or 11, wherein: The device determination unit is specifically used to: When it is determined, according to the mode information of the current working mode of the first device, that the first device is in the target mode, the second device is used as the target device; The target mode indicates a mode in which the first device needs to control the second device.

13. The cloud server according to claim 12, wherein: The device determination unit is further configured to: When it is determined according to the mode information of the current working mode of the first device that the first device is not in the target mode, the first device is used as the target device.

14. The cloud server according to claim 12 or 13, wherein: The device determination unit is specifically used to: When it is determined that the first device is in a target mode according to the mode information of the current working mode of the first device, determining whether the first device meets an exit condition for exiting the target mode; In a case where it is determined that the exit condition for exiting the target mode is not satisfied, the second device is used as the target device.

15. The cloud server according to claim 13, wherein: The device determination unit is specifically used to: In a case where it is determined that an exit condition for exiting the target mode is satisfied, the first device is used as the target device.

16. The cloud server according to any one of claims 9 to 11, wherein: The instruction sending unit is further used for: Performing intent recognition on the control data to obtain an intent recognition result corresponding to the control data; The control instruction is generated according to the intention recognition result.

17. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 8.

18. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-8.

19. A computer program product, comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 8.