Control methods, systems, devices, electronic devices and computer-readable storage media

Abstract

This application provides a control method, system, device, electronic device, and computer-readable storage medium, relating to the field of intelligent control. The method is applied to a control system including a control device and at least one smart home device. The control device is connected to each smart home device and performs the following: based on the original state information of each smart home device, creating virtual devices corresponding to each smart home device in a virtual community, and displaying each virtual device in association with its corresponding original state information; acquiring operation information of a first user; based on the operation information, determining a first target virtual device from the at least one virtual device, and generating a first control command corresponding to the first target virtual device; sending the first control command to the first smart home device corresponding to the first target virtual device to perform corresponding control on the first smart home device. This application embodiment achieves intelligent control of each smart home device.

Description

Technical Field

[0001] This application relates to the field of intelligent control, and more specifically, to a control method, apparatus, electronic device, and computer-readable storage medium. Background Technology

[0002] Smart home technology uses a residence as a platform to connect various devices within the home and acquire and control residential information through a control terminal, thereby improving the quality of life.

[0003] As living standards improve, smart homes are being adopted in more and more situations. However, as the intelligence level of smart homes increases, the control requirements for smart homes also become higher, resulting in a less than ideal user experience and limiting their practicality. Summary of the Invention

[0004] This application provides a control method, apparatus, electronic device, and computer-readable storage medium that can achieve precise control of smart home devices.

[0005] According to one aspect of the embodiments of this application, a control method is provided. The method is applied in a control system, which includes a control device and at least one smart home device. The control device is connected to each smart home device. The method is implemented by the control device and includes:

[0006] Based on the received original state information of each smart home device, a virtual device corresponding to each smart home device is created in the virtual community, and each virtual device is associated with and displayed with its corresponding original state information. This virtual community is created in response to the received virtual community creation request.

[0007] Obtain the operation information of the first user;

[0008] Based on this operation information, a first target virtual device is determined from at least one of the displayed virtual devices, and a first control command corresponding to the first target virtual device is generated;

[0009] Send a first control command to the first smart home device corresponding to the first target virtual device to control the first smart home device accordingly.

[0010] According to another aspect of the embodiments of this application, a control system is provided, the control system including a control device and at least one smart home device, the control device being connected to each smart home device respectively:

[0011] A control device is used to create a virtual device corresponding to each smart home device in a virtual community based on the received original state information of each smart home device, and to associate and display each virtual device with the corresponding original state information. The virtual community is created in response to a received virtual community creation request.

[0012] The control device is also used to acquire the operation information of the first user;

[0013] The control device is also configured to, based on the operation information, determine a first target virtual device from at least one displayed virtual device, and generate a first control command corresponding to the first target virtual device;

[0014] The control device is also used to send a first control command to the first smart home device corresponding to the first target virtual device;

[0015] The first smart home device is used to update the corresponding status information based on the first control command.

[0016] According to another aspect of the embodiments of this application, a control device is provided, applied in a control system, the control system including the control device and at least one smart home device, the control device being connected to each smart home device respectively, the control device comprising:

[0017] The creation module is used to create a virtual community in response to a received virtual community creation request; and to create a virtual device corresponding to each smart home device in the virtual community based on the received original state information of each smart home device.

[0018] The display module is used to associate and display each virtual device with its corresponding original state information.

[0019] The operation information acquisition module is used to acquire the operation information of the first user;

[0020] A control instruction generation module is used to determine a first target virtual device from at least one displayed virtual device based on the operation information, and generate a first control instruction corresponding to the first target virtual device.

[0021] The control command sending module is used to send a first control command to the first smart home device corresponding to the first target virtual device, so as to control the first smart home device accordingly.

[0022] According to another aspect of the embodiments of this application, an electronic device is provided, the electronic device including a memory, a processor and a computer program stored in the memory, the processor executing the computer program to implement the steps of the above method.

[0023] According to another aspect of the embodiments of this application, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps of the above-described method.

[0024] According to another aspect of the embodiments of this application, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps of the above-described method.

[0025] The beneficial effects of the technical solutions provided in this application are:

[0026] Based on the control method provided in the embodiments of this application, by creating virtual devices corresponding to each smart home device in a virtual community based on the original state information of each smart home device, and associating each virtual device with the corresponding original state information, visualization of the residence where the smart home devices are located can be achieved.

[0027] Furthermore, by determining a first target virtual device from at least one displayed virtual device based on the acquired first operation information, generating a first control command corresponding to the first target virtual device, and sending the first control command to the first smart home device corresponding to the first target virtual device to control the first smart home device accordingly, it is possible to control each smart home device through the control device. Attached Figure Description

[0028] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments of this application will be briefly introduced below.

[0029] Figure 1 A flowchart of a control method provided in an embodiment of this application is shown;

[0030] Figure 2 A schematic diagram of the control system provided in an embodiment of this application is shown;

[0031] Figure 3 A schematic diagram of a control device provided in an embodiment of this application is shown;

[0032] Figure 4 A schematic diagram of the structure of an electronic device to which this application embodiment applies is shown. Detailed Implementation

[0033] The embodiments of this application are described below with reference to the accompanying drawings. It should be understood that the embodiments described below with reference to the accompanying drawings are exemplary descriptions for explaining the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions of the embodiments of this application.

[0034] Those skilled in the art will understand that, unless specifically stated otherwise, the singular forms “a,” “an,” “the,” and “the” used herein may also include the plural forms. It should be further understood that the terms “comprising” and “including” as used in embodiments of this application mean that the corresponding feature can be implemented as the presented feature, information, data, step, operation, element, and / or component, but do not exclude implementation as other features, information, data, step, operation, element, component, and / or combinations thereof supported by the art. It should be understood that when we say that an element is “connected” or “coupled” to another element, the one element can be directly connected or coupled to the other element, or it can mean that the one element and the other element establish a connection relationship through an intermediate element. Furthermore, “connected” or “coupled” as used herein can include wireless connection or wireless coupling. The term “and / or” as used herein indicates at least one of the items defined by the term; for example, “A and / or B” can be implemented as “A,” or as “B,” or as “A and B.”

[0035] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0036] First, let's introduce and explain several terms used in this application:

[0037] Smart home system: A control system that uses a residence as a platform to connect various home appliances, such as refrigerators, air conditioners, and televisions, and obtains information from each device through a control terminal to control each device.

[0038] Metaverse: A collection of virtual spacetimes composed of augmented reality (AR), virtual reality (VR), and the Internet, capable of providing immersive experiences based on extended reality technologies. For example, in the embodiments of this application, the metaverse can be combined with a smart TV to effectively enhance the user experience.

[0039] The technical solutions of this application and their effects are described below through several exemplary embodiments. It should be noted that the following embodiments can be referenced, borrowed from, or combined with each other. Identical terms, similar features, and similar implementation steps in different embodiments will not be repeated.

[0040] Figure 1A flowchart of a control method provided in an embodiment of this application is shown. The method is applied in a control system including a control device and at least one smart home device. The control device is connected to each smart home device, and the method is implemented by the control device.

[0041] In this embodiment, the control system can be a smart home system, and each smart home device can be any home appliance within that system. For example, smart home devices may include, but are not limited to, smart TVs, smart sockets, smart switches, robot vacuum cleaners, smart air conditioners, smart water heaters, and smart refrigerators. This embodiment does not limit the specific number of smart home devices; it can be determined based on actual circumstances.

[0042] Considering the applicability of the control method provided in this application embodiment, and the wider range of users for image information, the control device provided in this application embodiment can be an electronic device with a display module, such as a smartphone, tablet, laptop, desktop computer, AR / VR device, etc., but is not limited to these. Of course, the control device can be a smart home device in the control system, for example, the control device can be a smart TV.

[0043] In this control system, the control device can connect to various smart home devices via wired or wireless communication methods, but is not limited to these. The specific method can be determined based on the actual application scenario requirements, and is not limited here.

[0044] For example, when the control device connects to various smart home devices via wired communication, a USB interface can be used. When the control device connects to various smart home devices via wireless communication, Wi-Fi or Bluetooth can be used.

[0045] like Figure 1 As shown, the method includes:

[0046] Step S110: Based on the received original state information of each smart home device, create a virtual device corresponding to each smart home device in the virtual community, and associate and display each virtual device with its corresponding original state information. This virtual community is created in response to the received virtual community creation request.

[0047] For any smart home device, its status information may include, but is not limited to, its startup status, volume, operating mode, and location information of other smart home devices. Taking a smart air conditioner as an example, its status information could include that it is turned on and currently operating in cooling mode, at 26°C, with vertical airflow enabled.

[0048] The original state information of the smart home device refers to its current state when it establishes a connection with the control device. Specifically, the state information of each virtual device created after the creation of a virtual device corresponding to each smart home device in the virtual community constitutes the original state information of that corresponding smart home device.

[0049] In one possible implementation, the original status information of each smart home device can be obtained through the sensors corresponding to each smart home device. When each smart home device establishes a connection with the control device, the obtained original status information and the corresponding smart home device identifier are sent to the control device through the connection method corresponding to each smart home device.

[0050] Of course, sensors can also be installed in the control device to obtain environmental information about the area where each smart home device is located. This application embodiment does not limit the type or number of sensors; these sensors can be temperature sensors, smoke sensors, etc. For example, the sensor installed can be a temperature sensor to collect temperature information about the area where each smart home device is located.

[0051] In one possible implementation, the aforementioned virtual community is created in response to a received virtual community creation request, and may include:

[0052] The aforementioned virtual community was created using metaverse technology in response to the aforementioned virtual community creation request.

[0053] For example, the virtual community creation request can be triggered when the control device is started, or it can be triggered when the original state information of each smart home device is obtained. This application embodiment does not limit this.

[0054] By creating corresponding virtual devices based on the original state information of each smart home device and obtaining the environmental information of each smart home device, the virtual community can better simulate the real-world environment information corresponding to each smart home device. Furthermore, by associating and displaying each virtual device with its corresponding current state information, the visualization of each virtual device in the virtual community can be achieved.

[0055] In one possible implementation, the above method may further include:

[0056] Receive current status information for a third smart home device among at least one smart home device;

[0057] Based on the current status information of the third smart home device, update the status information of the third target virtual device corresponding to the third smart home device in the aforementioned virtual community.

[0058] In this implementation, by receiving the current status information of each smart home device in real time and updating the status information of the corresponding virtual devices in the virtual community based on the current status information of each smart home device, the status information of each virtual device in the virtual community can be updated in real time, thereby better realizing the visualization of each virtual device in the virtual community.

[0059] Step S120: Obtain the operation information of the first user.

[0060] The first user can be any user in the control system, and this application embodiment does not limit this. Of course, there can also be multiple first users, and the specific number of first users can be determined according to the actual situation, and this application embodiment does not limit this either.

[0061] The first user's operation information can be based on the operation information of the virtual community with various virtual devices displayed. Specifically, it may include, but is not limited to, the first user's action information, language information, location information, etc., but this application embodiment does not limit this.

[0062] Taking the acquisition of the first user's motion information as an example, an image or video corresponding to the first user can be acquired through an image acquisition device in the control device. Based on a preset skeleton tracking system, the acquired motion image or video can be recognized to obtain the first user's motion information. For example, the first user's motion information can be acquired through a Kincet motion sensing device.

[0063] By acquiring images or videos of the first user through motion-sensing devices and using their built-in skeleton tracking system to identify the first user's body language or more complex facial expressions and gestures, the corresponding first control command can be determined, enabling more intelligent acquisition and recognition of the first user's operation information.

[0064] Of course, the user's operation information can also be obtained through a separate operation information device, and the obtained operation information can be sent to the control device by connecting with the control device.

[0065] Step S130: Based on the operation information, determine the first target virtual device from the at least one virtual device displayed, and generate a first control command corresponding to the first target virtual device.

[0066] In this implementation, the corresponding text information can be obtained by recognizing the voice information of the first user, and the obtained text information can be matched with preset keywords. Based on the matching result, the first target virtual device and the corresponding first control command can be determined.

[0067] For example, when the text information obtained by recognizing the voice information of the first user is "adjust the air conditioner temperature to 23℃", the keywords "air conditioner" and "23℃" can be obtained, and the first target virtual device can be determined to be the virtual device corresponding to "smart air conditioner". The first control command is "adjust the current temperature of the smart air conditioner to 23℃".

[0068] Alternatively, based on the location information of the first user and the location information of each virtual device, the virtual device whose location information is closest to that of the first user can be identified as the first target virtual device. Furthermore, the corresponding first control command can be determined based on the first user's action information.

[0069] Specifically, the first control command can be determined based on a preset mapping relationship between control commands and action information, as well as the action information of the first user. For example, the gesture "V-sign" can be associated with the control command "open the refrigerator." When the action information of the first user is detected as "V-sign," the corresponding first control command can be determined to be "open the refrigerator."

[0070] Step S140: Send a first control command to the first smart home device corresponding to the first target virtual device to control the first smart home device accordingly.

[0071] The control method provided in this application embodiment creates virtual devices corresponding to each smart home device in a virtual community based on the original state information of each smart home device, and associates and displays each virtual device with its corresponding original state information, thereby enabling visualization of the residence where the smart home devices are located.

[0072] Furthermore, by determining a first target virtual device from at least one displayed virtual device based on the acquired first operation information, generating a first control command corresponding to the first target virtual device, and sending the first control command to the first smart home device corresponding to the first target virtual device to control the first smart home device accordingly, it is possible to control each smart home device through the control device.

[0073] In one possible implementation, the above method may further include:

[0074] Based on the above operation information, the first virtual role corresponding to the first user in the virtual community is determined, and the operation information is associated with and displayed with the first virtual role. The first virtual role is created in response to the role creation request sent by the first user.

[0075] In this implementation, a role creation request can be initiated when the first user starts the control device to create the corresponding first virtual role.

[0076] For example, taking a smart TV as the control device, the corresponding virtual character can be created by setting the "character creation" option in the smart TV's startup wizard or settings and triggering this option.

[0077] By identifying the corresponding first virtual role based on the first user's operation information and displaying the operation information and the first virtual role together, the visualization of the first user in the virtual community can be achieved.

[0078] Considering the increasing number of young and middle-aged people migrating for work, the growing number of left-behind children and elderly in rural areas, and the increasing intelligence of furniture such as air conditioners and refrigerators, these groups are unable to accurately control smart home devices, reducing the intelligence and user experience of smart homes and even affecting their daily lives. Specifically, in some cases, the first user may be a child or elderly person. In such situations, if the first target virtual device is determined based on the first user's operation information, and a first control command is generated, and then the corresponding smart home device is controlled according to this command, erroneous operations may occur, damaging the smart home device or failing to achieve the control objective. To address this, this application provides the following further control methods:

[0079] In one possible implementation, sending the first control command to the first smart home device corresponding to the first target virtual device may include:

[0080] Determine the security level of the first control command;

[0081] If the security level of the first control command is greater than or equal to the preset level threshold, then the first control command is sent to the aforementioned first smart home device.

[0082] The above methods may also include:

[0083] If the security level of the first control command is less than the preset level threshold, the first control command is determined to be a misoperation command, and a prompt message is generated based on the first control command to remind the first user to regenerate the operation information.

[0084] In this implementation, the preset level threshold is an experimental value or an empirical value, or it can be determined according to the actual situation. This application embodiment does not limit the specific value of the preset level threshold, and it can be determined according to the actual situation.

[0085] In this implementation, the prompt message can be in text or voice format, etc., and this application embodiment does not limit the format of the prompt message. That is, the prompt message can be directly broadcast through the control device, or it can be displayed through the display module of the control device. The content of the prompt message can be "Current control operation is invalid" or "Please note the current control operation", and this application embodiment does not limit the content of the prompt message.

[0086] By determining the security level of the first control command, when the security level of the first control command is greater than or equal to a preset threshold, the first control command, generated directly based on the first user's operation information, is sent to the first smart home device to complete the control of the first smart home device, thereby improving the security of controlling the first smart home device. When the security level of the first control command is less than the preset threshold, a prompt message is generated to remind the first user to regenerate the operation information, which can further improve the security of controlling the first smart home device.

[0087] In one possible implementation, the method may further include:

[0088] The prompt message is sent to the second user so that the second user and the first user can interact through the second virtual role and the first virtual role corresponding to the second user in the virtual community. The second user is an associated user of the first user. The association between the first user and the second user and the second virtual role are created based on the user binding request sent by the second user and in response to the user binding request with the first user.

[0089] During the interaction between the second virtual character and the first virtual character, each virtual character is associated with and displayed with its corresponding interaction information;

[0090] Based on the interaction information corresponding to each virtual character, a second target virtual device is determined from at least one virtual device, and a second control command corresponding to the second target virtual device is generated;

[0091] The second control command is sent to the second smart home device corresponding to the second target virtual device to control the second smart home device accordingly.

[0092] The second user can be any user outside the residence where the control system is located, or a user within the residence where the control system is located. This application embodiment does not restrict the specific location of the second user.

[0093] The relationship between the first user and the second user can be a parent-child relationship, a friend relationship, etc.

[0094] The interaction information for each virtual character can be generated based on the user's operation information corresponding to each virtual character. The specific method for obtaining the second user's operation information can refer to the method described above for obtaining the first user's operation information.

[0095] In this implementation, a prompt message can be sent to a second user, allowing the second user to check the status information of the current smart home device based on the first operation command.

[0096] Of course, it is also possible to identify the first user's operation information and send a prompt message to the second user when the first user's operation information includes keywords such as "help".

[0097] The interaction between the first virtual character and the second virtual character can be considered as the first user asking the second user for help, or the second user providing guidance to the first user.

[0098] When the security level of the first control command is lower than a preset threshold, a prompt message is sent to the second user, allowing both the first and second users to interact within the virtual community through their respective virtual roles. By using the interaction information corresponding to each virtual role, a second target virtual device is redefined, and a second control command corresponding to that device is generated. This enables real-time, long-distance communication and interaction, more effective control of smart home devices, and improved user experience.

[0099] In one possible implementation, determining the security level of the first control command may include:

[0100] The first control command is matched with historical control commands in the security level database. The security level corresponding to the matched historical control command is determined as the security level of the first control command. This security level database is created in the following way:

[0101] A security level database is created based on the mapping relationship between multiple historical control commands and the security level of each historical control command.

[0102] In the specific implementation process, methods including but not limited to keyword matching can be used to match the first control command and each historical control command. If the matching degree between the keyword in the first control command and the keyword of a historical control command is greater than a preset value, it is determined that the historical control command matches the first control command.

[0103] In this implementation, machine learning can also be used based on metaverse technology or artificial intelligence to determine the security level database.

[0104] Specifically, this can be achieved by acquiring multiple historical control commands, determining the security level of each command, and then using the security level of each command as its corresponding label to generate a training database. The initial classification model is then trained based on this database until it meets the training termination criteria, resulting in a well-trained security level determination model.

[0105] After obtaining the first control command, the security level corresponding to the first control command is obtained by inputting the first control command into the security level determination model.

[0106] Based on the same principle as the control method provided in the embodiments of this application, a control system is also provided in the embodiments of this application. Figure 2 A schematic diagram of a control system provided in an embodiment of this application is shown. Figure 2 As shown, the control system includes a control device 201 and at least one smart home device 202, with the control device 201 connected to each smart home device 202 respectively.

[0107] Control device 201 is used to create a virtual device corresponding to each smart home device 202 in a virtual community based on the received original state information of each smart home device 202, and associate each virtual device with the corresponding original state information for display. The virtual community is created in response to a received virtual community creation request.

[0108] The control device 201 is also used to acquire the operation information of the first user;

[0109] The control device 201 is further configured to determine a first target virtual device from at least one displayed virtual device based on the operation information, and generate a first control command corresponding to the first target virtual device;

[0110] The control device 201 is also used to send a first control command to the first smart home device 202 corresponding to the first target virtual device;

[0111] The first smart home device 202 is used to update the corresponding status information based on the first control command.

[0112] In one possible implementation, the control device 201 described above can also be used for:

[0113] Based on the above operation information, the first virtual role corresponding to the first user in the virtual community is determined, and the operation information is associated with and displayed with the first virtual role. The first virtual role is created in response to the role creation request sent by the first user.

[0114] In one possible implementation, when the control device 201 sends the first control command to the first smart home device 202 corresponding to the first target virtual device, it can specifically be used for:

[0115] Determine the security level of the first control command;

[0116] If the security level of the first control command is greater than or equal to the preset level threshold, then the first control command is sent to the first smart home device 202.

[0117] The aforementioned control device 201 can also be used for:

[0118] If the security level of the first control command is less than the preset level threshold, the first control command is determined to be a misoperation command, and a prompt message is generated based on the first control command to remind the first user to regenerate the operation information.

[0119] In one possible implementation, the control device 201 described above can also be used for:

[0120] The prompt message is sent to the second user so that the second user and the first user can interact through the second virtual role and the first virtual role corresponding to the second user in the virtual community. The second user is an associated user of the first user. The association between the first user and the second user and the second virtual role are created based on the user binding request sent by the second user and in response to the user binding request with the first user.

[0121] During the interaction between the second virtual character and the first virtual character, each virtual character is associated with and displayed with its corresponding interaction information;

[0122] Based on the interaction information corresponding to each virtual character, a second target virtual device is determined from at least one virtual device, and a second control command corresponding to the second target virtual device is generated;

[0123] The second control command is sent to the second smart home device 202 corresponding to the second target virtual device to control the second smart home device 202 accordingly.

[0124] In one possible implementation, the control device 201, when determining the security level of the first control command, can specifically be used for:

[0125] The first control command is matched with historical control commands in the security level database. The security level corresponding to the matched historical control command is determined as the security level of the first control command. This security level database is created in the following way:

[0126] A security level database is created based on the mapping relationship between multiple historical control commands and the security level of each historical control command.

[0127] In one possible implementation, the aforementioned virtual community is created in response to a received virtual community creation request, and may include:

[0128] The aforementioned virtual community was created using metaverse technology in response to the aforementioned virtual community creation request.

[0129] In one possible implementation, the control device 201 described above can also be specifically used for:

[0130] Receive current status information for a third smart home device 202 among at least one smart home device 202;

[0131] Based on the current status information of the third smart home device 202, update the status information of the third target virtual device corresponding to the third smart home device 202 in the aforementioned virtual community.

[0132] The control system of this application embodiment can execute the method provided in this application embodiment. The implementation principle is similar. The actions performed by each device in the control system of each embodiment of this application correspond to the steps in the method of each embodiment of this application. For detailed functional descriptions of each device in the control system, please refer to the descriptions in the corresponding methods shown above, which will not be repeated here.

[0133] Based on the same principles as the control methods and control systems provided in the embodiments of this application, a control device is also provided in the embodiments of this application. Figure 3 A schematic diagram of a control device according to an embodiment of this application is shown. The control device 30 is applied in a control system, which includes the control device 30 and at least one smart home device, with the control device 30 connected to each smart home device. Figure 3 As shown, the control device 30 includes:

[0134] The creation module 301 is used to create a virtual community in response to a received virtual community creation request; and to create a virtual device corresponding to each smart home device in the virtual community based on the received original state information of each smart home device.

[0135] Display module 302 is used to associate and display each virtual device with its corresponding original state information.

[0136] The operation information acquisition module 303 is used to acquire the operation information of the first user;

[0137] The control instruction generation module 304 is used to determine a first target virtual device from at least one displayed virtual device based on the operation information, and generate a first control instruction corresponding to the first target virtual device.

[0138] The control command sending module 305 is used to send a first control command to the first smart home device corresponding to the first target virtual device, so as to control the first smart home device accordingly.

[0139] In one possible implementation, the control device 30 further includes a virtual role determination module.

[0140] The virtual role determination module is used to: determine the first virtual role corresponding to the first user in the virtual community based on the above operation information. The first virtual role is created by the above creation module 301 in response to the role creation request sent by the first user.

[0141] The aforementioned display module 302 is also used to associate and display operation information with the first virtual character.

[0142] In one possible implementation, when the control command sending module 305 sends the first control command to the first smart home device corresponding to the first target virtual device, it can be specifically used for:

[0143] Determine the security level of the first control command;

[0144] If the security level of the first control command is greater than or equal to the preset level threshold, then the first control command is sent to the aforementioned first smart home device.

[0145] The aforementioned control command sending module 305 can also be used for:

[0146] If the security level of the first control command is less than the preset level threshold, the first control command is determined to be a misoperation command, and a prompt message is generated based on the first control command to remind the first user to regenerate the operation information.

[0147] In one possible implementation, the control command sending module 305 described above can also be used for:

[0148] The prompt message is sent to the second user so that the second user and the first user can interact through the second virtual role and the first virtual role corresponding to the second user in the virtual community. The second user is an associated user of the first user. The association between the first user and the second user and the second virtual role are created based on the user binding request sent by the second user and in response to the user binding request with the first user.

[0149] During the interaction between the second virtual character and the first virtual character, each virtual character is associated with and displayed with its corresponding interaction information;

[0150] Based on the interaction information corresponding to each virtual character, a second target virtual device is determined from at least one virtual device, and a second control command corresponding to the second target virtual device is generated;

[0151] The second control command is sent to the second smart home device corresponding to the second target virtual device to control the second smart home device accordingly.

[0152] In one possible implementation, the control command sending module 305, when determining the security level of the first control command, can specifically be used for:

[0153] The first control command is matched with historical control commands in the security level database. The security level corresponding to the matched historical control command is determined as the security level of the first control command. This security level database is created in the following way:

[0154] A security level database is created based on the mapping relationship between multiple historical control commands and the security level of each historical control command.

[0155] In one possible implementation, when the creation module 301 creates a virtual community in response to a received virtual community creation request, it can specifically be used to:

[0156] In response to the aforementioned request to create a virtual community, the aforementioned virtual community was created using metaverse technology.

[0157] In one possible implementation, the creation module 301 described above can also be used for:

[0158] Receive current status information for a third smart home device among at least one smart home device;

[0159] Based on the current status information of the third smart home device, update the status information of the third target virtual device corresponding to the third smart home device in the aforementioned virtual community.

[0160] The control device in this application embodiment can execute the method provided in this application embodiment. The implementation principle is similar. The actions performed by each module in the control device of each embodiment of this application correspond to the steps in the method of each embodiment of this application. For detailed functional descriptions of each module of the control device, please refer to the descriptions in the corresponding methods shown above, which will not be repeated here.

[0161] Based on the same principles as the control methods, control systems, and control devices provided in the embodiments of this application, the embodiments of this application also provide an electronic device (such as a server). The electronic device may include a memory, a processor, and a computer program stored in the memory. The processor executes the computer program to implement the steps of the method provided in any optional embodiment of this application.

[0162] Optionally, Figure 4 A schematic diagram of the structure of an electronic device to which this application embodiment applies is shown, such as... Figure 4 As shown, Figure 4 The illustrated electronic device 4000 includes a processor 4001 and a memory 4003. The processor 4001 and the memory 4003 are connected, for example, via a bus 4002. Optionally, the electronic device 4000 may further include a transceiver 4004, which can be used for data interaction between the electronic device and other electronic devices, such as sending and / or receiving data. It should be noted that in practical applications, the transceiver 4004 is not limited to one type, and the structure of the electronic device 4000 does not constitute a limitation on the embodiments of this application.

[0163] Processor 4001 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 4001 may also be a combination that implements computational functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0164] Bus 4002 may include a pathway for transmitting information between the aforementioned components. Bus 4002 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. Bus 4002 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 4 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0165] The memory 4003 may be ROM (Read Only Memory) or other types of static storage devices capable of storing static information and instructions, RAM (Random Access Memory) or other types of dynamic storage devices capable of storing information and instructions, or EEPROM (Electrically Erasable Programmable Read Only Memory), CD-ROM (Compact Disc Read Only Memory) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media, other magnetic storage devices, or any other medium capable of carrying or storing computer programs and capable of being read by a computer, without limitation herein.

[0166] The memory 4003 stores computer programs that execute embodiments of this application, and its execution is controlled by the processor 4001. The processor 4001 executes the computer programs stored in the memory 4003 to implement the steps shown in the foregoing method embodiments.

[0167] This application provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it can implement the steps and corresponding content of the aforementioned method embodiments.

[0168] This application also provides a computer program product, including a computer program that, when executed by a processor, can implement the steps and corresponding content of the aforementioned method embodiments.

[0169] The terms "first," "second," "third," "fourth," "1," "2," etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in a sequence other than that shown in the figures or text.

[0170] It should be understood that although arrows indicate various operation steps in the flowcharts of this application's embodiments, the order in which these steps are implemented is not limited to the order indicated by the arrows. Unless explicitly stated herein, in some implementation scenarios of this application's embodiments, the implementation steps in each flowchart can be executed in other orders as required. Furthermore, some or all steps in each flowchart, based on the actual implementation scenario, may include multiple sub-steps or multiple stages. Some or all of these sub-steps or stages can be executed at the same time, and each sub-step or stage can also be executed at different times. In scenarios where execution times differ, the execution order of these sub-steps or stages can be flexibly configured according to requirements, and this application's embodiments do not limit this.

[0171] The above description is only an optional implementation method for some implementation scenarios of this application. It should be noted that for those skilled in the art, other similar implementation methods based on the technical concept of this application without departing from the technical concept of this application also fall within the protection scope of the embodiments of this application.

Claims

1. A control method, characterized in that, Applied in a control system, the control system includes a control device and at least one smart home device, the control device being connected to each of the smart home devices, and the method being implemented by the control device, including: Based on the received original state information of each smart home device, a virtual device corresponding to each smart home device is created in the virtual community, and each virtual device is associated with and displayed with its corresponding original state information. The virtual community is created in response to a received virtual community creation request. Obtain the operation information of the first user; Based on the operation information, a first target virtual device is determined from at least one displayed virtual device, and a first control command corresponding to the first target virtual device is generated; If the security level of the first control command is greater than or equal to a preset level threshold, the first control command is sent to the first smart home device corresponding to the first target virtual device to control the first smart home device accordingly. If the security level of the first control command is less than the preset level threshold, the first control command is determined to be a misoperation command, and a prompt message is generated based on the first control command and sent to the second user. During the interaction between the second virtual character corresponding to the second user and the first virtual character corresponding to the first user, each virtual character is associated with and displayed with its corresponding interaction information; the second user is an associated user of the first user, and the association between the first user and the second user, as well as the second virtual character, are created based on the user binding request sent by the second user and in response to the user binding request with the first user; Based on the interaction information corresponding to each virtual character, a second target virtual device is determined from the at least one virtual device, and a second control command corresponding to the second target virtual device is generated; Send the second control command to the second smart home device corresponding to the second target virtual device to control the second smart home device accordingly.

2. The method according to claim 1, characterized in that, The method further includes: Based on the operation information, the first virtual role corresponding to the first user in the virtual community is determined, and the operation information is associated with and displayed with the first virtual role. The first virtual role is created in response to the role creation request sent by the first user.

3. The method according to claim 1 or 2, characterized in that, The method further includes: The first control command is matched with historical control commands in the security level database, and the security level corresponding to the matched historical control command is determined as the security level of the first control command. The security level database is created in the following manner: The security level database is created based on the mapping relationship between multiple historical control commands and the security level of each historical control command.

4. The method according to claim 1, characterized in that, The method further includes: Receive current status information for a third smart home device among the at least one smart home devices; Based on the current status information of the third smart home device, update the status information of the third target virtual device corresponding to the third smart home device in the virtual community.

5. A control system, characterized in that, The control system includes a control device and at least one smart home device, wherein the control device is connected to each of the smart home devices. The control device is configured to create a virtual device corresponding to each smart home device in the virtual community based on the received original state information of each smart home device, and associate and display each virtual device with the corresponding original state information. The virtual community is created in response to a received virtual community creation request. The control device is also used to acquire the operation information of the first user; The control device is further configured to determine a first target virtual device from at least one displayed virtual device based on the operation information, and generate a first control command corresponding to the first target virtual device. The control device is further configured to send the first control command to the first smart home device corresponding to the first target virtual device, wherein the security level of the first control command is greater than or equal to a preset level threshold. The first smart home device is used to update the corresponding status information based on the first control command; The control device is further configured to: generate a prompt message based on the first control command, and send the prompt message to the second user; wherein the security level of the first control command is less than the preset level threshold; During the interaction between the second virtual character corresponding to the second user and the first virtual character corresponding to the first user, each virtual character is associated with and displayed with its corresponding interaction information; the second user is an associated user of the first user, and the association between the first user and the second user, as well as the second virtual character, are created based on the user binding request sent by the second user and in response to the user binding request with the first user; Based on the interaction information corresponding to each virtual character, a second target virtual device is determined from the at least one virtual device, and a second control command corresponding to the second target virtual device is generated; Send the second control command to the second smart home device corresponding to the second target virtual device; The second smart home device is used to update the corresponding status information based on the second control command.

6. A control device, characterized in that, The system is applied in a control system, which includes a control device and at least one smart home device. The control device is connected to each of the smart home devices, and the control device includes: A creation module is configured to create a virtual community in response to a received virtual community creation request; and to create a virtual device corresponding to each of the smart home devices in the virtual community based on the received original state information of each of the smart home devices. The display module is used to associate and display each virtual device with its corresponding original state information. The operation information acquisition module is used to acquire the operation information of the first user; A control instruction generation module is used to determine a first target virtual device from at least one displayed virtual device based on the operation information, and generate a first control instruction corresponding to the first target virtual device. The control command sending module is used to send the first control command to the first smart home device corresponding to the first target virtual device in order to control the first smart home device accordingly. The security level of the first control command is greater than or equal to a preset level threshold. The control command generation module is further configured to: determine that the first control command is a misoperation command, generate a prompt message based on the first control command, and send the prompt message to the second user; the security level of the first control command is less than the preset level threshold. The display module is further configured to associate and display each virtual character with its corresponding interaction information during the interaction between the second virtual character corresponding to the second user and the first virtual character corresponding to the first user; the second user is an associated user of the first user, and the association relationship between the first user and the second user, as well as the second virtual character, are created based on the user binding request sent by the second user and in response to the user binding request with the first user; The control command generation module is further configured to: determine a second target virtual device from the at least one virtual device based on the interaction information corresponding to each virtual character, and generate a second control command corresponding to the second target virtual device; The control command sending module is further configured to send the second control command to the second smart home device corresponding to the second target virtual device, so as to control the second smart home device accordingly.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory, characterized in that, The processor executes the computer program to implement the steps of the method according to any one of claims 1-4.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1-4.

Images