Interactive control methods, devices, equipment and storage media for equipment

Abstract

This application discloses a method, apparatus, device, and storage medium for interactive control of devices. The method includes: acquiring device information of devices within a target area; based on the device information, associating the interactive permissions of devices with similar functions within the target area to obtain at least one device group; determining a first interactive permission of an interactive object for at least one function of at least one device in each device group; and controlling the interactive behavior of the interactive object with devices within the target area based on the first interactive permission. The technical solution of this application can avoid abnormal interactions between interactive objects and devices, improving the security of interactions between interactive objects and devices.

Description

Technical Field

[0001] This application relates to the field of smart home management technology, and in particular to an interactive control method, device, equipment and storage medium for a device. Background Technology

[0002] In related technologies, with the increasing number of home appliances, users may not be able to fully grasp how to use each appliance, and the actual user identity may change, which may lead to potential safety hazards during the use of home appliances. Summary of the Invention

[0003] To overcome the problems existing in the related technologies, this application provides an interactive control method, apparatus, electronic device and storage medium for a device.

[0004] In a first aspect, embodiments of this application provide a device interaction control method, comprising: acquiring device information of devices within a target area; based on the device information, associating the interaction permissions of devices with similar functions among the devices in the target area to acquire at least one device group; determining a first interaction permission of an interaction object for at least one function of at least one device in each device group; and controlling the interaction behavior of the interaction object with the devices in the target area based on the first interaction permission.

[0005] In one implementation, obtaining device information of a device within a target area includes: obtaining image information of the target area; performing image recognition on the image information of the target area to obtain image information of the device within the target area; and performing image recognition on the image information of the device within the target area to obtain device information of the device within the target area.

[0006] In one implementation, the step of associating the interaction permissions of devices with similar functions within the target area based on the device information to obtain at least one device group includes: obtaining user manual information of the devices within the target area based on the device information; performing semantic recognition on the user manual information to obtain functional information of the devices within the target area; determining the functional similarity between the devices within the target area based on the functional information; associating the interaction permissions of devices within the target area whose functional similarity is greater than a preset threshold; and identifying the devices whose functional similarity is greater than the preset threshold as a device group.

[0007] In one optional implementation, determining the first interaction permission of the interactive object for at least one function of at least one device in each of the device groups includes: obtaining the physical attribute information of the interactive object; and determining the first interaction permission of the interactive object for at least a portion of the functions of at least one device in each of the device groups based on the physical attribute information and the function information of the devices in each of the device groups.

[0008] In one optional implementation, obtaining the body attribute information of the interactive object includes: obtaining image information of the interactive object; performing image recognition on the image information of the interactive object to obtain the body attribute information of the interactive object.

[0009] In one implementation, controlling the interaction behavior between the interaction object and devices within the target area based on the first interaction permission includes: obtaining interaction information of a first device; wherein the first device is a device within the target area that interacts with the interaction object; determining a second interaction permission of the interaction object for the first device from the first interaction permission; determining whether an abnormal interaction behavior has occurred based on the interaction information and the second interaction permission; determining a corresponding handling measure in response to the occurrence of the abnormal interaction behavior; and controlling the interaction behavior between the interaction object and the first device based on the handling measure.

[0010] In one optional implementation, the interaction information includes an interaction image. Determining whether an abnormal interaction has occurred based on the interaction information and the second interaction permission includes: inputting the interaction image and the second interaction permission into a pre-trained abnormal interaction recognition model, and obtaining the recognition result output by the abnormal interaction recognition model; wherein the abnormal interaction recognition model can recognize the interaction image and, in conjunction with the second interaction permission, determine whether the interaction image contains abnormal interaction behavior; and determine whether the abnormal interaction behavior has occurred based on the recognition result.

[0011] Optionally, the identification result includes the behavior type and risk level of the abnormal interaction behavior, and determining the corresponding handling measures for the abnormal interaction behavior includes: inputting the behavior type and the risk level into a pre-trained handling measure matching model to obtain the handling measures; wherein, the handling measure matching model can be the behavior type and the risk level, matching the corresponding handling measures.

[0012] In an optional implementation, the method further includes: in response to the occurrence of the abnormal interaction behavior, obtaining user manual information of the first device; and pushing the user manual information to the interaction object.

[0013] In an optional implementation, the method further includes: in response to the occurrence of the abnormal interaction behavior, determining a third interaction permission associated with the abnormal interaction behavior; determining a target device group associated with the first device from the device group; and revoking the third interaction permission of the interaction object on all devices in the target device group.

[0014] Optionally, the method further includes: determining whether the interaction object has obtained the user manual information of the first device; and in response to the interaction object having obtained the user manual information of the first device, restoring the interaction object's third interaction permission to all devices in the target device group.

[0015] Secondly, embodiments of this application provide an interactive control device for a device, comprising: a first acquisition module, configured to acquire device information of devices within a target area; a first processing module, configured to associate the interaction permissions of devices with similar functions within the target area based on the device information, and acquire at least one device group; a second processing module, configured to determine a first interaction permission of an interactive object for at least one function of at least one device in each device group; and a control module, configured to control the interactive behavior of the interactive object with the devices within the target area based on the first interaction permission.

[0016] In one implementation, the first acquisition module is specifically used to: acquire image information of the target area; perform image recognition on the image information of the target area to acquire image information of the device within the target area; and perform image recognition on the image information of the device within the target area to acquire device information of the device within the target area.

[0017] In one implementation, the first processing module is specifically configured to: obtain user manual information of the devices within the target area based on the device information; perform semantic recognition on the user manual information to obtain functional information of the devices within the target area; determine the functional similarity between the devices within the target area based on the functional information; associate the interaction permissions of devices within the target area whose functional similarity is greater than a preset threshold; and determine the devices whose functional similarity is greater than the preset threshold as a device group.

[0018] In one optional implementation, the first processing module is specifically used to: obtain the body attribute information of the interactive object; and determine, based on the body attribute information and the functional information of the devices in each device group, the first interaction permission of the interactive object for at least a portion of the functions of at least one device in each device group.

[0019] Optionally, the first processing module is specifically used to: acquire image information of the interactive object; perform image recognition on the image information of the interactive object to acquire body attribute information of the interactive object.

[0020] In one implementation, the control module is specifically configured to: acquire interaction information of a first device; wherein the first device is a device within the target area that interacts with the interaction object; determine a second interaction permission of the interaction object on the first device from the first interaction permission; determine whether an abnormal interaction behavior has occurred based on the interaction information and the second interaction permission; in response to the occurrence of the abnormal interaction behavior, determine a corresponding handling measure for the abnormal interaction behavior; and control the interaction behavior between the interaction object and the first device based on the handling measure.

[0021] In one optional implementation, the interaction information includes an interaction image, and the control module is specifically configured to: input the interaction image and the second interaction permission into a pre-trained abnormal interaction recognition model, and obtain the recognition result output by the abnormal interaction recognition model; wherein, the abnormal interaction recognition model can recognize the interaction image and, in conjunction with the second interaction permission, determine whether the interaction image contains abnormal interaction behavior; and, based on the recognition result, determine whether the abnormal interaction behavior has occurred.

[0022] Optionally, the identification result includes the behavior type and risk level of the abnormal interaction behavior, and the control module is specifically used to: input the behavior type and the risk level into a pre-trained treatment measure matching model to obtain the treatment measure; wherein, the treatment measure matching model can match the behavior type and the risk level with the corresponding treatment measure.

[0023] In an optional implementation, the device further includes: a second acquisition module, configured to acquire user manual information of the first device in response to the occurrence of the abnormal interaction behavior; and a push module, configured to push the user manual information to the interaction object.

[0024] In an optional implementation, the apparatus further includes: a third processing module, configured to determine a third interaction permission associated with the abnormal interaction behavior in response to the occurrence of the abnormal interaction behavior; a fourth processing module, configured to determine a target device group associated with the first device from the device group; and a fifth processing module, configured to revoke the third interaction permission of the interaction object on all devices in the target device group.

[0025] Optionally, the device further includes: a determining module, configured to determine whether the interactive object has obtained the user manual information of the first device; and a sixth processing module, configured to, in response to the interactive object having obtained the user manual information of the first device, restore the third interaction permission of the interactive object to all devices in the target device group.

[0026] Thirdly, embodiments of this application provide an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the interactive control method of the device as described in the first aspect.

[0027] Fourthly, embodiments of this application provide a computer-readable storage medium for storing instructions that, when executed, cause the method described in the first aspect to be implemented.

[0028] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the steps of the interactive control method for the device as described in the first aspect.

[0029] The technical solutions provided by the embodiments of this application can include the following beneficial effects: Device information of devices within a target area can be obtained, and devices within the target area can be associated based on this device information to obtain at least one device group. Interaction permissions of the interactive object to at least one device in each device group can be obtained, and the interaction between the interactive object and devices within the target area can be controlled based on these interaction permissions. This can prevent abnormal interactions between the interactive object and devices, and improve the security of interactions between the interactive object and devices.

[0030] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description

[0031] The accompanying drawings are provided for a better understanding of this solution and do not constitute a limitation of this application. Wherein:

[0032] Figure 1 This is a schematic diagram of an interactive control method for a device provided in an embodiment of this application;

[0033] Figure 2 This is a schematic diagram of another interactive control method for a device provided in an embodiment of this application;

[0034] Figure 3 This is a schematic diagram of another interactive control method for a device provided in an embodiment of this application;

[0035] Figure 4 This is a schematic diagram of another interactive control method for a device provided in an embodiment of this application;

[0036] Figure 5 This is a schematic diagram of an interactive control device for a device provided in an embodiment of this application;

[0037] Figure 6 This is a schematic diagram of an interactive control device for another device provided in an embodiment of this application;

[0038] Figure 7 This is a schematic diagram of another interactive control device for a device provided in an embodiment of this application;

[0039] Figure 8 This is a schematic diagram of another interactive control device for a device provided in an embodiment of this application;

[0040] Figure 9 This is a schematic block diagram of an example electronic device that can be used to implement embodiments of this application. Detailed Implementation

[0041] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of this application, including various details to aid understanding. These should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this application. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0042] In the description of this application, unless otherwise stated, " / " means "or", for example, A / B can mean A or B; "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. The various numerical designations such as "first", "second", etc., involved in this application are only for the convenience of description and are not used to limit the scope of the embodiments of this application, nor do they indicate the order of events.

[0043] Please see Figure 1 , Figure 1 This is a schematic diagram of an interactive control method for a device provided in an embodiment of this application. For example... Figure 1 As shown, the method may include, but is not limited to, the following steps:

[0044] Step S101: Obtain device information of devices within the target area.

[0045] For example, a device can be provided to the interactive object through a terminal device to add a device, and the device information added by the interactive object through the adding interface can be obtained.

[0046] In some embodiments of this application, the target area can be a user-specified area.

[0047] In the embodiments of this application, the aforementioned device information includes, but is not limited to, device name and device model.

[0048] In the embodiments of this application, the aforementioned devices may include, but are not limited to, home appliances (e.g., water dispensers, air conditioners, and televisions) and tool devices (e.g., knives).

[0049] Step S102: Based on device information, associate the interaction permissions of devices with similar functions in the target area to obtain at least one device group.

[0050] For example, based on device information, the functions of each device within the target area are obtained, devices with the same or similar functions are associated, and associated devices are grouped together. For instance, an induction cooker and a gas stove are associated as a single device group.

[0051] In other embodiments of this application, devices with the same or similar operating methods can be associated and associated devices can be grouped together as a device group.

[0052] Step S103: Determine the first interaction permission of the interaction object for at least one function of at least one device in each device group.

[0053] Specifically, it is determined that a pre-defined interaction object has a first interaction permission for at least one function in at least one device in each device group.

[0054] It is understandable that a device may have multiple functions, and the object to be interacted with may have interaction permissions for at least one of the aforementioned functions.

[0055] As an example, let's take device A in a device group as having function A and function B. An interactive object can have interactive permissions for function A, but not interactive permissions for function B.

[0056] Step S104: Based on the first interaction permission, control the interaction behavior between the interaction object and the device in the target area.

[0057] Specifically, it determines whether the interaction behavior between the interactive object and any device within the target area exceeds the first interaction permission scope corresponding to the device group associated with that arbitrary device, in order to control the interaction behavior between the interactive object and the devices within the target area.

[0058] As an example, if the interaction object's interaction behavior is to turn on device A, but the interaction object does not have the permission to turn on device A associated with the device group, then the interaction object's behavior of turning on device A will be terminated.

[0059] By implementing the embodiments of this application, device information of devices within a target area can be obtained. Based on this device information, devices within the target area can be associated to obtain at least one device group. Furthermore, interaction permissions for the interactive object to at least one device in each device group can be obtained. Based on these interaction permissions, the interaction between the interactive object and devices within the target area can be controlled. This can prevent abnormal interactions between the interactive object and devices, improving the security of interactions between the interactive object and devices.

[0060] In one implementation, image information of the target area can be acquired, and device information of devices within the target area can be obtained based on this image information. For an example, please refer to [link to example]. Figure 2 , Figure 2 This is a schematic diagram of another interactive control method for a device provided in an embodiment of this application. For example... Figure 2 As shown, the method may include, but is not limited to, the following steps:

[0061] Step S201: Obtain image information of the target area.

[0062] For example, image information of the target area is acquired by using an image acquisition device (e.g., a camera) pre-set in the target area.

[0063] Step S202: Perform image recognition on the image information of the target area to obtain the image information of the device within the target area.

[0064] Specifically, image recognition is performed on the image information of the target area to obtain the devices present in the target area, thereby obtaining the image information corresponding to each device in the target area.

[0065] Step S203: Perform image recognition on the image information of the devices within the target area to obtain the device information of the devices within the target area.

[0066] Specifically, image recognition is performed on the image information corresponding to each device within the target area to obtain the device information of each device within the target area.

[0067] In some embodiments of this application, image recognition can also be performed directly on the image information of the target area to obtain device information of the device within the target area.

[0068] Step S204: Based on the device information, associate the interaction permissions of devices with similar functions in the target area to obtain at least one device group.

[0069] In the embodiments of this application, step S204 can be implemented in any of the embodiments of this application. The embodiments of this application do not limit this and will not be described in detail.

[0070] Step S205: Determine the first interaction permission of the interaction object for at least one function of at least one device in each device group.

[0071] In the embodiments of this application, step S205 can be implemented in any of the embodiments of this application. The embodiments of this application do not limit this and will not be described in detail.

[0072] Step S206: Based on the first interaction permission, control the interaction behavior between the interaction object and the device in the target area.

[0073] In the embodiments of this application, step S206 can be implemented in any of the ways described in the embodiments of this application. The embodiments of this application do not limit this, nor will they be described in detail.

[0074] By implementing the embodiments of this application, image information of a target area can be obtained, and device information of devices within the target area can be obtained based on this image information. Then, devices within the target area can be associated based on this device information to obtain at least one device group. Furthermore, interaction permissions for the interactive object to at least one device in each device group can be obtained, and the interaction between the interactive object and devices within the target area can be controlled based on these interaction permissions. This can prevent abnormal interactions between the interactive object and devices, improving the security of interactions between the interactive object and devices.

[0075] In one implementation, the functional information of devices within the target area can be determined based on their device information. Then, based on this functional information, the interaction permissions of devices with similar functions within the target area can be associated to obtain at least one device group. For an example, please refer to [link to example]. Figure 3 , Figure 3 This is a schematic diagram of another interactive control method for a device provided in an embodiment of this application, as shown below. Figure 3 As shown, the method may include, but is not limited to, the following steps:

[0076] Step S301: Obtain device information of devices within the target area.

[0077] In the embodiments of this application, step S301 can be implemented in any of the ways described in the embodiments of this application. The embodiments of this application do not limit this, nor will they be described in detail.

[0078] Step S302: Based on the device information, obtain the user manual information of the devices within the target area.

[0079] As an example, a search can be conducted on the internet based on device information to obtain user manual information for devices within a target area. For instance, a search can be performed on the internet to retrieve the user manuals for devices within the target area, thereby obtaining the user manual information.

[0080] As another example, if the user manual information of the device in the target area cannot be found directly, the user manual information of the similar device in the target area can be obtained based on the device information of the device in the target area, and then used as the user manual information of the device in the target area.

[0081] Among them, the similar equipment to the equipment in the target area can be equipment with the same or similar model as the equipment in the target area, or it can be equipment with the same or similar functions as the equipment in the target area.

[0082] Step S303: Perform semantic recognition on the instruction manual information to obtain the functional information of the device within the target area.

[0083] Specifically, semantic recognition processing is performed on the instruction manual information to obtain functional information of each device within the target area.

[0084] Step S304: Based on functional information, determine the functional similarity between devices within the target area.

[0085] For example, the similarity of functional information between each device in the target area and other devices is calculated, and this similarity is determined as the functional similarity between devices in the target area.

[0086] Step S305: Associate the interaction permissions of devices with functional similarity greater than a preset threshold within the target area.

[0087] As an example, let's consider a target area containing devices A, B, C, and D. If the functional similarity between devices A and C is greater than a preset threshold, and the functional similarity between devices B and D is greater than a preset threshold, then the control permissions of devices A and C will be associated, and the control permissions of devices B and D will be associated.

[0088] In the embodiments of this application, the aforementioned preset threshold is a preset threshold used to determine whether the device functions are similar.

[0089] Step S306: Determine devices with a functional similarity greater than a preset threshold as a device group.

[0090] As an example, let's consider a target area containing devices A, B, C, and D. If the functional similarity between devices A and C is greater than a preset threshold, and the functional similarity between devices B and D is greater than a preset threshold, then devices A and C are identified as one device group, and devices B and D are identified as another device group.

[0091] Step S307: Determine the first interaction permission of the interaction object for at least some of the functions of at least one device in each device group.

[0092] For example, determine the first interaction permission of a pre-defined interaction object for at least a portion of the functionality of at least one device in each device group.

[0093] In one alternative implementation, determining the first interaction permission of the interactive object for at least one function of at least one device in each device group may include the following steps: obtaining the physical attribute information of the interactive object; and determining the first interaction permission of the interactive object for at least some functions of at least one device in each device group based on the physical attribute information and the function information of the devices in each device group.

[0094] In the embodiments of this application, the aforementioned physical attribute information may include, but is not limited to, the gender, age, and physical condition (e.g., vision, hearing, intelligence, mental state, and memory) of the interactive object.

[0095] For example, obtain the physical attribute information of the interactive object; based on the physical attribute information of the interactive object and the functional information of the devices in each device group, determine at least some functions of at least one device in each device group that the interactive object can normally use, thereby determining the first interaction permission of the interactive object to at least some functions of at least one device in each device group.

[0096] As an example, taking a child as the interactive object, if device group A in the target area contains devices such as gas stoves and induction cookers, and the interactive object may be in danger when using a gas stove, then it is determined that the interactive object does not have the interaction permission for gas stoves, and thus it is determined that the interactive object does not have the interaction permission for any device in device group A.

[0097] As another example, if the interactive object is a blind person, then the interactive object cannot have interactive permissions for devices that may generate high temperatures. For example, if device group A in the target area includes devices such as electric kettles and instant water dispensers, and the interactive object may be scalded by hot water when using the instant water dispenser, then it is determined that the interactive object does not have interactive permissions for the instant water dispenser, and thus it is determined that the interactive object does not have interactive permissions for any device in device group A.

[0098] As another example, taking a blind person as the interaction object, if the devices in the target area have multiple functions, and at least one function generates high temperatures, then the interaction object cannot have the interaction permission for the function that generates high temperatures. For example, if there is a water dispenser in the target area that has both cooling and heating functions, and the interaction object is scalded by hot water while using the heating function of the water dispenser, then it can be determined that the interaction object does not have the interaction permission for the heating function of the water dispenser, but the interaction object has the interaction permission for the cooling function of the water dispenser.

[0099] As another example, taking a blind person as the interactive object, if there are knives or other devices in the target area, the interactive object may be stabbed or scratched when using such devices, then it is determined that the interactive object does not have the permission to interact with such devices.

[0100] As another example, if the memory status of the interactive object is abnormal, it can be determined that the interactive object does not have the interactive permission for the stove.

[0101] As another example, for devices with timer functionality, when determining the interaction permissions of an interactive object to that device, the memory capacity of the interactive object can be disregarded.

[0102] Optionally, obtaining the body attribute information of the interactive object may include the following steps: obtaining the image information of the interactive object; performing image recognition on the image information of the interactive object to obtain the body attribute information of the interactive object.

[0103] For example, image information of the interactive object is acquired, and image recognition is performed on the image information to obtain information such as the interactive object's action posture characteristics, height, and hair characteristics, thereby determining the interactive object's body attribute information based on the above information.

[0104] In some embodiments of this application, a body attribute information setting interface can be provided to obtain the body attribute information set by the interactive object through the setting interface.

[0105] In some embodiments of this application, baseline body attribute information can be set. When the body attribute information of an interactive object reaches the baseline body attribute information, all permissions of the device can be opened to the interactive object.

[0106] As an example, baseline attribute information could be age greater than or equal to 18 years, no visual impairment, no hearing impairment, no intellectual disability, normal mental state, and normal memory.

[0107] In some embodiments of this application, for the functions of a device that may have a significant impact, after determining that the interactive object can have the interaction permission for the function based on the physical attribute information of the interactive object, the user manual information of the device can be pushed to the interactive object, and the interactive object's knowledge of the user manual information can be assessed. If the assessment is passed and it is determined that the interactive object has clearly known the user manual information of the device, it is determined that the interactive object has the interaction permission for the aforementioned device function.

[0108] As an example, if a microwave oven exists in the target area, after determining that the interactive object has permission to use the microwave oven based on its physical attribute information, the system pushes the microwave oven's user manual information to the interactive object and generates several questions based on this information. After the interactive object correctly answers the questions, it is determined that the interactive object has permission to use the microwave oven.

[0109] Step S308: Based on the first interaction permission, control the interaction behavior between the interaction object and the device in the target area.

[0110] In the embodiments of this application, step S308 can be implemented in any of the ways described in the various embodiments of this application. The embodiments of this application do not limit this, nor will they be described in detail.

[0111] By implementing the embodiments of this application, the functional information of devices within the target area can be determined based on the device information of the devices within the target area. Then, based on this functional information, the interaction permissions of devices with similar functions within the target area can be associated to obtain at least one device group. Furthermore, the interaction permissions of the interactive object on at least one device in each device group can be obtained. Based on these interaction permissions, the interaction between the interactive object and the devices within the target area can be controlled. This can prevent abnormal interactions between the interactive object and the devices, improving the security of interactions between the interactive object and the devices.

[0112] In one implementation, interaction information between the interactive object and at least one device within the target area can be obtained. Based on this interaction information and the interactive object's first interaction permissions, it can be determined whether abnormal interaction behavior has occurred. For an example, please refer to [link to example]. Figure 4 , Figure 4 This is a schematic diagram of another interactive control method for a device provided in an embodiment of this application. For example... Figure 4 As shown, the method may include, but is not limited to, the following steps:

[0113] Step S401: Obtain device information of devices within the target area.

[0114] In the embodiments of this application, step S401 can be implemented in any of the ways described in the embodiments of this application. The embodiments of this application do not limit this, nor will they be described in detail.

[0115] Step S402: Based on the device information, associate the interaction permissions of devices with similar functions in the target area to obtain at least one device group.

[0116] In the embodiments of this application, step S402 can be implemented in any of the ways described in the embodiments of this application. The embodiments of this application do not limit this, nor will they be described in detail.

[0117] Step S403: Determine the first interaction permission of the interaction object for at least one function of at least one device in each device group.

[0118] In the embodiments of this application, step S403 can be implemented in any of the embodiments of this application. The embodiments of this application do not limit this and will not be described in detail.

[0119] Step S404: Obtain the interaction information of the first device.

[0120] The first device is the device within the target area that interacts with the interactive object.

[0121] Specifically, it obtains information related to the interaction behavior between the interactive object and the first device.

[0122] In the embodiments of this application, the aforementioned interaction information may include, but is not limited to, specific interaction behaviors and other relevant information related to the interaction behaviors. For example, other items involved in the interaction behaviors.

[0123] As an example, changes in current and / or power of devices within a target area can be detected to determine the current usage status of home products, thereby obtaining interaction information from the first device interacting with the interactive object. For instance, when an increase in the power of a kettle is detected, the obtained interaction information is that the interactive object is using the kettle.

[0124] As another example, the operating status information reported by smart devices with status detection capabilities within the target area can be directly obtained. Based on this operating status information, the interaction information of the first device interacting with the interactive object can be obtained. For instance, if an air conditioner with status detection capabilities reports that its operating status has changed to cooling mode, the obtained interaction information is that the interactive object has turned on the air conditioner's cooling mode.

[0125] Step S405: Determine the second interaction permission of the interaction object to the first device from the first interaction permission.

[0126] For example, determine the device group to which the first device belongs, and then determine the first interaction permission corresponding to that device group as the second interaction permission of the interaction object to the first device.

[0127] Step S406: Based on the interaction information and the second interaction permission, determine whether abnormal interaction behavior has occurred.

[0128] For example, based on the interaction information, it is determined whether the interaction behavior between the interaction object and the first device is a normal interaction behavior. If the interaction behavior between the interaction object and the first device is a normal interaction behavior, then the interaction object's second interaction permission to the first device is further combined to determine whether the interaction object has the interaction permission required to implement the interaction behavior corresponding to the interaction information, so as to determine whether an abnormal interaction behavior has occurred.

[0129] As an example, taking the interaction information as the interaction object to use an instant hot water dispenser, if the interaction behavior of using an instant hot water dispenser is a normal interaction behavior, then it is further determined whether the interaction object performing this interaction behavior has the interaction permission to use an instant hot water dispenser. If the interaction object does not have the interaction permission to use an instant hot water dispenser, then it is determined that an abnormal interaction behavior has occurred.

[0130] As another example, if the interaction information directly turns on the ultraviolet germicidal lamp, then this interaction behavior can be directly identified as an abnormal interaction behavior.

[0131] In one alternative implementation, the interaction information includes an interaction image. Based on the interaction information and the second interaction permission, determining whether an abnormal interaction behavior has occurred includes: inputting the interaction image and the second interaction permission into a pre-trained abnormal interaction recognition model, and obtaining the recognition result output by the abnormal interaction recognition model.

[0132] In the embodiments of this application, the abnormal interaction recognition model can identify the interaction image and, in conjunction with the second interaction permission, determine whether the interaction image contains abnormal interaction behavior; based on the recognition result, determine whether abnormal interaction behavior has occurred.

[0133] For example, the interactive image and the second interactive permission are input into a pre-trained abnormal interaction recognition model, and the recognition result output by the abnormal interaction recognition model is obtained, thereby determining whether an abnormal interactive behavior has occurred based on the recognition result.

[0134] Understandably, by recognizing interactive images, it's possible to identify abnormal interactive behaviors that are difficult to detect using conventional methods. For example, eggs cannot be heated in a microwave oven. When an interactive object with microwave oven operation permissions uses the microwave to heat an egg, conventional methods can only obtain the interactive behavior of the interactive object using the microwave oven, but cannot confirm that the interactive behavior is abnormal. However, through an abnormal interaction recognition model, it is possible to identify the abnormal interactive behavior of the interactive object using the microwave to heat an egg.

[0135] In some embodiments of this application, a training image library of image information of abnormal interactions of various types of devices can be obtained, and the image library can be used to train the initial abnormal interaction recognition model to obtain the trained abnormal interaction recognition model.

[0136] Step S407: In response to the occurrence of abnormal interaction behavior, determine the corresponding handling measures for the abnormal interaction behavior.

[0137] For example, in response to an abnormal interactive behavior, a corresponding handling measure is determined based on a control method that enables control of the first device.

[0138] As an example, if the first device involved in the abnormal interaction is a tool, a prompt message can be issued through a pre-set voice device. For instance, if the abnormal interaction involves a blind person using a knife, a prompt message can be issued through a pre-set voice device to alert the interacting object.

[0139] As another example, if the first device involved in the abnormal interaction is a smart device with network control capabilities, then the first device can be controlled accordingly. For instance, if the abnormal interaction involves a younger user using an instant water dispenser, then the heating function of the instant water dispenser can be turned off, or the instant water dispenser can be turned off altogether.

[0140] As another example, if the first device involved in the abnormal interaction behavior is a traditional device without network control capabilities, the power supply connected to that device can be controlled to control the device's operating status.

[0141] As another example, if it is determined that abnormal interaction has caused damage to the equipment and / or environment of the interacting object or target area, an alarm message can be automatically sent to the relevant authorities. For instance, if it is determined that abnormal interaction has caused injury to the body of the person interacting with the object, an alarm message can be sent to a medical institution. Yet another example is that if abnormal interaction causes a fire in the first piece of equipment, an alarm message can be sent to the fire department.

[0142] Optionally, the above identification results include the behavior type and risk level of the abnormal interaction behavior. The above determination of the corresponding handling measures for the abnormal interaction behavior may include the following steps: inputting the behavior type and risk level into a pre-trained handling measure matching model to obtain the handling measures.

[0143] In the embodiments of this application, the above-mentioned treatment measure matching model can be a behavior type and a risk level, matching the corresponding treatment measures.

[0144] For example, the behavior type and risk level of abnormal interaction behavior are input into a pre-trained response matching model, and the output of the response matching model is obtained as the response measure corresponding to the abnormal interaction behavior.

[0145] In some embodiments of this application, the number of times the same type of abnormal interaction behavior occurs when an interaction object interacts with all devices in a device group can be counted. When the number of interactions exceeds a preset threshold, the target interaction permission associated with the abnormal interaction behavior is determined, and the target interaction permission of the interaction object to the devices in the device group is revoked.

[0146] Step S408: Based on the handling measures, control the interaction behavior between the interactive object and the first device.

[0147] Specifically, measures are taken to handle abnormal interactive behaviors in order to control the interaction between the interactive object and the first device.

[0148] By implementing the embodiments of this application, interaction information between an interactive object and at least one device within a target area can be obtained. Based on this interaction information and the interactive object's first interaction permissions, it can be determined whether abnormal interaction behavior has occurred. This can prevent abnormal interactions between the interactive object and the device, thereby improving the security of interactions between the interactive object and the device.

[0149] In some embodiments of this application, the above method may further include: in response to an abnormal interactive behavior, obtaining user manual information of the first device; and pushing the user manual information to the interactive object.

[0150] For example, in response to an abnormal interaction, the user manual information of the first device is obtained and pushed to the interaction object.

[0151] As an example, the user manual information for the first device can be pushed to the terminal device used by the interacting object (e.g., mobile phone, tablet, etc.).

[0152] As another example, if a television is present in the target area, the user manual information of the first device can be pushed to the television when the interactive object uses the television.

[0153] As another example, user manual information for a first device can be pushed to the interactive object through a pre-configured voice device.

[0154] In some embodiments of this application, the method for pushing user manual information of the first device can be determined by using the body attribute information of the interactive object obtained in the foregoing embodiments.

[0155] As an example, if the age information in the body attribute information of the interactive object is greater than or equal to 60 years old, or less than or equal to 18 years old, the user manual information of the first device can be pushed through the voice device pre-set in the target area.

[0156] In some embodiments of this application, audio information of the interactive object can be obtained, and the language type (e.g., language type or dialect type) used by the interactive object can be determined based on the audio information. The user manual information of the first device can then be pushed to the interactive object using the language type.

[0157] In some embodiments of this application, the above method may further include: in response to an abnormal interaction behavior, determining a third interaction permission associated with the abnormal interaction behavior; determining a target device group associated with a first device from the device group; and revoking the third interaction permission of the interaction object on all devices in the target device group.

[0158] Specifically, in response to an abnormal interaction, the third interaction permission associated with the abnormal interaction is determined, and from at least one determined device group, the target device group associated with the first device is determined, so as to revoke the third interaction permission of the interaction object on all devices in the target device group.

[0159] As an example, taking an instant hot water dispenser as the first device, and an electric kettle as an associated device group, in response to determining that the interaction behavior between the interaction object and the instant hot water dispenser is abnormal, the third-party interaction permission of the interaction object to the instant hot water dispenser and the electric kettle in the target device group is revoked.

[0160] Optionally, the above method may further include: determining whether the interaction object has obtained the user manual information of the first device; in response to the interaction object having obtained the user manual information of the first device, restoring the interaction object's third interaction permission to all devices in the target device group.

[0161] As an example, taking the example of pushing the instruction information of a first device to a television in a target area, when the television displays the instruction information, a pre-set image acquisition device can be used to determine whether the interactive object is paying attention to the information displayed on the television, thereby determining whether the interactive object has learned the instruction information of the first device. Upon determining that the interactive object has learned the instruction information of the first device, the interactive object's third-party interaction rights with all devices in the target device group are restored.

[0162] As another example, several questions can be generated based on the instruction information of the first device. After the interactive object answers the questions correctly, it is determined that the interactive object has learned the instruction information of the first device, and then the interactive object's third interactive permission to all devices in the target device group is restored.

[0163] Please see Figure 5 , Figure 5 This is a schematic diagram of an interactive control device for a device provided in an embodiment of this application. For example... Figure 5 As shown, the device 500 includes: a first acquisition module 501, used to acquire device information of devices within a target area; a first processing module 502, used to associate the interaction permissions of devices with similar functions within the target area based on the device information, and acquire at least one device group; a second processing module 503, used to determine the first interaction permission of the interaction object for at least one function of at least one device in each device group; and a control module 504, used to control the interaction behavior of the interaction object with the devices within the target area based on the first interaction permission.

[0164] In one implementation, the first acquisition module 501 is specifically used to: acquire image information of a target area; perform image recognition on the image information of the target area to acquire image information of a device within the target area; and perform image recognition on the image information of the device within the target area to acquire device information of the device within the target area.

[0165] In one implementation, the first processing module 502 is specifically used to: obtain user manual information of devices within a target area based on device information; perform semantic recognition on the user manual information to obtain functional information of devices within the target area; determine the functional similarity between devices within the target area based on the functional information; and associate the interaction permissions of devices within the target area whose functional similarity is greater than a preset threshold to determine them as a device group.

[0166] In one alternative implementation, the second processing module 503 is specifically used to: obtain the body attribute information of the interactive object; and determine the first interaction permission of the interactive object for at least a portion of the functions of at least one device in each device group based on the body attribute information and the functional information of the devices in each device group.

[0167] Optionally, the first processing module 502 is specifically used to: acquire image information of the interactive object; perform image recognition on the image information of the interactive object to acquire the body attribute information of the interactive object.

[0168] In one implementation, the control module 504 is specifically used to: acquire interaction information of a first device; wherein the first device is a device within the target area that interacts with the interaction object; determine the second interaction permission of the interaction object to the first device from the first interaction permission; determine whether an abnormal interaction behavior has occurred based on the interaction information and the second interaction permission; in response to the occurrence of abnormal interaction behavior, determine the corresponding handling measures for the abnormal interaction behavior; and control the interaction behavior between the interaction object and the first device based on the handling measures.

[0169] In one optional implementation, the interaction information includes an interaction image, and the control module 504 is specifically used to: input the interaction image and the second interaction permission into a pre-trained abnormal interaction recognition model, and obtain the recognition result output by the abnormal interaction recognition model; wherein, the abnormal interaction recognition model can recognize the interaction image and, in combination with the second interaction permission, determine whether the interaction image contains abnormal interaction behavior; and, based on the recognition result, determine whether abnormal interaction behavior has occurred.

[0170] Optionally, the identification results include the behavior type and risk level of the abnormal interaction behavior. The control module 504 is specifically used to: input the behavior type and risk level into a pre-trained treatment measure matching model to obtain treatment measures; wherein, the treatment measure matching model can be the behavior type and risk level, and match the corresponding treatment measures.

[0171] In an alternative implementation, the above apparatus further includes a second acquisition module and a push module. As an example, please refer to... Figure 6 , Figure 6 This is a schematic diagram of an interactive control device for another device provided in an embodiment of this application. For example... Figure 6 As shown, the device 600 further includes: a second acquisition module 605, used to acquire user manual information of the first device in response to an abnormal interaction; and a push module 606, used to push the user manual information to the interaction object. Figure 6 Modules 601-604 in Figure 5 Modules 501 to 504 in the series have the same structure and function.

[0172] In an alternative implementation, the above apparatus further includes a third processing module, a fourth processing module, and a fifth processing module. As an example, please refer to... Figure 7 , Figure 7 This is a schematic diagram of another interactive control device provided in an embodiment of this application. For example... Figure 7 As shown, the device 700 further includes: a third processing module 705 for determining the third interaction permission associated with the abnormal interaction behavior in response to the occurrence of abnormal interaction behavior; a fourth processing module 706 for determining the target device group associated with the first device from the device group; and a fifth processing module 707 for revoking the third interaction permission of the interaction object on all devices in the target device group. Figure 7 Modules 701-704 in Figure 5 Modules 501 to 504 in the series have the same structure and function.

[0173] Optionally, the above-described apparatus further includes a determining module and a sixth processing module. As an example, please refer to... Figure 8 , Figure 8This is a schematic diagram of another interactive control device provided in an embodiment of this application. For example... Figure 8 As shown, the device 800 further includes: a determining module 805, used to determine whether the interactive object has obtained the user manual information of the first device; and a sixth processing module 806, used to restore the interactive object's third interaction permission to all devices in the target device group in response to the interactive object having obtained the user manual information of the first device. Figure 8 Modules 801-804 in Figure 5 Modules 501 to 504 in the series have the same structure and function.

[0174] The apparatus described in this application embodiment can obtain device information of devices within a target area, associate the devices within the target area based on the device information, obtain at least one device group, and obtain interaction permissions of an interactive object for at least one device in each device group. Based on these interaction permissions, the interaction between the interactive object and the devices within the target area can be controlled. This can prevent abnormal interactions between the interactive object and the devices, improving the security of interactions between the interactive object and the devices.

[0175] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0176] Based on embodiments of this application, this application also provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the interactive control method of the device of any of the foregoing embodiments.

[0177] Based on embodiments of this application, this application also provides a computer-readable storage medium, wherein computer instructions are used to cause a computer to execute an interactive control method for a device according to any of the foregoing embodiments provided in this application.

[0178] Please see Figure 9 ,like Figure 9 The diagram shown is a schematic block diagram of an example electronic device that can be used to implement embodiments of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present application described and / or claimed herein.

[0179] like Figure 9As shown, device 900 includes a computing unit 901, which can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) 902 or a computer program loaded from storage unit 908 into random access memory (RAM) 903. RAM 903 may also store various programs and data required for the operation of device 900. The computing unit 901, ROM 902, and RAM 903 are interconnected via bus 904. Input / output (I / O) interface 905 is also connected to bus 904.

[0180] Multiple components in device 900 are connected to I / O interface 905, including: input unit 906, such as keyboard, mouse, etc.; output unit 907, such as various types of monitors, speakers, etc.; storage unit 908, such as disk, optical disk, etc.; and communication unit 909, such as network card, modem, wireless transceiver, etc. Communication unit 909 allows device 900 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0181] The computing unit 901 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 901 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 901 performs the various methods and processes described above, such as the interactive control methods of the device. For example, in some embodiments, the interactive control methods of the device may be implemented as computer software programs tangibly contained in a machine-readable medium, such as storage unit 908. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 900 via ROM 902 and / or communication unit 909. When the computer program is loaded into RAM 903 and executed by the computing unit 901, one or more steps of the interactive control methods of the device described above may be performed. Alternatively, in other embodiments, the computing unit 901 may be configured to perform interactive control methods of the device by any other suitable means (e.g., by means of firmware).

[0182] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems-on-chip (SoCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0183] The program code used to implement the methods of this application may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing device, such that when executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0184] In the context of this application, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) or flash memory, optical fiber, compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0185] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a cathode ray tube (CRT) or LCD (Liquid Crystal Display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0186] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), the Internet, and blockchain networks.

[0187] Computer systems can include clients and servers. Clients and servers are generally geographically separated and typically interact via communication networks. The client-server relationship is established by computer programs running on the respective computers and having a client-server relationship with each other. A server can be a cloud server, also known as a cloud computing server or cloud host, a hosting product within the cloud computing service system that addresses the shortcomings of traditional physical hosts and VPS (Virtual Private Server) services, such as high management difficulty and weak business scalability. Servers can also be servers for distributed systems or servers integrated with blockchain technology.

[0188] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this application can be achieved, and this is not limited herein.

[0189] The specific embodiments described above do not constitute a limitation on the scope of protection of this application. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A method for interactive control of a device, characterized in that, include: Obtain device information for devices within the target area; Based on the device information, the interaction permissions of devices with similar functions in the target area are associated to obtain at least one device group; Determine the first interaction permission of the interaction object for at least one function of at least one device in each of the device groups; Based on the first interaction permission, the interaction behavior between the interaction object and the device in the target area is controlled; The step of controlling the interaction behavior between the interaction object and the device within the target area based on the first interaction permission includes: Obtain interaction information of a first device; wherein, the first device is a device within the target area that interacts with the interaction object, and the interaction information is information related to the interaction behavior between the interaction object and the first device; From the first interaction permissions, determine the second interaction permissions of the interaction object for the first device; Based on the interaction information and the second interaction permission, determine whether an abnormal interaction behavior has occurred; In response to the occurrence of the abnormal interaction behavior, determine the corresponding handling measures for the abnormal interaction behavior; Based on the aforementioned measures, the interaction behavior between the interactive object and the first device is controlled; The interaction information includes an interaction image. The step of determining whether abnormal interaction behavior has occurred based on the interaction information and the second interaction permission includes: The interactive image and the second interactive permission are input into a pre-trained abnormal interaction recognition model to obtain the recognition result output by the abnormal interaction recognition model; wherein, the abnormal interaction recognition model can recognize the interactive image and, in combination with the second interactive permission, determine whether the interactive image contains abnormal interactive behavior; Based on the identification results, determine whether the abnormal interaction behavior has occurred.

2. The method as described in claim 1, characterized in that, The acquisition of device information within the target area includes: Obtain image information of the target region; Image recognition is performed on the image information of the target area to obtain the image information of the device within the target area; Image recognition is performed on the image information of the devices within the target area to obtain the device information of the devices within the target area.

3. The method as described in claim 1, characterized in that, The step of associating the interaction permissions of devices with similar functions within the target area based on the device information to obtain at least one device group includes: Based on the device information, obtain the user manual information of the devices within the target area; Semantic recognition is performed on the instruction manual information to obtain the functional information of the device within the target area; Based on the functional information, the functional similarity between devices within the target area is determined; Associate the interaction permissions of devices within the target area whose functional similarity is greater than a preset threshold. Devices with a functional similarity greater than a preset threshold are identified as a device group.

4. The method as described in claim 3, characterized in that, The determination of the first interaction permission of the interaction object for at least one function of at least one device in each of the device groups includes: Obtain the body attribute information of the interactive object; Based on the body attribute information and the functional information of the devices in each device group, the interaction object is given a first interaction permission for at least a portion of the functions of at least one device in each device group.

5. The method as described in claim 4, characterized in that, The step of obtaining the body attribute information of the interactive object includes: Obtain the image information of the interactive object; Image recognition is performed on the image information of the interactive object to obtain the body attribute information of the interactive object.

6. The method as described in claim 1, characterized in that, The identification result includes the behavior type and risk level of the abnormal interaction behavior, and the determination of the corresponding handling measures for the abnormal interaction behavior includes: The behavior type and the risk level are input into a pre-trained treatment measure matching model to obtain the treatment measure; wherein, the treatment measure matching model can match the corresponding treatment measure based on the behavior type and the risk level.

7. The method as described in claim 1 or 6, characterized in that, The method further includes: In response to the occurrence of the abnormal interaction behavior, obtain the user manual information of the first device; The user manual information is pushed to the interactive object.

8. The method as described in claim 1 or 6, characterized in that, The method further includes: In response to the occurrence of the abnormal interaction behavior, determine the third interaction permission associated with the abnormal interaction behavior; From the device group, determine the target device group associated with the first device; Revoke the third interaction permission of the interaction object on all devices in the target device group.

9. The method as described in claim 8, characterized in that, The method further includes: Determine whether the interaction object has obtained the user manual information of the first device; In response to the fact that the interaction object has learned the user manual information of the first device, the interaction object's third interaction permission for all devices in the target device group is restored.

10. An interactive control device for an equipment, characterized in that, include: The first acquisition module is used to acquire device information of devices within the target area; The first processing module is used to associate the interaction permissions of devices with similar functions in the target area based on the device information, and obtain at least one device group; The second processing module is used to determine the first interaction permission of the interaction object for at least one function of at least one device in each of the device groups; The control module is used to control the interaction behavior between the interaction object and the device within the target area based on the first interaction permission; the control module is specifically used for: Obtain interaction information of a first device; wherein, the first device is a device within the target area that interacts with the interaction object, and the interaction information is information related to the interaction behavior between the interaction object and the first device; From the first interaction permissions, determine the second interaction permissions of the interaction object for the first device; Based on the interaction information and the second interaction permission, determine whether an abnormal interaction behavior has occurred; In response to the occurrence of the abnormal interaction behavior, determine the corresponding handling measures for the abnormal interaction behavior; Based on the aforementioned measures, the interaction behavior between the interactive object and the first device is controlled; The interactive information includes interactive images, and the control module is specifically used for: The interactive image and the second interactive permission are input into a pre-trained abnormal interaction recognition model to obtain the recognition result output by the abnormal interaction recognition model; wherein, the abnormal interaction recognition model can recognize the interactive image and, in combination with the second interactive permission, determine whether the interactive image contains abnormal interactive behavior; Based on the identification results, determine whether the abnormal interaction behavior has occurred.

11. An electronic device, characterized in that, include: At least one processor; and a memory communicatively connected to the at least one processor; The memory stores instructions that can be executed by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the interactive control method of the device according to any one of claims 1 to 9.

12. A computer-readable storage medium for storing instructions, characterized in that, When the instructions are executed, the method as described in any one of claims 1 to 9 is implemented.

Images