Multi-device joint control method and system applied to digital human

Abstract

The application relates to the technical field of device linkage control, and discloses a multi-device joint control method and system applied to a digital person, which comprises the following steps: in the process of interaction between the digital person and a demand person, a first control scheme for a target interactive device is determined according to the first interaction demand of the demand person facing the digital person; the second interaction demand of the demand person is determined according to the related reaction information of the demand person to the current scene, and a first to-be-linked device and the corresponding second control scheme are determined according to the second interaction demand; and corresponding linkage control operations are performed on the target interactive device and the first to-be-linked device according to the first control scheme and the second control scheme. It can be seen that the multi-device linkage control function can be realized by implementing the application, the linkage control accuracy and reliability of the multi-device are improved, the linkage control efficiency and convenience of the multi-device are improved, the collaborative efficiency of the multi-device is improved, the operation process between the multi-device is simplified, and the user experience is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of device linkage control, in particular to a multi-device joint control method and system applied to digital people. BACKGROUND

[0002] With the rapid development of science and technology, people's application of devices is increasingly widespread and in-depth, from home entertainment, daily life to industrial production, scientific research, etc. Various devices have become an indispensable part of modern society. However, in actual application, the existing device control method is mostly that the user controls each device one by one, which is tedious and over-reliant on human operation, and the existing device control method will lead to low control accuracy and control efficiency of the device. Therefore, it is particularly important to provide a device control method for improving the control accuracy and control efficiency of the device. SUMMARY

[0003] The present application provides a multi-device joint control method and system applied to digital people, which can realize linkage control of multiple devices, thereby improving the control accuracy and control efficiency of the device.

[0004] In order to solve the above technical problems, the first aspect of the present application discloses a multi-device joint control method applied to digital people, which comprises:

[0005] In the process of interaction between the digital person and the demand person, according to the first interaction demand of the demand person facing the digital person perceived, a first control scheme for the target interaction device is determined;

[0006] According to the relevant reaction information of the demand person to the current scene perceived, the second interaction demand of the demand person is determined, and according to the second interaction demand, the first to-be-linked device and its corresponding second control scheme are determined;

[0007] According to the first control scheme and the second control scheme, the target interaction device and the first to-be-linked device are executed corresponding linkage control operation.

[0008] As an optional implementation, in the first aspect of the present application, before the second interaction demand is determined, the first to-be-linked device and its corresponding second control scheme are determined, the method further comprises:

[0009] According to the second interaction demand, the expected demand control type of the demand person for the current scene and its corresponding expected control scheme are determined;

[0010] determine, according to the determined scene property information of the current scene, that the expected demand regulation type is based on a regular phenomenon condition of the current scene, and determine an expected phenomenon condition of the current scene for the expected demand regulation type;

[0011] determine, according to the expected phenomenon condition, the regular phenomenon condition and the expected regulation scheme, whether the demand personnel meet a preset device regulation permission condition for the current scene;

[0012] when it is determined that the demand personnel meet the device regulation permission condition, perform the operation of determining, according to the second interaction demand, a first to-be-interactive device and a second control scheme corresponding to the first to-be-interactive device; the first to-be-interactive device is in the current scene.

[0013] As an optional implementation, in the first aspect of the present application, the method further comprises:

[0014] when it is determined that the demand personnel do not meet the device regulation permission condition, determine, according to the first interaction demand, the expected demand regulation type and the expected regulation scheme corresponding to the expected demand regulation type, a target candidate scene from preset candidate scenes corresponding to the digital person;

[0015] determine, according to the first interaction demand, the expected demand regulation type and the expected regulation scheme corresponding to the expected demand regulation type, a second to-be-interactive device and a third control scheme corresponding to the second to-be-interactive device from the target candidate scene, and perform a corresponding interactive control operation on the second to-be-interactive device according to the third control scheme;

[0016] generate a scene change prompt instruction corresponding to the demand personnel according to the target candidate scene, the scene change prompt instruction being used to prompt the demand personnel to go to the target candidate scene to perform a corresponding interaction operation.

[0017] As an optional implementation, in the first aspect of the present application, after the operation of determining, according to the second interaction demand, a first to-be-interactive device and a second control scheme corresponding to the first to-be-interactive device, the method further comprises:

[0018] determine, according to the second control scheme, whether the first to-be-interactive device meets a preset expected effect realization condition;

[0019] when it is determined that the first to-be-interactive device meets the expected effect realization condition, perform the operation of performing, according to the first control scheme and the second control scheme, a corresponding interactive control operation on the target interactive device and the first to-be-interactive device;

[0020] determining function configuration information of the first to-be-linked device, and determining an expected regulation effect of the demand person on the current scene according to the second control scheme; determining a third to-be-linked device that can realize similar functions to the first to-be-linked device and has a linkage priority lower than the first to-be-linked device from the current scene according to the function configuration information and the expected regulation effect; determining a fourth control scheme of the third to-be-linked device according to the second control scheme; and performing corresponding linkage control operations on the target interactive device and the third to-be-linked device according to the first control scheme and the fourth control scheme.

[0021] As an optional implementation form, in the first aspect of the present application, the step of judging whether the demand person meets a preset device regulation permission condition for the current scene according to the expected phenomenon condition, the regular phenomenon condition and the expected regulation scheme comprises:

[0022] judging whether the current scene meets a preset abnormal phenomenon condition according to the expected phenomenon condition and the regular phenomenon condition;

[0023] when it is judged that the current scene does not meet the abnormal phenomenon condition, determining other interactive and reaction information of other persons in the current scene, and determining a general demand phenomenon condition of the other persons on the current scene according to the other interactive and reaction information;

[0024] judging whether the demand person and the other persons meet a preset unified scene regulation demand condition according to the expected regulation scheme and the general demand phenomenon condition;

[0025] when it is judged that the demand person and the other persons meet the unified scene regulation demand condition, determining that the demand person meets the preset device regulation permission condition for the current scene;

[0026] when it is judged that the demand person and the other persons do not meet the unified scene regulation demand condition, determining a demand execution priority situation of the demand person and the other persons according to the regular phenomenon condition, the expected regulation scheme and the general demand phenomenon condition; when the demand execution priority situation indicates that the demand execution priority of the demand person is higher than that of the other persons, determining that the demand person meets the preset device regulation permission condition for the current scene; and when the demand execution priority situation indicates that the demand execution priority of the demand person is less than or equal to that of the other persons, determining that the demand person does not meet the preset device regulation permission condition for the current scene.

[0027] As an optional implementation, in the first aspect of the present application, the method further comprises:

[0028] When it is judged that the demand person and the other person meet the unified scene regulation demand condition, whether the current scene meets a preset regulation implementable demand condition is judged according to the mass demand phenomenon condition, the expected regulation scheme and a preset maximum limit regulation scheme of the current scene.

[0029] When it is judged that the current scene meets the regulation implementable demand condition, the step of determining that the demand person meets a preset device regulation authority condition for the current scene is executed.

[0030] When it is judged that the current scene does not meet the regulation implementable demand condition, it is determined that the demand person does not meet a preset device regulation authority condition for the current scene.

[0031] As an optional implementation, in the first aspect of the present application, the judging whether the first to-be-linked device meets a preset expected effect implementable condition according to the second control scheme comprises:

[0032] According to the second control scheme and the personnel information of the demand person, whether the first to-be-linked device meets a preset operation regulation authority condition is judged.

[0033] When it is judged that the first to-be-linked device does not meet the operation regulation authority condition, it is determined that the first to-be-linked device does not meet a preset expected effect implementable condition.

[0034] When it is judged that the first to-be-linked device meets the operation regulation authority condition, according to the second control scheme and the determined personnel and article distribution information of the current scene, a predicted influence condition of the first to-be-linked device based on the second control scheme is determined, the predicted influence condition comprising a predicted influence range and / or a predicted specific influence content.

[0035] According to the predicted influence condition, whether the first to-be-linked device and the current scene meet a preset acceptable influence condition is judged.

[0036] When it is judged that the first to-be-linked device and the current scene meet the acceptable influence condition, it is determined that the first to-be-linked device meets a preset expected effect implementable condition.

[0037] When it is judged that the first to-be-linked device and the current scene do not meet the acceptable influence condition, it is determined that the first to-be-linked device does not meet a preset expected effect implementable condition.

[0038] The second aspect of the present application discloses a multi-device joint control system applied to a digital human, and the system comprises:

[0039] A first scheme determination module is configured to determine a first control scheme for a target interaction device according to a first interaction demand of a demand person facing the digital human during interaction between the digital human and the demand person.

[0040] A second scheme determination module is configured to determine a second interaction demand of the demand person according to relevant reaction information of the demand person to a current scene, and determine a first to-be-linked device and a corresponding second control scheme of the first to-be-linked device according to the second interaction demand.

[0041] A linkage control module is configured to perform corresponding linkage control operations on the target interaction device and the first to-be-linked device according to the first control scheme and the second control scheme.

[0042] As an optional implementation, in the second aspect of the present application, the system further comprises:

[0043] A determination module is configured to determine an expected demand regulation type of the demand person for the current scene and a corresponding expected regulation scheme according to the second interaction demand before the second scheme determination module determines a first to-be-linked device and a corresponding second control scheme of the first to-be-linked device according to the second interaction demand; determine that the expected demand regulation type is based on a regular phenomenon condition of the current scene according to the determined scene property information of the current scene, and determine an expected phenomenon condition of the current scene for the expected demand regulation type.

[0044] A first judgment module is configured to judge whether the demand person meets a preset device regulation permission condition for the current scene according to the expected phenomenon condition, the regular phenomenon condition and the expected regulation scheme; when it is judged that the demand person meets the device regulation permission condition, the second scheme determination module performs the operation of determining a first to-be-linked device and a corresponding second control scheme of the first to-be-linked device according to the second interaction demand; and the first to-be-linked device is in the current scene.

[0045] As an optional implementation, in the second aspect of the present application, the system further comprises:

[0046] A candidate scene determination module is configured to determine a target candidate scene from preset candidate scenes corresponding to the digital human according to the first interaction demand, the expected demand regulation type and the corresponding expected regulation scheme when it is judged by the first judgment module that the demand person does not meet the device regulation permission condition.

[0047] The third scheme determining module is configured to determine a second to-be-linked device and a third control scheme corresponding to the second to-be-linked device from the target candidate scene according to the first interaction demand, the expected demand regulation type, and the corresponding expected regulation scheme, and perform a corresponding linked control operation on the second to-be-linked device according to the third control scheme.

[0048] The prompt instruction generating module is configured to generate a scene change prompt instruction corresponding to the demand personnel according to the target candidate scene, where the scene change prompt instruction is used to prompt the demand personnel to go to the target candidate scene to perform a corresponding interaction operation.

[0049] As an optional implementation, in the second aspect of the present application, the system further comprises:

[0050] The second judging module is configured to judge whether the first to-be-linked device meets a preset expected effect realization condition according to the second control scheme after the second scheme determining module determines the first to-be-linked device and the second control scheme corresponding to the first to-be-linked device according to the second interaction demand; and when it is judged that the first to-be-linked device meets the expected effect realization condition, the linked control module performs the step of performing a corresponding linked control operation on the target interaction device and the first to-be-linked device according to the first control scheme and the second control scheme.

[0051] The third scheme determining module is configured to determine function configuration information of the first to-be-linked device and determine an expected regulation effect of the demand personnel for the current scene according to the second control scheme when the second judging module judges that the first to-be-linked device does not meet the expected effect realization condition; determine a third to-be-linked device that can realize a similar function to the first to-be-linked device and has a linked priority lower than the first to-be-linked device from the current scene according to the function configuration information and the expected regulation effect; and determine a fourth control scheme of the third to-be-linked device according to the second control scheme.

[0052] The linked control module is further configured to perform a corresponding linked control operation on the target interaction device and the third to-be-linked device according to the first control scheme and the fourth control scheme.

[0053] As an optional implementation, in the second aspect of the present application, the manner in which the first judging module judges whether the demand personnel meets a preset device regulation permission condition for the current scene according to the expected phenomenon condition, the conventional phenomenon condition, and the expected regulation scheme specifically comprises:

[0054] determine whether the current scene meets a preset abnormal phenomenon condition according to the expected phenomenon condition and the normal phenomenon condition;

[0055] when it is determined that the current scene does not meet the abnormal phenomenon condition, determine other interaction and reaction information of other personnel in the current scene, and determine a public demand phenomenon condition of the other personnel for the current scene according to the other interaction and reaction information;

[0056] determine whether the demand personnel and the other personnel meet a preset unified scene regulation demand condition according to the expected regulation scheme and the public demand phenomenon condition;

[0057] when it is determined that the demand personnel and the other personnel meet the unified scene regulation demand condition, determine that the demand personnel meet a preset device regulation permission condition for the current scene;

[0058] when it is determined that the demand personnel and the other personnel do not meet the unified scene regulation demand condition, determine a demand execution priority situation of the demand personnel and the other personnel according to the normal phenomenon condition, the expected regulation scheme and the public demand phenomenon condition; when the demand execution priority situation indicates that the demand execution priority of the demand personnel is higher than that of the other personnel, determine that the demand personnel meet a preset device regulation permission condition for the current scene; when the demand execution priority situation indicates that the demand execution priority of the demand personnel is less than or equal to that of the other personnel, determine that the demand personnel do not meet a preset device regulation permission condition for the current scene.

[0059] As an optional implementation, in the second aspect, the first determining module is further configured to, when it is determined that the demand personnel and the other personnel meet the unified scene regulation demand condition, determine whether the current scene meets a preset regulation implementable demand condition according to the public demand phenomenon condition, the expected regulation scheme and a preset maximum limit regulation scheme of the current scene; when it is determined that the current scene meets the regulation implementable demand condition, execute the step of determining that the demand personnel meet the preset device regulation permission condition for the current scene; and when it is determined that the current scene does not meet the regulation implementable demand condition, determine that the demand personnel do not meet the preset device regulation permission condition for the current scene.

[0060] As an optional implementation, in the second aspect, the second determining module determines whether the first to-be-associated device meets a preset expected effect implementable condition according to the second control scheme, and the manner specifically includes:

[0061] According to the second control scheme and the personnel information of the required personnel, it is judged whether the first to-be-linked device meets a preset operation control permission condition;

[0062] When it is judged that the first to-be-linked device does not meet the operation control permission condition, it is determined that the first to-be-linked device does not meet a preset expected effect realization condition;

[0063] When it is judged that the first to-be-linked device meets the operation control permission condition, according to the second control scheme and the determined personnel and article distribution information of the current scene, a predicted influence situation caused by the first to-be-linked device based on the second control scheme is determined, and the predicted influence situation includes a predicted influence range and / or a predicted specific influence content;

[0064] According to the predicted influence situation, it is judged whether the first to-be-linked device and the current scene meet a preset acceptable influence condition;

[0065] When it is judged that the first to-be-linked device and the current scene meet the acceptable influence condition, it is determined that the first to-be-linked device meets a preset expected effect realization condition;

[0066] When it is judged that the first to-be-linked device and the current scene do not meet the acceptable influence condition, it is determined that the first to-be-linked device does not meet a preset expected effect realization condition.

[0067] The third aspect of the present application discloses another kind of multi-device joint control system applied to digital person, the system includes:

[0068] Memory storing executable program code;

[0069] Processor coupled with the memory;

[0070] The processor calls the executable program code stored in the memory, and executes the multi-device joint control method applied to digital person disclosed in the first aspect of the present application.

[0071] The fourth aspect of the present application discloses a computer storage medium, the computer storage medium stores computer instructions, and the computer instructions are called to execute the multi-device joint control method applied to digital person disclosed in the first aspect of the present application.

[0072] Compared with the prior art, the embodiment of the present application has the following beneficial effects:

[0073] In the embodiment of the present application, in the process of interaction between the digital human and the demand person, the first control scheme for the target interaction device is determined according to the perceived first interaction demand of the demand person facing the digital human; the second interaction demand of the demand person is determined according to the perceived relevant reaction information of the demand person to the current scene, and the first to-be-linked device and its corresponding second control scheme are determined according to the second interaction demand; and the corresponding linkage control operation is performed on the target interaction device and the first to-be-linked device according to the first control scheme and the second control scheme. It can be seen that the present application can determine the first control scheme according to the first interaction demand of the digital human, determine the second control scheme according to the relevant reaction information, and then perform the corresponding linkage control operation on the target interaction device and the first to-be-linked device according to the first control scheme and the second control scheme, thereby realizing the multi-device linkage control function, which is beneficial to improving the comprehensiveness and rationality of the multi-device linkage control mode applied to the digital human, thereby improving the linkage control accuracy and reliability of the multi-device, and improving the linkage control efficiency and convenience of the multi-device, thereby improving the cooperation efficiency of the multi-device and simplifying the operation process between the multi-device, and improving the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0074] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0075] Figure 1 is a flowchart of a multi-device joint control method applied to a digital human disclosed by the embodiment of the present application;

[0076] Figure 2 is a flowchart of another multi-device joint control method applied to a digital human disclosed by the embodiment of the present application;

[0077] Figure 3 is a structural diagram of a multi-device joint control system applied to a digital human disclosed by the embodiment of the present application;

[0078] Figure 4 is a structural diagram of another multi-device joint control system applied to a digital human disclosed by the embodiment of the present application;

[0079] Figure 5 is a structural diagram of another multi-device joint control system applied to a digital human disclosed by the embodiment of the present application. DETAILED DESCRIPTION

[0080] In the following, the technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all the other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0081] The terms "first", "second", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish different objects, rather than to describe a particular order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, device, product, or end including a series of steps or units is not limited to the listed steps or units, but can optionally include steps or units not listed or can optionally include other steps or units inherent to the process, method, product, or end.

[0082] Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearance of the phrase in various places in the specification does not necessarily all refer to the same embodiment, nor does it necessarily exclude other embodiments that are not explicitly described. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0083] The present application discloses a multi-device joint control method and system applied to digital people, which can determine a first control scheme according to a first interaction demand based on digital people and determine a second control scheme according to relevant reaction information, and then perform corresponding joint control operations on target interaction devices and first to-be-linked devices according to the first control scheme and the second scheme, to realize a multi-device joint control function, which is conducive to improving the comprehensiveness and rationality of the multi-device joint control method applied to digital people, and further conducive to improving the joint control accuracy and reliability of the multi-device, and conducive to improving the joint control efficiency and convenience of the multi-device, thereby conducive to improving the collaborative efficiency of the multi-device and simplifying the operation process between the multi-device, and improving user experience. The following will be described in detail.

[0084] Embodiment one

[0085] Please refer to Figure 1 , Figure 1 is a flowchart of a multi-device joint control method applied to digital people according to an embodiment of the present application. Wherein, Figure 1The described method can be applied to a multi-device joint control system of a digital human, wherein the system can include a server, and the server includes a local server or a cloud server, and embodiments of the present application are not limited. Figure 1 As shown, the multi-device joint control method applied to the digital human includes the following operations:

[0086] 101. During the interaction between the digital human and the demand person, a first control scheme for a target interaction device is determined according to a first interaction demand of the demand person facing the digital human that is perceived.

[0087] Optionally, the first interaction demand can include, but is not limited to, one or more of the following: an interaction demand of the demand person received by the digital human for information query and knowledge acquisition, an interaction demand for entertainment and leisure, an interaction demand for education and learning, an interaction demand for socialization and communication, and an interaction demand for personalized service and customization. Embodiments of the present application are not limited thereto.

[0088] Optionally, the digital human and the target interaction device can be associated objects (such as integrated, having intersection content, etc.), and the digital human and the target interaction device can also be two independent objects, and embodiments of the present application are not limited thereto.

[0089] Optionally, the interaction record corresponding to each digital human can include an interaction record permission of the interaction record, which can be used to limit the permission requirement for viewing and / or obtaining the interaction record. Specifically, when viewing and / or obtaining the interaction record, the execution subject needs to be verified for permission, and when the permission of the execution subject is less than the interaction record permission of the interaction record, the execution subject is not allowed to view and / or obtain the interaction record, and the execution subject needs to apply for permission to obtain the viewing and / or obtaining permission of the interaction record, and embodiments of the present application are not limited thereto.

[0090] Optionally, during the process of collecting the interaction records corresponding to the digital humans in the target time period, all the collected interaction records are encrypted, and the encrypted interaction records are transmitted. The data encryption method can include symmetric encryption or asymmetric encryption. After receiving the encrypted interaction records, the data is decrypted based on a preset secret key, and the data is verified for data and data integrity. After verification, each interaction record is analyzed to obtain the operation of the interaction control strategy to be improved, and embodiments of the present application are not limited thereto.

[0091] 102. According to the perceived reaction information of the demand person to the current scene, a second interaction demand of the demand person is determined, and a first to-be-linked device and a second control scheme corresponding thereto are determined according to the second interaction demand.

[0092] Optionally, the second interaction requirement can include, but is not limited to, one or more of a visual aspect interaction requirement, an auditory aspect interaction requirement, a tactile aspect interaction requirement, an olfactory and gustatory aspect interaction requirement, an emotional aspect interaction requirement, a psychological aspect interaction requirement, an interaction fluency aspect interaction requirement, a personalization requirement aspect interaction requirement, a feedback and confirmation aspect interaction requirement, a movement mode interaction requirement, and other aspects interaction requirement, and the like, without limitation.

[0093] Optionally, the relevant reaction information of the requirement personnel to the current scene includes, for example, the requirement personnel feels that the current scene is too noisy, too cold, too dark, or needs to take the elevator, and the like, without limitation.

[0094] Further, for the first to-be-linked device and the corresponding second control scheme, for example, when the user interacts with the digital human to consult related issues, the user feels a little hot, and the temperature can be adjusted lower and the wind speed can be increased by controlling the central air conditioner (i.e., the first to-be-linked device) of the current scene, and the fan (i.e., the first to-be-linked device) can be controlled to blow wind towards the user, and the like, without limitation.

[0095] 103. According to the first control scheme and the second control scheme, the target interaction device and the first to-be-linked device are executed corresponding linkage control operation.

[0096] Further optionally, the above-mentioned according to the first control scheme and the second control scheme, the target interaction device and the first to-be-linked device are executed corresponding linkage control operation can include:

[0097] According to the first control scheme, the target interaction device is controlled to execute corresponding control operation, and according to the second control scheme, the first to-be-linked device is controlled to execute corresponding control operation; or

[0098] According to the first control scheme and the second control scheme, a comprehensive linkage control scheme is determined, and according to the comprehensive linkage control scheme, the target interaction device and the first to-be-linked device are controlled to execute corresponding control operation.

[0099] It can be seen that the multi-device joint control method applied to the digital person described in the embodiments of the present application can determine a first control scheme according to the first interaction demand based on the digital person and determine a second control scheme according to the related reaction information, and then perform corresponding joint control operations on the target interaction device and the first to-be-linked device according to the first control scheme and the second scheme, thereby realizing the multi-device joint control function, which is beneficial to improving the comprehensiveness and rationality of the multi-device joint control method applied to the digital person, thereby improving the joint control accuracy and reliability of the multi-device, and improving the joint control efficiency and convenience of the multi-device, thereby improving the collaborative efficiency of the multi-device and simplifying the operation process between the multi-device, and improving the user experience.

[0100] In an optional embodiment, after determining the first to-be-linked device and the corresponding second control scheme according to the second interaction demand, the method can further include the following operations:

[0101] According to the second control scheme, it is determined whether the first to-be-linked device meets the preset expected effect realization condition;

[0102] When it is determined that the first to-be-linked device meets the expected effect realization condition, the step of performing corresponding joint control operations on the target interaction device and the first to-be-linked device according to the first control scheme and the second control scheme is executed;

[0103] When it is determined that the first to-be-linked device does not meet the expected effect realization condition, the function configuration information of the first to-be-linked device is determined, and the expected regulation and control effect of the demand person for the current scene is determined according to the second control scheme; according to the function configuration information and the expected regulation and control effect, a third to-be-linked device that can realize similar functions to the first to-be-linked device and has a joint priority lower than the first to-be-linked device is determined from the current scene; according to the second control scheme, a fourth control scheme of the third to-be-linked device is determined; and according to the first control scheme and the fourth control scheme, corresponding joint control operations are performed on the target interaction device and the third to-be-linked device.

[0104] Optionally, the third to-be-linked device that can realize similar functions to the first to-be-linked device and has a joint priority lower than the first to-be-linked device is determined from the current scene according to the function configuration information and the expected regulation and control effect, for example: assuming that the first to-be-linked device is a central air conditioner, the function configuration information of the first to-be-linked device is to change the environmental temperature of the demand person in the current scene, and the expected regulation and control effect is to reduce the environmental temperature of the demand person; when the temperature of the central air conditioner cannot be directly reduced (i.e., the first to-be-linked device does not meet the expected effect realization condition), the oscillating fan (i.e., the third to-be-linked device) in the current scene can be controlled to blow towards the demand user, and other cases can be obtained in the same way, which is not limited by the embodiments of the present application.

[0105] Optionally, the first to-be-linked device and the third to-be-linked device can be understood as follows: first, the preferred control scheme is adopted (i.e., the first to-be-linked device), and if the preferred scheme cannot be implemented, the alternative scheme is adopted (i.e., the third to-be-linked device), and the embodiments of the present application are not limited in this regard.

[0106] Optionally, the expected control effect can include, but is not limited to, one or more of the following: an effect related to control accuracy, an effect related to control stability, an effect related to control efficiency, an effect related to control energy consumption, an effect related to control maintenance cost, an effect related to control spare parts inventory, an effect related to control adaptability, an effect related to control environmental performance, an effect related to control safety, an effect related to control intelligence, and other aspects of control effect, and the embodiments of the present application are not limited in this regard.

[0107] It can be seen that the optional embodiment can match the corresponding linkage device determination operation and device linkage control operation according to the satisfaction of the expected effect implementation condition of the first to-be-linked device, which is beneficial to improve the pertinence, diversity, flexibility and rationality of the linkage device determination method, and further beneficial to improve the accuracy and reliability of the determined target interactive device and to-be-linked device, thereby beneficial to improve the accuracy and reliability of the multi-device linkage control, and further beneficial to improve the accuracy and reliability of the device linkage control effect.

[0108] In another optional embodiment, the above-mentioned determining, according to the second control scheme, whether the first to-be-linked device satisfies the preset expected effect implementation condition can include:

[0109] determining, according to the second control scheme and the personnel information of the demand personnel, whether the first to-be-linked device satisfies a preset operation control permission condition;

[0110] when it is determined that the first to-be-linked device does not satisfy the operation control permission condition, determining that the first to-be-linked device does not satisfy the preset expected effect implementation condition;

[0111] when it is determined that the first to-be-linked device satisfies the operation control permission condition, determining, according to the second control scheme and the determined personnel and article distribution information of the current scene, a predicted impact situation that the first to-be-linked device will bring based on the second control scheme, the predicted impact situation including a predicted impact range and / or a predicted specific impact content;

[0112] determining, according to the predicted impact situation, whether the first to-be-linked device and the current scene satisfy a preset acceptable impact condition;

[0113] when it is determined that the first to-be-linked device and the current scene satisfy the acceptable impact condition, determining that the first to-be-linked device satisfies the preset expected effect implementation condition;

[0114] When it is judged that the first to-be-connected device and the current scene do not meet the acceptable influence condition, it is determined that the first to-be-connected device does not meet the preset expected effect realization condition.

[0115] Further, the judging whether the first to-be-connected device meets the preset operation control authority condition according to the second control scheme and the personnel information of the demand personnel can include:

[0116] According to the second control scheme, a first control authority level threshold of the first to-be-connected device based on the second control scheme is determined, and according to the personnel information of the demand personnel and the second control scheme, a second control authority level of the demand personnel capable of triggering the control operation of the first to-be-connected device based on the second control scheme is determined.

[0117] It is judged whether the second control authority level is greater than or equal to the first control authority level threshold.

[0118] When it is judged that the second control authority level is greater than or equal to the first control authority level threshold, it is determined that the first to-be-connected device meets the preset operation control authority condition.

[0119] When it is judged that the second control authority level is less than the first control authority level threshold, it is determined that the first to-be-connected device does not meet the preset operation control authority condition.

[0120] Further, the judging whether the first to-be-connected device and the current scene meet the preset acceptable influence condition according to the predicted influence situation can include:

[0121] According to the predicted influence situation, a corresponding predicted influence degree is determined, and it is judged whether the predicted influence degree is less than or equal to a preset predicted influence degree threshold.

[0122] When it is judged that the predicted influence degree is less than or equal to the preset predicted influence degree threshold, it is determined that the first to-be-connected device and the current scene meet the preset acceptable influence condition.

[0123] When it is judged that the predicted influence degree is greater than the preset predicted influence degree threshold, it is determined that the first to-be-connected device and the current scene do not meet the preset acceptable influence condition.

[0124] It can be seen that the optional embodiment can determine the expected effect realization condition satisfaction result according to the operation control authority condition satisfaction and the acceptable influence condition satisfaction, which is beneficial to improve the comprehensiveness, integrity, layer-by-layer progression and rationality of the expected effect realization condition satisfaction result determination method, and further beneficial to improve the accuracy and reliability of the determined expected effect realization condition satisfaction result, thereby beneficial to improve the execution accuracy and execution timeliness of the operation triggered based on the expected effect realization condition satisfaction result.

[0125] Example 2

[0126] See also Figure 2 , Figure 2 This is a flow chart of another multi-device joint control method for digital humans disclosed in an embodiment of the present invention. Figure 2 The described method can be applied to a multi-device joint control system of a digital human, wherein the system may include a server, wherein the server includes a local server or a cloud server, which is not limited in the embodiment of the present invention. Figure 2 As shown, the multi-device joint control method applied to digital humans includes the following operations:

[0127] 201. During the interaction between the digital human and the requesting person, a first control scheme for the target interactive device is determined based on the perceived first interactive demand of the requesting person towards the digital human.

[0128] 202. Determine the second interaction need of the person in need based on the perceived relevant response information of the person in need to the current scenario.

[0129] 203. Based on the second interaction requirement, determine the expected demand control type and corresponding expected control plan of the demander for the current scenario.

[0130] 204. Determine, based on the determined scene property information of the current scene, a conventional phenomenon condition of the expected demand regulation type based on the current scene, and determine an expected phenomenon condition of the current scene with respect to the expected demand regulation type.

[0131] Optionally, for the scene property information, the conventional phenomenon condition and the expected phenomenon condition for the expected demand regulation type, an example is given: the scene property information is a karaoke room, the conventional phenomenon condition is a high volume phenomenon, the expected demand regulation type is a volume type, and the expected phenomenon condition is a phenomenon condition for the volume type. Other situations can be obtained similarly, and the embodiments of the present invention do not limit this.

[0132] 205. Based on the expected phenomenon conditions, normal phenomenon conditions and expected control plans, determine whether the person in need meets the preset equipment control authority conditions for the current scenario.

[0133] Optionally, for example: the normal phenomenon is high volume, the expected phenomenon is high volume, and the expected control plan is to lower the volume to almost quiet, then it can be determined that the person in need does not meet the equipment control authority conditions; further, if the person in need is the only one in the current scene, then it can be determined that the person in need meets the equipment control authority conditions; further, if there are other people in the current scene besides the person in need, when the demand phenomenon of other people is consistent with that of the person in need, then it can be determined that the person in need meets the equipment control authority conditions; if the public demand phenomenon of other people is different from that of the person in need, then it can be determined that the person in need meets the equipment control authority conditions, and other situations are similar, and the embodiments of the present invention are not limited.

[0134] 206. When it is determined that the person in need meets the device control authority conditions, determine the first device to be linked and its corresponding second control scheme according to the second interaction requirement; the first device to be linked is in the current scene.

[0135] 207. Perform corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme.

[0136] In the embodiment of the present invention, for other descriptions of steps 201 to 207 , please refer to the detailed description of steps 101 to 103 in the first embodiment, which will not be repeated in the embodiment of the present invention.

[0137] It can be seen that the embodiment of the present invention can determine the first control scheme according to the first interactive demand based on the digital human and determine the second control scheme according to the relevant response information, and then perform corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second scheme, thereby realizing the multi-device linkage control function, which is conducive to improving the comprehensiveness and rationality of the multi-device linkage control method applied to the digital human, and thus is conducive to improving the accuracy and reliability of the linkage control of multiple devices, as well as the efficiency and convenience of the linkage control of multiple devices, thereby facilitating the improvement of the collaborative efficiency of multiple devices and simplifying the operation process between multiple devices, thereby improving the user experience; and, it can also determine whether the person in need meets the device control authority conditions, and only when the device control authority conditions are met will the subsequent device determination operation to be linked and device linkage control operation be performed, which is conducive to improving the comprehensiveness and integrity of the multi-device joint control method applied to the digital human, and thus is conducive to improving the accuracy, reliability and feasibility of the multi-device linkage control.

[0138] In an optional embodiment, the method may further include the following operations:

[0139] When it is determined that the person in need does not meet the device control authority conditions, a target candidate scene is determined from the preset candidate scenes corresponding to the digital human according to the first interactive demand, the expected demand control type and its corresponding expected control scheme;

[0140] According to the first interaction demand, the expected demand regulation type and the corresponding expected regulation scheme, a second to-be-linked device and a third control scheme corresponding to the second to-be-linked device are determined from the target candidate scene, and a corresponding linkage control operation is performed on the second to-be-linked device according to the third control scheme.

[0141] According to the target candidate scene, a scene change prompt instruction corresponding to the demand personnel is generated, and the scene change prompt instruction is used to prompt the demand personnel to go to the target candidate scene to perform a corresponding interaction operation.

[0142] Optionally, for the target candidate scene, it is illustrated that if the linkage device of the current scene cannot be regulated, the demand personnel can change a site scene to perform a corresponding operation, and the target candidate scene can realize the first interaction demand and the expected regulation scheme, and the embodiments of the present application are not limited.

[0143] It can be seen that the optional embodiment can provide a corresponding to-be-linked device determination manner and device linkage control manner for not meeting the device regulation permission condition, which is beneficial to improve the comprehensiveness and integrity of the multi-device joint control method applied to the digital person, and further beneficial to improve the accuracy and reliability of the determined to-be-linked device, thereby beneficial to improve the accuracy, reliability and feasibility of the multi-device linkage control.

[0144] In another optional embodiment, the above-mentioned judging whether the demand personnel meets the preset device regulation permission condition for the current scene according to the expected phenomenon condition, the conventional phenomenon condition and the expected regulation scheme can include:

[0145] According to the expected phenomenon condition and the conventional phenomenon condition, it is judged whether the current scene meets a preset abnormal phenomenon condition;

[0146] When it is judged that the current scene does not meet the abnormal phenomenon condition, other interaction and reaction information corresponding to other personnel in the current scene is determined, and a public demand phenomenon condition of the other personnel for the current scene is determined according to the other interaction and reaction information;

[0147] According to the expected regulation scheme and the public demand phenomenon condition, it is judged whether the demand personnel and the other personnel meet a preset unified scene regulation demand condition;

[0148] When it is judged that the demand personnel and the other personnel meet the unified scene regulation demand condition, it is determined that the demand personnel meets the preset device regulation permission condition for the current scene;

[0149] When it is judged that the demand personnel and other personnel do not satisfy the unified scene regulation demand condition, the demand personnel and other personnel are determined to correspond to a demand execution priority condition according to the conventional phenomenon condition, the expected regulation scheme and the mass demand phenomenon condition; when the demand execution priority condition is used to indicate that the demand execution priority of the demand personnel is higher than that of other personnel, it is determined that the demand personnel satisfy the preset device regulation authority condition for the current scene; when the demand execution priority condition is used to indicate that the demand execution priority of the demand personnel is less than or equal to that of other personnel, it is determined that the demand personnel do not satisfy the preset device regulation authority condition for the current scene.

[0150] Further optionally, the above judging whether the current scene satisfies the preset abnormal phenomenon condition according to the expected phenomenon condition and the conventional phenomenon condition can include:

[0151] judging whether the expected phenomenon condition matches the conventional phenomenon condition;

[0152] When it is judged that the expected phenomenon condition matches the conventional phenomenon condition, it is determined that the current scene satisfies the preset abnormal phenomenon condition;

[0153] When it is judged that the expected phenomenon condition does not match the conventional phenomenon condition, it is determined that the current scene does not satisfy the preset abnormal phenomenon condition.

[0154] Further optionally, for example, if the conventional phenomenon condition is a high-volume phenomenon and the actual phenomenon condition is a high-volume phenomenon, it is determined that the current scene does not satisfy the preset abnormal phenomenon condition; if the conventional phenomenon condition is a low-volume phenomenon and the actual phenomenon condition is a high-volume phenomenon, it is determined that the current scene satisfies the preset abnormal phenomenon condition, and other cases can be similarly obtained, which are not limited by the embodiments of the present application.

[0155] Further optionally, the above judging whether the demand personnel and other personnel satisfy the preset unified scene regulation demand condition according to the expected regulation scheme and the mass demand phenomenon condition can include:

[0156] judging whether the expected regulation scheme matches the mass demand phenomenon condition;

[0157] When it is judged that the expected regulation scheme matches the mass demand phenomenon condition, it is determined that the demand personnel and other personnel satisfy the preset unified scene regulation demand condition;

[0158] When it is judged that the expected regulation scheme does not match the mass demand phenomenon condition, it is determined that the demand personnel and other personnel do not satisfy the preset unified scene regulation demand condition.

[0159] Further optionally, for example, if the expected regulation scheme and the crowd demand phenomenon condition are used to represent the volume of the current scene being lowered, and the demand personnel and other personnel meet the preset unified scene regulation demand condition, then further regulation can be performed; if the crowd demand phenomenon condition is used to represent a high volume, the expected regulation scheme is used to represent the volume of the current scene being lowered, and the conventional phenomenon condition of the current scene is a high volume phenomenon, it is determined that the demand personnel and other personnel do not meet the preset unified scene regulation demand condition, that is, if the crowd demand is not unified, the demand execution priority of the current scene is considered based on the nature of the scene or the demand, and other cases can be obtained in the same manner, and the embodiments of the present application are not limited.

[0160] Further optionally, the determination of the demand execution priority of the demand personnel and other personnel according to the conventional phenomenon condition, the expected regulation scheme and the crowd demand phenomenon condition can include:

[0161] According to the conventional phenomenon condition and the expected regulation scheme, the first phenomenon matching degree corresponding to the demand personnel is determined, and according to the conventional phenomenon condition and the crowd demand phenomenon condition, the second phenomenon matching degree corresponding to the other personnel is determined.

[0162] According to the first phenomenon matching degree and the second phenomenon matching degree, the demand execution priority of the demand personnel and other personnel is determined.

[0163] Further optionally, the determination of the demand execution priority of the demand personnel and other personnel according to the first phenomenon matching degree and the second phenomenon matching degree can include:

[0164] When the first phenomenon matching degree is higher than the second phenomenon matching degree, it is determined that the demand execution priority condition is used to represent that the demand execution priority of the demand personnel is higher than that of the other personnel.

[0165] When the first phenomenon matching degree is lower than or equal to the second phenomenon matching degree, it is determined that the demand execution priority condition is used to represent that the demand execution priority of the demand personnel is less than or equal to that of the other personnel.

[0166] Further optionally, when the first phenomenon matching degree is equal to the second phenomenon matching degree, the number of personnel of the other personnel and the number of personnel of the demand personnel can be further considered, and the embodiments of the present application are not limited.

[0167] It can be seen that the optional embodiment can determine the device regulation permission condition satisfaction result according to the determined abnormal phenomenon condition satisfaction result, the unified scene regulation demand condition satisfaction result and the determined demand execution priority, which is beneficial to improve the comprehensiveness, integrity, layer-by-layer progression and rationality of the device regulation permission condition satisfaction result, and then is beneficial to improve the accuracy and reliability of the determined device regulation permission condition satisfaction result, thereby being beneficial to improve the execution accuracy and execution timeliness of the execution operation triggered based on the determined device regulation permission condition satisfaction result.

[0168] In another optional embodiment, the method can further include the following operations:

[0169] When it is judged that the demand personnel and other personnel meet the unified scene regulation demand condition, it is judged whether the current scene meets the preset regulation implementable demand condition according to the public demand phenomenon condition, the expected regulation scheme and the preset maximum limit regulation scheme of the current scene.

[0170] When it is judged that the current scene meets the regulation implementable demand condition, the step of determining that the demand personnel meet the preset device regulation permission condition for the current scene is executed.

[0171] When it is judged that the current scene does not meet the regulation implementable demand condition, it is determined that the demand personnel do not meet the preset device regulation permission condition for the current scene.

[0172] Further optionally, the judgment of whether the current scene meets the preset regulation implementable demand condition according to the public demand phenomenon condition, the expected regulation scheme and the preset maximum limit regulation scheme of the current scene is exemplified as follows: when the public demand phenomenon condition and the expected regulation scheme are used to indicate that the demand volume is too small and the current scene cannot be implemented, that is, cannot be adjusted to the demand low volume, it is determined that the current scene does not meet the preset regulation implementable demand condition, that is, the demand personnel can only change the scene at this time, and other cases can be obtained in the same way, which is not limited by the embodiments of the application.

[0173] It can be seen that the optional embodiment can further determine the device regulation permission condition satisfaction result according to the determined regulation implementable demand condition satisfaction when it is determined that the unified scene regulation demand condition is met, which is beneficial to improve the comprehensiveness, integrity, layer-by-layer progression and rationality of the device regulation permission condition satisfaction result, and then is beneficial to improve the accuracy and reliability of the determined device regulation permission condition satisfaction result, thereby being beneficial to improve the execution accuracy and execution timeliness of the execution operation triggered based on the determined device regulation permission condition satisfaction result.

[0174] Embodiment three

[0175] Please refer to Figure 3 , Figure 3It is a structural schematic diagram of a multi-device joint control system applied to a digital person disclosed by an embodiment of the present application. Among them, Figure 3 The described system can include a server, wherein the server includes a local server or a cloud server, and the embodiments of the present application are not limited. As shown in Figure 3 The multi-device joint control system applied to the digital person can include:

[0176] The first scheme determination module 301 is configured to determine a first control scheme for the target interaction device according to the perceived first interaction demand of the demand person facing the digital person during the interaction between the digital person and the demand person.

[0177] The second scheme determination module 302 is configured to determine a second interaction demand of the demand person according to the perceived related reaction information of the demand person to the current scene, and determine a first to-be-linked device and a corresponding second control scheme according to the second interaction demand.

[0178] The linkage control module 303 is configured to perform corresponding linkage control operations on the target interaction device and the first to-be-linked device according to the first control scheme and the second control scheme.

[0179] As can be seen, the implementation Figure 3 The multi-device joint control system applied to the digital person described can determine a first control scheme based on the first interaction demand of the digital person and a second control scheme based on related reaction information, and then perform corresponding linkage control operations on the target interaction device and the first to-be-linked device according to the first control scheme and the second control scheme, thereby realizing the multi-device linkage control function, which is conducive to improving the comprehensiveness and rationality of the multi-device linkage control method applied to the digital person, and then conducive to improving the linkage control accuracy and reliability of the multi-device, and conducive to improving the linkage control efficiency and convenience of the multi-device, thereby conducive to improving the coordination efficiency of the multi-device and simplifying the operation process between the multi-device, and improving the user experience.

[0180] In an optional embodiment, as shown in Figure 4 The system can also include:

[0181] The determination module 304 is configured to determine an expected demand regulation type of the demand person for the current scene and a corresponding expected regulation scheme according to the second interaction demand before the second scheme determination module 302 determines the first to-be-linked device and the corresponding second control scheme according to the second interaction demand; determine that the expected demand regulation type is based on a conventional phenomenon condition of the current scene according to the determined scene property information of the current scene, and determine an expected phenomenon condition of the current scene for the expected demand regulation type.

[0182] The first judgment module 305 is configured to judge whether the demand personnel meets the preset device control permission condition for the current scene according to the expected phenomenon condition, the conventional phenomenon condition and the expected regulation scheme; when it is judged that the demand personnel meets the device control permission condition, the second scheme determination module 302 performs the operation of determining the first to-be-activated device and the corresponding second control scheme according to the second interaction demand; and the first to-be-activated device is in the current scene.

[0183] It can be seen that the system described in the embodiment Figure 4 The system described in the embodiment can judge whether the demand personnel meets the device control permission condition, and perform the subsequent to-be-activated device determination operation and device activation control operation when the demand personnel meets the device control permission condition, which is beneficial to improve the comprehensiveness and integrity of the multi-device joint control method applied to the digital person, and further beneficial to improve the accuracy, reliability and feasibility of the multi-device joint control.

[0184] In another optional embodiment, as Figure 4 shown, the system can further include:

[0185] The candidate scene determination module 306 is configured to determine a target candidate scene from the preset candidate scenes corresponding to the digital person according to the first interaction demand, the expected demand regulation type and the corresponding expected regulation scheme when the first judgment module 305 judges that the demand personnel does not meet the device control permission condition.

[0186] The third scheme determination module 307 is configured to determine the second to-be-activated device and the corresponding third control scheme from the target candidate scene according to the first interaction demand, the expected demand regulation type and the corresponding expected regulation scheme, and perform the corresponding activation control operation on the second to-be-activated device according to the third control scheme.

[0187] The prompt instruction generation module 308 is configured to generate a scene replacement prompt instruction corresponding to the demand personnel according to the target candidate scene, and the scene replacement prompt instruction is used to prompt the demand personnel to go to the target candidate scene to perform the corresponding interaction operation.

[0188] It can be seen that the system described in the embodiment Figure 4 The system described in the embodiment can also provide a corresponding to-be-activated device determination method and device activation control method for the demand personnel who does not meet the device control permission condition, which is beneficial to improve the comprehensiveness and integrity of the multi-device joint control method applied to the digital person, and further beneficial to improve the accuracy and reliability of the determined to-be-activated device, thereby improving the accuracy, reliability and feasibility of the multi-device joint control.

[0189] In yet another optional embodiment, as Figure 4 shown, the system can further include:

[0190] The second determining module 309 is configured to, after the second scheme determining module 302 determines the first to-be-linked device and the corresponding second control scheme according to the second interaction requirement, determine whether the first to-be-linked device meets a preset expected effect realization condition according to the second control scheme; and when it is determined that the first to-be-linked device meets the expected effect realization condition, the linkage control module 303 performs a step of performing corresponding linkage control operations on the target interaction device and the first to-be-linked device according to the first control scheme and the second control scheme.

[0191] The third scheme determining module 307 is configured to, when the second determining module 309 determines that the first to-be-linked device does not meet the expected effect realization condition, determine functional configuration information of the first to-be-linked device, and determine an expected regulation and control effect of the demand person for the current scene according to the second control scheme; determine a third to-be-linked device that can realize a similar function to the first to-be-linked device and has a linkage priority lower than the first to-be-linked device from the current scene according to the functional configuration information and the expected regulation and control effect; and determine a fourth control scheme of the third to-be-linked device according to the second control scheme.

[0192] The linkage control module 303 is further configured to perform corresponding linkage control operations on the target interaction device and the third to-be-linked device according to the first control scheme and the fourth control scheme.

[0193] It can be seen that the system described above can determine the target interaction device and the to-be-linked device according to the expected effect realization condition of the first to-be-linked device, and can determine the target interaction device and the to-be-linked device according to the expected effect realization condition of the first to-be-linked device. Figure 4 The system described above can also match corresponding linkage device determining operations and device linkage control operations for the case where the expected effect realization condition of the first to-be-linked device is met, which is beneficial to improving the pertinence, diversity, flexibility and rationality of the linkage device determining manner, and further beneficial to improving the accuracy and reliability of the determined target interaction device and to-be-linked device, thereby being beneficial to improving the accuracy and reliability of the multi-device linkage control, and further beneficial to improving the accuracy and reliability of the device linkage control effect.

[0194] In yet another optional embodiment, the first determining module 305 determines whether the demand person meets a preset device regulation and control permission condition for the current scene according to the expected phenomenon condition, the conventional phenomenon condition and the expected regulation and control scheme in the following manner:

[0195] According to the expected phenomenon condition and the conventional phenomenon condition, it is determined whether the current scene meets a preset abnormal phenomenon condition;

[0196] When it is determined that the current scene does not meet the abnormal phenomenon condition, other interaction and reaction information of other persons in the current scene is determined, and a general demand phenomenon condition of the other persons for the current scene is determined according to the other interaction and reaction information;

[0197] According to the expected regulation scheme and the mass demand phenomenon condition, it is judged whether the demand personnel and other personnel meet the preset unified scene regulation demand condition;

[0198] When it is judged that the demand personnel and other personnel meet the unified scene regulation demand condition, it is determined that the demand personnel meet the preset device regulation permission condition for the current scene;

[0199] When it is judged that the demand personnel and other personnel do not meet the unified scene regulation demand condition, according to the conventional phenomenon condition, the expected regulation scheme and the mass demand phenomenon condition, the demand execution priority condition corresponding to the demand personnel and other personnel is determined; when the demand execution priority condition is used to indicate that the demand execution priority of the demand personnel is higher than that of other personnel, it is determined that the demand personnel meet the preset device regulation permission condition for the current scene; when the demand execution priority condition is used to indicate that the demand execution priority of the demand personnel is less than or equal to that of other personnel, it is determined that the demand personnel do not meet the preset device regulation permission condition for the current scene.

[0200] It can be seen that, in the implementation Figure 4 The described system can also determine the device regulation permission condition meeting result according to the determined abnormal phenomenon condition meeting result, the unified scene regulation demand condition meeting result and the determined demand execution priority condition, which is beneficial to improve the comprehensiveness, integrity, layer-by-layer progression and rationality of the device regulation permission condition meeting result, and further beneficial to improve the accuracy and reliability of the determined device regulation permission condition meeting result, so as to improve the execution accuracy and execution timeliness of the execution operation triggered based on the determined device regulation permission condition meeting result.

[0201] In yet another optional embodiment, the first judging module 305 is further configured to, when it is judged that the demand personnel and other personnel meet the unified scene regulation demand condition, judge whether the current scene meets the preset regulation implementable demand condition according to the mass demand phenomenon condition, the expected regulation scheme and the preset maximum limit regulation scheme of the current scene; when it is judged that the current scene meets the regulation implementable demand condition, perform the step of determining that the demand personnel meet the preset device regulation permission condition for the current scene; and when it is judged that the current scene does not meet the regulation implementable demand condition, determine that the demand personnel do not meet the preset device regulation permission condition for the current scene.

[0202] It can be seen that, in the implementation Figure 4The system described can further determine the device control permission condition satisfaction result according to the determined control can achieve condition satisfaction condition when it is determined that the unified scene regulation demand condition is met, which is conducive to improving the comprehensiveness, integrity, layer-by-layer progression and rationality of the device control permission condition satisfaction result, and further conducive to improving the accuracy and reliability of the determined device control permission condition satisfaction result, thereby conducive to improving the execution accuracy and execution timeliness of the execution operation triggered based on the determined device control permission condition satisfaction result.

[0203] In yet another optional embodiment, the second determining module 309 determines whether the first to-be-linked device meets the preset expected effect implementation condition according to the second control scheme in the following manner:

[0204] According to the second control scheme and the personnel information of the demand personnel, it is determined whether the first to-be-linked device meets the preset operation control permission condition;

[0205] When it is determined that the first to-be-linked device does not meet the operation control permission condition, it is determined that the first to-be-linked device does not meet the preset expected effect implementation condition;

[0206] When it is determined that the first to-be-linked device meets the operation control permission condition, according to the second control scheme and the determined personnel and article distribution information of the current scene, the predicted impact situation that the first to-be-linked device will bring based on the second control scheme is determined, and the predicted impact situation includes a predicted impact range and / or a predicted specific impact content;

[0207] According to the predicted impact situation, it is determined whether the first to-be-linked device and the current scene meet the preset acceptable impact condition;

[0208] When it is determined that the first to-be-linked device and the current scene meet the acceptable impact condition, it is determined that the first to-be-linked device meets the preset expected effect implementation condition;

[0209] When it is determined that the first to-be-linked device and the current scene do not meet the acceptable impact condition, it is determined that the first to-be-linked device does not meet the preset expected effect implementation condition.

[0210] It can be seen that the implementation Figure 4 The system described can further determine the expected effect implementation condition satisfaction result according to the determined operation control permission condition satisfaction and acceptable impact condition satisfaction two levels, which is conducive to improving the comprehensiveness, integrity, layer-by-layer progression and rationality of the expected effect implementation condition satisfaction result determination method, and further conducive to improving the accuracy and reliability of the determined expected effect implementation condition satisfaction result, thereby conducive to improving the execution accuracy and execution timeliness of the execution operation triggered based on the expected effect implementation condition satisfaction result.

[0211] Embodiment four

[0212] Please refer to Figure 5 , Figure 5 is another structure diagram of a multi-device joint control system applied to a digital person according to an embodiment of the present application. Wherein, Figure 5 The system described can include a server, wherein the server includes a local server or a cloud server, and the embodiments of the present application are not limited. As Figure 5 indicated, the system can include:

[0213] a memory 401 storing executable program codes;

[0214] a processor 402 coupled with the memory 401;

[0215] Further, it can also include an input interface 403 and an output interface 404 coupled with the processor 402;

[0216] Wherein, the processor 402 calls the executable program codes stored in the memory 401, for executing the steps in the multi-device joint control method applied to a digital person described in embodiment one or embodiment two.

[0217] Embodiment five

[0218] The embodiments of the present application disclose a computer storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer to execute the steps in the multi-device joint control method applied to a digital person described in embodiment one or embodiment two.

[0219] Embodiment six

[0220] The embodiments of the present application disclose a computer program product, which includes a non-transitory computer readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the steps in the multi-device joint control method applied to a digital person described in embodiment one or embodiment two.

[0221] The device embodiments described above are only schematic, wherein the modules illustrated as separate components can or can not be physically separate, and the components illustrated as modules can or can not be physical modules, i.e., they can be located in one place, or distributed on multiple network modules. Part or all of the modules can be selected according to actual needs to achieve the purpose of the present embodiment. Those skilled in the art can understand and implement it without creative labor.

[0222] Those skilled in the art can clearly understand the implementation of the various embodiments by means of software and the necessary general hardware platform through the above specific description of the embodiments, and of course, the embodiments can also be implemented by hardware. Based on such understanding, the above technical solutions, essentially or in the sense of contribution to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer readable storage medium, including a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an one-time programmable read-only memory (OTPROM), an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM), or other optical disk storage, a magnetic disk storage, a magnetic tape storage, or any other medium that can be used to carry or store data in a computer readable manner.

[0223] Finally, it should be noted that: the application discloses a kind of application in digital person Multi-device joint control method and system disclosed in the embodiment of the application is only the preferred embodiment of the application, only for the description of the technical scheme of the application, not for its limitation;Although the application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing various embodiments, or make equivalent replacement to part of the technical features;And these modifications or replacements do not make the essence of the corresponding technical scheme deviate from the spirit and scope of the technical solutions of the various embodiments of the application.

Claims

1. A multi-device joint control method applied to a digital human, characterized in that, The method comprises: In the process of interaction between the digital human and the demand person, a first control scheme for a target interaction device is determined according to a perceived first interaction demand of the demand person facing the digital human; A second interaction demand of the demand person is determined according to perceived relevant reaction information of the demand person to a current scene, and a first to-be-linked device and a corresponding second control scheme thereof are determined according to the second interaction demand; Whether the first to-be-linked device meets a preset expected effect realization condition is judged according to the second control scheme; When it is judged that the first to-be-linked device meets the expected effect realization condition, corresponding linkage control operations are performed on the target interaction device and the first to-be-linked device according to the first control scheme and the second control scheme; When it is judged that the first to-be-linked device does not meet the expected effect realization condition, function configuration information of the first to-be-linked device is determined, and an expected regulation and control effect of the demand person for the current scene is determined according to the second control scheme; a third to-be-linked device capable of realizing similar functions of the first to-be-linked device and having a linkage priority lower than that of the first to-be-linked device is determined from the current scene according to the function configuration information and the expected regulation and control effect; a fourth control scheme of the third to-be-linked device is determined according to the second control scheme; and corresponding linkage control operations are performed on the target interaction device and the third to-be-linked device according to the first control scheme and the fourth control scheme. 2.The multi-device joint control method applied to a digital human according to claim 1, wherein, Before the step of determining a first to-be-linked device and a corresponding second control scheme thereof according to the second interaction demand, the method further comprises: An expected demand regulation and control type of the demand person for the current scene and a corresponding expected regulation and control scheme thereof are determined according to the second interaction demand; It is determined that the expected demand regulation and control type is based on a regular phenomenon condition of the current scene according to determined scene property information of the current scene, and an expected phenomenon condition of the current scene for the expected demand regulation and control type is determined; Whether the demand person meets a preset device regulation and control permission condition for the current scene is judged according to the expected phenomenon condition, the regular phenomenon condition and the expected regulation and control scheme; When it is judged that the demand person meets the device regulation and control permission condition, the operation of determining a first to-be-linked device and a corresponding second control scheme thereof according to the second interaction demand is performed; and the first to-be-linked device is in the current scene. 3.The multi-device joint control method applied to a digital human of claim 2, wherein, The method further comprises: When it is judged that the demand person does not meet the device regulation and control permission condition, a target candidate scene is determined from preset candidate scenes corresponding to the digital human according to the first interaction demand, the expected demand regulation and control type and the corresponding expected regulation and control scheme thereof. determine a second to-be-linked device and a third control scheme corresponding to the second to-be-linked device from the target candidate scene according to the first interaction requirement, the expected requirement regulation type and the corresponding expected regulation scheme, and perform a corresponding linked control operation on the second to-be-linked device according to the third control scheme; generate a scene change prompt instruction corresponding to the requirement personnel according to the target candidate scene, and the scene change prompt instruction is used to prompt the requirement personnel to go to the target candidate scene to perform a corresponding interaction operation. 4.The multi-device joint control method applied to a digital human of claim 2, wherein, The determining whether the requirement personnel meets a preset device regulation permission condition for the current scene according to the expected phenomenon condition, the regular phenomenon condition and the expected regulation scheme comprises: determining whether the current scene meets a preset abnormal phenomenon condition according to the expected phenomenon condition and the regular phenomenon condition; when it is determined that the current scene does not meet the abnormal phenomenon condition, determining other interaction and reaction information corresponding to other personnel in the current scene, and determining a public requirement phenomenon condition of the other personnel for the current scene according to the other interaction and reaction information; determining whether the requirement personnel and the other personnel meet a preset unified scene regulation requirement condition according to the expected regulation scheme and the public requirement phenomenon condition; when it is determined that the requirement personnel and the other personnel meet the unified scene regulation requirement condition, determining that the requirement personnel meets the preset device regulation permission condition for the current scene; when it is determined that the requirement personnel and the other personnel do not meet the unified scene regulation requirement condition, determining a requirement execution priority situation corresponding to the requirement personnel and the other personnel according to the regular phenomenon condition, the expected regulation scheme and the public requirement phenomenon condition; when the requirement execution priority situation indicates that the requirement execution priority of the requirement personnel is higher than that of the other personnel, it is determined that the requirement personnel meets the preset device regulation permission condition for the current scene; and when the requirement execution priority situation indicates that the requirement execution priority of the requirement personnel is less than or equal to that of the other personnel, it is determined that the requirement personnel does not meet the preset device regulation permission condition for the current scene. 5.The multi-device joint control method applied to a digital human according to claim 4, wherein, The method further comprises: when it is determined that the requirement personnel and the other personnel meet the unified scene regulation requirement condition, determining whether the current scene meets a preset regulation implementable requirement condition according to the public requirement phenomenon condition, the expected regulation scheme and a preset maximum limit regulation scheme of the current scene; when it is determined that the current scene meets the regulation implementable requirement condition, performing the step of determining that the requirement personnel meets the preset device regulation permission condition for the current scene; when it is determined that the current scene does not meet the regulation implementable requirement condition, determining that the requirement personnel does not meet the preset device regulation permission condition for the current scene. 6.The multi-device joint control method applied to a digital human of claim 1, wherein, The determining whether the first to-be-associated device meets the preset expected effect realization condition according to the second control scheme comprises: determining whether the first to-be-associated device meets a preset operation regulation permission condition according to the second control scheme and the personnel information of the demand personnel; when it is determined that the first to-be-associated device does not meet the operation regulation permission condition, determining that the first to-be-associated device does not meet the preset expected effect realization condition; when it is determined that the first to-be-associated device meets the operation regulation permission condition, determining a predicted impact situation of the first to-be-associated device based on the second control scheme according to the second control scheme and the determined personnel and article distribution information of the current scene, the predicted impact situation comprising a predicted impact range and / or a predicted specific impact content; determining whether the first to-be-associated device and the current scene meet a preset acceptable impact condition according to the predicted impact situation; when it is determined that the first to-be-associated device and the current scene meet the acceptable impact condition, determining that the first to-be-associated device meets the preset expected effect realization condition; when it is determined that the first to-be-associated device and the current scene do not meet the acceptable impact condition, determining that the first to-be-associated device does not meet the preset expected effect realization condition.

7. A multi-device joint control system applied to a digital human, characterized by, The system is used to execute the method for multi-device joint control of digital person according to any one of claims 1-6, and the system comprises: a first scheme determination module configured to determine a first control scheme for a target interactive device according to a first interaction demand of a demand personnel facing the digital person in an interaction process between the digital person and the demand personnel; a second scheme determination module configured to determine a second interaction demand of the demand personnel according to sensed relevant reaction information of the demand personnel to a current scene, and determine a first to-be-associated device and a second control scheme corresponding to the first to-be-associated device according to the second interaction demand; an associated control module configured to execute corresponding associated control operations on the target interactive device and the first to-be-associated device according to the first control scheme and the second control scheme.

8. A multi-device joint control system applied to a digital human, characterized by, The system comprises: a memory storing executable program codes; a processor coupled with the memory; the processor invokes the executable program codes stored in the memory to execute the method for multi-device joint control of digital person according to any one of claims 1-6.

9. A computer storage medium, characterized in that The computer storage medium stores computer instructions, and the computer instructions are used to execute the method for multi-device joint control of digital person according to any one of claims 1-6 when invoked.

Images