Multi-device joint control method and system applied to digital human

Abstract

The invention relates to the technical field of device linkage control, and discloses a multi-device combined control method and system applied to a digital human, and the method comprises the steps: determining a first control scheme for a target interaction device according to the first interaction demand of a demander for the digital human in the interaction process of the digital human and the demander; determining a second interaction demand of the demander according to related response information of the demander to the current scene, and determining a first to-be-linked device and a corresponding second control scheme according to the second interaction demand; and according to the first control scheme and the second control scheme, executing corresponding linkage control operation on the target interaction equipment and the first to-be-linked equipment. It can be seen that the multi-device linkage control function can be achieved, the multi-device linkage control accuracy and reliability are improved, the multi-device linkage control efficiency and convenience are improved, the multi-device cooperation efficiency is improved, the multi-device operation process is simplified, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of device linkage control, and in particular to a multi-device joint control method and system applied to digital humans. Background Art

[0002] With the rapid development of science and technology, people's use of devices is becoming increasingly extensive and in-depth. From home entertainment and daily life to industrial production and scientific research, various devices have become an indispensable part of modern society. However, in actual applications, existing device control methods mostly require users to perform specific adjustments for each device one by one. The adjustment steps are cumbersome, the operation is overly dependent on human intervention, and there is a high degree of human subjectivity. Existing device control methods can lead to problems with low control accuracy and control efficiency. Therefore, it is particularly important to provide a device control method that improves device control accuracy and control efficiency. Summary of the Invention

[0003] The present invention provides a multi-device joint control method and system applied to digital humans, which can realize the linkage control of multiple devices and thus improve the control accuracy and control efficiency of the devices.

[0004] In order to solve the above technical problems, the first aspect of the present invention discloses a multi-device joint control method applied to a digital human, the method comprising: During the interaction between the digital human and the person requiring the interaction, determining a first control scheme for the target interactive device according to a first interactive demand of the person requiring the interaction with the digital human; Determining a second interaction requirement of the person requesting the request based on the perceived response information of the person requesting the request to the current scenario, and determining a first device to be linked and a corresponding second control scheme based on the second interaction requirement; According to the first control scheme and the second control scheme, corresponding linkage control operations are performed on the target interactive device and the first device to be linked.

[0005] As an optional implementation manner, in the first aspect of the present invention, before determining the first device to be linked and its corresponding second control scheme according to the second interaction requirement, the method further includes: Determining, based on the second interaction requirement, the expected demand control type of the demander for the current scenario and its corresponding expected control solution; Determining, based on the determined scene property information of the current scene, a conventional phenomenon condition of the expected demand regulation type based on the current scene, and determining an expected phenomenon condition of the current scene with respect to the expected demand regulation type; According to the expected phenomenon condition, the conventional phenomenon condition and the expected control scheme, determining whether the person in need meets the preset equipment control authority conditions for the current scenario; When it is determined that the person in need meets the device control authority condition, the operation of determining the first device to be linked and its corresponding second control scheme according to the second interaction requirement is performed; the first device to be linked is in the current scene.

[0006] As an optional embodiment, in the first aspect of the present invention, the method further comprises: When it is determined that the person requiring the device does not meet the device control authority condition, a target candidate scene is determined from preset candidate scenes corresponding to the digital human according to the first interaction requirement, the expected requirement control type and its corresponding expected control scheme; Determining a second device to be linked and a corresponding third control scheme from the target candidate scenario based on the first interaction requirement, the expected demand regulation type and its corresponding expected regulation scheme, and performing a corresponding linkage control operation on the second device to be linked according to the third control scheme; Based on the target candidate scene, a scene change prompt instruction corresponding to the person in need is generated, and the scene change prompt instruction is used to prompt the person in need to go to the target candidate scene to perform a corresponding interactive operation.

[0007] As an optional implementation manner, in the first aspect of the present invention, after determining the first device to be linked and its corresponding second control scheme according to the second interaction requirement, the method further includes: According to the second control scheme, determining whether the first device to be linked meets the preset expected effect realization conditions; When it is determined that the first device to be linked meets the expected effect realization condition, executing the step of performing corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme; When it is determined that the first device to be linked does not meet the conditions for achieving the expected effect, the functional configuration information of the first device to be linked is determined, and according to the second control scheme, the expected control effect of the person in need for the current scene is determined; according to the functional configuration information and the expected control effect, a third device to be linked is determined from the current scene, which can achieve similar functions as the first device to be linked and has a linkage priority lower than that of the first device to be linked; according to the second control scheme, a fourth control scheme for the third device to be linked is determined; according to the first control scheme and the fourth control scheme, corresponding linkage control operations are performed on the target interactive device and the third device to be linked.

[0008] As an optional embodiment, in the first aspect of the present invention, judging whether the person in need meets the preset device control authority conditions for the current scenario based on the expected phenomenon condition, the normal phenomenon condition, and the expected control scheme includes: According to the expected phenomenon condition and the normal phenomenon condition, determining whether the current scene meets the preset abnormal phenomenon condition; When it is determined that the current scene does not meet the abnormal phenomenon condition, determining other interaction and reaction information corresponding to other persons in the current scene, and determining the public demand phenomenon status of the other persons with respect to the current scene based on the other interaction and reaction information; According to the expected regulation scheme and the public demand phenomenon, determine whether the demand person and the other persons meet the preset unified scene regulation demand conditions; When it is determined that the requesting person and the other persons meet the unified scene control requirement conditions, determining that the requesting person meets the preset device control authority conditions for the current scene; When it is determined that the person in need and the other personnel do not meet the unified scene control demand conditions, the demand execution priority corresponding to the person in need and the other personnel is determined based on the normal phenomenon conditions, the expected control plan and the public demand phenomenon conditions; when the demand execution priority situation is used to indicate that the demand execution priority of the person in need is higher than that of the other personnel, it is determined that the person in need meets the preset equipment control authority conditions for the current scene; when the demand execution priority situation is used to indicate that the demand execution priority of the person in need is less than or equal to that of the other personnel, it is determined that the person in need does not meet the preset equipment control authority conditions for the current scene.

[0009] As an optional embodiment, in the first aspect of the present invention, the method further comprises: When it is determined that the demanding person and the other persons meet the unified scene control demand conditions, judging whether the current scene meets the preset control achievable demand conditions based on the public demand phenomenon, the expected control scheme and the preset maximum controllable scheme of the current scene; When it is determined that the current scenario meets the control requirement, the step of determining whether the person in need meets the preset device control authority condition for the current scenario is performed; When it is determined that the current scene does not meet the control achievable requirement condition, it is determined that the person in need does not meet the preset device control authority condition for the current scene.

[0010] As an optional implementation manner, in the first aspect of the present invention, judging whether the first device to be linked meets a preset expected effect realization condition according to the second control scheme includes: According to the second control scheme and the personnel information of the person in need, determining whether the first device to be linked meets the preset operation control authority conditions; When it is determined that the first device to be linked does not meet the operation control authority condition, determining that the first device to be linked does not meet the preset expected effect realization condition; When it is determined that the first device to be linked meets the operation control authority condition, determining, based on the second control scheme and the determined personnel and object distribution information of the current scene, a predicted impact of the first device to be linked based on the second control scheme, the predicted impact including the predicted impact range and / or the predicted specific impact content; Determining, based on the predicted impact, whether the first device to be linked and the current scenario meet preset acceptable impact conditions; When it is determined that the first device to be linked and the current scenario meet the acceptable impact condition, determining that the first device to be linked meets a preset expected effect achievement condition; When it is determined that the first device to be linked and the current scenario do not satisfy the acceptable impact condition, it is determined that the first device to be linked does not satisfy a preset expected effect realization condition.

[0011] The second aspect of the present invention discloses a multi-device joint control system applied to a digital human, the system comprising: A first solution determination module is configured to determine a first control solution for a target interactive device according to a first interactive demand of the person requesting the digital human during the interaction between the digital human and the person requesting the digital human; A second solution determination module is configured to determine a second interaction requirement of the requesting person based on the perceived response information of the requesting person to the current scenario, and determine a first device to be linked and its corresponding second control solution based on the second interaction requirement; The linkage control module is used to perform corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme.

[0012] As an optional embodiment, in the second aspect of the present invention, the system further includes: a determination module configured to determine, based on the second interaction requirement, the expected demand regulation type and the corresponding expected regulation scheme of the demanding person for the current scene before the second solution determination module determines the first device to be linked and its corresponding second control scheme based on the second interaction requirement; determine, based on the determined scene property information of the current scene, a conventional phenomenon condition of the expected demand regulation type based on the current scene, and determine an expected phenomenon condition of the current scene with respect to the expected demand regulation type; The first judgment module is used to judge whether the person in need meets the preset equipment control authority conditions for the current scene based on the expected phenomenon conditions, the normal phenomenon conditions and the expected control scheme; when it is judged that the person in need meets the equipment control authority conditions, the second scheme determination module executes the operation of determining the first device to be linked and its corresponding second control scheme based on the second interaction requirement; the first device to be linked is in the current scene.

[0013] As an optional embodiment, in the second aspect of the present invention, the system further includes: a candidate scene determination module configured to determine a target candidate scene from preset candidate scenes corresponding to the digital human based on the first interaction requirement, the expected requirement control type, and its corresponding expected control solution, when the first judgment module determines that the person requiring the scene does not meet the device control authority condition; a third scheme determining module, configured to determine a second device to be linked and its corresponding third control scheme from the target candidate scenario based on the first interaction requirement, the expected demand regulation type and its corresponding expected regulation scheme, and perform a corresponding linkage control operation on the second device to be linked according to the third control scheme; A prompt instruction generation module is used to generate a scene change prompt instruction corresponding to the person in need based on the target candidate scene, and the scene change prompt instruction is used to prompt the person in need to go to the target candidate scene to perform corresponding interactive operations.

[0014] As an optional embodiment, in the second aspect of the present invention, the system further includes: a second judgment module configured to, after the second scheme determination module determines the first device to be linked and its corresponding second control scheme according to the second interaction requirement, determine whether the first device to be linked meets a preset expected effect realization condition according to the second control scheme; when it is determined that the first device to be linked meets the expected effect realization condition, the linkage control module executes the step of performing corresponding linkage control operations on the target interaction device and the first device to be linked according to the first control scheme and the second control scheme; a third scheme determination module configured to, when the second judgment module determines that the first device to be linked does not meet the conditions for achieving the expected effect, determine the functional configuration information of the first device to be linked, and determine the expected control effect of the requesting person for the current scenario based on the second control scheme; determine, based on the functional configuration information and the expected control effect, a third device to be linked from the current scenario that can achieve a similar function to the first device to be linked and has a lower linkage priority than the first device to be linked; and determine, based on the second control scheme, a fourth control scheme for the third device to be linked; The linkage control module is further configured to perform corresponding linkage control operations on the target interactive device and the third device to be linked according to the first control scheme and the fourth control scheme.

[0015] As an optional embodiment, in the second aspect of the present invention, the first judgment module determines whether the demanding person meets the preset device control authority conditions for the current scenario based on the expected phenomenon condition, the normal phenomenon condition, and the expected control scheme, specifically including: According to the expected phenomenon condition and the normal phenomenon condition, determining whether the current scene meets the preset abnormal phenomenon condition; When it is determined that the current scene does not meet the abnormal phenomenon condition, determining other interaction and reaction information corresponding to other persons in the current scene, and determining the public demand phenomenon status of the other persons with respect to the current scene based on the other interaction and reaction information; According to the expected regulation scheme and the public demand phenomenon, determine whether the demand person and the other persons meet the preset unified scene regulation demand conditions; When it is determined that the requesting person and the other persons meet the unified scene control requirement conditions, determining that the requesting person meets the preset device control authority conditions for the current scene; When it is determined that the person in need and the other personnel do not meet the unified scene control demand conditions, the demand execution priority corresponding to the person in need and the other personnel is determined based on the normal phenomenon conditions, the expected control plan and the public demand phenomenon conditions; when the demand execution priority situation is used to indicate that the demand execution priority of the person in need is higher than that of the other personnel, it is determined that the person in need meets the preset equipment control authority conditions for the current scene; when the demand execution priority situation is used to indicate that the demand execution priority of the person in need is less than or equal to that of the other personnel, it is determined that the person in need does not meet the preset equipment control authority conditions for the current scene.

[0016] As an optional embodiment, in the second aspect of the present invention, the first judgment module is also used to judge whether the current scene meets the preset control achievable demand conditions based on the public demand phenomenon, the expected control plan and the preset maximum controllable plan of the current scene when it is judged that the demand person and the other persons meet the unified scene control demand conditions; when it is judged that the current scene meets the control achievable demand conditions, execute the step of determining whether the demand person meets the preset equipment control authority conditions for the current scene; when it is judged that the current scene does not meet the control achievable demand conditions, determine that the demand person does not meet the preset equipment control authority conditions for the current scene.

[0017] As an optional embodiment, in the second aspect of the present invention, the second judgment module judges whether the first device to be linked meets the preset expected effect realization condition according to the second control scheme in a manner specifically including: According to the second control scheme and the personnel information of the person in need, determining whether the first device to be linked meets the preset operation control authority conditions; When it is determined that the first device to be linked does not meet the operation control authority condition, determining that the first device to be linked does not meet the preset expected effect realization condition; When it is determined that the first device to be linked meets the operation control authority condition, determining, based on the second control scheme and the determined personnel and object distribution information of the current scene, a predicted impact of the first device to be linked based on the second control scheme, the predicted impact including the predicted impact range and / or the predicted specific impact content; Determining, based on the predicted impact, whether the first device to be linked and the current scenario meet preset acceptable impact conditions; When it is determined that the first device to be linked and the current scenario meet the acceptable impact condition, determining that the first device to be linked meets a preset expected effect achievement condition; When it is determined that the first device to be linked and the current scenario do not satisfy the acceptable impact condition, it is determined that the first device to be linked does not satisfy a preset expected effect realization condition.

[0018] The third aspect of the present invention discloses another multi-device joint control system applied to a digital human, the system comprising: a memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the multi-device joint control method applied to the digital human disclosed in the first aspect of the present invention.

[0019] The fourth aspect of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute the multi-device joint control method for digital humans disclosed in the first aspect of the present invention.

[0020] Compared with the prior art, the embodiments of the present invention have the following beneficial effects: In an embodiment of the present invention, during the interaction between a digital human and a requesting person, a first control scheme for a target interactive device is determined based on a first interactive demand of the requesting person directed at the digital human; a second interactive demand of the requesting person is determined based on relevant response information of the requesting person to the current scene, and a first device to be linked and its corresponding second control scheme are determined based on the second interactive demand; and corresponding linkage control operations are performed on the target interactive device and the first device to be linked based on the first control scheme and the second control scheme. It can be seen that the present invention can determine a first control scheme based on the first interactive demand of the digital human and determine a second control scheme based on relevant response information, and then perform corresponding linkage control operations on the target interactive device and the first device to be linked based on the first control scheme and the second control scheme, thereby realizing a multi-device linkage control function, which is conducive to improving the comprehensiveness and rationality of the multi-device linkage control method applied to the digital human, and further conducive to improving the accuracy and reliability of the linkage control of multiple devices, as well as the efficiency and convenience of the linkage control of multiple devices, thereby conducive to improving the collaborative efficiency of multiple devices and simplifying the operation process between multiple devices, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 This is a flow chart of a multi-device joint control method applied to a digital human disclosed in an embodiment of the present invention; Figure 2 This is a flow chart of another multi-device joint control method applied to a digital human disclosed in an embodiment of the present invention; Figure 3 This is a schematic diagram of the structure of a multi-device joint control system applied to a digital human disclosed in an embodiment of the present invention; Figure 4 This is a schematic structural diagram of another multi-device joint control system applied to a digital human disclosed in an embodiment of the present invention; Figure 5 This is a structural diagram of another multi-device joint control system applied to digital humans disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0024] The terms "first," "second," and so on, in the description and claims of the present invention and the accompanying drawings are used to distinguish between different items, not to describe a specific order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or end comprising a series of steps or elements is not limited to the listed steps or elements but may optionally include steps or elements not listed therein, or may optionally include other steps or elements inherent to such process, method, product, or end.

[0025] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present invention. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute a separate or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0026] The present invention discloses a multi-device joint control method and system for digital humans. The method can determine a first control scheme based on a first interaction requirement of the digital human and a second control scheme based on relevant response information. Then, according to the first control scheme and the second scheme, corresponding linkage control operations are performed on the target interactive device and the first device to be linked, thereby realizing a multi-device linkage control function. This method is conducive to improving the comprehensiveness and rationality of the multi-device linkage control method applied to the digital human, thereby improving the accuracy and reliability of the linkage control of multiple devices, as well as improving the efficiency and convenience of the linkage control of multiple devices, thereby improving the collaborative efficiency of multiple devices, simplifying the operation process between multiple devices, and improving the user experience. Detailed descriptions are given below.

[0027] Example 1 See also Figure 1 , Figure 1 This is a flow chart of a multi-device joint control method for a digital human disclosed in an embodiment of the present invention. Figure 1 The described method can be applied to a multi-device joint control system of a digital human, wherein the system may include a server, wherein the server includes a local server or a cloud server, which is not limited in the embodiment of the present invention. Figure 1 As shown, the multi-device joint control method applied to digital humans includes the following operations: 101. During the interaction between the digital human and the person requiring the digital human, a first control scheme for the target interactive device is determined based on the perceived first interactive demand of the person requiring the digital human.

[0028] Optionally, the first interaction demand may include, but is not limited to, interaction demands received by the digital human from the requesting party regarding information query and knowledge acquisition, entertainment and leisure, education and learning, social interaction and communication, and personalized services and customization. Other interaction demands, such as one or more, are not limited in this embodiment of the present invention.

[0029] Optionally, the digital human and the target interactive device may be related objects (such as integrated objects, objects with overlapping content, etc.), or they may be two independent objects, which is not limited in the embodiment of the present invention.

[0030] Optionally, the interaction record corresponding to each digital person may include the interaction record permission of the interaction record, and the interaction record permission may be used to limit the permission requirements for viewing and / or obtaining the interaction record. Specifically, when viewing and / or obtaining the interaction record, the execution subject needs to be verified for permission. When the permission of the execution subject is less than the interaction record permission of the interaction record, the execution subject is not allowed to view and / or obtain the interaction record. The execution subject needs to apply for permission to obtain the permission to view and / or obtain the interaction record, which is not limited in the embodiment of the present invention.

[0031] Optionally, in the process of collecting interaction records corresponding to several digital humans within the target time period, all collected interaction records are encrypted and the encrypted interaction records are transmitted. The data encryption method may include symmetric encryption or asymmetric encryption. After receiving the encrypted interaction record, the data is decrypted based on a preset key, and data verification and data integrity verification are performed on the data. After the verification is passed, each interaction record is analyzed to obtain the operation of the interaction control strategy to be improved. This is not limited in the embodiment of the present invention.

[0032] 102. Determine a second interaction requirement of the requesting person based on the perceived response information of the requesting person to the current scenario, and determine a first device to be linked and its corresponding second control scheme based on the second interaction requirement.

[0033] Optionally, the second interaction requirement may include, but is not limited to, one or more of interaction requirements for vision, interaction requirements for hearing, interaction requirements for touch, interaction requirements for smell and taste, interaction requirements for emotion, interaction requirements for psychology, interaction requirements for interaction fluency, interaction requirements for personalized needs, interaction requirements for feedback and confirmation, interaction requirements for mobility, and interaction requirements for other aspects, and is not limited in the embodiments of the present invention.

[0034] Optionally, the person in need may provide relevant reaction information to the current scene, for example: the person in need may feel that the current scene is too noisy, too cold, too dark, or may need to take an elevator, etc. This is not limited in the embodiment of the present invention.

[0035] Furthermore, for the first device to be linked and its corresponding second control scheme, an example is given: for example, when a user is interacting with a digital human to consult about related issues, he feels a little hot. He can control the central air conditioner (i.e., the first device to be linked) in the current scene to lower the temperature / increase the wind speed, or control the oscillating fan (i.e., the first device to be linked) to blow air towards the user, etc. The embodiments of the present invention do not limit this.

[0036] 103. Perform corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme.

[0037] Further optionally, performing corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme may include: Control the target interactive device to perform a corresponding control operation according to the first control scheme, and control the first device to be linked to perform a corresponding control operation according to the second control scheme; or According to the first control scheme and the second control scheme, a comprehensive linkage control scheme is determined, and according to the comprehensive linkage control scheme, the target interactive device and the first device to be linked are controlled to perform corresponding control operations.

[0038] It can be seen that the implementation of the multi-device joint control method applied to the digital human described in the embodiment of the present invention can determine the first control scheme based on the first interaction demand of the digital human and determine the second control scheme based on the relevant response information, and then perform corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second scheme, thereby realizing the multi-device linkage control function, which is conducive to improving the comprehensiveness and rationality of the multi-device linkage control method applied to the digital human, and thus is conducive to improving the accuracy and reliability of the linkage control of multiple devices, as well as the efficiency and convenience of the linkage control of multiple devices, thereby improving the collaborative efficiency of multiple devices and simplifying the operation process between multiple devices, thereby improving the user experience.

[0039] In an optional embodiment, after determining the first device to be linked and its corresponding second control solution according to the second interaction requirement, the method may further include the following operations: According to the second control scheme, determining whether the first device to be linked meets the preset expected effect realization conditions; When it is determined that the first device to be linked meets the conditions for achieving the expected effect, executing the step of performing corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme; When it is determined that the first device to be linked does not meet the conditions for achieving the expected effect, the functional configuration information of the first device to be linked is determined, and based on the second control scheme, the expected control effect of the demand personnel for the current scene is determined; based on the functional configuration information and the expected control effect, a third device to be linked is determined from the current scene that can achieve similar functions as the first device to be linked and has a linkage priority lower than that of the first device to be linked; based on the second control scheme, a fourth control scheme for the third device to be linked is determined; based on the first control scheme and the fourth control scheme, corresponding linkage control operations are performed on the target interactive device and the third device to be linked.

[0040] Optionally, based on the functional configuration information and expected control effect, the third device to be linked is determined from the current scene, which can realize similar functions as the first device to be linked and has a linkage priority lower than the first device to be linked. For example: assuming that the first device to be linked is a central air-conditioning, the functional configuration information of the first device to be linked is to change the ambient temperature of the current scene where the person in need is located, and the expected control effect is to lower the ambient temperature perceived by the person in need. When the temperature of the central air-conditioning cannot be directly lowered (that is, the first device to be linked does not meet the conditions for achieving the expected effect), the oscillating fan in the current scene (that is, the third device to be linked) can be controlled to blow air towards the user in need. Other situations are similar, and the embodiments of the present invention are not limited.

[0041] Optionally, the first device to be linked and the third device to be linked can be understood as: first adopting the preferred control scheme (i.e., the first device to be linked), and if the preferred scheme cannot be implemented, then adopting the alternative scheme (i.e., the third device to be linked), which is not limited in the embodiment of the present invention.

[0042] Optionally, the expected control effect may include, but is not limited to, one or more of the effects on the control accuracy level, the effects on the control stability level, the effects on the control efficiency level, the effects on the control energy consumption level, the effects on the control maintenance cost level, the effects on the control spare parts inventory level, the effects on the control adaptability level, the effects on the control environmental performance level, the effects on the control safety level, the effects on the control intelligence level and other control effects, and the embodiments of the present invention are not limited thereto.

[0043] It can be seen that this optional embodiment can match the corresponding linkage device determination operation and device linkage control operation according to the satisfaction of the conditions for achieving the expected effect of the first device to be linked, which is conducive to improving the pertinence, diversity, flexibility and rationality of the linkage device determination method, and thus is conducive to improving the accuracy and reliability of the determined target interactive devices and devices to be linked, thereby helping to improve the accuracy and reliability of multi-device linkage control, and further helping to improve the accuracy and reliability of the device linkage control effect.

[0044] In another optional embodiment, the above-mentioned determination of whether the first device to be linked meets the preset expected effect realization condition according to the second control scheme may include: According to the second control scheme and the personnel information of the person in need, determining whether the first device to be linked meets the preset operation control authority conditions; When it is determined that the first device to be linked does not meet the operation control authority condition, determining that the first device to be linked does not meet the preset expected effect realization condition; When it is determined that the first device to be linked meets the operation control authority conditions, the predicted impact of the first device to be linked based on the second control scheme is determined based on the second control scheme and the determined personnel and object distribution information of the current scene, including the predicted impact range and / or the predicted specific impact content; Based on the predicted impact, determine whether the first device to be linked and the current scenario meet preset acceptable impact conditions; When it is determined that the first device to be linked and the current scenario meet the acceptable impact condition, determining that the first device to be linked meets the preset expected effect realization condition; When it is determined that the first device to be linked and the current scenario do not meet the acceptable impact condition, it is determined that the first device to be linked does not meet the preset expected effect realization condition.

[0045] Further optionally, judging whether the first device to be linked meets a preset operation control authority condition based on the second control scheme and the personnel information of the person in need may include: Determine, based on the second control scheme, a first control authority level threshold capable of controlling the first device to be linked based on the second control scheme, and determine, based on the personnel information of the requesting personnel and the second control scheme, a second control authority level capable of triggering the control operation of the first device to be linked based on the second control scheme by the requesting personnel; Determine whether the second control authority level is greater than or equal to the first control authority level threshold; When it is determined that the second control authority level is greater than or equal to the first control authority level threshold, determining that the first device to be linked meets the preset operation control authority condition; When it is determined that the second control authority level is less than the first control authority level threshold, it is determined that the first device to be linked does not meet the preset operation control authority condition.

[0046] Further optionally, judging whether the first device to be linked and the current scenario meet preset acceptable impact conditions based on the predicted impact may include: Determine the corresponding predicted impact level based on the predicted impact situation, and judge whether the predicted impact level is less than or equal to a preset predicted impact level threshold; When it is determined that the predicted impact degree is less than or equal to a preset predicted impact degree threshold, determining that the first device to be linked and the current scenario meet a preset acceptable impact condition; When it is determined that the predicted impact degree is greater than a preset predicted impact degree threshold, it is determined that the first device to be linked and the current scenario do not meet a preset acceptable impact condition.

[0047] It can be seen that this optional embodiment can determine the results of the expected effect realization conditions being met based on the two levels of the determined operation control authority conditions being met and the acceptable impact conditions being met, which is conducive to improving the comprehensiveness, integrity, layer-by-layer progressiveness and rationality of the method for determining the results of the expected effect realization conditions being met, and thus is conducive to improving the accuracy and reliability of the determined results of the expected effect realization conditions being met, thereby helping to improve the execution accuracy and timeliness of the execution operations triggered by the expected effect realization conditions being met.

[0048] Example 2 See also Figure 2 , Figure 2 This is a flow chart of another multi-device joint control method for digital humans disclosed in an embodiment of the present invention. Figure 2 The described method can be applied to a multi-device joint control system of a digital human, wherein the system may include a server, wherein the server includes a local server or a cloud server, which is not limited in the embodiment of the present invention. Figure 2 As shown, the multi-device joint control method applied to digital humans includes the following operations: 201. During the interaction between the digital human and the requesting person, a first control scheme for the target interactive device is determined based on the perceived first interactive demand of the requesting person towards the digital human.

[0049] 202. Determine the second interaction need of the person in need based on the perceived relevant response information of the person in need to the current scenario.

[0050] 203. Based on the second interaction requirement, determine the expected demand control type and corresponding expected control plan of the demand person for the current scenario.

[0051] 204. Determine, based on the determined scene property information of the current scene, a conventional phenomenon condition of the expected demand regulation type based on the current scene, and determine an expected phenomenon condition of the current scene with respect to the expected demand regulation type.

[0052] Optionally, for the scene property information, the conventional phenomenon condition and the expected phenomenon condition for the expected demand regulation type, an example is given: the scene property information is a karaoke room, the conventional phenomenon condition is a high volume phenomenon, the expected demand regulation type is a volume type, and the expected phenomenon condition is a phenomenon condition for the volume type. Other situations can be obtained similarly, and the embodiments of the present invention do not limit this.

[0053] 205. Based on the expected phenomenon conditions, normal phenomenon conditions and expected control plans, determine whether the person in need meets the preset equipment control authority conditions for the current scenario.

[0054] Optionally, for example: the normal phenomenon is high volume, the expected phenomenon is high volume, and the expected control plan is to lower the volume to almost quiet, then it can be determined that the person in need does not meet the equipment control authority conditions; further, if the person in need is the only one in the current scene, then it can be determined that the person in need meets the equipment control authority conditions; further, if there are other people in the current scene besides the person in need, when the demand phenomenon of other people is consistent with that of the person in need, then it can be determined that the person in need meets the equipment control authority conditions; if the public demand phenomenon of other people is different from that of the person in need, then it can be determined that the person in need meets the equipment control authority conditions, and other situations are similar, and the embodiments of the present invention are not limited.

[0055] 206. When it is determined that the person in need meets the device control authority conditions, determine the first device to be linked and its corresponding second control scheme according to the second interaction requirement; the first device to be linked is in the current scene.

[0056] 207. Perform corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme.

[0057] In the embodiment of the present invention, for other descriptions of steps 201 to 207 , please refer to the detailed description of steps 101 to 103 in the first embodiment, which will not be repeated in the embodiment of the present invention.

[0058] It can be seen that the embodiment of the present invention can determine the first control scheme according to the first interactive demand based on the digital human and determine the second control scheme according to the relevant response information, and then perform corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second scheme, thereby realizing the multi-device linkage control function, which is conducive to improving the comprehensiveness and rationality of the multi-device linkage control method applied to the digital human, and thus is conducive to improving the accuracy and reliability of the linkage control of multiple devices, as well as the efficiency and convenience of the linkage control of multiple devices, thereby facilitating the improvement of the collaborative efficiency of multiple devices and simplifying the operation process between multiple devices, thereby improving the user experience; and, it can also determine whether the person in need meets the device control authority conditions, and only when the device control authority conditions are met will the subsequent device determination operation to be linked and device linkage control operation be performed, which is conducive to improving the comprehensiveness and integrity of the multi-device joint control method applied to the digital human, and thus is conducive to improving the accuracy, reliability and feasibility of the multi-device linkage control.

[0059] In an optional embodiment, the method may further include the following operations: When it is determined that the person in need does not meet the device control authority conditions, a target candidate scene is determined from the preset candidate scenes corresponding to the digital human according to the first interactive demand, the expected demand control type and its corresponding expected control scheme; Determine, from the target candidate scenario, a second device to be linked and a corresponding third control scheme based on the first interaction demand, the expected demand regulation type, and its corresponding expected regulation scheme, and perform corresponding linkage control operations on the second device to be linked according to the third control scheme; Based on the target candidate scene, a scene change prompt instruction corresponding to the person in need is generated. The scene change prompt instruction is used to prompt the person in need to go to the target candidate scene to perform corresponding interactive operations.

[0060] Optionally, for the target candidate scene, for example: if the linkage equipment of the current scene cannot be controlled, the required personnel can change a venue scene to perform corresponding operations. The target candidate scene can achieve the first interaction requirement and the expected control plan, which is not limited in the embodiment of the present invention.

[0061] It can be seen that this optional embodiment can provide a corresponding method for determining devices to be linked and a method for controlling device linkage for devices that do not meet the device control authority conditions, which is beneficial to improving the comprehensiveness and integrity of the multi-device joint control method applied to digital humans, and further beneficial to improving the accuracy and reliability of the determined devices to be linked, thereby improving the accuracy, reliability and feasibility of multi-device linkage control.

[0062] In another optional embodiment, the above-mentioned determination of whether the person in need meets the preset device control authority conditions for the current scenario based on the expected phenomenon conditions, the normal phenomenon conditions, and the expected control plan may include: Based on the expected phenomenon conditions and normal phenomenon conditions, determine whether the current scene meets the preset abnormal phenomenon conditions; When it is determined that the current scene does not meet the abnormal phenomenon conditions, other interaction and reaction information corresponding to other persons in the current scene is determined, and based on the other interaction and reaction information, the public demand phenomenon status of other persons with respect to the current scene is determined; According to the expected control plan and the public demand phenomenon, determine whether the demand personnel and other personnel meet the preset unified scene control demand conditions; When it is determined that the person in need and other persons meet the unified scene control requirement conditions, it is determined that the person in need meets the preset device control authority conditions for the current scene; When it is determined that the demand person and other personnel do not meet the unified scene control demand conditions, the demand execution priority corresponding to the demand person and other personnel is determined based on the normal phenomenon conditions, expected control plans and public demand phenomenon conditions; when the demand execution priority situation is used to indicate that the demand execution priority of the demand person is higher than that of other personnel, it is determined that the demand person meets the preset equipment control authority conditions for the current scene; when the demand execution priority situation is used to indicate that the demand execution priority of the demand person is less than or equal to that of other personnel, it is determined that the demand person does not meet the preset equipment control authority conditions for the current scene.

[0063] Further optionally, judging whether the current scene satisfies a preset abnormal phenomenon condition based on the expected phenomenon condition and the normal phenomenon condition may include: Determine whether the expected phenomenon status matches the normal phenomenon status; When it is determined that the expected phenomenon condition matches the normal phenomenon condition, it is determined that the current scene meets the preset abnormal phenomenon condition; When it is determined that the expected phenomenon condition does not match the normal phenomenon condition, it is determined that the current scene does not meet the preset abnormal phenomenon condition.

[0064] Further optionally, for example: if the normal phenomenon condition is a high volume phenomenon and the actual phenomenon condition is a high volume phenomenon, then it is determined that the current scene does not meet the preset abnormal phenomenon condition; if the normal phenomenon condition is a low volume phenomenon and the actual phenomenon condition is a high volume phenomenon, then it is determined that the current scene meets the preset abnormal phenomenon condition. The same applies to other situations, and the embodiments of the present invention are not limited thereto.

[0065] Further optionally, judging whether the demanding personnel and other personnel meet the preset unified scene control demand conditions based on the expected control plan and the public demand phenomenon may include: Determine whether the expected regulatory plan matches the public demand situation; When it is determined that the expected regulation plan matches the public demand phenomenon, it is determined that the demand personnel and other personnel meet the preset unified scenario regulation demand conditions; When it is determined that the expected regulation plan does not match the public demand phenomenon, it is determined that the demand personnel and other personnel do not meet the preset unified scenario regulation demand conditions.

[0066] Further optionally, for example: if the expected control scheme and the public demand phenomenon status are both used to indicate lowering the volume of the current scene, then it is determined that the demand person and other personnel meet the preset unified scene control demand conditions, and further control can be performed; if the public demand phenomenon status is used to indicate a high volume, the expected control scheme is used to indicate lowering the volume of the current scene, and the normal phenomenon status of the current scene is a high volume phenomenon, then it is determined that the demand person and other personnel do not meet the preset unified scene control demand conditions, that is, if the public demand is not unified, it is based on the scene nature of the current scene or the demand execution priority. Other situations are similar, and the embodiments of the present invention are not limited.

[0067] Further optionally, the above-mentioned determination of the demand execution priorities corresponding to the demand personnel and other personnel based on the conventional phenomena, the expected control plan and the public demand phenomena may include: Determine the first phenomenon matching degree for the required personnel based on the normal phenomenon conditions and the expected control plan, and determine the second phenomenon matching degree for other personnel based on the normal phenomenon conditions and the public demand phenomenon conditions; According to the matching degree of the first phenomenon and the matching degree of the second phenomenon, the demand execution priority corresponding to the demand personnel and other personnel is determined.

[0068] Further optionally, the above-mentioned determination of the demand execution priorities corresponding to the demand personnel and other personnel based on the first phenomenon matching degree and the second phenomenon matching degree may include: When the first phenomenon matching degree is higher than the second phenomenon matching degree, the demand execution priority is determined to indicate that the demand execution priority of the demand person is higher than that of other persons; When the first phenomenon matching degree is lower than or equal to the second phenomenon matching degree, determining the demand execution priority situation is used to indicate that the demand execution priority of the demand person is lower than or equal to that of other persons.

[0069] Further optionally, when the first phenomenon matching degree is equal to the second phenomenon matching degree, the number of other personnel and the number of required personnel may be further weighed and considered, which is not limited in the embodiment of the present invention.

[0070] It can be seen that this optional embodiment can determine the device control authority condition satisfaction result based on the determined abnormal phenomenon condition satisfaction result, the unified scene control requirement condition satisfaction result and the determined requirement execution priority situation, which is conducive to improving the comprehensiveness, integrity, layer-by-layer progressiveness and rationality of the device control authority condition satisfaction result, and thus is conducive to improving the accuracy and reliability of the determined device control authority condition satisfaction result, thereby helping to improve the execution accuracy and timeliness of the execution operation triggered by the determined device control authority condition satisfaction result.

[0071] In another optional embodiment, the method may further include the following operations: When it is determined that the demand personnel and other personnel meet the unified scene control demand conditions, based on the public demand phenomenon, the expected control plan and the preset maximum controllable plan for the current scene, it is determined whether the current scene meets the preset control achievable demand conditions; When it is determined that the current scenario meets the control requirement, the step of determining whether the person in need meets the preset device control authority conditions for the current scenario is executed; When it is determined that the current scene does not meet the control achievable demand conditions, it is determined that the demanding person does not meet the preset equipment control authority conditions for the current scene.

[0072] Further optionally, the above-mentioned judgment of whether the current scene meets the preset control achievable demand conditions based on the public demand phenomenon status, the expected control scheme and the preset maximum control scheme of the current scene is used to illustrate: when the public demand phenomenon status and the expected control scheme are used to indicate that the required volume is too low, the current scene cannot be achieved, that is, it cannot be adjusted to the required low volume, then it is determined that the current scene does not meet the preset control achievable demand conditions, that is, the person in need can only change the venue scene at this time. Other situations are similar, and the embodiments of the present invention are not limited.

[0073] It can be seen that this optional embodiment can further determine the device control authority condition satisfaction result based on the determined control achievable demand conditions when it is determined that the unified scene control demand conditions are met, which is beneficial to improving the comprehensiveness, integrity, layer-by-layer progressiveness and rationality of the device control authority condition satisfaction result, and thus is beneficial to improving the accuracy and reliability of the determined device control authority condition satisfaction result, thereby helping to improve the execution accuracy and timeliness of the execution operation triggered by the determined device control authority condition satisfaction result.

[0074] Example 3 See also Figure 3 , Figure 3 This is a schematic diagram of the structure of a multi-device joint control system for digital humans disclosed in an embodiment of the present invention. Figure 3 The described system may include a server, wherein the server includes a local server or a cloud server, which is not limited in the embodiment of the present invention. Figure 3 As shown, the multi-device joint control system applied to digital humans may include: The first solution determination module 301 is used to determine a first control solution for a target interactive device according to a first interactive demand of the person requesting the digital human during the interaction between the digital human and the person requesting the digital human.

[0075] The second solution determination module 302 is used to determine the second interaction requirement of the requesting person based on the perceived relevant response information of the requesting person to the current scene, and determine the first device to be linked and its corresponding second control solution based on the second interaction requirement.

[0076] The linkage control module 303 is configured to perform corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme.

[0077] It can be seen that implementation Figure 3 The described multi-device joint control system applied to the digital human can determine the first control scheme based on the first interaction demand of the digital human and determine the second control scheme based on the relevant response information, and then perform corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second scheme, thereby realizing the multi-device linkage control function, which is conducive to improving the comprehensiveness and rationality of the multi-device linkage control method applied to the digital human, and thus is conducive to improving the accuracy and reliability of the linkage control of multiple devices, as well as the efficiency and convenience of the linkage control of multiple devices, thereby improving the collaborative efficiency of multiple devices and simplifying the operation process between multiple devices, thereby improving the user experience.

[0078] In an optional embodiment, if Figure 4 As shown, the system may further include: The determination module 304 is used to determine the expected demand control type and the corresponding expected control scheme of the demand person for the current scene according to the second interaction requirement before the second scheme determination module 302 determines the first device to be linked and its corresponding second control scheme according to the second interaction requirement; determine the expected demand control type based on the normal phenomenon status of the current scene according to the determined scene property information of the current scene, and determine the expected phenomenon status of the current scene for the expected demand control type.

[0079] The first judgment module 305 is used to judge whether the person in need meets the preset equipment control authority conditions for the current scene based on the expected phenomenon conditions, the normal phenomenon conditions and the expected control scheme; when it is judged that the person in need meets the equipment control authority conditions, the second scheme determination module 302 determines the operation of the first device to be linked and its corresponding second control scheme based on the second interaction requirement; the first device to be linked is in the current scene.

[0080] It can be seen that implementation Figure 4The described system can determine whether the person in need meets the conditions for device control authority. Only when the conditions for device control authority are met will the subsequent operations of determining the devices to be linked and controlling the devices in linkage be executed. This is conducive to improving the comprehensiveness and integrity of the multi-device joint control method applied to digital humans, and further helps to improve the accuracy, reliability and feasibility of multi-device linkage control.

[0081] In another optional embodiment, Figure 4 As shown, the system may further include: The candidate scene determination module 306 is used to determine the target candidate scene from the preset candidate scenes corresponding to the digital human according to the first interaction requirement, the expected requirement regulation type and its corresponding expected regulation plan when the first judgment module 305 determines that the person in need does not meet the equipment control authority conditions.

[0082] The third scheme determination module 307 is used to determine the second device to be linked and its corresponding third control scheme from the target candidate scene based on the first interaction demand, the expected demand regulation type and its corresponding expected regulation scheme, and perform corresponding linkage control operations on the second device to be linked according to the third control scheme.

[0083] The prompt instruction generation module 308 is used to generate a scene change prompt instruction corresponding to the requesting person according to the target candidate scene. The scene change prompt instruction is used to prompt the requesting person to go to the target candidate scene to perform the corresponding interactive operation.

[0084] It can be seen that implementation Figure 4 The described system can also provide corresponding methods for determining devices to be linked and controlling device linkage for devices that do not meet the device control authority conditions, which is conducive to improving the comprehensiveness and integrity of the multi-device joint control method applied to digital humans, and further conducive to improving the accuracy and reliability of the determined devices to be linked, thereby helping to improve the accuracy, reliability and feasibility of multi-device linkage control.

[0085] In another optional embodiment, Figure 4 As shown, the system may further include: The second judgment module 309 is used to determine whether the first device to be linked meets the preset expected effect realization conditions according to the second control scheme after the second scheme determination module 302 determines the first device to be linked and its corresponding second control scheme according to the second interaction requirement; when it is determined that the first device to be linked meets the expected effect realization conditions, the linkage control module 303 executes the steps of performing corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme.

[0086] The third scheme determination module 307 is used to determine the functional configuration information of the first device to be linked when the second judgment module 309 determines that the first device to be linked does not meet the conditions for achieving the expected effect, and determine the expected control effect of the demand personnel for the current scene based on the second control scheme; based on the functional configuration information and the expected control effect, determine from the current scene a third device to be linked that can achieve similar functions to the first device to be linked and has a linkage priority lower than that of the first device to be linked; and determine a fourth control scheme for the third device to be linked based on the second control scheme.

[0087] The linkage control module 303 is further configured to perform corresponding linkage control operations on the target interactive device and the third device to be linked according to the first control scheme and the fourth control scheme.

[0088] It can be seen that implementation Figure 4 The described system can also match the corresponding linkage device determination operation and device linkage control operation according to the satisfaction of the conditions for achieving the expected effect of the first device to be linked, which is conducive to improving the pertinence, diversity, flexibility and rationality of the linkage device determination method, and thus is conducive to improving the accuracy and reliability of the determined target interactive devices and devices to be linked, thereby improving the accuracy and reliability of multi-device linkage control, and further conducive to improving the accuracy and reliability of the device linkage control effect.

[0089] In another optional embodiment, the first judgment module 305 judges whether the requesting person meets the preset device control authority conditions for the current scenario based on the expected phenomenon conditions, the normal phenomenon conditions, and the expected control plan. Specifically, the method includes: Based on the expected phenomenon conditions and normal phenomenon conditions, determine whether the current scene meets the preset abnormal phenomenon conditions; When it is determined that the current scene does not meet the abnormal phenomenon conditions, other interaction and reaction information corresponding to other persons in the current scene is determined, and based on the other interaction and reaction information, the public demand phenomenon status of other persons with respect to the current scene is determined; According to the expected control plan and the public demand phenomenon, determine whether the demand personnel and other personnel meet the preset unified scene control demand conditions; When it is determined that the person in need and other persons meet the unified scene control requirement conditions, it is determined that the person in need meets the preset device control authority conditions for the current scene; When it is determined that the demand person and other personnel do not meet the unified scene control demand conditions, the demand execution priority corresponding to the demand person and other personnel is determined based on the normal phenomenon conditions, expected control plans and public demand phenomenon conditions; when the demand execution priority situation is used to indicate that the demand execution priority of the demand person is higher than that of other personnel, it is determined that the demand person meets the preset equipment control authority conditions for the current scene; when the demand execution priority situation is used to indicate that the demand execution priority of the demand person is less than or equal to that of other personnel, it is determined that the demand person does not meet the preset equipment control authority conditions for the current scene.

[0090] It can be seen that implementation Figure 4 The described system can also determine the device control authority condition satisfaction results based on the determined abnormal phenomenon condition satisfaction results, the unified scene control requirement condition satisfaction results and the determined requirement execution priority, which is conducive to improving the comprehensiveness, integrity, layer-by-layer progressiveness and rationality of the device control authority condition satisfaction results, and thus is conducive to improving the accuracy and reliability of the determined device control authority condition satisfaction results, thereby helping to improve the execution accuracy and timeliness of the execution operations triggered by the determined device control authority condition satisfaction results.

[0091] In another optional embodiment, the first judgment module 305 is also used to judge whether the current scene meets the preset control achievable demand conditions based on the public demand phenomenon, the expected control plan and the preset maximum controllable plan of the current scene when it is judged that the demand person and other personnel meet the unified scene control demand conditions; when it is judged that the current scene meets the control achievable demand conditions, execute the step of determining whether the demand person meets the preset equipment control authority conditions for the current scene; when it is judged that the current scene does not meet the control achievable demand conditions, determine that the demand person does not meet the preset equipment control authority conditions for the current scene.

[0092] It can be seen that implementation Figure 4 The described system can also determine the device control authority condition satisfaction results based on the determined control achievable requirement conditions when it is determined that the unified scene control requirement conditions are met, which is conducive to improving the comprehensiveness, integrity, layer-by-layer progressiveness and rationality of the device control authority condition satisfaction results, and thus is conducive to improving the accuracy and reliability of the determined device control authority condition satisfaction results, thereby helping to improve the execution accuracy and timeliness of the execution operations triggered by the determined device control authority condition satisfaction results.

[0093] In another optional embodiment, the second judgment module 309 judges whether the first device to be linked meets the preset expected effect realization condition according to the second control scheme in the following manner: According to the second control scheme and the personnel information of the person in need, determining whether the first device to be linked meets the preset operation control authority conditions; When it is determined that the first device to be linked does not meet the operation control authority condition, determining that the first device to be linked does not meet the preset expected effect realization condition; When it is determined that the first device to be linked meets the operation control authority conditions, the predicted impact of the first device to be linked based on the second control scheme is determined based on the second control scheme and the determined personnel and object distribution information of the current scene, including the predicted impact range and / or the predicted specific impact content; Based on the predicted impact, determine whether the first device to be linked and the current scenario meet preset acceptable impact conditions; When it is determined that the first device to be linked and the current scenario meet the acceptable impact condition, determining that the first device to be linked meets the preset expected effect realization condition; When it is determined that the first device to be linked and the current scenario do not meet the acceptable impact condition, it is determined that the first device to be linked does not meet the preset expected effect realization condition.

[0094] It can be seen that implementation Figure 4 The described system can also determine the results of the expected effect realization conditions being met based on the two levels of the determined operation control authority conditions being met and the acceptable impact conditions being met, which is conducive to improving the comprehensiveness, integrity, progressiveness and rationality of the method of determining the results of the expected effect realization conditions being met, and thus is conducive to improving the accuracy and reliability of the determined results of the expected effect realization conditions being met, thereby helping to improve the execution accuracy and timeliness of the execution operations triggered by the expected effect realization conditions being met.

[0095] Example 4 See also Figure 5 , Figure 5 This is a structural diagram of another multi-device joint control system applied to digital humans disclosed in an embodiment of the present invention. Figure 5 The described system may include a server, wherein the server includes a local server or a cloud server, which is not limited in the embodiment of the present invention. Figure 5 As shown, the system may include: A memory 401 storing executable program code; a processor 402 coupled to the memory 401; Furthermore, it may also include an input interface 403 and an output interface 404 coupled to the processor 402; The processor 402 calls the executable program code stored in the memory 401 to execute the steps of the multi-device joint control method applied to the digital human described in the first or second embodiment.

[0096] Example 5 An embodiment of the present invention discloses a computer storage medium storing a computer program for electronic data exchange, wherein the computer program enables a computer to execute the steps of the multi-device joint control method applied to a digital human described in the first or second embodiment.

[0097] Example 6 An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the steps of the multi-device joint control method applied to a digital human described in Example 1 or Example 2.

[0098] The device embodiments described above are merely illustrative, wherein the modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, i.e., they may be located in one place or distributed across multiple network modules. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Those skilled in the art can understand and implement the present invention without inventive effort.

[0099] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus the necessary general hardware platform, or of course, by means of hardware. Based on this understanding, the above technical solution, in essence, or the portion that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, including a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium capable of carrying or storing data.

[0100] Finally, it should be noted that the multi-device joint control method and system for digital humans disclosed in the embodiments of the present invention are merely preferred embodiments of the present invention, and are only used to illustrate the technical solutions of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features therein may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A multi-device joint control method applied to digital humans, characterized in that: The method comprises: During the interaction between the digital human and the person requiring the interaction, determining a first control scheme for the target interactive device according to a first interactive demand of the person requiring the interaction with the digital human; Determining a second interaction requirement of the person requesting the request based on the perceived response information of the person requesting the request to the current scenario, and determining a first device to be linked and a corresponding second control scheme based on the second interaction requirement; According to the first control scheme and the second control scheme, corresponding linkage control operations are performed on the target interactive device and the first device to be linked.

2. The multi-device joint control method for digital human according to claim 1, characterized in that: Before determining the first device to be linked and its corresponding second control solution according to the second interaction requirement, the method further includes: Determining, based on the second interaction requirement, the expected demand control type of the demander for the current scenario and its corresponding expected control solution; Determining, based on the determined scene property information of the current scene, a conventional phenomenon condition of the expected demand regulation type based on the current scene, and determining an expected phenomenon condition of the current scene with respect to the expected demand regulation type; According to the expected phenomenon condition, the conventional phenomenon condition and the expected control scheme, determining whether the person in need meets the preset equipment control authority conditions for the current scenario; When it is determined that the person in need meets the device control authority condition, the operation of determining the first device to be linked and its corresponding second control scheme according to the second interaction requirement is performed; the first device to be linked is in the current scene.

3. The multi-device joint control method for digital human according to claim 2 is characterized in that: The method further comprises: When it is determined that the person requiring the device does not meet the device control authority condition, a target candidate scene is determined from preset candidate scenes corresponding to the digital human according to the first interaction requirement, the expected requirement control type and its corresponding expected control scheme; Determining a second device to be linked and a corresponding third control scheme from the target candidate scenario based on the first interaction requirement, the expected demand regulation type and its corresponding expected regulation scheme, and performing a corresponding linkage control operation on the second device to be linked according to the third control scheme; Based on the target candidate scene, a scene change prompt instruction corresponding to the person in need is generated, and the scene change prompt instruction is used to prompt the person in need to go to the target candidate scene to perform a corresponding interactive operation.

4. The multi-device joint control method for digital human according to any one of claims 1 to 3, characterized in that: After determining the first device to be linked and its corresponding second control solution according to the second interaction requirement, the method further includes: According to the second control scheme, determining whether the first device to be linked meets the preset expected effect realization conditions; When it is determined that the first device to be linked meets the expected effect realization condition, executing the step of performing corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme; When it is determined that the first device to be linked does not meet the conditions for achieving the expected effect, the functional configuration information of the first device to be linked is determined, and according to the second control scheme, the expected control effect of the person in need for the current scene is determined; according to the functional configuration information and the expected control effect, a third device to be linked is determined from the current scene, which can achieve similar functions as the first device to be linked and has a linkage priority lower than that of the first device to be linked; according to the second control scheme, a fourth control scheme for the third device to be linked is determined; according to the first control scheme and the fourth control scheme, corresponding linkage control operations are performed on the target interactive device and the third device to be linked.

5. The multi-device joint control method for digital human according to claim 2 is characterized in that: The determining, based on the expected phenomenon condition, the conventional phenomenon condition, and the expected control scheme, whether the person in need meets a preset device control authority condition for the current scenario includes: According to the expected phenomenon condition and the normal phenomenon condition, determining whether the current scene meets the preset abnormal phenomenon condition; When it is determined that the current scene does not meet the abnormal phenomenon condition, determining other interaction and reaction information corresponding to other persons in the current scene, and determining the public demand phenomenon status of the other persons with respect to the current scene based on the other interaction and reaction information; According to the expected regulation scheme and the public demand phenomenon, determine whether the demand person and the other persons meet the preset unified scene regulation demand conditions; When it is determined that the requesting person and the other persons meet the unified scene control requirement conditions, determining that the requesting person meets the preset device control authority conditions for the current scene; When it is determined that the person in need and the other personnel do not meet the unified scene control demand conditions, the demand execution priority corresponding to the person in need and the other personnel is determined based on the normal phenomenon conditions, the expected control plan and the public demand phenomenon conditions; when the demand execution priority situation is used to indicate that the demand execution priority of the person in need is higher than that of the other personnel, it is determined that the person in need meets the preset equipment control authority conditions for the current scene; when the demand execution priority situation is used to indicate that the demand execution priority of the person in need is less than or equal to that of the other personnel, it is determined that the person in need does not meet the preset equipment control authority conditions for the current scene.

6. The multi-device joint control method for digital human according to claim 5, characterized in that: The method further comprises: When it is determined that the demanding person and the other persons meet the unified scene control demand conditions, judging whether the current scene meets the preset control achievable demand conditions based on the public demand phenomenon, the expected control scheme and the preset maximum controllable scheme of the current scene; When it is determined that the current scenario meets the control requirement, the step of determining whether the person in need meets the preset device control authority condition for the current scenario is performed; When it is determined that the current scene does not meet the control achievable requirement condition, it is determined that the person in need does not meet the preset device control authority condition for the current scene.

7. The multi-device joint control method for digital human according to claim 4 is characterized in that: The step of judging whether the first device to be linked satisfies a preset expected effect realization condition according to the second control scheme includes: According to the second control scheme and the personnel information of the person in need, determining whether the first device to be linked meets the preset operation control authority conditions; When it is determined that the first device to be linked does not meet the operation control authority condition, determining that the first device to be linked does not meet the preset expected effect realization condition; When it is determined that the first device to be linked meets the operation control authority condition, determining, based on the second control scheme and the determined personnel and object distribution information of the current scene, a predicted impact of the first device to be linked based on the second control scheme, the predicted impact including the predicted impact range and / or the predicted specific impact content; Determining, based on the predicted impact, whether the first device to be linked and the current scenario meet preset acceptable impact conditions; When it is determined that the first device to be linked and the current scenario meet the acceptable impact condition, determining that the first device to be linked meets a preset expected effect achievement condition; When it is determined that the first device to be linked and the current scenario do not satisfy the acceptable impact condition, it is determined that the first device to be linked does not satisfy a preset expected effect realization condition.

8. A multi-device joint control system applied to digital humans, characterized in that: The system comprises: A first solution determination module is configured to determine a first control solution for a target interactive device according to a first interactive demand of the person requesting the digital human during the interaction between the digital human and the person requesting the digital human; A second solution determination module is configured to determine a second interaction requirement of the requesting person based on the perceived response information of the requesting person to the current scenario, and determine a first device to be linked and its corresponding second control solution based on the second interaction requirement; The linkage control module is used to perform corresponding linkage control operations on the target interactive device and the first device to be linked according to the first control scheme and the second control scheme.

9. A multi-device joint control system applied to digital humans, characterized in that: The system comprises: a memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the multi-device joint control method applied to a digital human as described in any one of claims 1 to 7.

10. A computer storage medium, characterized in that The computer storage medium stores computer instructions, which, when called, are used to execute the multi-device joint control method applied to a digital human as claimed in any one of claims 1 to 7.

Images