Video call method and device based on virtual digital human real-time intelligent interaction

Abstract

The invention provides a video call method and device based on virtual digital human real-time intelligent interaction. The method is applied to the technical field of video calls, and comprises the following steps: when a called end does not respond to a call request of a calling end, judging whether the called end orders a target product service or not according to a calling instruction of an Interactive Voice Response system; if the called end orders the target product service, judging whether the virtual digital human engine end is idle or not according to the target product service setting ordered by the called end; if the virtual digital human engine end is idle, a negotiation instruction is sent to an Interactive Voice Response system, so that the Interactive Voice Response system carries out negotiation with the calling end according to the negotiation instruction; and if the negotiation result is a video and the working state of the virtual digital human engine end is normal, the Interactive Voice Response system sends a synthesis instruction to the virtual digital human engine end, so that the virtual digital human engine end synthesizes the intelligent interaction video in real time according to the synthesis instruction. In this way, the use satisfaction degree of the user can be improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of video calls, and in particular to a video call method and device based on real-time intelligent interaction of virtual digital humans. Background Art

[0002] Virtual digital human technology, that is, creating virtual characters through digital means and realizing real-time intelligent interaction, is an important progress in the field of science and technology in recent years. It combines artificial intelligence, image processing and natural language processing technologies to give virtual characters human-like interactive capabilities. Virtual digital humans can simulate the expressions, voices and behaviors of real people, thereby providing a more vivid and natural communication experience. Compared with traditional video calls, virtual digital humans can make interactions more real and emotional through advanced facial expressions and body language, which not only improves user satisfaction, but also enhances the effectiveness of communication; virtual digital humans can be highly customized according to user needs, whether it is appearance, tone or communication method, they can be adjusted to meet specific user needs and enhance user participation and satisfaction.

[0003] At present, the call system is mainly voice call. Although it can meet people's basic call needs, it lacks visual communication and cannot meet people's higher-level communication needs, resulting in low user satisfaction. Summary of the invention

[0004] The present invention provides a video call method and device based on real-time intelligent interaction of virtual digital humans.

[0005] According to a first aspect of the present disclosure, a video call method based on real-time intelligent interaction of virtual digital humans is provided. The method comprises: When the called party does not answer the call request of the calling party, determine whether the called party has subscribed to the target product service according to the calling instruction of the Interactive Voice Response system; If the called party has subscribed to the target product service, then judging whether the virtual digital human engine end is idle according to the target product service settings subscribed by the called party; If the virtual digital human engine end is idle, a negotiation instruction is sent to the Interactive Voice Response system so that the Interactive Voice Response system can negotiate with the calling end according to the negotiation instruction; if the negotiation result is a video and the working status of the virtual digital human engine end is normal, the Interactive Voice Response system sends a synthesis instruction to the virtual digital human engine end so that the virtual digital human engine end can synthesize an intelligent interactive video in real time according to the synthesis instruction.

[0006] Furthermore, the method further comprises: If the called party has not subscribed to the target product service, the large network analog audio information will be fed back to the calling party.

[0007] Furthermore, the method further comprises: When judging whether the virtual digital human engine end is idle according to the target product service settings ordered by the called party, if the virtual digital human engine end is completely busy or offline, the Interactive Voice Response system calls the virtual digital human engine end through the HTTP interface to generate corresponding real-time audio and feeds it back to the calling party.

[0008] Furthermore, the method further comprises: If the negotiation result is a video, and the working status of the virtual digital human engine is busy or unavailable, the Interactive Voice Response system calls the virtual digital human engine through the HTTP interface to generate the corresponding real-time audio and feeds it back to the calling end.

[0009] Furthermore, the method further comprises: If the negotiation result is audio or the negotiation exceeds the preset time or the calling party does not support video service, the Interactive Voice Response system calls the virtual digital human engine through the HTTP interface to generate the corresponding real-time audio and feed it back to the calling party.

[0010] Furthermore, the method further comprises: After the calling end or the virtual digital human engine end hangs up, the virtual digital human engine sends each intelligent interaction video to the mini program end, so that the mini program end generates prompt information according to each of the intelligent interaction videos and sends it to the called end.

[0011] Furthermore, the mini program terminal includes a variety of virtual digital human images, scenario modes and reply templates.

[0012] According to a second aspect of the present disclosure, a video call device based on real-time intelligent interaction of a virtual digital human is provided. The device comprises: The first judgment module is used to judge whether the called user terminal has subscribed to the target product service according to the calling instruction of the Interactive Voice Response system when the called terminal does not answer the call request of the calling terminal; The second judgment module is used to judge whether the virtual digital human engine terminal is idle according to the target product service settings ordered by the called user terminal if the called user terminal has ordered the target product service; The synthesis module is used to send a negotiation instruction to the Interactive Voice Response system if the virtual digital human engine end is idle, so that the Interactive Voice Response system negotiates with the calling end according to the negotiation instruction; if the negotiation result is a video and the working status of the virtual digital human engine end is normal, the Interactive Voice Response system sends a synthesis instruction to the virtual digital human engine end, so that the virtual digital human engine end synthesizes the intelligent interactive video in real time according to the synthesis instruction.

[0013] According to a third aspect of the present disclosure, an electronic device is provided, comprising: a memory and a processor, wherein a computer program is stored in the memory, and the method is implemented when the processor executes the program.

[0014] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, and the program implements the method when executed by a processor.

[0015] Compared with the prior art, the beneficial effects of the present disclosure are as follows: when the called end does not answer the call request of the calling end, it is judged whether the called end has subscribed to the target product service according to the call instruction of the Interactive Voice Response system; if the called end has subscribed to the target product service, it is judged whether the virtual digital human engine end is idle according to the target product service setting subscribed by the called end; if the virtual digital human engine end is idle, a negotiation instruction is sent to the Interactive Voice Response system, so that the Interactive Voice Response system negotiates with the calling end according to the negotiation instruction; if the negotiation result is a video, and the working state of the virtual digital human engine end is normal, the Interactive Voice Response system sends a synthesis instruction to the virtual digital human engine end, so that the virtual digital human engine end synthesizes the intelligent interactive video in real time according to the synthesis instruction. The intelligent interaction between the virtual digital human and the calling end is realized, and the user's satisfaction is improved.

[0016] It should be understood that the contents described in the summary of the invention are not intended to limit the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein: Figure 1 A flow chart of a video call method based on real-time intelligent interaction of virtual digital humans according to an embodiment of the present disclosure is shown; Figure 2 A block diagram of a video call device based on real-time intelligent interaction of virtual digital humans according to an embodiment of the present disclosure is shown; Figure 3 A block diagram of an exemplary electronic device capable of implementing embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0019] In addition, the term "and / or" in this article is only a description of the association relationship between the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0020] Figure 1 A flowchart of a video call method 100 based on real-time intelligent interaction of a virtual digital human according to an embodiment of the present disclosure is shown. The method 100 includes: S101, when the called end does not answer the call request of the calling end, determine whether the called end has subscribed to the target product service according to the call instruction of the Interactive Voice Response system; according to the embodiment of the present disclosure, it is avoided that the calling end wastes time when the called end does not answer; it ensures that call resources are only used for customers with needs, and reduces unnecessary calls; by providing targeted services, user satisfaction is improved; invalid calls are reduced, and operating costs are reduced.

[0021] In some embodiments, when the calling end (which can be a China Unicom user, a China Telecom user or a China Mobile user) sends a call request to the called end (which can only be a China Unicom user), if the called end is busy or unreachable, the called end's call is forwarded to "provincial capital area code + 101907"; after the call is forwarded to the called end's home IMS, the home IMS routes the call to the core network centralized IMS (for example, Shanghai or Sichuan), and forwards the route to the Wo Assistant missed call reminder service platform through the SIP protocol, and the UAP9600 queuing machine assigns the call request to the Interactive Voice Response system. At this time, the Interactive VoiceResponse system generates a call request based on the call request.

[0022] S102, if the called party has subscribed to the target product service, then according to the target product service setting subscribed by the called party, determine whether the virtual digital human engine is idle; according to the embodiment of the present disclosure, determine the idle state of the virtual digital human engine according to the service setting of the called party, and optimize resource allocation; ensure that the virtual digital human engine does not have resource conflicts when processing requests, and improve response speed; customize interactive content according to the subscribed services to improve customer satisfaction; and reduce the waiting time of the calling and calling users and improve the overall service quality by effectively managing the use of the virtual engine.

[0023] In some embodiments, the method further includes: if the called end has not subscribed to the target product service (for example, the Wo Assistant product), then feeding back the large network analog audio information to the calling end.

[0024] In some embodiments, the method also includes: if the called party has not subscribed to the target product service (for example, the Wo Assistant product), and the call request is forwarded to "provincial capital area code + 101907", then the large network analog audio information is fed back to the calling party.

[0025] In some embodiments, the method further includes: if the called end has unsubscribed from the target product service (for example, the Wo Assistant product) and has not canceled the call forwarding, then feeding back the large network analog audio information to the calling end.

[0026] S103, if the virtual digital human engine end is idle, a negotiation instruction is sent to the Interactive Voice Response system, so that the Interactive Voice Response system negotiates with the calling end according to the negotiation instruction; if the negotiation result is a video, and the working state of the virtual digital human engine end is normal, the Interactive Voice Response system sends a synthesis instruction to the virtual digital human engine end, so that the virtual digital human engine end synthesizes the intelligent interactive video in real time according to the synthesis instruction. According to the embodiment of the present disclosure, the InteractiveVoice Response system flexibly negotiates according to the state of the virtual digital human engine to ensure efficient use of resources; when the negotiation result is a video, the intelligent interactive video is synthesized in real time to improve the user experience; by checking the working state of the virtual digital human engine, the quality and stability of the generated video are guaranteed; video interaction enhances the user's sense of participation and satisfaction.

[0027] In some embodiments, the Interactive Voice Response system calls the UAP queuing machine and the calling end to negotiate the media video capabilities according to the negotiation instruction.

[0028] In some embodiments, during the real-time intelligent interaction of virtual digital humans, if the calling end loses video capability, audio information is fed back to the calling end, and a secondary negotiation is conducted with the calling end; if the secondary negotiation fails, the call is disconnected.

[0029] In some embodiments, the method also includes: when determining whether the virtual digital human engine end is idle according to the target product service settings ordered by the called end, if the virtual digital human engine end is completely busy, the Interactive Voice Response system calls the virtual digital human engine end through the HTTP interface to generate corresponding real-time audio (the audio has the same timbre as the virtual digital human), and feeds it back to the calling end.

[0030] In some embodiments, the method also includes: when determining whether the virtual digital human engine end is idle according to the target product service settings ordered by the called end, if the virtual digital human engine end is offline, the Interactive Voice Response system calls the virtual digital human engine end through the HTTP interface to generate corresponding real-time audio (the audio has the same timbre as the virtual digital human) and feeds it back to the calling end.

[0031] In some embodiments, the method further includes: if the negotiation result is a video, and the working status of the virtual digital human engine end is unavailable, the Interactive Voice Response system calls the virtual digital human engine end through the HTTP interface to generate corresponding real-time audio (the audio has the same timbre as the virtual digital human), and feeds it back to the calling end.

[0032] In some embodiments, the method also includes: if the negotiation result is a video, and the working status of the virtual digital human engine end is busy, after queuing for 3 seconds, the Interactive Voice Response system calls the virtual digital human engine end through the HTTP interface to generate corresponding real-time audio (the audio has the same timbre as the virtual digital human), and feeds it back to the calling end.

[0033] In some embodiments, the method further includes: if the negotiation result is audio, the Interactive VoiceResponse system calls the virtual digital human engine end through the HTTP interface to generate corresponding real-time audio (the audio and the virtual digital human have the same timbre), and feeds it back to the calling end.

[0034] In some embodiments, the method further includes: if the negotiation exceeds a preset time (for example, 8 seconds), the negotiation is determined to have failed, and the Interactive Voice Response system calls the virtual digital human engine end through the HTTP interface to generate corresponding real-time audio (the audio has the same timbre as the virtual digital human), and feeds it back to the calling end.

[0035] In some embodiments, the method further includes: if the calling end does not support video service, the Interactive VoiceResponse system calls the virtual digital human engine end through the HTTP interface to generate corresponding real-time audio (the audio has the same timbre as the virtual digital human) and feeds it back to the calling end.

[0036] In some embodiments, the method also includes: after the calling end or the virtual digital human engine end hangs up, the virtual digital human engine sends each intelligent interactive video to the mini program end, so that the mini program end generates prompt information based on each of the intelligent interactive videos and call information (for example, the prompt information may be that Zhang San calls you at 2:13 pm on August 10, 2024, and invites you to attend the wedding at 9 am on August 15, 2024), and sends it to the called end or displays it to the called end through the Wo Assistant mini program.

[0037] In some embodiments, the mini program end includes a variety of virtual digital human images (for example, the virtual digital human images have different hairstyles, skin colors, hair colors, face shapes and clothing), scenario modes and reply templates (the reply template is a reply message customized by the called party, such as I am busy now, please leave a message, etc.).

[0038] According to the embodiment of the present disclosure, when the called end does not answer the call request of the calling end, according to the call instruction of the InteractiveVoice Response system, it is judged whether the called end has subscribed to the target product service; if the called end has subscribed to the target product service, it is judged whether the virtual digital human engine end is idle according to the target product service setting subscribed by the called end; if the virtual digital human engine end is idle, a negotiation instruction is sent to the InteractiveVoice Response system, so that the Interactive Voice Response system negotiates with the calling end according to the negotiation instruction; if the negotiation result is a video, and the working state of the virtual digital human engine end is normal, the Interactive Voice Response system sends a synthesis instruction to the virtual digital human engine end, so that the virtual digital human engine end synthesizes the intelligent interactive video in real time according to the synthesis instruction. The intelligent interaction between the virtual digital human and the calling end is realized, and the user's satisfaction is improved.

[0039] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present disclosure is not limited by the order of the actions described, because according to the present disclosure, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present disclosure.

[0040] The above is an introduction to the method embodiment. The following is a further explanation of the scheme disclosed in the present invention through an apparatus embodiment.

[0041] Figure 2 A block diagram of a video call device 200 based on real-time intelligent interaction of a virtual digital human according to an embodiment of the present disclosure is shown, and the device 200 includes: The first determination module 201 is used to determine whether the called user terminal has subscribed to the target product service according to the calling instruction of the Interactive Voice Response system when the called user terminal does not answer the call request of the calling user terminal; The second judgment module 202 is used to judge whether the virtual digital human engine terminal is idle according to the target product service settings ordered by the called user terminal if the called user terminal has ordered the target product service; The synthesis module 203 is used to send a negotiation instruction to the Interactive Voice Response system if the virtual digital human engine end is idle, so that the Interactive Voice Response system negotiates with the calling end according to the negotiation instruction; if the negotiation result is a video and the working status of the virtual digital human engine end is normal, the Interactive Voice Response system sends a synthesis instruction to the virtual digital human engine end, so that the virtual digital human engine end synthesizes the intelligent interactive video in real time according to the synthesis instruction.

[0042] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the described module can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0043] In the technical solution disclosed herein, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0044] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.

[0045] Figure 3 A schematic block diagram of an electronic device 300 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0046] The electronic device 300 includes a computing unit 301, which can perform various appropriate actions and processes according to a computer program stored in a ROM 302 or a computer program loaded from a storage unit 308 into a RAM 303. In the RAM 303, various programs and data required for the operation of the electronic device 300 can also be stored. The computing unit 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An I / O interface 305 is also connected to the bus 304.

[0047] A number of components in the electronic device 300 are connected to the I / O interface 305, including: an input unit 306, such as a keyboard, a mouse, etc.; an output unit 307, such as various types of displays, speakers, etc.; a storage unit 308, such as a disk, an optical disk, etc.; and a communication unit 309, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 309 allows the electronic device 300 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0048] The computing unit 301 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 301 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 301 performs the various methods and processes described above, such as a video call method based on real-time intelligent interaction of virtual digital people. For example, in some embodiments, the video call method based on real-time intelligent interaction of virtual digital people may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 308. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 300 via the ROM 302 and / or the communication unit 309. When the computer program is loaded into the RAM 303 and executed by the computing unit 301, one or more steps of the video call method based on real-time intelligent interaction of virtual digital people described above may be performed. Alternatively, in other embodiments, the computing unit 301 may be configured in any other appropriate manner (eg, by means of firmware) to execute a video calling method based on real-time intelligent interaction of a virtual digital human.

[0049] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0050] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0051] In the context of the present disclosure, a readable storage medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or apparatus. A readable storage medium may be a machine-readable signal medium or a machine-readable storage medium. A readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. More specific examples of readable storage media may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0052] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0053] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0054] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0055] It should be understood that the above-mentioned various forms of processes can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of this disclosure can be achieved, and this document is not limited here.

[0056] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A video call method based on real-time intelligent interaction of virtual digital humans, characterized in that: include: When the called party does not answer the call request of the calling party, determine whether the called party has subscribed to the target product service according to the calling instruction of the Interactive Voice Response system; If the called party has subscribed to the target product service, then judging whether the virtual digital human engine end is idle according to the target product service settings subscribed by the called party; If the virtual digital human engine end is idle, a negotiation instruction is sent to the Interactive Voice Response system, so that the Interactive Voice Response system negotiates with the calling end according to the negotiation instruction; If the negotiation result is a video, and the working status of the virtual digital human engine is normal, the Interactive Voice Response system sends a synthesis instruction to the virtual digital human engine so that the virtual digital human engine can synthesize the intelligent interactive video in real time according to the synthesis instruction.

2. The video call method based on real-time intelligent interaction of virtual digital humans according to claim 1, characterized in that: The method further comprises: If the called party has not subscribed to the target product service, the large network analog audio information will be fed back to the calling party.

3. The video call method based on real-time intelligent interaction of virtual digital human according to claim 1, characterized in that: The method further comprises: When judging whether the virtual digital human engine end is idle according to the target product service settings ordered by the called party, if the virtual digital human engine end is completely busy or offline, the Interactive Voice Response system calls the virtual digital human engine end through the HTTP interface to generate corresponding real-time audio and feeds it back to the calling party.

4. The video call method based on real-time intelligent interaction of virtual digital humans according to claim 1, characterized in that: The method further comprises: If the negotiation result is video, and the working status of the virtual digital human engine end is busy or unavailable, the InteractiveVoice Response system calls the virtual digital human engine end through the HTTP interface to generate the corresponding real-time audio and feed it back to the calling end.

5. The video call method based on real-time intelligent interaction of virtual digital humans according to claim 1, characterized in that: The method further comprises: If the negotiation result is audio or the negotiation exceeds the preset time or the calling party does not support video service, the InteractiveVoice Response system calls the virtual digital human engine through the HTTP interface to generate the corresponding real-time audio and feed it back to the calling party.

6. The video call method based on real-time intelligent interaction of virtual digital humans according to claim 1, characterized in that: The method further comprises: After the calling end or the virtual digital human engine end hangs up, the virtual digital human engine sends each intelligent interaction video to the mini program end, so that the mini program end generates prompt information according to each of the intelligent interaction videos and sends it to the called end.

7. The video call method based on real-time intelligent interaction of virtual digital humans according to claim 6, characterized in that: The mini program terminal includes a variety of virtual digital human images, scenario modes and reply templates.

8. A video call device based on real-time intelligent interaction of virtual digital humans, characterized in that: include: The first judgment module is used to judge whether the called user terminal has subscribed to the target product service according to the calling instruction of the Interactive VoiceResponse system when the called terminal does not answer the call request of the calling terminal; The second judgment module is used to judge whether the virtual digital human engine terminal is idle according to the target product service settings ordered by the called user terminal if the called user terminal has ordered the target product service; A synthesis module, used for sending a negotiation instruction to the Interactive Voice Response system if the virtual digital human engine end is idle, so that the Interactive Voice Response system negotiates with the calling end according to the negotiation instruction; If the negotiation result is a video, and the working status of the virtual digital human engine is normal, the Interactive VoiceResponse system sends a synthesis instruction to the virtual digital human engine so that the virtual digital human engine can synthesize the intelligent interactive video in real time according to the synthesis instruction.

9. An electronic device, characterized in that: include: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in any one of claims 1-7.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-7.

Images