Virtual image driving method, device, equipment, storage medium and program product

Abstract

The present disclosure provides a virtual image driving method, device, equipment, storage medium and program product, which relate to the field of data processing technology, especially to the field of artificial intelligence, computer vision and virtual reality technology. The specific implementation scheme is: obtaining virtual image data, wherein the virtual image data includes virtual image driving data and target event triggering instructions, and there is a time correlation relationship between the virtual image driving data and the target event triggering instructions; determining the virtual image video stream according to the virtual image driving data; determining the target event associated with the target event triggering instruction according to the target event triggering instruction; and determining the target virtual image video stream according to the target event and the virtual image video stream, wherein the target virtual image video stream includes a target virtual image video frame matching the time correlation relationship, and the target virtual image video frame is associated with the target event.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, in particular to the field of artificial intelligence, computer vision, and virtual reality technology, and specifically to a virtual image driving method, device, equipment, storage medium, and program product. Background Art

[0002] With the development of computer technology and Internet technology, various functional services in life and entertainment can be provided through virtual images. Summary of the invention

[0003] The present disclosure provides a virtual image driving method, apparatus, device, storage medium and program product.

[0004] According to one aspect of the present disclosure, a virtual image driving method is provided, comprising: acquiring virtual image data, wherein the virtual image data includes virtual image driving data and a target event triggering instruction, and there is a time correlation relationship between the virtual image driving data and the target event triggering instruction; determining a virtual image video stream according to the virtual image driving data; determining a target event associated with the target event triggering instruction according to the target event triggering instruction; and determining a target virtual image video stream according to the target event and the virtual image video stream, wherein the target virtual image video stream includes a target virtual image video frame matching the time correlation relationship, and the target virtual image video frame is associated with the target event.

[0005] According to another aspect of the present disclosure, a virtual image driving device is provided, comprising: a virtual image data acquisition module, a virtual image video stream determination module, a target event determination module, and a target virtual image video stream determination module. The virtual image data acquisition module is used to acquire virtual image data, wherein the virtual image data includes virtual image driving data and a target event trigger instruction, and there is a time association relationship between the virtual image driving data and the target event trigger instruction; the virtual image video stream determination module is used to determine the virtual image video stream according to the virtual image driving data; the target event determination module is used to determine the target event associated with the target event trigger instruction according to the target event trigger instruction; the target virtual image video stream determination module is used to determine the target virtual image video stream according to the target event and the virtual image video stream, wherein the target virtual image video stream includes a target virtual image video frame that matches the time association relationship, and the target virtual image video frame is associated with the target event.

[0006] According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor and a memory in communication with the at least one processor, wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method of the embodiment of the present disclosure.

[0007] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, where the computer instructions are used to cause a computer to execute the method of the embodiment of the present disclosure.

[0008] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, wherein the computer program is stored on at least one of a readable storage medium and an electronic device, and the computer program is stored on at least one of a readable storage medium and an electronic device, and the computer program implements the method of an embodiment of the present disclosure when executed by a processor.

[0009] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0011] Figure 1 A system architecture diagram schematically shows a method and device for driving a virtual image according to an embodiment of the present disclosure;

[0012] Figure 2 A flowchart of a method for driving a virtual image according to an embodiment of the present disclosure is schematically shown;

[0013] Figure 3 A schematic diagram schematically shows a method for driving a virtual image according to another embodiment of the present disclosure;

[0014] Figure 4A and Figure 4B A schematic diagram schematically shows a method for driving a virtual image according to another embodiment of the present disclosure;

[0015] Figure 5 A block diagram schematically shows a virtual image driving device according to an embodiment of the present disclosure; and

[0016] Figure 6 A block diagram of an electronic device that can implement the virtual character driving method of an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0017] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0018] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0019] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification, and should not be interpreted in an idealized or overly rigid manner.

[0020] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0021] With the development of computer technology and Internet technology, various functional services in life and entertainment can be provided through virtual images.

[0022] For example, a virtual image can be used to drive the digital live studio to explain the text using a virtual image. There is a situation where the virtual image explains the text, which involves triggering some business-related instructions under specific preset circumstances. For example, when the virtual image says "start the lottery", a lottery window pops up on the user side interface, and the user can click to participate in the lottery. This makes it a technical problem that needs to be solved urgently to accurately trigger the corresponding business behavior when the virtual image explains the text, so that the virtual image's text explanation is synchronized with the corresponding triggering instructions.

[0023] In some implementations, when the virtual image encounters a node that needs to trigger interaction in the live broadcast room during the process of automatically explaining the copy, the live broadcast operator manually triggers the interaction in the live broadcast room in the background according to the live broadcast content seen in the live broadcast room, or according to the agreed time. Since the interactive node in the live broadcast room is manually triggered, it may be triggered too early or later than the corresponding live broadcast audio and video screen triggering, which may easily cause inconsistencies between the interactive node and the live broadcast content due to human errors. Even due to human errors, the command is not triggered.

[0024] In some implementations, a scheduled task is used to execute the script at a specified time, thereby triggering the instructions corresponding to the interactive behavior in the live broadcast room. Since the exact time when the virtual image live stream screen appears is difficult to predict, and the content of the virtual image live broadcast script may be added or deleted at any time, the difficulty of prediction is increased. Therefore, the solution of triggering instructions at a specified screen through a scheduled task will also cause the problem of inconsistency between the screen and the instruction triggering timing.

[0025] Figure 1 The system architecture of the virtual image driving method and device according to an embodiment of the present disclosure is schematically shown. It should be noted that: Figure 1 What is shown is merely an example of a system architecture to which the embodiments of the present disclosure can be applied, in order to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios.

[0026] like Figure 1 As shown, the system architecture 100 according to this embodiment may include a first server 101, a second server 102, clients 103, 104, 105, and a network 106. The network 106 is used to provide a medium for communication links between the first server 101, the second server 102, and the clients 103, 104, 105. The network 106 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0027] The first server 101 and the second server 102 may be servers that provide various services. In addition, the first server 101 and the second server 102 may also be cloud servers, that is, the first server 101 and the second server 102 have cloud computing functions.

[0028] The first server 101 may store, for example, avatar data.

[0029] The second server 102 may, for example, obtain the virtual image data from the first server 101, and drive the virtual image according to the virtual image data to obtain a target virtual image video stream.

[0030] The user can use the client 103, 104, 105 to interact with the second server 102 through the network 106 to receive or send messages, etc. Various communication client applications can be installed on the client 103, 104, 105, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for example).

[0031] The clients 103, 104, 105 may be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, etc. The clients 103, 104, 105 of the disclosed embodiment may, for example, run applications.

[0032] It should be noted that the virtual image driving method provided in the embodiment of the present disclosure can be executed by the second server 102. Accordingly, the virtual image driving device provided in the embodiment of the present disclosure can be set in the second server 102. The virtual image driving method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the second server 102 and can communicate with the first server 101, the client 103, 104, 105 and / or the second server 102. Accordingly, the virtual image driving device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the second server 102 and can communicate with the first server 101, the client 103, 104, 105 and / or the second server 102.

[0033] In one example, the second server 102 can obtain virtual image data from the first server 101 through the network 106, and execute the virtual image driving method to obtain a target virtual image video stream. The target virtual image video stream can be sent to the clients 103, 104, 105 through the network 106 and displayed on the clients 103, 104, 105.

[0034] It should be understood that Figure 1 The number of the first server 101, the second server 102, the clients 103, 104, 105 and the network 106 is only illustrative. According to the implementation requirements, there can be any number of the first server 101, the second server 102, the clients 103, 104, 105 and the network 106.

[0035] It should be noted that in the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0036] In the technical solution of the present disclosure, the user's authorization or consent is obtained before obtaining or collecting the user's personal information.

[0037] The present disclosure provides a method for driving a virtual image. Figure 1 The system architecture of Figure 2 to Figure 4B The virtual image driving method according to the exemplary embodiment of the present disclosure is described as follows. The virtual image driving method of the embodiment of the present disclosure can be, for example, Figure 1 The second server 102 is shown to execute.

[0038] Figure 2 The flowchart of a virtual character driving method according to an embodiment of the present disclosure is schematically shown.

[0039] like Figure 2 As shown, the virtual character driving method 200 of the embodiment of the present disclosure may include, for example, operations S210 to S240.

[0040] In operation S210, avatar data is acquired.

[0041] The virtual image data includes virtual image driving data and target event triggering instructions, and there is a time correlation relationship between the virtual image driving data and the target event triggering instructions.

[0042] The time association relationship between the virtual image driving data and the target event triggering instruction can be predetermined.

[0043] In operation S220, an avatar video stream is determined according to the avatar driving data.

[0044] In operation S230 , a target event associated with the target event triggering instruction is determined according to the target event triggering instruction.

[0045] In the case where there is a temporal correlation between the virtual image driving data and the target event triggering instruction, there will also be a temporal correlation between the virtual image video stream determined by the virtual image driving data and the target event related to the target event triggering instruction.

[0046] The target event trigger instruction can be used to trigger a target event, and the target event can be determined according to specific business needs.

[0047] For example, the virtual image driving data is used to drive the virtual image to make corresponding expressions and body movements. At the same time, the virtual image driving data can also emit corresponding voices. Take the specific application scenario of the virtual image driving data driving the virtual image to explain the text as an example. In some cases, in addition to the virtual image, a target event is also involved. For example, when the virtual image explains specific content, the target event needs to be executed.

[0048] For example, the target event may be a countdown event when the avatar speaks a voice saying "start countdown". The avatar's voice saying "start countdown" is temporally associated with the target event, and thus the avatar video stream is temporally associated with the target event.

[0049] In operation S240, a target avatar video stream is determined according to the target event and the avatar video stream.

[0050] The target virtual image video stream includes target virtual image video frames that match the time association relationship, and the target virtual image video frames are associated with the target event.

[0051] The target event is triggered by a target event trigger instruction, and there is a time correlation relationship between the target event trigger instruction and the virtual image driving data. Therefore, when the virtual image video stream is determined according to the virtual image driving data, the execution of the target event and some virtual image video frames of the virtual image video stream are temporally overlapped. For example, the image generated by the execution of the target event and the virtual image video frame that temporally overlaps with the target event can be superimposed to obtain the target virtual image video frame.

[0052] According to the virtual image driving method of the embodiment of the present disclosure, by obtaining virtual image data and determining the virtual image video stream according to the virtual image driving data, the virtual image can be used to display the virtual image, and the displayed virtual image can provide audio-visual services. By determining the target event related to the target event triggering instruction according to the target event triggering instruction, business-related events other than the virtual image can be introduced to adapt to specific business needs. By determining the target virtual image video stream according to the target event and the virtual image video stream to include a target virtual image video frame that matches the time association relationship, and the target virtual image video frame is associated with the target event, the target event can be accurately triggered according to the time association relationship, thereby improving the synchronization between the target event and the virtual image driving, and thus improving the user experience.

[0053] It should be noted that operation S220 and operation S230 only represent different operations, and do not represent the order in which the operations are executed.

[0054] Figure 3 A schematic diagram of a virtual character driving method 300 according to another embodiment of the present disclosure is schematically shown.

[0055] like Figure 3 As shown, for example, the following embodiments may be used to implement a specific example of determining a target event associated with a target event triggering instruction in operation S330 of another embodiment of the present disclosure.

[0056] The target event triggering instruction includes a pseudo image loading instruction.

[0057] The avatar driver provides audio-visual services in the form of images and voices on the client. The visualization of the avatar video stream can be achieved, for example, by loading pictures and rendering data. The target event triggering instruction includes a pseudo-image loading instruction, which can be adapted to the actual implementation method of the avatar video stream visualization.

[0058] In operation S331 , in response to the dummy image load instruction being executed, callback data 305 is determined.

[0059] The callback data includes the target event identifier.

[0060] Callbacks can be used for inter-layer collaboration. The upper layer installs the function of this layer in the lower layer. This function is the callback, and the lower layer triggers the callback under certain conditions. For example, as a driver (bottom layer), when receiving a data, in addition to completing the processing work of this layer, it will also make a callback and hand over the data to the upper application layer for further processing.

[0061] In operation S332 , the target event 306 is determined according to the target event identifier.

[0062] According to the virtual image driving method of the embodiment of the present disclosure, callback data is determined in response to the execution of a pseudo image loading instruction, and the callback data includes a target event identifier. The target event can be accurately determined according to the target event identifier in synchronization with the pseudo image loading instruction.

[0063] Since the virtual image video stream is used for display on the client, which is a visualization process, the pseudo image loading instruction can be adapted to the visualization of the virtual image video stream.

[0064] For example, a virtual image rendering engine can be used to perform virtual image rendering and display (i.e., virtual image visualization). The virtual image rendering engine supports loading pictures and uses a pseudo image loading instruction as a target event trigger instruction. Subsequently, for example, a pseudo image can be loaded according to the pseudo image loading instruction. The pseudo image can be displayed as an image on the client, and the virtual image video stream will not be displayed abnormally on the client due to the target event trigger instruction.

[0065] exist Figure 3 In the example, operation S310 of acquiring virtual avatar data 301 is schematically shown, and the virtual avatar data 301 includes virtual avatar driving data 302 and target event triggering instruction 303. Operation S320 of determining a virtual avatar video stream 304 according to the virtual avatar driving data 302 is schematically shown. Operation S340 of determining a target virtual avatar video stream 311 according to the target event 306 and the virtual avatar video stream 304 is schematically shown.

[0066] Exemplarily, for example, the target event may be determined from the event set according to the target event identifier.

[0067] The event set may be predetermined, for example. The event set may also be maintained by relevant personnel, for example, by adding events, deleting events, and the like.

[0068] Exemplarily, the event set includes at least one of the following: sending a dynamic special effect event and displaying a countdown event.

[0069] like Figure 3 As shown, a virtual character driving method 300 according to yet another embodiment of the present disclosure.

[0070] Figure 3 A specific example of determining a target avatar video stream according to a target event and the avatar video stream in operation S340 is exemplarily shown.

[0071] The avatar video stream includes instruction-trigger video frames associated with target event-trigger instructions.

[0072] Exemplarily, the avatar video stream may include an avatar image stream and an avatar voice stream having an image frame-voice frame timing matching relationship, wherein the avatar image stream includes a plurality of image frames, and the avatar voice stream includes a plurality of voice frames.

[0073] The instruction trigger video frame related to the target event trigger instruction can be determined in advance. For example, taking the example of triggering the target event when the virtual image issues "start countdown" as mentioned above, in the voice stream of the virtual image, for example, the voice frame corresponding to the xth last word in "start countdown" can be used as the instruction trigger video frame.

[0074] It should be noted that the command-triggered video frame can not only be a voice frame, that is, supporting voice-triggered target events, but the command-triggered video frame can also be an image frame, for example, to support image-triggered target events. Image-triggered target events can, for example, include triggering target events such as specific posture movements of the virtual image displayed in the image or triggering target events such as background switching of the image display.

[0075] In operation S341 , in response to determining the target speech frame, a pseudo image loading instruction is executed to determine the pseudo image 307 .

[0076] In response to determining the target voice frame, the pseudo image determined by executing the pseudo image loading instruction can execute the target event trigger instruction in the form of image loading, which can be adapted to the virtual image visualization drive. For example, the obtained pseudo image can be added to the virtual image video stream, and the virtual image will not be displayed abnormally due to the execution of the target event trigger instruction.

[0077] The pseudo image may be, for example, an image having specific image elements, for example, the pseudo image may be a transparent image.

[0078] In operation S342 , in response to the pseudo image loading instruction being executed, a target image frame 308 is determined according to the avatar video stream.

[0079] The target image frame can be understood as: the virtual image image frame displayed simultaneously in the virtual image video stream at the moment when the pseudo image loading instruction is executed, that is, the moment when the target event is triggered.

[0080] In operation S343 , a target avatar image frame 310 is determined according to the target image frame 308 and the target event control 309 corresponding to the target event 306 .

[0081] Exemplarily, for example, the target event control 309 corresponding to the target event 306 may be superimposed on the target image frame 308 to obtain the target virtual image frame 310 .

[0082] In operation S344 , a target avatar video stream 311 is determined based on the pseudo image 307 , the target avatar image frame 308 , and the avatar video stream 304 .

[0083] According to the virtual image driving method of the embodiment of the present disclosure, the virtual image video stream including the virtual image voice stream and the virtual image image stream and the target voice frame associated with the target event triggering instruction are adapted to the actual scene of triggering the target event by voice. By executing the pseudo image loading instruction, the pseudo image can be added to the target virtual image video stream without affecting the normal display of the virtual image video stream. By responding to the execution of the pseudo image loading instruction, according to the virtual image video stream, the target image frame is determined, according to the target image frame and the target event corresponding to the target event control, the target virtual image image frame is determined, and according to the pseudo image target virtual image image frame and the virtual image video stream, the determined target virtual image video stream can automatically and accurately trigger the target event when driving the virtual image to perform audio-visual services. The target virtual image video stream integrates the virtual image display and the specific business needs, and the triggering of the business needs is accurate and synchronous. In addition, since the target event triggering instruction is separated from the virtual image driving data, for example, in the scenario where the virtual image explains the copy, the content of the copy, such as addition, deletion, etc., will not affect the target event triggering instruction.

[0084] Figure 4A and Figure 4B A schematic diagram of a virtual character driving method according to another embodiment of the present disclosure is schematically shown.

[0085] exist Figure 4AIn the example, a specific tool for executing the virtual image driving method is schematically shown, for example, a specific function can be implemented by using a corresponding interface service.

[0086] exist Figure 4A In the example, for example, it may specifically include a virtual image driving service 401, a virtual image rendering engine service 402, a callback interface service 403, and a business callback interface service 404.

[0087] Figure 4B The specific operation steps for realizing the corresponding functions by utilizing the above-mentioned interface service are schematically shown. For example, the following steps may be executed in sequence: starting the virtual image rendering engine service, starting the callback interface service, starting the virtual image driving service, the virtual image driving service generating and sending instructions, the virtual image rendering engine service executing the instructions, the callback interface service loading a pseudo image, the business callback interface service triggering a business background behavior according to the pseudo image (the business background behavior is the target event), and performing client streaming according to the virtual image video stream (the client will display the virtual image video stream and the pseudo image).

[0088] The virtual image driver service is used to generate a virtual image rendering engine instruction according to the virtual image data and send the instruction to the virtual image rendering engine service.

[0089] The virtual image rendering engine service is used to receive instructions that the virtual image needs to execute, and the execution instructions include, for example, speaking according to the explanation text, loading images at the specified location of the explanation text, generating a virtual image video stream, and streaming the generated virtual image video stream. The loaded image can be, for example, a pseudo image.

[0090] Loading a pseudo image triggers the callback interface service.

[0091] Callbacks can be used for inter-layer collaboration. The upper layer installs the function of this layer in the lower layer. This function is the callback, and the lower layer triggers the callback under certain conditions. For example, as a driver (bottom layer), when receiving a data, in addition to completing the processing work of this layer, it will also make a callback and hand over the data to the upper application layer for further processing.

[0092] For example, in the virtual image driving method of the embodiment of the present disclosure, the virtual image rendering engine service serves as the bottom layer. When receiving a target event trigger instruction for loading a pseudo image, in addition to loading the pseudo image, it also determines the target event identifier based on the pseudo image.

[0093] The callback interface service may be used to receive a callback from the virtual image driving service and call a pre-configured business interface (business callback interface service 406 ) according to the callback parameters.

[0094] The callback interface service may, for example, output a 1px transparent png image whose Content-Type of an http response header is image / png as a pseudo image.

[0095] Exemplarily, the name of the callback interface service may be suffixed with ".png" to ensure that the rendering engine can recognize it as a png image, so that the virtual image rendering engine does not affect the screen display when loading the callback interface service.

[0096] Exemplarily, the interface request parameter of the callback interface service may carry a callback instruction id, and the corresponding service callback address may be found through the callback instruction id. The callback instruction id and the corresponding service callback address may be stored in a data table, for example.

[0097] It is understandable that the corresponding service callback address can be determined through the callback instruction id, and then different target events can be determined.

[0098] Exemplarily, the callback instruction id may be, for example, a self-incrementing id.

[0099] After the callback interface service is requested, the callback instruction id in the request parameter can be parsed, and the callback url can be obtained through the callback id. The callback interface service requests the business callback interface service.

[0100] The business callback interface service can execute the corresponding target event (the target event is the business behavior) after receiving the request sent by the callback interface.

[0101] Figure 5 The figure schematically shows a block diagram of a virtual image driving device according to an embodiment of the present disclosure.

[0102] like Figure 5 As shown, the virtual image driving device 500 of the embodiment of the present disclosure includes, for example, a virtual image data acquisition module 510 , a virtual image video stream determination module 520 , a target event determination module 530 , and a target virtual image video stream determination module 540 .

[0103] The virtual image data acquisition module 510 is used to acquire the virtual image data.

[0104] The virtual image data includes virtual image driving data and target event triggering instructions, and there is a time correlation relationship between the virtual image driving data and the target event triggering instructions.

[0105] The virtual image video stream determination module 520 is used to determine the virtual image video stream according to the virtual image driving data.

[0106] The target event determination module 530 is used to determine the target event associated with the target event trigger instruction according to the target event trigger instruction.

[0107] The target avatar video stream determination module 540 is used to determine the target avatar video stream according to the target event and the avatar video stream.

[0108] The target virtual image video stream includes target virtual image video frames that match the time association relationship, and the target virtual image video frames are associated with the target event.

[0109] According to another embodiment of the present disclosure, the target event triggering instruction includes a pseudo image loading instruction; the target event determining module includes: a callback data determining submodule and a target event determining submodule.

[0110] The callback data determination submodule is used to determine the callback data in response to the dummy image loading instruction being executed.

[0111] The callback data includes the target event identifier.

[0112] The target event determination submodule is used to determine the target event according to the target event identifier.

[0113] According to another embodiment of the present disclosure, the virtual image video stream includes an instruction trigger video frame associated with a target event trigger instruction; the target virtual image video stream determination module includes: a pseudo image determination submodule, a target image frame determination submodule, a target virtual image image frame determination submodule and a target virtual image video stream determination submodule.

[0114] The pseudo image determination submodule is used to execute the pseudo image loading instruction and determine the pseudo image in response to determining the target speech frame.

[0115] The target image frame determination submodule is used to determine the target image frame according to the virtual image video stream in response to the pseudo image loading instruction being executed.

[0116] The target virtual image image frame determination submodule is used to determine the target virtual image frame according to the target image frame and the target event control corresponding to the target event.

[0117] The target virtual image video stream determination submodule is used to determine the target virtual image video stream according to the pseudo image, the target virtual image image frame and the virtual image video stream.

[0118] According to another embodiment of the present disclosure, the target event determination submodule includes: a target event determination unit, configured to determine a target event from an event set according to a target event identifier.

[0119] According to yet another embodiment of the present disclosure, the event set includes at least one of the following: sending a dynamic special effect event and displaying a countdown event.

[0120] It should be understood that the embodiments of the device part of the present disclosure are the same or similar to the embodiments of the method part of the present disclosure, and the technical problems solved and the technical effects achieved are also the same or similar, and the present disclosure will not elaborate on them here.

[0121] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0122] Figure 6 A schematic block diagram of an example electronic device 600 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0123] like Figure 6 As shown, the device 600 includes a computing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 602 or a computer program loaded from a storage unit 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the device 600 can also be stored. The computing unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0124] A number of components in the device 600 are connected to the I / O interface 605, including: an input unit 606, such as a keyboard, a mouse, etc.; an output unit 607, such as various types of displays, speakers, etc.; a storage unit 608, such as a disk, an optical disk, etc.; and a communication unit 609, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0125] The computing unit 601 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 601 performs the various methods and processes described above, such as the virtual image driving method. For example, in some embodiments, the virtual image driving method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 608. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 600 via the ROM 602 and / or the communication unit 609. When the computer program is loaded into the RAM 603 and executed by the computing unit 601, one or more steps of the virtual image driving method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the virtual image driving method in any other appropriate manner (e.g., by means of firmware).

[0126] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0127] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0128] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0129] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0130] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0131] A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.

[0132] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0133] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for driving a virtual image, comprising: Acquire virtual image data, wherein the virtual image data includes virtual image driving data and target event triggering instructions, and the virtual image driving data and the target event triggering instructions have a time correlation relationship; Determining a virtual image video stream according to the virtual image driving data; According to the target event triggering instruction, determining a target event associated with the target event triggering instruction; and Determine a target virtual image video stream according to the target event and the virtual image video stream, wherein the target virtual image video stream includes a target virtual image video frame matching the time association relationship, and the target virtual image video frame is associated with the target event; Wherein, the target event trigger instruction is executed in response to determining that the virtual image video stream includes an instruction trigger video frame associated with the target event trigger instruction; the time of executing the target event overlaps with the display time of some virtual image video frames of the virtual image video stream, and the target virtual image video frame is obtained by superimposing an image generated by executing the target event with the said partial virtual image video frame.

2. The method according to claim 1, wherein: The target event triggering instruction includes a pseudo image loading instruction; and determining the target event associated with the target event triggering instruction according to the target event triggering instruction includes: In response to the dummy image loading instruction being executed, determining callback data, wherein the callback data includes a target event identifier; and The target event is determined according to the target event identifier.

3. The method according to claim 2, wherein: Determining a target virtual image video stream according to the target event and the virtual image video stream comprises: In response to determining that the instruction triggers a video frame, executing the pseudo image loading instruction to determine a pseudo image; In response to the pseudo image loading instruction being executed, determining a target image frame according to the virtual image video stream; Determining the target virtual image frame according to the target image frame and the target event control corresponding to the target event; and The target virtual image video stream is determined according to the pseudo image, the target virtual image image frame and the virtual image video stream.

4. The method according to claim 2, wherein: Determining the target event according to the target event identifier includes: The target event is determined from an event set according to the target event identifier.

5. The method according to claim 4, wherein: The event set includes at least one of the following: sending a dynamic special effect event and displaying a countdown event.

6. A virtual image driving device, comprising: A virtual image data acquisition module, used to acquire virtual image data, wherein the virtual image data includes virtual image driving data and target event triggering instructions, and there is a time correlation relationship between the virtual image driving data and the target event triggering instructions; A virtual image video stream determination module, used to determine the virtual image video stream according to the virtual image driving data; a target event determination module, configured to determine a target event associated with the target event trigger instruction according to the target event trigger instruction; and a target virtual image video stream determination module, configured to determine a target virtual image video stream according to the target event and the virtual image video stream, wherein the target virtual image video stream includes a target virtual image video frame matching the time association relationship, and the target virtual image video frame is associated with the target event; Wherein, the target event trigger instruction is executed in response to determining that the virtual image video stream includes an instruction trigger video frame associated with the target event trigger instruction; the time of executing the target event overlaps with the display time of some virtual image video frames of the virtual image video stream, and the target virtual image video frame is obtained by superimposing an image generated by executing the target event with the said partial virtual image video frame.

7. The device according to claim 6, wherein: The target event triggering instruction includes a pseudo image loading instruction; the target event determining module includes: a callback data determination submodule, configured to determine callback data in response to the pseudo image loading instruction being executed, wherein the callback data includes a target event identifier; and The target event determination submodule is used to determine the target event according to the target event identifier.

8. The device according to claim 7, wherein: The target virtual image video stream determination module includes: a pseudo image determination submodule, configured to execute the pseudo image loading instruction and determine the pseudo image in response to determining the instruction triggering video frame; a target image frame determination submodule, configured to determine a target image frame according to the virtual image video stream in response to the pseudo image loading instruction being executed; a target virtual image image frame determination submodule, configured to determine the target virtual image frame according to the target image frame and a target event control corresponding to the target event; and The target virtual image video stream determination submodule is used to determine the target virtual image video stream according to the pseudo image, the target virtual image image frame and the virtual image video stream.

9. The device according to claim 7, wherein: The target event determination submodule includes: The target event determination unit is used to determine the target event from the event set according to the target event identifier.

10. The device according to claim 9, wherein: The event set includes at least one of the following: sending a dynamic special effect event and displaying a countdown event.

11. An electronic device, comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 5.

12. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-5.

13. A computer program product, comprising a computer program, wherein the computer program is stored in at least one of a readable storage medium and an electronic device, and when the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.

Images