Methods and sets of data processing equipment, electronic devices, computer-readable storage media, and computer software products.

Abstract

Invention details;

Description

Data processing method, device, electronic device, computer-readable storage medium, and computer program product

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] The embodiments of this application are based on the Chinese patent application with application number 202210009571.6 and application date on January 5, 2022, and the Chinese patent application with application number 202210086698.8 and application date on January 25, 2022, and claim the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby introduced into the embodiments of this application as a reference. Technical Field

[0003] The present application relates to the field of computer technology, and in particular to a data processing method, device, electronic device, computer-readable storage medium, and computer program product. Background Art

[0004] Film and television is an art form that uses copies, tapes, films, storage devices, etc. as carriers and is projected on screens to achieve a comprehensive visual and auditory experience. It is a comprehensive form of modern art that includes movies, TV series, programs, animations, and other content.

[0005] Taking videos produced based on virtual reality technology as an example, real-life data is used, and electronic signals generated by computer technology are combined with various output devices to transform them into phenomena that people can feel, supporting users to have an immersive experience during the viewing process.

[0006] However, in traditional video playback scenarios, the content presented in the video is fixed and too single, and related technologies lack a solution for efficient secondary editing of the single video to form a personalized video that meets user needs.

[0007] Summary of the Invention

[0008] The embodiments of the present application provide a data processing method, device, electronic device, computer-readable storage medium, and computer program product, which can lightweightly integrate viewers into video content through lower data processing resources, improve human-computer interaction efficiency, and enrich video presentation and interaction methods.

[0009] An embodiment of the present application provides a data processing method, which is executed by a computer device and includes:

[0010] In response to a triggering operation on a multi-view video, displaying a virtual video space scene corresponding to the multi-view video;

[0011] In response to a scene editing operation on the virtual video space scene, obtaining object data of a first object in the virtual video space scene, wherein the first object is an object that initiates a triggering operation on the multi-view video;

[0012] A creative video associated with the multi-view video is played in a virtual display interface, wherein the creative video is obtained by editing the virtual video space scene based on the object data.

[0013] An embodiment of the present application provides a data processing device, including:

[0014] A first response module is configured to display a virtual video space scene corresponding to the multi-view video in response to a trigger operation on the multi-view video;

[0015] a second response module configured to, in response to a scene editing operation on the virtual video space scene, obtain object data of a first object in the virtual video space scene, wherein the first object is an object that initiates a triggering operation on the multi-view video;

[0016] The video playback module is configured to play a creative video associated with the multi-view video in a virtual display interface, wherein the creative video is obtained by editing the virtual video space scene based on the object data.

[0017] An embodiment of the present application provides a computer device, including: a processor, a memory, and a network interface;

[0018] The processor is connected to the memory and the network interface, wherein the network interface is used to provide a data communication network element, the memory is used to store a computer program, and the processor is used to call the computer program to execute the method in the embodiment of the present application.

[0019] An embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. The computer program is suitable for being loaded by a processor and executing the method in the embodiment of the present application.

[0020] An embodiment of the present application provides a computer program product or a computer program, which includes computer instructions. The computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method in the embodiment of the present application.

[0021] Through the embodiment of the present application, the first object can watch the virtual video space scene from any perspective in the virtual video space scene. The first object can perform secondary creation for the multi-perspective video according to its own creative ideas in the virtual video space scene to obtain a creative video, which can enrich the video presentation and interaction methods. Moreover, since the creative video in which the first object participates can be obtained without the need for secondary shooting, the audience can be lightweightly integrated into the video content through lower data processing resources, thereby improving the efficiency of human-computer interaction while saving data processing resources, and enriching the video presentation and interaction methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0023] FIG1 is a schematic diagram of a system architecture provided by an embodiment of the present application;

[0024] FIG2a is a schematic diagram of a scene creation based on virtual reality provided in an embodiment of the present application;

[0025] FIG2b is a schematic diagram of a video comparison provided in an embodiment of the present application;

[0026] FIG3 is a flow chart of a data processing method provided in an embodiment of the present application;

[0027] FIG4 is a flow chart of a data processing method for dubbing based on virtual reality provided in an embodiment of the present application;

[0028] FIG5a is a schematic diagram of a scenario in which a dubbing mode list is displayed according to an embodiment of the present application;

[0029] FIG5 b is a schematic diagram of a scene of displaying a dubbing-capable video object provided by an embodiment of the present application;

[0030] FIG5c is a schematic diagram of a scene of object dubbing provided in an embodiment of the present application;

[0031] FIG6 is a flow chart of a data processing method for a virtual reality-based performance provided in an embodiment of the present application;

[0032] FIG7 a is a schematic diagram of a scene of displaying a performance mode list provided by an embodiment of the present application;

[0033] FIG7 b is a schematic diagram of a scenario of alternative video object selection provided by an embodiment of the present application;

[0034] FIG7c is a schematic diagram of another alternative video object selection scenario provided by an embodiment of the present application;

[0035] FIG7 d is a schematic diagram of a scene of an object performance based on virtual reality provided in an embodiment of the present application;

[0036] FIG7e is a schematic diagram of a scene of transparent display of an object based on virtual reality provided by an embodiment of the present application;

[0037] FIG7f is a schematic diagram of a scene of a virtual reality-based mirror preview provided in an embodiment of the present application;

[0038] FIG7g is a schematic diagram of a first image customization list provided in an embodiment of the present application;

[0039] FIG7h is a schematic diagram of a second image customization list provided in an embodiment of the present application;

[0040] FIG7i is a schematic diagram of a scene showing purchasable virtual items provided by an embodiment of the present application;

[0041] FIG8 is a flow chart of a data processing method for creating a multi-object video based on virtual reality provided by an embodiment of the present application;

[0042] FIG9a is a schematic diagram of a scenario of object invitation based on virtual reality provided in an embodiment of the present application;

[0043] FIG9 b is a schematic diagram of a scene of a second object display based on virtual reality provided by an embodiment of the present application;

[0044] FIG10 is a flow chart of a data processing method for video recording based on virtual reality provided in an embodiment of the present application;

[0045] FIG11a is a schematic diagram of a scene of mobile perspective switching based on virtual reality provided in an embodiment of the present application;

[0046] FIG11b is a schematic diagram of a scene of fixed-point perspective switching based on virtual reality provided in an embodiment of the present application;

[0047] FIG11c is a schematic diagram of a scene of video shooting based on virtual reality provided by an embodiment of the present application;

[0048] FIG12 is a schematic structural diagram of a data processing device provided in an embodiment of the present application;

[0049] FIG13 is a schematic structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0051] Artificial Intelligence (AI) is the theory, methods, techniques, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, to perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that seeks to understand the essence of intelligence and produce new intelligent machines that can respond in a manner similar to human intelligence. AI also involves studying the design principles and implementation methods of various intelligent machines, enabling them to possess the capabilities of perception, reasoning, and decision-making.

[0052] Artificial intelligence (AI) technology is a comprehensive discipline encompassing a wide range of fields, encompassing both hardware and software technologies. Foundational AI technologies generally include sensors, specialized AI chips, cloud computing, distributed storage, big data processing, operating / interaction systems, and mechatronics. AI software technologies primarily encompass computer vision, speech processing, natural language processing, and machine learning / deep learning.

[0053] Computer vision (CV) is the science of making machines "see." Specifically, it refers to using cameras and computers to replace the human eye in identifying and measuring objects, and then further processing the images to make them more suitable for human observation or transmission to instrumentation. As a scientific discipline, computer vision studies related theories and technologies, aiming to build artificial intelligence systems that can extract information from images or multidimensional data. Computer vision technologies generally include image processing, image recognition, image semantic understanding, image retrieval, optical character recognition (OCR), video processing, video semantic understanding, video content recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, and simultaneous localization and mapping.

[0054] Virtual reality (VR) technology integrates computer, electronic information, and simulation technologies. Its fundamental implementation involves computer-simulated virtual environments, creating a sense of immersion. Virtual reality, as the name suggests, is the fusion of virtual and real life. Theoretically, VR is a computer simulation system that allows users to create and experience virtual worlds. It uses computers to generate a simulated environment, immersing the user in it. VR utilizes real-life data, electronic signals generated by computers, and various output devices to transform it into perceptible phenomena. Because these phenomena are not directly visible but rather simulated through computer technology, they are called virtual reality. VR technology combines simulation with multiple technologies, including computer graphics, human-computer interface technology, multimedia technology, sensor technology, and network technology. It is a challenging, interdisciplinary, and cutting-edge research field. VR technology primarily encompasses simulated environments, motion, perception, and sensor devices. The simulated environment includes real-time, dynamic, computer-generated three-dimensional panoramic images and sound.

[0055] The solution provided in the embodiments of the present application relates to the field of virtual reality technology in artificial intelligence computer vision technology, and is specifically illustrated by the following embodiments.

[0056] Please refer to Figure 1, which is a system architecture diagram provided by an embodiment of the present application. As shown in Figure 1, the system architecture may include a data processing device 100, a virtual display device 200, and a controller (Figure 1 takes controller 300a and controller 300b as an example. Of course, the number of controllers may also be 1 or more than 1, i.e., the controller may include controller 300a and / or controller 300b). The controller and the virtual display device 200 may both be connected to the data processing device 100 by communication. The communication connection does not limit the connection mode. The connection may be directly or indirectly via a wired communication mode, directly or indirectly via a wireless communication mode, or by other means. The embodiment of the present application does not limit this. In addition, when the data processing device 100 is integrated into the virtual display device 200, the controller 300a and the controller 300b may also be directly connected to the virtual display device 200 having data processing capability by wire or wireless. The virtual display device 200 may be a VR device, a computer device with an augmented reality (AR) function, or a computer device with a mixed reality (MR) function.

[0057] As shown in FIG1 , the controller (i.e., controller 300a and / or controller 300b) can send control instructions to the data processing device 100. The data processing device 100 can generate relevant animation data according to the control instructions and send the animation data to the virtual display device 200 for display. The virtual display device 200 can be worn on the user's head, for example, a virtual reality helmet, and display a virtual world to the user (a virtual world can refer to a world that is independent of the real world, connected to the real world, and that people enter in the form of consciousness through virtual reality devices, similar to the earth or the universe, developed or formed using computer technology, Internet technology, satellite technology, and human consciousness potential); the controller can be a handle in the virtual reality system, or a somatosensory device worn on the user, or a smart wearable device (for example, a smart bracelet); the data processing device 100 can be a server or terminal with data processing capabilities. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud databases, cloud services, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The terminal can be a smart terminal with data computing capabilities, such as a smartphone, tablet computer, laptop computer, desktop computer, PDA, mobile internet device (MID), etc.

[0058] The virtual display device 200 and the data processing device 100 can be independent devices or integrated (i.e., the data processing device 100 is integrated into the virtual display device 200). In order to better understand the data processing method provided in the embodiments of the present application, the subsequent embodiments are described in detail by taking the control device implementing the data processing method provided in the present application as an example. The control device can also be called a virtual reality device. The virtual reality device refers to the device obtained by integrating the virtual display device 200 with the data processing device 100. The virtual reality device can be connected to the controller to process data, and can also provide a virtual display interface to display the video screen corresponding to the data.

[0059] An embodiment of the present application provides a data processing method that, in response to a trigger operation on a multi-view video by a first subject, can select a multi-view video. A virtual reality device can display a virtual video space scene corresponding to the multi-view video in response to the trigger operation on the multi-view video by the first subject. The virtual video space scene is a simulated environment generated by the virtual reality device, which can provide the first subject with a simulation of senses such as vision, hearing, and touch, giving the first subject an immersive feeling. The first subject wearing the virtual reality device will feel that they have entered the virtual video space scene. In the first subject's perception, the virtual video space scene is a three-dimensional spatial scene. The virtual reality device will present the virtual video space scene to the first subject from the first subject's perspective. When the first subject moves, the first subject's perspective will also change accordingly. The virtual reality device will obtain the first subject's real-time perspective and present the first subject with the virtual video space scene from the first subject's real-time perspective, thereby allowing the first subject to perceive themselves as walking in the virtual video space scene. In addition, the first subject can interact with the virtual reality device regarding the virtual video space scene.

[0060] Please refer to Figures 2a-2b. Figure 2a is a scene diagram of a scene creation based on virtual reality provided in an embodiment of the present application. The implementation process of the application processing scene can be implemented based on a virtual reality device. As shown in Figure 2a, it is assumed that the first object (for example, object A) is wearing a virtual reality device 21 (that is, the device after the virtual display device 200 and the data processing device 100 described in Figure 1 are integrated) and a virtual reality handle 22 (that is, the controller described in Figure 1). After the virtual reality device 21 responds to the trigger operation of object A for the multi-perspective video, it can enter the virtual video space scene 2000 corresponding to the multi-perspective video. Multi-perspective video can refer to a video with a six-degree-of-freedom (6DOF, Six degrees of freedom tracking) browsing mode. The multi-perspective video can be composed of virtual video pictures under multiple different perspectives. For example, the multi-perspective video can include a target virtual video picture under a target perspective. The target virtual video image can be captured by an image acquisition device (e.g., a camera) from a target perspective. The virtual reality device can output this target virtual video image on a virtual display interface 23 using three-dimensional (3D) display technology, thereby simulating the real-world scene from the target perspective. The simulated real-world scene from the target perspective is the virtual video space scene from the target perspective. As shown in FIG2a , the virtual reality device 21 can display a virtual video image 201 on the virtual display interface 23. In this virtual video image 201, video object B corresponding to character Xiaojia and video object C corresponding to character Xiaoyi are conversing. Virtual video image 201 can be the video image corresponding to virtual video space scene 2000 from a default perspective. The default perspective can be the main lens perspective, i.e., the director's ideal lens perspective. The virtual reality device 21 can present virtual video image 201 to subject A using 3D display technology, and subject A will immersively believe that video objects B and C are standing not far from them, conversing. Object A sees the virtual video space scene 2000 under the default perspective. In Object A's perception, the virtual video space scene 2000 is considered to be a three-dimensional real space scene, and the object can move around freely in the virtual video space scene 2000. Therefore, Object A's viewing perspective of the virtual video space scene 2000 can change as Object A moves around.To immerse subject A in virtual video space scene 2000, virtual reality device 21 obtains subject A's position in virtual video space scene 2000, determines subject A's viewing angle, and then obtains a virtual video image of virtual video space scene 2000 from subject A's viewing angle. This image is then displayed through a virtual display interface, allowing subject A to see virtual video space scene 2000 from its viewing angle. This provides subject A with a sense of immersion, allowing subject A to perceive itself as being in virtual video space scene 2000 and to freely move around and view virtual video space scene 2000 from different viewing angles. Furthermore, in addition to using 3D display technology to achieve visual simulation of subject A, virtual reality device 21 can also generate electronic signals through computer technology and combine them with various output devices to achieve other sensory simulations for subject A. For example, virtual reality device 21 can utilize surround sound technology, simulating the directionality of sound by adjusting parameters such as the volume of different sound channels, thereby providing subject A with a realistic auditory experience. This embodiment of the present application is not limited to this.

[0061] Through the virtual reality device 21, subject A can immerse themselves in the virtual video space scene corresponding to the multi-view video from a first-person perspective and experience the plot of the multi-view video. If subject A has other creative ideas for the plot of the multi-view video, subject A can use the virtual reality device 21 to create scenes in the virtual video space scene 2000 corresponding to the multi-view video, such as dubbing or performing. Subject A can also invite friends to join in the scene creation for the multi-view video. The virtual reality device 21 can also independently display a scene creation bar 24 on the virtual display interface 23. As shown in Figure 2a, subject A can see this scene creation bar 24 floating in front of the subject. The scene creation bar 24 may include a dubbing control 241, a performance control 242, and a subject invitation control 243. Using the virtual reality controller 22, subject A can trigger scene editing operations in the virtual video space scene 2000, that is, triggering operations on a control in the scene creation bar 24. Subject A can then modify the plot of the multi-view video according to their own creative ideas and obtain the created video generated by the modified plot of the multi-view video through the virtual reality device 21. For example, object A can add narration to the multi-perspective video or modify the lines of a certain character by triggering the dubbing control 241, or object A can add a new character to the multi-perspective video or replace a character in the video object by triggering the performance control 242 to create a performance, or object A can invite friends to create a plot for the multi-perspective video by triggering the object invitation control 243. After the virtual reality device 21 responds to the scene editing operation of object A on the virtual video space scene 2000 (i.e., the operation of a certain control in the above-mentioned triggering scene creation bar 24), object A can perform corresponding scene creation in the virtual video space scene 2000, such as dubbing, performance, etc. The virtual reality device 21 will obtain the object data of object A in the virtual video space scene 2000, and then the virtual reality device 21 will fuse the obtained object data with the virtual video space scene 2000 to obtain the created video. The acquisition of object data and the implementation process of object data fusion can be found in the detailed description of the subsequent embodiments.

[0062] Please also refer to Figure 2b, which is a video comparison diagram provided by an embodiment of the present application. As shown in Figure 2b, in the virtual video screen 202 at time A in the multi-perspective video, video object B corresponding to character Xiaojia and video object C corresponding to character Xiaoyi are talking. Assuming that object A really likes video object B and wishes that it were themselves who were talking to video object B at this moment, object A can replace video object C and then play the role of Xiaoyi. Object A can trigger the performance control 242 in the scene shown in Figure 2a above, and then perform their own performance in the virtual video space scene 2000, that is, talk with video object B in the virtual video space scene 2000. The virtual reality device 21 will obtain the object data of object A and virtual reality object B during their conversation. The object data can include data such as object A's skeleton, movements, expressions, image, and position in the virtual video space scene. The virtual reality device 21 can create a video object A with the object data, then cancel the display of video object C in the multi-perspective video, and then merge video object A into the multi-perspective video that has filtered out video object C to obtain the created video. It can be seen from this that after object A's creation in the virtual video space scene 2000, object A becomes the actor of the character Xiao Yi.

[0063] It is understandable that in the specific implementation of this application, the object data involved, when the above embodiments of this application are applied to specific products or technologies, need to obtain user permission or consent, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0064] In an embodiment of the present application, after object A enters the virtual video space scene through a virtual reality device, the virtual reality device can display the virtual video space scene corresponding to the multi-perspective video, allowing object A to immerse in the virtual video space scene, and in response to object A's creative operations on the virtual video space scene, obtain object data such as dubbing and performance performed by object A in the virtual video space scene, and then merge the object data with the virtual video space scene to obtain a creative video, which can efficiently realize object A's secondary creation of the multi-perspective video and enrich the presentation and interaction methods of the multi-perspective video.

[0065] Please refer to Figure 3, which is a schematic flow chart of a data processing method provided in an embodiment of the present application. This data processing method can be executed by a virtual reality device. For ease of understanding, this embodiment of the present application uses the method executed by a virtual reality device as an example. This data processing method may include at least the following steps S101-S103.

[0066] Step S101 : In response to a triggering operation on a multi-view video, a virtual video space scene corresponding to the multi-view video is displayed.

[0067] Multi-view videos can be creative videos such as movies, TV series, and musicals with 6DOF viewing. These videos can include virtual video footage of a real-world scene from at least one specific perspective. The virtual reality device displays a target virtual video footage from a target perspective in 3D on a virtual display interface. The target perspective is determined based on the real-time position and posture of the first subject. For example, if the first subject is currently standing facing south and looking up, the perspective indicated by the first subject standing facing south and looking up is the target perspective. The target perspective can also be determined in response to a perspective selection operation by the first subject. The first subject wearing the virtual reality device can see the virtual video scene from the target perspective. When the virtual reality device switches between displaying virtual video footage from different perspectives through the virtual display interface, the first subject can see the virtual video scene from different perspectives. This virtual video scene is not a real-world scene, but rather a simulation of a real-world scene. The objects, environment, and speech in the virtual video scene can be generated entirely by the virtual reality device, or they can be a combination of virtual and real, meaning that some objects, environment, and speech are generated by the virtual reality device, while others actually exist in the real-world scene where the first subject is located. When a first subject wears a virtual reality device, the device uses computer-generated electronic signals, combined with various output devices, to enter a virtual video space corresponding to the multi-perspective video. The first subject can then see the virtual video space from their own perspective. To the first subject, this virtual video space is no different from the real space; that is, the first subject will believe they are in the real space. For example, in the virtual video space 2000 shown in Figure 2a above, subject A perceives that subject A is located within virtual video space 2000, and can experience the plot of the multi-perspective video from a first-person perspective. It should be noted that while the first subject perceives themselves as being in the virtual video space, what they "see" is the virtual video space from their own perspective. In reality, what they see originates from the virtual video image on the virtual display interface of the virtual reality device.

[0068] A feasible process for shooting and producing multi-view videos involves capturing the real-world environment (i.e., the real-world scene) corresponding to the multi-view video using a panoramic camera to obtain point cloud data for the complete scene. This point cloud data is then used for fitting and modeling, and multi-scene model fusion and optimization is performed based on the fitting and modeling results. Simultaneously, a complete character scan and modeling of the actor is performed in a specially designed studio to create a virtual object (i.e., the corresponding video object). Furthermore, during the multi-view video shooting process, the actor is required to wear green clothing, with markers and capture points attached to their body, and perform in the real-world environment corresponding to the multi-view video. The actor is then fully recorded and captured by a camera system consisting of the film director's main camera and multiple cameras. The captured data from multiple angles is then merged to obtain real-time motion and expression data for each actor. The created video object is then placed into the optimized multi-scene model. The real-time motion and expression data then drives the video object's body structure and expression. Lighting and shadow effects are then added to the modeled real-world environment to produce the final multi-view video. It should be noted that before conducting a complete character scan and complete recording capture of an actor, the actor's permission should be obtained, and the obtained motion data and expression data will only be used to produce multi-perspective videos and will not be used for other purposes such as data analysis.

[0069] Step S102 : In response to a scene editing operation on a virtual video space scene, object data of a first object in the virtual video space scene is acquired.

[0070] The first object refers to the object that initiates the trigger operation for the multi-view video. During the playback of the multi-view video, the first object can trigger the scene editing operation for the virtual video space scene. After the virtual reality device responds to the scene editing operation, it will obtain the object data of the first object when performing scene creation and performance in the virtual video space scene. Scene creation can include dubbing, performance, object invitation, etc. Object data can include voice data, posture data, image data, position data and other data. The voice data corresponds to the voice of the first object, the posture data corresponds to the action form of the first object, the image data corresponds to the appearance of the first object, and the position data corresponds to the position of the first object in the virtual video space scene. One feasible implementation for a virtual reality device to acquire object data is as follows: the virtual reality device may include multiple real-time capture cameras and a recording control. The cameras may capture a first object from different perspectives in real time, obtaining images captured from different perspectives. The virtual reality device may fuse the multiple images and then calculate real-time object data for the first object, including posture data and image data of the first object. The posture data may further include limb skeletal data and expression data of the first object. The virtual reality device may determine the image of a performing object associated with the first object based on the image data, determine the performing object's real-time movements based on the limb skeletal data, and determine the performing object's real-time expressions based on the expression data. The recording control may acquire the first object's voice data in real time. When acquiring the first object's object data, the virtual reality device must obtain authorization from the first object before proceeding. The acquired object data is only used to create a creative video. For example, the voice data in the object data is only used to present the first object's voice in the creative video, the posture data is only used to present the movements and expressions of the video object corresponding to the first object in the creative video, and the image data is only used to present the image and clothing of the video object corresponding to the first object in the creative video. This data is not used for other purposes such as data analysis. The same applies to the object data acquired in subsequent embodiments of this application and will not be repeated here.

[0071] In the perception of the first subject, the first subject is located in the virtual video space scene, and the first subject can perform actions such as walking, talking, laughing, and crying in the virtual video space scene. Therefore, the first subject can experience the scene creation performance of the multi-perspective video plot in the virtual video space scene. Scene creation performance means that the first subject can perform and present a favorite character, that is, replace the video object corresponding to the character in the virtual video space scene to perform lines, actions, and expressions, and promote the plot together with other video objects in the virtual video space scene, or interact with other video objects of interest in the plot; the first subject can also perform in the virtual video space scene as a newly added character; the first subject can also invite the second subject to perform together in the virtual video space scene.

[0072] In response to a scene editing operation for dubbing, the virtual reality device acquires the first subject's voice data as object data. For example, in the scenario shown in FIG. 2a , after subject A (the first subject) triggers dubbing control 271, the virtual reality device 21 acquires the voice data corresponding to the voice spoken by subject A in virtual video space scene 2000. In response to a scene editing operation for performance, the virtual reality device may acquire the first subject's posture data and image data as object data. For example, in the scenario shown in FIG. 2a , after subject A triggers performance control 272, the virtual reality device 21 acquires the posture data corresponding to subject A's movement form in virtual video space scene 2000, as well as the image data corresponding to subject A's object image. In response to a scene editing operation for subject invitation, the virtual reality device can change the secondary creation of multi-view videos from single-person creation to multi-person collaborative creation. In other words, the first subject and the second subject invited by the first subject can enter the virtual video space scene corresponding to the same multi-view video. At this point, the virtual reality device acquires the object data of the first subject performing the scene creation and performance in the virtual video space scene, and also acquires the target object data of the second subject performing the scene creation and performance in the virtual video space scene. The first subject can simultaneously perform dubbing and performance scene creation, and at this time the virtual reality device can simultaneously obtain the voice data, posture data and image data of the first subject as object data.

[0073] A feasible implementation process for a virtual reality device to obtain object data of a first object in a virtual video space scene in response to a scene editing operation on a virtual video space scene may be as follows: the virtual reality device responds to the first object's scene editing operation on the virtual video space scene, and then displays a video clip input control for the virtual video space scene on a virtual display interface; the virtual reality device may respond to an input operation on the video clip input control, obtain the inputted clip progress information for the multi-view video, and use the video clip indicated by the clip progress information as the video clip to be created; and the virtual reality device may obtain object data of the first object in the virtual video space scene during the process of playing the video clip to be created. Through the embodiment of the present application, the video clip to be created can be directly obtained, so that the video clip to be created can be directly created later, which can save the waiting time of the first object waiting for the video clip to be played, thereby improving the efficiency of human-computer interaction.

[0074] The first subject can select a video clip from the multi-view video as the video clip to be created, and then perform only for the video clip to be created. For example, if the multi-view video plays for two hours, and the character the first subject wants to replace only appears between the 50th and 55th minutes of the multi-view video, if the virtual reality device plays the multi-view video, the first subject will have to wait 50 minutes before performing. Therefore, the first subject can select the video clip between the 50th and 55th minutes as the video clip to be created. The virtual reality device will then directly play the video clip to be created, and the first subject can perform the character they want to replace in the virtual video space. The virtual reality device will then obtain the subject data of the first subject's performance. The real-world scenes corresponding to different playback times of the multi-view video can be different. For example, if the multi-view video plays at the 10th minute, the corresponding real-world scene is subject D sleeping, while the multi-view video plays at the 20th minute, the corresponding real-world scene is subject D singing. The virtual video space scene perceived by the first object will change based on the real space scene corresponding to the multi-perspective video playback time. Therefore, when the multi-perspective video is played at the tenth minute, the video object D (video object D is generated based on object D) in the virtual video space scene perceived by object A is sleeping. When the multi-perspective video is played at the twentieth minute, the video object D in the virtual video space scene perceived by object A is singing.

[0075] During playback of the video clip to be created, the virtual reality device may display a playback progress control bar on the virtual display interface. The playback progress control bar may include a pause control, a start control, and a multiplier control. In response to a trigger operation on the pause control, the virtual reality device will pause playback of the video clip to be created. In response to a trigger operation on the start control, the virtual reality device will continue playback of the video clip to be created. In response to a selection operation on the multiplier control, the virtual reality device will adjust the playback speed of the video clip to be created according to the selected playback multiplier. Through the embodiments of the present application, the video clip to be created can be paused, continued, and played at a variable speed, and the video clip to be created can be flexibly adjusted to meet the performance requirements of the first subject in real time.

[0076] Step S103: Play the creative video associated with the multi-view video in the virtual display interface.

[0077] The creative video is obtained by editing and processing the virtual video space scene based on object data.

[0078] When the object data is acquired, the virtual reality device can fuse the object data with the virtual video space scene to create a creative video. When the object data is voice data acquired by the virtual reality device in response to a scene editing operation for dubbing, the virtual reality device can, based on the scene editing operation for the first object, use the voice data to replace the video and voice data of a video object in the virtual video space scene, or superimpose the voice data into the virtual video space scene. When the object data is posture data and image data acquired by the virtual reality device in response to a scene editing operation for a performance, the virtual reality device can generate a performance object with the posture data and image data, use the performance object to replace a video object in the virtual video space scene, or directly add the performance object to the virtual video space scene. When the object data is object data acquired by the virtual reality device in response to a scene editing operation for an object invitation, and the virtual reality device acquires the target object data of the second object invited by the first object, the virtual reality device will fuse the object data and the target object data into the virtual video space scene.

[0079] A video creation can have two data forms. One is a video format, such as a Moving Picture Experts Group 4 (MP4) file. This video can be played not only in VR devices but also on other devices with video playback capabilities. The other is a recording file of the virtual video space scene. This recording file is a file in a specific format and contains all the data recorded. The first subject can open this file in an editor and browse and edit the digital scene on a computer. The digital scene contains the virtual video space scene that the first subject wishes to preserve and the performance object with object data. Browsing and editing the digital scene on a computer is similar to real-time editing in a game engine. In the editor, users can manipulate the overall content with speed, sound, lighting, image, filters, and special stylization. They can also beautify and process the video object or performance object corresponding to the character, and add preset special effects and props to the performance. The result is a new video creation. The first subject can save the creation video locally or in the cloud, or send it to other subjects through VR social applications, non-VR social applications, social short video applications, and so on.

[0080] In an embodiment of the present application, a first object can perceive itself as being in a virtual video space scene corresponding to a multi-perspective video through a virtual reality device. The virtual video space scene is a simulation of the real space scene corresponding to the multi-perspective video. The first object is located in the virtual video space scene corresponding to the multi-perspective video and can feel the emotional expression of the characters in the multi-perspective video from the first perspective, and deeply experience the plot. The first object can also create scenes in the virtual video space scene. The virtual reality device will obtain the object data of the first object when creating the scene, and then merge the object data with the virtual video space scene to obtain the created video. This shows that the first object can break through physical limitations and does not need to spend time and money to arrange the real space scene corresponding to the multi-perspective video. Secondary creation of the multi-perspective video can be performed in the virtual video space scene corresponding to the real space scene, enriching the presentation and interaction methods of the multi-perspective video, while avoiding the time and money spent on arranging the real space scene corresponding to the multi-perspective video, saving creation costs.

[0081] To better understand the process of obtaining the voice data of the first object as object data and creating a video based on the object data when the virtual reality device responds to the scene editing operation for dubbing in Figure 3 above, please refer to Figure 4, which is a flow chart of a data processing method for dubbing based on virtual reality provided in an embodiment of the present application. The data processing method can be executed by a virtual reality device. For ease of understanding, the embodiment of the present application is described by taking the method executed by a virtual reality device as an example. The data processing method may include at least the following steps S201-S203:

[0082] Step S201 : In response to a triggering operation on a multi-view video, a virtual video space scene corresponding to the multi-view video is displayed.

[0083] The implementation of step S201 may refer to step S101 in the embodiment corresponding to FIG. 3 .

[0084] In some embodiments, the scene editing operation includes triggering a voiceover control in a virtual display interface. In step 102, in response to the scene editing operation on the virtual video space scene, object data of a first object in the virtual video space scene is obtained. This can be achieved by playing a multi-view video, and in response to the triggering operation on the voiceover control in the virtual display interface, obtaining voice data of the first object in the virtual video space scene, and determining the voice data of the first object as object data to be applied to the multi-view video. In embodiments of the present application, the voice data of the first object can be obtained as object data by triggering the voiceover control, thereby efficiently obtaining object data and improving human-computer interaction efficiency.

[0085] The voice data of the first object includes at least one of the following: object voice data, background voice data. The above-mentioned response to the triggering operation of the dubbing control in the virtual display interface, obtaining the voice data of the first object in the virtual video space scene, and determining the voice data of the first object as the object data applied to the multi-view video can be achieved through the following steps S202 to S204, and step 206.

[0086] Step S202 : Displaying a dubbing mode list in response to a triggering operation on a dubbing control in the virtual display interface.

[0087] The dubbing mode list includes object dubbing controls and background dubbing controls.

[0088] The virtual reality device can independently display a dubbing control on the virtual display interface, such as the dubbing control 241 shown in FIG2 a. At this time, the scene editing operation for dubbing can be a triggering operation for the dubbing control 241.

[0089] The object dubbing control and the background dubbing control correspond to two dubbing modes respectively. The object dubbing control corresponds to the object dubbing mode. At this time, the first object can dub at least one dubable video object in the multi-view video, that is, the voice of the first object can replace the original sound of the dubable video object; the background dubbing control corresponds to the background dubbing mode. The first object can dub the entire multi-view video, that is, when the original character voice and background sound exist at the same time in the multi-view video, the virtual reality device can record the additional sound of the first object and use the recorded additional sound of the first object as narration, sound effect, etc.

[0090] Please also refer to Figure 5a, which is a schematic diagram of a scene displaying a dubbing mode list provided in an embodiment of the present application. Based on the scene shown in Figure 2a above, in response to the triggering operation of the dubbing control 241 selected by the subject A through the virtual reality handle 22, the virtual reality device 21 can respond to the triggering operation of the dubbing control 241 by displaying the dubbing mode list 51 on the virtual display interface 23. The dubbing mode list 51 can include an object dubbing control 511 and a background dubbing control 512. The dubbing mode list 51 can be displayed independently on the virtual video screen 500. The virtual video screen 500 is used to present the virtual video space scene from the perspective of the subject A.

[0091] Step S203: in response to the selection operation on the object dubbing control, display the video object that can be dubbed; in response to the selection operation on the video object that can be dubbed, use the selected video object that can be dubbed as the object to be dubbed.

[0092] Dubbing-capable video objects are video objects presented in multi-view videos.

[0093] The virtual reality device may select only the video object currently displayed in the virtual display interface as a dubbing-capable video object, or may select all video objects presented in the multi-view video as dubbing-capable video objects. The first subject may select one or more video objects from the dubbing-capable video objects as dubbing-capable objects, and the virtual reality device may highlight the dubbing-capable objects.

[0094] The example of a virtual reality device treating the video object currently displayed in the virtual display interface as a dubbing video object is used for explanation. Please refer to Figure 5b, which is a schematic diagram of a scene of displaying a dubbing video object provided by an embodiment of the present application. Based on the scene shown in Figure 5a above, after the virtual reality device 21 responds to the triggering operation of the object dubbing control 511 by object A, the video object B and video object C displayed in the current virtual display interface 23 can be treated as dubbing video objects, and the dubbing video objects are highlighted. As shown in Figure 5b, the virtual reality device 21 can highlight the video object B through the dotted box 521 in the virtual display interface 23, and highlight the video object C through the dotted box 522. At this point, object A can know that video object B and video object C are dubbing video objects, and then determine the object to be dubbed through the virtual reality handle 22.

[0095] Step S204: During the playback of the multi-view video, object voice data of the first object is obtained based on the object to be dubbed.

[0096] Through the above steps S202 to S204, the object voice data can be flexibly acquired, and the object voice data can be determined as object data according to user needs, thereby improving the efficiency of human-computer interaction in the voice dimension.

[0097] In the process of playing a multi-perspective video, the process of obtaining the object voice data of the first object based on the object to be dubbed can be as follows: in the process of playing a multi-perspective video, the virtual reality device mutes the video voice data corresponding to the object to be dubbed; when the object to be dubbed is in a vocal state, the virtual reality device displays the text information and audio track information corresponding to the video voice data, obtains the object voice data of the first object, and then determines the object voice data as the object data. The text information and audio track information can be used to prompt the first object, the original voice of the object to be dubbed, and the sound intensity. The vocal state refers to the state in which the object to be dubbed speaks in the multi-perspective video. Through the embodiment of the present application, the user can be assisted in dubbing through text information and audio track information, and because the object to be dubbed is in a vocal state, it can be ensured that the voice data is consistent with the picture, thereby improving the success rate of dubbing, thereby avoiding repeated acquisition of object voice data, and improving resource utilization and human-computer interaction efficiency.

[0098] Please also refer to Figure 5c, which is a schematic diagram of a scene for object dubbing provided by an embodiment of the present application. Based on the scenario shown in Figure 5b above, subject A can select a video object that can be dubbed using the virtual reality controller 22. Assuming subject A selects video object C as the object to be dubbed, the virtual reality device can continue to highlight the dubbing object, that is, video object C, through the dotted box 522 during the playback of the multi-view video, and mute the video and audio data corresponding to video object C. In this way, when video object C is in a sounding state, subject A cannot hear the original sound of video object C. When video object C is in a sounding state, the virtual reality device 21 can also display prompt information 53 corresponding to the video and audio data of video object C. Prompt information 53 includes text information and audio track information. Based on the displayed prompt information 53, subject A can know that video object C should be dubbed at this time. The virtual reality device will also collect subject A's voice when displaying prompt information 53 to obtain subject A's object voice data.

[0099] Step S205: In the multi-view video, the object voice data is used to replace the video voice data corresponding to the object to be dubbed in the multi-view video to obtain a creative video.

[0100] After the virtual reality device replaces the video voice data of the object to be dubbed with the object voice data of the first object in the multi-perspective video, it can obtain a creative video after the first object dubs the multi-perspective video. In the creative video, when the video object to be dubbed is in a sounding state, the voice corresponding to the object voice data of the first object will be played.

[0101] Step S206 , in response to a selection operation on a background dubbing control, during the playback of the multi-view video, background voice data of the first object is acquired, and the background voice data is determined as object data.

[0102] Through the above step S206, background voice data can be flexibly obtained, and the background voice data can be determined as object data according to user needs, thereby improving the efficiency of human-computer interaction in the voice dimension.

[0103] Specifically, taking FIG. 5 a as an example, when object A wants to perform background dubbing, object A can trigger the background dubbing control 512 , and then the virtual reality device 21 will obtain the background voice data corresponding to the voice of object A during the process of playing the multi-view video.

[0104] Step S207: In the multi-view video, the background voice data is superimposed on the multi-view video to obtain a creative video.

[0105] The virtual reality device can add the voice of object A into the multi-view video based on the background voice data to obtain the creative video.

[0106] By using the data processing method provided in the embodiment of the present application, the first object can dub the characters in the multi-perspective video, or add background sound and narration in the virtual video space scene corresponding to the multi-perspective video to obtain a creative video. Through low data processing resources, the audience can be lightweight integrated into the video content, thereby improving the efficiency of human-computer interaction and enriching the video presentation and interaction methods.

[0107] To better understand how the virtual reality device of FIG. 3 responds to a scene editing operation for a performance, obtains the posture data and image data of the first object as object data, and then creates a video based on the object data, please refer to FIG. 6 , which is a flow chart of a data processing method for a virtual reality-based performance provided in an embodiment of the present application. This data processing method can be executed by a virtual reality device. For ease of understanding, this embodiment of the present application uses the method executed by a virtual reality device as an example. This data processing method can include at least the following steps S301-S303.

[0108] Step S301 : In response to a triggering operation on a multi-view video, a virtual video space scene corresponding to the multi-view video is displayed.

[0109] Specifically, the implementation of step S301 may refer to step S101 in the embodiment corresponding to FIG. 3 .

[0110] In some embodiments, the scene editing operation includes a triggering operation for a performance control in a virtual display interface. In step 102, in response to the scene editing operation for the virtual video space scene, object data of the first object in the virtual video space scene is obtained. This can be achieved by the following technical solutions: playing a multi-perspective video, in response to a triggering operation for a performance control in the virtual display interface, obtaining posture data and image data of the first object in the virtual video space scene, determining the posture data and image data as object data applied to the multi-perspective video, and including a performance object associated with the first object in the creative video. The performance object in the creative video is presented based on the posture data and image data. The embodiment of the present application can obtain the voice data of the first object as object data by triggering the performance control, thereby efficiently obtaining object data and improving the efficiency of human-computer interaction.

[0111] The above-mentioned response to the triggering operation of the performance control in the virtual display interface, obtaining the posture data and image data of the first object in the virtual video space scene, and determining the posture data and image data as object data can be achieved through the following steps S302 to S304, and step 306.

[0112] Step S302: Displaying a performance mode list in response to a triggering operation on a performance control in the virtual display interface.

[0113] The Performance Mode list includes character replacement controls and character creation controls.

[0114] For a plot presented in a multi-perspective video, the first subject can perform in the virtual video space corresponding to the multi-perspective video based on their own creative ideas, resulting in a creative video of themselves performing the plot in the multi-perspective video. The virtual reality device can independently display performance controls on the virtual display interface, such as performance control 242 shown in Figure 2b above. In this case, scene editing operations for the performance can be triggered by the performance controls in the virtual display interface.

[0115] The character replacement control and the character creation control correspond to two performance modes respectively. The character replacement control corresponds to the character replacement mode. At this time, the first object can choose to replace the video object corresponding to any character in the multi-perspective video to perform the role; the character creation control corresponds to the character creation mode. At this time, the first object can add a new character to the virtual video space scene corresponding to the multi-perspective video at the target moment to perform. The character can be a character that has appeared in the virtual video space scene corresponding to the multi-perspective video at other moments, or it can be a brand new character customized by the first object.

[0116] Please also refer to Figure 7a, which is a schematic diagram of a performance mode list display scenario provided by an embodiment of the present application. Based on the scenario shown in Figure 2a above, assuming that subject A selects performance control 242 via virtual reality controller 22, virtual reality device 21 can respond to the triggering operation on performance control 242 by displaying performance mode list 71 on virtual display interface 23. This performance mode list 71 can include character replacement control 711 and character creation control 712. Dubbing mode list 51 can be independently displayed on virtual video screen 700. Virtual video screen 700 is used to present the virtual video space scene from subject A's perspective.

[0117] Step S303: in response to a triggering operation on the role replacement control, displaying a replaceable video object; in response to a selection operation on the replaceable video object, using the selected replaceable video object as a role replacement object.

[0118] Replaceable video objects are video objects presented in a multi-view video.

[0119] In response to a trigger operation on a character replacement control, a virtual reality device displays a replaceable video object. In response to a selection operation on the replaceable video object, a feasible implementation process of using the selected replaceable video object as a character replacement object may be: in response to a trigger operation on a character replacement control, the virtual reality device determines the video object currently displayed in the object virtual video screen as a replaceable video object. In response to a marking operation on the replaceable video object, the marked replaceable video object is displayed according to a first display mode, wherein the first display mode is different from the display mode of other video objects other than the replaceable video object. The first display mode may be a highlighting mode, such as adding a filter to the marked replaceable video object, etc., and using the marked replaceable video object as a character replacement object. The object virtual video screen is used to present a virtual video space scene under the current perspective. Through the embodiment of the present application, the marked replaceable video object can be highlighted, thereby serving as a prompt during the user's performance and improving the efficiency of human-computer interaction.

[0120] Please also refer to Figure 7b, which is a schematic diagram of a scene for selecting a replaceable video object provided by an embodiment of the present application. Based on the scene shown in Figure 7a above, assuming that object A triggers the character replacement control 711 through the virtual reality handle 22, the virtual reality device 21 will use the video object currently displayed in the virtual video screen 700 (i.e., the above-mentioned object virtual video screen) as a replaceable video object. As shown in Figure 7b, video object B and video object C will be used as replaceable video objects. The virtual reality device 21 can highlight the replaceable video objects. For example, the virtual reality device 21 can highlight video object B through a dotted box 721 in the virtual display interface 23 and highlight video object C through a dotted box 722. At this point, object A can know that video object B and video object C are replaceable video objects. Object A can mark the replaceable video object through the virtual reality handle 22. Assuming that object A marks the video object C, the virtual reality device 21 will highlight the marked video object C in a new way, for example, by replacing the dotted box 722 with the solid box 723 to highlight the video object C. Then the virtual reality device 21 will use the video object C as the character replacement object. The virtual reality device 21 can then turn off the highlighting and cancel the display of the video object C in the virtual display interface 23. As shown in Figure 7b, the virtual reality device 21 will switch the virtual video screen 700 containing the video object C to a virtual video screen 701 that does not contain the video object C.

[0121] In response to a trigger operation on a character replacement control, a virtual reality device displays a replaceable video object, and in response to a selection operation on the replaceable video object, a feasible implementation process of using the selected replaceable video object as the character replacement object can be: in response to a trigger operation on the character replacement control, the virtual reality device displays at least one video clip corresponding to the multi-view video, in response to a selection operation on at least one video clip, displays the video object contained in the selected video clip, determines the video object contained in the selected video clip as the replaceable video object, and in response to a marking operation on the replaceable video object, displays the marked replaceable video object in a first display mode, wherein the first display mode is different from the display mode of other video objects other than the replaceable video object, and the first display mode can be a highlighting mode, such as adding a filter to the marked replaceable video object, and using the marked replaceable video object as the character replacement object. Through the embodiments of the present application, the marked replaceable video object can be highlighted, thereby serving as a prompt during the user's performance and improving the efficiency of human-computer interaction.

[0122] Please also refer to Figure 7c, which is a schematic diagram of another scenario for selecting replaceable video objects provided by an embodiment of the present application. Based on the scenario shown in Figure 7a above, assuming that object A triggers the character replacement control 711 through the virtual reality handle 22, the virtual reality device can display at least one video clip corresponding to the multi-perspective video. As shown in Figure 7c, after the virtual reality device 21 responds to the triggering operation on the character replacement control 711, video clips 731, 732, and 733 are displayed. Video clips 731, 732, and 733 all belong to the multi-perspective video. Video clip 731 contains video objects B and C, video clip 732 contains video object D, and video clip 733 contains video object E. The virtual reality device 21 can highlight the selected video clip with a black border. As shown in Figure 7c, subject A has selected video clips 731 and 732. After subject A completes the selection, the virtual reality device 21 selects video objects B, C, and D as replaceable video objects and then displays the replaceable video objects. Subject A can then select at least one of the replaceable video objects as a character replacement object. As shown in Figure 7c, subject A can mark the replaceable video objects using the virtual reality controller 22. Assuming subject A marks video object B, the virtual reality device 21 will highlight the marked video object B, for example, by circling video object B with a solid-line frame 724. Once subject A confirms the marking is complete, the virtual reality device 21 will mark video object B as the character replacement object. The virtual reality device 21 can then turn off the highlighting and remove video object B from the virtual display interface 23. As shown in Figure 7c, the virtual reality device 21 will switch the virtual video screen 700 to a virtual video screen 702 that does not contain video object B.

[0123] Step S304 : During the playback of the multi-view video, the posture data and image data of the first object are obtained based on the character replacement object, and the posture data and image data are determined as object data.

[0124] After the first subject determines the role replacement object, the virtual reality device can cancel the display of the role replacement object. Therefore, the role replacement object will no longer appear in the virtual video space scene perceived by the first subject, but other space scenes, that is, other video objects, props, backgrounds, etc. still exist. It can be seen that if the first subject wants to perform the role corresponding to the role replacement object, there is no need to actually arrange the real space scene corresponding to the multi-perspective video. The first subject can perform in the perceived virtual video space scene, and the virtual reality device can capture the posture data and image data of the first subject.

[0125] Please also refer to Figure 7d, which is a schematic diagram of a scene of an object performance based on virtual reality provided by an embodiment of the present application. Based on the scene shown in Figure 7b above, the virtual reality device 21 displays a virtual video screen 701 that does not include video object C in the virtual display interface. At this moment, the virtual video space scene perceived by object A is shown in Figure 7d, and object A will believe that it is in the virtual video space scene 7000. As can be seen from the above, the virtual video space scene 7000 is a three-dimensional spatial scene in the cognition of object A. However, object A can only see the virtual video space scene 7000 from the perspective corresponding to the virtual video screen 701. Taking video object B as an example, the virtual video screen 701 only shows the front of video object B, and object A can only see the front of video object B. Object A will believe that video object B is standing in front of itself and facing itself. Because when object A moves, the virtual reality device 21 will constantly obtain the virtual video screen from the perspective of object A and display it in the virtual display interface, so that object A can always see the virtual video space scene 7000 from the perspective it is in. Therefore, in the perception of object A, he can move around freely in the virtual video space scene 7000 and can naturally perform accordingly in the virtual video space scene 7000. When object A performs, the posture data and image data of object A will be acquired by the virtual reality device 21.

[0126] In the process of obtaining the posture data and image data of the first object, the virtual reality device can display a replacement transparency input control for the character replacement object in the virtual display interface. Then, the virtual reality device can respond to the input operation on the transparency input control, obtain the input transparency information for the character replacement object, update the transparency of the character replacement object in the virtual display interface according to the transparency information, and display the position cursor of the character replacement object after the transparency is updated in the virtual video space scene.

[0127] In the virtual video space scene 7000 shown in FIG7d above, object A cannot see video object C and can freely express itself. However, if object A wishes to imitate the movements of video object C, object A can input transparency information for the character replacement object using the replacement transparency input control 741, for example, 60% transparency. In this case, the virtual reality device 21 can redisplay video object C at 60% transparency in the virtual display interface 23 and display a position cursor in the virtual display interface. This position cursor is used to indicate to object A the position of video object C in the virtual video space scene 7000. For easier understanding, please also refer to FIG7e, which is a schematic diagram of a scene of transparent display of objects based on virtual reality provided by an embodiment of the present application. As shown in FIG7e, after the virtual reality device 21 obtains the transparency information in response to the input operation of the replacement transparency input control 741, it can switch the virtual video screen 701 that does not contain video object C to a virtual video screen 703 that contains video object C at 60% transparency in the virtual display interface 23, and display a position cursor 74 in the virtual video screen 703. At this point, subject A can see video object C with 60% transparency appearing in front of them in the perceived virtual video space scene 7000. Position cursor 742 is displayed beneath the feet of video object C with 60% transparency. Using position cursor 742, subject A can determine the position of character Xiao Yi, corresponding to video object C, in virtual video space scene 7000. At the same time, subject A can imitate the body shape, movements, and performance rhythm of video object C with 60% transparency to play the role of Xiao Yi. It should be noted that video object C with 60% transparency does not appear in the created video.

[0128] Through the above steps S302 to S304, the posture data and image data applied to the character replacement object can be flexibly obtained, thereby improving the human-computer interaction efficiency in the image dimension.

[0129] Step S305, cancel the display of the character replacement object in the performance perspective video, integrate the performance object that meets the performance object data into the performance perspective video, and obtain the creative video.

[0130] The performance perspective video is obtained by shooting the virtual video space scene through the performance perspective after the performance control is triggered and the multi-perspective video is played; the performance object data refers to the data presented by the object data under the performance perspective.

[0131] The creative video includes a performance object associated with the first object, and the performance object in the creative video is presented based on the posture data and image data in the object data.

[0132] When playing a multi-perspective video through a virtual reality device, the virtual video space scene corresponding to the multi-perspective video can be viewed from different perspectives, and the first subject can freely move around in the virtual video space scene to adjust the viewing angle of the virtual video space scene according to their preferences. However, for terminal devices (e.g., mobile phones, tablets, computers, etc.) that only have a single-perspective video playback function, when playing a certain video, only the video image of the corresponding real spatial scene from a certain perspective can be presented at any time. Therefore, when playing a multi-perspective video through a terminal device, the terminal device can only display the video image of the real spatial scene corresponding to the target multi-perspective from the perspective of the main lens. The main lens perspective can also be called the director's perspective, that is, the director's original film focus lens. When the first subject creates a scene for the multi-perspective video in the virtual video space scene, it can also set a single perspective for the created video when the terminal device plays it, namely the performance perspective. After the first subject triggers the performance control and the multi-perspective video is not playing, the virtual reality device can display a virtual camera control on the virtual display interface. In response to the first subject's creation operation on the virtual camera control, the virtual reality device can create a virtual camera from the performance perspective of the virtual video space scene. The virtual camera can be used to output the video image corresponding to the virtual video space scene from the performance perspective. After triggering the performance control and while playing a multi-view video, the virtual reality device can capture and record the virtual video space scene using a virtual camera, obtaining a performance perspective video corresponding to the virtual video space scene from the performance perspective. The virtual reality device can then remove the character replacement object from the performance perspective video. Simultaneously, the virtual reality device can obtain the object data presented from the performance perspective, namely, performance object data. This performance data is used to present the performance object associated with the first object from the performance perspective. During the multi-view video playback, the virtual camera can be moved, meaning that the performance perspective can change. For example, the performance perspective corresponding to the video output by the virtual camera at time A can differ from the performance perspective corresponding to the video output by the virtual camera at time B. The virtual reality device can create at least one virtual camera in the virtual video space scene. Each virtual camera can have a different performance perspective at the same time, and each virtual camera can capture and record a performance perspective video. In other words, the virtual reality device can simultaneously obtain at least one performance perspective video, and each performance perspective video can have a different performance perspective. The scene diagram of the virtual reality device capturing the virtual video space scene using a virtual camera can be seen in the subsequent scene diagram shown in FIG11c.

[0133] The position of the virtual camera in the virtual video space scene determines the performance perspective. The methods for determining the position of the virtual camera can include following the lens, shooting in situ, and free movement. Among them, following the lens means that the perspective of the virtual camera will follow the director's original movie focus lens perspective, so the position of the virtual camera in the virtual video space scene will follow the position of the director's lens in the real space scene. Shooting in situ means that during the playback of multi-perspective videos, the virtual camera will shoot and record at a fixed position in the virtual video space scene, and the position of the virtual camera will not change. The fixed position can be selected by the first object. Free movement means that during the playback of multi-perspective videos, the first object can adjust the position of the virtual camera at any time to change the shooting perspective.

[0134] Step S306 , in response to a triggering operation on the character creation control, during the playback of the multi-view video, obtaining posture data and image data of the first object, and determining the posture data and image data as object data.

[0135] After the virtual reality device responds to the character creation control, it does not need to perform other processing on the video objects in the virtual video space scene corresponding to the multi-view video. It can directly obtain the posture data and image data of the first object as object data during the playback of the multi-view video.

[0136] Step S307: Integrate the performance object that matches the performance object data into the performance perspective video to obtain a creative video.

[0137] The performance perspective video is the video obtained by shooting the virtual video space scene with the virtual camera in step S305. The virtual reality device does not need to process other video objects in the performance perspective video, and can simply integrate the performance object with performance object data into the performance perspective video.

[0138] As an example, while acquiring the posture and image data of a first subject, the virtual reality device may display a mirror preview control in a virtual display interface. In response to a triggering operation on the mirror preview control, the virtual reality device may display a virtual video of the performance in a performance preview area of ​​the virtual display interface. The virtual video of the performance includes the performance object integrated into the virtual video space scene. Through embodiments of the present application, the first subject can adjust their performance by viewing the virtual video of the performance, avoiding the first subject from having to make multiple revisions due to performance errors, thereby improving the efficiency of human-computer interaction.

[0139] Please also refer to Figure 7f, which is a scene diagram of a mirror preview based on virtual reality provided by an embodiment of the present application. Based on the virtual reality scene shown in Figure 7d above, object A can play the role corresponding to video object C in a virtual video space scene 7000 that does not contain video object C. Assuming that object A walks to the position of video object C in the virtual video space scene 7000, that is, next to video object B, the virtual video space scene 7000 from the perspective of object A is presented through the virtual video screen 704 displayed in the virtual display interface, as shown in Figure 7f. At this time, object A is facing forward and cannot see video object B. Object A cannot see his own performance in the virtual video space scene 2000, and therefore does not know whether the generated creative video can achieve his expected effect. Therefore, while acquiring the posture and image data of subject A, the virtual reality device 21 may display a mirror preview control 75 in the virtual display interface 23. When subject A triggers the mirror preview control 75 via the virtual reality controller 22, the virtual reality device 21 may display a performance virtual video frame 705 in the performance preview area 76 of the virtual display interface 23. Performance virtual video frame 705 is a mirror image of the virtual video space scene 7000 excluding video object C and object A from subject A's perspective. Performance object A is generated based on the posture and image data of subject A. For example, the virtual reality device may also display a performance virtual video frame 706 in the comparison area 77. Performance virtual video frame 706 is a mirror image of the virtual video space scene 7000 containing video object C from subject A's perspective. Subject A can adjust his or her performance by viewing performance virtual video frames 705 and 706.

[0140] As an example, a virtual reality device can display an image customization list in a virtual display interface; in response to completing the configuration operation for the image customization list, the image data is updated according to the configured image data to obtain the configured image data. The configured image data includes clothing data, body shape data, sound data, and appearance data; then the virtual reality device can display the performance object in the creation video with performance actions and performance images. Among them, the performance action is determined based on the posture data of the first object; the performance image is determined based on at least one of the clothing data, body shape data, sound data, and appearance data. Through the embodiment of the present application, it is possible to achieve the first object to customize the image of the performance object corresponding to the target performance role in the multi-perspective video, thereby improving the simulation degree of the performance object, effectively improving the success rate of creation, and thus improving the efficiency of human-computer interaction.

[0141] Clothing data is used to represent the subject's clothing. For example, the subject presented based on clothing data can be wearing a short-sleeved shirt, a shirt, long pants, or a dress. Body shape data is used to represent the subject's body shape. For example, the subject presented based on body shape data can have a large head and a small body, a small head and a large body, tall and thin, or short and fat. Voice data is used to represent the subject's voice. For example, the subject presented based on voice data can have a child's voice or a young person's voice. Appearance data is used to represent the subject's appearance. The first subject can customize the performance image of the subject associated with them in the created video.

[0142] The image customization list includes a first image customization list and a second image customization list. The first image customization list can include character images, object images, and custom images. The character image is the image of the video object corresponding to the character, the object image is the image of the first object, and the custom image is a generic image provided by the virtual reality device. The second image customization list can also include object images and custom images. When the first subject is performing as a target performance character that has already appeared in the multi-view video, the first subject can use the first image customization list to select a performance image that completely or partially replaces the image of the video object corresponding to the target performance character, such as clothing, body shape, appearance, and voice. The target performance character can be the character that the first subject wants to replace in the virtual video space corresponding to the target playback time of the multi-view video, or a character that the first subject wants to create that does not appear at the target playback time. When the first subject is performing as a newly added character, that is, a character that has not appeared in the multi-view video, the first subject can also use the image customization list to customize the clothing, body shape, appearance, and voice of the performance object corresponding to the newly added character, but there is no character image option.

[0143] To facilitate understanding of the process of customizing the image of the first object for the target performance character corresponding to the multi-view video, the target performance character is Xiao Yi. Please also refer to Figure 7g, which is a schematic diagram of a first image customization list provided in an embodiment of the present application. In the scenario of replaceable video object selection shown in Figure 7b above, after the virtual reality device 21 determines that the video object C corresponding to the character Xiao Yi is the character replacement object, and before the virtual reality device 21 switches the virtual video screen 700 containing the video object C to the virtual video screen 701 without the video object C, the virtual reality device 21 may first switch the virtual video screen 700 to display the image customization interface 707 for the character Xiao Yi. As shown in Figure 7g, the image customization interface 707 includes a first image customization list 78 and an image preview area 79. The image preview area 79 displays a preview performance object 710. The initial image of the preview performance object 710 can be consistent with the image of the video object C or the image of the object A. Subject A can then adjust the image of preview performance object 710 based on first image customization list 78. Once Subject A completes the configuration operations for first image customization list 78, the image of preview performance object 710 will serve as the performance image for the performance object corresponding to character Xiao Yi in the created video. As shown in Figure 7g, first image customization list 78 includes clothing controls 781, body shape controls 782, appearance controls 783, and voice controls 784. After Subject A triggers clothing controls 781 using the virtual reality controller 22, Subject A can select "Character Costume," in which case the costume of preview performance object 710 will be displayed as that of video object C, corresponding to character Xiao Yi. Subject A can also select "Real Person Costume," in which case the costume of preview performance object 710 will be displayed as that of Subject A herself. Subject A can also select "Customize," choosing from a variety of preset costumes, in which case the costume of preview performance object 710 will be displayed as the preset costume selected by Subject A. Subject A can freely combine these costumes, selecting "Character Costume" for some, "Real Person Costume" for others, and "Customize" for others. After subject A triggers clothing control 782 via virtual reality controller 22, subject A can select "Character Body Type," in which case the preview performance object 710 will be displayed as the body type of video subject C. Subject A can also select "Real Person Body Type," in which case the preview performance object 710 will be displayed as subject A's own body type. Subject A can also select "Custom," choosing from a variety of preset body types, in which case the preview performance object 710 will be displayed as the preset body type selected by subject A. Subject A can adjust their body type, either partially or completely, and their height based on the selected body type. The virtual reality device 21 can also provide a recommended body type suitable for character Xiao Yi.After subject A triggers appearance control 783 via the virtual reality controller 22, subject A can select "Character Appearance," in which case the preview of performance object 710 will display the facial features of video subject C. Subject A can also select "Real Person Appearance," in which case the preview of performance object 710 will display the facial features of subject A himself. Subject A can also select "Custom," selecting a combination of preset features such as "face shape, eyes, nose, mouth, ears, etc.", in which case the preview of performance object 710 will display the combined facial features selected by subject A. Subject A can also adjust the appearance selected in the "Real Person Appearance" and "Custom" options, such as local deformation, color, gloss, and makeup. After subject A triggers the sound control 784 through the virtual reality handle 22, subject A can select "character voice". At this time, the sound characteristics of the preview performance object 710 will be the same as the sound characteristics of the video object C; subject A can also select "real person voice". At this time, the sound characteristics of the preview performance object 710 will be the same as the voice characteristics of subject A himself; subject A can also select "voice change" and select various preset voice change types to change the voice, and the sound characteristics of the preview performance object 710 will change to the selected sound characteristics.

[0144] To facilitate understanding of the process by which a first subject customizes the image of a performance object corresponding to a newly added character in a multi-view video, the newly added character, Xiao Ding, will be used as an example. Please also refer to Figure 7h, which is a schematic diagram of a second image customization list provided in an embodiment of the present application. Based on the scenario shown in Figure 7a above, subject A wishes to add the character Xiao Ding to the multi-view video. When the virtual reality device 21 responds to subject A's triggering operation on the character creation control 712, as shown in Figure 7h, the virtual reality device 21 may display an image customization interface 708 for the character Xiao Ding in the virtual display interface. As shown in Figure 7g, image customization interface 708 includes a second image customization list 711 and an image preview area 712. Image preview area 712 displays a preview performance object 713, the initial image of which may be the same as subject A's. Subject A may then adjust the image of preview performance object 713 based on the second image customization list 711. As shown in Figure 7h, the second image customization list 711 includes clothing controls 7111, body shape controls 7112, appearance controls 7113, and voice controls 7114. Unlike the first image customization list 78, the options corresponding to each control in the second image customization list 711 do not include those related to the character's image. The remaining options are the same as those in the first image customization list 78 and will not be further described here.

[0145] As an example, a virtual reality device may display a shopping control in a virtual display interface, and in response to a triggering operation on the shopping control, display the purchasable virtual items in a second display mode, wherein the second display mode is different from the display mode of the purchasable virtual items before the shopping control is triggered. Purchasable virtual items are items presented in a virtual video space scene. Then, in response to a selection operation on a purchasable virtual item, the virtual reality device may use the selected purchasable virtual item as a purchase item and display the purchase information corresponding to the purchase item in the virtual display interface. Through the embodiments of the present application, purchasable virtual items can be highlighted, thereby serving as a prompt during the purchase process and improving the efficiency of human-computer interaction.

[0146] Please also refer to Figure 7i, which is a schematic diagram of a scene for displaying purchasable virtual items provided by an embodiment of the present application. As shown in Figure 7i, based on the scene shown in Figure 2a above, the virtual reality device 21 can also independently display a shopping control 714 in the virtual display interface 23. When object A triggers the shopping control 714 through the virtual reality handle 22, the virtual reality device 21 can highlight the purchasable virtual items (for example, frame them with a dotted frame). As shown in Figure 7i, the purchasable virtual items include a virtual hat 715 and the like. Object A can select the purchasable virtual items he wants to know about. Assuming that object A selects the virtual hat 715, the virtual reality device 21 can display purchase information 716 to inform object A about the price, purchase method, etc. of the real hat corresponding to the virtual hat 715.

[0147] By using the method provided in the embodiment of the present application, the first object can interpret the characters in the multi-perspective video in the virtual video space scene corresponding to the multi-perspective video, or add new characters to obtain a creative video, which can enrich the presentation method of the multi-perspective video.

[0148] In order to better understand the process described in Figure 3 above, when the virtual reality device responds to the scene editing operation for the object invitation, the virtual reality device obtains the object data of the first object in the virtual video space scene, and obtains the object data of the second object, and then obtains the object data of the first object and the object data of the second object, and then obtains the creation video based on the object data of the first object and the object data of the second object, please refer to Figure 8, which is a flow chart of a data processing method for creating multi-object videos based on virtual reality provided by an embodiment of the present application. The data processing method can be executed by a virtual reality device. For ease of understanding, the embodiment of the present application is explained by taking the method executed by a virtual reality device as an example. The data processing method may include at least the following steps S401-S403.

[0149] Step S401: In response to a triggering operation on a multi-view video, a virtual video space scene corresponding to the multi-view video is displayed.

[0150] The implementation of step S401 may refer to step S101 in the embodiment corresponding to FIG. 3 .

[0151] In step S402, an object invitation control is displayed in the virtual display interface. In response to a triggering operation on the object invitation control, an object list is displayed. In response to a selection operation on the object list, an invitation request is sent to the target virtual reality device associated with the second object, so that the target virtual reality device associated with the second object displays the virtual video space scene. The object list includes objects associated with the first object. This embodiment of the present application allows the second object to be invited into the virtual video space scene, thereby improving interaction efficiency.

[0152] The first object can choose to invite at least one second object to jointly create a scene for a multi-view video. At this time, a low-latency long connection network will be established between the respective virtual reality devices of the first object and the second object.

[0153] In response to a selection operation on the object list, the virtual reality device sends an invitation request to a target virtual reality device associated with the second object, so that the target virtual reality device associated with the second object displays the virtual video space scene. One feasible implementation process may include: in response to the selection operation on the object list, initiating an invitation request for the second object to a server, so that the server sends the invitation request to the target virtual reality device associated with the second object; wherein, when the target virtual reality device accepts the invitation request, the virtual video space scene is displayed on the target virtual reality device. When the target virtual reality device accepts the invitation request and displays the virtual video space scene, the target virtual object is displayed in the target virtual video screen, wherein the second object enters the virtual video space scene as the target virtual object, the target virtual object is associated with the image data of the second object, and the target virtual video screen is used to present the virtual video space scene from the perspective of the first object.

[0154] Please refer to Figure 9a. Figure 9a is a scene diagram of a virtual reality-based object invitation provided by an embodiment of the present application. Based on the scene shown in Figure 2a above, it is assumed that object A selects the object invitation control 243 through the virtual reality handle 22. The virtual reality device 21 can respond to the trigger operation of the object invitation control 243 and display the object list 91 in the virtual display interface 23. The object list 91 includes objects that have a friend relationship with object A, such as object aaa, object aab, etc. Object A can select the second object to be invited, for example, object aaa, through the virtual reality handle 22. The virtual reality device 21 can respond to the selection operation of object aaa and initiate an invitation request for object aaa to the server.

[0155] Please refer to Figure 9b, which is a schematic diagram of a virtual reality-based second object display scenario provided by an embodiment of the present application. As shown in Figure 9b, object aaa can be equipped with a target virtual reality device and a target virtual reality controller. Object aaa can accept an invitation request from object A via the target virtual reality controller. In response to object aaa's acceptance of the invitation request, the target virtual reality device can obtain object aaa's image data and then enter the virtual video space scene 2000 corresponding to the multi-perspective video, which is equivalent to displaying the virtual video space scene 2000 corresponding to the multi-perspective video on the target virtual reality device. The target virtual reality device will share object aaa's image data with virtual reality device 21. Therefore, virtual reality device 21 can generate a target virtual object 92 with the same image as object aaa based on object aaa's image data. Then, virtual reality device 21 will display target virtual object 92 from the perspective of object A on virtual video screen 201. In addition, the target virtual reality device can also acquire the posture data and voice data of object aaa in real time to present the movements, expressions, and voices of object aaa as target object data, and share the acquired target object data in real time with virtual reality device 21. Virtual reality device 21 can then simulate and present the movements, expressions, and voices of object aaa in real time through target virtual object 92 based on the target object data. It should be understood that virtual reality device 21 also acquires the object data of object A and shares it with the target virtual reality device, so that the target virtual reality device displays the virtual reality object associated with object A in the virtual display interface and simulates and presents the movements, expressions, and voices of object A through the virtual reality object associated with object A.

[0156] As an example, a first object and a second object can have an instant conversation in a virtual video space scene through their respective associated virtual reality objects, using voice, text, or other means. When the second object speaks, the virtual reality device bound to the second object will obtain the second object's instant voice data and share it with the virtual reality device. The virtual reality device can then play the second object's voice based on the second object's instant voice data. In addition, the virtual reality device can also display the conversation message corresponding to the target virtual object in the object's virtual video screen, where the conversation message is generated based on the second object's instant voice data.

[0157] Step S403, when the second object has triggered the performance control, in response to the triggering operation of the first object on the performance control in the virtual display interface, the target object data corresponding to the target virtual object is displayed in the object virtual video screen, and the object data of the first object in the virtual video space scene is obtained at the same time.

[0158] The target virtual object is associated with the avatar data of the second object.

[0159] In the virtual video space scene corresponding to the multi-view video, a first object and a second object can be simultaneously performed. The virtual reality device acquires the object data of the first object, and the virtual reality device bound to the second object acquires the target object data of the second object. The virtual reality device bound to the second object shares the target object data with the virtual reality device. The acquisition of object data and target object data can be referred to the description of the embodiments corresponding to Figures 4 and 6 above, and will not be repeated here.

[0160] Step S404: Playing a creative video associated with the multi-view video in the virtual display interface. The creative video includes a performance object and a target virtual object associated with the first object. The performance object in the creative video is presented based on the object data, and the target virtual object in the creative video is presented based on the target object data.

[0161] The virtual reality device that has a binding relationship with the first object integrates the object data, the target object data, and the virtual video space scene to obtain a creative video obtained through multi-object collaboration. In the process of obtaining the object data of the first object in the virtual video space scene, the virtual reality device that has a binding relationship with the first object shoots the virtual video space scene from a collaborative performance perspective to obtain a collaborative performance video. Then, the performance object with the performance object data and the target virtual object with the collaborative performance object data are integrated into the collaborative performance video to obtain a creative video. Among them, the performance object data refers to the data presented by the object data under the collaborative performance perspective, and the collaborative performance object data refers to the data presented by the target object data under the performance perspective.

[0162] By using the method provided in the embodiment of the present application, a first object can invite a second object to create a scene in the same virtual video space scene, further enriching the presentation and interaction methods of multi-perspective videos.

[0163] Please refer to Figure 10, which is a schematic flow chart of a data processing method for virtual reality-based video recording provided in an embodiment of the present application. This data processing method can be executed by a virtual reality device. For ease of understanding, this embodiment of the present application uses the method executed by a virtual reality device as an example. This data processing method may include at least the following steps S501-S503.

[0164] Step S501 : In response to a triggering operation on a multi-view video, a virtual video space scene corresponding to the multi-view video is displayed.

[0165] When a virtual reality device displays a virtual video space corresponding to a multi-view video, the device defaults to the primary lens virtual video image in the virtual display interface. A first subject wearing the virtual reality device then perceives the virtual video space corresponding to the multi-view video, viewing the virtual video space from the primary lens's perspective. The virtual reality device uses the first subject's current perspective as the primary lens's perspective. The first subject can also switch perspectives at any time through the virtual reality device, viewing the virtual video space from different perspectives.

[0166] As an example, a virtual reality device can display a mobile perspective switching control in a virtual display interface. Then, in response to a triggering operation on the mobile perspective switching control, the virtual reality device can obtain the perspective of the first object after movement with respect to the virtual video space scene as the mobile perspective; and then switch the main lens virtual video frame to display a mobile virtual video frame of the virtual video space scene under the mobile perspective. In other words, when the first object triggers the mobile perspective switching control, the first object can freely move around in the perceived virtual video space scene, viewing the virtual video space scene corresponding to the multi-perspective video in 360 degrees. For ease of understanding, please refer to Figure 11a, which is a schematic diagram of a virtual reality-based mobile perspective switching scenario provided in an embodiment of the present application. As shown in Figure 11a, assume that object A perceives a virtual video space scene 1100 through virtual reality device 1101, and that virtual video space scene 1100 includes video object G. At this time, virtual reality device 1101 can display a virtual video frame 1104 in virtual display interface 1103, which is used to present the virtual video space scene 1100 from the perspective of object A. For example, object A can see the front of video object G. The virtual reality device 1101 can display a mobile perspective switching control 1105 in the virtual display interface 1103. When subject A wants to change the viewing angle of the virtual video space scene 1103 by walking, subject A can trigger the mobile perspective switching control 1105 using the virtual reality handle 1102, and then subject A can walk. The virtual reality device 21 will obtain the perspective of the first subject after movement with respect to the virtual video space scene 1100 as the mobile perspective, and then obtain a virtual video image for presenting the virtual video space scene 1100 under the mobile perspective. For example, if subject A walks from the front of video object G to the back of video object G in the virtual video space scene 1100, as shown in Figure 11a, the virtual reality device 1101 will display a virtual video image 1106 in the virtual display interface 1103. It can be seen that at this time, subject A can only see the back of video object G.

[0167] As an example, the virtual reality device can display a fixed-point perspective switching control in the virtual display interface. The virtual reality device can display a fixed-point cursor in the virtual display interface in response to a trigger operation on the fixed-point perspective switching control. The virtual reality device can respond to a movement operation on the fixed-point cursor, obtain the perspective of the moved fixed-point cursor for the virtual video space scene as a fixed-point perspective, and then switch the main lens virtual video picture to a fixed-point virtual video picture of the virtual video space scene under the fixed-point perspective. In other words, the first object can also adjust the viewing perspective for the virtual video space scene through the fixed-point cursor without moving. For ease of understanding, please refer to Figure 11b, which is a scene schematic diagram of fixed-point perspective switching based on virtual reality provided in an embodiment of the present application. In the scenario shown in FIG11a , virtual reality device 1101 may also display a fixed-point perspective switch control 1107 on virtual display interface 1103. When virtual reality device 1101 responds to a triggering operation on fixed-point perspective switch control 1107, subject A can see a fixed cursor 1108 in the virtual video space. Assuming subject A uses virtual reality controller 1102 to move fixed cursor 1108 behind video object G, virtual reality device 1101 will capture the perspective of fixed cursor 1108 with respect to the virtual video space as the fixed-point perspective, and then obtain a virtual video frame 1109 for presenting virtual video space scene 1100 from the fixed-point perspective. As shown in FIG11b , subject A's position remains unchanged, but the virtual video space scene perceived by subject A has changed, resulting in subject A viewing virtual video space scene 1100 from the fixed-point perspective.

[0168] Step S502: Display a shooting and recording control in the virtual display interface, and shoot and record the virtual video space scene in response to a triggering operation on the shooting and recording control to obtain a recorded video.

[0169] In response to a trigger operation for a shooting and recording control, the virtual reality device shoots and records the virtual video space scene to obtain a feasible implementation process of the recorded video. It can be as follows: the virtual reality device obtains a shooting perspective for the virtual video space scene in response to a trigger operation for a shooting and recording control. Then the virtual reality device can display the virtual video screen of the virtual video space scene under the shooting perspective in the virtual display interface, and display a recording picture frame in the shooting virtual video screen; record the video screen of the shooting virtual video screen in the recording picture frame to obtain a recorded video. Among them, the determination of the shooting perspective is the same as the determination of the performance perspective mentioned above, corresponding to three determination methods, namely, following the lens, shooting in situ, and free movement. For ease of understanding, please refer to Figure 11c, which is a scene diagram of video shooting based on virtual reality provided in an embodiment of the present application. The virtual reality device 1101 can shoot or record a fragment of the virtual video space scene 1100. As shown in Figure 11c, virtual reality device 1101 may display a capture and recording control 1110 within virtual display interface 1103. When virtual reality device 1101 responds to a triggering operation on capture and recording control 1110, it may display a virtual video frame 1111 of the virtual video space scene 1110 from the shooting perspective, along with a recording frame 1112. It should be understood that only the footage within recording frame 1112 is recorded, and subject A can adjust the size and position of recording frame 1112. Subject A can capture a scene by triggering capture control 1113 and record a segment by triggering recording control 1114. Furthermore, subject A can trigger a path selection control 1115. Upon triggering path selection control 1115, the virtual reality device may display a path selection list 1115, which includes three shooting path options: follow shot, in-place shooting, and free movement. For example, a first subject can add multiple shots and shooting paths to record footage without interfering with each other.

[0170] Using the method provided in the embodiment of the present application, the first object selects a shooting perspective to shoot and record the virtual video space scene, and obtains a creative video with the main lens perspective as the shooting perspective, enriching the presentation and interaction methods of multi-perspective videos.

[0171] Please refer to Figure 12, which is a structural diagram of a data processing device provided in an embodiment of the present application. The data processing device can be a computer program (including program code) running on a computer device, for example, the data processing device is an application software; the device can be used to execute the corresponding steps in the data processing method provided in an embodiment of the present application. As shown in Figure 12, the data processing device 1 may include: a first response module 101, a second response module 102 and a video playback module 103. The first response module 101 is configured to display the virtual video space scene corresponding to the multi-view video in response to a trigger operation for the multi-view video; the second response module 102 is configured to obtain object data of the first object in the virtual video space scene in response to a scene editing operation for the virtual video space scene, wherein the first object refers to the object that initiates the trigger operation for the multi-view video; the video playback module 103 is configured to play a creative video associated with the multi-view video in a virtual display interface, wherein the creative video is obtained by editing the virtual video space scene based on the object data.

[0172] The specific implementation of the first response module 101, the second response module 102 and the video playback module 103 can be found in the description of steps S101 to S103 in the embodiment corresponding to FIG. 3 above, which will not be repeated here.

[0173] In some embodiments, the scene editing operation includes triggering a dubbing control in the virtual display interface. Referring again to FIG. 12 , the second response module 102 includes a first response unit 1021 configured to play the multi-view video and, in response to the triggering operation of the dubbing control in the virtual display interface, obtain voice data of a first object in the virtual video space scene and determine the voice data of the first object as object data to be applied to the multi-view video.

[0174] The specific implementation of the first response unit 1021 can refer to the description of step S102 in the embodiment corresponding to FIG3 above, and will not be repeated here.

[0175] In some embodiments, the voice data of the first object includes object voice data or background voice data; please refer to Figure 12 again, the first response unit 1021 includes: a first response subunit 10211, a first selection subunit 10212, a first determination subunit 10213 and a second determination subunit 10214. The first response subunit 10211 is configured to display a dubbing mode list, wherein the dubbing mode list includes an object dubbing control and a background dubbing control; the first selection subunit 10212 is configured to display a dubbing-capable video object in response to a selection operation on the object dubbing control, and in response to a selection operation on the dubbing-capable video object, use the selected dubbing-capable video object as the object to be dubbed, wherein the dubbing-capable video object belongs to the video object presented in the multi-view video; the first determination subunit 10213 is configured to obtain object voice data of the first object based on the object to be dubbed during the playback of the multi-view video, and determine the object voice data as object data; the second determination subunit 10214 is configured to obtain background voice data of the first object in response to a selection operation on the background dubbing control during the playback of the multi-view video, and determine the background voice data as object data.

[0176] The specific implementation of the first response subunit 10211, the first selection subunit 10212, the first determination subunit 10213 and the second determination subunit 10214 can be found in the description of steps S201 to S207 in the embodiment corresponding to Figure 4 above, and will not be repeated here.

[0177] In some embodiments, the first determination subunit 10213 is also configured to mute the video voice data corresponding to the object to be dubbed; when the object to be dubbed is in a sounding state, the text information and audio track information corresponding to the video voice data are displayed, and the object voice data of the first object is obtained; and the object voice data is determined as object data.

[0178] In some embodiments, referring again to FIG. 12 , the data processing device 1 further includes: a voice replacement module 104 and a voice superposition module 105. The voice replacement module 104 is configured to, when the object data is object voice data, replace the video and voice data corresponding to the object to be dubbed in the multi-view video with the object voice data to obtain a creative video; and the voice superposition module 105 is configured to, when the object data is background voice data, superimpose the background voice data onto the multi-view video to obtain a creative video.

[0179] The specific implementation of the voice replacement module 104 and the voice superposition module 105 can be found in the description of steps S201 to S207 in the embodiment corresponding to FIG4 , which will not be described in detail here.

[0180] In some embodiments, the scene editing operation includes triggering a performance control in the virtual display interface. Referring again to FIG. 12 , the second response module 102 includes a second response unit 1022. The second response unit 1022 is configured to play the multi-view video. In response to the triggering operation on the performance control in the virtual display interface, the second response unit 1022 is configured to obtain posture data and image data of a first object in the virtual video space scene, and determine the posture data and image data as object data to be applied to the multi-view video. The creative video includes a performance object associated with the first object, and the performance object in the creative video is presented based on the posture data and image data.

[0181] The specific implementation of the second response unit 1022 can refer to the description of step S102 in the embodiment corresponding to FIG3 above, and will not be repeated here.

[0182] In some embodiments, referring to FIG. 12 again, the second responding unit 1022 includes: a second responding subunit 10221 , a second selecting subunit 10222 , a third determining subunit 10223 , and a fourth determining subunit 10224 . The second response sub-unit 10221 is configured to display a performance mode list, wherein the performance mode list includes a character replacement control and a character creation control; the second selection sub-unit 10222 is configured to display a replaceable video object in response to a trigger operation on the character replacement control, and in response to a selection operation on the replaceable video object, use the selected replaceable video object as a character replacement object, wherein the replaceable video object belongs to the video object presented in the multi-view video; the third determination sub-unit 10223 is configured to obtain posture data and image data of the first object based on the character replacement object during the playback of the multi-view video, and determine the posture data and image data as object data; the fourth determination sub-unit 10224 is configured to obtain posture data and image data of the first object during the playback of the multi-view video in response to a trigger operation on the character creation control, and determine the posture data and image data as object data.

[0183] The specific implementation of the second response subunit 10221, the second selection subunit 10222, the third determination subunit 10223 and the fourth determination subunit 10224 can be found in the description of steps S301 to S307 in the embodiment corresponding to Figure 6 above, and will not be repeated here.

[0184] In some embodiments, please refer to Figure 12 again. The above-mentioned data processing device 1 further includes: a performance replacement module 106 and a performance integration module 107. The performance replacement module 106 is configured to cancel the display of the character replacement object in the performance perspective video when the object data is obtained by triggering the character replacement control, and integrate the performance object that meets the performance object data into the performance perspective video to obtain a creative video, wherein the performance perspective video is obtained by shooting the virtual video space scene through the performance perspective after the performance control is triggered and during the multi-perspective video playback; the performance object data refers to the data presented by the object data under the performance perspective; the performance integration module 107 is configured to integrate the performance object that meets the performance object data into the performance perspective video to obtain a creative video when the object data is obtained by triggering the character creation control.

[0185] The specific implementation of the performance replacement module 106 and the performance integration module 107 can be found in the description of steps S301 to S307 in the embodiment corresponding to FIG6 , which will not be repeated here.

[0186] In some embodiments, the second selection subunit 10222 is further configured to, in response to a trigger operation on a character replacement control, determine a video object currently displayed in the object virtual video screen as a replaceable video object, and in response to a marking operation on the replaceable video object, display the marked replaceable video object in a first display mode, wherein the first display mode is different from a display mode of other video objects other than the replaceable video object, and use the marked replaceable video object as a character replacement object, wherein the object virtual video screen is used to present a virtual video space scene from the perspective of the first object;

[0187] In some embodiments, the second selection sub-unit 10222 is further configured to, in response to a trigger operation on a character replacement control, display at least one video segment corresponding to the multi-perspective video, in response to a selection operation on at least one video segment, display the video object contained in the selected video segment, and determine the video object contained in the selected video segment as a replaceable video object, and in response to a marking operation on the replaceable video object, display the marked replaceable video object in a first display mode, wherein the first display mode is different from the display mode of other video objects except the replaceable video object, and the marked replaceable video object is used as a character replacement object.

[0188] In some embodiments, referring again to FIG. 12 , the data processing device 1 further includes a mirror display module 108. The mirror display module 108 is configured to display a mirror preview control in the virtual display interface during the process of acquiring the posture data and image data of the first object. The mirror display module 108 is further configured to display a virtual video image of a performance in a performance preview area of ​​the virtual display interface in response to a triggering operation on the mirror preview control, wherein the virtual video image of the performance includes a performance object integrated into the virtual video space scene.

[0189] The specific implementation of the mirror display module 108 can refer to the description of the optional embodiment in the embodiment corresponding to FIG6 above, which will not be repeated here.

[0190] In some embodiments, referring again to FIG. 12 , the data processing device 1 further includes an image customization module 109. The image customization module 109 is configured to display an image customization list in a virtual display interface; the image customization module 109 is further configured to, in response to completing a configuration operation for the image customization list, update the image data according to the configured image data to obtain configured image data, wherein the configured image data includes clothing data, body shape data, and appearance data; and the image customization module 109 is further configured to display the performance object in the creation video with a performance action and a performance image, wherein the performance action is determined based on the posture data of the first object, and the performance image is determined based on at least one of the clothing data, body shape data, voice data, and appearance data.

[0191] The specific implementation of the image customization module 109 can refer to the description of the optional embodiment in the embodiment corresponding to FIG6 above, which will not be repeated here.

[0192] In some embodiments, referring again to FIG. 12 , the data processing device 1 further includes a transparent display module 110. The transparent display module 110 is configured to display a replacement transparency input control for the character replacement object in the virtual display interface; the transparent display module 110 is further configured to, in response to an input operation on the transparency input control, obtain input transparency information for the character replacement object, update the transparency of the character replacement object in the virtual display interface according to the transparency information, and display a position cursor of the character replacement object after the transparency update in the virtual video space scene.

[0193] The specific implementation of the transparent display module 110 can refer to the description of the optional embodiment of step S304 in the embodiment corresponding to FIG6 , which will not be described in detail here.

[0194] In some embodiments, referring again to FIG. 12 , the data processing apparatus 1 further includes an object invitation module 111 and a third response module 112. The object invitation module 111 is configured to display an object invitation control in the virtual display interface and, in response to a triggering operation on the object invitation control, display an object list, wherein the object list includes objects associated with the first object; and the third response module 112 is configured to, in response to a selection operation on the object list, send an invitation request to a target virtual reality device associated with the second object, so that the target virtual reality device associated with the second object displays the virtual video space scene.

[0195] The specific implementation of the object invitation module 111 and the third response module 112 can refer to the description of step S402 in the embodiment corresponding to FIG8 , which will not be repeated here.

[0196] In some embodiments, referring again to FIG. 12 , the third response module 112 includes an invitation unit 1121 and a display unit 1122. The invitation unit 1121 is configured to initiate an invitation request for the second object to the server, so that the server sends the invitation request to the target virtual reality device associated with the second object; wherein, when the target virtual reality device accepts the invitation request, the virtual video space scene is displayed on the target virtual reality device; and the display unit 1122 is configured to display the target virtual object in the object virtual video screen when the target virtual reality device accepts the invitation request and displays the virtual video space scene. The second object enters the virtual video space scene as the target virtual object, the target virtual object is associated with the image data of the second object, and the object virtual video screen is used to present the virtual video space scene from the perspective of the first object.

[0197] The specific implementation of the invitation unit 1121 and the display unit 1122 can refer to the description of step S302 in the embodiment corresponding to FIG8 , which will not be repeated here.

[0198] In some embodiments, when the second object has triggered the performance control, the scene editing operation includes the triggering operation of the first object on the performance control in the virtual display interface; please refer to Figure 12 again, the second response module 102 includes: a determination unit 1023. The determination unit 1023 is configured to display the target object data corresponding to the target virtual object in the object virtual video screen in response to the triggering operation of the first object on the performance control in the virtual display interface, and obtain the object data of the first object in the virtual video space scene, wherein the creative video contains a performance object and a target virtual object associated with the first object, the performance object in the creative video is presented based on the object data, and the target virtual object in the creative video is presented based on the target object data.

[0199] The specific implementation of the determination unit 1023 can refer to the description of step S403 in the embodiment corresponding to FIG8 , which will not be repeated here.

[0200] In some embodiments, please refer to FIG12 again, the data processing device 1 further includes: a shooting module 113 and a fusion module 114. The shooting module 113 is configured to, in the process of obtaining object data of the first object in the virtual video space scene, shoot the virtual video space scene through the collaborative performance perspective to obtain a collaborative performance video; the fusion module 114 is configured to integrate the performance object having the performance object data and the target virtual object having the collaborative performance object data into the collaborative performance video to obtain a creative video, wherein the performance object data refers to the data presented by the object data under the collaborative performance perspective, and the collaborative performance object data refers to the data presented by the target object data under the performance perspective.

[0201] The specific implementation of the shooting module 113 and the fusion module 114 can be found in the description of step S403 in the embodiment corresponding to FIG8 above, which will not be repeated here.

[0202] In some embodiments, referring to FIG12 , the data processing device 1 further includes a conversation display module 115. The conversation display module 115 is configured to display a conversation message corresponding to the target virtual object in the object virtual video screen, wherein the conversation message is generated based on the instant voice data of the second object.

[0203] The specific implementation of the conversation display module 115 can refer to the description of the optional embodiment of step S403 in the embodiment corresponding to FIG8 , which will not be described in detail here.

[0204] In some embodiments, referring again to FIG. 12 , the data processing device 1 further includes a shopping module 116. The shopping module 116 is configured to display a shopping control in the virtual display interface and, in response to a triggering operation on the shopping control, display the purchasable virtual items in a second display manner, wherein the second display manner is different from the display manner of the purchasable virtual items before the shopping control is triggered; the purchasable virtual items are items presented in the virtual video space scene; and the shopping module 116 is configured to, in response to a selection operation on the purchasable virtual items, treat the selected purchasable virtual items as purchase items and display purchase information corresponding to the purchase items in the virtual display interface.

[0205] The specific implementation of the shopping module 116 can refer to the description of the optional embodiment in the embodiment corresponding to Figure 6 above, and will not be repeated here.

[0206] In some embodiments, please refer to FIG12 again. The data processing device 1 further includes: a first screen display module 117 and a first perspective switching module 118. The first screen display module 117 is configured to display the main lens virtual video screen of the virtual video space scene under the main lens perspective in the virtual display interface; the first perspective switching module 118 is configured to display the mobile perspective switching control in the virtual display interface; the first perspective switching module 118 is further configured to obtain the perspective of the first object after movement with respect to the virtual video space scene as the mobile perspective in response to a triggering operation on the mobile perspective switching control; the first perspective switching module 118 is further configured to switch the main lens virtual video screen to display the mobile virtual video screen of the virtual video space scene under the mobile perspective.

[0207] The specific implementation of the first picture display module 117 and the first viewing angle switching module 118 can be found in the description of step S501 in the embodiment corresponding to FIG. 10 , which will not be repeated here.

[0208] In some embodiments, referring to FIG. 12 , the data processing device 1 further includes: a second screen display module 119 and a second perspective switching module 120. The second screen display module 119 is configured to display a main lens virtual video screen of the virtual video space scene under the main lens perspective in the virtual display interface; the second perspective switching module 120 is configured to display a fixed-point perspective switching control in the virtual display interface; the second perspective switching module 120 is further configured to display a fixed-point cursor in the virtual display interface in response to a trigger operation on the fixed-point perspective switching control; the second perspective switching module 120 is further configured to obtain the perspective of the moved fixed-point cursor with respect to the virtual video space scene as the fixed-point perspective in response to a movement operation on the fixed-point cursor; and the second perspective switching module 120 is further configured to switch the main lens virtual video screen to display a fixed-point virtual video screen of the virtual video space scene under the fixed-point perspective.

[0209] The specific implementation of the second picture display module 119 and the second perspective switching module 120 can be found in the description of step S501 in the embodiment corresponding to FIG10 above, and will not be repeated here.

[0210] In some embodiments, referring again to FIG. 12 , the data processing device 1 further includes: a first display module 121 and a fourth response module 122. The first display module 121 is configured to display a capture and recording control in a virtual display interface; the fourth response module 122 is configured to capture and record the virtual video space scene in response to a triggering operation on the capture and recording control to obtain a recorded video.

[0211] The specific implementation of the first display module 121 and the fourth response module 122 can refer to the description of step S502 in the embodiment corresponding to FIG10 , which will not be repeated here.

[0212] In some embodiments, referring again to FIG. 12 , the fourth response module 122 includes a perspective acquisition unit 1221, a first display unit 1222, a second display unit 1223, and a recording unit 1224. The perspective acquisition unit 1221 is configured to acquire a shooting perspective for the virtual video space scene in response to a triggering operation on the shooting and recording control; the first display unit 1222 is configured to display a captured virtual video image of the virtual video space scene under the shooting perspective in a virtual display interface; the second display unit 1223 is configured to display a recording image frame in the captured virtual video image; and the recording unit 1224 is configured to record the video image of the captured virtual video image in the recording image frame to obtain a recorded video.

[0213] The specific implementation of the viewing angle acquisition unit 1221, the first display unit 1222, the second display unit 1223 and the recording unit 1224 can be found in the description of step S502 in the embodiment corresponding to FIG10 above, which will not be repeated here.

[0214] In some embodiments, referring again to FIG12 , the second response module 102 includes a segment input unit 1024, a segment acquisition unit 1025, and an acquisition unit 1026. The segment input unit 1024 is configured to display a video segment input control for the virtual video space scene on the virtual display interface in response to the first subject's scene editing operation on the virtual video space scene; the segment acquisition unit 1025 is configured to, in response to the input operation on the video segment input control, acquire the input segment progress information for the multi-view video and use the video segment indicated by the segment progress information as the video segment to be created; and the acquisition unit 1026 is configured to acquire object data of the first subject in the virtual video space scene during playback of the video segment to be created.

[0215] The specific implementation of the fragment input unit 1024, the fragment acquisition unit 1025 and the acquisition unit 1026 can refer to the description of step S103 in the embodiment corresponding to FIG. 3 above, which will not be repeated here.

[0216] In some embodiments, please refer to FIG12 again. The data processing device 1 further includes: a second display module 123 and a fifth response module. The second display module 123 is configured to display a playback progress control bar on the virtual display interface during playback of the video clip to be created; the playback progress control bar includes a pause control, a start control, and a multiple control; the fifth response module 124 is configured to pause playback of the video clip to be created in response to a trigger operation on the pause control; the fifth response module is further configured to continue playback of the video clip to be created in response to a trigger operation on the start control; the fifth response module is further configured to adjust the playback speed of the video clip to be created according to the selected playback multiple in response to a selection operation on the multiple control.

[0217] The specific implementation of the second display module 123 and the fifth response module can refer to the description of step S103 in the embodiment corresponding to FIG3 , which will not be repeated here.

[0218] Please refer to Figure 13, which is a structural diagram of a computer device provided in an embodiment of the present application. As shown in Figure 13, the computer device 1000 may include: a processor 1001, a network interface 1004 and a memory 1005. In addition, the above-mentioned computer device 1000 may also include: a user interface 1003, and at least one communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. Among them, the user interface 1003 may include a display screen (Display), a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may include a standard wired interface and a wireless interface (such as a WI-FI interface) as an example. The memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk storage. The memory 1005 may also be, as an example, at least one storage device located away from the aforementioned processor 1001. As shown in Figure 13, the memory 1005 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module and a device control application.

[0219] In the computer device 1000 shown in Figure 13, the network interface 1004 can provide a network communication network element; the user interface 1003 is mainly used to provide an input interface for the user; and the processor 1001 can be used to call the device control application stored in the memory 1005 to implement the following steps: in response to a trigger operation for a multi-perspective video, the virtual video space scene corresponding to the multi-perspective video is displayed, and the multi-perspective video is played in the virtual video space scene; in response to a scene editing operation for the virtual video space scene, the object data of the first object in the virtual video space scene is obtained, wherein the first object refers to the object that initiates the trigger operation for the multi-perspective video; and the creative video associated with the multi-perspective video is played in the virtual display interface, wherein the creative video is obtained by editing the virtual video space scene based on the object data.

[0220] It should be understood that the computer device 1000 described in the embodiments of the present application can execute the description of the data processing method in any of the corresponding embodiments above, which will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated here either.

[0221] In addition, it should be pointed out here that: the embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program executed by the data processing device 1 mentioned above, and the computer program includes program instructions. When the processor executes the program instructions, it can execute the description of the data processing method in any of the corresponding embodiments above. Therefore, it will not be repeated here. In addition, the description of the beneficial effects of using the same method will not be repeated. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application.

[0222] The computer-readable storage medium may be the data processing device provided in any of the aforementioned embodiments or the internal storage unit of the computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer device. The computer-readable storage medium may also include both the internal storage unit of the computer device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

[0223] In addition, it should be noted that embodiments of the present application also provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method provided in any of the corresponding embodiments described above.

[0224] The terms "first", "second", etc. in the description, claims, and drawings of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device comprising a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules not listed, or may optionally include other step units inherent to these processes, methods, apparatuses, products, or devices.

[0225] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. To clearly illustrate the interchangeability of hardware and software, the above description has generally described the components and steps of each example in terms of network elements. Whether these network elements are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel may use different methods to implement the described network elements for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0226] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Images