Video recording method and device, equipment and storage medium

Abstract

The invention provides a video recording method and device, equipment and a storage medium, and the method comprises the steps: controlling a first camera to record a real image of a real object in response to a detected video recording instruction; a target virtual picture sent by a second terminal device is obtained, the target virtual picture is recorded based on a second camera created by the second terminal device in the mixed reality space, and the target virtual picture comprises at least one virtual object; according to the real picture and the target virtual picture, a mixed reality video is generated, and the mixed reality video takes a real object in the real picture and a virtual object in the target virtual picture as a foreground picture and takes a real background in the real picture as a background picture. According to the invention, the recorded mixed reality video forms can be enriched, the diversified requirements of the user are met, and the use experience of the user is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of video processing technology, and in particular to a video recording method, apparatus, device and storage medium. Background Art

[0002] In order to record the content that they are interested in or like, people usually use terminal devices to record videos. For example, when users interact with other users in virtual scenes such as extended reality (XR), they can use the mixed reality capture (MRC) function on the terminal device to record mixed reality videos. However, the current recorded mixed reality videos are in a relatively single format and cannot meet the diverse needs of users. Summary of the invention

[0003] The embodiments of the present application provide a video recording method, apparatus, device and storage medium, which can enrich the form of recorded mixed reality videos, meet the diverse needs of users, and thus improve the user experience.

[0004] In a first aspect, an embodiment of the present application provides a video recording method, which is applied to a first terminal device, wherein the first terminal device includes: a first camera, and the method includes:

[0005] In response to the detected video recording instruction, controlling the first camera to record a real picture of a real object;

[0006] Acquire a target virtual picture sent by the second terminal device, where the target virtual picture is recorded based on a second camera created by the second terminal device in the mixed reality space, and the target virtual picture includes: at least one virtual object;

[0007] A mixed reality video is generated according to the real picture and the target virtual picture. The mixed reality video uses the real objects in the real picture and the virtual objects in the target virtual picture as foreground pictures, and uses the real background in the real picture as background picture.

[0008] In a second aspect, an embodiment of the present application provides a video recording method, which is applied to a second terminal device, and the method includes:

[0009] In response to a video recording instruction sent by a user, creating a second camera in a mixed reality space, the mixed reality space including: at least one virtual object;

[0010] Recording a target virtual picture in the mixed reality space by the second camera, wherein the target virtual picture includes: at least one virtual object;

[0011] The target virtual screen is sent to a first terminal device to instruct the first terminal to generate a mixed reality video based on the target virtual screen, wherein the mixed reality video uses real objects in the real screen and virtual objects in the target virtual screen as foreground screens, and uses real background in the real screen as background screen.

[0012] In a third aspect, an embodiment of the present application provides a video recording device, which is configured in a first terminal device, wherein the first terminal device includes: a first camera, including:

[0013] A first recording module, configured to control the first camera to record a real picture of a real object in response to a detected video recording instruction;

[0014] A picture acquisition module, used to acquire a target virtual picture sent by a second terminal device, wherein the target virtual picture is recorded based on a second camera created by the second terminal device in a mixed reality space, and the target virtual picture includes: at least one virtual object;

[0015] A video generation module is used to generate a mixed reality video based on the real picture and the target virtual picture, wherein the mixed reality video uses the real objects in the real picture and the virtual objects in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture.

[0016] In a fourth aspect, an embodiment of the present application provides a video recording device, which is configured on a second terminal device, including:

[0017] A creation module, configured to create a second camera in a mixed reality space in response to a video recording instruction sent by a user, wherein the mixed reality space includes: at least one virtual object;

[0018] A second recording module, configured to record a target virtual picture in the mixed reality space through the second camera, wherein the target virtual picture includes: at least one virtual object;

[0019] A picture sending module is used to send the target virtual picture to a first terminal device to instruct the first terminal to generate a mixed reality video based on the target virtual picture, wherein the mixed reality video uses the real objects in the real picture and the virtual objects in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture.

[0020] In a fifth aspect, an embodiment of the present application provides an electronic device, including:

[0021] A processor and a memory, wherein the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory to execute the video recording method described in the first aspect embodiment or the second aspect embodiment.

[0022] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the video recording method as described in the embodiment of the first aspect or the embodiment of the second aspect.

[0023] In a seventh aspect, an embodiment of the present application provides a computer program product comprising program instructions. When the program instructions are executed on an electronic device, the electronic device executes the video recording method as described in the embodiment of the first aspect or the embodiment of the second aspect.

[0024] The technical solution disclosed in the embodiments of the present application has at least the following beneficial effects:

[0025] Based on the detected video recording instruction, the first camera is controlled to capture the real picture of the real object, and the target virtual picture sent by the second terminal is obtained. Then, according to the real picture and the target virtual picture, a mixed reality video is generated with the real object in the real picture and the virtual object in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture. This can enrich the form of recorded mixed reality videos, meet the diverse needs of users, and thus improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0027] Figure 1 A schematic diagram of an application scenario of a video recording method provided in an embodiment of the present application;

[0028] Figure 2 A schematic diagram of a flow chart of a video recording method provided in an embodiment of the present application;

[0029] Figure 3 A schematic diagram for generating a mixed reality video based on a real picture and a target virtual picture;

[0030] Figure 4 A schematic diagram of a process for generating a mixed reality video based on a real picture and a target virtual picture provided in an embodiment of the present application;

[0031] Figure 5 A schematic diagram of a process for calibrating a first camera provided in an embodiment of the present application;

[0032] Figure 6 A flowchart of another video recording method provided in an embodiment of the present application;

[0033] Figure 7 A schematic block diagram of a video recording device provided in an embodiment of the present application;

[0034] Figure 8 A schematic block diagram of another video recording device provided in an embodiment of the present application;

[0035] Fig. 9 A schematic block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0036] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. According to the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0037] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0038] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or scheme described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or schemes. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0039] In order to facilitate understanding of the embodiments of the present application, before describing each embodiment of the present application, some concepts involved in all embodiments of the present application are first appropriately explained, as follows:

[0040] 1) Virtual Reality (VR), a technology for creating and experiencing a virtual world, generates a virtual environment by computation, and is a multi-source information (the virtual reality mentioned in this article includes at least visual perception, and can also include auditory perception, tactile perception, motion perception, and even taste perception, olfactory perception, etc.), realizing the fusion of virtual environment, interactive three-dimensional dynamic vision and simulation of entity behavior, allowing users to immerse themselves in a simulated virtual reality environment, and realizing applications in various virtual environments such as maps, games, videos, education, medical care, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair.

[0041] 2) Virtual reality devices (VR devices), terminals for realizing virtual reality effects, can usually be provided in the form of glasses, helmet-mounted displays (Head Mount Display, HMD), and contact lenses to realize visual perception and other forms of perception. Of course, the form of virtual reality devices is not limited to this, and can be further miniaturized or enlarged according to actual needs.

[0042] Optionally, the virtual reality devices described in the embodiments of the present application may include but are not limited to the following types:

[0043] 2.1) PC-based virtual reality (PCVR) devices use the PC to perform relevant calculations and data output for virtual reality functions. External PC-based virtual reality devices use the data output by the PC to achieve virtual reality effects.

[0044] 2.2) Mobile virtual reality devices support the configuration of mobile terminals (such as smart phones) in various ways (such as head-mounted displays with dedicated card slots). Through wired or wireless connection with the mobile terminal, the mobile terminal performs relevant calculations of virtual reality functions and outputs data to the mobile virtual reality device, such as watching virtual reality videos through the mobile terminal's APP.

[0045] 2.3) All-in-one virtual reality devices have a processor for performing relevant calculations of virtual functions, and thus have independent virtual reality input and output functions. They do not need to be connected to a PC or mobile terminal and have a high degree of freedom in use.

[0046] 3) Augmented Reality (AR): A technology that calculates the camera's posture parameters in the real world (or three-dimensional world, real world) in real time during the process of the camera capturing images, and adds virtual elements to the images captured by the camera based on the camera posture parameters. Virtual elements include but are not limited to: images, videos, and three-dimensional models. The goal of AR technology is to integrate the virtual world with the real world on the screen for interaction.

[0047] 4) Mixed Reality (MR): A simulated setting that integrates computer-created sensory input (e.g., virtual objects) with sensory input from a physical setting or its representation. In some MR settings, the computer-created sensory input can adapt to changes in sensory input from the physical setting. In addition, some electronic systems used to present MR settings can monitor the orientation and / or position relative to the physical setting so that virtual objects can interact with real objects (i.e., physical elements from the physical setting or their representations). For example, the system can monitor movement so that virtual plants appear stationary relative to physical buildings.

[0048] 5) Extended Reality (XR) refers to all real and virtual combined environments and human-computer interactions generated by computer technology and wearable devices, which include virtual reality (VR), augmented reality (AR) and mixed reality (MR) and other forms.

[0049] 6) A virtual scene (also known as a virtual space) is a virtual scene displayed (or provided) when an application is running on an electronic device. The virtual scene can be a simulation of the real world, a semi-simulated and semi-fictitious virtual scene, or a purely fictitious virtual scene. The virtual scene can be any of a two-dimensional virtual scene, a 2.5-dimensional virtual scene, or a three-dimensional virtual scene. The embodiments of the present application do not limit the dimensions of the virtual scene. For example, a virtual scene can include the sky, land, ocean, etc., and the land can include environmental elements such as deserts and cities.

[0050] 7) Virtual objects: objects that interact in virtual scenes, are controlled by users or robot programs (e.g., robot programs based on artificial intelligence), and can be stationary, move, and perform various behaviors in virtual scenes.

[0051] Considering that the traditional mixed reality video recording method is to synthesize the real objects in the real video into the virtual background in the virtual video, this recording form is relatively simple and cannot meet the diverse needs of users. In order to solve the above technical problems, the inventive concept of this application is: through the first terminal device, the real objects and real background in the real picture recorded by its own first camera are merged with the virtual objects in the virtual picture sent by the second terminal device to generate a mixed reality video with the real objects and virtual objects as the foreground picture and the real background as the background picture, thereby enriching the recording form of the mixed reality video and meeting the diverse needs of users for recording videos.

[0052] It should be understood that the technical solution of the present application can be applied but not limited to the following scenarios:

[0053] like Figure 1 As shown, the application scenario may include: a first terminal device 10 and a second terminal device 20. The first terminal device 10 and the second terminal device 20 may communicate through a network to implement data interaction.

[0054] The above-mentioned first terminal device 10 can be selected as any device equipped with a camera that can support video recording and video playback based on the camera, such as a laptop computer, a smart phone, a tablet computer, a wearable device, an AR device, a VR device, an MR device, an XR device, etc.

[0055] The second terminal device 20 may be a head mounted display (HMD) of any virtual space product, wherein the virtual space product may be, but is not limited to, a VR device, an AR device, an MR device, an XR device, and the like.

[0056] In this application scenario, the first terminal device 10 can obtain the real picture and the virtual picture recorded by the second terminal device 20, so that the first terminal device 10 can generate a mixed reality video with real objects and virtual objects as foreground pictures and real background as background pictures based on the real picture and the virtual picture.

[0057] It should be noted that Figure 1 The first terminal device 10 and the second terminal device 20 shown in the figure are only schematic. The number and device type of the first terminal device 10 and the second terminal device 20 can be adjusted according to actual usage. Figure 1 shown.

[0058] After introducing the application scenarios of the embodiments of the present application, the technical solution of the present application is described in detail below.

[0059] Figure 2 A schematic flow chart of a video recording method provided in an embodiment of the present application. The video recording method provided in the present application can be performed by a video recording device. The video recording device can be composed of hardware and / or software and can be integrated in a first terminal device.

[0060] It should be noted that, in order to facilitate the explanation of the technical solution of the present application, in the following embodiments, the first terminal device is a smart phone, and the second terminal device is an HMD under the XR device as an example to explain the technical solution of the present application in detail.

[0061] like Figure 2 As shown, the video recording method may include the following steps:

[0062] S101, in response to a detected video recording instruction, controlling a first camera to record a real picture of a real object.

[0063] Among them, the video recording instruction can be selected as a mixed reality video recording instruction.

[0064] In the present application, the first camera may be selected as a camera on a smartphone that can locate the position information of the smartphone in the current space, such as an AR camera or an MR camera.

[0065] The current space where the smartphone is located is specifically a real space or a real physical space.

[0066] The real object mentioned above may be a real user, and the real user may be understood as a user using the HMD.

[0067] Optionally, after a user enters a mixed reality space through an HMD, when at least one virtual object is presented in the mixed reality space, the user can perform various interactions with the virtual object presented in the mixed reality space. However, the interactive screen between the user and the virtual object may be of great interest to the user, so there is a need to record the interactive screen between the user and the virtual object so that the user can watch it again later or share it with other users.

[0068] To this end, the user can set up a smart phone at a suitable location in the real space where the user is located, so as to capture the real image of the user through the first camera on the smart phone.

[0069] The above-mentioned suitable position can be selected as any position that can capture the entire body of the user, such as a third-person perspective position (third-person perspective position), etc. This application does not impose any restrictions on this position.

[0070] In the present application, the virtual object may be any virtual object, such as a virtual person, a virtual animal or a virtual item. The virtual item may be, but is not limited to, a virtual vase, a virtual clock, a virtual painting or other virtual decorations.

[0071] It should be noted that when setting a smartphone in the real space in this application, the smartphone can be optionally set in the real space before the user wears the HMD, or after the user wears the HMD to enter the mixed reality space, the smartphone is set in the real space seen based on the turned-on video see-through (VST) function. Preferably, this application adopts the second method mentioned above, that is, the user wears the HME to enter the mixed reality space, and sets the smartphone in the real space seen based on the turned-on video see-through function.

[0072] After setting up the smartphone, the user can trigger the video recording control provided by the smartphone set in the real space under the film and television perspective function, so that the smartphone controls the first camera to record the real picture of the real object under the third perspective according to the video recording command triggered by the user, thereby laying the foundation for the subsequent generation of mixed reality video.

[0073] The video recording controls provided by the above-mentioned smartphone may be virtual controls or physical controls, and this application does not impose any restrictions on this.

[0074] S102, obtaining a target virtual picture sent by the second terminal device, where the target virtual picture is recorded based on a second camera created by the second terminal device in the mixed reality space, and the target virtual picture includes: at least one virtual object.

[0075] Considering that recording mixed reality videos requires virtual images in addition to real images, the user can control a second camera with the same viewing angle as the first camera in the mixed reality space presented by the HMD to record the virtual images in the mixed reality space while recording the real images of the real objects through the first camera on the smartphone.

[0076] In some optional embodiments, the user can turn on the mixed reality video recording function of the HMD, so that the HMD creates a second camera with the same viewing angle as the first camera in the presented mixed reality space according to the mixed reality video recording instruction sent by the user. Then, the target virtual screen including at least one virtual object in the mixed reality space is recorded by the second camera. Then, the target virtual screen recorded by the second camera is sent to the smartphone in real time, so that the smartphone generates a mixed reality video according to the target virtual screen sent by the HMD and the real screen recorded by the first camera.

[0077] Among them, when the mixed reality video recording function of the HMD is turned on, it can be executed before starting the mixed reality video recording function of the smartphone, or it can be executed after starting the mixed reality video recording function of the smartphone, and this application does not impose any restrictions on this.

[0078] When creating the second camera with the same viewing angle as the first camera, the location information of the smartphone (i.e., the first camera) can be obtained according to the location tracking function enabled by the smartphone, and the location information of the first camera is sent to the HMD through the network, so that the HMD creates the second camera according to the location information of the first camera and the coordinate system conversion relationship between the virtual space and the real space. The implementation process of creating the second camera will be described in detail in the following embodiments, and will not be described in detail here.

[0079] In the present application, the second camera is specifically a third-perspective camera, and the third perspective is preferably a foreground and background virtual camera.

[0080] That is to say, when the HMD controls the second camera to capture the target virtual picture in the mixed reality space, the second camera can capture the virtual foreground picture and the virtual background picture (virtual background picture) at the same timestamp from the third perspective. Correspondingly, when the HMD sends the target virtual picture to the smartphone, the virtual foreground picture and the virtual subsequent picture at the same timestamp can be optionally packaged together and sent to the smartphone, so that the smartphone can quickly generate a mixed reality video based on the packaged picture and the real picture at the same timestamp.

[0081] S103, generating a mixed reality video according to the real picture and the target virtual picture, wherein the mixed reality video uses the real objects in the real picture and the virtual objects in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture.

[0082] Among them, the foreground picture of the mixed reality video picture may include at least one virtual object.

[0083] Optionally, the smart phone can determine the real picture and the target virtual picture at the same timestamp based on the acquired real-time real picture and the real-time target virtual picture. Then, the real picture at each timestamp is processed by foreground and background segmentation to obtain the real object picture and the real background picture at each timestamp. At the same time, the target virtual picture at each timestamp is processed by foreground and background separation to obtain the virtual foreground picture and the virtual background picture at each timestamp.

[0084] The virtual foreground picture refers to a virtual object picture, the virtual background picture refers to a content picture other than the virtual object, and the real background picture refers to a content picture other than the real object.

[0085] It can be understood that the above-mentioned real object picture can be selected as a portrait picture, and the real background picture can be selected as a real environment picture.

[0086] In the present application, the foreground and background segmentation processing is performed on the real picture, and the foreground background segmentation algorithm, the foreground background segmentation algorithm based on Gaussian mixture, the foreground background segmentation algorithm based on K nearest neighbor, the segmentation function in OpenCV or the foreground background segmentation model can be optionally used, and no specific restrictions are made here.

[0087] Furthermore, considering that the target virtual picture is specifically a packaged picture of virtual foreground and background pictures at different timestamps, when the present application separates the foreground and background of the target virtual picture, it is to split the overall virtual picture packaged at the same timestamp into a virtual foreground picture and a virtual background picture. The present application does not impose any restrictions on the splitting method.

[0088] After obtaining the real object picture, real background picture, virtual foreground picture and virtual background picture at each timestamp, the smart phone can optionally use the real background picture at each timestamp as the background picture in the mixed reality video, and use the real object picture and virtual foreground picture at each timestamp as the foreground picture to perform picture fusion to generate a mixed reality video.

[0089] It can be understood that the present application sets a smartphone in the real space where the user uses the HMD, so as to capture the user's real picture from a third perspective through the first camera on the smartphone, and captures the target virtual picture through the second camera with the same perspective as the first camera created by the HMD in the mixed reality space, and then generates a mixed reality video based on the real picture and the target virtual picture, with the real objects in the real picture and the virtual objects in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture, thereby solving the problem of the single mixed reality video recording form when synthesizing the real objects in the real video into the virtual background in the virtual video in the traditional mixed reality video recording method, thereby enriching the recording form of the mixed reality video and meeting the diverse needs of users for recording mixed reality videos.

[0090] The technical solution provided in the embodiment of the present application controls the first camera to capture the real picture of the real object based on the detected video recording instruction, and obtains the target virtual picture sent by the second terminal, and then generates a mixed reality video with the real object in the real picture and at least one virtual object in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture according to the real picture and the target virtual picture. This can enrich the form of recorded mixed reality videos, meet the diverse needs of users, and thus improve the user experience.

[0091] Based on the above embodiments, the generation of mixed reality video according to the real picture and the target virtual picture in this application is further explained. Figure 3 and 4 . Figure 3 A schematic diagram of generating a mixed reality video based on a real image and a target virtual image. Figure 3 On the basis of Figure 4 As shown, the above S103 includes the following steps:

[0092] S103-1, determining a real foreground picture and a real background picture according to the real picture.

[0093] S103 - 2 , determining a virtual foreground picture and a virtual background picture according to the target virtual picture.

[0094] S103-3, the real foreground picture, the real background picture, the virtual foreground picture and the virtual background picture are integrated to generate a mixed reality video.

[0095] Among them, the mixed reality video uses the real objects in the real picture and the virtual objects in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture.

[0096] In some optional embodiments, the present application may splice the real foreground picture, the real background picture, the virtual foreground picture and the virtual background picture at the same timestamp in the order of the real background picture as the first layer, the virtual background picture as the second layer, the real foreground picture as the third layer and the virtual foreground picture as the fourth layer to obtain the mixed reality picture at each timestamp. Then, a mixed reality video is generated according to the mixed reality picture at each timestamp.

[0097] In the present application, a mixed reality video is generated based on the mixed reality screen at each timestamp, which specifically means integrating the mixed reality screen at each timestamp in the order of the timestamps to obtain the mixed reality video.

[0098] As an optional implementation method, the real foreground picture, the real background picture, the virtual foreground picture and the virtual background picture at the same timestamp are spliced ​​to obtain the mixed reality picture at each timestamp. Optionally, the pixel values ​​of the same position pixel points in the real foreground picture, the real background picture, the virtual foreground picture and the virtual background picture at the same timestamp are summed. Then, the sum value of each pixel point is used as the pixel value of the corresponding position pixel point in the mixed reality picture obtained after fusion, thereby obtaining the mixed reality picture at each timestamp.

[0099] The above-mentioned technical solution provided by the present application fuses the pictures at each timestamp in the fusion order of the real background picture as the first layer, the virtual background picture as the second layer, the real foreground picture as the third layer and the virtual foreground picture as the fourth layer, so as to obtain a mixed reality picture with the real objects in the real picture and the virtual objects in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture, and then obtains a mixed reality video based on the mixed reality pictures at all timestamps, thereby enriching the form of recorded mixed reality videos and meeting the diverse needs of users.

[0100] In some optional implementations, considering that when generating a mixed reality video based on the real picture recorded by the first camera and the target virtual picture sent by the second terminal device, the first camera and the second camera need to capture the real picture and the virtual picture under the same perspective. Therefore, before controlling the first camera to record the real picture of the real object and the second camera to record the target virtual picture, the present application needs to ensure that the perspective of the first camera and the perspective of the second camera are aligned, that is, the first camera and the second camera have the same perspective, so that when the real picture recorded by the first camera and the target virtual picture recorded by the second camera are mixed, the pictures are also aligned. Then combined with Figure 5 , the process of aligning the viewing angle of the first camera and the viewing angle of the second camera is described in detail.

[0101] like Figure 5 As shown, the method may include the following steps:

[0102] S201, obtaining a position calibration parameter sent by a second terminal device, where the position calibration parameter is position information of a second camera.

[0103] S202: Calibrate the position information of the first camera according to the position calibration parameters.

[0104] Optionally, when the HMD obtains the mixed reality video recording instruction sent by the user, the HMD creates a second camera in the mixed reality space presented by the HMD through a virtual engine, such as unity or UE (Unreal Engine), and obtains the position information of the second camera. Then, the position information of the second camera is sent to the smartphone as a position calibration parameter.

[0105] Furthermore, after the smart device obtains the position calibration parameters sent by the HMD, it calibrates the first camera based on the position calibration parameters to ensure that the viewing angle of the first camera is aligned with the viewing angle of the second camera.

[0106] The position of the second camera mentioned above can be selected as the initial position information of the second camera.

[0107] In some optional embodiments, when the smartphone calibrates the first camera based on the position calibration parameters, the position calibration parameters may be displayed on the smartphone screen, and then based on the position calibration parameters displayed on the screen, the user moves the smartphone so that the center point of the smartphone screen coincides with the position calibration parameters. At this time, it is determined that the plane where the first camera and the second camera on the smartphone are located are aligned.

[0108] Taking into account that when a user moves a smartphone, there will be different degrees of shaking. Therefore, when the first camera on the smartphone is aligned with the plane where the second camera is located and is in a stable state, the present application can also obtain the new position information of the first camera after calibration through the 6 degrees of freedom (dof) positioning and tracking function turned on by the smartphone. Among them, the new position information after the first camera is calibrated can be understood as the new position information after the smartphone moves. Furthermore, the smartphone determines the position conversion relationship between the first camera and the second camera based on the new position information and position calibration parameters after the first camera is calibrated. The position conversion relationship between the first camera and the second camera can be understood as the coordinate system conversion relationship between the real space and the mixed reality space.

[0109] As an optional implementation, the position conversion relationship between the first camera and the second camera is determined according to the new position information and position calibration parameters after the first camera is calibrated, which can be implemented by the following formula (1):

[0110] (M*P1)*P1 -1 =P0*P1 -1 ………………………………(1)

[0111] Wherein, M represents the position conversion relationship between the first camera and the second camera, P1 represents the new position information after calibration of the first camera, P0 represents the position calibration parameter, and -1 represents the inverse processing.

[0112] Furthermore, when the first camera moves from the first position to the second position, the smartphone can determine the position change according to the first position and the second position, and based on the position change and the position calibration parameters (initial position information) of the second camera, the new position information of the second camera can be determined. Then, the smartphone can send the new position information of the second camera to the HMD, so that the HMD moves the second camera from the initial position to the new position sent by the smartphone. In this way, the alignment purpose of the first camera and the second camera is achieved. When the position of the first camera changes, the position of the corresponding second virtual camera also changes accordingly, so that the viewing angle of the second camera is always the same as that of the first camera.

[0113] For example, assuming that the first position of the first camera is P11, the second position is P12, the position conversion relationship between the first camera and the second camera is M, and the position calibration parameter is P01, then when the position of the first camera is the second position P12, the current position of the second virtual camera is: P02 = N*M+P01, where N = P12-P11. That is, N represents the position change of the first camera from the first position P11 to the second position P12.

[0114] The technical solution provided in the embodiment of the present application calibrates the position of the first camera based on the position of the second camera created by the second terminal device in the mixed reality space before controlling the first camera to capture the real picture of the real object and obtaining the target virtual picture sent by the second terminal device, so that after the calibration, no matter how the first camera moves, the viewing angle of the second camera created by the second terminal device in the mixed reality space is always aligned with the first camera, thereby determining that the real picture recorded by the first camera and the target virtual picture recorded by the second camera are always aligned, so that the mixed reality video generated based on the real picture recorded by the first camera and the target virtual picture recorded by the second camera has better quality, thereby enhancing the user's interest in recording mixed reality videos.

[0115] See also Figure 6 The embodiment of the present application further provides a video recording method, which is applied to a second terminal device and may include the following steps:

[0116] S301, in response to a video recording instruction sent by a user, creating a second camera in a mixed reality space, where the mixed reality space includes: at least one virtual object.

[0117] The above video recording instructions are specifically mixed reality video recording instructions.

[0118] Optionally, after wearing and starting the HMD, the user can select any virtual space from the multiple virtual spaces provided by the HMR and enter the selected virtual space, such as a mixed reality space. The mixed reality space will display various virtual applications to the user, such as a virtual live broadcast application, a virtual game application, etc. Thus, the user can select any virtual application and display the virtual screen of the virtual application in the mixed reality space, so that the user can interact with at least one virtual object in the virtual screen in the mixed reality space.

[0119] At least one virtual object in the above-mentioned virtual screen may exist when the user enters the mixed reality space, or may be a virtual object created or added in the mixed reality space after the user enters the mixed reality space using the virtual object panel presented in the mixed reality space. This application does not impose any restrictions on this.

[0120] It should be noted that after entering the mixed reality space based on the HMD, the user can also calibrate the real objects in the real space in the mixed reality space based on the video see-through (VST) function, so that the real objects can be presented to the user in a virtualized form in the mixed reality space. The real objects in the real space can be selected as tables, chairs, beds, cabinets and other objects, and the objects that respond to the virtualization can be selected as virtual tables, virtual chairs, virtual beds, virtual cabinets and other virtual objects.

[0121] Among them, when the user calibrates the real objects in the real space in the mixed reality space based on the VST function, the user can optionally use external devices or gestures to control the cursor to calibrate the virtualized real objects in the mixed reality space according to the outline of the real objects. This application does not limit the implementation method of calibrating the real objects.

[0122] Furthermore, considering the interaction between the user and any virtual object, the user may be interested in it, so it is necessary to record the interaction screen between the user and the virtual object. Then, based on the recorded video screen, it is convenient for the user to watch it again or share it with other users later.

[0123] Therefore, the user can turn on the mixed reality video recording function of the HMD, so that the HMD creates a second camera in the presented mixed reality space according to the mixed reality video recording instruction sent by the user, so that the target virtual picture in the mixed reality space can be recorded based on the second camera. Among them, the second camera can be created in any way, and this application does not impose any restrictions on the creation method of the second camera.

[0124] In addition, the user also turns on the mixed reality video recording function on the smartphone set in the real space where the user is located, so that the first camera on the smartphone records the real image of the real user while the second camera records the target virtual image, thereby laying the foundation for generating mixed reality video.

[0125] The first camera mentioned above can be selected as a camera on the smartphone that can locate the position information of the smartphone in the current space, such as an AR camera or an MR camera.

[0126] The second camera is specifically a third-perspective camera, and the third perspective is preferably a foreground and background virtual camera.

[0127] In some optional embodiments, when the user sends a mixed reality video recording instruction to the HMD, it may include but is not limited to the following situations:

[0128] In the first case, the user may send a mixed reality video recording instruction to the HMD by selecting a mixed reality video recording control presented in the mixed reality space.

[0129] In order to facilitate the user to send a video recording instruction to the HMD, the present application optionally displays a mixed reality video recording control at any position in the mixed reality space presented by the HMD that does not block other objects. Furthermore, when the user needs to send a mixed reality video recording instruction, he can send a mixed reality video recording instruction to the HMD by selecting the mixed reality video recording control presented in the mixed reality space.

[0130] In the second case, the user can send a mixed reality video recording instruction to the HMD through an external device connected to the HMD for communication.

[0131] Typically, the HMD will establish a communication connection with an external device such as a handle, hand controller, bracelet or ring. Therefore, the user can open the control interface in the mixed reality space through the external device, and trigger the mixed reality video recording control in the control interface to send a mixed reality video recording instruction to the HMD. Alternatively, the user can send a mixed reality video recording instruction to the HMD by pressing a preset video recording control on the external device, and this application does not impose any restrictions on this.

[0132] In some optional embodiments, after creating a second camera in the mixed reality space, the present application also includes: obtaining position information of the second camera; sending the position information of the second camera to the first terminal device to instruct the first terminal device to calibrate the position information of the first camera based on the position information of the second camera, and determine the position conversion relationship between the first camera and the second camera.

[0133] That is to say, the present application can send the created initial position of the second camera as a position calibration parameter to the smartphone, so that the smartphone can perform position calibration on the first camera based on the position calibration parameter, so that the perspectives of the calibrated first camera and the second camera are aligned. Thus, when the first camera moves, the position of the second camera also changes accordingly, and the corresponding perspective of the second camera also changes with the perspective of the first camera. Thus, it is ensured that the perspectives of the first camera and the second camera are always aligned. For the specific alignment process of the first camera and the second camera, please refer to the aforementioned embodiment applied to the smartphone, and no further elaboration will be given here.

[0134] S302, recording a target virtual picture in the mixed reality space through a second camera, where the target virtual picture includes: at least one virtual object.

[0135] S303: Send the target virtual picture to the first terminal device to instruct the first terminal to generate a mixed reality video based on the target virtual picture.

[0136] Among them, the mixed reality video uses the real objects in the real picture and the virtual objects in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture.

[0137] Optionally, when the position information of the second camera sent by the smartphone is obtained, the HMD can selectively adjust the position of the second camera based on the above position information through the virtual engine. Then, the HMD can record the target virtual picture in the mixed reality space through the second camera. At the same time, the target virtual picture recorded by the second camera is sent to the smartphone in real time, so that the smartphone generates a mixed reality video based on the target virtual picture sent by the HMD and the real picture recorded by the first camera.

[0138] The position information of the second camera mentioned above may be selected as initial position information, or as new position information determined after the position of the first camera is changed.

[0139] Considering that the second camera is a third-perspective camera, and the third-perspective camera is specifically a virtual foreground and background camera. Therefore, the target virtual picture recorded by the second camera in this application is specifically a third-perspective target virtual picture in the mixed reality space recorded by the third-perspective foreground and background virtual cameras, and the third-perspective target virtual picture has the same perspective as the real picture recorded by the first camera.

[0140] The technical solution provided in the embodiment of the present application creates a second camera in a mixed reality space according to a video recording instruction sent by a user, so as to record a target virtual screen including at least one virtual object in the mixed reality space through the second camera, and then sends the target virtual screen to a first terminal, so that the first terminal generates a mixed reality video with real objects in the real screen and virtual objects in the target virtual screen as foreground screens, and real background in the real screen as background screen according to the target virtual screen and the real screen recorded by the first camera. This can enrich the form of recorded mixed reality videos, meet the diverse needs of users, and thus improve the user experience.

[0141] Please refer to the attached Figure 7 , a video recording device proposed in an embodiment of the present application is described. Figure 7 A schematic block diagram of a video recording device provided in an embodiment of the present application, wherein the video recording device is configured in a first terminal device, and the first terminal device includes: a first camera.

[0142] like Figure 7 As shown, the video recording device 400 includes: a first recording module 410 , a picture acquisition module 420 and a video generation module 430 .

[0143] The first recording module 410 is used to control the first camera to record a real picture of a real object in response to a detected video recording instruction;

[0144] The picture acquisition module 420 is used to acquire a target virtual picture sent by the second terminal device, wherein the target virtual picture is recorded based on a second camera created by the second terminal device in the mixed reality space, and the target virtual picture includes: at least one virtual object;

[0145] The video generation module 430 is used to generate a mixed reality video based on the real picture and the target virtual picture. The mixed reality video uses the real objects in the real picture and the virtual objects in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture.

[0146] In one or more optional implementations of the embodiment of the present application, the video generation module 430 includes:

[0147] A first determining unit, configured to determine a real foreground picture and a real background picture according to the real picture;

[0148] A second determining unit, configured to determine a virtual foreground picture and a virtual background picture according to the target virtual picture;

[0149] The image fusion unit is used to fuse the real foreground image, the real background image, the virtual foreground image and the virtual background image to generate the mixed reality video.

[0150] In one or more optional implementations of the embodiments of the present application, the picture fusion unit is specifically used to:

[0151] splicing the real foreground picture, the real background picture, the virtual foreground picture and the virtual background picture at the same timestamp in the order of the real background picture as the first layer, the virtual background picture as the second layer, the real foreground picture as the third layer and the virtual foreground picture as the fourth layer to obtain a mixed reality picture at each timestamp;

[0152] The mixed reality video is generated according to the mixed reality picture at each timestamp.

[0153] One or more optional implementations of the embodiments of the present application may also include:

[0154] A parameter acquisition module, used to acquire a position calibration parameter sent by the second terminal device, where the position calibration parameter is the position information of the second camera;

[0155] A position calibration module is used to calibrate the position information of the first camera according to the position calibration parameters.

[0156] One or more optional implementations of the embodiments of the present application may also include:

[0157] A position acquisition module, used to acquire new position information of the first camera after calibration;

[0158] The relationship determination module is used to determine the position conversion relationship between the first camera and the second camera according to the new position information after the first camera is calibrated and the position calibration parameters.

[0159] It should be understood that the device embodiment and the aforementioned method embodiment may correspond to each other, and similar descriptions may refer to the method embodiment. To avoid repetition, they will not be described here. Specifically, Figure 7 The apparatus 400 shown may perform Figure 2 The corresponding method embodiments, and the aforementioned and other operations and / or functions of each module in the device 400 are respectively to implement Figure 2 For the sake of brevity, the corresponding processes in each method are not repeated here.

[0160] The above describes the device 400 of the embodiment of the present application from the perspective of the functional module in conjunction with the accompanying drawings. It should be understood that the functional module can be implemented in hardware form, can be implemented by instructions in software form, and can also be implemented by a combination of hardware and software modules. Specifically, the steps of the first aspect method embodiment in the embodiment of the present application can be completed by the hardware integrated logic circuit and / or software form instructions in the processor, and the steps of the first aspect method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or a combination of hardware and software modules in the decoding processor to perform. Optionally, the software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory, and completes the steps in the above-mentioned first aspect method embodiment in conjunction with its hardware.

[0161] Please refer to the attached Figure 8 , another video recording device proposed in an embodiment of the present application is described. Figure 8 A schematic block diagram of a video recording device provided in an embodiment of the present application. The video recording device is configured in a second terminal device. Figure 8 As shown, the video recording device 500 includes: a creation module 510 , a second recording module 520 and a picture sending module 530 .

[0162] The creation module 510 is configured to create a second camera in a mixed reality space in response to a video recording instruction sent by a user, wherein the mixed reality space includes: at least one virtual object;

[0163] A second recording module 520 is configured to record a target virtual image in the mixed reality space through the second camera, wherein the target virtual image includes: at least one virtual object;

[0164] The screen sending module 530 is used to send the target virtual screen to the first terminal device to instruct the first terminal to generate a mixed reality video based on the target virtual screen, wherein the mixed reality video uses the real objects in the real screen and the virtual objects in the target virtual screen as the foreground screen, and the real background in the real screen as the background screen.

[0165] In one or more optional implementations of the embodiment of the present application, the second camera is a third-viewing angle camera;

[0166] Accordingly, the second recording module 520 is specifically configured to:

[0167] The third-perspective target virtual image in the mixed reality space is recorded through the third-perspective camera.

[0168] In one or more optional implementations of the embodiments of the present application, the third-view camera is a foreground and background virtual camera.

[0169] One or more optional implementations of the embodiments of the present application may also include:

[0170] An information acquisition module, used to acquire the position information of the second camera;

[0171] An information sending module is used to send the position information of the second camera to the first terminal device to instruct the first terminal device to calibrate the position information of the first camera based on the position information of the second camera and determine the position conversion relationship between the first camera and the second camera.

[0172] It should be understood that the device embodiment and the aforementioned method embodiment may correspond to each other, and similar descriptions may refer to the method embodiment. To avoid repetition, they will not be described here. Specifically, Figure 8 The apparatus 500 shown may perform Figure 6 The corresponding method embodiments, and the aforementioned and other operations and / or functions of each module in the device 500 are respectively to implement Figure 6 For the sake of brevity, the corresponding processes in each method are not repeated here.

[0173] The above describes the device 500 of the embodiment of the present application from the perspective of the functional module in conjunction with the accompanying drawings. It should be understood that the functional module can be implemented in hardware form, can be implemented by instructions in software form, and can also be implemented by a combination of hardware and software modules. Specifically, each step of the second aspect method embodiment in the embodiment of the present application can be completed by the hardware integrated logic circuit and / or software form instructions in the processor, and the steps of the second aspect method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or a combination of hardware and software modules in the decoding processor to perform. Optionally, the software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory, and completes the steps in the above-mentioned second aspect method embodiment in conjunction with its hardware.

[0174] Fig. 9 A schematic block diagram of an electronic device provided in an embodiment of the present application. Fig. 9 As shown, the electronic device 600 may include:

[0175] The memory 610 and the processor 620, the memory 610 is used to store the computer program and transmit the program code to the processor 620. In other words, the processor 620 can call and run the computer program from the memory 610 to implement the video recording method in the embodiment of the present application.

[0176] For example, the processor 620 may be used to execute the above-mentioned video recording method embodiment according to the instructions in the computer program.

[0177] In some embodiments of the present application, the processor 620 may include but is not limited to:

[0178] General-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.

[0179] In some embodiments of the present application, the memory 610 includes but is not limited to:

[0180] Volatile memory and / or non-volatile memory. Among them, the non-volatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM) or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus random access memory (DR RAM).

[0181] In some embodiments of the present application, the computer program may be divided into one or more modules, which are stored in the memory 610 and executed by the processor 620 to complete the video recording method provided by the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic device.

[0182] like Fig. 9 As shown, the electronic device 600 may further include:

[0183] The transceiver 630 may be connected to the processor 620 or the memory 610 .

[0184] The processor 620 may control the transceiver 630 to communicate with other devices, specifically, to send information or data to other devices, or to receive information or data sent by other devices. The transceiver 630 may include a transmitter and a receiver. The transceiver 630 may further include an antenna, and the number of antennas may be one or more.

[0185] It should be understood that the various components in the electronic device are connected via a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.

[0186] The present application also provides a computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the video recording method described in the above method embodiment.

[0187] An embodiment of the present application also provides a computer program product including program instructions. When the program instructions are executed on an electronic device, the electronic device executes the video recording method of the above method embodiment.

[0188] When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (digital video disc, DVD)), or a semiconductor medium (e.g., a solid state drive (solid state disk, SSD)), etc.

[0189] Those of ordinary skill in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0190] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the module is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0191] The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. For example, each functional module in each embodiment of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

[0192] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A video recording method, characterized in that: Applied to a first terminal device, the first terminal device includes: a first camera, and the method includes: In response to the detected video recording instruction, controlling the first camera to record a real picture of a real object; Acquire a target virtual picture sent by the second terminal device, where the target virtual picture is recorded based on a second camera created by the second terminal device in the mixed reality space, and the target virtual picture includes: at least one virtual object; A mixed reality video is generated according to the real picture and the target virtual picture, wherein the mixed reality video uses the real objects in the real picture and the virtual objects in the target virtual picture as foreground pictures, and uses the real background in the real picture as background picture.

2. The method according to claim 1, characterized in that The generating a mixed reality video according to the real picture and the target virtual picture includes: Determining a real foreground picture and a real background picture according to the real picture; Determining a virtual foreground picture and a virtual background picture according to the target virtual picture; The real foreground picture, the real background picture, the virtual foreground picture and the virtual background picture are merged to generate the mixed reality video.

3. The method according to claim 2, characterized in that The step of fusing the real foreground picture, the real background picture, the virtual foreground picture and the virtual background picture to generate the mixed reality video includes: splicing the real foreground picture, the real background picture, the virtual foreground picture and the virtual background picture at the same timestamp in the order of the real background picture as the first layer, the virtual background picture as the second layer, the real foreground picture as the third layer and the virtual foreground picture as the fourth layer to obtain a mixed reality picture at each timestamp; The mixed reality video is generated according to the mixed reality picture at each timestamp.

4. The method according to claim 1, characterized in that Also includes: Obtaining a position calibration parameter sent by the second terminal device, where the position calibration parameter is position information of the second camera; The position information of the first camera is calibrated according to the position calibration parameters.

5. The method according to claim 4, characterized in that Also includes: Obtaining new position information of the first camera after calibration; A position conversion relationship between the first camera and the second camera is determined according to the new position information after the first camera is calibrated and the position calibration parameters.

6. A video recording method, characterized in that: Applied to a second terminal device, the method includes: In response to a video recording instruction sent by a user, creating a second camera in a mixed reality space, the mixed reality space including: at least one virtual object; Recording a target virtual picture in the mixed reality space by the second camera, wherein the target virtual picture includes: at least one virtual object; The target virtual screen is sent to a first terminal device to instruct the first terminal to generate a mixed reality video based on the target virtual screen, wherein the mixed reality video uses real objects in the real screen and virtual objects in the target virtual screen as foreground screens, and uses real background in the real screen as background screen.

7. The method according to claim 6, characterized in that The second camera is a third-angle camera; Correspondingly, recording the target virtual picture in the mixed reality space through the second camera includes: The third-perspective target virtual image in the mixed reality space is recorded through the third-perspective camera.

8. The method according to claim 7, characterized in that The third-viewing angle camera is a virtual front and back view camera.

9. The method according to claim 6, characterized in that Also includes: Obtaining location information of the second camera; The position information of the second camera is sent to the first terminal device to instruct the first terminal device to calibrate the position information of the first camera based on the position information of the second camera, and determine the position conversion relationship between the first camera and the second camera.

10. A video recording device, characterized in that: Configured in a first terminal device, the first terminal device includes: a first camera, including: A first recording module, configured to control the first camera to record a real picture of a real object in response to a detected video recording instruction; A picture acquisition module, used to acquire a target virtual picture sent by a second terminal device, wherein the target virtual picture is recorded based on a second camera created by the second terminal device in a mixed reality space, and the target virtual picture includes: at least one virtual object; A video generation module is used to generate a mixed reality video based on the real picture and the target virtual picture, wherein the mixed reality video uses the real objects in the real picture and the virtual objects in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture.

11. A video recording device, characterized in that: The second terminal device is configured to include: A creation module, configured to create a second camera in a mixed reality space in response to a video recording instruction sent by a user, wherein the mixed reality space includes: at least one virtual object; A second recording module, configured to record a target virtual picture in the mixed reality space through the second camera, wherein the target virtual picture includes: at least one virtual object; A picture sending module is used to send the target virtual picture to a first terminal device to instruct the first terminal to generate a mixed reality video based on the target virtual picture, wherein the mixed reality video uses the real objects in the real picture and the virtual objects in the target virtual picture as the foreground picture, and the real background in the real picture as the background picture.

12. An electronic device, characterized in that: include: A processor and a memory, wherein the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory to execute the video recording method according to any one of claims 1 to 9.

13. A computer-readable storage medium, characterized in that: Used to store a computer program, wherein the computer program enables a computer to execute the video recording method according to any one of claims 1 to 9.

14. A computer program product comprising program instructions, characterized in that When the program instructions are executed on an electronic device, the electronic device executes the video recording method as described in any one of claims 1 to 9.

Images