Method and electronic device for playing back six-degree-of-freedom video.

Abstract

This invention relates to a method and electronic device for playing six-degree-of-freedom video in the field of immersive video technology. The method includes obtaining a first position, which is the position of a target object in the six-degree-of-freedom video in a virtual three-dimensional space at a given time, and a second position, which is the viewpoint position of the user in the virtual three-dimensional space at the same time; obtaining the line of sight direction according to the first and second positions; obtaining a target viewpoint stream corresponding to the line of sight direction from among multiple viewpoint streams of the six-degree-of-freedom video; and playing the six-degree-of-freedom video in a virtual three-dimensional space based on the target viewpoint stream.

Description

Technical Field

[0005] , ,

[0001] [Related Application] This application claims the priority of a Chinese patent application filed on April 24, 2023, with the title "Method for Playing Six-Degree-of-Freedom Video and Electronic Device" and the application number 2023104570817, the entire content of which is incorporated herein by reference. [Technical Field]

[0002] This application relates to the technical field of immersive video, and particularly to a method for playing six-degree-of-freedom video and an electronic device.

Background Art

[0003] With the continuous development of display technology, users' requirements for video viewing experiences are becoming increasingly high. In related technologies, more immersive videos such as 3D videos and virtual reality (VR) videos have been proposed. However, in these videos, they often only support viewing 3-degree-of-freedom (DOF) videos by switching pitch, roll, and yaw, and can only view videos from preset viewpoint positions, and cannot freely switch the viewpoint position to view video content from different viewpoint positions.

[0004] To solve the problem that videos can only be viewed from one viewpoint position, six-degree-of-freedom technology has been proposed in related technologies. The six-degree-of-freedom technology is a technology for enhancing the degree of freedom of video viewing. Users can adjust the viewing viewpoint position by interaction means during video viewing and view from a free viewpoint position they want to view, thereby greatly enhancing the immersion of video viewing. Theoretically, playing six-degree-of-freedom videos in a virtual 3D space can enhance both the video viewing scene and the degree of freedom of video viewing, further enhancing the immersion of the video.

Summary of the Invention

[0005] In view of this, the embodiment of the present application provides a method for reproducing six-degree-of-freedom video and an electronic device for realizing the reproduction of six-degree-of-freedom video in a virtual three-dimensional space.

[0006] To achieve the above objective, the embodiments of this application provide the following technical solutions.

[0007] In a first embodiment, the embodiment of the present application provides a method for reproducing a six-degree-of-freedom video, the method being: The process involves obtaining a first position, which is the position of a target object in a six-degree-of-freedom video in a virtual three-dimensional space at a given time, and a second position, which is the viewpoint position in the virtual three-dimensional space at the same time, Depending on the first and second positions, the line of sight direction from the viewpoint position to the target object is obtained, Among the multiple viewing angle streams of the six-degree-of-freedom video, the target viewing angle stream corresponding to the line of sight is obtained, This includes playing back the six-degree-of-freedom video in the virtual three-dimensional space based on the target viewing angle stream.

[0008] As one selectable embodiment of the embodiments of the present application, the six-degree-of-freedom image is reproduced in the virtual three-dimensional space based on the target viewing angle stream. The virtual screen is placed in the aforementioned virtual 3D space, This includes playing video content corresponding to the target viewing angle stream on the virtual screen in order to play the six-degree-of-freedom video in the virtual three-dimensional space.

[0009] As one of the selectable embodiments of the present invention, a virtual screen is placed in the virtual three-dimensional space. The pose of the virtual screen is determined according to the line of sight direction and the first position, This includes placing the virtual screen in the virtual three-dimensional space according to the pose of the virtual screen.

[0010] As one selectable embodiment of the embodiments of the present application, determining the pose of the virtual screen according to the line of sight and the first position, This includes determining that the virtual screen is located at the first position and determining that the plane on which the virtual screen is located is perpendicular to the line of sight.

[0011] As one selectable embodiment of the embodiments of the present application, the method is: Obtaining the target distance, which is the distance between the first position and the second position, This includes setting the size of the virtual screen according to the target distance, The size of the virtual screen is negatively correlated with the target distance.

[0012] As one selectable embodiment of the present invention, among the multiple viewing angle streams of the six-degree-of-freedom video, the target viewing angle stream corresponding to the line of sight is obtained. Obtaining a target viewing angle stream identifier according to the aforementioned viewing direction, Sending a view angle stream request to the server that carries the aforementioned target view angle stream identifier, This includes receiving a view angle stream response that carries the target view angle stream, transmitted from the server.

[0013] As one of the selectable embodiments of the present invention, obtaining a target viewing angle stream identifier according to the viewing direction is: This includes obtaining the target viewing angle stream identifier based on the aforementioned viewing direction and a predetermined mapping relationship, The predetermined mapping relationship includes each of the six-degree-of-freedom video's viewing angle streams and the directions corresponding to each of the six-degree-of-freedom video's viewing angle streams.

[0014] In a second embodiment, the embodiment of the present application provides an electronic device, which is An acquisition unit for acquiring a first position, which is the position of a target object in a six-degree-of-freedom video in a virtual three-dimensional space at a given time, and a second position, which is the viewpoint position of the user in the virtual three-dimensional space at the same time. A processing unit for obtaining the line of sight direction according to the first and second positions, and for obtaining a target viewing angle stream corresponding to the line of sight direction from among multiple viewing angle streams of the six-degree-of-freedom video, The system includes a playback unit for playing back the six-degree-of-freedom video in the virtual three-dimensional space based on the target viewing angle stream.

[0015] In one selectable embodiment of the present invention, the playback unit is specifically used to install a virtual screen in the virtual three-dimensional space and to play video content corresponding to the target viewing angle stream on the virtual screen, thereby playing the six-degree-of-freedom video in the virtual three-dimensional space.

[0016] In one selectable embodiment of the embodiments of the present application, the playback unit is specifically used to determine the pose of the virtual screen according to the line of sight and the first position, and to place the virtual screen in the virtual three-dimensional space according to the pose of the virtual screen.

[0017] In one selectable embodiment of the embodiments of the present application, the playback unit is specifically used to determine that the virtual screen is located at the first position and that the plane on which the virtual screen is located is perpendicular to the line of sight.

[0018] As one selectable embodiment of the embodiments of the present application, the playback unit is further used to obtain a target distance which is the distance between the first position and the second position, and to set the size of the virtual screen according to the target distance. Here, the size of the virtual screen is negatively correlated with the target distance.

[0019] As one selectable embodiment of an example of the present application, specifically, the processing unit is used to obtain a target viewing angle stream identifier according to the viewing line direction, send a viewing angle stream request carrying the target viewing angle stream identifier to a server, and receive a viewing angle stream response carrying the target viewing angle stream sent from the server.

[0020] As one selectable embodiment of an example of the present application, specifically, the processing unit is used to obtain the target viewing angle stream identifier based on the viewing line direction and a predetermined mapping relationship. The predetermined mapping relationship includes each viewing angle stream of the six-degree-of-freedom video and the direction corresponding to each viewing angle stream of the six-degree-of-freedom video.

[0021] In a third aspect, an example of the present application provides an electronic device, which includes a memory and a processor. The memory is used to store a computer program, and when the processor executes the computer program, it is used to cause the electronic device to implement the method for playing a six-degree-of-freedom video described in any of the above embodiments.

[0022] In a fourth aspect, when executed by a computing device, an example of the present application provides a computer-readable storage medium for causing the computing device to implement the method for playing a six-degree-of-freedom video described in any of the above embodiments.

[0023] In a fifth aspect, when executed on a computer, an example of the present application provides a computer program product for causing the computer to implement the method for playing a six-degree-of-freedom video described in any of the above embodiments.

Brief Description of the Drawings

[0024] The accompanying drawings are incorporated herein and constitute part of this specification, illustrating embodiments conforming to this application and are used together with the specification to interpret the principles of this application.

[0025] To more clearly explain the embodiments of this application or the technical proposals in the prior art, the accompanying drawings that may be used in the description of the embodiments or the prior art are briefly introduced below, although it is obvious to an ordinary person of the art that other drawings can be obtained by following these accompanying drawings without expending any creative effort. [Figure 1] This is a scene architecture diagram of a six-degree-of-freedom video playback method provided by an embodiment of the present invention. [Figure 2] This is a flowchart of the steps for a method of playing back six-degree-of-freedom video provided by an embodiment of the present invention. [Figure 3] This is a schematic diagram of a six-degree-of-freedom video generation method provided by an embodiment of the present invention. [Figure 4] This is a schematic diagram of the line of sight provided by the embodiment of the present application. [Figure 5] This is one schematic diagram of a visual angle stream corresponding to the line of sight direction provided by an embodiment of the present invention. [Figure 6] This is a schematic diagram 2 of the viewing angle stream corresponding to the line of sight provided by the embodiment of the present application. [Figure 7] This is schematic diagram 3 of the viewing angle stream corresponding to the line of sight direction provided by the embodiment of the present application. [Figure 8] Figure 4 is a schematic diagram of the viewing angle stream corresponding to the line of sight direction provided by the embodiment of the present application. [Figure 9] This is flowchart 2 of the steps for the method of playing back six-degree-of-freedom video provided by the embodiment of the present invention. [Figure 10] This is a schematic diagram of the configuration of the electronic device provided by the embodiment of the present application. [Figure 11] This is a schematic diagram of the hardware configuration of the electronic device provided by the embodiment of the present application. [Modes for carrying out the invention]

[0026] To better understand the above-mentioned objectives, features, and advantages of this application, the solution of this application is further described below. Note that the embodiments and features of this application can be combined with each other without contradiction.

[0027] Many specific details are described below in order to fully understand this application, however this application may be implemented in forms other than those described herein, and the examples in the specification are only a selection of, not all, examples of the application.

[0028] In the embodiments of this Application, the terms “exemplary” or “for example” are used to indicate an example, illustration, or explanation. Any embodiment or design solution described as “exemplary” or “for example” in the embodiments of this Application should not be construed as being preferable or advantageous to other embodiments or design solutions. Rather, the use of the terms “exemplary” or “for example” is intended to present the relevant concepts in a particular way. Furthermore, in the description of the embodiments of this Application, unless otherwise stated, “plural” means two or more.

[0029] Below, we will first describe the scene architecture of the six-degree-of-freedom video playback method provided by the embodiment of this application.

[0030] Referring to Figure 1, the scene architecture of the six-degree-of-freedom video playback method provided by the embodiment of the present application includes a server 11 and an electronic device 12. Here, the server 11 is used to generate a six-degree-of-freedom video including a plurality of viewing angle streams, receives a viewing angle stream request from the electronic device 12, and transmits the corresponding viewing angle stream to the electronic device 12. The electronic device 12 constructs a virtual three-dimensional space including a virtual screen for playing the six-degree-of-freedom video, and before each video frame of the six-degree-of-freedom video is played, it obtains a first position of the user's viewpoint in the virtual three-dimensional space and a second position of a target object in the six-degree-of-freedom video, obtains a line of sight direction based on the first and second positions, transmits a request for a target viewing angle stream corresponding to the line of sight direction to the server 11, and plays the video content corresponding to the target viewing angle stream on the virtual screen.

[0031] Here, the method for server 11 to generate a six-degree-of-freedom video including multiple viewing angle streams may include performing motion capture on a real object (e.g., a person or an object), generating drive data to drive a virtual model based on the movement of the real object, driving the virtual model with the drive data, and capturing the driven virtual model as video from different viewing angles using multiple virtual cameras to obtain a six-degree-of-freedom video including multiple viewing angle streams.

[0032] The electronic device in the embodiment of the present application may be an immersive video viewing device such as a VR device or an augmented reality (AR) device.

[0033] In the embodiment of this application, a six-degree-of-freedom video refers to a video that can be viewed by arbitrarily switching the viewpoint position to any of the six directions: front, back, left, right, up, and down in three-dimensional space.

[0034] An embodiment of the present invention provides a method for playing back six-degree-of-freedom video applicable to electronic devices, and referring to Figure 2, this method for playing back six-degree-of-freedom video includes the following steps S21 to S24.

[0035] S21: Get the first and second positions.

[0036] Here, the first position is the position of the target object in the six-degree-of-freedom video in the virtual three-dimensional space at a given time, and the second position is the viewpoint position of the user in the virtual three-dimensional space at that time.

[0037] The six-degree-of-freedom video in the embodiment of the present application includes multiple viewing angle streams obtained by photographing the target object from different viewing angles. For example, referring to Figure 3, when generating the six-degree-of-freedom video, multiple cameras 301 are placed on a sphere centered on the location of the target object 300. The multiple cameras 301 on the sphere photograph the target object 300 from different viewing angles to obtain multiple viewing angle streams, and finally, a six-degree-of-freedom video is generated based on these multiple viewing angle streams. The relative positions of the multiple cameras 301 on the sphere and the target object 300 are fixed. When the target object 300 moves, the multiple cameras 301 move in accordance with the target object 300, and the relative positions of each camera 301 on the sphere and the target object 300 do not change.

[0038] In some embodiments, the method for obtaining the first position may include first transforming the six-degree-of-freedom video and the virtual three-dimensional space into the same coordinate system according to the camera parameters of the six-degree-of-freedom video, and then calculating the position of the target object in the virtual three-dimensional space based on the displacement information of the target object in the coordinate system of the six-degree-of-freedom video and the initial position of the target object in the virtual three-dimensional space.

[0039] In some embodiments, the method for obtaining the second position may include acquiring data collected by an accelerometer, gyroscope, etc., integrated into an electronic device, and calculating the second position based on the data collected by the accelerometer, gyroscope, etc.

[0040] S22: The line of sight direction from the viewpoint position to the target object is obtained according to the first position and the second position.

[0041] In the embodiment of the present application, the line of sight direction is the extension direction from the second position to the first position. For example, referring to Figure 4, if the position of the target object 300 in the six-degree-of-freedom video is P1 in the virtual three-dimensional space, and the user's viewpoint position in the virtual three-dimensional space is P2, then the line of sight direction obtained based on the first position P1 and the second position P2 may be the direction indicated by the arrow in Figure 4.

[0042] S23: Obtain the target viewing angle stream corresponding to the line of sight direction from among the multiple viewing angle streams of the six-degree-of-freedom video.

[0043] In the embodiment of the present invention, the target viewing angle stream corresponding to the line of sight is a viewing angle stream obtained by capturing a video of the target object with a camera located in the line of sight.

[0044] As an example, referring to Figure 5, step S23 above will be explained using the example that in Figure 5, the position of the target object in the six-degree-of-freedom video does not change in the virtual 3D space, but the user's viewpoint position in the said virtual 3D space does change. If the position of the target object 300 in the six-degree-of-freedom video in the virtual 3D space (first position) is 50, and the user's viewpoint position in the said virtual 3D space (second position) is 51, then the line of sight direction is D1, and the camera located at line of sight direction D1 is camera a, so the viewing angle stream obtained by camera a's shooting is set as the target viewing angle stream corresponding to line of sight direction D1. Also, if the user's viewpoint position in the said virtual 3D space (second position) is 52, then the line of sight direction is D2, and the camera located at line of sight direction D2 is camera b, so the viewing angle stream obtained by camera b's shooting is set as the target viewing angle stream corresponding to line of sight direction D2. Furthermore, if the position of the target object in the virtual 3D space does not change, after the user moves from position 51 to position 52, the viewing angle from which the target object is viewed can be switched from direction D1 to direction D2, and the corresponding target viewing angle stream can be switched from the viewing angle stream obtained by camera a to the viewing angle stream obtained by camera b.

[0045] As an example, referring to Figure 6, step S23 above will be explained using the example that in Figure 6, the position of the target object 300 in the six-degree-of-freedom video in the virtual three-dimensional space changes, but the user's viewpoint position in the said virtual three-dimensional space does not change. If the user's viewpoint position (second position) in the virtual three-dimensional space is 60 and the position of the target object 300 in the six-degree-of-freedom video in the virtual three-dimensional space (first position) is 61, the line of sight direction is D3, and the camera located at line of sight direction D3 is camera c, so the viewing angle stream captured by camera c is set as the target viewing angle stream corresponding to line of sight direction D3. Also, if the position of the target object 300 in the six-degree-of-freedom video in the virtual three-dimensional space (first position) is 62, the line of sight direction is D4, and the camera located at line of sight direction D4 is camera d, so the viewing angle stream captured by camera d is set as the target viewing angle stream corresponding to line of sight direction D4. Furthermore, if there is no change in the user's viewpoint position in the virtual 3D space, after the virtual object moves from position 61 to position 62 in the virtual 3D space, the viewing angle of the target object can be switched from direction D3 to direction D4, and the corresponding target viewing angle stream is switched from the viewing angle stream captured by camera c to the viewing angle stream captured by camera d.

[0046] As an example, referring to Figure 7, step S23 above will be explained using the example that both the position of the target object 300 in the six-degree-of-freedom video in the virtual three-dimensional space and the user's viewpoint position in the said virtual three-dimensional space change. When the position of the target object 300 in the six-degree-of-freedom video in the virtual three-dimensional space is 71 and the user's viewpoint position (second position) in the said virtual three-dimensional space is 72, the line of sight direction is D5, and the camera located at the line of sight direction D5 is camera e, so the viewing angle stream captured by camera e is set as the target viewing angle stream corresponding to the line of sight direction D5. Also, when the position of the target object 300 in the six-degree-of-freedom video in the virtual three-dimensional space is 73 and the user's viewpoint position (second position) in the said virtual three-dimensional space is 74, the line of sight direction is D6, and the camera located at the line of sight direction D6 is camera f, so the viewing angle stream captured by camera f is set as the target viewing angle stream corresponding to the line of sight direction. The user's viewpoint in the virtual 3D space moves from position 71 to position 73, and the virtual object in the virtual 3D space moves from position 72 to position 74, thereby switching the viewing angle of the target object from direction D5 to direction D6, and the corresponding target viewing angle stream is switched from the viewing angle stream obtained by camera e to the viewing angle stream obtained by camera f.

[0047] As an example, referring to Figure 8, step S23 above will be explained using the example that both the position of the target object 300 in the six-degree-of-freedom video in the virtual three-dimensional space and the user's viewpoint position in the said virtual three-dimensional space change. When the position of the target object 300 in the six-degree-of-freedom video in the virtual three-dimensional space is 81 and the user's viewpoint position (second position) in the said virtual three-dimensional space is 82, the line of sight direction is D7, and the camera located at the line of sight direction D7 is camera g, so the viewing angle stream captured by camera g is taken as the target viewing angle stream corresponding to the line of sight direction D7. When the position of the target object 300 in the six-degree-of-freedom video in the virtual three-dimensional space is 83 and the user's viewpoint position (second position) in the said virtual three-dimensional space is 84, the line of sight direction is still D7, and the camera located at the line of sight direction D7 is still camera g, so the viewing angle stream captured by camera g is taken as the target viewing angle stream corresponding to the line of sight direction. Furthermore, as the user's viewpoint in the virtual 3D space moves from position 81 to position 83, and the virtual object in the virtual 3D space moves from position 82 to position 84, the viewing angle for the target object remains in direction D7, and the corresponding target viewing angle stream remains the viewing angle stream obtained by the camera g's capture.

[0048] S24: Based on the target viewing angle stream, the six-degree-of-freedom video is played back in the virtual three-dimensional space.

[0049] The method for playing back a six-degree-of-freedom video provided by the embodiment of the present application, when playing back a six-degree-of-freedom video in a virtual three-dimensional space, obtains a first position in the virtual three-dimensional space and a second position in the virtual three-dimensional space of the user's viewpoint at that time, obtains a line of sight direction from the viewpoint position to view the target object based on the first and second positions, obtains a target viewpoint stream corresponding to the line of sight direction from among a plurality of viewpoint streams of the six-degree-of-freedom video, and plays back the six-degree-of-freedom video in the virtual three-dimensional space based on the target viewpoint stream. The line of sight direction determined according to the first and second positions is the line of sight direction in which the user views the target object in the six-degree-of-freedom video in the virtual three-dimensional space. Therefore, by obtaining the target viewing angle stream corresponding to the line of sight direction from among the multiple viewing angle streams of the six-degree-of-freedom video, and playing back the six-degree-of-freedom video in the virtual three-dimensional space based on the target viewing angle stream, it is possible to switch the corresponding viewing angle stream in accordance with the change in the line of sight direction of the user viewing the target object. This has the effect of allowing the corresponding viewing angle stream to be viewed at any viewpoint position, thereby realizing the playback of a six-degree-of-freedom video in the virtual three-dimensional space.

[0050] As an extension and subdivision of the above embodiment, the embodiment of the present application provides another method for playing back six-degree-of-freedom video, which, referring to Figure 9, includes the following steps.

[0051] S901: Get the first and second positions.

[0052] Here, the first position is the position of the target object in the six-degree-of-freedom video in the virtual three-dimensional space at a given time, and the second position is the viewpoint position of the user in the virtual three-dimensional space at that time.

[0053] S902: The line of sight direction from the viewpoint position to the target object is obtained according to the first position and the second position.

[0054] The method for implementing steps S901 and S902 described above is the same as steps S21 and S22 in the embodiment shown in Figure 2, so the explanation will not be repeated here.

[0055] S903: Obtain the target viewing angle stream identifier according to the aforementioned viewing direction.

[0056] In some embodiments, step S903 (obtaining a target viewing angle stream identifier according to the viewing direction) includes obtaining the target viewing angle stream identifier based on the viewing direction and a predetermined mapping relationship.

[0057] Here, the predetermined mapping relationship includes each of the six-degree-of-freedom video's viewing angle streams and the directions corresponding to each of the six-degree-of-freedom video's viewing angle streams.

[0058] For example, the predetermined mapping relationships are shown in Table 1 below. [Table 1]

[0059] If the predetermined mapping relationship is as shown in Table 1 and the line of sight direction is direction 3, the identifier of the viewing angle stream c is determined as the target viewing angle stream identifier.

[0060] S904: Send a view angle stream request to the server that carries the target view angle stream identifier.

[0061] S905: Receives the viewing angle stream response that carries the target viewing angle stream, which was transmitted from the server.

[0062] S906: A virtual screen is set up in the aforementioned virtual 3D space.

[0063] In some embodiments, setting up a virtual screen in the virtual three-dimensional space includes determining the pose of the virtual screen according to the line of sight direction and the first position, and setting up the virtual screen in the virtual three-dimensional space according to the pose of the virtual screen.

[0064] It should be noted that, since the virtual screen always exists in the virtual 3D space during the playback of the six-degree-of-freedom video in the virtual 3D space, setting up a virtual screen in the virtual 3D space and determining the pose of the virtual screen according to the line of sight direction and the first position can be described as setting up one virtual screen in the virtual 3D space only at the start of playback of the six-degree-of-freedom video, and then adjusting the pose of the virtual screen according to the line of sight direction and the first position acquired during the subsequent playback of the six-degree-of-freedom video.

[0065] In some embodiments, determining the pose of the virtual screen according to the line of sight and the first position is: This includes determining that the virtual screen is located at the first position and determining that the plane on which the virtual screen is located is perpendicular to the line of sight.

[0066] In the embodiment of the present application, it is determined that the virtual screen is located at the first position and that the plane on which the virtual screen is located is perpendicular to the line of sight. Therefore, when the viewing angle stream of the six-degree-of-freedom video is played back through the virtual screen, the target object is positioned at the first position of the virtual scene, and the user can normally view the contents of the target viewing angle stream.

[0067] S907: Get the target distance.

[0068] Here, the target distance is the distance between the first position and the second position.

[0069] S908: Set the size of the virtual screen according to the target distance.

[0070] Here, the size of the virtual screen is negatively correlated with the target distance.

[0071] The above embodiment further obtains the distance between the first position and the second position, sets the size of the virtual screen according to the distance between the first position and the second position, and since the size of the virtual screen is negatively correlated with the target distance, the target object can be made smaller when the user is far from the target object and larger when the user is close to the target object, thereby satisfying the visual principle of small objects appearing farther away and large objects appearing closer, and further enhancing the sense of presence of the target object.

[0072] S909: In order to play the six-degree-of-freedom video in the virtual three-dimensional space, the video content corresponding to the target viewing angle stream is played on the virtual screen.

[0073] In some embodiments, the transparency of the background of the virtual screen and the six-degree-of-freedom video may be 100%.

[0074] By setting the transparency of the background of the virtual screen and the six-degree-of-freedom video to 100%, when playing video content corresponding to the target viewing angle stream on the virtual screen, only the target object is displayed, and the area other than the target object becomes content in the virtual three-dimensional space, thereby enhancing the immersion of the six-degree-of-freedom video.

[0075] Based on the same inventive concept, the present invention further provides an electronic device as an implementation of the above method, and this embodiment corresponds to the above-mentioned method embodiment. For the convenience of reading, this embodiment does not repeat the details of the above-mentioned method embodiment one by one, but it should be made clear that the electronic device in this embodiment can correspondingly implement all the contents of the above-mentioned method embodiment.

[0076] The embodiment of the present application provides an electronic device, and Figure 10 is a schematic diagram of the configuration of this electronic device, and as shown in Figure 10, this electronic device 100 is An acquisition unit 101 for acquiring a first position, which is the position of a target object in a six-degree-of-freedom video in a virtual three-dimensional space at a given time, and a second position, which is the viewpoint position of the user in the virtual three-dimensional space at the same time. A processing unit 102 for obtaining the line of sight direction from the viewpoint position to view the target object according to the first and second positions, and for obtaining the target viewing angle stream corresponding to the line of sight direction from among the multiple viewing angle streams of the six-degree-of-freedom video, The system includes a playback unit 103 for playing back the six-degree-of-freedom video in the virtual three-dimensional space based on the target viewing angle stream.

[0077] In one selectable embodiment of the present invention, the playback unit is specifically used to install a virtual screen in the virtual three-dimensional space and to play video content corresponding to the target viewing angle stream on the virtual screen, thereby playing the six-degree-of-freedom video in the virtual three-dimensional space.

[0078] In one selectable embodiment of the present invention, the playback unit 103 is specifically used to determine the pose of the virtual screen in accordance with the line of sight and the first position.

[0079] In one selectable embodiment of the present invention, the playback unit 103 is specifically used to determine that the virtual screen is located at the first position and that the plane on which the virtual screen is located is perpendicular to the line of sight.

[0080] As one selectable embodiment of the embodiments of the present application, the playback unit 103 is further used to obtain a target distance which is the distance between the first position and the second position, and to set the size of the virtual screen according to the target distance. Here, the size of the virtual screen is negatively correlated with the target distance.

[0081] In one selectable embodiment of the embodiments of the present application, the processing unit 102 is specifically used to acquire a target viewing angle stream identifier according to the viewing direction, to send a viewing angle stream request to a server that carries the target viewing angle stream identifier, and to receive a viewing angle stream response sent from the server that carries the target viewing angle stream.

[0082] As one selectable embodiment of the embodiments of the present application, the processing unit 102 is specifically used to obtain the target viewing angle stream identifier based on the viewing direction and a predetermined mapping relationship, Here, the predetermined mapping relationship includes each of the six-degree-of-freedom video's viewing angle streams and the directions corresponding to each of the six-degree-of-freedom video's viewing angle streams.

[0083] The electronic device provided by this embodiment can perform the six-degree-of-freedom video playback method provided by the above-described method embodiment, but the implementation principle and technical effects are the same and will not be repeated here.

[0084] Based on the same inventive concept, embodiments of the present application further provide electronic equipment. Figure 11 is a schematic diagram of the configuration of electronic equipment provided by embodiments of the present application, and as shown in Figure 11, the electronic equipment provided by embodiments comprises a memory 111 and a processor 112, wherein the memory 111 is used to store a computer program, and the processor 112, when executing the computer program, is used to execute the six-degree-of-freedom video playback method provided by the above embodiment.

[0085] Based on the same inventive concept, the embodiment of the present application also provides a computer-readable storage medium in which a computer program is stored that, when executed by a processor, enables the computing device to implement the six-degree-of-freedom video playback method provided by the embodiment.

[0086] Based on the same inventive concept, the embodiment of the present application also provides a computer program product that, when executed on a computer, enables the computing device to implement the six-degree-of-freedom video playback method provided by the embodiment.

[0087] Those skilled in the art will understand that embodiments of this application may be provided as methods, systems, or computer program products. Accordingly, this application may take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware. Furthermore, this application may take the form of a computer program product implemented on one or more computer-readable storage media containing computer-readable program code.

[0088] The processor may be a Central Processing Unit (CPU), another general-purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or another programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The general-purpose processor may be a microprocessor or any of the standard processors.

[0089] Memory can take the form of volatile memory, random access memory (RAM), and / or non-volatile memory such as read-only memory (ROM) or flash memory (flash RAM) in a computer-readable medium. Memory is an example of a computer-readable medium.

[0090] Computer-readable media include non-volatile and volatile, removable and non-removable storage media. Storage media can store information that is computer-readable instructions, data configurations, program modules, or other data by any means or technique. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random-access memory (SRAM), dynamic random-access memory (DRAM), other types of random-access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROMs, digital versatile disks (DVDs) or other optical storage devices, magnetic cartridge tapes, disk storage devices or other magnetic storage devices, or any other non-transferable media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media do not include transient computer-readable media such as modulated data signals or carriers.

[0091] Finally, it should be noted that the embodiments described above are used merely to illustrate the technical concepts of the present application and are not intended to limit them. Although the present application has been described in detail with reference to the embodiments described above, it should be understood that it is still possible to modify the technical concepts described in the embodiments described above, or to make equivalent substitutions to some or all of the technical features therein, and such modifications or substitutions will not cause the essence of the corresponding technical concepts to deviate from the scope of the technical concepts of the embodiments of the present disclosure.

Claims

1. Obtaining a first position that is the position in the virtual three-dimensional space at the time when there is a target object within the six-degree-of-freedom video, and a second position that is the viewpoint position of the user in the virtual three-dimensional space at that time; Obtaining a line-of-sight direction for viewing the target object from the viewpoint position according to the first position and the second position; Obtaining a target viewing angle stream corresponding to the line-of-sight direction among a plurality of viewing angle streams of the six-degree-of-freedom video; Playing the six-degree-of-freedom video in the virtual three-dimensional space based on the target viewing angle stream; A method for playing a six-degree-of-freedom video, characterized by including the above.

2. Playing the six-degree-of-freedom video in the virtual three-dimensional space based on the target viewing angle stream includes: Installing a virtual screen in the virtual three-dimensional space; Playing video content corresponding to the target viewing angle stream on the virtual screen for playing the six-degree-of-freedom video in the virtual three-dimensional space. The method according to claim 1, characterized by including the above.

3. Installing a virtual screen in the virtual three-dimensional space includes: Determining the pose of the virtual screen according to the line-of-sight direction and the first position; Installing the virtual screen in the virtual three-dimensional space according to the pose of the virtual screen. The method according to claim 2, characterized by including the above.

4. Determining the pose of the virtual screen according to the line-of-sight direction and the first position includes: Determining that the virtual screen is located at the first position, and determining that the plane where the virtual screen is located is perpendicular to the line-of-sight direction. The method according to claim 3 is characterized by including the above.

5. Obtaining a target distance that is the distance between the first position and the second position; Further including setting the size of the virtual screen according to the target distance, and The size of the virtual screen has a negative correlation with the target distance. The method according to claim 2 is characterized by the above.

6. Obtaining a target viewing angle stream corresponding to the line-of-sight direction among a plurality of viewing angle streams of the six-degree-of-freedom video includes: Obtaining a target viewing angle stream identifier according to the line-of-sight direction. Sending a perspective stream request for carrying the target perspective stream identifier to a server; Receiving a perspective stream response for carrying the target perspective stream, which is sent from the server; The method according to claim 1, characterized by including the above.

7. Obtaining a target perspective stream identifier according to the line-of-sight direction includes: Obtaining the target perspective stream identifier according to the line-of-sight direction and a predetermined mapping relationship, The method according to claim 6, characterized in that the predetermined mapping relationship includes each perspective stream of the six-degree-of-freedom video and the direction corresponding to each perspective stream of the six-degree-of-freedom video.

8. An acquisition unit for obtaining a first position, which is the position in the virtual three-dimensional space at the time when there is a target object in the six-degree-of-freedom video, and a second position, which is the viewpoint position of the user in the virtual three-dimensional space at the time; A processing unit for obtaining a line-of-sight direction of viewing the target object from the viewpoint position according to the first position and the second position, and obtaining a target perspective stream corresponding to the line-of-sight direction from among a plurality of perspective streams of the six-degree-of-freedom video; A playback unit for playing back the six-degree-of-freedom video in the virtual three-dimensional space based on the target perspective stream; An electronic device, characterized by including the above.

9. An electronic device including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the electronic device realizes the method for playing back a six-degree-of-freedom video according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that when executed by a computing device, a computer program for realizing the method for playing back a six-degree-of-freedom video according to any one of claims 1 to 7 is stored in the computing device.

Images