Stereoscopic video shooting method, processing method, playing method, equipment thereof and program product

Abstract

The invention discloses a stereoscopic video shooting method, a stereoscopic video processing method, a stereoscopic video playing method, equipment and a program product, and relates to the technical field of stereoscopic videos, the stereoscopic video shooting method comprises the following steps: shooting a stereoscopic video by using a trinocular camera to obtain a stereoscopic video file containing three groups of video contents; collecting attitude data of the trinocular camera in the shooting process; calculating three groups of attitude change data based on the attitude data and the position relationship among the three lenses; writing the three groups of attitude change data into a data track to obtain a target video file; the target video file is used for being read by the post-processing software and / or the stereoscopic video player, so that the post-processing software and / or the stereoscopic video player carry out visual angle correction on the video content. Three groups of video contents and attitude data are acquired by using the trinocular camera, so that post-processing software and / or a stereoscopic video player can perform visual angle correction on the video contents, and discomfort caused by visual angle change when a user watches a stereoscopic video is avoided.

Description

Technical Field

[0001] The present application relates to the field of stereoscopic video technology, and in particular to a stereoscopic video shooting method, processing method, and playback method, as well as devices and program products thereof. Background Art

[0002] When shooting traditional stereoscopic videos, a binocular system is constructed using two horizontally or vertically parallel cameras. Based on a certain degree of synchronization, two synchronous video streams with equal resolution, frame rate, and 3A data are output. During playback, different images are displayed on the left and right eyes respectively to achieve a stereoscopic effect in a certain direction.

[0003] Since there are only two parallel cameras, the 3D information contained in the video they capture only includes one direction. The user can only ensure a proper 3D visual effect if they keep the same direction and angle as the camera and are horizontally aligned. Any deviation will cause discomfort. Similarly, if the camera is displaced or rotated, the 3D information collected will be missing, and the user will feel uncomfortable when watching due to the misalignment of the 3D information.

[0004] Therefore, changes in the viewing angle of the video screen or the user's viewing angle will cause the three-dimensional information to be misaligned, and the problem of causing discomfort to the user needs to be solved urgently.

[0005] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0006] The main purpose of this application is to provide a stereoscopic video shooting method, processing method, playback method and its equipment and program product, aiming to solve the technical problem that changes in the viewing angle of the video picture or the user's viewing angle will cause dislocation of three-dimensional information and make the user feel uncomfortable.

[0007] To achieve the above objectives, the present application proposes a stereoscopic video shooting method, which is applied to a three-eye camera. The stereoscopic video shooting method includes:

[0008] Using the trinocular camera to shoot a stereoscopic video to obtain a stereoscopic video file; wherein the distances between the three lenses of the trinocular camera are equal; and the data track of the stereoscopic video file contains three sets of video content;

[0009] During the shooting process, collecting the posture data of the trinocular camera;

[0010] Based on the posture data and the positional relationship between the three lenses, calculating the posture change angle of each lens at each moment to obtain three sets of posture change data;

[0011] The three groups of posture change data are written into the data track to obtain a target video file; wherein the target video file is used to be read by post-processing software and / or a stereoscopic video player, so that the post-processing software and / or the stereoscopic video player can perform perspective correction on the video content based on the posture change data and the user's posture.

[0012] In one embodiment, the three lenses have the same optical structure, and the three lenses have the same parameter settings; the parameter settings include at least one or more of resolution, frame rate, automatic exposure, automatic focus and automatic white balance.

[0013] In one embodiment, the collection frequency of the gesture data is greater than the frame rate of the video content;

[0014] Before the step of writing the three sets of posture change data into the data track to obtain the target video file, the step further includes:

[0015] Selecting the posture change data closest to the acquisition time of each frame of the video content for matching, to obtain paired video images and paired posture change data;

[0016] Marking the paired video images and the paired gesture change data with a system timestamp;

[0017] Based on the system timestamp, the paired video images are time-aligned with the paired gesture change data.

[0018] In one embodiment, the attitude data includes heading angle data and pitch angle data;

[0019] The step of calculating the posture change angle of each lens at each moment based on the posture data and the positional relationship between the three lenses to obtain three sets of posture change data comprises:

[0020] Subtracting the initial heading angle from the heading angle data at each moment to obtain the heading change angle at each moment;

[0021] Based on the heading change angle and the positional relationship between the three lenses, the heading change angle of each lens is calculated to obtain three groups of single-lens heading change angles;

[0022] Subtracting the initial pitch angle from the pitch angle data at each moment to obtain the pitch change angle at each moment;

[0023] Based on the pitch change angle and the positional relationship between the three lenses, the pitch change angle of each lens is calculated to obtain three groups of single-lens pitch change angles;

[0024] The three groups of single-lens heading change angles and the corresponding three groups of single-lens pitch change angles are integrated to obtain three groups of posture change data.

[0025] In addition, to achieve the above purpose, the present application also proposes a stereoscopic video processing method, which is applied to the back end. The stereoscopic video processing method includes:

[0026] Parsing the data track of the target video file to obtain three sets of video content and three sets of corresponding posture change data; the target video file is obtained by the stereoscopic video shooting method as described above;

[0027] Based on the three sets of posture change data and the user's default posture, the video content is corrected for perspective to obtain a binocular stereo video.

[0028] In one embodiment, the step of performing perspective correction on the video content based on the three sets of posture change data and the user's default posture to obtain a binocular stereoscopic video includes:

[0029] A selection step, selecting two sets of data closest to the user's default posture from the three sets of posture change data corresponding to the single-frame timestamp, obtaining two sets of single-frame posture change data, and solving two sets of monocular lens offset values;

[0030] A correction step, based on the two sets of single-frame posture change data and the two sets of monocular lens offset values, correcting the video content and synthesizing to obtain a single-frame binocular video picture at the single-frame timestamp;

[0031] Repeat the selection step and the correction step for each frame timestamp to obtain a plurality of single-frame binocular video images;

[0032] A plurality of the single-frame binocular video images are synthesized to obtain the binocular stereo video.

[0033] In one embodiment, the selecting step includes:

[0034] Performing posture comparisons on the three groups of posture change data corresponding to the single-frame timestamps and the user's default posture one by one, and obtaining two groups of single-frame posture change data closest to the user's default posture;

[0035] The two sets of single-frame posture change data and horizontal parallax angle data are compared to obtain the two sets of monocular lens offset values.

[0036] In one embodiment, the correcting step comprises:

[0037] Based on the two target shots corresponding to the two sets of single-frame posture change data, determining the two sets of video content corresponding to the two target shots, and obtaining two sets of single-frame video content;

[0038] Taking the two sets of monocular lens offset values ​​as a reference and according to the optical parameters of the two target lenses, spherical projection is performed on the two sets of single-frame video contents respectively to obtain two sets of projected video contents;

[0039] The two groups of projected video contents are cropped and re-projected into two groups of planar video frames;

[0040] The two groups of planar video frames are synthesized to obtain a single-frame binocular video picture.

[0041] In addition, to achieve the above purpose, the present application also proposes a stereoscopic video playback method, which is applied to a player. The stereoscopic video playback method includes:

[0042] Parsing the data track of the target video file to obtain three sets of video content and three sets of corresponding posture change data; the target video file is obtained by the stereoscopic video shooting method as described above;

[0043] Based on the three sets of posture change data and the user's current posture, the video content is corrected for perspective, and the corrected binocular video images are obtained in real time and played synchronously.

[0044] In one embodiment, the step of performing perspective correction on the video content based on the three sets of posture change data and the current posture of the user, obtaining the corrected binocular video picture in real time and playing it synchronously includes:

[0045] An acquisition step of acquiring the current posture of the user corresponding to a single frame timestamp;

[0046] A selection step, selecting two sets of data closest to the current posture of the user from the three sets of posture change data, obtaining two sets of single-frame posture change data, and solving two sets of monocular lens offset values;

[0047] A correction step, based on the two sets of single-frame posture change data and the two sets of monocular lens offset values, correcting the video content and synthesizing to obtain the single-frame binocular video picture;

[0048] Display step, displaying a single frame of the binocular video picture;

[0049] The acquisition step, the selection step, the correction step and the display step are repeated for each frame time stamp to generate the binocular video picture of each frame in real time and play it synchronously.

[0050] In one embodiment, the selecting step includes:

[0051] Performing posture comparisons on the three groups of posture change data corresponding to the single-frame timestamps and the current posture of the user one by one, and obtaining two groups of single-frame posture change data closest to the current posture of the user;

[0052] The two sets of single-frame posture change data and horizontal parallax angle data are compared to obtain the two sets of monocular lens offset values.

[0053] In one embodiment, the correcting step comprises:

[0054] Based on the two target shots corresponding to the two sets of single-frame posture change data, determining the two sets of video content corresponding to the two target shots, and obtaining two sets of single-frame video content;

[0055] Taking the two sets of monocular lens offset values ​​as a reference and according to the optical parameters of the two target lenses, spherical projection is performed on the two sets of single-frame video contents respectively to obtain two sets of projected video contents;

[0056] The two groups of projected video contents are cropped and re-projected into two groups of planar video frames;

[0057] The two groups of planar video frames are synthesized to obtain a single-frame binocular video picture.

[0058] In addition, to achieve the above-mentioned purpose, the present application also proposes a stereoscopic video shooting device, which includes:

[0059] A shooting module, used for shooting a stereoscopic video with the three-eye camera to obtain a stereoscopic video file; wherein the three lenses of the three-eye camera are spaced equally from each other; and the data track of the stereoscopic video file contains three sets of video content;

[0060] An acquisition module, used to acquire the posture data of the trinocular camera during shooting;

[0061] A calculation module, used for calculating the posture change angle of each lens at each moment based on the posture data and the positional relationship between the three lenses, to obtain three sets of posture change data;

[0062] A writing module is used to write the three groups of posture change data into the data track to obtain a target video file; wherein the target video file is used to be read by post-processing software and / or a stereoscopic video player, so that the post-processing software and / or the stereoscopic video player can perform perspective correction on the video content based on the posture change data and the user posture.

[0063] In addition, to achieve the above-mentioned purpose, the present application also proposes a stereoscopic video shooting device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the stereoscopic video shooting method as described above.

[0064] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the stereoscopic video shooting method described above are implemented.

[0065] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps of the stereoscopic video shooting method described above are implemented.

[0066] In addition, to achieve the above-mentioned purpose, the present application also proposes a stereoscopic video processing device, the stereoscopic video processing device comprising:

[0067] A parsing module, used for parsing the data track of the target video file to obtain three sets of video content and three sets of corresponding posture change data; the target video file is obtained by the stereoscopic video shooting method as described above;

[0068] The correction module is used to perform perspective correction on the video content based on the three groups of posture change data and the user's default posture to obtain a binocular stereo video.

[0069] In addition, to achieve the above-mentioned purpose, the present application also proposes a stereoscopic video processing device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the stereoscopic video processing method as described above.

[0070] In addition, to achieve the above objectives, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the stereoscopic video processing method described above are implemented.

[0071] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the stereoscopic video processing method described above are implemented.

[0072] In addition, to achieve the above-mentioned purpose, the present application also proposes a device, wherein the stereoscopic video playback device comprises:

[0073] A parsing module, used for parsing the data track of the target video file to obtain three sets of video content and three sets of corresponding posture change data; the target video file is obtained by the stereoscopic video shooting method as described above;

[0074] The correction module is used to correct the viewing angle of the video content based on the three groups of posture change data and the user's current posture, obtain the corrected binocular video image in real time and play it synchronously.

[0075] In addition, to achieve the above-mentioned purpose, the present application also proposes a stereoscopic video playback device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the stereoscopic video playback method described above.

[0076] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the stereoscopic video playback method described above are implemented.

[0077] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps of the stereoscopic video playback method described above are implemented.

[0078] One or more technical solutions proposed in this application have at least the following technical effects:

[0079] The technical solution of the present application is applied to a trinocular camera by adopting a stereoscopic video shooting method. The stereoscopic video shooting method comprises: using the trinocular camera to shoot a stereoscopic video to obtain a stereoscopic video file; wherein the distances between the three lenses of the trinocular camera are equal; the data track of the stereoscopic video file contains three groups of video content; during the shooting process, collecting the posture data of the trinocular camera; based on the posture data and the positional relationship between the three lenses, calculating the posture change angle of each lens at each moment to obtain three groups of posture change data; writing the three groups of posture change data into the data track to obtain a target video file; wherein the target video file is used for being read by post-processing software and / or a stereoscopic video player, so that the post-processing software and / or the stereoscopic video player can perform perspective correction on the video content based on the posture change data and the user posture.

[0080] The existing stereo video shooting method only uses binocular cameras, and the 3D information contained in the video it captures only includes the depth information in a direction perpendicular to the plane where the two lenses of the binocular camera are located. Users can only have a suitable 3D visual effect when the camera maintains the same direction and angle. And if the shooting camera has any displacement or rotation, the collected 3D information will also be lost.

[0081] The technical solution of the present application uses a trinocular lens to collect three groups of video content with different perspective depth information and visual information, and collects the posture data of the trinocular camera, calculates it to obtain three groups of posture change data, and finally obtains the target video file. Compared with the conventional stereo video shot by a binocular camera, the target video file of the present application has more comprehensive depth information, thereby providing a better stereoscopic visual effect. In addition, the setting of equal spacing between the three lenses can improve the uniformity of the distribution of the parallax information generated by each lens relative to other lenses in space, so that more consistent data can be obtained in the subsequent correction process, reducing the error caused by uneven parallax information.

[0082] In addition, the target video file in this embodiment also contains posture change data, so that the post-processing software and the stereoscopic video player can perform perspective correction on the video content based on the posture change data in the target video file and the user's posture, thereby ensuring that the user can still obtain a suitable stereoscopic visual effect when the camera moves, rotates, or the user's perspective changes, thereby avoiding dizziness and other discomforts in the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0083] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0084] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0085] Figure 1 A schematic diagram of a flow chart provided for the first embodiment of the stereoscopic video shooting method of the present application;

[0086] Figure 2 A schematic diagram of the structure of a three-eye camera provided in Example 1 of the stereoscopic video shooting method of the present application;

[0087] Figure 3 A flowchart of a fourth embodiment of the stereoscopic video processing method of the present application is provided;

[0088] Figure 4 A flowchart of the sixth embodiment of the stereoscopic video playback method of the present application is provided;

[0089] Figure 5 A brief flowchart diagram of an embodiment of a stereoscopic video shooting method of the present application is provided;

[0090] Figure 6 This is a schematic diagram of the module structure of a stereoscopic video shooting device according to an embodiment of the present application;

[0091] Figure 7 A schematic diagram of the device structure of the hardware operating environment involved in the stereoscopic video shooting method in the embodiment of the present application;

[0092] Figure 8 This is a schematic diagram of the module structure of a stereoscopic video processing device according to an embodiment of the present application;

[0093] Fig. 9 A schematic diagram of the device structure of the hardware operating environment involved in the stereoscopic video processing method in the embodiment of the present application;

[0094] Fig.10 This is a schematic diagram of the module structure of the stereoscopic video playback device according to an embodiment of the present application;

[0095] Fig.11 Schematic diagram of the device structure of the hardware operating environment involved in the stereoscopic video playback method in the embodiment of the present application.

[0096] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0097] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0098] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0099] The main solution of the embodiment of the present application is: use the three-eye camera to shoot a stereoscopic video to obtain a stereoscopic video file; wherein, the distances between the three lenses of the three-eye camera are equal; the data track of the stereoscopic video file contains three groups of video content; during the shooting process, the posture data of the three-eye camera is collected; based on the posture data and the positional relationship between the three lenses, the posture change angle of each lens at each moment is calculated to obtain three groups of posture change data; the three groups of posture change data are written into the data track to obtain a target video file; wherein, the target video file is used for post-processing software and / or a stereoscopic video player to read, so that the post-processing software and / or the stereoscopic video player can perform perspective correction on the video content based on the posture change data and the user posture.

[0100] In this embodiment, for the convenience of description, the following description is made with a trinocular camera as the execution subject.

[0101] When shooting traditional stereoscopic videos, a binocular system is constructed using two horizontally or vertically parallel cameras. Based on a certain degree of synchronization, two synchronous video streams with equal resolution, frame rate, and 3A data are output. During playback, different images are displayed on the left and right eyes respectively to achieve a stereoscopic effect in a certain direction.

[0102] Since there are only two parallel cameras, the 3D information contained in the video they capture only includes one direction. The user can only ensure a proper stereoscopic visual effect if they keep the same direction and angle as the camera and are horizontally aligned. Any deviation will cause discomfort. Similarly, if the camera is displaced or rotated, the 3D information collected will be missing, and the user will feel uncomfortable when watching due to the misalignment of the 3D information.

[0103] Therefore, changes in the viewing angle of the video screen or the user's viewing angle will cause the three-dimensional information to be misaligned, and the problem of causing discomfort to the user needs to be solved urgently.

[0104] Based on this, the present application provides a solution, which first obtains a stereoscopic video file by shooting a stereoscopic video with the three-eye camera; wherein the distances between the three lenses of the three-eye camera are equal; the data track of the stereoscopic video file contains three groups of video content; during the shooting process, the posture data of the three-eye camera is collected; based on the posture data and the positional relationship between the three lenses, the posture change angle of each lens at each moment is calculated to obtain three groups of posture change data; the three groups of posture change data are written into the data track to obtain a target video file; wherein the target video file is used for post-processing software and / or a stereoscopic video player to read, so that the post-processing software and / or the stereoscopic video player can perform perspective correction on the video content based on the posture change data and the user posture.

[0105] The technical solution of the present application uses a trinocular lens to collect three groups of video content with different perspective depth information and visual information, and collects the posture data of the trinocular camera, calculates it to obtain three groups of posture change data, and finally obtains the target video file. Compared with the conventional stereo video shot by a binocular camera, the target video file of the present application has more comprehensive depth information, so as to provide a better stereoscopic visual effect. In addition, the setting of equal spacing between the three lenses can improve the uniformity of the distribution of the parallax information generated by each lens relative to other lenses in space, so that more consistent data can be obtained in the subsequent correction process, reducing the error caused by uneven parallax information.

[0106] In addition, the target video file in this embodiment also contains posture change data, so that the post-processing software and the stereoscopic video player can perform perspective correction on the video content based on the posture change data in the target video file and the user's posture, thereby ensuring that the user can still obtain a suitable stereoscopic visual effect when the camera moves, rotates, or the user's perspective changes, thereby avoiding dizziness and other discomforts in the user.

[0107] It should be noted that the execution subject of this embodiment can be a computing service device with stereoscopic video shooting, data processing, network communication and program running functions, such as a three-eye camera, a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a three-eye video shooting device, etc. The following takes a three-eye camera as an example to illustrate this embodiment and the following embodiments.

[0108] Based on this, the present application embodiment provides a stereoscopic video shooting method, please refer to Figure 1 , Figure 1 This is a flowchart diagram of the first embodiment of the stereoscopic video shooting method of the present application.

[0109] In this embodiment, the stereoscopic video shooting method includes steps S10 to S70:

[0110] Step S10, using the trinocular camera to shoot a stereoscopic video to obtain a stereoscopic video file; wherein the distances between the three lenses of the trinocular camera are equal; and the data track of the stereoscopic video file contains three sets of video content;

[0111] Please note that, please refer to Figure 2 The trinocular camera in this embodiment is a shooting device with three lenses. Compared with the binocular camera, the trinocular camera can simultaneously collect three sets of video images with different depth information and viewing angle information; in addition, the binocular camera can only collect depth information in a single direction along the direction of the line connecting the two lenses. Since the trinocular camera in this embodiment adopts a setting in which the three lenses are spaced equally apart, the three lenses can collect depth information in multiple directions, effectively avoiding the misalignment of the stereoscopic effect caused by the lack of collected depth information.

[0112] In addition, the three lenses in this embodiment can be an integrated structure integrated on the same body, or a split structure in which the three lenses are separated from each other. Regardless of the structure of the three lenses of the trinocular camera, the three sets of video content captured by the three lenses need to be summarized and the video information needs to be synchronized.

[0113] In addition, it should be noted that the stereoscopic video file may include multiple data tracks, and the three sets of video content may be stored in different data tracks respectively.

[0114] Wherein, as an optional implementation, the three lenses have the same optical structure, and the three lenses have the same parameter settings; the parameter settings include at least one or more of resolution, frame rate, automatic exposure, automatic focus and automatic white balance.

[0115] In this embodiment, by making the three lenses have the same optical structure and the same parameter settings, it is ensured that the video content captured by the three lenses has a high consistency in visual performance such as video color difference, white balance, clarity, and smoothness, thereby effectively avoiding the problem of large differences in the three groups of video content shot by the three lenses, and ensuring the user's viewing experience.

[0116] Step S20, during the shooting process, collecting the posture data of the trinocular camera;

[0117] It should be noted that trinocular cameras and other shooting devices usually have built-in inertial measurement unit (IMU) chips, and trinocular cameras can obtain the posture of the shooting device through the IMU chip. Therefore, this posture acquisition solution is highly versatile and suitable for most camera devices. It can collect the posture data of stereo video shooting devices without external posture sensors, reducing data acquisition costs.

[0118] Step S30, based on the posture data and the positional relationship between the three lenses, calculating the posture change angle of each lens at each moment to obtain three sets of posture change data;

[0119] Step S70, write the three groups of posture change data into the data track to obtain a target video file; wherein, the target video file is used for being read by post-processing software and / or a stereoscopic video player, so that the post-processing software and / or the stereoscopic video player can perform perspective correction on the video content based on the posture change data and the user posture.

[0120] It should be noted that the posture change data can be written into one of the data tracks of various formats of files such as mp4 format files and mov format files corresponding to the target video file, so as to achieve storage.

[0121] In steps S10 to S70, three sets of posture change data are obtained by calculating the posture change angle at each moment, thereby providing data support for the post-processing software and / or the stereoscopic video player to perform perspective correction on the video content; the posture change data is written into the data track of the stereoscopic video file to obtain a target video file containing the video content and posture change data. In this way, the post-processing software and / or the stereoscopic video player can compare the posture change data with the user posture, determine the degree of rotational offset of the perspective, and make accurate perspective correction to the video content to achieve a suitable correction effect.

[0122] In the first embodiment of the present application, a stereoscopic video shooting method is provided, by using a trinocular lens to collect three groups of video content with different viewing angle depth information and visual information, and collecting the posture data of the trinocular camera, calculating it to obtain three groups of posture change data, and finally obtaining a target video file. Compared with the conventional stereoscopic video obtained by shooting with a binocular camera, the target video file of the present application has more comprehensive depth information, thereby being able to provide a better stereoscopic visual effect. In addition, the setting of equal spacing between the three lenses can improve the uniformity of the distribution of the parallax information generated by each lens relative to other lenses in space, so that more consistent data can be obtained in the subsequent correction process, reducing the error caused by uneven parallax information.

[0123] In addition, the target video file in this embodiment also contains posture change data, so that the post-processing software and the stereoscopic video player can perform perspective correction on the video content based on the posture change data in the target video file and the user's posture, thereby ensuring that the user can still obtain a suitable stereoscopic visual effect when the camera moves, rotates, or the user's perspective changes, thereby avoiding dizziness and other discomforts in the user.

[0124] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those of the above-mentioned first embodiment can be referred to the above introduction and will not be repeated later.

[0125] On this basis, the acquisition frequency of the posture data is greater than the frame rate of the video content;

[0126] Before step S70, the stereoscopic video shooting method further includes steps S40 to S60:

[0127] Step S40, selecting the posture change data closest to the acquisition time of each frame of the video content for matching, to obtain paired video images and paired posture change data;

[0128] It should be noted that, since there is a certain degree of deviation between the actual frame rate of the video content and the set acquisition frame rate, it is necessary to avoid the problem that the posture change data corresponding to a certain frame of video screen and the actual change of viewing angle are greatly different due to the fluctuation of the video frame rate. In this embodiment, by making the acquisition frequency of the posture data greater than the frame rate of the video content, even if the video content has a frame rate fluctuation problem, the method in step S40 can still be used to match each frame of video content with the posture change data closest to its acquisition time, so that the posture change data corresponding to each frame of video screen is highly consistent with the actual change of shooting viewing angle.

[0129] Step S50, marking a system timestamp for the paired video images and the paired posture change data;

[0130] Step S60: Time-aligning the paired video frame with the paired posture change data based on the system timestamp.

[0131] It should be noted that in the second embodiment of the present application, the system timestamp is a method of marking time on data. By marking each frame of video in the stereoscopic video file and the corresponding posture data at the same time with the same system timestamp, it is convenient to compare whether the video image and the posture data are generated synchronously according to the system timestamp, thereby achieving time alignment of the paired posture change data with the paired video image.

[0132] In the second embodiment of the present application, by making the acquisition frequency of posture data greater than the frame rate of the video content, and matching each frame of video content with the posture change data closest to its acquisition time, the posture change data corresponding to each frame of video is made highly consistent with the actual shooting angle change; by using the system timestamp to align the paired video screen with the paired posture data, the subsequent indexing of the paired video screen and the paired posture change data is facilitated.

[0133] Based on the first embodiment of the present application, in the third embodiment of the present application, the same or similar contents as those of the above-mentioned first embodiment can be referred to the above introduction and will not be repeated later.

[0134] On this basis, the attitude data includes heading angle data and pitch angle data;

[0135] Step S30 includes steps S31 to S35:

[0136] Step S31, subtracting the initial heading angle from the heading angle data at each moment to obtain the heading change angle at each moment;

[0137] It should be noted that, in step S31, the heading angle yaw angle at each moment in the heading angle data may be set to y, and the initial heading angle may be set to y0, then the heading change angle Δy at each moment is =y-y0.

[0138] Among them, in the first embodiment, the initial heading angle can be the posture of the three-eye camera at the starting moment of the stereo video sequence, and the initial heading angle is defined as the initial state of the rotating coordinate system, providing a reference for the subsequent azimuth change; in the second embodiment, the initial heading angle can also refer to the heading angle at the previous moment, and the heading change angle under this embodiment is the relative rotation state of the three-eye camera in the rotating coordinate system from the previous moment to the current moment. Step S31 can be implemented by using any of the above two embodiments, and the developer can choose a specific calculation implementation method according to actual needs, which is not limited here.

[0139] Step S32, calculating the heading change angle of each lens based on the heading change angle and the positional relationship between the three lenses, to obtain three groups of single-lens heading change angles;

[0140] Among them, since the distances between the three lenses in this application are equal, the heading change angles of the three groups of single lenses can be calculated based on the specific position of the IMU chip preset in the trinocular camera and the positional relationship between the IMU chip and the single lens.

[0141] Step S33, subtracting the initial pitch angle from the pitch angle data at each moment to obtain the pitch change angle at each moment;

[0142] Similarly, in step S33, the pitch angle at each moment in the pitch angle data is set to p, and the initial heading angle is set to p0, then the heading change angle Δp at each moment is =p-p0.

[0143] Among them, in the first embodiment, the initial pitch angle can be the posture of the three-eye camera at the starting moment of the stereoscopic video sequence, and the initial pitch angle can be defined as the initial state of the rotating coordinate system to provide a reference for subsequent azimuth changes. In the second embodiment, the initial pitch angle can also refer to the pitch angle at the previous moment. The heading change angle and the pitch change angle under this embodiment are the relative rotation state of the three-eye camera in the rotating coordinate system from the previous moment to the current moment. Step S33 can be implemented by using any of the above two embodiments, and the developer can choose a specific calculation implementation method according to actual needs, which is not limited here.

[0144] Step S34, calculating the pitch change angle of each lens based on the pitch change angle and the positional relationship between the three lenses, to obtain three groups of single-lens pitch change angles;

[0145] Step S35, integrating the three groups of single-lens heading change angles and the corresponding three groups of single-lens pitch change angles to obtain three groups of posture change data.

[0146] In the third embodiment of the present application, the heading angle and pitch angle in the attitude data are respectively subtracted from the initial heading angle and initial pitch angle to obtain the heading change angle and the pitch change angle; then, according to the heading change angle, the pitch change angle, and the positional relationship between the three lenses, three groups of single-lens heading change angles and three groups of single-lens pitch change angles are calculated, and finally three groups of attitude change data are synthesized. The calculation method of the attitude change data in this embodiment is simple, has the characteristics of low complexity and low demand for computing resources, and is suitable for deployment in shooting equipment with relatively limited computing resources such as trinocular cameras to achieve efficient computing.

[0147] The fourth embodiment of the present application also provides a stereoscopic video processing method, please refer to Figure 3 , Figure 3 This is a flowchart of Embodiment 4 of the stereoscopic video processing method of the present application.

[0148] In this embodiment, the stereoscopic video processing method is applied to the back end, and the execution body of the stereoscopic video processing method may be post-processing software deployed on a computing terminal.

[0149] The stereoscopic video processing method comprises steps A10 to A20:

[0150] Step A10, parsing the data track of the target video file to obtain three sets of video content and three sets of corresponding posture change data; the target video file is obtained by the stereoscopic video shooting method of the above embodiment;

[0151] It should be noted that the target video file may include multiple data tracks, each data track is used to store a type of data. For example, the first data track is used to store video image data in the video content, the second data track is used to store audio data in the video content, and the third data track is used to store gesture change data. Each data track may contain multiple sub-tracks for distinguishing data tracks of the same type. For example, the video image data in three groups of video content may be stored in three sub-tracks respectively.

[0152] Step A20, based on the three sets of posture change data and the user's default posture, the video content is corrected for perspective to obtain a binocular stereoscopic video.

[0153] It should be noted that the user's default posture refers to the user's posture in the motion stabilization mode, that is, the user's perspective has not changed, and it is the default horizontal posture. The user's default posture is equivalent to the posture of the user looking straight ahead. Perspective correction based on the user's default posture and three sets of posture change data can make the perspective of the video screen in the corrected binocular stereo video consistent with the perspective of the user looking straight ahead, so that the user can obtain a complete binocular stereo viewing effect by maintaining a posture of looking straight ahead in most usage scenarios.

[0154] In the fourth embodiment of the present application, the target video file is obtained, and based on the three sets of posture change data and the user's default posture, the video content is corrected to obtain a corrected binocular stereo video. Since the binocular stereo video is a corrected image, it eliminates the impact of the change in shooting angle of view on the user's viewing as much as possible, thereby ensuring that the user obtains a complete binocular stereo viewing effect when watching in the user's default posture, thereby avoiding the user from feeling dizzy or other discomfort. In addition, after adopting the stereo video processing method in this embodiment, the stereo video shooter can change the shooting angle of view during the shooting process, and can make various posture displacements to the shooting device, thereby providing the shooter with more freedom of choice of the stereo video shooting angle of view.

[0155] Based on the fourth embodiment of the present application, in the fifth embodiment of the present application, the same or similar contents as those in the fourth embodiment can be referred to the above description, and will not be repeated in the following. On this basis, step A20 includes steps A21 to A24:

[0156] Step A21, a selection step, selecting two sets of data closest to the user's default posture from the three sets of posture change data corresponding to the single-frame timestamp, obtaining two sets of single-frame posture change data, and solving two sets of monocular lens offset values;

[0157] In step A21, since the video content finally played in the player is a binocular stereo video, among the three groups of video content captured by the three-eye camera, only two groups of video content will be selected for synthesis in a frame of video screen finally presented on the player, and the remaining group of video content will not participate in the synthesis of the frame of video screen. For different frames of video screens, the two groups of video content selected for synthesis may be different. For the convenience of explanation, illustratively, for three groups of video content A, B, and C, the first frame of the binocular stereo video can select video content A and C for synthesis, the second frame can select video content B and C for synthesis, and the third frame can select video content A and B for synthesis.

[0158] The above method of selecting video content is only an example. Specifically, when selecting video content, firstly, two sets of single-frame posture change data closest to the user's default posture are selected through step A21, and then the corresponding video content is determined based on the two sets of single-frame posture change data.

[0159] In a feasible implementation, step A21 may include steps A211 to A212:

[0160] Step A211, comparing the three groups of posture change data corresponding to the single-frame timestamp with the user's default posture one by one, to obtain two groups of single-frame posture change data closest to the user's default posture;

[0161] Step A212, comparing the two sets of single-frame posture change data and horizontal parallax angle data, and calculating to obtain the two sets of monocular lens offset values.

[0162] In this embodiment, by comparing with the user's default posture, the two sets of single-frame posture change data closest to each other are indexed, thereby ensuring that the two sets of single-frame posture change data are as close as possible to the user's viewing angle, so that the video image can be corrected as much as possible according to the user's viewing angle in the subsequent correction step. The two sets of monocular lens offset values ​​obtained by the solution can provide a correction benchmark for the subsequent correction step to ensure the correction effect of the video content.

[0163] Step A22, a correction step, based on the two sets of single-frame posture change data and the two sets of monocular lens offset values, correcting the video content and synthesizing to obtain a single-frame binocular video picture at the single-frame timestamp;

[0164] In a feasible implementation, step A22 may include steps A221 to A224:

[0165] Step A221, based on the two target shots corresponding to the two sets of single-frame posture change data, determining the two sets of video content corresponding to the two target shots, and obtaining two sets of single-frame video content;

[0166] Step A222, taking the two sets of monocular lens offset values ​​as a reference and according to the optical parameters of the two target lenses, respectively performing spherical projection on the two sets of single-frame video contents to obtain two sets of projected video contents;

[0167] Step A223, cutting and re-projecting the two groups of projected video contents into two groups of planar video frames;

[0168] Step A224, synthesizing the two groups of planar video frames to obtain a single-frame binocular video image.

[0169] In this embodiment, by performing spherical projection on the single-frame video content, and then cutting and reprojecting, two sets of plane video frames are obtained, thereby realizing the perspective correction of the video screen. Among them, the two sets of single-frame video content are firstly spherically projected and then cut, so that the two sets of single-frame video content can be restored to the spherical space first. At this time, the single-frame video content in the spherical state has a three-dimensional posture relationship, which is convenient for cutting and correction; and then reprojection is performed to reproject the cut single-frame video content in the spherical state into a two-dimensional plane video frame, which is convenient for the player to play and display.

[0170] Step A23, repeating the selection step and the correction step for each frame timestamp to obtain a plurality of single-frame binocular video images;

[0171] Step A24, synthesizing the multiple single-frame binocular video images to obtain the binocular stereo video.

[0172] In the fifth embodiment of the present application, a target video file is obtained, and the video content is corrected through a selection step and a correction step to synthesize a single-frame binocular video image; and the selection step and the correction step are repeated for each frame timestamp to synthesize multiple single-frame binocular video images to obtain a binocular stereo video. Since a single-frame binocular video image is a corrected image, it eliminates the influence of the change in shooting angle on the user's viewing as much as possible, thereby ensuring that when the user watches a binocular stereo video composed of multiple single-frame binocular video images in the user's default posture, a complete binocular stereo viewing effect can be obtained, thereby avoiding discomfort such as dizziness in the user.

[0173] The sixth embodiment of the present application also provides a stereoscopic video playback method, please refer to Figure 4 , Figure 4 This is a flow chart of the sixth embodiment of the stereoscopic video playback method of the present application.

[0174] In this embodiment, the stereoscopic video playback method is applied to a player. The executor of the stereoscopic video playback method can be a shooting device such as a trinocular camera, which uses the stereoscopic video playback method to play the video after shooting is completed; the executor of the stereoscopic video playback method can also be a head-mounted display device such as VR (Virtual Reality) and AR (Augmented Reality), which uses the stereoscopic video playback method to correct and play the video content.

[0175] The stereoscopic video playback method comprises steps B10 to B20:

[0176] Step B10, parsing the data track of the target video file to obtain three sets of video content and three sets of corresponding posture change data; the target video file is obtained by the stereoscopic video shooting method of the above embodiment;

[0177] Step B20, based on the three groups of posture change data and the user's current posture, the video content is corrected for perspective, and the corrected binocular video images are obtained in real time and played synchronously.

[0178] It should be noted that the user's current posture refers to the user's real-time posture in motion mode, that is, the user's viewing angle has changed, and the video image needs to be corrected according to the user's current viewing angle so that the user can obtain a complete binocular stereoscopic viewing effect at each viewing angle.

[0179] In the sixth embodiment of the present application, the target video file is obtained, and based on the three sets of posture change data and the current posture of the user, the video content is corrected, and the corrected binocular video picture is played synchronously in real time. By correcting the perspective of the video picture in real time and displaying it, the effect of generating the single-frame binocular video picture of each frame timestamp in real time and playing it synchronously is achieved, ensuring that no matter whether the shooting perspective changes or the user changes the viewing perspective, a complete binocular stereoscopic viewing effect can be obtained, avoiding discomfort such as dizziness in the user.

[0180] Based on the sixth embodiment of the present application, in the seventh embodiment of the present application, the same or similar contents as those in the sixth embodiment can be referred to the above description, and will not be described in detail later. On this basis, step B20 includes steps B21 to B25:

[0181] Step B21, an acquisition step, acquiring the current posture of the user corresponding to a single frame timestamp;

[0182] In step B21, since the user's posture may change at any time while watching the stereoscopic video, it is necessary to obtain the user's current posture before playing the video picture corresponding to the single-frame timestamp, so as to perform perspective correction processing on the picture of the video content according to the user's current posture.

[0183] Step B22, a selection step, selecting two sets of data closest to the current posture of the user from the three sets of posture change data, obtaining two sets of single-frame posture change data, and solving two sets of monocular lens offset values;

[0184] In a feasible implementation manner, step B22 may include steps B221 to B222:

[0185] Step B221, comparing the three groups of posture change data corresponding to the single-frame timestamp with the current posture of the user one by one, to obtain two groups of single-frame posture change data closest to the current posture of the user;

[0186] Step B222, comparing the two sets of single-frame posture change data and horizontal parallax angle data, and calculating to obtain the two sets of monocular lens offset values.

[0187] In this embodiment, by comparing with the current posture of the user, the two sets of single-frame posture change data closest to each other are indexed, thereby ensuring that the two sets of single-frame posture change data are as close as possible to the user's current viewing angle, so that the video image can be corrected as much as possible according to the user's current viewing angle in the subsequent correction step. The two sets of monocular lens offset values ​​obtained by the solution can provide a correction benchmark for the subsequent correction step to ensure the correction effect of the video content.

[0188] Step B23, a correction step, based on the two sets of single-frame posture change data and the two sets of monocular lens offset values, correcting the video content and synthesizing to obtain the single-frame binocular video picture;

[0189] In a feasible implementation manner, step B23 may include steps B231 to B234:

[0190] Step B231, based on the two target shots corresponding to the two sets of single-frame posture change data, determining the two sets of video content corresponding to the two target shots, and obtaining two sets of single-frame video content;

[0191] Step B232, taking the two sets of monocular lens offset values ​​as a reference and according to the optical parameters of the two target lenses, respectively performing spherical projection on the two sets of single-frame video contents to obtain two sets of projected video contents;

[0192] Step B233, cutting and re-projecting the two groups of projected video contents into two groups of planar video frames;

[0193] Step B234, synthesizing the two groups of the planar video frames to obtain a single frame of the binocular video picture.

[0194] In this embodiment, by performing spherical projection on the single-frame video content, and then cutting and reprojecting, two sets of plane video frames are obtained, thereby realizing the perspective correction of the video screen. Among them, the two sets of single-frame video content are firstly spherically projected and then cut, so that the two sets of single-frame video content can be restored to the spherical space first. At this time, the single-frame video content in the spherical state has a three-dimensional posture relationship, which is convenient for cutting and correction; and then reprojection is performed to reproject the cut single-frame video content in the spherical state into a two-dimensional plane video frame, which is convenient for the player to play and display.

[0195] Step B24, display step, displaying a single frame of the binocular video picture;

[0196] Step B25, repeating the acquisition step, the selection step, the correction step and the display step for each frame timestamp to generate the binocular video image of each frame in real time and play it synchronously.

[0197] In the seventh embodiment of the present application, by executing the acquisition step, the selection step, the correction step and the display step, the perspective of a single frame of video can be corrected according to the user's current posture, and by repeating the above steps, the perspective of the video can be corrected and displayed in real time, thereby achieving the effect of real-time generation of the single frame binocular video picture with each frame time stamp and synchronous playback, ensuring that no matter whether the shooting perspective changes or the user changes the viewing perspective, a complete three-dimensional binocular visual viewing effect can be obtained, avoiding the user from feeling dizzy and other discomfort.

[0198] For example, to help understand the implementation process of the stereoscopic video shooting method obtained by combining this embodiment with the above-mentioned first embodiment, please refer to Figure 5 , Figure 5 A brief flowchart of a stereoscopic video shooting method is provided, specifically:

[0199] First, the three lenses of the trinocular camera respectively capture three groups of video content and write the three groups of video content into the target video file. The inertial measurement unit of the trinocular camera collects posture data and writes the calculated posture change data into the target video file. Then, based on the posture change data and the user's posture, the video content is corrected for perspective, so as to obtain a corrected single-frame binocular video image and achieve a perspective correction effect.

[0200] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the stereoscopic video shooting method of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0201] This application also provides a stereoscopic video shooting device, please refer to Figure 6 , the stereoscopic video shooting device comprises:

[0202] The shooting module 10 is used to shoot a stereoscopic video using the trinocular camera to obtain a stereoscopic video file; wherein the three lenses of the trinocular camera are spaced equally from each other; and the data track of the stereoscopic video file contains three sets of video content;

[0203] The acquisition module 20 is used to acquire the posture data of the three-eye camera during the shooting process;

[0204] A calculation module 30, for calculating the posture change angle of each lens at each moment based on the posture data and the positional relationship between the three lenses, to obtain three sets of posture change data;

[0205] The writing module 70 is used to write the three sets of posture change data into the data track to obtain a target video file; wherein the target video file is used to be read by post-processing software and / or a stereoscopic video player, so that the post-processing software and / or the stereoscopic video player can perform perspective correction on the video content based on the posture change data and the user posture.

[0206] The stereoscopic video shooting device provided by the present application adopts the stereoscopic video shooting method in the above embodiment, which can solve the technical problem that the change of the viewing angle of the video screen or the change of the viewing angle of the user will cause the three-dimensional information to be misplaced and cause the user to feel uncomfortable. Compared with the prior art, the beneficial effects of the stereoscopic video shooting device provided by the present application are the same as the beneficial effects of the stereoscopic video shooting method provided by the above embodiment, and the other technical features of the stereoscopic video shooting device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0207] The present application provides a stereoscopic video shooting device, which includes: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the stereoscopic video shooting method in the above-mentioned embodiment 1.

[0208] Reference below Figure 7, which shows a schematic diagram of the structure of a stereoscopic video shooting device suitable for implementing the embodiment of the present application. The stereoscopic video shooting device in the embodiment of the present application may include but is not limited to mobile terminals such as trinocular cameras, mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 7 The stereoscopic video shooting device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0209] like Figure 7 As shown, the stereoscopic video shooting device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the stereoscopic video shooting device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the stereoscopic video capture device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows a stereoscopic video capture device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0210] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0211] The stereoscopic video shooting device provided by the present application adopts the stereoscopic video shooting method in the above embodiment, which can solve the technical problem that the change of the viewing angle of the video screen or the change of the viewing angle of the user will cause the three-dimensional information to be misplaced and cause the user to feel uncomfortable. Compared with the prior art, the beneficial effects of the stereoscopic video shooting device provided by the present application are the same as the beneficial effects of the stereoscopic video shooting method provided by the above embodiment, and the other technical features in the stereoscopic video shooting device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0212] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0213] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0214] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the stereoscopic video shooting method in the above-mentioned embodiment.

[0215] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0216] The computer-readable storage medium may be included in the stereoscopic video shooting device; or may exist independently without being assembled into the stereoscopic video shooting device.

[0217] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by a stereoscopic video shooting device, the stereoscopic video shooting device: uses the three-eye camera to shoot a stereoscopic video to obtain a stereoscopic video file; wherein the distances between the three lenses of the three-eye camera are equal; the data track of the stereoscopic video file contains three groups of video content; during the shooting process, the posture data of the three-eye camera is collected; based on the posture data and the positional relationship between the three lenses, the posture change angle of each lens at each moment is calculated to obtain three groups of posture change data; the three groups of posture change data are written into the data track to obtain a target video file; wherein the target video file is used for post-processing software and / or a stereoscopic video player to read, so that the post-processing software and / or the stereoscopic video player can perform perspective correction on the video content based on the posture change data and the user posture.

[0218] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0219] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0220] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0221] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned stereoscopic video shooting method, and can solve the technical problem that changes in the viewing angle of the video screen or changes in the viewing angle of the user will cause the three-dimensional information to be misaligned and cause discomfort to the user. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the stereoscopic video shooting method provided by the above-mentioned embodiment, and will not be repeated here.

[0222] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned stereoscopic video shooting method when executed by a processor.

[0223] The computer program product provided by the present application can solve the technical problem that changes in the viewing angle of the video screen or the viewing angle of the user will cause the three-dimensional information to be misplaced and cause discomfort to the user. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the stereoscopic video shooting method provided by the above embodiment, and will not be repeated here.

[0224] This application also provides a stereoscopic video processing device, please refer to Figure 8 , the stereoscopic video processing device comprises:

[0225] The parsing module 10 is used to parse the data track of the target video file to obtain three sets of video content and three sets of corresponding posture change data; the target video file is obtained by the stereoscopic video shooting method of the above embodiment;

[0226] The correction module 20 is used to perform perspective correction on the video content based on the three sets of posture change data and the user's default posture to obtain a binocular stereo video.

[0227] The stereoscopic video processing device provided by the present application adopts the stereoscopic video processing method in the above embodiment, which can solve the technical problem that the change of the viewing angle of the video screen or the change of the viewing angle of the user will cause the three-dimensional information to be misplaced and cause the user to feel uncomfortable. Compared with the prior art, the beneficial effects of the stereoscopic video processing device provided by the present application are the same as the beneficial effects of the stereoscopic video processing method provided by the above embodiment, and the other technical features in the stereoscopic video processing device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0228] The present application provides a stereoscopic video processing device, which includes: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the stereoscopic video processing method in the above-mentioned embodiment 1.

[0229] Reference below Fig. 9, which shows a schematic diagram of the structure of a stereoscopic video processing device suitable for implementing the embodiment of the present application. The stereoscopic video processing device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig. 9 The stereoscopic video processing device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0230] like Fig. 9 As shown, the stereoscopic video processing device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the stereoscopic video processing device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the stereoscopic video processing device to communicate with other devices wirelessly or by wire to exchange data. Although the stereoscopic video processing device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0231] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0232] The stereoscopic video processing device provided by the present application adopts the stereoscopic video processing method in the above embodiment, which can solve the technical problem that the change of the viewing angle of the video screen or the change of the viewing angle of the user will cause the three-dimensional information to be misplaced and cause the user to feel uncomfortable. Compared with the prior art, the beneficial effects of the stereoscopic video processing device provided by the present application are the same as the beneficial effects of the stereoscopic video processing method provided by the above embodiment, and the other technical features in the stereoscopic video processing device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0233] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0234] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0235] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the stereoscopic video processing method in the above-mentioned embodiment.

[0236] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0237] The computer-readable storage medium may be included in the stereoscopic video processing device; or may exist independently without being assembled into the stereoscopic video processing device.

[0238] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the stereoscopic video processing device, the stereoscopic video processing device: parses the data track of the target video file to obtain three groups of video content and corresponding three groups of posture change data; the target video file is obtained by the stereoscopic video shooting method of the above-mentioned embodiment; based on the three groups of posture change data and the user's default posture, the video content is corrected for perspective to obtain a binocular stereoscopic video.

[0239] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0240] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0241] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0242] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned stereoscopic video processing method, and can solve the technical problem that changes in the viewing angle of the video screen or changes in the viewing angle of the user will cause the three-dimensional information to be misaligned and cause discomfort to the user. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the stereoscopic video processing method provided by the above-mentioned embodiment, and will not be repeated here.

[0243] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned stereoscopic video processing method when executed by a processor.

[0244] The computer program product provided by the present application can solve the technical problem that changes in the viewing angle of the video screen or the viewing angle of the user will cause the three-dimensional information to be misplaced and cause discomfort to the user. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the stereoscopic video processing method provided by the above embodiment, and will not be repeated here.

[0245] This application also provides a stereoscopic video playback device, please refer to Fig.10 , the stereoscopic video playback device comprises:

[0246] The parsing module 10 is used to parse the data track of the target video file to obtain three sets of video content and three sets of corresponding posture change data; the target video file is obtained by the stereoscopic video shooting method of the above embodiment;

[0247] The correction module 20 is used to perform perspective correction on the video content based on the three sets of posture change data and the user's current posture, obtain the corrected binocular video image in real time and play it synchronously.

[0248] The stereoscopic video playback device provided by the present application adopts the stereoscopic video playback method in the above embodiment, which can solve the technical problem that the change of the viewing angle of the video screen or the change of the viewing angle of the user will cause the three-dimensional information to be misplaced and cause the user to feel uncomfortable. Compared with the prior art, the beneficial effects of the stereoscopic video playback device provided by the present application are the same as the beneficial effects of the stereoscopic video playback method provided by the above embodiment, and the other technical features of the stereoscopic video playback device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0249] The present application provides a stereoscopic video playback device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the stereoscopic video playback method in the above-mentioned embodiment one.

[0250] Reference below Fig.11, which shows a schematic diagram of the structure of a stereoscopic video playback device suitable for implementing the embodiment of the present application. The stereoscopic video playback device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.11 The stereoscopic video playback device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0251] like Fig.11 As shown, the stereoscopic video playback device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the stereoscopic video playback device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the stereoscopic video playback device to communicate wirelessly or wired with other devices to exchange data. Although the stereoscopic video playback device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0252] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0253] The stereoscopic video playback device provided by the present application adopts the stereoscopic video playback method in the above embodiment, which can solve the technical problem that the change of the viewing angle of the video screen or the change of the viewing angle of the user will cause the three-dimensional information to be misplaced and cause the user to feel uncomfortable. Compared with the prior art, the beneficial effects of the stereoscopic video playback device provided by the present application are the same as the beneficial effects of the stereoscopic video playback method provided by the above embodiment, and the other technical features in the stereoscopic video playback device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0254] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0255] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0256] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the stereoscopic video playback method in the above-mentioned embodiment.

[0257] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0258] The computer-readable storage medium may be included in the stereoscopic video playback device; or may exist independently without being assembled into the stereoscopic video playback device.

[0259] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the stereoscopic video playback device, the stereoscopic video playback device: parses the data track of the target video file to obtain three groups of video content and corresponding three groups of posture change data; the target video file is obtained by the stereoscopic video shooting method of the above-mentioned embodiment; based on the three groups of posture change data and the user's current posture, the video content is corrected in perspective, and the corrected binocular video picture is obtained in real time and played synchronously.

[0260] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0261] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0262] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0263] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned stereoscopic video playback method, and can solve the technical problem that changes in the viewing angle of the video screen or changes in the viewing angle of the user will cause the three-dimensional information to be misaligned and cause discomfort to the user. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the stereoscopic video playback method provided by the above-mentioned embodiment, and will not be repeated here.

[0264] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned stereoscopic video playback method when executed by a processor.

[0265] The computer program product provided by the present application can solve the technical problem that changes in the viewing angle of the video screen or the viewing angle of the user will cause the three-dimensional information to be misplaced and cause discomfort to the user. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the stereoscopic video playback method provided by the above embodiment, and will not be repeated here.

[0266] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A stereoscopic video shooting method, characterized in that: Applied to a three-eye camera, the stereoscopic video shooting method includes: Using the trinocular camera to shoot a stereoscopic video to obtain a stereoscopic video file; wherein the distances between the three lenses of the trinocular camera are equal; and the data track of the stereoscopic video file contains three sets of video content; During the shooting process, collecting the posture data of the trinocular camera; Based on the posture data and the positional relationship between the three lenses, calculating the posture change angle of each lens at each moment to obtain three sets of posture change data; The three groups of posture change data are written into the data track to obtain a target video file; wherein the target video file is used to be read by post-processing software and / or a stereoscopic video player, so that the post-processing software and / or the stereoscopic video player can perform perspective correction on the video content based on the posture change data and the user's posture.

2. The stereoscopic video shooting method according to claim 1, wherein: The three lenses have the same optical structure, and the three lenses have the same parameter settings; the parameter settings include at least one or more of resolution, frame rate, automatic exposure, automatic focus and automatic white balance.

3. The stereoscopic video shooting method according to claim 1, wherein: The collection frequency of the posture data is greater than the frame rate of the video content; Before the step of writing the three sets of posture change data into the data track to obtain the target video file, the step further includes: Selecting the posture change data closest to the acquisition time of each frame of the video content for matching, to obtain paired video images and paired posture change data; Marking the paired video images and the paired posture change data with a system timestamp; Based on the system timestamp, the paired video images are time-aligned with the paired gesture change data.

4. The stereoscopic video shooting method according to claim 1, wherein: The attitude data includes heading angle data and pitch angle data; The step of calculating the posture change angle of each lens at each moment based on the posture data and the positional relationship between the three lenses to obtain three sets of posture change data comprises: Subtracting the initial heading angle from the heading angle data at each moment to obtain the heading change angle at each moment; Based on the heading change angle and the positional relationship between the three lenses, the heading change angle of each lens is calculated to obtain three groups of single-lens heading change angles; Subtracting the initial pitch angle from the pitch angle data at each moment to obtain the pitch change angle at each moment; Based on the pitch change angle and the positional relationship between the three lenses, the pitch change angle of each lens is calculated to obtain three groups of single-lens pitch change angles; The three groups of single-lens heading change angles and the corresponding three groups of single-lens pitch change angles are integrated to obtain three groups of posture change data.

5. A stereoscopic video processing method, characterized in that: Applied to the back end, the stereoscopic video processing method includes: Parsing the data track of the target video file to obtain three sets of video content and three sets of corresponding posture change data; the target video file is obtained by the stereoscopic video shooting method according to claim 1; Based on the three sets of posture change data and the user's default posture, the video content is corrected for perspective to obtain a binocular stereoscopic video.

6. The stereoscopic video processing method according to claim 5, characterized in that: The step of performing perspective correction on the video content based on the three sets of posture change data and the user's default posture to obtain a binocular stereoscopic video includes: A selection step, selecting two sets of data closest to the user's default posture from the three sets of posture change data corresponding to the single-frame timestamp, obtaining two sets of single-frame posture change data, and solving two sets of monocular lens offset values; A correction step, based on the two sets of single-frame posture change data and the two sets of monocular lens offset values, correcting the video content and synthesizing to obtain a single-frame binocular video picture at the single-frame timestamp; Repeat the selection step and the correction step for each frame timestamp to obtain a plurality of single-frame binocular video images; A plurality of the single-frame binocular video images are synthesized to obtain the binocular stereo video.

7. The stereoscopic video processing method according to claim 6, characterized in that: The selection step comprises: Performing posture comparisons on the three groups of posture change data corresponding to the single-frame timestamps and the user's default posture one by one, and obtaining two groups of single-frame posture change data closest to the user's default posture; The two sets of single-frame posture change data and horizontal parallax angle data are compared to obtain the two sets of monocular lens offset values.

8. The stereoscopic video processing method according to claim 6, characterized in that: The correction steps include: Based on the two target shots corresponding to the two sets of single-frame posture change data, determining the two sets of video content corresponding to the two target shots, and obtaining two sets of single-frame video content; Taking the two sets of monocular lens offset values ​​as a reference and according to the optical parameters of the two target lenses, spherical projection is performed on the two sets of single-frame video contents respectively to obtain two sets of projected video contents; The two groups of projected video contents are cropped and re-projected into two groups of planar video frames; The two groups of planar video frames are synthesized to obtain a single-frame binocular video picture.

9. A stereoscopic video playback method, characterized in that: Applied to a player, the stereoscopic video playback method includes: Parsing the data track of the target video file to obtain three sets of video content and three sets of corresponding posture change data; the target video file is obtained by the stereoscopic video shooting method according to claim 1; Based on the three sets of posture change data and the user's current posture, the video content is corrected for perspective, and the corrected binocular video images are obtained in real time and played synchronously.

10. The stereoscopic video processing method according to claim 9, characterized in that: The step of correcting the viewing angle of the video content based on the three sets of posture change data and the current posture of the user, obtaining the corrected binocular video picture in real time and playing it synchronously comprises: An acquisition step of acquiring the current posture of the user corresponding to a single frame timestamp; A selection step, selecting two sets of data closest to the current posture of the user from the three sets of posture change data, obtaining two sets of single-frame posture change data, and solving two sets of monocular lens offset values; A correction step, based on the two sets of single-frame posture change data and the two sets of monocular lens offset values, correcting the video content and synthesizing to obtain the single-frame binocular video picture; Display step, displaying a single frame of the binocular video picture; The acquisition step, the selection step, the correction step and the display step are repeated for each frame time stamp to generate the binocular video picture of each frame in real time and play it synchronously.

11. The stereoscopic video playback method according to claim 10, characterized in that: The selection step comprises: Performing posture comparisons on the three groups of posture change data corresponding to the single-frame timestamps and the current posture of the user one by one, and obtaining two groups of single-frame posture change data closest to the current posture of the user; The two sets of single-frame posture change data and horizontal parallax angle data are compared to obtain the two sets of monocular lens offset values.

12. The stereoscopic video playback method according to claim 10, characterized in that: The correction steps include: Based on the two target shots corresponding to the two sets of single-frame posture change data, determining the two sets of video content corresponding to the two target shots, and obtaining two sets of single-frame video content; Taking the two sets of monocular lens offset values ​​as a reference and according to the optical parameters of the two target lenses, spherical projection is performed on the two sets of single-frame video contents respectively to obtain two sets of projected video contents; The two groups of projected video contents are cropped and re-projected into two groups of planar video frames; The two groups of planar video frames are synthesized to obtain a single-frame binocular video picture.

13. A stereoscopic video shooting device, characterized in that: The stereoscopic video shooting device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the stereoscopic video shooting method according to any one of claims 1 to 4.

14. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the stereoscopic video shooting method according to any one of claims 1 to 4 are implemented.

15. A stereoscopic video processing device, characterized in that: The stereoscopic video processing device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the stereoscopic video processing method according to any one of claims 5 to 8.

16. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the stereoscopic video processing method according to any one of claims 5 to 8 are implemented.

17. A stereoscopic video playback device, characterized in that: The stereoscopic video playback device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the stereoscopic video playback method according to any one of claims 9 to 12.

18. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the stereoscopic video playback method according to any one of claims 9 to 12 are implemented.

Images