Stereoscopic video comfort prompting method, device, equipment, medium and program product

Abstract

The invention discloses a stereoscopic video comfort prompting method, device and equipment, a medium and a program product, and relates to the technical field of stereoscopic vision, and the prompting method comprises the steps: shooting a stereoscopic video through stereoscopic video shooting equipment; in the shooting process of the stereoscopic video, calculating the single-frame picture stereoscopic comfort of each frame picture of the stereoscopic video according to a single-frame picture stereoscopic comfort evaluation algorithm; displaying the video picture of the stereoscopic video and the comfort information of the single-frame picture in a monitoring window of the stereoscopic video shooting equipment; wherein the single-frame picture comfort degree information comprises the single-frame picture three-dimensional comfort degree corresponding to the current video picture. According to the method, the single-frame picture three-dimensional comfort level of each frame picture is calculated in real time and displayed in the monitoring window in the three-dimensional video shooting process, so that a user can perceive the three-dimensional video comfort level of the currently shot video picture in real time in the shooting process, the user can conveniently decide a shooting strategy and adjust the shooting strategy in time, working chains are reduced, and the shooting efficiency is improved. And shooting efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of stereoscopic vision technology, and in particular to a method, device, equipment, medium and program product for providing comfort level of stereoscopic video. Background Art

[0002] Stereoscopic videos have a comfort problem. If the object is too close to the camera, the two eyes will not be able to see the video together when watching it, causing discomfort to the human brain.

[0003] Currently, it is difficult for users to know the stereoscopic comfort of a stereoscopic video during or after shooting. The stereoscopic comfort of the video can only be known when the stereoscopic video file is put into a VR / AR head display device for viewing. If the stereoscopic comfort is not good, the video material cannot be used and needs to be reshot.

[0004] However, users rarely carry a VR / AR device with them to check the comfort level during daily shooting. Even if they carry a VR / AR device, the process of monitoring the stereoscopic effect is time-consuming and inefficient, which is not suitable for daily personal shooting.

[0005] Therefore, when using a stereo camera to shoot a stereoscopic video, the problem that the user cannot perceive the stereoscopic comfort of the video in time needs to be solved urgently. Summary of the invention

[0006] The main purpose of this application is to provide a stereoscopic video comfort prompt method, device, equipment, medium and program product, aiming to solve the technical problem that when using a stereo camera to shoot stereoscopic video, the user cannot perceive the stereoscopic comfort of the video in time.

[0007] To achieve the above object, the present application proposes a stereoscopic video comfort prompting method, the method comprising:

[0008] Shooting a stereoscopic video using a stereoscopic video shooting device;

[0009] During the shooting process of the stereoscopic video, the single-frame stereoscopic comfort of each frame of the stereoscopic video is calculated according to a single-frame stereoscopic comfort evaluation algorithm;

[0010] The video picture and single-frame picture comfort information of the stereoscopic video are displayed in the monitoring window of the stereoscopic video shooting device; wherein the single-frame picture comfort information includes the single-frame picture stereoscopic comfort corresponding to the current video picture.

[0011] In one embodiment, during the shooting process of the stereoscopic video, the step of calculating the single-frame stereoscopic comfort of each frame of the stereoscopic video according to a single-frame stereoscopic comfort evaluation algorithm comprises:

[0012] During the shooting process of the stereoscopic video, calculating the parallax data of the left lens picture and the right lens picture at the same time in the stereoscopic video;

[0013] According to a preset parallax value range, obtaining a classification result of each parallax value in the parallax data;

[0014] According to the proportion of different classification results in the disparity data, the stereoscopic comfort of the single frame is determined according to a preset determination order:

[0015] If the classification result shows that the proportion of extremely close images is greater than the preset threshold of extremely close image proportion, the stereoscopic comfort of the single frame is poor; otherwise, the next step is executed;

[0016] If the classification result shows that the proportion of the second closest is less than the preset threshold of the second closest proportion, the stereoscopic comfort of the single frame is excellent; otherwise, the next step is executed;

[0017] If the classification result shows that the proportion of medium and far images is greater than the preset threshold of the proportion of medium and far images, the stereoscopic comfort of the single frame is good; otherwise, the next step is executed;

[0018] If the classification result is the other cases, the stereoscopic comfort level of the single-frame image is medium.

[0019] In one embodiment, the method further comprises:

[0020] If the stereoscopic comfort of the single-frame image is medium or poor, the camera position adjustment suggestion information and the scene layout adjustment suggestion information are also displayed on the monitoring window.

[0021] In one embodiment, the method further comprises:

[0022] The single-frame stereo comfort degree corresponding to each frame is stored in a stereo video file;

[0023] Determining whether the shooting of the stereoscopic video is completed;

[0024] If yes, then based on the single-frame stereoscopic comfort in the stereoscopic video file and according to the overall video stereoscopic comfort evaluation algorithm, the overall stereoscopic comfort of the stereoscopic video file is calculated, and the overall stereoscopic comfort is displayed in the monitoring window;

[0025] If not, continue to calculate the stereoscopic comfort of the single frame of the stereoscopic video, and display the single frame comfort information in the monitoring window.

[0026] In one embodiment, the step of calculating the overall stereoscopic comfort of the stereoscopic video file according to the overall video stereoscopic comfort evaluation algorithm comprises:

[0027] Calculating the proportions of different single-frame stereo comfort levels in the stereo video to obtain the proportions of different categories of single-frame stereo comfort levels;

[0028] According to the proportion results of the stereoscopic comfort of the single-frame images of different categories, the overall stereoscopic comfort of the stereoscopic video file is determined according to a preset determination order:

[0029] If the proportion of the single-frame images with excellent stereoscopic comfort is greater than the preset excellent threshold, and the proportion of the single-frame images with poor stereoscopic comfort is less than the preset poor threshold, then the overall stereoscopic comfort of the stereoscopic video file is excellent; otherwise, execute the next step;

[0030] If the proportion of single-frame images with medium stereo comfort is greater than a preset medium threshold, and the proportion of single-frame images with poor stereo comfort is greater than a preset poor threshold, then the overall stereo comfort of the stereo video file is poor; otherwise, execute the next step;

[0031] If the proportion of good stereo comfort of the single-frame images is greater than the preset good threshold, and the proportion of poor stereo comfort of the single-frame images is less than the preset poor threshold, then the overall stereo comfort of the stereo video file is good; otherwise, execute the next step;

[0032] If the proportion result is the other cases, the overall stereoscopic comfort of the stereoscopic video file is medium.

[0033] In one embodiment, after the step of calculating the overall stereoscopic comfort of the stereoscopic video file, the method further includes:

[0034] When the overall stereoscopic comfort is medium or poor, the stereoscopic video file is divided into N unit time periods according to the duration, and the number of low-quality pictures in each unit time period is detected; wherein the low-quality picture refers to the video picture whose single-frame stereoscopic comfort is medium or poor;

[0035] If the number of the low-quality images in the k-th unit time period reaches a preset number threshold, a segment re-recording prompt message is displayed in the monitoring window; wherein the segment re-recording prompt message includes the start time and end time of the k-th unit time period; 1≤k≤N;

[0036] If the number of the low-quality images in each unit time period is less than the preset number threshold, a full re-recording prompt message is displayed in the monitoring window; wherein the full re-recording prompt message is used to prompt the user to re-record the entire stereoscopic video.

[0037] In addition, to achieve the above-mentioned purpose, the present application also proposes a stereoscopic video comfort prompting device, the stereoscopic video comfort prompting device comprising:

[0038] A shooting module, used for shooting a stereoscopic video using a stereoscopic video shooting device;

[0039] A calculation module, used for calculating the single-frame stereoscopic comfort of each frame of the stereoscopic video according to a single-frame stereoscopic comfort evaluation algorithm during the shooting process of the stereoscopic video;

[0040] A display module is used to display the video picture and single-frame picture comfort information of the stereoscopic video in the monitoring window of the stereoscopic video shooting device; wherein the single-frame picture comfort information includes the single-frame picture stereoscopic comfort corresponding to the currently displayed video picture.

[0041] In addition, to achieve the above-mentioned purpose, the present application also proposes a stereoscopic video shooting device, the device comprising: a shooting module, a display module, a memory, a processor, and a computer program stored in the memory and executable on the processor;

[0042] The shooting module is used to shoot stereoscopic video;

[0043] The display module is used to display the video picture and single-frame picture comfort information of the stereoscopic video; wherein the single-frame picture comfort information is obtained by the stereoscopic video comfort prompting method as described above;

[0044] The computer program is configured to implement the steps of the stereoscopic video comfort prompting method as described above.

[0045] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the stereoscopic video comfort prompt method described above are implemented.

[0046] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the steps of the stereoscopic video comfort prompting method as described above.

[0047] One or more technical solutions proposed in this application have at least the following technical effects:

[0048] The present application utilizes a stereoscopic video shooting device to shoot a stereoscopic video; during the shooting process of the stereoscopic video, the single-frame stereoscopic comfort of each frame of the stereoscopic video is calculated according to a single-frame stereoscopic comfort evaluation algorithm; the video picture and single-frame comfort information of the stereoscopic video are displayed in a monitoring window of the stereoscopic video shooting device; wherein the single-frame comfort information includes the single-frame stereoscopic comfort corresponding to the current video picture.

[0049] After adopting the stereoscopic video comfort prompt method, the present application can calculate the single-frame stereoscopic comfort of each frame in real time during the process of shooting stereoscopic video, and display the video picture and its corresponding single-frame stereoscopic comfort in the monitoring window of the stereoscopic video shooting device, so that the user can perceive the stereoscopic video comfort of the currently captured video picture in real time during the shooting process, thereby facilitating the user to decide on the shooting strategy and decide whether to adjust the camera position and scenery, etc., so as to facilitate the user to make timely adjustments, reduce the work chain, and improve shooting efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0051] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0052] Figure 1 A flowchart of the first embodiment of the stereoscopic video comfort prompting method of the present application is provided;

[0053] Figure 2 A schematic diagram of a simplified flow chart of a stereoscopic video comfort prompting method provided in Embodiments 1, 2, and 3 of the present application;

[0054] Figure 3 This is a schematic diagram of the module structure of the stereoscopic video comfort prompting device in the embodiment of the present application;

[0055] Figure 4 This is a schematic diagram of the device structure of the hardware operating environment involved in the stereoscopic video comfort prompting method in the embodiment of the present application.

[0056] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0057] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0058] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0059] The main solution of the embodiment of the present application is: using a stereoscopic video shooting device to shoot a stereoscopic video; during the shooting process of the stereoscopic video, calculating the single-frame stereoscopic comfort of each frame of the stereoscopic video according to a single-frame stereoscopic comfort evaluation algorithm; displaying the video picture and single-frame comfort information of the stereoscopic video in the monitoring window of the stereoscopic video shooting device; wherein the single-frame comfort information includes the single-frame stereoscopic comfort corresponding to the current video picture.

[0060] In this embodiment, for the convenience of description, the following description is made by taking a stereoscopic video shooting device as the execution subject.

[0061] In the prior art, stereoscopic videos have a comfort problem. If an object is too close to the camera, the two eyes will not be able to see the captured video together when watching it, causing discomfort to the human brain.

[0062] Currently, it is difficult for users to know the stereoscopic comfort of a stereoscopic video during or after shooting. The stereoscopic comfort of the video can only be known when the stereoscopic video file is put into a VR / AR head display device for viewing. If the stereoscopic comfort is not good, the video material cannot be used and needs to be reshot.

[0063] However, users rarely carry a VR / AR device with them to check the comfort level during daily shooting. Even if they carry a VR / AR device, the process of monitoring the stereoscopic effect is time-consuming and inefficient, which is not suitable for daily personal shooting.

[0064] Therefore, when using a stereo camera to shoot a stereoscopic video, the problem that the user cannot perceive the stereoscopic comfort of the video in time needs to be solved urgently.

[0065] The present application provides a solution, which uses a stereoscopic video shooting device to shoot a stereoscopic video; during the shooting process of the stereoscopic video, the single-frame stereoscopic comfort of each frame of the stereoscopic video is calculated according to a single-frame stereoscopic comfort evaluation algorithm; the video picture and single-frame comfort information of the stereoscopic video are displayed in a monitoring window of the stereoscopic video shooting device; wherein the single-frame comfort information includes the single-frame stereoscopic comfort corresponding to the current video picture.

[0066] After adopting the stereoscopic video comfort prompt method, the present application can calculate the single-frame stereoscopic comfort of each frame in real time during the process of shooting stereoscopic video, and display the video picture and its corresponding single-frame stereoscopic comfort in the monitoring window of the stereoscopic video shooting device, so that the user can perceive the stereoscopic video comfort of the currently captured video picture in real time during the shooting process, thereby facilitating the user to decide on the shooting strategy and decide whether to adjust the camera position and scenery, etc., so as to facilitate the user to make timely adjustments, reduce the work chain, and improve shooting efficiency.

[0067] It should be noted that the execution subject of this embodiment may be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a stereoscopic video shooting device, etc. The following takes a stereoscopic video shooting device as an example to illustrate this embodiment and the following embodiments.

[0068] Based on this, the present application embodiment provides a stereoscopic video comfort prompting method, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the stereoscopic video comfort prompting method of the present application.

[0069] In this embodiment, the stereoscopic video comfort prompting method includes steps S10 to S30:

[0070] Step S10, using a stereoscopic video shooting device to shoot a stereoscopic video;

[0071] It should be noted that the stereoscopic video shooting device can be set as a stereo camera such as a binocular camera or a multi-eye camera. Since stereoscopic video shooting usually requires at least two cameras with a predetermined distance between each other, so that the captured images have parallax, generally speaking, the larger the parallax, the more obvious the stereo effect. Therefore, a stereo camera such as a binocular camera is used for shooting. Since the stereo camera is provided with at least two cameras with a preset distance, images with parallax can be captured, thereby producing a stereoscopic visual effect.

[0072] Step S20, during the shooting process of the stereoscopic video, calculating the single-frame stereoscopic comfort of each frame of the stereoscopic video according to a single-frame stereoscopic comfort evaluation algorithm;

[0073] It should be noted that the stereoscopic comfort of a single-frame picture refers to an evaluation index of the comfort level of the stereoscopic viewing effect of a single-frame video picture. Exemplarily, the stereoscopic comfort of a single-frame picture can be divided into four indicators: excellent, good, medium, and poor, or it can be divided into multiple indicators such as A, B, C, D, E, and F. The specific evaluation index to be used can be selected according to actual needs. As long as it can reflect the evaluation of the stereoscopic effect of a single-frame picture of a stereoscopic video, the evaluation index obtained by a simple transformation of the stereoscopic comfort of a single-frame picture on this basis should be regarded as a technical feature that is essentially the same as that of the present application. In the present application, a scheme is adopted in which the stereoscopic comfort of a single-frame picture can be divided into four indicators: excellent, good, medium, and poor.

[0074] Step S30, displaying the video picture and single-frame picture comfort information of the stereoscopic video in the monitoring window of the stereoscopic video shooting device; wherein the single-frame picture comfort information includes the single-frame picture stereo comfort corresponding to the current video picture.

[0075] It should be noted that the monitoring window of the stereoscopic video shooting device can be understood as a display window of a stereoscopic camera, a display screen or other components with display functions, and the currently shot video image can be displayed in real time on the monitoring window of the stereoscopic video shooting device.

[0076] The present embodiment provides a stereoscopic video comfort prompting method, which can calculate the single-frame stereoscopic comfort of each frame in real time during the process of shooting stereoscopic video, and display the video picture and its corresponding single-frame stereoscopic comfort in the monitoring window of the stereoscopic video shooting device, so that the user can perceive the stereoscopic video comfort of the currently captured video picture in real time during the shooting process, thereby facilitating the user to decide on the shooting strategy and decide whether to adjust the camera position and the scenery, etc., so that the user can make timely adjustments, reduce the work chain, and improve the shooting efficiency.

[0077] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the first embodiment can be referred to the above description, and will not be described in detail later. On this basis, step S20 can include steps S21 to S23:

[0078] Step S21, during the shooting process of the stereoscopic video, calculating the parallax data of the left lens picture and the right lens picture at the same moment in the stereoscopic video;

[0079] It should be noted that the disparity data is an m*n matrix, which is equivalent to dividing the image into m*n grids. Each value in the matrix represents the difference between the left lens image and the right lens image in the current grid range; the larger the difference, the closer the object is to the camera; otherwise, the farther it is. The disparity data can be calculated using the OpenCV algorithm library.

[0080] Step S22, obtaining a classification result of each disparity value in the disparity data according to a preset disparity value range;

[0081] Among them, the setting of the preset parallax value range can be adopted as follows: define the extremely close parallax value pn1, the second closest parallax value pn2, and the medium and far disparity value pf1; if the parallax value in the parallax data is ≥pn1, the classification result of the parallax value is extremely close; if pn2≤parallax value<pn1, the classification result of the parallax value is secondarily close; if pf1≤parallax value<pn2, the classification result of the parallax value is medium and far; if the parallax value in the parallax data is<pf1, the classification result of the parallax value is extremely far.

[0082] Step S23, determining the stereoscopic comfort of the single frame according to the proportion of the different classification results in the disparity data in accordance with a preset determination order:

[0083] Step S231, if the classification result is that the proportion of extremely close images is greater than the preset threshold of the proportion of extremely close images, then the stereoscopic comfort of the single frame image is poor; otherwise, execute the next step;

[0084] Step S232, if the classification result is that the proportion of the second closest is less than the preset threshold of the second closest proportion, then the stereoscopic comfort of the single frame is excellent; otherwise, execute the next step;

[0085] Step S233, if the classification result is that the proportion of medium and far images is greater than the preset threshold of the proportion of medium and far images, then the stereoscopic comfort of the single frame image is good; otherwise, execute the next step;

[0086] Step S234: If the classification result is other cases, the stereoscopic comfort level of the single-frame image is medium.

[0087] It should be noted that when the classification result is the other cases, the corresponding situation at this time is that the classification result is that the proportion of extremely far is greater than the preset threshold of the extremely far proportion. In this case, the stereo comfort of the single-frame picture is medium.

[0088] In this embodiment, the disparity data is calculated, and according to the preset disparity value range, the classification result of each disparity value in the disparity data is obtained, and then the proportion of different classification results is compared with different preset thresholds, so as to obtain the stereo comfort of a single frame. The calculation method of this single-frame stereo comfort evaluation algorithm is simple and efficient, and is suitable for real-time calculation of the stereo comfort of the current picture and synchronous display of the stereo comfort of the video picture and the corresponding single-frame picture. Due to the low computational complexity of the algorithm, the algorithm is suitable for deployment in stereo video shooting equipment with relatively limited computing resources such as stereo cameras.

[0089] After step S23, the stereoscopic video comfort prompting method may further include step S24:

[0090] Step S24: If the stereoscopic comfort of the single-frame image is medium or poor, camera position adjustment suggestion information and scene layout adjustment suggestion information are also displayed on the monitoring window.

[0091] For users who do not understand the meaning of stereo comfort, they may not be able to intuitively understand what adjustments should be made from the value of stereo comfort. In order to facilitate users to know whether they need to adjust the shooting, in step S24, by directly displaying the camera adjustment suggestion information and the scene layout adjustment suggestion information in the monitoring window when the comfort level of the current picture is medium or poor, it is convenient for users to quickly understand what adjustment operations should be taken, thereby lowering the user's understanding threshold.

[0092] It should be noted that the camera position adjustment suggestion information may include information such as getting closer to the shooting location, moving away from the shooting location, adjusting the focal length, etc.; the scene layout adjustment suggestion information may include information such as reducing the scenery that is extremely close to the shooting equipment, reducing the scenery that is extremely far away, etc.

[0093] In the second embodiment of the present application, by calculating the disparity data and obtaining the classification result of each disparity value in the disparity data according to the preset disparity value range, the proportion of different classification results is compared with different preset thresholds to obtain the stereo comfort of a single frame; the calculation method of the single-frame stereo comfort evaluation algorithm is simple and efficient, and is suitable for real-time calculation of the stereo comfort of the current picture and synchronous display of the stereo comfort of the video picture and the corresponding single-frame picture; due to the low calculation complexity of the algorithm, the algorithm is suitable for deployment in stereo video shooting equipment with relatively limited computing resources such as stereo cameras. This embodiment also directly displays the camera adjustment suggestion information and the scene layout adjustment suggestion information in the monitoring window when the comfort of the current picture is medium or poor, so as to facilitate users to quickly understand what adjustment operations should be taken and reduce the user's understanding threshold.

[0094] Based on the first embodiment of the present application, in the third embodiment of the present application, the same or similar contents as those in the first embodiment can be referred to the above description, and will not be described in detail later. On this basis, after step S30, the stereoscopic video comfort prompting method further includes steps S40 to S70:

[0095] Step S40, storing the single-frame stereo comfort level corresponding to each frame into a stereo video file;

[0096] The stereo comfort of a single frame may be stored in the data track of a stereo video file.

[0097] Step S50, determining whether the shooting of the stereoscopic video is completed;

[0098] It should be noted that the judgment method can be to judge whether the stereoscopic video file is still writing new data, or to judge whether the shooting program is still executing. Of course, other judgment methods can also be used. The specific method of judging whether the shooting is finished is not limited here.

[0099] Step S60: if yes, then based on the single-frame stereoscopic comfort in the stereoscopic video file, according to the overall video stereoscopic comfort evaluation algorithm, calculate the overall stereoscopic comfort of the stereoscopic video file, and display the overall stereoscopic comfort in the monitoring window;

[0100] In a feasible implementation manner, in step S60, the step of calculating the overall stereoscopic comfort of the stereoscopic video file according to the overall video stereoscopic comfort evaluation algorithm may include steps A61 to A62:

[0101] Step A61, calculating the proportions of different single-frame stereoscopic comfort levels in the stereoscopic video, and obtaining the proportions of different categories of single-frame stereoscopic comfort levels;

[0102] Step A62, according to the proportion results of the stereoscopic comfort of the single-frame images of different categories, the overall stereoscopic comfort of the stereoscopic video file is determined according to a preset determination order:

[0103] Step A621, if the proportion of single-frame images with excellent stereoscopic comfort is greater than a preset excellent threshold, and the proportion of single-frame images with poor stereoscopic comfort is less than a preset poor threshold, then the overall stereoscopic comfort of the stereoscopic video file is excellent; otherwise, execute the next step;

[0104] Step A622, if the proportion of single-frame images with medium stereo comfort is greater than a preset medium threshold, and the proportion of single-frame images with poor stereo comfort is greater than a preset poor threshold, then the overall stereo comfort of the stereo video file is poor; otherwise, execute the next step;

[0105] Step A623, if the proportion of the single-frame images with good stereoscopic comfort is greater than the preset good threshold, and the proportion of the single-frame images with poor stereoscopic comfort is less than the preset poor threshold, then the overall stereoscopic comfort of the stereoscopic video file is good; otherwise, execute the next step;

[0106] In step A624, if the proportion result is the other cases, the overall stereoscopic comfort level of the stereoscopic video file is medium.

[0107] It should be noted that, since the overall stereoscopic comfort of the stereoscopic video file is determined according to a preset judgment order in step A62, in steps A621 to A624, after each judgment step is executed, the next judgment step will be executed only if the conditions are not met. Therefore, it can effectively avoid the situation where the proportion of the stereoscopic comfort of a single single-frame picture corresponds to the overall stereoscopic comfort of different stereoscopic video files.

[0108] Exemplarily, when the preset judgment order is not used for judgment, for the case where the proportion of single-frame images with excellent stereo comfort is greater than the preset excellent threshold, the proportion of single-frame images with good stereo comfort is greater than the preset good threshold, and the proportion of single-frame images with poor stereo comfort is less than the preset poor threshold, it satisfies the conditions of both step A621 and step A623. In this case, the overall stereo comfort of the stereo video file can be either excellent or good, which will cause confusion in the overall stereo comfort of the final output. When the preset judgment order is used for judgment, for the case in the example, step A621 is judged first. Since this case satisfies the conditions of step A621, it is confirmed that the overall stereo comfort of the stereo video file in this case can be either excellent, and the entire judgment process is terminated. The final overall stereo comfort will not cause confusion, avoiding the situation where a single proportion result corresponds to multiple overall stereo comforts.

[0109] In this embodiment, by calculating the proportion of different single-frame stereo comfort in the stereo video, the proportion of the stereo comfort of different categories of single-frame is obtained; by comparing the different proportion results with various preset thresholds, the overall stereo comfort of the stereo video is obtained. This overall video stereo comfort evaluation algorithm is simple and efficient, because the evaluation algorithm does not need to recalculate the stereo comfort of each frame, but calculates the proportion of different single-frame stereo comfort in the stereo video, and compares the proportion of different categories with the preset thresholds of different categories to obtain the overall stereo comfort. Therefore, the use of this evaluation algorithm for calculation can quickly calculate the overall stereo comfort of the stereo video file, avoiding the user having to wait for a long time to obtain the overall stereo comfort, thereby improving work efficiency.

[0110] In a feasible implementation manner, in step S60, after the step of calculating the overall stereoscopic comfort of the stereoscopic video file, steps B61 to B63 may also be included:

[0111] Step B61, when the overall stereoscopic comfort level is medium or poor, the stereoscopic video file is divided into N unit time periods according to the duration, and the number of low-quality pictures in each unit time period is detected; wherein the low-quality pictures refer to the video pictures whose single-frame stereoscopic comfort level is medium or poor;

[0112] Among them, by dividing the stereoscopic video file into N unit time periods according to the duration, and detecting the number of low-quality pictures in each unit time period, it can be known whether there are too many low-quality pictures in each unit time period. Too many low-quality pictures in a single unit time period reflects that the overall picture quality in this time period is low and needs to be re-recorded. Therefore, the detection of each unit time period can accurately know the picture quality in the subdivided time period, so as to re-record the shooting content of the time period, saving shooting costs.

[0113] Step B62, if the number of the low-quality images in the k-th unit time period reaches a preset number threshold, displaying a clip re-recording prompt message in the monitoring window; wherein the clip re-recording prompt message includes the start time and end time of the k-th unit time period; 1≤k≤N;

[0114] In step B62, when the number of low-quality images in the k-th unit time period reaches a preset threshold, a clip re-recording prompt message is displayed in the monitoring window, thereby prompting the photographer to re-record, and the start time and end time of the k-th unit time period are displayed in the monitoring window, which facilitates the photographer to efficiently and accurately time-locate the stereoscopic video file, thereby improving the convenience of the photographer in reviewing the video images of the k-th unit time period.

[0115] Furthermore, as an optional implementation, the clip re-recording prompt information may also include a video jump link for the kth unit time period, which, when selected by the user, jumps to the start time of the kth unit time period and plays the video content of the kth unit time period, and stops playing when the video reaches the end time of the kth unit time period. In this way, the "one-click play" effect of the video content of the kth unit time period can be achieved, further improving the operational efficiency of replaying the kth unit time period.

[0116] Step B63, if the number of the low-quality images in each unit time period is less than the preset number threshold, a full re-recording prompt message is displayed in the monitoring window; wherein the full re-recording prompt message is used to prompt the photographer to re-record the entire stereoscopic video.

[0117] In step B63, when the overall stereo comfort of the stereo video is medium or poor, but the number of low-quality images in each unit time period is less than the preset number threshold, it means that the distribution of low-quality images in the full length of the stereo video is relatively uniform, and the overall stereo comfort of the stereo video cannot be effectively improved by changing the video images in a single unit time period (i.e., re-recording the video images in the unit time period); at this time, the entire stereo video needs to be re-recorded to effectively improve the overall stereo comfort of the video. Therefore, in this case, by displaying all re-recording prompt information in the monitoring window, the shooter is prompted to re-record the entire video, so that the user can make a timely decision to re-record the video and improve work efficiency.

[0118] In this embodiment, the stereoscopic video file is divided into N unit time periods according to the duration, and the number of low-quality images in each unit time period is detected; when the number of low-quality images in a unit time period reaches a preset number threshold, a segment re-recording prompt message is displayed in the monitoring window to prompt the user to re-record the segment without re-recording the entire stereoscopic video, thereby greatly reducing the time cost, labor cost, etc. consumed by the user in the re-recording process. When the number of low-quality images in each unit time period is less than the preset number threshold, a full re-recording prompt message is displayed in the monitoring window to prompt the shooter to re-record the entire video, thereby facilitating the user to make a timely decision to re-record the video and improving work efficiency.

[0119] Step S70: If not, continue to calculate the stereoscopic comfort of the single frame of the stereoscopic video, and display the single frame comfort information in the monitoring window.

[0120] In the third embodiment of the present application, the overall stereoscopic comfort of the stereoscopic video file is calculated by an overall video stereoscopic comfort evaluation algorithm, and the overall stereoscopic comfort is displayed in the monitoring window; thereby, after the shooting is completed, the photographer can promptly know the overall stereoscopic comfort of the entire stereoscopic video file in the monitoring window, without having to import the stereoscopic video file into a stereoscopic video player of AR, VR and other devices for monitoring, thereby facilitating users to make timely decisions on whether re-recording is needed, thereby improving work efficiency.

[0121] For example, in order to help understand the implementation process of the stereoscopic video comfort prompting method obtained by combining the first embodiment, the second embodiment, and the third embodiment, please refer to Figure 2 , Figure 2 A brief flowchart of a stereoscopic video comfort prompting method is provided, specifically:

[0122] At the beginning of shooting, the parallax data of the left lens picture and the right lens picture in the video data are calculated, and the stereo comfort of the current picture (i.e., the single-frame stereo comfort) is evaluated using the single-frame stereo comfort evaluation algorithm; based on the obtained single-frame stereo comfort, the video picture and single-frame comfort information of the stereo video are displayed in the monitoring window to remind the user (shooter) of the stereo comfort of the current picture in real time. In addition, the single-frame stereo comfort is stored in the stereo video file for subsequent call.

[0123] Afterwards, determine whether the shooting is completed. If the shooting is completed, use the overall video stereo comfort evaluation algorithm to evaluate the overall stereo comfort of the stereo video file, and display the overall stereo comfort in the monitoring window to provide a prompt for the user; if the shooting is not completed, return to the previous step, continue to calculate the parallax data, and then calculate the single-frame stereo comfort of the stereo video, and display the single-frame comfort information in the monitoring window.

[0124] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the stereoscopic video comfort prompting method of the present application. More simple transformations based on this technical concept are all within the protection scope of the present application.

[0125] This application also provides a stereoscopic video comfort prompting device, please refer to Figure 3 , the stereoscopic video comfort prompting device comprises:

[0126] A shooting module 10, used for shooting a stereoscopic video using a stereoscopic video shooting device;

[0127] A calculation module 20 is used to calculate the single-frame stereoscopic comfort of each frame of the stereoscopic video according to a single-frame stereoscopic comfort evaluation algorithm during the shooting process of the stereoscopic video;

[0128] The display module 30 is used to display the video picture and single-frame picture comfort information of the stereoscopic video in the monitoring window of the stereoscopic video shooting device; wherein the single-frame picture comfort information includes the single-frame picture stereo comfort corresponding to the currently displayed video picture.

[0129] The stereoscopic video comfort prompting device provided by the present application adopts the stereoscopic video comfort prompting method in the above-mentioned embodiment, which can solve the technical problem that the user cannot perceive the stereoscopic comfort of the video in time when shooting a stereoscopic video with a stereo camera. Compared with the prior art, the beneficial effects of the stereoscopic video comfort prompting device provided by the present application are the same as the beneficial effects of the stereoscopic video comfort prompting method provided by the above-mentioned embodiment, and the other technical features of the stereoscopic video comfort prompting device are the same as the features disclosed in the above-mentioned embodiment method, which will not be repeated here.

[0130] The present application provides a stereoscopic video shooting device, which includes: at least one shooting module, at least one display module, at least one processor; and a memory connected to the at least one processor in communication; wherein the shooting module is used to shoot stereoscopic video; the display module is used to display the video picture and single-frame picture comfort information of the stereoscopic video; the single-frame picture comfort information is obtained by the stereoscopic video comfort prompting method as described above; the memory stores instructions that can be executed by at least one processor, and the instructions are executed by at least one processor so that the at least one processor can execute the stereoscopic video comfort prompting method in the above-mentioned embodiment one.

[0131] Reference below Figure 4 , which shows a schematic diagram of the structure of a stereoscopic video shooting device suitable for implementing the embodiment of the present application. The stereoscopic video shooting device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4 The stereoscopic video shooting device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0132] like Figure 4As shown, the stereoscopic video shooting device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the stereoscopic video shooting device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the stereoscopic video capture device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows a stereoscopic video capture device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0133] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0134] The stereoscopic video shooting device provided by the present application adopts the stereoscopic video comfort prompting method in the above embodiment, which can solve the technical problem that the user cannot perceive the stereoscopic comfort of the video in time when shooting a stereoscopic video with a stereo camera. Compared with the prior art, the beneficial effects of the stereoscopic video shooting device provided by the present application are the same as the beneficial effects of the stereoscopic video comfort prompting method provided by the above embodiment, and the other technical features in the stereoscopic video shooting device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0135] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0136] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0137] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the stereoscopic video comfort prompting method in the above-mentioned embodiment.

[0138] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0139] The computer-readable storage medium may be included in the stereoscopic video shooting device; or may exist independently without being assembled into the stereoscopic video shooting device.

[0140] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the stereoscopic video shooting device, the stereoscopic video shooting device: uses the stereoscopic video shooting device to shoot stereoscopic video; during the shooting process of the stereoscopic video, calculates the single-frame stereoscopic comfort of each frame of the stereoscopic video according to the single-frame stereoscopic comfort evaluation algorithm; displays the video picture and single-frame comfort information of the stereoscopic video in the monitoring window of the stereoscopic video shooting device; wherein the single-frame comfort information includes the single-frame stereoscopic comfort corresponding to the current video picture.

[0141] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0142] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0143] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0144] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned stereoscopic video comfort prompting method, and can solve the technical problem that when a stereoscopic video is shot with a stereo camera, the user cannot perceive the stereoscopic comfort of the video in time. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the stereoscopic video comfort prompting method provided by the above-mentioned embodiment, and will not be repeated here.

[0145] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned stereoscopic video comfort prompting method when executed by a processor.

[0146] The computer program product provided by the present application can solve the technical problem that when a stereoscopic video is shot with a stereo camera, the user cannot perceive the stereoscopic comfort of the video in time. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the stereoscopic video comfort prompt method provided by the above embodiment, and will not be described in detail here.

[0147] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A stereoscopic video comfort prompting method, characterized in that: The method comprises: Shooting a stereoscopic video using a stereoscopic video shooting device; During the shooting process of the stereoscopic video, the single-frame stereoscopic comfort of each frame of the stereoscopic video is calculated according to a single-frame stereoscopic comfort evaluation algorithm; The video picture and single-frame picture comfort information of the stereoscopic video are displayed in the monitoring window of the stereoscopic video shooting device; wherein the single-frame picture comfort information includes the single-frame picture stereoscopic comfort corresponding to the current video picture.

2. The method according to claim 1, characterized in that In the process of shooting the stereoscopic video, the step of calculating the single-frame stereoscopic comfort of each frame of the stereoscopic video according to the single-frame stereoscopic comfort evaluation algorithm comprises: During the shooting process of the stereoscopic video, calculating the parallax data of the left lens picture and the right lens picture at the same time in the stereoscopic video; According to a preset parallax value range, obtaining a classification result of each parallax value in the parallax data; According to the proportion of different classification results in the disparity data, the stereoscopic comfort of the single frame is determined according to a preset determination order: If the classification result shows that the proportion of extremely close images is greater than the preset threshold of extremely close image proportion, the stereoscopic comfort of the single frame is poor; otherwise, the next step is executed; If the classification result shows that the proportion of the second closest is less than the preset threshold of the second closest proportion, the stereoscopic comfort of the single frame is excellent; otherwise, the next step is executed; If the classification result shows that the proportion of medium and far images is greater than the preset threshold of the proportion of medium and far images, the stereoscopic comfort of the single frame is good; otherwise, the next step is executed; If the classification result is the other cases, the stereoscopic comfort level of the single-frame image is medium.

3. The method according to claim 2, characterized in that The method further comprises: If the stereoscopic comfort of the single-frame image is medium or poor, the camera position adjustment suggestion information and the scene layout adjustment suggestion information are also displayed on the monitoring window.

4. The method according to claim 1, characterized in that The method further comprises: The single-frame stereo comfort degree corresponding to each frame is stored in a stereo video file; Determining whether the shooting of the stereoscopic video is completed; If yes, then based on the single-frame stereoscopic comfort in the stereoscopic video file and according to the overall video stereoscopic comfort evaluation algorithm, the overall stereoscopic comfort of the stereoscopic video file is calculated, and the overall stereoscopic comfort is displayed in the monitoring window; If not, continue to calculate the stereoscopic comfort of the single frame of the stereoscopic video, and display the single frame comfort information in the monitoring window.

5. The method according to claim 4, characterized in that The step of calculating the overall stereoscopic comfort of the stereoscopic video file according to the overall video stereoscopic comfort evaluation algorithm comprises: Calculating the proportions of different single-frame stereo comfort levels in the stereo video to obtain the proportions of different categories of single-frame stereo comfort levels; According to the proportion results of the stereoscopic comfort of the single-frame images of different categories, the overall stereoscopic comfort of the stereoscopic video file is determined according to a preset determination order: If the proportion of the single-frame images with excellent stereoscopic comfort is greater than the preset excellent threshold, and the proportion of the single-frame images with poor stereoscopic comfort is less than the preset poor threshold, then the overall stereoscopic comfort of the stereoscopic video file is excellent; otherwise, execute the next step; If the proportion of single-frame images with medium stereo comfort is greater than a preset medium threshold, and the proportion of single-frame images with poor stereo comfort is greater than a preset poor threshold, then the overall stereo comfort of the stereo video file is poor; otherwise, execute the next step; If the proportion of good stereo comfort of the single-frame images is greater than the preset good threshold, and the proportion of poor stereo comfort of the single-frame images is less than the preset poor threshold, then the overall stereo comfort of the stereo video file is good; otherwise, execute the next step; If the proportion result is the other cases, the overall stereoscopic comfort of the stereoscopic video file is medium.

6. The method according to claim 4, characterized in that After the step of calculating the overall stereoscopic comfort of the stereoscopic video file, the method further includes: When the overall stereoscopic comfort is medium or poor, the stereoscopic video file is divided into N unit time periods according to the duration, and the number of low-quality pictures in each unit time period is detected; wherein the low-quality picture refers to the video picture whose single-frame stereoscopic comfort is medium or poor; If the number of the low-quality images in the k-th unit time period reaches a preset number threshold, a segment re-recording prompt message is displayed in the monitoring window; wherein the segment re-recording prompt message includes the start time and end time of the k-th unit time period; 1≤k≤N; If the number of the low-quality images in each unit time period is less than the preset number threshold, a full re-recording prompt message is displayed in the monitoring window; wherein the full re-recording prompt message is used to prompt the user to re-record the entire stereoscopic video.

7. A stereoscopic video comfort prompting device, characterized in that: The device comprises: A shooting module, used for shooting a stereoscopic video using a stereoscopic video shooting device; A calculation module, used for calculating the single-frame stereoscopic comfort of each frame of the stereoscopic video according to a single-frame stereoscopic comfort evaluation algorithm during the shooting process of the stereoscopic video; A display module is used to display the video picture and single-frame picture comfort information of the stereoscopic video in the monitoring window of the stereoscopic video shooting device; wherein the single-frame picture comfort information includes the single-frame picture stereoscopic comfort corresponding to the currently displayed video picture.

8. A stereoscopic video shooting device, characterized in that: The device comprises: a shooting module, a display module, a memory, a processor, and a computer program stored in the memory and executable on the processor; The shooting module is used to shoot stereoscopic video; The display module is used to display the video picture and single-frame picture comfort information of the stereoscopic video; wherein the single-frame picture comfort information is obtained by the stereoscopic video comfort prompting method according to any one of claims 1 to 6; The computer program is configured to implement the steps of the stereoscopic video comfort prompting method according to any one of claims 1 to 6.

9. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the stereoscopic video comfort prompting method according to any one of claims 1 to 6 are implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the stereoscopic video comfort prompting method according to any one of claims 1 to 6 are implemented.

Images