Stereoscopic display method and stereoscopic display device for live performance, medium and system

Abstract

Stereoscopic display method for a live performance, comprising: obtaining binocular video streams from at least two recording areas by performing a binocular video recording of the at least two recording areas of an area to be recorded; storing the binocular video streams of the at least two recording areas, and determining the viewing position according to a detected gaze direction of a user in front of the 3D display device (740); determining a target recording area corresponding to the viewing position, and displaying the binocular video streams obtained on the basis of the target recording area in the three-dimensional autostereoscopic 3D display device (740);In response to a detection that a user's viewing position has moved from one recording area to another, the autostereoscopic 3D display device (740) is controlled to display a binocular video stream obtained based on the switched recording area.

Description

Stereoscopic display method, device, medium and system for live performances

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on June 17, 2021, with application number 202110670702.0. The entire contents of the above application are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of machine vision technology, for example, to a stereoscopic display method, device, medium and system for live performances. Background Art

[0003] Live stereoscopic display is intended to provide an immersive experience, where the displayed scene changes as the user's head position changes.

[0004] Related art head-mounted displays (HMDs) support this immersive viewing experience. With these devices, when the user looks forward, the display presents the scene captured in front of the camera. When the user turns completely around, the display presents the scene captured behind the camera. However, this approach has the drawback of requiring the user to wear a HMD, which can be inconvenient for users who already wear glasses due to myopia.

[0005] Summary of the Invention

[0006] Embodiments of the present application provide a method, device, medium, and system for stereoscopic display of a live performance.

[0007] In a first aspect, an embodiment of the present application provides a method for stereoscopic display of a live performance, the method comprising:

[0008] Performing binocular video capture on at least two shooting intervals of the shooting area to obtain binocular video streams of the at least two shooting intervals;

[0009] storing the binocular video streams of the at least two shooting intervals, and determining the viewing position based on the eye tracking result;

[0010] determining a target shooting interval corresponding to the viewing position, and displaying a binocular video stream obtained based on the target shooting interval on a naked-eye 3D (3-dimensional) display device;

[0011] In response to detecting a shooting interval switching event of the viewing position, the naked-eye 3D display device is controlled to display a binocular video stream obtained based on the switched shooting interval.

[0012] In a second aspect, an embodiment of the present application provides a stereoscopic display device for live performances, the device comprising:

[0013] a video stream obtaining module configured to obtain binocular video streams of at least two shooting intervals by performing binocular video shooting on at least two shooting intervals of a shooting area;

[0014] a position determination module configured to store the binocular video streams of the at least two shooting intervals and determine the viewing position based on the eye tracking result;

[0015] a video display module configured to determine a target shooting interval corresponding to the viewing position, and display a binocular video stream obtained based on the target shooting interval on a naked-eye 3D display device;

[0016] The video switching module is configured to control the naked-eye 3D display device to display a binocular video stream obtained based on the switched shooting interval in response to detecting a shooting interval switching event of the viewing position.

[0017] In a third aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the stereoscopic display method for a live performance as described in the embodiment of the present application is implemented.

[0018] In a fourth aspect, this embodiment provides a stereoscopic display system for live performances, comprising at least two shooting devices, a processing device, a storage device, and a naked-eye 3D display device; the at least two shooting devices, the storage device, and the naked-eye 3D display device are respectively connected to the processing device, wherein:

[0019] The at least two shooting devices are configured to shoot binocular video of the live performance in at least two shooting intervals;

[0020] The storage device is configured to store the binocular video streams of the at least two shooting intervals;

[0021] The naked-eye 3D display device is configured to determine a viewing position based on a human eye tracking result;

[0022] The processing device is configured to determine a target shooting interval corresponding to the viewing position, and control the naked-eye 3D display device to display a binocular video stream obtained based on the target shooting interval;

[0023] The processing device is further configured to control the naked-eye 3D display device to display a binocular video stream obtained based on the switched shooting interval in response to detecting a shooting interval switching event of the viewing position. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] FIG1 is a flow chart of a method for stereoscopic display of a live performance provided in Example 1 of the present application;

[0025] FIG2 is a schematic diagram of a shooting scene provided in Example 1 of the present application;

[0026] FIG3 is a schematic diagram of another shooting scene provided in Example 1 of the present application;

[0027] FIG4 is a schematic diagram of video acquisition and playback provided in Example 1 of the present application;

[0028] FIG5 is a flow chart of a stereoscopic display method for a live performance provided in Example 2 of the present application;

[0029] FIG6 is a schematic structural diagram of a stereoscopic display device for live performances provided in Example 3 of the present application;

[0030] FIG7 is a structural block diagram of a stereoscopic display system for live performances provided in Example 5 of the present application. DETAILED DESCRIPTION

[0031] The present application will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are intended only to illustrate the present application and are not intended to limit the present application. It should also be noted that, for ease of description, the accompanying drawings only illustrate portions of the present application, not all of the structures.

[0032] Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe the steps as sequential processes, many of the steps can be implemented in parallel, concurrently, or simultaneously. In addition, the order of the steps can be rearranged. The process can be terminated when its operation is completed, but can also have additional steps not included in the accompanying drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0033] Example 1

[0034] Figure 1 is a flowchart of the stereoscopic display method for live performances provided in Example 1 of the present application. This embodiment can satisfy the user's need to watch the stereoscopic stage from various horizontal angles in front of the screen. The method can be executed by the stereoscopic display device for live performances provided in the embodiment of the present application. The device can be implemented by software and / or hardware and can be integrated into the system.

[0035] As shown in FIG1 , the stereoscopic display method of the live performance includes:

[0036] S110 , performing binocular video shooting on at least two shooting intervals of the shooting area to obtain binocular video streams of the at least two shooting intervals.

[0037] Wherein, the shooting interval can connect the center of the stage and one of the at least one shooting devices, and the area scanned by the angle range (-α, β) is a shooting interval, where α is the angle of the line connecting the center of the stage and one of the shooting devices offset to the left, and β is the angle of the line offset to the right. For example, Figure 2 is a schematic diagram of a shooting scene. As shown in Figure 2, the area covered by the angle range (-α, β) connecting the center of the stage and the shooting device A is the shooting interval of the shooting device A, that is, the range between the two solid lines in Figure 2. Wherein, α and β can be the same or different, and this embodiment does not limit this.

[0038] In this embodiment, it is understood that binocular video is a video that simulates the left and right eyes of a person capturing an image of an object. Binocular video can be captured by a binocular camera or a monocular camera. If a monocular camera is used, any two adjacent monocular cameras are considered a group. The setup method is similar to that of a binocular camera. This embodiment does not restrict the choice of camera type.

[0039] For the implementation method using a monocular camera, it is necessary to ensure that the line connecting the two adjacent cameras that need to be used as binocular cameras is perpendicular to the direction from the center of the stage to the midpoint of the line. If this condition is met, a binocular camera can be assembled. In addition, if the distance between the two adjacent monocular cameras can be close to the distance of the human eye, or the angle formed by the two monocular cameras and the center of the stage is close to the angle formed by the human eye when viewing the screen, a better display effect can be obtained. In this solution, if the monocular cameras are set close enough, it is not limited to binding the two adjacent monocular cameras to obtain a binocular video stream, but also possible to jump to form a binocular video stream acquisition device, for example, the first monocular camera and the third monocular camera form a group of binocular cameras, so as to generate the corresponding video stream and display it during subsequent use. Among them, how to select adjacent or jumping monocular cameras can be based on manual selection by staff, or it can be autonomously allocated by obtaining the distance between several monocular cameras or the angle formed with the center of the stage.

[0040] The binocular video stream may be continuous video data captured by a binocular camera or a group of monocular cameras and transmitted and played in chronological order on the network.

[0041] For example, Figure 3 is a schematic diagram of another shooting scene. As shown in Figures 2 and 3, a series of binocular cameras are arranged in a line or in a slightly arc-shaped arrangement at an appropriate distance in front of the stage. The dual lens planes of the binocular cameras are perpendicular to the center point of the stage, and the field of view (FOV) of the outermost camera can be ensured to exceed the edge of the stage on its side, simulating the scene of the audience watching the performance from different angles in the same row in the theater. Monocular cameras can also be used for the same shooting, but the installation height of each camera must be consistent. It is understandable that both binocular and monocular cameras can use the same model to facilitate subsequent calibration and correction.

[0042] S120: Store the binocular video streams of the at least two shooting intervals, and determine the viewing position according to the eye tracking result.

[0043] Among them, the eye tracking result can be that the eye tracking device obtains the coordinate information of the viewer's eyes and performs a coordinate system conversion. For example, the eye tracking device can be placed at the center of the upper edge of the screen, and a spatial rectangular coordinate system A is established with the eye tracking device as the origin. The eye tracking device detects that the rectangular coordinates of the left and right eyes of the person are (x1, y1, z1) and (x2, y2, z2) respectively, then the rectangular coordinates of the center of the left and right eyes are (x3, y3, z3). Another rectangular coordinate system B is established with the center of the stage as the origin. The position coordinates of the audience in front of the stage are (X1, Y1, Z1), then X1 = C1x1, Y1 = C2y1, Z1 = C3z1, where C1, C2, C3 are constants. The corresponding conversion relationship between the two coordinate systems A and B can be obtained. Among them, the eye tracking device can be externally connected to the video playback device or installed in the video playback device, and this embodiment does not limit this.

[0044] In this embodiment, the video captured by the camera is processed and stored in a storage device or transmitted via computer or communication technology to a backend device, such as a computer or mobile phone used by the user. After receiving the transmitted signal, the backend device decompresses and restores at least one video stream and stores these streams in a local storage device for selection by the backend host for playback or later playback.

[0045] S130 , determining a target shooting interval corresponding to the viewing position, and displaying a binocular video stream obtained based on the target shooting interval on a naked-eye 3D display device.

[0046] The target shooting interval corresponding to the viewing position can be determined by determining the angle formed by the viewing position and the naked-eye 3D display device, and then determining which shooting interval the angle falls within. It is understood that the binocular video stream corresponding to the target shooting interval is the video stream that the user needs to see at the current viewing position, so the binocular video stream corresponding to the target shooting interval can be displayed for the user to watch.

[0047] For example, FIG4 is a schematic diagram of video acquisition and playback. As shown in FIG4 , the eye tracking device converts the coordinates based on the detected coordinate information of the human eye to determine the viewing position and sends the viewing position information to the back-end host system. The back-end host system matches the viewing position information with at least one shooting interval, determines which shooting interval the viewer's viewing position is in, and uses the matched shooting interval as the target shooting interval. The binocular video corresponding to the target shooting interval is then retrieved from the storage device in the back-end host system and the naked-eye 3D display device is controlled to play the binocular video for the viewer to watch. Among them, the naked-eye 3D display device can be a display device that utilizes the parallax characteristic of the human eyes to obtain realistic stereoscopic images with space and depth without the need for any auxiliary equipment (such as 3D glasses, helmets, etc.).

[0048] S140 , in response to detecting a shooting interval switching event of the viewing position, controlling the naked-eye 3D display device to display a binocular video stream obtained based on the switched shooting interval.

[0049] The shooting interval switching event of the viewing position may be the viewer's viewing position moving from one shooting interval to another. For example, when the viewer's viewing position changes, the eye tracking device detects the change and sends the new eye coordinate information to the backend host system. The backend host system analyzes and determines that the viewer's viewing position has moved from one shooting area to another, then retrieves the binocular video stream corresponding to the new shooting area from the storage device and controls the naked-eye 3D display device to display the binocular video.

[0050] The technical solution provided by the embodiment of the present application is to obtain binocular video streams of at least two shooting intervals of the shooting area by performing binocular video shooting; storing the binocular video streams of the at least two shooting intervals and determining the viewing position based on the human eye tracking results; determining the target shooting interval corresponding to the viewing position, and displaying the binocular video stream obtained based on the target shooting interval on the naked-eye 3D display device; in response to detecting a shooting interval switching event of the viewing position, controlling the naked-eye 3D display device to display the binocular video stream obtained based on the switched shooting interval. This embodiment completes the stereoscopic playback of the stage from different angles through the above means, achieving the beneficial effect of allowing the audience to watch realistic live performance videos in real time through the naked-eye 3D display, and users can choose to watch the live performance from different angles according to their preferences.

[0051] This solution achieves the beneficial effects of simplifying the device for viewing stereoscopic videos and improving user viewing comfort through the above means.

[0052] In one example, the stereoscopic display method for a live performance described in the embodiments of the present application is executed by a stereoscopic display system for a live performance.

[0053] Example 2

[0054] FIG5 is a flow chart of the stereoscopic display method for a live performance in the second embodiment of the present application, and this embodiment is optimized based on the above embodiment. Specifically, the optimization is as follows: after determining the target shooting interval corresponding to the viewing position and displaying the binocular video stream obtained based on the target shooting interval in the naked-eye 3D display device, the method further includes: determining the adjacent shooting interval of the target shooting interval corresponding to the viewing position; in the process of displaying the binocular video stream obtained based on the target shooting interval, synchronously preloading the binocular video stream obtained based on the adjacent shooting interval; in response to detecting a shooting interval switching event of the viewing position, controlling the naked-eye 3D display device to display the binocular video stream obtained based on the switched shooting interval, including: determining the target adjacent shooting interval in response to detecting a shooting interval switching event of the viewing position; and synchronously switching the preloaded binocular video stream obtained based on the target adjacent shooting interval through the naked-eye 3D display device. Through such processing, it is possible to achieve smooth switching of the binocular video stream when the viewer moves.

[0055] As shown in FIG5 , the method of this embodiment includes the following steps:

[0056] S510 , performing binocular video shooting on at least two shooting intervals in the shooting area to obtain binocular video streams of the at least two shooting intervals.

[0057] In this embodiment, in one example, before performing binocular video shooting on at least two shooting intervals of the shooting area, the method further includes obtaining calibration parameters of the at least two shooting devices. Accordingly, after obtaining the binocular video streams of the at least two shooting intervals, the method further includes performing calibration parameter compensation processing on the binocular video streams shot by the at least two shooting devices based on the calibration parameters.

[0058] The calibration parameters may be parameters that need to be calibrated in the camera. For example, the calibration parameters may be vertical parallax in the camera. This vertical parallax may be caused by a slight difference in the height of the two cameras of the camera during the current capture interval, resulting in vertical parallax between the two cameras of the camera. The calibration parameter compensation process may be to calibrate the calibration parameters to eliminate the error.

[0059] Exemplarily, vertical calibration is performed on the left and right images in the binocular video streams captured by the at least two cameras based on the magnitude of the vertical parallax. The vertical calibration involves vertically shifting the left and right images based on the vertical parallax to eliminate the vertical parallax between the left and right images. This embodiment, by obtaining calibration parameters of the cameras and performing compensation processing on the calibration parameters, can address distortion in images captured by the cameras, thereby producing higher-quality images.

[0060] In this embodiment, in one example, before obtaining the binocular video streams of at least two shooting intervals, the method also includes obtaining shooting parameters of the at least two shooting devices. Accordingly, after obtaining the binocular video streams of at least two shooting intervals, the method also includes performing shooting parameter consistency processing on the binocular video streams captured by the at least two shooting devices based on the shooting parameters.

[0061] The shooting parameters of the shooting device may include, for example, focal length, depth of field, and exposure.

[0062] This embodiment improves the audience's viewing experience of the video by adjusting the shooting parameters of the binocular videos obtained in different shooting areas to be consistent.

[0063] S520: Store the binocular video streams of the at least two shooting intervals, and determine the viewing position according to the eye tracking result.

[0064] S530: Determine a target shooting interval corresponding to the viewing position, and display a binocular video stream obtained based on the target shooting interval on a naked-eye 3D display device.

[0065] S540: Determine a shooting interval adjacent to the target shooting interval corresponding to the viewing position.

[0066] The adjacent shooting intervals of the target shooting interval may be 1, 2, ..., N shooting intervals to the left and right of the target shooting interval, respectively. This embodiment does not limit the number of adjacent shooting intervals. In this embodiment, for example, the method for determining the adjacent shooting intervals of the target shooting interval corresponding to the viewing position may be to compare the straight-line distance between other shooting intervals and the target shooting interval to determine whether the shooting interval is an adjacent shooting interval of the target shooting interval. The number of adjacent shooting intervals may be fixed or dynamically adjusted according to different scenarios.

[0067] S550 : During the display process of the binocular video stream obtained based on the target shooting interval, synchronously pre-load the binocular video stream obtained based on the adjacent shooting interval.

[0068] The synchronous preloading may include downloading the binocular video stream corresponding to the adjacent shooting interval at the same time as the binocular video stream corresponding to the target shooting interval is displayed.

[0069] S560 : In response to detecting a shooting interval switching event of the viewing position, determining a target adjacent shooting interval.

[0070] The target adjacent shooting interval may be at least one adjacent shooting interval of the target shooting interval corresponding to the new viewing position after switching.

[0071] It is understandable that when the viewing position of the viewer changes, the backend host system needs to determine a new target shooting interval according to the new viewing position, and then determine a target adjacent shooting interval of the new target shooting interval.

[0072] S570 , synchronously switching the preloaded binocular video stream obtained based on the target adjacent shooting interval through the naked-eye 3D display device.

[0073] For example, when the display device plays the binocular video corresponding to shooting interval A, the back-end host system downloads the binocular video streams corresponding to A's adjacent shooting intervals B and C. When the viewer's viewing position moves to B, the back-end host system controls the display device to switch the video to the binocular video corresponding to shooting interval B at the same time, and at the same time loads the binocular video streams corresponding to the target adjacent shooting intervals E and F of shooting interval B.

[0074] In this embodiment, the preloaded binocular video stream obtained based on the target adjacent shooting interval is synchronously switched by the naked-eye 3D display device, including: obtaining the frame blanking period of the naked-eye 3D display device; in response to the detection of the shooting interval switching event of the viewing position, switching from the current binocular video stream to the binocular video stream obtained based on the target adjacent shooting interval during the frame blanking period. Among them, when a frame is played, the display is bright for a period of time, corresponding to the positive display period; another short period of time is completely black, corresponding to the blanking period, which is extremely short in duration and cannot be observed by the human eye. If the video is switched when the frame is bright, the picture will flicker. In this embodiment, the back-end host system chooses to switch the video during the frame blanking period, that is, in the dark state, so that the audience cannot perceive the video switch, thereby improving the audience's viewing experience of the video.

[0075] The technical solution provided by the embodiment of the present application determines the adjacent shooting intervals of the target shooting interval corresponding to the viewing position; during the display process of the binocular video stream obtained based on the target shooting interval, synchronously loads the binocular video stream obtained based on the adjacent shooting interval; accordingly, in response to detecting the shooting interval switching event of the viewing position, controls the naked-eye 3D display device to display the binocular video stream obtained based on the switched shooting interval, including: in response to detecting the shooting interval switching event of the viewing position, determining the target adjacent shooting interval; and synchronously switching the pre-loaded binocular video stream obtained based on the target adjacent shooting interval through the naked-eye 3D display device. This embodiment achieves the synchronous switching of the video through the above means, avoiding the freeze and delay during the video stream switching process, allowing the audience to smoothly view the stereoscopic area to be captured from different angles. In one example, due to the limited viewing angle of the screen, even if the user moves left or right to the maximum angle, the angle of the content switching may not cover the full angle captured by the camera array. For example, the camera array captures 360 degrees, but through the cooperation of human eye tracking and the screen, the video captured may be switched within a range of at most 120 degrees. The technical solution of this embodiment can switch the reference video angle corresponding to the direction facing the screen through manual control. For example, under normal circumstances, the picture that the user watches facing the screen is taken by the shooting equipment facing the center of the stage at the shooting scene. If the user wants to see the picture in a larger range, the picture taken by the shooting equipment offset by a certain angle from the center of the stage can be used as the picture that the user can see facing the screen, and then the user can move left and right to watch the picture at a nearby angle.

[0076] Example 3

[0077] FIG6 is a block diagram of a stereoscopic display device for live performances provided in Example 3 of the present application. This device can execute the stereoscopic display method for live performances provided in any of the embodiments of the present application and has the corresponding functional modules and beneficial effects. As shown in FIG6 , the device may include:

[0078] The video stream obtaining module 610 is configured to obtain binocular video streams of at least two shooting intervals by performing binocular video shooting on at least two shooting intervals of the shooting area;

[0079] a position determination module 620 configured to store the binocular video streams of the at least two shooting intervals and determine the viewing position based on the eye tracking result;

[0080] The video display module 630 is configured to determine a target shooting interval corresponding to the viewing position, and display a binocular video stream obtained based on the target shooting interval on a naked-eye 3D display device;

[0081] The video switching module 640 is configured to control the naked-eye 3D display device to display a binocular video stream obtained based on the switched shooting interval in response to detecting a shooting interval switching event of the viewing position.

[0082] In one embodiment, the apparatus further comprises:

[0083] a neighboring interval determining module configured to determine a neighboring shooting interval of the target shooting interval corresponding to the viewing position;

[0084] a video loading module configured to synchronously preload the binocular video stream obtained based on the adjacent shooting interval during the display process of the binocular video stream obtained based on the target shooting interval;

[0085] Accordingly, the video switching module 640 includes:

[0086] a target adjacent interval determining unit configured to determine a target adjacent shooting interval in response to detecting a shooting interval switching event of the viewing position;

[0087] The video switching unit is configured to synchronously switch the preloaded binocular video stream obtained based on the target adjacent shooting interval through the naked-eye 3D display device.

[0088] In one embodiment, the video switching unit is further configured to: obtain a frame blanking period of the naked-eye 3D display device; and in response to detecting a shooting interval switching event of the viewing position, switch from the current binocular video stream to a binocular video stream obtained based on the target adjacent shooting interval during the frame blanking period.

[0089] In one embodiment, the apparatus further comprises:

[0090] A parameter acquisition module, configured to acquire calibration parameters of the at least two shooting devices;

[0091] Accordingly, after obtaining the binocular video streams of at least two shooting intervals, the apparatus further includes:

[0092] The parameter compensation module is configured to perform calibration parameter compensation processing on the binocular video streams captured by the at least two shooting devices based on the calibration parameters.

[0093] In one embodiment, the apparatus further comprises:

[0094] A shooting parameter acquisition module, configured to acquire shooting parameters of the at least two shooting devices;

[0095] The parameter processing module is configured to perform shooting parameter consistency processing on the binocular video streams captured by the at least two shooting devices based on the shooting parameters.

[0096] The above-mentioned product can execute the stereoscopic display method for live performances provided in the embodiment of the present application, and has the corresponding functional modules and beneficial effects of the execution method.

[0097] Example 4

[0098] A fourth embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, the stereoscopic display method for a live performance provided in all embodiments of the present application is implemented:

[0099] Performing binocular video capture on at least two shooting intervals of the shooting area to obtain binocular video streams of the at least two shooting intervals;

[0100] storing the binocular video streams of the at least two shooting intervals, and determining the viewing position based on the eye tracking result;

[0101] Determining a target shooting interval corresponding to the viewing position, and displaying a binocular video stream obtained based on the target shooting interval on a naked-eye 3D display device;

[0102] In response to detecting a shooting interval switching event of the viewing position, the naked-eye 3D display device is controlled to display a binocular video stream obtained based on the switched shooting interval.

[0103] Any combination of one or more computer-readable media can be used. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device, or device.

[0104] A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0105] The program code embodied on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wire, optical cable, RF (Radio Frequency), etc., or any suitable combination thereof.

[0106] The computer program code for performing the operations of the present application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0107] Example 5

[0108] Figure 7 is a block diagram of a stereoscopic display system for live performances provided in Example 5 of the present application. The system can execute the stereoscopic display method for live performances provided in any embodiment of the present application and has the corresponding functional modules and beneficial effects of the execution method. As shown in Figure 7, the system may include:

[0109] At least two shooting devices 710, a processing device 720, a storage device 730, and a naked-eye 3D display device 740; the at least two shooting devices 710, the storage device 730, and the naked-eye 3D display device 740 are all connected to the processing device 720, wherein:

[0110] The at least two shooting devices 710 are configured to shoot binocular video of the live performance in at least two shooting intervals;

[0111] The storage device 730 is configured to store the binocular video streams of the at least two shooting intervals;

[0112] The naked-eye 3D display device 740 is configured to determine a viewing position based on a human eye tracking result;

[0113] The processing device 720 is configured to determine a target shooting interval corresponding to the viewing position, and control the naked-eye 3D display device to display a binocular video stream obtained based on the target shooting interval;

[0114] The processing device 720 is further configured to control the naked-eye 3D display device to display a binocular video stream obtained based on the switched shooting interval in response to detecting a shooting interval switching event of the viewing position.

[0115] The above system can execute the stereoscopic display method for live performances provided in the embodiment of the present application, and has the corresponding functional modules and beneficial effects of the execution method.

[0116] The embodiments of the present application provide a stereoscopic display method, device, medium, and system for live performances, which can enable users to watch stereoscopic videos from any angle without wearing a head-mounted display, thereby improving the user's viewing comfort.

[0117] Note that the above are only some embodiments of the present application. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application has been described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A method for stereoscopic display of a live performance, comprising: Performing binocular video capture on at least two shooting intervals of the shooting area to obtain binocular video streams of the at least two shooting intervals; storing the binocular video streams of the at least two shooting intervals, and determining the viewing position based on the eye tracking result; Determining a target shooting interval corresponding to the viewing position, and displaying a binocular video stream obtained based on the target shooting interval on a naked-eye 3D display device; In response to detecting a shooting interval switching event of the viewing position, the naked-eye 3D display device is controlled to display a binocular video stream obtained based on the switched shooting interval.

2. The method according to claim 1, further comprising: after determining a target shooting interval corresponding to the viewing position and displaying a binocular video stream obtained based on the target shooting interval on a naked-eye 3D display device; determining a shooting interval adjacent to the target shooting interval corresponding to the viewing position; During the display process of the binocular video stream obtained based on the target shooting interval, synchronously preloading the binocular video stream obtained based on the adjacent shooting interval; In response to detecting a shooting interval switching event of the viewing position, controlling the naked-eye 3D display device to display a binocular video stream obtained based on the switched shooting interval, comprising: In response to detecting a shooting interval switching event of the viewing position, determining a target adjacent shooting interval; The preloaded binocular video stream obtained based on the target adjacent shooting interval is synchronously switched through the naked-eye 3D display device.

3. The method according to claim 2, wherein: Synchronously switching, through the naked-eye 3D display device, a preloaded binocular video stream obtained based on the target adjacent shooting interval, including: Obtaining a frame blanking period of the naked-eye 3D display device; In response to detecting a shooting interval switching event of the viewing position, the current binocular video stream is switched to a binocular video stream obtained based on a shooting interval adjacent to the target during the frame blanking period.

4. The method according to claim 1, further comprising: before performing binocular video capture on at least two capture intervals of the capture area; Obtain calibration parameters of at least two cameras; After binocular video shooting is performed on at least two shooting intervals of the shooting area to obtain binocular video streams of at least two shooting intervals, the method further includes: Based on the calibration parameters, calibration parameter compensation processing is performed on the binocular video streams captured by the at least two shooting devices.

5. The method according to claim 4, wherein In response to the calibration parameters including the vertical parallax between the at least two shooting devices, performing calibration parameter compensation processing on the binocular video streams captured by the at least two shooting devices based on the calibration parameters, including: Based on the size of the vertical parallax, vertical calibration is performed on the left image and the right image in the binocular video stream captured by the at least two shooting devices; wherein the vertical calibration is to vertically move the left image and the right image based on the vertical parallax so that the vertical parallax of the left image and the right image is eliminated.

6. The method according to claim 1, before performing binocular video capture on at least two shooting intervals of the shooting area to obtain binocular video streams of at least two shooting intervals, the method further comprises: Obtaining shooting parameters of at least two shooting devices; After binocular video shooting is performed on at least two shooting intervals of the shooting area to obtain binocular video streams of at least two shooting intervals, the method further includes: Based on the shooting parameters, shooting parameter consistency processing is performed on the binocular video streams captured by the at least two shooting devices.

7. A stereoscopic display device for live performances, comprising: a video stream obtaining module configured to obtain binocular video streams of at least two shooting intervals by performing binocular video shooting on at least two shooting intervals of a shooting area; a position determination module configured to store the binocular video streams of the at least two shooting intervals and determine the viewing position based on the eye tracking result; a video display module configured to determine a target shooting interval corresponding to the viewing position, and display a binocular video stream obtained based on the target shooting interval on a naked-eye 3D display device; The video switching module is configured to control the naked-eye 3D display device to display a binocular video stream obtained based on the switched shooting interval in response to detecting a shooting interval switching event of the viewing position.

8. The apparatus according to claim 7, further comprising: a neighboring interval determining module configured to determine a neighboring shooting interval of the target shooting interval corresponding to the viewing position; a video loading module configured to synchronously preload the binocular video stream obtained based on the adjacent shooting interval during the display process of the binocular video stream obtained based on the target shooting interval; The video switching module includes: a target adjacent interval determining unit configured to determine a target adjacent shooting interval in response to detecting a shooting interval switching event of the viewing position; The video switching unit is configured to synchronously switch the preloaded binocular video stream obtained based on the target adjacent shooting interval through the naked-eye 3D display device.

9. A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the stereoscopic display method for a live performance according to any one of claims 1 to 6.

10. A stereoscopic display system for live performances, comprising at least two shooting devices, a processing device, a storage device, and a naked-eye 3D display device; the at least two shooting devices, the storage device, and the naked-eye 3D display device are respectively connected to the processing device, wherein: The at least two shooting devices are configured to shoot binocular video of the live performance in at least two shooting intervals; The storage device is configured to store the binocular video streams of the at least two shooting intervals; The naked-eye 3D display device is configured to determine a viewing position based on a human eye tracking result; The processing device is configured to determine a target shooting interval corresponding to the viewing position, and control the naked-eye 3D display device to display a binocular video stream obtained based on the target shooting interval; The processing device is further configured to control the naked-eye 3D display device to display a binocular video stream obtained based on the switched shooting interval in response to detecting a shooting interval switching event of the viewing position.