Video presentation method, electronic device, computer storage medium and program product

By receiving and processing composite videos from the central device via client devices, and dynamically selecting and stitching video frames from multiple shooting devices, the problem of poor user experience in multi-device collaborative shooting systems is solved, enabling flexible and diverse video presentation and resource utilization.

CN115484486BActive Publication Date: 2026-03-20HUAWEI TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-07-23
Publication Date
2026-03-20

AI Technical Summary

Technical Problem

Existing multi-device collaborative shooting systems present images in a single way, resulting in a poor user experience and failing to fully utilize the video resources of multiple shooting devices.

Method used

The client device receives composite video from the central device and determines the video to be presented based on the composite video. Through user input commands or panoramic viewing operations, it dynamically selects and stitches video frames from multiple shooting devices to generate a panoramic image sequence.

Benefits of technology

It enhances the user experience, enables flexible and diverse video presentation methods, makes full use of video resources from multiple shooting devices, and ensures the continuity and coherence of the presentation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115484486B_ABST
    Figure CN115484486B_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure provide a video presentation method, an electronic device, a computer storage medium and a program product. The method comprises: receiving, by a client device, a composite video from a center device, an i-th frame of the composite video being obtained based on i-th frames of videos respectively captured by a plurality of shooting devices in a distributed shooting system at the same time, i being any positive integer; determining, by the client device, a to-be-presented video based on the composite video, the to-be-presented video being associated with at least one shooting device of the plurality of shooting devices; and presenting, by the client device, the to-be-presented video. In this way, the client device can determine the to-be-presented video for presentation based on the composite video from the center device, so that the presentation at the client device is more flexible and diverse, thereby improving the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to the field of multimedia processing, and more particularly, to a video presentation method, an electronic device, a computer storage medium and a program product. BACKGROUND

[0002] There are more and more application scenarios of collaborative interconnection between multiple different devices. For example, in a scenario of collaborative shooting of multiple shooting devices, multi-path same-screen display and multi-path image real-time splicing can be implemented, thereby bringing users a different scene experience from a single device. Such a scenario of multiple shooting devices forming a shooting array can also be referred to as a distributed shooting system.

[0003] The images shot by the distributed shooting system can be presented on a client, but the current presentation method is relatively single, resulting in poor user experience. SUMMARY

[0004] Embodiments of the present disclosure provide a scheme for presenting a to-be-presented video on a client device based on a composite video from a center device.

[0005] In a first aspect, a video presentation method is provided. The method includes: receiving, by a client device, a composite video from a center device, an i-th frame of the composite video being obtained based on i-th frames of videos respectively shot by multiple shooting devices in a distributed shooting system at the same time, i being any positive integer; determining, by the client device, a to-be-presented video based on the composite video, the to-be-presented video being associated with at least one of the multiple shooting devices; and presenting, by the client device, the to-be-presented video.

[0006] In this way, the client device can determine the to-be-presented video for presentation based on the composite video from the center device, so that the to-be-presented video is no longer passively received, but determined by the client device, making the presentation at the client device more flexible and diverse, thereby improving user experience.

[0007] In some embodiments of the first aspect, before the client device receives the composite video from the center device, the method further includes: establishing, by the center device, a connection with each of the multiple shooting devices. In some embodiments, the center device establishes a wireless connection with each of the multiple shooting devices, and the center device and the multiple shooting devices are in the same local area network environment.

[0008] In some embodiments of the first aspect, the client device determines the video to be presented based on the composite video by determining each frame of the video to be presented through the following process: the client device determines from the i-th frame of the composite video the i-th frame of a video captured by a target shooting device, the target shooting device being a shooting device located at a target location among a plurality of shooting devices; and the client device determines the i-th frame of the video captured by the target shooting device as the i-th frame of the video to be presented.

[0009] In this way, the client device can determine and display the video captured by the target shooting device based on the composite video, which simplifies the user operation.

[0010] In some embodiments of the first aspect, the client device determines the video to be presented based on the composite video, including: the client device receiving a user input instruction, the user input instruction indicating a target shooting device; the client device determining each frame of the video to be presented through the following process: determining the i-th frame of the video captured by the target shooting device from the i-th frame of the composite video; and determining the i-th frame of the video captured by the target shooting device as the i-th frame of the video to be presented.

[0011] In this way, the client device can determine and present the video captured by the target shooting device corresponding to the user's input command based on the composite video. This allows users to view videos of interest as needed, making the presentation at the shooting device more diverse and improving the user experience.

[0012] In some embodiments of the first aspect, the method further includes: a client device receiving a user's surround view operation on the current frame of a video to be presented; and in response to the surround view operation, the client device presenting a sequence of surround view images corresponding to the current frame of the video to be presented.

[0013] In this way, the client device can present a sequence of surround view images based on the user's surround view operation, allowing the user to view the surround view effect more intuitively. This diversified presentation method can improve the user experience.

[0014] In some embodiments of the first aspect, the client device presenting the surround view image sequence includes: in response to the surround view operation, the client device determining a frame from the composite video corresponding to the current frame of the video to be presented; the client device splitting the determined frame of the composite video corresponding to the current frame of the video to be presented into multiple images corresponding to multiple shooting devices respectively; obtaining the surround view image sequence based on the multiple images; and the client device presenting the surround view image sequence.

[0015] In this way, by obtaining a panoramic image sequence from multiple images captured by multiple shooting devices, the various shooting devices in the distributed shooting system can be fully utilized, maximizing resource utilization.

[0016] In some embodiments of the first aspect, the number of the plurality of images is equal to the number of the plurality of shooting devices.

[0017] In some embodiments of the first aspect, the obtaining, by the client device, the surround view image sequence based on the plurality of images comprises: arranging, by the client device, the plurality of images in a position order of the plurality of shooting devices to obtain the surround view image sequence.

[0018] In this way, the surround view image sequence is obtained in the position order of the plurality of shooting devices, which can ensure the presentation effect of the surround view image sequence and avoid errors.

[0019] In some embodiments of the first aspect, the obtaining, by the client device, the surround view image sequence based on the plurality of images comprises: arranging, by the client device, the plurality of images in a position order of the plurality of shooting devices; and inserting, by the client device, an intermediate frame between each two adjacent images of the plurality of images through an interpolation operation to obtain the surround view image sequence.

[0020] In this way, the continuity of the surround view can be ensured by inserting the intermediate frame between the adjacent images, which can avoid image jumping and ensure the coherence of the viewing effect of the user and improve the user experience.

[0021] In some embodiments of the first aspect, the i-th frame of the composite video is obtained by splicing the i-th frames of the videos respectively shot by the plurality of shooting devices at the same time.

[0022] The second aspect provides a video presentation method. The method comprises: receiving, by a center device, videos respectively shot by a plurality of shooting devices in a distributed shooting system; obtaining, by the center device, a composite video based on the videos respectively shot by the plurality of shooting devices, wherein an i-th frame of the composite video is obtained based on i-th frames of the videos respectively shot by the plurality of shooting devices at the same time, i being any positive integer; and sending, by the center device, the composite video to a client device.

[0023] In some embodiments of the second aspect, the obtaining, by the center device, the composite video comprises determining each frame of the composite video through the following process: splicing, by the center device, the i-th frames of the videos respectively shot by the plurality of shooting devices at the same time to obtain the i-th frame of the composite video.

[0024] In some embodiments of the second aspect, the method further comprises: presenting, by the center device, a video shot by a specific shooting device in the distributed shooting system.

[0025] In a third aspect, an apparatus for video presentation is provided. The apparatus comprises: a receiving module configured to receive a composite video from a center device, an i-th frame of the composite video being obtained based on i-th frames of videos respectively captured by a plurality of capturing devices at a same time in a distributed capturing system, i being any positive integer; a determining module configured to determine a to-be-presented video based on the composite video, the to-be-presented video being associated with at least one capturing device of the plurality of capturing devices; and a presenting module configured to present the to-be-presented video.

[0026] In some embodiments of the third aspect, the determining module is configured to determine each frame of the to-be-presented video by: determining an i-th frame of a video captured by a target capturing device from the i-th frame of the composite video, the target capturing device being a capturing device of the plurality of capturing devices located at a target position; and determining the i-th frame of the video captured by the target capturing device as the i-th frame of the to-be-presented video.

[0027] In some embodiments of the third aspect, the receiving module is further configured to receive a user input instruction, the user input instruction indicating the target capturing device. The determining module is configured to determine each frame of the to-be-presented video by: determining an i-th frame of a video captured by the target capturing device from the i-th frame of the composite video; and determining the i-th frame of the video captured by the target capturing device as the i-th frame of the to-be-presented video.

[0028] In some embodiments of the third aspect, the receiving module is further configured to receive a look-around viewing operation of a user on a current frame of the to-be-presented video; and the presenting module is further configured to present, in response to the look-around viewing operation, a look-around image sequence corresponding to the current frame of the to-be-presented video.

[0029] In some embodiments of the third aspect, the determining module is configured to: determine, in response to the look-around viewing operation, a frame of the composite video corresponding to the current frame of the to-be-presented video; split the determined frame of the composite video corresponding to the current frame of the to-be-presented video into a plurality of images respectively corresponding to the plurality of capturing devices; and obtain the look-around image sequence based on the plurality of images.

[0030] In some embodiments of the third aspect, a number of the plurality of images is equal to a number of the plurality of capturing devices.

[0031] In some embodiments of the third aspect, the determining module is configured to arrange the plurality of images in a look-around image sequence in a position order of the plurality of capturing devices.

[0032] In some embodiments of the third aspect, the determining module is configured to arrange the plurality of images in a look-around image sequence in a position order of the plurality of capturing devices; and insert an intermediate frame between each two adjacent images of the plurality of images by an interpolation operation to obtain the look-around image sequence.

[0033] In some embodiments of the third aspect, the i-th frame of the composite video is obtained by stitching the i-th frames of the videos respectively captured by the plurality of shooting devices at the same time.

[0034] In a fourth aspect, an apparatus for video presentation is provided. The apparatus comprises: a receiving module configured to receive videos respectively captured by a plurality of shooting devices in a distributed shooting system; a determining module configured to obtain a composite video based on the videos respectively captured by the plurality of shooting devices, wherein an i-th frame of the composite video is obtained based on i-th frames of the videos respectively captured by the plurality of shooting devices at the same time, i being any positive integer; and a sending module configured to send the composite video to a client device.

[0035] In some embodiments of the fourth aspect, the determining module is configured to determine each frame of the composite video by stitching the i-th frames of the videos respectively captured by the plurality of shooting devices at the same time to obtain the i-th frame of the composite video.

[0036] In some embodiments of the fourth aspect, the apparatus further comprises a presenting module configured to present a video captured by a specific shooting device in the distributed shooting system.

[0037] In a fifth aspect, an electronic device is provided. The electronic device comprises a transceiver, a processor, and a memory having instructions stored thereon for execution by the processor, which when executed by the processor cause the electronic device to implement: receiving, via the transceiver, a composite video from a center device, wherein an i-th frame of the composite video is obtained based on i-th frames of videos respectively captured by a plurality of shooting devices in a distributed shooting system at the same time, i being any positive integer; determining a to-be-presented video based on the composite video, wherein the to-be-presented video is associated with at least one shooting device of the plurality of shooting devices; and presenting the to-be-presented video.

[0038] In some embodiments of the fifth aspect, the instructions executed by the processor cause the electronic device to implement determining each frame of the to-be-presented video by: determining, from the i-th frame of the composite video, an i-th frame of a video captured by a target shooting device, wherein the target shooting device is a shooting device of the plurality of shooting devices located at a target position; and determining the i-th frame of the video captured by the target shooting device as the i-th frame of the to-be-presented video.

[0039] In some embodiments of the fifth aspect, the instructions executed by the processor cause the electronic device to implement: receiving, via the transceiver, a user input instruction, wherein the user input instruction indicates the target shooting device; and determining each frame of the to-be-presented video by: determining, from the i-th frame of the composite video, an i-th frame of a video captured by the target shooting device; and determining the i-th frame of the video captured by the target shooting device as the i-th frame of the to-be-presented video.

[0040] In some embodiments of the fifth aspect, the processor executes the instructions to cause the electronic device to implement: receiving a look-around viewing operation of a user for a current frame of the video to be presented; and in response to the look-around viewing operation, presenting a look-around image sequence corresponding to the current frame of the video to be presented.

[0041] In some embodiments of the fifth aspect, the processor executes the instructions to cause the electronic device to implement: in response to the look-around viewing operation, determining a frame corresponding to the current frame of the video to be presented from the composite video; splitting the determined frame of the composite video corresponding to the current frame of the video to be presented into a plurality of images corresponding to the plurality of photographing devices respectively; obtaining a look-around image sequence based on the plurality of images; and presenting the look-around image sequence.

[0042] In some embodiments of the fifth aspect, the number of the plurality of images is equal to the number of the plurality of photographing devices.

[0043] In some embodiments of the fifth aspect, the processor executes the instructions to cause the electronic device to implement: arranging the plurality of images in a position order of the plurality of photographing devices to obtain the look-around image sequence.

[0044] In some embodiments of the fifth aspect, the processor executes the instructions to cause the electronic device to implement: arranging the plurality of images in a position order of the plurality of photographing devices; and inserting an intermediate frame between each two adjacent images of the plurality of images by an interpolation operation to obtain the look-around image sequence.

[0045] In some embodiments of the fifth aspect, the i-th frame of the composite video is obtained by splicing i-th frames of videos respectively photographed by the plurality of photographing devices at the same time.

[0046] In some embodiments of the fifth aspect, the electronic device comprises a display screen for presenting the video to be presented or the look-around image sequence.

[0047] A sixth aspect provides an electronic device. The electronic device comprises a transceiver, a processor, and a memory having instructions stored thereon for execution by the processor, which when executed by the processor cause the electronic device to implement: receiving, via the transceiver, videos respectively photographed by a plurality of photographing devices in a distributed photographing system; obtaining, based on the videos respectively photographed by the plurality of photographing devices, a composite video, an i-th frame of the composite video being obtained based on i-th frames of videos respectively photographed by the plurality of photographing devices at the same time, i being any positive integer; and sending, via the transceiver, the composite video to a client device.

[0048] In some embodiments of the sixth aspect, the processor executes the instructions to cause the electronic device to implement determining each frame of the composite video by: splicing i-th frames of videos respectively photographed by the plurality of photographing devices at the same time to obtain an i-th frame of the composite video.

[0049] In some embodiments of the sixth aspect, the processor executes the instructions to cause the electronic device to implement: presenting a video captured by a specific capturing device in the distributed capturing system.

[0050] In some embodiments of the sixth aspect, the electronic device comprises a capturing device.

[0051] In a seventh aspect, a computer-readable storage medium is provided, and the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the operations of the method according to the first aspect or the second aspect or any implementation manner thereof.

[0052] In an eighth aspect, a chip or chip system is provided. The chip or chip system comprises a processing circuitry configured to perform the operations of the method according to the first aspect or the second aspect or any implementation manner thereof.

[0053] In a ninth aspect, a computer program or computer program product is provided. The computer program or computer program product is tangibly stored on a computer-readable medium and includes computer-executable instructions, which, when executed on a computer, cause the computer to perform the operations of the method according to the first aspect or the second aspect or any implementation manner thereof. BRIEF DESCRIPTION OF DRAWINGS

[0054] The above and other features, aspects and advantages of embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. In the drawings similar elements are denoted by similar reference numerals, in which:

[0055] Figure 1 One schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented is shown;

[0056] Figure 2 One schematic diagram showing an example scenario in which embodiments of the present disclosure can be implemented is shown;

[0057] Figure 3 One schematic interaction diagram showing a video presentation process according to some embodiments of the present disclosure is shown;

[0058] Figure 4 One schematic flow diagram showing a process of determining a composite video according to some embodiments of the present disclosure is shown;

[0059] Figure 5 One schematic diagram showing a manner of determining a composite video according to some embodiments of the present disclosure is shown;

[0060] Figure 6A schematic flow diagram showing a process of presenting a sequence of surround view images according to some embodiments of the disclosure;

[0061] Figure 7 A schematic diagram showing interpolation according to some embodiments of the disclosure;

[0062] Figure 8 A schematic flow diagram showing a process of video presentation according to some embodiments of the disclosure;

[0063] Figure 9 A schematic flow diagram showing a process of video presentation according to some embodiments of the disclosure;

[0064] Figure 10 A schematic block diagram showing an apparatus for video presentation according to some embodiments of the disclosure;

[0065] Figure 11 Another schematic block diagram showing an apparatus for video presentation according to some embodiments of the disclosure; and

[0066] Figure 12 A schematic block diagram of an example device that can be used to implement embodiments of the disclosure. DETAILED DESCRIPTION

[0067] Embodiments of the disclosure will be described more fully hereinafter with reference to the accompanying drawings. While several embodiments of the disclosure are shown in the drawings, it is understood that the disclosure can be embodied in many forms and should not be construed as limited to the embodiments set forth herein, but should be read to include any embodiments falling within the scope of the disclosure. As used herein, the term "exemplary" is used interchangeably with the term "by way of example," and should not be construed as a reflection of an idealized or preferred embodiment. As used herein, the term "or" should be understood as meaning "and / or" unless otherwise indicated.

[0068] In the description of embodiments of the disclosure, the term "including" and its derivatives, shall be understood as comprising but not limited to. The term "based on" shall be understood as "based, at least in part, on." The term "one embodiment" or "an embodiment" shall be understood as "at least one embodiment." The term "first," "second," and the like, can refer to different or identical objects. Other definitions can be explicitly or implicitly provided throughout this document.

[0069] A distributed shooting system can include a shooting array composed of at least two shooting devices, which can shoot images or videos, and can be referred to as image acquisition devices, etc. The distributed shooting system can also be referred to as a distributed camera system or a distributed shooting array or a distributed image acquisition system, etc. It should be understood that the "image" in the embodiments of the present disclosure can be an image shot by a shooting device or can be a frame of a video shot by a shooting device. In addition, a video can also be referred to as an image stream, a frame stream, a video stream, a media stream, etc., and the present disclosure does not limit this.

[0070] The at least two shooting devices in the distributed shooting system can shoot at the same time to obtain more visual information, and then can be coordinated with each other to realize multi-channel image display on the same screen, real-time splicing of multi-channel images, etc. The distributed shooting system can be implemented in various different scenarios. For example, the distributed shooting device system can be implemented as a surround shooting array, and the multiple shooting devices in the system can be arranged around a target object at a certain angle and distance, and each shooting device is responsible for shooting the target object in a certain field of view. When the images shot by each shooting device are played in sequence, it is as if the human eye observes the target object from different angles along an arc in a direction with the target object as the center.

[0071] The distributed shooting system is also applied in network live streaming. In the network live streaming scenario, the multiple shooting devices of the distributed shooting system can shoot respectively, and the host can select the video to be presented for the customers to view through the client devices. In this process, the content viewed by the customers is determined by the host, that is, the client devices are only passive receivers of the video, which causes the live streaming content viewed by all customers from their respective client devices to be exactly the same. Even if the host does not switch the shooting devices, it will also cause waste of the videos shot by other shooting devices in the distributed shooting system, and the videos shot by the multiple shooting devices cannot be fully utilized. In this way, the experience and feeling of the user watching the live streaming are seriously affected.

[0072] Therefore, the present disclosure provides a video presentation scheme. The client device can receive a composite video obtained by multiple shooting devices, and then perform local presentation based on the composite video. In this way, different needs of different users for presentation can be met, and the user experience is improved.

[0073] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In the example environment 100, a center device 110, a distributed shooting system 120, a client device 130-1, a client device 130-2, and a client device 130-N are shown. The distributed shooting system 120 includes multiple shooting devices, such as a shooting device 121-1, a shooting device 121-2, a shooting device 121-3, a shooting device 121-4, and a shooting device 121-5. Figure 1The shooting equipment 122-1, shooting equipment 122-2 and shooting equipment 122-3 are shown in the picture.

[0074] For ease of description below, in this embodiment of the disclosure, shooting devices 122-1, 122-2, and 122-3 are collectively referred to as shooting device 122, and client devices 130-1, 130-2, ..., and 130-N are collectively referred to as client devices 130. It is also understood that, although... Figure 1 The diagram shows a distributed shooting system 120 including three shooting devices. However, in practical applications, the number of shooting devices included in the distributed shooting system 120 can be set according to the scenario, etc. The shooting device 122 can be a standalone device or a peripheral device of other electronic devices. For example, the shooting device 122 can be implemented as an electronic device with image acquisition capabilities. The shooting device 122 can include cameras, video cameras, snapshot devices, mobile phones, tablets, wearable devices, etc., and this disclosure is not limited thereto.

[0075] like Figure 1 As shown, the central device 110 can interact with the client device 130. In scenarios such as live streaming, the central device 110 can be an electronic device that interacts with the broadcaster, and the client device 130 can be an electronic device that interacts with the user. That is to say, there is a communication connection between the central device 110 and the client device 130.

[0076] In some embodiments, the central device 110 may interact with the client device 130 via a server (e.g., a streaming media server). In some embodiments, the central device 110 and the client device 130 may be implemented as electronic devices such as smartphones, tablets, wearable devices, etc. The embodiments of this disclosure do not limit the number (N) of client devices; for example, in a live webcasting scenario, the number of client devices may be in the hundreds, thousands, or even greater.

[0077] like Figure 1 As shown, the central device 110 can interact with the distributed shooting system 120. For example, images or videos captured by shooting devices 122-1, 122-2 and 122-3 can be transmitted to the central device 110.

[0078] The center device 110 and the shooting device 122 can have a communication connection, and embodiments of the present disclosure do not limit the connection manner, for example, wired or wireless connection. The wired manner can include, but is not limited to, fiber connection, universal serial bus (USB) connection, etc., and the wireless manner can include, but is not limited to, mobile communication technology (including but not limited to 2G, 3G, 4G, 5G, 6G, etc., Wi-Fi, Bluetooth, point-to-point (P2P), etc.

[0079] Taking Wi-Fi connection as an example, the center device 110 and the shooting device 122 can be in the same local area network environment, the center device 110 can discover the shooting device 122 in the same local area network environment through its distributed shooting system control module (or connection discovery module or other module, etc.), and establish a Wi-Fi connection with the shooting device 122, for example, the center device 110 and the shooting device 122 can be connected to the same router. It should be noted that the communication connection manner between the center device 110 and different shooting devices 122 can be the same or different. For example, the connection manner between the center device 110 and the shooting device 122-1 can be different from the connection manner between the center device 110 and the shooting device 122-2.

[0080] Although Figure 1 Although the center device 110 is shown as a device independent of the distributed shooting system 120, in some embodiments, the center device 110 can be implemented as part of the distributed shooting system 120, for example, the center device 110 can be the electronic device corresponding to the shooting device 122-2.

[0081] Embodiments of the present disclosure do not limit the arrangement manner of each shooting device in the distributed shooting system 120.

[0082] In some embodiments, the shooting device 122-1, the shooting device 122-2 and the shooting device 122-3 can be arranged side by side, so that when the target object is shot, the shooting direction of the target object is parallel or basically consistent.

[0083] In some embodiments, the shooting device 122-1, the shooting device 122-2 and the shooting device 122-3 can be arranged around the target object, so that when the target object is shot, the shooting direction of the target object is at a certain angle. In combination with Figure 2 , it is assumed that the distributed shooting system 120 includes 7 shooting devices, which are the shooting device 122-1 to 122-7, and the electronic device corresponding to the shooting device 122-4 is the center device 110.

[0084] In Figure 2In the illustrated scenario 200, seven shooting devices can be installed on a fixed support 201, and each of the seven shooting devices can perform image shooting on a target object 202. In scenarios such as network live streaming, the target object 202 can be an item to be displayed by a host.

[0085] In some embodiments, Figure 2 In some embodiments, the fixed support 201 is implemented as a ring-shaped support, and a plurality of fixing buckles are provided on the fixed support 201 for fixing the plurality of shooting devices 122. After the plurality of shooting devices 122 are respectively installed on the fixed support 201, the position and angle of each shooting device 122 relative to the center of the fixed support 201 (e.g., the center of the circle on which the ring is located) can be fixed. It can be understood that although Figure 2 In some embodiments, the plurality of shooting devices 122 in the fixed support 201 can shoot towards the center of the fixed support 201, that is, the target object 202 is located near the center of the fixed support 201. However, embodiments of the present disclosure are not limited thereto, for example, the plurality of shooting devices 122 can also shoot towards the outside of the fixed support 201, which can expand the field of view and thus perform panoramic live streaming.

[0086] In some embodiments, Figure 2 In some embodiments, each of the seven shooting devices in the fixed support 201 can be implemented as a camera on a smart terminal, for example, in the case of a smart terminal being a mobile phone, seven mobile phones can be installed at corresponding positions of the fixed support 201. In an embodiment, the seven shooting devices are respectively installed on the fixed support 201, so that the shooting angle of the seven shooting devices for shooting the target object 202 is fixed, that is, each shooting device is not movable and not rotatable. In some embodiments, the included angle of the center lines of each two adjacent shooting devices can be fixed, for example, the included angle can be set to 20° or other values.

[0087] In embodiments of the present disclosure, the shooting regions of two adjacent shooting devices in the distributed shooting system 120 can have partial overlap. For example, a first image is obtained by shooting the target object 202 by the shooting device 122-1, a second image is obtained by shooting the target object 202 by the shooting device 122-2, and a first region in the first image and a second region in the second image are for the same shooting region of the target object 202. In an example, the first region accounts for 1 / 4 or more of the first image, and the second region accounts for 1 / 4 or more of the second image.

[0088] Embodiments of the present disclosure can be applied to scenarios of network live streaming. In order to perform network live streaming, a host can pre-prepare and fix each shooting device 122 to form a distributed shooting system. For example, as shown in FIG. 2, the host can fix the seven shooting devices 122 on the fixed support 201 to form the distributed shooting system 120. Figure 2In the illustrated manner, multiple shooting devices 122 are installed on the fixed support 201. The host can also select a center device 110, for example, set the electronic device corresponding to the shooting device 122-4 as the center device 110. Subsequently, the host can create a live room through the center device 110, for example, connect the server of the live platform through the center device 110 to create a live room. The center device 110 can request the server of the live platform to obtain a streaming address, such as a uniform resource locator (URL). Streaming can be a process in which the center device 110 pushes an audio and video stream to the server of the live platform, and the streaming address is an address corresponding to the streaming process, and the format of the streaming address depends on the protocol used, etc. Similarly, the client device 130 can obtain the corresponding audio and video stream from the server of the live platform through the pull streaming address corresponding to the streaming address, where the pull streaming can be a process in which the client device 130 pulls the audio and video stream on the server of the live platform to the local, and the pull streaming address is an address corresponding to the pull streaming process, and the format of the pull streaming address depends on the protocol used, etc. It can be understood that the number of client devices 130 connected with the center device 110 can change as the customers enter or exit the live room.

[0089] It can be understood that the client device 130 can establish a communication connection with the center device 110 through the operation of the user entering the live room. In some embodiments, the center device 110 can send live room information to the client device 130. In some embodiments, the client device 130 can send an information request to the live platform server, and then obtain the live room information from the center device 110.

[0090] Exemplarily, the live room information can include system information of the distributed shooting system. In some embodiments, the system information of the distributed shooting system can include the number of shooting devices included in the distributed shooting system. For example, in the scenario as shown in FIG. 1, the number is 7. Figure 2 In some embodiments, the system information of the distributed shooting system can include the size of the image shot by each shooting device, for example, the width and the height. For example, if the image size shot by each shooting device is equal, then w and h can be included to represent the width and the height of the image shot by a single shooting device, respectively. In some embodiments, the system information of the distributed shooting system can include the identification of the shooting device associated with the center device 110. For example, in the scenario as shown in FIG. 1, the center device 110 is the electronic device corresponding to the shooting device 122-4, and then the identification of the shooting device associated with the center device 110 can be 4. It can be understood that the system information of the distributed shooting system can also include other information, such as the resolution of the shooting device, etc., which will not be listed one by one here. Figure 2 ​

[0091] Exemplarily, the live room information can further include a pull streaming address for the client device 130, and the client device 130 can obtain the video through the pull streaming address. It can be understood that the live room information can further include other information, such as a live room address, a live broadcast playing time, and the like, which will not be listed one by one here.

[0092] The following will be described in combination with Figures 3 to 7 The embodiments of the present disclosure will be described in more detail.

[0093] Figure 3 A schematic interaction diagram of a video presentation process 300 according to some embodiments of the present disclosure is shown. Figure 3 The process 300 shown involves the center device 110 and the client device 130.

[0094] In the process 300, the center device 110 determines 310 a composite video based on a plurality of videos respectively captured by a plurality of shooting devices 122 of the distributed shooting system 120.

[0095] Exemplarily, the process in which the center device 110 determines the composite video can refer to Figure 4 As shown, Figure 4 A schematic flowchart of a process 400 in which the center device 110 determines the composite video is shown.

[0096] In the process 400, the shooting device 122 performs video shooting 410. Taking 3 shooting devices as an example, it can be assumed that the shooting device 122-1 captures video 1, it can be assumed that the shooting device 122-2 captures video 2, and it can be assumed that the shooting device 122-3 captures video 3.

[0097] Optionally or additionally, the center device 110 and the shooting device 122 can perform time synchronization 402. The specific manner of time synchronization is not limited by the embodiments of the present disclosure. In some embodiments, through time synchronization, time synchronization information between the local clock of the center device 110 and the local clock of the shooting device 122 can be determined. In some embodiments, after time synchronization, different shooting devices 122 can perform image shooting at the same time. For example, the i-th frame captured by the shooting device 122-1 and the i-th frame captured by the shooting device 122-2 are acquired at the same time.

[0098] In the process 400, the shooting device 122 sends 420 the captured video to the center device 110. Taking 3 shooting devices as an example, the center device 110 can obtain video 1, video 2, and video 3.

[0099] Optionally or additionally, the center device 110 can pre-process 422 the video from the shooting device 122. In some embodiments, the pre-processing can be for part of the video or the whole video. In some embodiments, the pre-processing can include, but is not limited to, beautifying, watermarking, mosaicking, etc. As an example, the watermarking can include adding all or part of the following information on part or all of the frames of the video: anchor name, information of the target object, identification of the shooting device 122, etc.

[0100] In the process 400, the center device 110 obtains 430 the composite video. Taking 3 shooting devices as an example, the center device 110 can synthesize the video 1, the video 2 and the video 3 to obtain the composite video.

[0101] In embodiments of the present disclosure, the i-th frame of the composite video can be obtained based on the i-th frame shot by the shooting device 122. In some embodiments, the i-th frame shot by each shooting device 122 can be synthesized to obtain the i-th frame of the composite video. i is any positive integer, so that by obtaining each frame of the composite video, the composite video can be obtained.

[0102] In some embodiments, the i-th frame shot by each shooting device 122 can be spliced in the order of the shooting device 122 to obtain the i-th frame of the composite video. For example, assuming that the i-th frame shot by each shooting device 122 has the same size, for example, the width w and the height h. Then the width of the i-th frame of the composite video can be equal to the sum of the width of the i-th frame shot by each shooting device 122, and the height of the i-th frame of the composite video is equal to h. In some embodiments, the order of the shooting device 122 can be: the order of the shooting device arranged in the clockwise direction with the target object 202 as the reference. In combination with Figure 2 With the target object 202 as the center point, the clockwise order of the shooting device 122 is: the shooting device 122-1, the shooting device 122-2, the shooting device 122-3, the shooting device 122-4, the shooting device 122-5, the shooting device 122-6 and the shooting device 122-7.

[0103] In order to simplify the description, the process of obtaining the composite video is described taking 3 shooting devices as an example. Specifically, each frame in the video 1 shot by the shooting device 122-1 is denoted as f11, f12, …, f1n, each frame in the video 2 shot by the shooting device 122-2 is denoted as f21, f22, …, f2n, and each frame in the video 3 shot by the shooting device 122-3 is denoted as f31, f32, …, f3n. Then as shown in Figure 5 the 1st frame of the composite video can be sequentially spliced from f11, f21 and f31, …, and the n-th frame of the composite video can be sequentially spliced from f1n, f2n and f3n.

[0104] In other words, the center device 110 can take the first frame from each of the videos in the order of the shooting devices 122, and after taking the first frame from all the videos, stitch the first frames in the order of the shooting devices 122 as the first frame of the composite video. Then the center device 110 can take the second frame from each of the videos in the order of the shooting devices 122, and after taking the second frame from all the videos, stitch the second frames in the order of the shooting devices 122 as the second frame of the composite video. This cycle can obtain the composite video.

[0105] It can be understood that the above embodiment is only illustrative of the way to obtain the composite video, and the embodiments of the present disclosure are not limited thereto. For example, the videos can be stitched in the reverse order of the shooting devices 122, or can be stitched in other predetermined rules. For example, the videos can be stitched in the width direction or in the height direction, or can be stitched in other manners.

[0106] In the process 300, the center device 110 sends 320 the composite video to the client device 130.

[0107] In some embodiments, the client device 130 can obtain the composite video from the streaming server through the streaming address.

[0108] In some embodiments, the center device 110 can send the composite video to the client device 130 after encoding and compressing, encapsulating, etc. For example, the video can be encoded and compressed by using the H.264 video compression technology. For example, the video can be encapsulated into the streaming media format such as FLV or TS. In this way, the demand for network bandwidth, etc. can be reduced, the transmission rate can be improved, and the real-time performance can be ensured.

[0109] Correspondingly, the client device 130 can determine the composite video by decapsulation, decoding and decompression, etc. In some embodiments, the client device 130 can obtain the encapsulated video data in the FLV or TS format by pulling the stream from the live streaming platform server, and then can obtain the encoded and compressed video data by parsing, etc. Further, the client device 130 can restore the composite video by decoding.

[0110] In the process 300, the client device 130 determines 330 the video to be presented, wherein the video to be presented is associated with at least one shooting device 122. Further, the client device 130 presents 340 the video to be presented.

[0111] In the embodiments of the present disclosure, presenting the video can mean displaying the frames of the video frame by frame, or can be understood as playing the video.

[0112] In some embodiments, the video to be presented can be a composite video. Since a frame of the composite video includes images captured by various shooting devices in a distributed shooting system, images of the target object 202 captured by multiple shooting devices can be simultaneously presented at the client device 130. In this way, the user at the client device 130 can simultaneously see images of the target object 202 from various angles, thereby facilitating subsequent selection by the user, such as viewing the video from which shooting device.

[0113] In some embodiments, the video to be presented can be a video captured by a specific shooting device in a distributed shooting system. Specifically, the portion captured by the specific shooting device can be separated from each frame of the composite video to determine the video to be presented. In embodiments of this disclosure, the specific shooting device can be any of the following: a shooting device located at the target location, a shooting device specified by the user of the client device 130, etc.

[0114] In some embodiments, the target location may be a central device 110, and the video to be presented may be a video captured by a shooting device corresponding to the central device 110. For example, the shooting device corresponding to the central device 110 may be a shooting device included in the central device 110.

[0115] For simplicity, the shooting device corresponding to the central device 110 can be referred to as the central shooting device. In some embodiments, the client device 130 can separate the video to be presented corresponding to the central shooting device from the composite video based on the number of multiple shooting devices in the distributed shooting system (assuming M) and the identifier of the central shooting device (assuming p).

[0116] For example, if the method for determining composite videos is similar to... Figure 5 The stitching method is shown below. Therefore, for any frame of the composite video (let's say the i-th frame), a portion with a width in the range [(p-1)×w, p×w] can be extracted from the i-th frame of the composite video and used as the i-th frame of the video to be presented. For another example, the i-th frame of the composite video can be split into M images, that is, the images captured by M shooting devices can be recovered, and then the image captured by the central shooting device can be determined from the M images.

[0117] Since the central device 110 is generally an electronic device operated by the broadcaster, this method ensures that the video displayed on the client device 130 is consistent with the content on the central device 110 that the broadcaster interacts with. Especially when the broadcaster is giving a voice introduction to the target object 202, it allows users to view the specific details being described in real time.

[0118] In some embodiments, the target position can be a middle position of the plurality of shooting devices, and the video to be presented can be a video shot by a shooting device at the middle position in the distributed shooting system. Assuming that the number of the plurality of shooting devices in the distributed shooting system is M. Then if M is odd, the number of the shooting device at the middle position is (M+1) / 2. If M is even, the number of the shooting device at the middle position can be M / 2 or M / 2+1.

[0119] In this way, the user at the client device 130 can view the image of the front of the target object 202, so that the user can view more details of the target object 202.

[0120] In some embodiments, the video to be presented can be a video shot by a shooting device specified by the user. Specifically, the client device 130 can receive an input instruction of the user, which can indicate which shooting device in the plurality of shooting devices.

[0121] For example, the user can input a shooting device number, such as “2”, so that the client device 130 can obtain the input instruction. For example, in the process of playing a video shot by a certain shooting device (assuming the number is n1), the user can determine the shooting device number by swiping left or right. For example, swiping left indicates that the shooting device number is reduced by one, i.e., the shooting device number is specified as n1-1. For example, swiping right indicates that the shooting device number is increased by one, i.e., the shooting device number is specified as n1+1.

[0122] In this way, in the embodiments of the present disclosure, the user at the client device 130 can determine which video of the shooting device to be presented by inputting an instruction, which realizes the switching of the video presented on the client device 130, improves the autonomy of the user, and better meets the needs of the customer. In this way, the video presented on the client device 130 does not need to be consistent with the video on the electronic device of the host, and is no longer a passive video receiver, but can be autonomously selected by the user. The video of interest, while not affecting the electronic device of the host and other client devices 130.

[0123] In addition, the embodiments of the present disclosure do not limit the video presented on the center device 110, which can be a video shot by a center shooting device.

[0124] Alternatively or additionally, the client device 130 can receive 350 a look-around viewing operation of the user. Further, the client device 130 can present a 360 look-around image sequence.

[0125] In some embodiments, the user can click on a specific area on the interface of the client device 130 to perform the surround view operation, for example, click on a "surround view" button on the specific area. In some embodiments, the user can operate a specific gesture on the interface of the client device 130 to perform the surround view operation, for example, the specific gesture is a circle or a semi-arc.

[0126] Figure 6 A schematic flowchart of a process 600 of presenting a surround view image sequence is shown according to some embodiments of the present disclosure.

[0127] At block 610, the client device 130 determines, in response to the surround view operation, a current frame of the composite video corresponding to a current frame of the video to be presented.

[0128] Specifically, assuming that the current frame of the video to be presented is the t-th frame, the t-th frame of the composite video can be obtained, which can be understood as including images taken by each of the shooting devices in the distributed shooting system.

[0129] At block 620, the client device 130 splits the current frame of the composite video into multiple images.

[0130] Specifically, the splitting can be based on the number of shooting devices, that is, the number of multiple images is equal to the number of multiple shooting devices. In some embodiments, the multiple images are respectively images taken by the multiple shooting devices.

[0131] At block 630, the client device 130 obtains a surround view image sequence based on the multiple images.

[0132] In some embodiments, the multiple images can be sorted according to the positions of the shooting devices to obtain the surround view image sequence. That is, the multiple images can be sequentially arranged in the order of the positions of the multiple shooting devices to obtain the surround view image sequence. For example, as shown in the scenario, the image taken by the shooting device 122-i is located at the i-th position in the surround view image sequence, i being any value in 1 to 7. Figure 2

[0133] In some embodiments, the multiple images can be sequentially arranged in the order of the positions of the multiple shooting devices, and at least one frame can be inserted between each two adjacent images to form the surround view image sequence. It can be understood that in this embodiment, the number of images in the surround view image sequence is equal to the number of multiple shooting devices.

[0134] ​Specifically, at least one frame can be inserted between two adjacent images through an interpolation operation. The inserted at least one frame can be referred to as a virtual frame or an intermediate frame, and embodiments of the present disclosure do not limit the manner of interpolation. The interpolation can also be referred to as frame filling or animation frame filling, and the virtual frame can be obtained through an algorithm such as local interpolation. Through the interpolation processing, the virtual frame is inserted between the two adjacent images, which can ensure the continuity of the image change between the two adjacent images.

[0135] For example, it is assumed that the current frame is the t th frame, the number of the plurality of shooting devices is m, and the plurality of images are images shot by the plurality of shooting devices, denoted as f1t, f2t, f3t, …, and fmt. As shown in FIG. 7, four virtual frames can be inserted between each two images, thereby obtaining a loop view image sequence 700. In this way, the loop view image sequence obtained after the interpolation includes m+4×(m-1) images. Figure 7

[0136] In this way, the number of images in the loop view image sequence can be expanded, so that the loop view image sequence is more smooth when presented later.

[0137] It should be noted that the number of virtual frames inserted in the interpolation processing is not limited in embodiments of the present disclosure. In some embodiments, the number of virtual frames inserted between each two adjacent frames can be a preset value, for example, 4. Figure 7 In the above example, the preset value is 4, and it can be understood that the preset value can also be other values. The preset value can be set in advance according to the angle between the two adjacent shooting devices, the number of shooting devices, etc. In some embodiments, the number of virtual frames inserted between different adjacent two frames can be equal or unequal, for example, the number of virtual frames inserted between f1t and f2t is a first number, and the number of virtual frames inserted between f2t and f3t is a second number, and the first number can be equal to or not equal to the second number.

[0138] At block 640, the client device 130 presents each image in the loop view image sequence in sequence.

[0139] In some embodiments, the client device 130 can also present the corresponding image in the loop view image sequence based on the left-right sliding operation of the user. In this way, the user can view the loop view effect of the target object 202 according to his own needs.

[0140] As can be seen, embodiments of the present disclosure provide a real-time loop view live streaming scheme based on a distributed shooting system. The client device can receive the composite video from the center device, and then the client device can present the to-be-presented video or the loop view effect according to the actual needs or user instructions. In this way, the user at the client device can autonomously determine the content to be presented, and the client device is no longer a single passive content receiver, which can greatly improve the user's interactive experience.​

[0141] Figure 8 A schematic flowchart of a video presenting process 800 is shown according to some embodiments of the present disclosure. The process 800 can be performed by a client device 130 as shown in FIG. 1. Figure 1

[0142] At block 810, the client device 130 receives a composite video from the center device, an ith frame of the composite video being obtained based on ith frames of videos respectively captured by a plurality of capturing devices at a same time in a distributed capturing system, i being any positive integer. At block 820, the client device 130 determines a to-be-presented video based on the composite video, the to-be-presented video being associated with at least one capturing device of the plurality of capturing devices. At block 830, the client device 130 presents the to-be-presented video.

[0143] In some embodiments, the ith frame of the composite video is obtained by stitching the ith frames respectively captured by the plurality of capturing devices at the same time. For example, at the same time, the plurality of capturing devices respectively capture corresponding multiple frames, then the corresponding multiple frames can be stitched by the center device, and the stitched frame is taken as a frame corresponding to the time in the composite video.

[0144] In some embodiments, the client device 130 determining the to-be-presented video based on the composite video can include determining each frame of the to-be-presented video by the following process: the client device 130 determines an ith frame of a video captured by a target capturing device from an ith frame of the composite video, the target capturing device being a capturing device of the plurality of capturing devices located at a target position; and determining the ith frame of the video captured by the target capturing device as an ith frame of the to-be-presented video. Optionally, the target position can be a middle position of the plurality of capturing devices.

[0145] In some embodiments, the client device 130 determining the to-be-presented video based on the composite video includes: the client device 130 receiving a user input instruction, the user input instruction indicating a target capturing device; and determining each frame of the to-be-presented video by the following process: determining an ith frame of a video captured by the target capturing device from an ith frame of the composite video; and determining the ith frame of the video captured by the target capturing device as an ith frame of the to-be-presented video. In this way, by taking i as 1, 2, … in turn, each frame of the to-be-presented video can be obtained frame by frame. Optionally, the user input instruction can be based on a sliding operation of the user on an interface, the sliding operation can be left sliding or right sliding to respectively indicate determining the target capturing device by moving the position left or right.

[0146] ​For example, for any frame, such as the i-th frame, of the composite video, the i-th frame of the video captured by the target capturing device can be determined from the i-th frame of the composite video as the i-th frame of the to-be-presented video. Generally, the image size of the i-th frame of the to-be-presented video is smaller than the image size of the i-th frame of the composite video.

[0147] Optionally or additionally, as shown in FIG. 8B, at block 840, the client device 130 receives a user’s look-around viewing operation for a current frame of the to-be-presented video. At block 850, the client device 130 presents, in response to the look-around viewing operation, a look-around image sequence corresponding to the current frame of the to-be-presented video. Figure 8

[0148] In some embodiments, the client device 130 presenting the look-around image sequence in response to the look-around viewing operation can include: the client device 130 determining, in response to the look-around viewing operation, a frame of the composite video corresponding to the current frame of the to-be-presented video; splitting the determined frame of the composite video corresponding to the current frame of the to-be-presented video into a plurality of images respectively corresponding to the plurality of capturing devices; obtaining the look-around image sequence based on the plurality of images; and presenting the look-around image sequence. Illustratively, the number of the plurality of images is equal to the number of the plurality of capturing devices.

[0149] In some embodiments, the client device 130 obtaining the look-around image sequence based on the plurality of images can include: the client device 130 arranging the plurality of images in a position order of the plurality of capturing devices to obtain the look-around image sequence.

[0150] In some embodiments, the client device 130 obtaining the look-around image sequence based on the plurality of images includes: the client device 130 arranging the plurality of images in a position order of the plurality of capturing devices; and inserting, by an interpolation operation, an intermediate frame between each two adjacent images of the plurality of images to obtain the look-around image sequence.

[0151] Figure 9 A schematic flowchart of a video presentation process 900 according to some embodiments of the present disclosure is shown. The process 900 can be performed by the center device 110 as shown in FIG. 9. Figure 1 The center device 110 receives videos respectively captured by the plurality of capturing devices in the distributed capturing system, at block 910. The center device 110 obtains a composite video based on the videos respectively captured by the plurality of capturing devices, at block 920. The i-th frame of the composite video is obtained based on i-th frames of the videos respectively captured by the plurality of capturing devices at the same time, i being any positive integer. The center device 110 sends the composite video to the client device, at block 930.

[0152] The center device 110 receives videos respectively captured by the plurality of capturing devices in the distributed capturing system, at block 910. The center device 110 obtains a composite video based on the videos respectively captured by the plurality of capturing devices, at block 920. The i-th frame of the composite video is obtained based on i-th frames of the videos respectively captured by the plurality of capturing devices at the same time, i being any positive integer. The center device 110 sends the composite video to the client device, at block 930.

[0153] ​In some embodiments, obtaining the composite video by the central device 110 may include determining each frame of the composite video through the following process: the central device 110 stitches together the i-th frames of videos captured by multiple shooting devices at the same time to obtain the i-th frame of the composite video. For example, if multiple shooting devices capture corresponding multiple frames at the same time, the central device 110 can stitch together the corresponding multiple frames and use the stitched frame as the frame in the composite video corresponding to that time.

[0154] In some embodiments, the method may further include presenting a video captured by a specific camera in the distributed shooting system at the central device 110. For example, after acquiring videos captured by multiple cameras in the distributed shooting system, the central device 110 presents the video captured by the target camera. For example, the target camera may be a device in the distributed shooting system that interacts with the user, or the target camera may be a device located in the middle of the distributed shooting system.

[0155] Figure 10 A schematic block diagram of an apparatus 1000 for video presentation according to some embodiments of the present disclosure is shown. The apparatus 1000 may be implemented as or included in... Figure 1 In client device 130.

[0156] The device 1000 may include multiple modules for performing tasks such as Figure 8 The corresponding steps in process 800 discussed herein. For example... Figure 10 As shown, the device 1000 includes a receiving module 1010, a determining module 1020, and a presenting module 1030. The receiving module 1010 is configured to receive composite video from a central device. The i-th frame of the composite video is obtained based on the i-th frame of videos captured simultaneously by multiple shooting devices in a distributed shooting system, where i is any positive integer. The determining module 1020 is configured to determine a video to be presented based on the composite video. The video to be presented is associated with at least one of the multiple shooting devices. The presenting module 1030 is configured to present the video to be presented.

[0157] In some embodiments, the i-th frame of the composite video is obtained by stitching together the i-th frames captured by multiple shooting devices at the same time.

[0158] In some embodiments, the determining module 1020 may be configured to determine each frame of the video to be presented by the following process: determining the i-th frame of the video captured by a target shooting device from the i-th frame of the composite video, wherein the target shooting device is a shooting device located at a target location among a plurality of shooting devices; and determining the i-th frame of the video captured by the target shooting device as the i-th frame of the video to be presented.

[0159] In some embodiments, the receiving module 1010 may also be configured to receive a user input instruction, which instructs the target shooting device. The determining module 1020 may be configured to determine each frame of the video to be presented by: determining the i-th frame of the video captured by the target shooting device from the i-th frame of the composite video; and determining the i-th frame of the video to be presented from the i-th frame of the video captured by the target shooting device.

[0160] In some embodiments, the receiving module 1010 may also be configured to receive a user's panoramic viewing operation on the current frame of the video to be presented. The presentation module 1030 may also be configured to present a panoramic image sequence corresponding to the current frame of the video to be presented in response to the panoramic viewing operation.

[0161] In some embodiments, the determining module 1020 may be configured to: in response to a surround view operation, determine a frame from the composite video corresponding to the current frame of the video to be presented; split the determined frame of the composite video into multiple images corresponding to multiple shooting devices respectively; and obtain a surround view image sequence based on the multiple images.

[0162] In some embodiments, the number of multiple images is equal to the number of multiple shooting devices.

[0163] In some embodiments, the determining module 1020 may be configured to arrange multiple images according to the positional order of multiple capturing devices to obtain a panoramic image sequence.

[0164] In some embodiments, the determining module 1020 may be configured to: arrange multiple images according to the positional order of the multiple capturing devices; and insert intermediate frames between every two adjacent images of the multiple images through a frame interpolation operation to obtain a panoramic image sequence. The number of images in the panoramic image sequence is greater than the number of multiple capturing devices.

[0165] For example, Figure 10 The device 1000 can be implemented as a client device 130, or as a chip or chip system in the client device 130, and the embodiments of this disclosure are not limited thereto. Figure 10 The device 1000 in the middle can be used to achieve the above-mentioned combination. Figures 3 to 9 For the sake of brevity, the various processes described in the client device 130 will not be repeated here.

[0166] Figure 11 Another schematic block diagram of an apparatus 1100 for video presentation according to some embodiments of the present disclosure is shown. The apparatus 1100 may be implemented as or included in... Figure 1 The central equipment 110.

[0167] Device 1100 may include multiple modules for performing, such asFigure 9 The corresponding steps in process 900 discussed herein. For example... Figure 11 As shown, the device 1100 includes a receiving module 1110, a determining module 1120, and a transmitting module 1130. The receiving module 1110 is configured to receive videos captured by multiple shooting devices in a distributed shooting system. The determining module 1120 is configured to obtain a composite video based on the videos captured by the multiple shooting devices, wherein the i-th frame of the composite video is obtained based on the i-th frame of the videos captured by the multiple shooting devices simultaneously, where i is any positive integer. The transmitting module 1130 is configured to transmit the composite video to a client device.

[0168] In some embodiments, the determining module 1120 may be configured to determine each frame of the composite video by the following process: "stitching together the i-th frames of the videos captured by multiple shooting devices at the same time to obtain the i-th frame of the composite video."

[0169] In some embodiments, the apparatus 1100 may further include a presentation module configured to present video captured by a specific shooting device in a distributed shooting system.

[0170] For example, Figure 11 The device 1100 can be implemented as a central device 110, or as a chip or chip system in the central device 110, and the embodiments of this disclosure are not limited thereto. Figure 11 The device 1100 in the middle can be used to achieve the above-mentioned combination. Figures 3 to 9 For the sake of brevity, the various processes described in the central equipment 110 will not be repeated here.

[0171] Figure 12 A schematic block diagram of an example device 1200 that can be used to implement embodiments of the present disclosure is provided. Device 1200 may be implemented as or included in... Figure 1 In the client device 130, or the device 1200, it can be implemented as or included in Figure 1 The central equipment 110.

[0172] As shown, the device 1200 includes a central processing unit (CPU) 1201, a read-only memory (ROM) 1202, and a random access memory (RAM) 1203. The CPU 1201 can perform various appropriate actions and processes according to computer program instructions stored in the RAM 1202 and / or the RAM 1203 or loaded into the ROM 1202 and / or the RAM 1203 from the storage unit 1208. Various programs and data required for the operation of the device 1200 can also be stored in the ROM 1202 and / or the RAM 1203. The CPU 1201 and the ROM 1202 and / or the RAM 1203 are connected to each other through a bus 1204. An input / output (I / O) interface 1205 is also connected to the bus 1204.

[0173] A plurality of components in the device 1200 are connected to the I / O interface 1205, including an input unit 1206 such as a keyboard, a mouse, etc., an output unit 1207 such as various types of displays, speakers, etc., a storage unit 1208 such as a magnetic disk, a magneto-optical disk, etc., and a communication unit 1209 such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1209 allows the device 1200 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0174] The CPU 1201 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples that can be implemented include, but are not limited to, a Graphics Processing Unit (GPU), various special-purpose Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any appropriate processor, controller, microcontroller, etc., which can be referred to as a computing unit accordingly. The CPU 1201 performs various methods and processes described above, such as the process 800 or 900. For example, in some embodiments, the process 800 or 900 can be implemented as a computer software program tangibly embodied in a computer readable medium, such as the storage unit 1208. In some embodiments, part or all of the computer program can be loaded and / or installed onto the device 1200 via the ROM 1202 and / or the RAM 1203 and / or the communication unit 1209. When the computer program is loaded onto the ROM 1202 and / or the RAM 1203 and executed by the CPU 1201, one or more steps of the process 800 or 900 described above can be performed. Alternatively, in other embodiments, the CPU 1201 can be configured to perform the process 800 or 900 by any other appropriate means, such as by means of firmware.

[0175] Exemplarily, Figure 12 The device 1200 in the electronic device can be implemented as an electronic device (such as the client device 130 or the center device 110), or can be implemented as a chip or chip system in the electronic device, and the embodiments of the present disclosure are not limited thereto.

[0176] Embodiments of the present disclosure also provide a chip, which can include an input interface, an output interface, and a processing circuit. In embodiments of the present disclosure, the interaction of the signaling or data described above can be completed by the input interface and the output interface, and the generation and processing of the signaling or data information can be completed by the processing circuit.

[0177] Embodiments of the present disclosure also provide a chip system, which includes a processor for supporting the client device 130 or the center device 110 to implement the functions involved in any of the above embodiments. In a possible design, the chip system can further include a memory for storing necessary program instructions and data, which, when the processor runs the program instructions, causes the device in which the chip system is installed to implement the method involved in any of the above embodiments. The chip system can be composed of a chip, or can include a chip and other discrete devices.

[0178] Embodiments of the present disclosure also provide a processor for coupling with a memory, the memory storing instructions which, when executed by the processor, cause the processor to perform the methods and functions involving the client device 130 or the center device 110 in any of the above embodiments.

[0179] Embodiments of the present disclosure also provide a computer program product containing instructions which, when executed on a computer, cause the computer to perform the methods and functions involving the client device 130 or the center device 110 in any of the above embodiments.

[0180] Embodiments of the present disclosure also provide a computer readable storage medium having computer instructions stored thereon, which, when executed by a processor, cause the processor to perform the methods and functions involving the client device 130 or the center device 110 in any of the above embodiments.

[0181] In general, the various embodiments of the present disclosure can be implemented in hardware or special-purpose circuits, software, logic or any combination thereof. Some aspects can be implemented in hardware, while other aspects can be implemented in firmware or software which can be executed by a controller, microprocessor or other computing device. While various aspects of embodiments of the present disclosure are illustrated and described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that these blocks, apparatus, systems, techniques or methods described herein can be implemented in, as non-limiting examples, hardware, software, firmware, special-purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.

[0182] The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer-readable storage medium. The computer program product includes computer-executable instructions, for example, instructions embodied in program modules, executed by devices in the target real or virtual processor to perform processes / methods as described above with reference to the accompanying drawings. Generally, program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform particular tasks or implement particular abstract data types. In various embodiments, the functionality of program modules can be combined or split between program modules as desired. Machine-executable instructions for program modules can be executed within a local or distributed device. In a distributed device, program modules can be located in both local and remote storage media.

[0183] Computer program code for carrying out operations of the methods of the present disclosure can be written in one or more programming languages. These computer program codes can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the program codes, which execute via the computer or other programmable data processing apparatus, cause the functions / operations specified in the flow diagrams and / or block diagrams to be implemented. The program code can be entirely on the computer, partially on the computer, as a stand-alone software package, partially on the computer and partially on a remote computer, or entirely on a remote computer or server.

[0184] In the context of the present disclosure, computer program code or related data can be embodied by any suitable carrier wave, including a signal, computer readable medium, or the like. Examples of a signal can include, but are not limited to, electro-magnetic waves, radio waves, sound waves, or other forms of propagated signals.

[0185] A computer readable medium can be any tangible medium that contains or stores the program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable medium can be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a computer readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), and a digital versatile disc (DVD), or any suitable combination of the foregoing.

[0186] Moreover, while operations of the methods of the present disclosure are described in a particular order in the drawings, this is not required or implied in any particular order for performing the operations, or that all of the illustrated operations be performed to achieve desirable results. Rather, the order of the steps depicted in the flowcharts can be changed. Additionally or alternatively, certain steps can be omitted, combined into a single step, and / or broken into multiple steps. It should also be noted that features and functions of two or more devices according to the present disclosure can be embodied in one device. Conversely, features and functions of one device described above can be further partitioned into multiple devices.

[0187] Having described various implementations of the disclosure above, the descriptions are not exhaustive and do not limit the implementations to the disclosed implementations. Numerous modifications and adaptations thereof will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The scope of the described implementations is defined by the appended claims, rather than the description of the described implementations. Terms of the description used herein are chosen for the purpose of explaining various implementations, not for purposes of limitation.

Claims

1. A video presentation method, comprising: The client device receives a composite video of the target object from the central device. The i-th frame of the composite video is obtained based on the i-th frame of the video captured by multiple shooting devices in the distributed shooting system at the same time. i is any positive integer. The multiple shooting devices are arranged around the target object. The client device determines the video to be presented based on the composite video, and the video to be presented is associated with at least one of the plurality of shooting devices; as well as The client device displays the video to be displayed; The method further includes: For the current frame of the video to be presented, based on the user's panoramic viewing operation on the client device, a panoramic image sequence is presented, wherein the panoramic image sequence includes at least multiple images corresponding to the multiple shooting devices, and presenting the panoramic image sequence includes sequentially playing the images corresponding to each shooting device, so that the user of the client device can observe the target object from different angles.

2. The method according to claim 1, wherein the client device determines the video to be presented based on the composite video by determining each frame of the video to be presented through the following process: The client device determines, from the i-th frame of the composite video, the i-th frame of the video captured by the target capturing device, wherein the target capturing device is the capturing device located at the target position among the plurality of capturing devices; and The client device determines the i-th frame of the video captured by the target shooting device as the i-th frame of the video to be presented.

3. The method according to claim 1, wherein the client device determines the video to be presented based on the composite video, comprising: The client device receives user input instructions, which instruct the target imaging device. The client device determines each frame of the video to be presented through the following process: determining the i-th frame of the video captured by the target shooting device from the i-th frame of the composite video; and determining the i-th frame of the video captured by the target shooting device as the i-th frame of the video to be presented.

4. The method according to any one of claims 1 to 3, wherein presenting the panoramic image sequence comprises: The client device receives the user's panoramic view operation for the current frame of the video to be presented; as well as In response to the surround view operation, the client device presents the surround view image sequence corresponding to the current frame of the video to be presented.

5. The method according to any one of claims 1 to 3, wherein presenting the panoramic image sequence comprises: In response to the surround view operation, the client device determines the frame corresponding to the current frame of the video to be presented from the composite video; The client device splits the frame corresponding to the current frame of the video to be presented into multiple images corresponding to the multiple shooting devices respectively; The client device obtains the panoramic image sequence based on the multiple images; as well as The client device presents the panoramic image sequence.

6. The method of claim 5, wherein the client device obtains the panoramic image sequence based on the plurality of images by: The client device arranges the multiple images according to the positional order of the multiple shooting devices to obtain the panoramic image sequence; or, The client device arranges the multiple images according to the positional order of the multiple shooting devices; as well as The client device inserts intermediate frames between every two adjacent images of the plurality of images to obtain the panoramic image sequence.

7. The method according to any one of claims 1 to 3, wherein the i-th frame of the composite video is obtained by stitching together the i-th frames captured by the plurality of shooting devices at the same time.

8. An electronic device comprising a processor and a memory, the memory storing computer instructions which, when executed by the processor, cause the electronic device to perform the method of any one of claims 1 to 7.

9. A computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the method according to any one of claims 1 to 7.

10. A computer program product comprising computer-executable instructions which, when executed, implement any one of claims 1 to 7.

Citation Information

Patent Citations

  • Multi-lens optical center superposing type omnibearing shooting device and panoramic shooting and retransmitting method

    CN101521745A

  • Panorama video real time playing method and apparatus

    CN105847850A

  • Composite Video Generation

    US20100296571A1

  • Bundling Separate Video Files to Support a Controllable End-User Viewing Experience with Frame-Level Synchronization

    US20180247672A1