A live video processing method, apparatus, system and storage medium

Abstract

The present invention provides a live video processing method. By obtaining a plurality of second videos associated with the current live video and entering a three-dimensional live interface or a video split screen interface based on a user's trigger operation, it enables the user to obtain information about a first object in the current live video more comprehensively and multi-dimensionally, improving the objectivity, comprehensiveness, and three-dimensional sense of the user's observation of the first object and avoiding being misled.

Description

Technical Field

[0001] This application relates to the technical field of live video processing, and in particular, to a live video processing method, device, system, and storage medium. Background Art

[0002] In the prior art, Internet video live broadcast platforms such as Douyin and Kuaishou have been widely accepted and used by users. Currently, short video platforms based on a recommendation mechanism, such as Douyin, can recommend short videos that a user may be interested in to meet the user's personalized needs based on a recommendation algorithm. However, since the short videos presented to the user by a simple recommendation mechanism may be videos that the user does not want to see currently. For example, the related videos of interest swiped are not continuous. Or, for short video creators, the short videos they present to users are the videos that the creators hope users will see. These videos are often fully processed to maximize the interests of the creators or publishers. Short video viewers often cannot objectively and comprehensively obtain the true situation of these videos and their protagonists, thus causing problems such as misleading viewers.

[0003] Therefore, there is a need to propose a live video processing method to solve the above problems. Summary of the Invention

[0004] The present invention provides a live video processing method, and the method includes the following steps:

[0005] Step S1, obtaining attribute information of a first live video currently played by a mobile terminal application program, where the attribute information includes first object information of the first live video;

[0006] Step S2, obtaining a plurality of second videos associated with the first live video and their attribute information according to the attribute information, and the attribute information of each second video includes the first object information;

[0007] Step S3, obtaining the video type of each second video. If the number of live videos in the second video is greater than a first threshold, execute Step S4; otherwise, execute Step S5;

[0008] Step S4, displaying a first trigger button on a first live interface of the first live video, and detecting a first trigger operation of a user on the first trigger button; generating a three-dimensional live interface of the first object based on the first trigger operation;

[0009] Step S5, displaying a second trigger button on the first live interface of the first live video, and detecting a second trigger operation of the user on the second trigger button; obtaining a first preset number of the second videos based on the second trigger operation to generate a video split screen interface.

[0010] As a preferred embodiment, steps S4 and S5 further include:

[0011] Display a third trigger button on the three-dimensional live broadcast interface and the video split screen interface;

[0012] Detect a third trigger operation of the user on the third trigger button, and return the interface of the first live video based on the third trigger operation.

[0013] As a preferred embodiment, in step S4, when generating the three-dimensional live broadcast interface of the first object based on the first trigger operation, it further includes:

[0014] Obtain the angle information of the first object in the live video of the second video relative to the first object in the first live video, and select a second preset number of the second videos and the first live video with uniformly distributed position angles in the angle information to synthesize the three-dimensional live broadcast interface of the first object. The three-dimensional live broadcast interface takes the perspective where the first object is located in the first live video as the first perspective.

[0015] As a preferred embodiment, it further includes:

[0016] Receive a sliding operation of the user on the three-dimensional live broadcast interface, and switch the perspective of the first object to a second perspective based on the sliding operation;

[0017] After playing for a preset duration in the second perspective, switch the three-dimensional live broadcast interface to the interface of the second video corresponding to the second perspective.

[0018] As a preferred embodiment, in step S5, when obtaining a first preset number of the second videos based on the second trigger operation to generate a video split screen interface, it further includes:

[0019] Obtain the clarity information of the first object in the live video of the second video relative to the first live video and / or the angle information of the first object, and select a third preset number of the second videos and the first live video with uniformly distributed position angles and / or higher clarity in the angle information to generate a video split screen interface.

[0020] As a preferred embodiment, it further includes:

[0021] Obtain the playing duration of the second video in the video split screen interface;

[0022] After any one of the second videos finishes playing, switch the corresponding split screen window to play a third video, and the third video has the same or closest angle and the highest clarity as the second video in the corresponding window.

[0023] As another embodiment, the present invention provides a live video processing device, which comprises the following modules:

[0024] A first object acquisition module, configured to acquire attribute information of a first live video currently played by a mobile terminal application, where the attribute information includes first object information of the first live video;

[0025] An associated video acquisition module, configured to acquire a plurality of second videos associated with the first live video and their attribute information according to the attribute information, and the attribute information of each second video includes the first object information;

[0026] A video type acquisition module, configured to acquire the video type of each second video. If the number of live videos in the second videos is greater than a first threshold, the three-dimensional live module is executed; otherwise, the video split screen module is executed;

[0027] A three-dimensional live module, configured to display a first trigger button on a first live interface of the first live video and detect a first trigger operation of a user on the first trigger button; generate a three-dimensional live interface of the first object based on the first trigger operation;

[0028] A video split screen module, configured to display a second trigger button on a first live interface of the first live video and detect a second trigger operation of a user on the second trigger button; acquire a first preset number of the second videos based on the second trigger operation to generate a video split screen interface.

[0029] As a preferred implementation manner, the three-dimensional live module and the video split screen module further include:

[0030] Display a third trigger button on the three-dimensional live interface and the video split screen interface;

[0031] Detect a third trigger operation of a user on the third trigger button, and return to the interface of the first live video based on the third trigger operation.

[0032] As a preferred implementation manner, generating the three-dimensional live interface of the first object based on the first trigger operation further includes:

[0033] Acquire angle information of the first object in the live videos of the second videos relative to the first object in the first live video, select a second preset number of the second videos with uniformly distributed position angles in the angle information and the first live video to synthesize the three-dimensional live interface of the first object, and the three-dimensional live interface uses the perspective where the first object is located in the first live video as the first perspective.

[0034] As a preferred implementation manner, it further includes:

[0035] Receive the user's sliding operation on the three-dimensional live broadcast interface, and switch the perspective of the first object to the second perspective based on the sliding operation;

[0036] After the second perspective is played for more than a preset duration, switch the three-dimensional live broadcast interface to the interface of the second video corresponding to the second perspective.

[0037] As a preferred implementation manner, obtaining a first preset number of the second videos based on the second trigger operation to generate a video split screen interface further includes:

[0038] Obtain the clarity information of the first object relative to the first live video and / or the angle information of the first object in the live video of the second video, and select a third preset number of the second videos and the first live video with evenly distributed position angles and / or higher clarity in the angle information to generate a video split screen interface.

[0039] As a preferred implementation manner, it further includes:

[0040] Obtain the playing duration of the second video in the video split screen interface;

[0041] After any one of the second videos finishes playing, switch the corresponding split screen window to play a third video, and the third video has the same or closest angle and the highest clarity as the second video in the corresponding window.

[0042] As another embodiment, the present invention provides a live video processing system, and the system executes the live video processing method described above.

[0043] As another embodiment, the present invention provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program, and the computer program executes the live video processing method.

[0044] It can be seen that the above-mentioned live video processing method of the present invention obtains a plurality of second videos associated with the current live video, and enters the three-dimensional live broadcast interface or the video split screen interface based on the user's trigger operation, so as to enable the user to obtain information about the first object of the current live video more comprehensively and multi-dimensionally, improving the objectivity, comprehensiveness and three-dimensional sense of the user's observation of the first object, and avoiding being misled. Description of the Drawings

[0045] To more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments and the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0046] Figure 1 It is a schematic diagram of the steps of a live video processing method of the present invention.

[0047] Figure 2 It is a schematic diagram of the structure of a live video processing device of the present invention. Specific embodiments

[0048] The following further illustrates the embodiments of the present invention with reference to the drawings.

[0049] Embodiment 1:

[0050] As Figure 1 shown, the present invention provides a live video processing method, and the method includes the following steps:

[0051] Step S1, obtaining attribute information of a first live video currently played by a mobile terminal application, where the attribute information includes first object information of the first live video; it should be noted that the mobile terminal in the present invention can be a terminal device such as a mobile phone, and the application can be an Internet live platform application such as Douyin or Kuaishou. For example, in step S1, a short video of Douyin is currently being played on the current foreground interface of the mobile phone, and the user can switch short videos by swiping up or down; at this time, the attribute information of the first live video, that is, the short video, can be obtained. Among them, the attribute information can include the video length, video resolution, protagonist in the video, and publisher identity information of the first live video. The protagonist can be the main character, main scenery, etc. in the live video, which are objects presenting the main content of the video, such as the continuously presented person in the video. Among them, the obtaining method of the first object can be to analyze the content of the live video, capture the content in the video frames of the live video, and continuously track multiple objects in multiple consecutive video frames to obtain one or more objects that occupy the main position and appear continuously in these video frames as the first object; the first object information can be the identification information of the first object, such as the name and ID of the object. The first object information can also be information such as the avatar of the first object extracted from the video frame that can uniquely identify the identity of the first object, which is not limited here.

[0052] Step S2: Obtain several second videos associated with the first live video and their attribute information according to the attribute information. The attribute information of each second video includes the first object information. It should be noted that after extracting the first object of the first video, it is necessary to search for second videos from several videos related to the first video that can be recommended by the application and have the first object. The specific search method can be to extract second videos with the first object information from several videos recommended by the application. The extraction method here can be the same as the method for extracting the first object information from the first video, which will not be elaborated here. After extracting the corresponding target objects from these videos, compare these target objects with the first object information, and determine whether these target objects are the same as the first object by judging the similarity of these target objects to the first object. And use the second videos corresponding to these target objects that are the same as the first object as the second videos for subsequent steps.

[0053] Step S3: Obtain the video type of each second video. If the number of live videos in the second video is greater than the first threshold, execute Step S4; otherwise, execute Step S5. It should be noted that the second videos obtained in the above Step S2 can be videos that other users in the application are currently live streaming, or short videos that have been published by users in the application. Therefore, the video type of the second video can be a live video, a short video, or even other types of videos, such as user comment videos. Thus, the types of video types are not limited here. Further, since different types of videos have different impacts on users' comprehensive and multi-dimensional understanding of the first object, it is necessary to consider the impact of video types on users separately. Specifically, live videos among these video types are more helpful for users to comprehensively and multi-dimensionally understand the first object. Therefore, more live videos need to be screened out from these second videos. For example, if the first threshold is four, when the number of live videos in the second video is greater than or equal to 4, it can basically meet the users' multi-dimensional understanding of the first object, and at this time, execute Step S4; conversely, if the number of live videos among these second videos is less than four, since the basic condition for multi-dimensional understanding of the first object cannot be met, Step S5 is executed.

[0054] Step S4, display a first trigger button on the first live interface of the first live video, and detect a first trigger operation of the user on the first trigger button; generate a three-dimensional live interface of the first object based on the first trigger operation; it should be noted that since the number of live videos of the second video cameras that simultaneously live broadcast the first object can meet the conditions for multi-dimensional observation of the first object, therefore, a first trigger button can be displayed on the interface of the first live video of the mobile terminal application. If the user performs a trigger operation on the first trigger button, such as a single click or a double click, the current first live interface will be switched to a three-dimensional live interface, and the three-dimensional live interface takes the first object as the protagonist, so as to facilitate the user to observe the first object from the three-dimensional interface. The three-dimensional live interface is formed by fusing multiple second videos of the live broadcast type. The specific fusion method can be AI fusion, or matte extraction, etc., which is not limited here. Further, the user can switch perspectives on the three-dimensional live interface through touch operations such as swiping to observe the first object from different angles, thereby realizing a more comprehensive and multi-dimensional observation and understanding of the first object by the user; more importantly, since the publishers or creators of these second videos of the live broadcast type are usually different from the publisher or creator of the first video, the first object in these second videos is likely to be presented to the user truthfully without excessive post-processing such as beauty filters. Therefore, the user can switch the first object published by multiple publishers through the above-mentioned swiping operation, which is convenient for the user to observe the first object from multiple angles in the live videos published by these publishers. Thus, the presentation of the first object is more real and credible, avoiding being misled by the single content presented on the first live interface, and helping the user to observe and understand the first object more rationally.

[0055] Step S5: Display a second trigger button on the first live interface of the first live video, and detect the user's second trigger operation on the second trigger button; obtain a first preset number of the second videos based on the second trigger operation to generate a video split screen interface. It should be noted that since the number of live video types in the second video is less than 4 at this time and a three-dimensional live interface cannot be established, only the secondary selection method can be used to facilitate the user to more comprehensively understand the first object. For example, the first object can be presented from multiple videos in a split screen manner. Specifically, by displaying a second trigger button on the first live interface of the first live video and monitoring whether the user performs a trigger operation on the second trigger button, such as a single click or double click operation. The second trigger button can be a different trigger button from the first trigger button. For example, trigger buttons with different positions, colors, and shapes on the first live interface can be used for the user to distinguish. In addition, the first trigger button and the second trigger button can be the same trigger button, so that the user can trigger to enter the three-dimensional live interface or the video split screen interface through different trigger operations. For example, by swiping the trigger button to the left, the three-dimensional live interface can be entered, and by swiping the trigger button to the right, the video split screen interface can be entered. The present invention does not limit the presentation form of the first trigger button and the second trigger button.

[0056] Further, after the user performs a second trigger operation on the second trigger button, the application switches from the first live interface to the video split screen interface; the video split screen interface is a split screen interface of a first preset number of the second videos. These second videos can only include short videos with the first object, or the second videos can simultaneously include short videos with the first object and live videos, which is not limited here. Preferably, the second videos displayed on the video split screen interface can be the second videos selected from multiple second videos. For example, they can be selected according to the number of views, or according to the number of likes, or according to the video clarity. The specific selection method is not limited. Preferably, the second videos used in the three-dimensional live interface are not the videos published by the publisher of the first live video to avoid interference from the publisher to the user's understanding of the first object.

[0057] It can be seen that the above live video processing method of the present invention obtains multiple second videos associated with the current live video, and enters the three-dimensional live interface or the video split screen interface based on the user's trigger operation, so as to enable the user to obtain information about the first object of the current live video more comprehensively and multi-dimensionally, improving the objectivity, comprehensiveness, and three-dimensional sense of the user's observation of the first object and avoiding being misled.

[0058] As a preferred implementation, the steps S4 and S5 further include:

[0059] Display a third trigger button on the three-dimensional live broadcast interface and the video split-screen interface; detect a third trigger operation of the user on the third trigger button, and return to the interface of the first live video based on the third trigger operation. It should be noted that, for the convenience of the user to return from the three-dimensional live broadcast interface or the locked video split-screen interface to the first live broadcast interface, a third trigger button can be displayed on the switched three-dimensional live broadcast interface and the video split-screen interface, and the trigger operation of the user on the third trigger button can be monitored. If the user triggers the third trigger button, such as a click or double-click trigger operation, then return to the first live broadcast interface of the first live video based on the third trigger operation, so as to facilitate the user to continue watching the first live video.

[0060] As a preferred implementation, in step S4, generating the three-dimensional live broadcast interface of the first object based on the first trigger operation further includes:

[0061] As a preferred implementation, it further includes:

[0062] Receive a sliding operation of the user on the three-dimensional live broadcast interface, and switch the viewing angle of the first object to a second viewing angle based on the sliding operation; after playing for a preset duration in the second viewing angle, switch the three-dimensional live broadcast interface to the interface of the second video corresponding to the second viewing angle. It should be noted that the angle of the first object presented in each second live video corresponds to a different viewing angle. Therefore, when the user switches the viewing angle of the first object through the sliding operation of the three-dimensional live broadcast interface, the user may be more inclined to understand the first object from other viewing angles. For example, if the preset duration is one minute, then after the user switches from the first viewing angle to the second viewing angle on the three-dimensional live broadcast interface for one minute, it indicates that the user is more inclined to observe the first object from the second viewing angle. At this time, preferably, the present invention not only provides a viewing angle switching function of the first object on the three-dimensional live broadcast interface, but also a function of switching from the three-dimensional live broadcast interface to the second video interface corresponding to the second viewing angle, so that the user can switch from the three-dimensional live broadcast interface to the live broadcast interface of the second viewing angle, thereby realizing a seamless switching of the live broadcast interface for the first object without returning to the interface of the first live video, thus providing a way to exit from the three-dimensional live broadcast interface and meeting the user's switching requirements for the first live video and the second live video with the first object.

[0063] As a preferred implementation, in step S5, obtaining the first preset number of the second videos based on the second trigger operation to generate a video split-screen interface further includes:

[0064] Obtain the clarity information of the first object relative to the first live video and / or the angle information of the first object in the live video of the second video, and select the third preset number of the second videos and the first live video with evenly distributed position angles and / or higher clarity in the angle information to generate a video split-screen interface. It should be noted that although the video split-screen interface cannot observe the first object from a three-dimensional perspective, or the second videos of the live broadcast type in the second video do not meet the basic conditions for synthesizing the three-dimensional live broadcast interface due to too small a number or too few angle distributions, in order to allow the user to observe the first object from multiple angles as much as possible and have a more comprehensive understanding of the first object, preferably, obtain the clarity information of the first object relative to the first live video and / or the angle information of the first object in the live video of the second video, select the third preset number of the second videos and the first live video with evenly distributed position angles and / or higher clarity in the angle information to generate a video split-screen interface, and allow the user to observe the first object from multiple angles as much as possible to have a more comprehensive understanding of the first object.

[0065] As a preferred embodiment, it further includes:

[0066] Obtain the playing duration of the second video in the video split-screen interface; after any one of the second videos finishes playing, switch the corresponding split-screen window to play the third video, and the third video has the same or closest angle and the highest clarity as the second video in the corresponding window. It should be noted that since the playing durations of different second videos in the video interface are often different, when the second videos are displayed in the corresponding split-screen windows, some of the second videos will finish playing first. To avoid the second video that has finished playing occupying the split-screen window due to stopping playback, preferably, obtain the playing duration of the second video in the video split-screen interface, that is, the playing duration of the second video played in each split-screen window; after any one of the second videos finishes playing, switch the corresponding split-screen window to play the third video, and the third video has the same or closest angle as the second video in the corresponding window so that the user can observe the first object from a similar angle; or, the third video has the highest clarity with the second video in the corresponding window to improve the user's viewing experience.

[0067] Embodiment 2:

[0068] As Figure 2 shown, the present invention provides a live video processing device, and the device includes the following modules:

[0069] The first object acquisition module is used to acquire the attribute information of the first live video currently played by the mobile terminal application, and the attribute information includes the first object information of the first live video. It should be noted that the mobile terminal in the present invention can be a terminal device such as a mobile phone, and the application can be an Internet live platform application such as Douyin or Kuaishou. For example, in the first object acquisition module, the mobile phone's current foreground interface is playing a Douyin short video, and the user can switch short videos by swiping up or down; at this time, the attribute information of the first live video, that is, the short video, can be acquired. Among them, the attribute information can include the video length, video resolution, the protagonist in the video, and the publisher's identity information of the first live video. The protagonist can be the main person, main scenery, etc. in the live video, which are objects presenting the main content of the video, such as the continuously presented person in the video. Among them, the acquisition method of the first object can be to analyze the content of the live video, capture the content in the video frames of the live video, and continuously track multiple objects in multiple consecutive video frames to obtain one or more objects that occupy the main position and appear continuously in these video frames as the first object; the first object information can be the identification information of the first object, such as the name or ID of the object. The first object information can also be information such as the avatar of the first object extracted from the video frame that can uniquely identify the identity of the first object, which is not limited here.

[0070] The associated video acquisition module is used to acquire several second videos associated with the first live video and their attribute information according to the attribute information. The attribute information of each second video includes the first object information. It should be noted that after extracting the first object of the first video, it is necessary to search for the second video from several videos associated with the first video and having the first object that can be recommended by the application. The specific search method can be to extract the second video with the first object information from several videos recommended by the application; the extraction method here can be the same as the method of extracting the first object information from the first video, which will not be elaborated here. After extracting the corresponding target objects from these videos, compare the first object information of these target objects, and determine whether these target objects are the same as the first object by judging the similarity of the first objects of these target objects; and use the second videos corresponding to these target objects that are the same as the first object as the second videos for subsequent steps.

[0071] The video type acquisition module is used to acquire the video type of each of the second videos. If the number of live videos in the second videos is greater than the first threshold, the three-dimensional live module is executed; otherwise, the video split-screen module is executed. It should be noted that the second videos acquired by the above-mentioned associated video acquisition module can be the videos that other users in the application are currently live-streaming, or the short videos that have been published by users in the application. Therefore, the video type of the second videos can be live videos, short videos, or even include other types of videos, such as user comment videos. Thus, the types of video types are not limited here. Further, since different types of videos have different impacts on users' comprehensive and multi-dimensional understanding of the first object, the impacts of video types on users need to be considered separately. Specifically, among these video types, live videos are more helpful for users to comprehensively and multi-dimensionally understand the first object. Therefore, more live videos need to be screened out from these second videos. For example, if the first threshold is four, when the number of live videos in the second videos is greater than or equal to 4, it can basically meet the users' multi-dimensional understanding of the first object, and at this time, the three-dimensional live module is executed; conversely, if the number of live videos in these second videos is less than four, since the basic condition for multi-dimensional understanding of the first object cannot be met, the video split-screen module is executed.

[0072] A three-dimensional live broadcast module is used to display a first trigger button on the first live broadcast interface of the first live broadcast video and detect a first trigger operation of a user on the first trigger button; generate a three-dimensional live broadcast interface of the first object based on the first trigger operation; it should be noted that since the number of live broadcast videos of the second video cameras that simultaneously conduct live broadcasts of the first object can meet the conditions for multi-dimensional observation of the first object, therefore, a first trigger button can be displayed on the interface of the first live broadcast video of the mobile terminal application. If the user performs a trigger operation on the first trigger button, such as a single click or a double click, the current first live broadcast interface will be switched to a three-dimensional live broadcast interface, and the three-dimensional live broadcast interface takes the first object as the protagonist, so as to facilitate the user to observe the first object from a three-dimensional interface. The three-dimensional live broadcast interface is formed by fusing multiple second videos of the live broadcast type. The specific fusion method can be AI fusion, or matte extraction, etc., which is not limited here. Further, the user can switch perspectives on the three-dimensional live broadcast interface through touch operations such as swiping to observe the first object from different angles, thereby realizing a more comprehensive and multi-dimensional observation and understanding of the first object by the user; more importantly, since these second videos of the live broadcast type are not live broadcast by the publisher of the first video, these second videos may not be post-processed such as beautification and are presented to the user truthfully. Thus, the user can switch the first object published by multiple publishers through the above-mentioned swiping operation, facilitating the user to observe the first object from multiple angles in the live broadcast videos published by these publishers. As a result, the presentation of the first object is more real and credible, avoiding being misled by the single content presented on the first live broadcast interface, and helping the user to observe and understand the first object more rationally.

[0073] A video split-screen module is used to display a second trigger button on the first live interface of the first live video and detect a second trigger operation of the user on the second trigger button; based on the second trigger operation, obtain a first preset number of the second videos to generate a video split-screen interface. It should be noted that since the number of live videos of the live broadcast type in the second video is less than 4 at this time and a three-dimensional live interface cannot be established, only the secondary selection method can be used to facilitate the user to more comprehensively understand the first object. For example, the first object can be presented from multiple videos in a split-screen manner. Specifically, by displaying a second trigger button on the first live interface of the first live video and monitoring whether the user performs a trigger operation on the second trigger button, such as a click or double-click operation. The second trigger button can be a different trigger button from the first trigger button. For example, it can be a trigger button with different positions, colors, and shapes on the first live interface for the user to distinguish; in addition, the first trigger button and the second trigger button can be the same trigger button, so that the user can trigger to enter the three-dimensional live interface or the video split-screen interface through different trigger operations. For example, by swiping the trigger button to the left, the three-dimensional live interface can be entered, and by swiping the trigger button to the right, the video split-screen interface can be entered. The present invention does not limit the presentation form of the first trigger button and the second trigger button. Further, after the user performs a second trigger operation on the second trigger button, the application switches from the first live interface to the video split-screen interface; the video split-screen interface is a split-screen interface of a first preset number of the second videos, and these second videos can only include short videos with the first object, or the second videos can simultaneously include short videos with the first object and live videos, which is not limited here. Preferably, the second videos displayed on the video split-screen interface can be second videos selected from multiple second videos. For example, they can be selected according to the number of views, or according to the number of likes, or according to the video clarity. The specific selection method is not limited. Preferably, the second videos used in the three-dimensional live interface are not the videos published by the publisher of the first live video to avoid interference from the publisher to the user's understanding of the first object.

[0074] It can be seen that the above-mentioned live video processing device of the present invention obtains a plurality of second videos associated with the current live video and enters the three-dimensional live interface or the video split-screen interface based on the user's trigger operation, so that the user can obtain information about the first object of the current live video more comprehensively and multi-dimensionally, improving the objectivity, comprehensiveness, and three-dimensional sense of the user's observation of the first object and avoiding being misled.

[0075] As a preferred implementation manner, the three-dimensional live module and the video split-screen module further include:

[0076] Display a third trigger button on the three-dimensional live broadcast interface and the video split-screen interface; detect a third trigger operation of the user on the third trigger button, and return the interface of the first live video based on the third trigger operation. It should be noted that, for the convenience of the user to return from the three-dimensional live broadcast interface or the locked video split-screen interface to the first live broadcast interface, a third trigger button can be displayed on the switched three-dimensional live broadcast interface and the video split-screen interface, and the trigger operation of the user on the third trigger button can be monitored. If the user triggers the third trigger button, such as a click or double-click trigger operation, then return to the first live broadcast interface of the first live video based on the third trigger operation, so that the user can continue to watch the first live video.

[0077] As a preferred implementation manner, in the three-dimensional live broadcast module, generating the three-dimensional live broadcast interface of the first object based on the first trigger operation further includes:

[0078] Obtain the angular information of the first object in the live video of the second video relative to the first object in the first live video. Select the second preset number of the second videos and the first live video with evenly distributed position angles in the angular information to synthesize the three-dimensional live interface of the first object. The three-dimensional live interface takes the perspective where the first object is located in the first live video as the first perspective. It should be noted that the three-dimensional live interface, that is, the 3D live interface of the first object, needs to live broadcast the first object from multiple different angles to construct the three-dimensional live interface. Therefore, preferably, taking the angle of the first object in the first live video as the benchmark, the second videos of the live broadcast types covering all 360-degree angles of the first object as much as possible are used as the screening conditions. For example, when the second preset number is 3 and the angle of the first object in the first live video is 0 degrees, the second videos of the live broadcast types with the angles of the first object being 90 degrees and 180 degrees are respectively selected as one of the synthesized videos of the three-dimensional live interface. It should be emphasized that the above angles can also be the second videos with an angle difference less than the preset degree to meet the need for synthesizing the three-dimensional live interface. Since the number of the second videos of the live broadcast type may be large, in order to improve the efficiency of video synthesis and avoid excessive occupation of memory resources, preferably, the third predicted number of the second videos is selected from multiple second videos for video synthesis. Since the synthesized videos of the three-dimensional live interface include both the first video and the second video, users can observe the first object from the perspective of the publisher of the first video and can also observe the first object from different angles of multiple second videos. Since the publishers of the second videos are different from the publisher of the first video, or even the publishers of multiple second videos are all different, users can observe and understand the first object from multiple perspectives and the perspectives of multiple publishers, so that users' understanding of the first object is more objective and real. For example, since there is excessive post-processing such as beautification in the first object in the first video, while there is mild beautification or natural face in the first object in multiple second videos, the first object understood by users through the three-dimensional live interface is more objectively and real without it.

[0079] As a preferred implementation manner, it further includes:

[0080] Receive the user's sliding operation on the three-dimensional live broadcast interface, and switch the perspective of the first object to the second perspective based on the sliding operation; after playing for more than a preset duration in the second perspective, switch the three-dimensional live broadcast interface to the interface of the second video corresponding to the second perspective. It should be noted that the angle of the first object presented in each of the second live videos corresponds to a different perspective. Therefore, when the user switches the perspective of the first object through the sliding operation on the three-dimensional live broadcast interface, the user may be more inclined to understand the first object from other perspectives. For example, if the preset duration is one minute, after the user switches from the first perspective to the second perspective on the three-dimensional live broadcast interface for one minute, it indicates that the user is more inclined to observe the first object from the second perspective. At this time, preferably, the present invention not only provides a function for switching the perspective of the first object on the three-dimensional live broadcast interface, but also a function for switching from the three-dimensional live broadcast interface to the interface of the second video corresponding to the second perspective, so that the user can switch from the three-dimensional live broadcast interface to the live broadcast interface of the second perspective, thereby achieving a seamless switch of the live broadcast interface for the first object without returning to the interface of the first live video, thus providing more ways to exit from the three-dimensional live broadcast interface and greatly meeting the user's switching requirements for the first live video and the second live video with the first object.

[0081] As a preferred implementation manner, in the video split-screen module, based on the second trigger operation, obtain a first preset number of the second videos to generate a video split-screen interface, and further include:

[0082] Obtain the clarity information of the first object in the live video of the second video relative to the first live video and / or the angle information of the first object, and select a third preset number of the second videos and the first live video with evenly distributed position angles and / or higher clarity in the angle information to generate a video split-screen interface. It should be noted that although the first object cannot be observed from a three-dimensional perspective in the video split-screen interface, or the second videos of the live broadcast type in the second videos do not meet the basic conditions for synthesizing the three-dimensional live broadcast interface due to too few quantities or too few angle distributions, in order to allow the user to observe the first object from multiple angles as much as possible and have a more comprehensive understanding of the first object, preferably, obtain the clarity information of the first object in the live video of the second video relative to the first live video and / or the angle information of the first object, and select a third preset number of the second videos and the first live video with evenly distributed position angles and / or higher clarity in the angle information to generate a video split-screen interface, so as to allow the user to observe the first object from multiple angles as much as possible and have a more comprehensive understanding of the first object.

[0083] As a preferred implementation manner, it further includes:

[0084] Obtain the playing duration of the second video in the video split-screen interface; after any of the second videos finishes playing, switch the corresponding split-screen window to play the third video, where the third video has the same angle as or is closest to and has the highest clarity as the second video in the corresponding window. It should be noted that since the playing durations of different second videos in the video interface are often different, when the second videos are displayed in the corresponding split-screen windows, some of the second videos will finish playing first. To prevent the finished-playing second videos from occupying the split-screen windows due to stopping playback, preferably, obtain the playing duration of the second video in the video split-screen interface, that is, the playing duration of the second video played in each split-screen window; after any of the second videos finishes playing, switch the corresponding split-screen window to play the third video, where the third video has the same angle as or is closest to the second video in the corresponding window, so that the user can observe the first object from a similar angle; or, the third video has the highest clarity as the second video in the corresponding window to improve the user's viewing experience.

[0085] Embodiment Three:

[0086] As another embodiment, the present invention provides a live video processing system, and the system executes the live video processing method described in Embodiment One.

[0087] The present invention provides a live video processing method. By obtaining a plurality of second videos associated with the current live video and entering a three-dimensional live interface or a video split-screen interface based on the user's trigger operation, it enables the user to obtain information about the first object of the current live video more comprehensively and multi-dimensionally, improving the objectivity, comprehensiveness, and three-dimensional sense of the user's observation of the first object and avoiding being misled.

[0088] Those skilled in the art can understand that the present invention includes devices for performing one or more of the operations described in this application. These devices can be specifically designed and manufactured for the required purposes, or they can also include known devices in general-purpose computers. These devices have computer programs stored therein, and these computer programs are selectively activated or reconstructed. Such computer programs can be stored in a device (e.g., a computer) readable medium or in any type of medium suitable for storing electronic instructions and coupled to the bus respectively. The computer readable medium includes, but is not limited to, any type of disk (including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic cards, or optical cards. That is, the readable medium includes any medium that stores or transmits information in a form readable by a device (e.g., a computer).

[0089] Those skilled in the art can understand that each block in these structural diagrams and / or block diagrams and / or flowcharts, as well as combinations of blocks in these structural diagrams and / or block diagrams and / or flowcharts, can be implemented with computer program instructions. Those skilled in the art can understand that these computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing methods to implement, so that the schemes specified in the blocks or multiple blocks of the structural diagrams and / or block diagrams and / or flowcharts disclosed in the present invention are executed by the processor of the computer or other programmable data processing methods.

[0090] Those skilled in the art can understand that the various operations, methods, steps, measures, and schemes in the processes discussed in the present invention can be alternated, changed, combined, or deleted. Further, other steps, measures, and schemes in the various operations, methods, and processes discussed in the present invention can also be alternated, changed, rearranged, decomposed, combined, or deleted. Further, the steps, measures, and schemes in the prior art that are the same as those disclosed in the various operations, methods, and processes of the present invention can also be alternated, changed, rearranged, decomposed, combined, or deleted.

[0091] The above are only embodiments of the present invention, and do not thereby limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present invention, or directly or indirectly applied in other related technical fields, shall equally be included within the patent protection scope of the present invention.

Claims

1. A live video processing method, characterized in that, The method includes the following steps: Step S1, obtaining attribute information of a first live video currently played by a mobile terminal application, where the attribute information includes first object information of the first live video; Step S2, obtaining a plurality of second videos associated with the first live video and their attribute information according to the attribute information, and the attribute information of each second video includes the first object information; Step S3, obtaining the video type of each second video. If the number of live videos in the second video is greater than a first threshold, execute Step S4; otherwise, execute Step S5; Step S4, displaying a first trigger button on a first live interface of the first live video, and detecting a first trigger operation of a user on the first trigger button; Generating a three-dimensional live interface of the first object based on the first trigger operation; Step S5, displaying a second trigger button on the first live interface of the first live video, and detecting a second trigger operation of a user on the second trigger button; Obtaining a first preset number of the second videos based on the second trigger operation to generate a video split screen interface; Among them, in Step S4, generating the three-dimensional live interface of the first object based on the first trigger operation further includes: obtaining angle information of the first object in the live video of the second video relative to the first object of the first live video, and selecting a second preset number of the second videos and the first live video with evenly distributed position angles in the angle information to synthesize the three-dimensional live interface of the first object, and the three-dimensional live interface uses the perspective where the first object is located in the first live video as the first perspective.

2. The live video processing method according to claim 1, wherein Steps S4 and S5 further include: Displaying a third trigger button on the three-dimensional live interface and the video split screen interface; Detecting a third trigger operation of a user on the third trigger button, and returning to the interface of the first live video based on the third trigger operation.

3. The live video processing method according to claim 1, wherein It further includes: Receiving a sliding operation of a user on the three-dimensional live interface, and switching the perspective of the first object to a second perspective based on the sliding operation; After playing for a preset duration in the second perspective, switching the three-dimensional live interface to the interface of the second video corresponding to the second perspective.

4. The live video processing method according to claim 1, wherein In Step S5, obtaining a first preset number of the second videos based on the second trigger operation to generate a video split screen interface further includes: Obtaining clarity information of the first object in the live video of the second video relative to the first live video and / or angle information of the first object, and selecting a third preset number of the second videos and the first live video with evenly distributed position angles and / or higher clarity in the angle information to generate a video split screen interface.

5. The live video processing method according to claim 4, wherein It further includes: Obtaining the playing duration of the second video in the video split screen interface; After any second video finishes playing, switching the corresponding split screen window to play a third video, and the third video has the same or closest angle and the highest clarity as the second video in the corresponding window.

6. A live video processing device, characterized in that, The device includes the following modules: The first object acquisition module is used to acquire the attribute information of the first live video currently played by the mobile terminal application, and the attribute information includes the first object information of the first live video; The associated video acquisition module is used to acquire a plurality of second videos associated with the first live video and their attribute information according to the attribute information, and the attribute information of each second video includes the first object information; The video type acquisition module is used to acquire the video type of each second video. If the number of live videos in the second video is greater than the first threshold, the three-dimensional live module is executed; otherwise, the video split-screen module is executed; The three-dimensional live module is used to display a first trigger button on the first live interface of the first live video and detect a first trigger operation of the user on the first trigger button; Generate a three-dimensional live interface of the first object based on the first trigger operation; The video split-screen module is used to display a second trigger button on the first live interface of the first live video and detect a second trigger operation of the user on the second trigger button; Acquire a first preset number of the second videos based on the second trigger operation to generate a video split-screen interface; Among them, in the three-dimensional live module, generating a three-dimensional live interface of the first object based on the first trigger operation further includes: acquiring the angle information of the first object in the live video of the second video relative to the first object in the first live video, and selecting a second preset number of the second videos and the first live video with evenly distributed position angles in the angle information to synthesize the three-dimensional live interface of the first object, and the three-dimensional live interface takes the perspective where the first object is located in the first live video as the first perspective.

7. The live video processing device according to claim 6, characterized in that The three-dimensional live module and the video split-screen module further include: Display a third trigger button on the three-dimensional live interface and the video split-screen interface; Detect a third trigger operation of the user on the third trigger button, and return to the interface of the first live video based on the third trigger operation.

Images