Video processing method and device, and electronic device

Abstract

The present disclosure provides a video processing method, device and electronic equipment, the method comprises: acquiring a plurality of first play delays of a plurality of users watching a first video and a plurality of first viewing angles of the plurality of users watching the first video, the first play delay being the delay between the play progress of the first video watched by the user and the current push progress of the first video; based on the plurality of first play delays and the preset interval duration, the first viewing angles are processed by angle classification to obtain a plurality of viewing angle sets, the first play delay of the first viewing angle associated in the viewing angle set is within the play delay interval associated with the viewing angle set, and the play delay interval is an interval determined based on the preset interval duration; based on the first viewing angle in each viewing angle set, determine the fusion viewing angle associated with each viewing angle set to obtain a plurality of fusion viewing angles; based on the plurality of fusion viewing angles, predict the predicted viewing angle of the plurality of users in the future period. Improve the accuracy of user viewing angle prediction.

Description

Technical Field

[0001] This disclosure relates to the field of image processing technology, and more particularly to a video processing method, apparatus, and electronic device. Background Technology

[0002] Terminal devices can predict the user's perspective in the next time period and then play full-view videos from the user's perspective (such as panoramic videos, virtual reality (VR) videos, etc.).

[0003] Currently, terminal devices can acquire a user's real-time perspective within a historical period and use this perspective to predict the user's perspective in future periods. For example, a terminal device can acquire multiple real-time perspectives of a user within a historical period and perform linear regression on these perspectives to predict the user's perspective in future periods. However, some of the user's perspectives within a historical period are unrelated to watching full-view video (e.g., random movement of the user's perspective), leading to lower accuracy in predicting the user's perspective. Summary of the Invention

[0004] This disclosure provides a video processing method, apparatus, and electronic device to solve the technical problem of low accuracy in user perspective prediction in the prior art.

[0005] In a first aspect, this disclosure provides a video processing method, the method comprising:

[0006] Multiple first playback delays and multiple first perspectives of multiple users watching the first video are obtained, wherein the first playback delay is the delay between the playback progress of the first video watched by the user and the current streaming progress of the first video;

[0007] Based on the multiple first playback delays and preset interval durations, the multiple first viewpoints are classified to obtain multiple viewpoint sets. The first playback delay associated with the first viewpoint within the viewpoint set is within the playback delay interval associated with the viewpoint set. The playback delay interval is an interval determined based on the preset interval duration.

[0008] Based on the first perspective within each perspective set, determine the fusion perspective associated with each perspective set to obtain multiple fusion perspectives;

[0009] Based on the multiple fused perspectives, predict the predicted perspectives of the multiple users in the future time period.

[0010] Secondly, this disclosure provides a video processing apparatus, which includes an acquisition module, a classification module, a determination module, and a prediction module, wherein:

[0011] The acquisition module is used to acquire multiple first playback delays of multiple users watching the first video and multiple first perspectives of the multiple users watching the first video, wherein the first playback delay is the delay between the playback progress of the first video watched by the user and the current streaming progress of the first video;

[0012] The classification module is used to perform perspective classification processing on the multiple first perspectives based on the multiple first playback delays and preset interval durations to obtain multiple perspective sets. The first playback delay associated with the first perspective in the perspective set is within the playback delay interval associated with the perspective set, and the playback delay interval is an interval determined based on the preset interval duration.

[0013] The determining module is used to determine the fusion view associated with each view set based on the first view within each view set, thereby obtaining multiple fusion views;

[0014] The prediction module is used to predict the predicted perspective of the multiple users in a future time period based on the multiple fused perspectives.

[0015] Thirdly, embodiments of this disclosure provide an electronic device including: a processor and a memory;

[0016] The memory stores computer-executed instructions;

[0017] The processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the video processing methods described in the first aspect above and various possible aspects of the first aspect.

[0018] Fourthly, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the video processing methods described in the first aspect and various possible aspects thereof.

[0019] Fifthly, embodiments of this disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the video processing methods described in the first aspect above and various possible aspects of the first aspect.

[0020] This disclosure provides a video processing method, apparatus, and electronic device. The electronic device acquires multiple first playback delays and multiple first viewpoints of multiple users watching a first video. Based on the multiple first playback delays and a preset interval, the multiple first viewpoints are classified to obtain multiple viewpoint sets. The first playback delay associated with each first viewpoint within a viewpoint set falls within a playback delay interval defined by the preset interval. Based on the first viewpoints within each viewpoint set, a fused viewpoint associated with each viewpoint set is determined, resulting in multiple fused viewpoints. Based on these fused viewpoints, the predicted viewpoints of multiple users in a future time period are predicted. According to this method, the electronic device can predict the predicted viewpoints of multiple users in a future time period based on their multiple first viewpoints. Since the multiple first viewpoints of multiple users accurately reflect the content that users are interested in in the first video, the influence of viewpoints unrelated to watching the first video on viewpoint prediction is reduced, thus improving the accuracy of user viewpoint prediction. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 A schematic diagram of a first video provided in an embodiment of this disclosure;

[0023] Figure 2 This is a schematic diagram illustrating a process for determining a first video according to an embodiment of the present disclosure;

[0024] Figure 3 A playback delay diagram provided for an embodiment of this disclosure;

[0025] Figure 4 This is a schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0026] Figure 5 A flowchart illustrating a video processing method provided in an embodiment of this disclosure;

[0027] Figure 6 A first-view schematic diagram provided for an embodiment of this disclosure;

[0028] Figure 7 A schematic diagram of a playback delay interval provided in an embodiment of this disclosure;

[0029] Figure 8This is a schematic flowchart of a method for determining a set of viewpoints provided in an embodiment of the present disclosure;

[0030] Figure 9 This is a schematic diagram illustrating a process for determining a set of viewpoints according to an embodiment of the present disclosure;

[0031] Figure 10 This is a schematic diagram of a video processing method provided in an embodiment of the present disclosure;

[0032] Figure 11 This is a schematic diagram of the structure of a video processing apparatus provided in an embodiment of the present disclosure; and,

[0033] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0034] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0035] For ease of understanding, the concepts involved in the embodiments of this disclosure will be explained below.

[0036] Terminal device: A device with wireless transceiver capabilities. Terminal devices can be deployed on land, including indoors or outdoors, handheld, wearable, or vehicle-mounted; they can also be deployed on water (such as on ships). These terminal devices can include mobile phones, tablets, computers with wireless transceiver capabilities, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, vehicle-mounted terminal devices, wireless terminals in self-driving vehicles, wireless terminal devices in remote medical care, wireless terminal devices in smart grids, wireless terminal devices in transportation safety, wireless terminal devices in smart cities, wireless terminal devices in smart homes, wearable terminal devices, etc. The terminal equipment involved in the embodiments of this disclosure may also be referred to as a terminal, user equipment (UE), access terminal equipment, vehicle-mounted terminal, industrial control terminal, UE unit, UE station, mobile station, mobile station, remote station, remote terminal equipment, mobile device, UE terminal equipment, wireless communication equipment, UE agent, or UE device, etc. The terminal equipment may also be fixed or mobile.

[0037] First video: The first video can be a full-view video. Optionally, the full-view video can be a video from any angle. For example, full-view videos can include virtual reality (VR) videos, panoramic videos, 180-degree view videos, etc. Optionally, the first video can be a live full-view video. For example, the first video can be a full-view video recorded in real time by a user through a terminal device. The terminal device can send the real-time recorded full-view video to an electronic device in real time, so that the electronic device can send the real-time recorded full-view video to other users' terminal devices.

[0038] Below, in conjunction with Figure 1 The first video of the present disclosure embodiment will be described.

[0039] Figure 1 This is a schematic diagram of a first video provided as an embodiment of this disclosure. Please refer to [link / reference]. Figure 1The system includes a cube model and image frames from a first video. The first video can be a VR video, and its image frames include top, back, bottom, left, front, and right side areas. The image in the top area of ​​the first video image frames can be mapped to the front of the cube model, the image in the back area to the back of the cube model, the image in the bottom area to the bottom of the cube model, the image in the left side area to the left side of the cube model, the image in the front area to the front of the cube model, and the image in the right side area to the right side of the cube model.

[0040] Optionally, the electronic device can receive a video playback request from the terminal device and determine the first video based on the video playback request. For example, the terminal device can generate a video playback request based on a user's trigger operation on the terminal device and send the video playback request to the electronic device. For example, the terminal device can obtain the user's touch operation on the control of the first video, generate a video playback request corresponding to the first video, and send the video playback request to the terminal device.

[0041] Below, in conjunction with Figure 2 The process of determining the first video by the electronic device is explained.

[0042] Figure 2 This is a schematic diagram illustrating a process for determining a first video according to an embodiment of this disclosure. Please refer to [link / reference]. Figure 2 This includes terminal devices and electronic devices. The terminal device displays a video playback page. The video playback page includes controls for video A, video B, and video C. When the user clicks the control for video A, the terminal device generates a video playback request, which includes an identifier for video A. The terminal device then sends the playback request for video A to the electronic device. Upon receiving the playback request for video A, the electronic device identifies the first video as video A.

[0043] First playback delay: The first playback delay can be the time difference between the user's current viewing position in the first video and the current streaming position of the first video. For example, due to differences in hardware, network parameters, and network status of each user's terminal device, the playback delay of the first video will vary for each user's terminal device. For instance, if the first video is a live video, and there is a 3-second difference between the user's current viewing position and the current streaming position of the live video, then the user's first playback delay is 3 seconds. For example, if the timestamp corresponding to the user's current viewing position in the live video is timestamp A, and the timestamp corresponding to the current streaming position is timestamp B, then the user's first playback delay is the duration corresponding to the difference between timestamp B and timestamp A.

[0044] Below, in conjunction with Figure 3 This section explains the multiple first playback delays experienced by multiple users watching the first video.

[0045] Figure 3 This is a schematic diagram illustrating a playback delay provided in an embodiment of this disclosure. Please refer to [link / reference]. Figure 3 This includes: the live stream of the first video, the viewing position of user A, and the viewing position of user B. The current stream in the live stream of the first video is the latest stream. The delay between the viewing position of user A and the current stream position is called playback delay A, and the delay between the viewing position of user B and the current stream position is called playback delay B. Playback delay A is the first playback delay for user A, and playback delay B is the first playback delay for user B.

[0046] In related technologies, terminal devices can predict a user's viewing angle in the next time period, thereby determining the full-view video content to be played in that period. Currently, terminal devices can acquire a user's real viewing angle within historical time periods and use this historical perspective to predict the user's viewing angle in future time periods. For example, a terminal device can acquire multiple historical real viewing angles of a user within a historical time period and process these angles using linear regression to predict the user's viewing angle in future time periods. However, some of a user's viewing angles within historical time periods are irrelevant to watching full-view video. For instance, when a user twists their neck, their viewing angle shifts, but this shift is unrelated to the content of the full-view video. Predicting the user's future viewing angle based on this shift would result in low accuracy.

[0047] To address the problems in related technologies, this disclosure provides a video processing method. An electronic device acquires multiple first playback delays and multiple first viewpoints of multiple users watching a first video. Based on the multiple first playback delays, it determines multiple playback timestamps associated with the multiple first viewpoints. Based on a preset interval and the multiple playback timestamps, it classifies the multiple first viewpoints to obtain multiple viewpoint sets. Based on the first viewpoints within each viewpoint set, it determines a fused viewpoint associated with each viewpoint set to obtain multiple fused viewpoints. Based on the multiple fused viewpoints, it predicts the predicted viewpoints of multiple users in future time periods and sends the predicted viewpoints to the terminal device. Thus, since the fused viewpoints corresponding to each viewpoint set are determined from multiple first viewpoints, the multiple fused viewpoints can accurately reflect the content that multiple users are interested in regarding the first video, reducing the impact of viewpoints unrelated to watching the first video on viewpoint prediction, thereby improving the accuracy of user viewpoint prediction.

[0048] Below, in conjunction with Figure 4 The application scenarios of the embodiments of this disclosure will be described.

[0049] Figure 4 This is a schematic diagram illustrating an application scenario provided by an embodiment of this disclosure. Please refer to [link / reference]. Figure 4 The system includes image frames of a first video, an electronic device, and a terminal device. The first video can be a VR video, and the image frames of the first video include a top area, a back area, a bottom area, a left side area, a front area, and a right side area.

[0050] Please see Figure 4 If the electronic device predicts that the user's viewing angle is in the frontal area, the electronic device sends the video of the frontal area of ​​the first video to the terminal device. The terminal device receives the video of the frontal area and can play it on the display screen. The electronic device can predict the viewing angles of multiple users in the future based on multiple first-viewpoints of multiple users, thereby reducing the influence of viewing angles unrelated to watching the first video on the viewing angle prediction and improving the accuracy of user viewing angle prediction.

[0051] It should be noted that, Figure 2 This is merely an example illustrating one application scenario of the embodiments of this disclosure, and is not intended to limit the application scenarios of the embodiments of this disclosure.

[0052] The technical solutions of this disclosure and how they solve the aforementioned technical problems will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of this disclosure will now be described with reference to the accompanying drawings.

[0053] Figure 5 This is a schematic flowchart illustrating a video processing method provided in an embodiment of this disclosure. Please refer to [link / reference]. Figure 5 The method may include:

[0054] S501, Obtain multiple first playback delays and multiple first-person perspectives of multiple users watching the first video.

[0055] The execution subject of this disclosure can be an electronic device or a video processing device installed in an electronic device. The video processing device can be implemented in software or a combination of software and hardware. Optionally, the electronic device can be any device with data processing and communication functions. For example, the electronic device can be a server or similar device.

[0056] Optionally, the first-person perspective can include the user's viewpoint when watching the first video. For example, the first-person perspective can include the center and range of the user's viewpoint when watching the first video. For instance, when a user watches a 360-degree VR video through a terminal device, if the user is watching the front area of ​​the VR video, the user's first-person perspective can be the front area or part of the front area of ​​the VR video (the user's viewpoint may not cover the entire front area); if the user is watching the top area of ​​the VR video, the user's first-person perspective is the top area or part of the top area of ​​the VR video.

[0057] Below, in conjunction with Figure 6 It explains things from the user's first-person perspective.

[0058] Figure 6 This is a first-view schematic diagram provided for an embodiment of this disclosure. Please refer to... Figure 6 It includes: image frames of a first video and the user's first-person perspective. The first video can be a VR video, and its image frames can include a top area, a back area, a bottom area, a left side area, a front area, and a right side area. The user's first-person perspective covers a portion of the left side area and a portion of the front area of ​​the image frames.

[0059] Optionally, the first playback delay is the delay between the playback progress of the first video watched by the user and the current streaming progress of the first video. For example, if the timestamp corresponding to the playback progress of the live video watched by the user is timestamp A, and the timestamp corresponding to the current streaming progress of the live video is timestamp B, then the first playback delay is the time difference between timestamp B and timestamp A.

[0060] Optionally, for any one of multiple users, the electronic device can obtain the first playback delay and first viewpoint of the user watching the first video according to the following feasible implementation: receiving video playback information sent by the terminal device, and determining the first playback delay and first viewpoint based on the video playback information. Optionally, the video playback information may include the first playback delay and first viewpoint of the user watching the first video. For example, the terminal device can periodically send the delay of the live video being watched by the user and the user's viewpoint while watching the live video to the electronic device. After receiving the video playback information, the electronic device can obtain the first playback delay and first viewpoint.

[0061] S502. Based on multiple first playback delays and preset interval durations, perform perspective classification processing on multiple first perspectives to obtain multiple perspective sets.

[0062] Optionally, the viewpoint set may include at least one first viewpoint. For example, the viewpoint set may include the first viewpoint of one user, or it may include the first viewpoints of multiple users; this disclosure does not limit this.

[0063] Optionally, a set of viewpoints can be associated with a playback delay interval, and the first playback delay associated with the first viewpoint within the viewpoint set is within the playback delay interval associated with the viewpoint set. For example, if the playback delay interval associated with the viewpoint set is a delay of 0 seconds to 1 second (relative to the current streaming position of the first video), then the delay for all users corresponding to the first viewpoints in the viewpoint set to watch the first video is between a delay of 0 seconds and a delay of 1 second.

[0064] Optionally, the preset interval duration can be any duration. For example, the preset interval duration can be 1 second, 2 seconds, etc. Optionally, the preset interval duration can also be a duration determined based on the current network parameters. For example, if the current network condition is good, the preset interval duration can be smaller; if the current network condition is poor, the preset interval duration can be larger. Optionally, the preset interval duration can be any preset duration, and this embodiment does not limit this. Optionally, the playback delay interval is an interval determined based on the preset interval duration.

[0065] Optionally, the overlap rate of playback delay intervals between multiple viewpoint sets is less than or equal to a preset threshold. For example, if the preset threshold is 0.1, and the playback delay interval associated with viewpoint set A is a delay of 1 second to 2 seconds, then the playback delay interval associated with viewpoint set B can be a delay of 0 seconds to 1.1 seconds, and the playback delay interval associated with viewpoint set C can be a delay of 1.9 seconds to 3 seconds.

[0066] Optionally, when the preset threshold is 0, the playback delay regions between multiple viewpoint sets do not overlap. For example, an electronic device performs viewpoint classification processing on multiple first viewpoints based on multiple first playback delays, resulting in viewpoint set A, viewpoint set B, and viewpoint set C. The playback delay range associated with viewpoint set A is from 0 seconds to 1 second, the playback delay range associated with viewpoint set B can be from 1 second to 2 seconds, and the playback delay range associated with viewpoint set C can be from 2 seconds to 4 seconds.

[0067] Below, in conjunction with Figure 7 This section explains the playback delay range of the viewpoint set.

[0068] Figure 7 This is a schematic diagram illustrating a playback delay interval provided in an embodiment of this disclosure. Please refer to [link / reference]. Figure 7 This includes the live stream of the first video. The current stream in the live stream of the first video is the latest stream. The playback delay range for viewpoint set A is from 0 seconds to 2 seconds, and the playback delay range for viewpoint set B is from 2 seconds to 4 seconds.

[0069] S503. Based on the first perspective within each perspective set, determine the fusion perspective associated with each perspective set to obtain multiple fusion perspectives.

[0070] Optionally, the fused perspective can be the perspective resulting from the fusion of first perspectives within a perspective set. Optionally, for any given perspective set, the electronic device can obtain multiple fused perspectives based on the following feasible implementation: obtaining the number of first perspectives within the perspective set, and determining the fused perspectives associated with the perspective set based on the number of perspectives. For example, if perspective set A includes 10 users' first perspectives and perspective set B includes 15 users' first perspectives, then the number of perspectives associated with perspective set A is 10, and the number of perspectives associated with perspective set B is 15.

[0071] Optionally, based on the number of viewpoints, the fused viewpoints associated with the viewpoint set can be determined in the following two ways:

[0072] Case 1: The number of viewpoints is 1.

[0073] If the number of viewpoints is 1, then the first viewpoint within the viewpoint set is determined as the merged viewpoint. For example, if the viewpoint set includes only one user's first viewpoint, the electronic device determines that first viewpoint as the merged viewpoint of the viewpoint set.

[0074] Case 2: The number of viewpoints is greater than 1.

[0075] If the number of viewpoints is greater than one, then based on the multiple first playback delays associated with multiple first viewpoints, the weights of the multiple viewpoints associated with each first viewpoint are determined. Based on the multiple first viewpoints and their weights, the merged viewpoint is determined. Optionally, the weight of a viewpoint associated with a first viewpoint is the weight of that first viewpoint among all first viewpoints in the viewpoint set. For example, if the viewpoint set includes first viewpoint A, first viewpoint B, and first viewpoint C, the viewpoint weight of first viewpoint A can be 0.5, the viewpoint weight of first viewpoint B can be 0.3, and the viewpoint weight of first viewpoint C can be 0.2.

[0076] Optionally, the electronic device can determine the multiple view weights associated with multiple first-viewpoints according to the following feasible implementation: determining the first time difference between the first playback delay corresponding to each first-viewpoint and the left endpoint of the playback delay interval corresponding to the viewpoint set. For example, if the playback delay interval associated with the viewpoint set is a delay of 1 second to 2 seconds, and if the first playback delay corresponding to first-viewpoint A is 1.2 seconds and the first playback delay corresponding to first-viewpoint B is 1.6 seconds, then the first time difference corresponding to first-viewpoint A is 0.2 seconds and the first time difference corresponding to first-viewpoint B is 0.6 seconds.

[0077] Optionally, a first preset relationship between the first time difference and the viewpoint weights is obtained. Optionally, the first preset relationship may include at least one time difference and the viewpoint weights corresponding to each time difference. For example, the first preset relationship may be as shown in Table 1:

[0078] Table 1

[0079] jet lag Perspective weight Time difference 1 Weight 1 Time difference 2 Weight 2 Time difference 3 Weight 3 …… ……

[0080] It should be noted that Table 1 is only an example to illustrate the first preset relationship, and is not a limitation on the first preset relationship.

[0081] Optionally, the viewpoint weight corresponding to the first viewpoint is determined based on the first preset relationship and the first time difference. For example, if the first time difference corresponding to the first viewpoint is time difference 1, then the viewpoint weight of the first viewpoint in the viewpoint set is weight 1; if the first time difference corresponding to the first viewpoint is time difference 2, then the viewpoint weight of the first viewpoint in the viewpoint set is weight 2; if the first time difference corresponding to the first viewpoint is time difference 3, then the viewpoint weight of the first viewpoint in the viewpoint set is weight 3.

[0082] Optionally, the first playback delay is inversely proportional to the viewpoint weight. For example, the larger the first playback delay of the first viewpoint within the viewpoint set, the smaller the viewpoint weight; conversely, the smaller the first playback delay of the first viewpoint within the viewpoint set, the smaller the viewpoint weight. For instance, if the first playback delay of the first viewpoint within the viewpoint set is large, it indicates that the first time difference of the first viewpoint is large, meaning the first viewpoint is an older viewpoint, and therefore, the viewpoint weight is smaller. Conversely, if the first playback delay of the first viewpoint within the viewpoint set is small, it indicates that the first time difference of the first viewpoint is small, meaning the first viewpoint is a newer viewpoint, and therefore, the viewpoint weight is larger.

[0083] Optionally, the fused perspective is determined based on multiple first-person perspectives and their associated weights. Specifically, multiple sub-perspectives are determined based on these multiple first-person perspectives and their associated weights. For example, if the first video is a 360-degree live stream, each first-person perspective has a corresponding angle in space. The sub-perspectives corresponding to each first-person perspective can be determined using their spatial angle and weight. For instance, if first-person perspective A has a spatial angle of 30 degrees and first-person perspective B has a spatial angle of 60 degrees, with a weight of 0.5 for both perspectives, then the sub-perspective corresponding to first-person perspective A is 15 degrees, and the sub-perspective corresponding to first-person perspective B is 30 degrees.

[0084] Optionally, multiple sub-viewpoints can be fused to obtain a fused viewpoint. For example, if the sub-viewpoint corresponding to the first viewpoint A in the viewpoint set is 15 degrees and the sub-viewpoint corresponding to the first viewpoint B is 30 degrees, then the fused viewpoint associated with the viewpoint set is 45 degrees.

[0085] Optionally, when determining the fused perspective corresponding to the latest view set, the fused perspective corresponding to the latest view set can be determined based on at least one first perspective within the latest view set. When determining the fused perspective corresponding to other view sets, since the other view sets are older view sets, the fused perspective corresponding to a view set newer than the other view sets will also affect the fused perspective within the other view sets. When determining the fused perspective of an older view set, the fused perspective of the older view set can also be determined based on the fused perspective of the newer view set (the perspective weight can be a fixed value or an arbitrary value) and multiple first perspectives. For example, if view set A is newer than view set B (the playback delay interval of view set A can be connected to or not connected to the playback delay interval of view set B; this embodiment does not limit this), and if the fused perspective corresponding to view set A is fused perspective A, and view set B includes first perspective A and first perspective B, then the electronic device can determine the fused perspective of view set B based on fused perspective A, first perspective A and first perspective B, and the perspective weight corresponding to each perspective.

[0086] S504: Based on multiple fusion perspectives, predict the prediction perspectives of multiple users in the future time period.

[0087] Optionally, the electronic device can predict the predicted perspectives of multiple users in the future based on multiple fused perspectives. For example, the electronic device can perform linear regression processing on multiple fused perspectives (e.g., linear regression, monotonic interval linear regression, or weighted linear regression) to obtain the predicted perspectives of multiple users in the future.

[0088] Optionally, the electronic device can process multiple fusion perspectives using a first model to obtain multiple predicted perspectives for users in future time periods. For example, the electronic device can input multiple fusion perspectives into the first model, and the first model can output a predicted perspective corresponding to the multiple fusion perspectives. Optionally, the first model can be learned from multiple sets of samples, which can include multiple sample fusion perspectives and sample predicted perspectives corresponding to the multiple sample fusion perspectives. For example, by obtaining sample fusion perspective 1, sample fusion perspective 2, and sample fusion perspective 3, as well as sample predicted perspective 1 corresponding to sample fusion perspective 1, sample fusion perspective 2, and sample fusion perspective 3, a set of samples is obtained, which includes sample fusion perspective 1, sample fusion perspective 2, sample fusion perspective 3, and sample predicted perspective 1. This method can obtain multiple sets of samples.

[0089] Optionally, if the executing entity of this embodiment is an electronic device, after the electronic device determines the predicted viewing angle of multiple users in a future time period, the electronic device can send the predicted viewing angle to multiple terminal devices of the multiple users, so that the multiple terminal devices can predict the user's viewing angle through the predicted viewing angle. For example, in practical applications, after the electronic device determines the predicted viewing angle, it can send the predicted viewing angle to each terminal device. The terminal device can determine the user's viewing angle in a future time period based on the predicted viewing angle and the user's historical viewing angle obtained by the terminal device. In this way, the predicted viewing angle is used to assist the terminal devices in predicting the user's viewing angle in a future time period, so that each user can independently determine the viewing angle in a future time period, thereby improving the accuracy of viewing angle prediction.

[0090] Optionally, if the execution subject of this embodiment is an electronic device, after the electronic device determines the predicted viewpoints of multiple users in the future time period, the electronic device can determine the target content that the users will focus on in the future time period based on the predicted viewpoints, and then obtain the video corresponding to the target content, and send the video corresponding to the target content to the terminal device so that the terminal device can play the video. In this way, the resources of the terminal device can be saved, the video playback delay can be reduced, and the accuracy and efficiency of video playback can be improved.

[0091] It should be noted that the electronic devices in this embodiment are merely examples to illustrate the execution subject of this embodiment and are not intended to limit the execution subject of this embodiment. The execution subject of this embodiment may also be a terminal device or other device with data processing capabilities.

[0092] This disclosure provides a video processing method in which an electronic device acquires multiple first playback delays and multiple first viewpoints of multiple users watching a first video. Based on the multiple first playback delays, the multiple first viewpoints are classified to obtain multiple viewpoint sets. The overlap rate of playback delay intervals between the multiple viewpoint sets is less than or equal to a preset threshold. The number of viewpoints within each viewpoint set is obtained. If the number of viewpoints is 1, the first viewpoint within the viewpoint set is determined as a fused viewpoint. If the number of viewpoints is greater than 1, multiple viewpoint weights associated with the multiple first playback delays are determined. A fused viewpoint is then determined based on the multiple first viewpoints and their weights. Based on the multiple fused viewpoints, the predicted viewpoints of multiple users in future time periods are predicted. Thus, since the fused viewpoints corresponding to each viewpoint set are determined from multiple first viewpoints, the multiple fused viewpoints can accurately reflect the content that multiple users are interested in regarding the first video, reducing the impact of viewpoints unrelated to watching the first video on viewpoint prediction, thereby improving the accuracy of user viewpoint prediction.

[0093] exist Figure 2Based on the embodiments shown, the following, in conjunction with Figure 8 The method described above for classifying multiple first viewpoints based on multiple first playback delays and preset interval durations to obtain multiple viewpoint sets is explained.

[0094] Figure 8 This is a schematic flowchart illustrating a method for determining a set of viewpoints according to an embodiment of this disclosure. Please refer to... Figure 8 The method process includes:

[0095] S801. Based on multiple first playback delays, determine multiple playback timestamps associated with multiple first-person perspectives.

[0096] Optionally, the playback timestamp associated with the first-person perspective can be the timestamp of the first video currently being watched by the user. For example, if the screen played by the terminal device is the screen of the first video at time A, then the playback timestamp associated with the user's first-person perspective can be the timestamp corresponding to time A; if the screen played by the terminal device is the screen of the first video at time B, then the playback timestamp associated with the user's first-person perspective can be the timestamp corresponding to time B.

[0097] Optionally, the electronic device can determine multiple playback timestamps associated with multiple first-person perspectives based on the following feasible implementation: obtaining the current playback timestamp of the first video. For example, the current playback timestamp can be the timestamp corresponding to the moment of the current streaming frame of the first video. For example, if the first video is a live video, and the live video has been recorded up to moment A, then the current playback timestamp of the first video is the timestamp corresponding to moment A; if the live video has been recorded up to moment B, then the current playback timestamp of the first video is the timestamp corresponding to moment B.

[0098] Based on multiple first playback delays and the current playback timestamp, multiple playback timestamps associated with multiple first-person perspectives are determined. For example, the difference between the current playback timestamp and the first playback delay corresponding to the first-person perspective is determined as the playback timestamp associated with the first-person perspective. For example, if the current playback timestamp is timestamp A and the first playback delay corresponding to the first-person perspective is 3 seconds, then the playback timestamp associated with the first-person perspective is the timestamp 3 seconds before timestamp A.

[0099] S802. Based on the preset interval duration and multiple playback timestamps, classify and process multiple first-person perspectives to obtain multiple perspective sets.

[0100] Optionally, the electronic device can obtain multiple viewpoint sets based on the following feasible implementation: determining the order of multiple first-person perspectives based on multiple playback timestamps. For example, the larger the playback timestamp corresponding to a first-person perspective, the earlier it is arranged in the order; the smaller the playback timestamp corresponding to a first-person perspective, the later it is arranged in the order. For example, if the playback timestamp of first-person perspective A is timestamp A, and the playback timestamp of first-person perspective B is timestamp B, if timestamp A is greater than timestamp B, then first-person perspective A is arranged before first-person perspective B.

[0101] Based on a preset interval, multiple first-person perspectives are categorized according to their arrangement, resulting in multiple perspective sets. For example, if the preset interval is 2 seconds, the electronic device divides the first-person perspectives into two perspective sets according to their arrangement, with each perspective set corresponding to a playback delay interval of 2 seconds. For instance, multiple users' first-person perspectives include perspective A, perspective B, perspective C, and perspective D. Perspective A has a delay of 0.2 seconds, perspective B has a delay of 0.5 seconds, perspective C has a delay of 1.3 seconds, and perspective D has a delay of 1.6 seconds. If the preset interval is 1 second, the electronic device will determine perspectives A and B as one perspective set and perspectives C and D as another perspective set.

[0102] Below, in conjunction with Figure 9 The process of determining the set of viewpoints is explained.

[0103] Figure 9 This is a schematic diagram illustrating a process for determining a set of viewpoints according to an embodiment of this disclosure. Please refer to... Figure 9 This includes a first-person perspective. The first-person perspective includes perspectives A, B, C, D, E, and F. The delay for perspective A is 0.3 seconds, for perspective B it is 0.8 seconds, for perspective C it is 1.1 seconds, for perspective D it is 1.2 seconds, for perspective E it is 1.8 seconds, and for perspective F it is 2.5 seconds.

[0104] Please see Figure 9 If the preset interval is 1 second, multiple first-person perspectives are classified into three sets: perspective set A, perspective set B, and perspective set C. Perspective set A includes perspectives A and B; perspective set B includes perspectives C, D, and E; and perspective set C includes perspective F. The playback delay range for perspective set A is 0 to 1 second, for perspective set B it is 1 to 2 seconds, and for perspective set C it is 2 to 3 seconds. This allows for accurate classification of multiple first-person perspectives, thereby improving the accuracy of user perspective prediction.

[0105] This disclosure provides a method for determining a set of viewpoints. Based on multiple first playback delays, multiple playback timestamps associated with multiple first viewpoints are determined. Based on a preset interval duration and the multiple playback timestamps, the multiple first viewpoints are classified to obtain multiple set of viewpoints. In this way, the electronic device can divide multiple first viewpoints into multiple set of viewpoints with equal consecutive playback delay intervals, thereby improving the accuracy of determining the set of viewpoints and improving the accuracy of viewpoint prediction.

[0106] Based on any of the above embodiments, the following, in conjunction with Figure 10 The process of the above video processing method will be explained.

[0107] Figure 10 This is a schematic diagram illustrating a video processing method provided in an embodiment of this disclosure. Please refer to [link / reference]. Figure 10 This includes terminal devices and electronic devices. The terminal device displays a video playback page. The video playback page includes controls for video A, video B, and video C. When the user clicks the control for video A, the terminal device generates a video playback request, which includes an identifier for video A. The terminal device then sends the playback request for video A to the electronic device. Upon receiving the playback request for video A, the electronic device identifies the first video as video A.

[0108] Please see Figure 10 The electronic device can acquire multiple first playback delays and multiple first-person perspectives from multiple users watching video A. The first-person perspectives include perspectives A, B, C, D, E, and F. The delay for perspective A is 0.3 seconds, for perspective B it is 0.8 seconds, for perspective C it is 1.1 seconds, for perspective D it is 1.2 seconds, for perspective E it is 1.8 seconds, and for perspective F it is 2.5 seconds.

[0109] Please see Figure 10 If the preset interval is 1 second, the multiple first-person perspectives are categorized to obtain perspective set A, perspective set B, and perspective set C. Perspective set A includes perspectives A and B, perspective set B includes perspectives C, D, and E, and perspective set C includes perspective F. The playback delay range for perspective set A is 0 to 1 second, for perspective set B it is 1 to 2 seconds, and for perspective set C it is 2 to 3 seconds.

[0110] Please see Figure 10The electronic device obtains a fused perspective A based on perspectives A and B in perspective set A, and a fused perspective B based on perspectives C, D, and E in perspective set B. Perspective F in perspective set C is then designated as fused perspective C. Using fused perspectives A, B, and C, the electronic device predicts the predicted perspectives of multiple users in future time periods. The electronic device can then send these predicted perspectives to the terminal device. In this way, because multiple first-person perspectives from multiple users can accurately reflect the content that users are interested in from the first video, the influence of perspectives unrelated to watching the first video on perspective prediction is reduced, thus improving the accuracy of user perspective prediction.

[0111] Figure 11 This is a schematic diagram of the structure of a video processing apparatus provided in an embodiment of this disclosure. Please refer to [link / reference]. Figure 11 The video processing device 110 includes an acquisition module 111, a classification module 112, a determination module 113, and a prediction module 114, wherein:

[0112] The acquisition module 111 is used to acquire multiple first playback delays of multiple users watching the first video and multiple first perspectives of the multiple users watching the first video, wherein the first playback delay is the delay between the playback progress of the first video watched by the user and the current streaming progress of the first video.

[0113] The classification module 112 is used to perform perspective classification processing on the multiple first perspectives based on the multiple first playback delays and preset interval durations to obtain multiple perspective sets. The first playback delay associated with the first perspective in the perspective set is within the playback delay interval associated with the perspective set, and the playback delay interval is an interval determined based on the preset interval duration.

[0114] The determining module 113 is used to determine the fusion view associated with each view set based on the first view within each view set, thereby obtaining multiple fusion views;

[0115] The prediction module 114 is used to predict the predicted perspective of the multiple users in a future time period based on the multiple fused perspectives.

[0116] According to one or more embodiments of this disclosure, the classification module 112 is specifically used for:

[0117] Based on the multiple first playback delays, multiple playback timestamps associated with the multiple first viewpoints are determined;

[0118] Based on the preset interval duration and the multiple playback timestamps, the multiple first perspectives are classified to obtain the set of multiple perspectives.

[0119] According to one or more embodiments of this disclosure, the classification module 112 is specifically used for:

[0120] Based on the multiple playback timestamps, determine the arrangement order of the multiple first-person perspectives;

[0121] Based on the preset interval duration, the multiple first perspectives are classified according to the arrangement order to obtain the multiple perspective sets.

[0122] According to one or more embodiments of this disclosure, the classification module 112 is specifically used for:

[0123] Get the current playback timestamp of the first video;

[0124] Based on the multiple first playback delays and the current playback timestamp, multiple playback timestamps associated with the multiple first perspectives are determined.

[0125] According to one or more embodiments of this disclosure, the determining module 113 is specifically used for:

[0126] Obtain the number of views of the first view within the view set;

[0127] Based on the number of viewpoints, the fused viewpoints associated with the viewpoint set are determined.

[0128] According to one or more embodiments of this disclosure, the determining module 113 is specifically used for:

[0129] If the number of viewpoints is 1, then the first viewpoint within the viewpoint set is determined as the fused viewpoint;

[0130] If the number of viewpoints is greater than 1, then the weights of multiple viewpoints associated with the multiple first viewpoints are determined based on the multiple first playback delays associated with the multiple first viewpoints; and the fused viewpoint is determined based on the multiple first viewpoints and the multiple viewpoint weights.

[0131] According to one or more embodiments of this disclosure, the determining module 113 is specifically used for:

[0132] Based on the multiple first perspectives and the multiple perspective weights associated with the multiple first perspectives, multiple sub-perspectives are determined;

[0133] The multiple sub-viewpoints are fused to obtain the fused viewpoint.

[0134] According to one or more embodiments of this disclosure, the first playback delay is inversely proportional to the viewpoint weight.

[0135] The video processing apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effect are similar, and will not be repeated here.

[0136] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Please refer to [link / reference]. Figure 12 The diagram illustrates a structural schematic of an electronic device 1200 suitable for implementing embodiments of the present disclosure. The electronic device 1200 can be an electronic device or an electronic device in general. The electronic device can include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), portable Android devices (PADs), portable media players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 12 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0137] like Figure 12 As shown, the electronic device 1200 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 1201, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1202 or a program loaded from a storage device 1208 into a random access memory (RAM) 1203. The RAM 1203 also stores various programs and data required for the operation of the electronic device 1200. The processing unit 1201, ROM 1202, and RAM 1203 are interconnected via a bus 1204. An input / output (I / O) interface 1205 is also connected to the bus 1204.

[0138] Typically, the following devices can be connected to I / O interface 1205: input devices 1206 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 1207 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1208 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1209. Communication device 1209 allows electronic device 1200 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 12An electronic device 1200 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0139] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1209, or installed from storage device 1208, or installed from ROM 1202. When the computer program is executed by processing device 1201, it performs the functions defined in the methods of embodiments of this disclosure.

[0140] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0141] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0142] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above embodiments.

[0143] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or electronic device. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0144] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0145] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0146] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0147] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0148] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0149] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0150] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0151] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the terminal device, application program, electronic device, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0152] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the terminal device.

[0153] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0154] It is understood that the data involved in this technical solution (including but not limited to the data itself, its acquisition, or its use) shall comply with the requirements of relevant laws, regulations, and provisions. Data may include information, parameters, and messages, such as flow control instructions.

[0155] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0156] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0157] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A video processing method, characterized in that, include: Multiple first playback delays and multiple first perspectives of multiple users watching the first video are obtained, wherein the first playback delay is the delay between the playback progress of the first video watched by the user and the current streaming progress of the first video; Based on the multiple first playback delays and preset interval durations, the multiple first viewpoints are classified to obtain multiple viewpoint sets. The first playback delay associated with the first viewpoint within the viewpoint set is within the playback delay interval associated with the viewpoint set. The playback delay interval is an interval determined based on the preset interval duration. Based on the first perspective within each perspective set, determine the fusion perspective associated with each perspective set to obtain multiple fusion perspectives; Based on the multiple fused perspectives, predict the predicted perspectives of the multiple users in future time periods; The step of determining the fused view associated with each view set based on the first view within each view set includes: Obtain the number of views of the first view within the view set; If the number of viewpoints is 1, then the first viewpoint within the viewpoint set is determined as the fused viewpoint; If the number of viewpoints is greater than 1, then the weights of multiple viewpoints associated with the multiple first viewpoints are determined based on the multiple first playback delays associated with the multiple first viewpoints; and the fused viewpoint is determined based on the multiple first viewpoints and the multiple viewpoint weights.

2. The method according to claim 1, characterized in that, Based on the multiple first playback delays and preset interval durations, the multiple first viewpoints are classified to obtain multiple viewpoint sets, including: Based on the multiple first playback delays, multiple playback timestamps associated with the multiple first viewpoints are determined; Based on the preset interval duration and the multiple playback timestamps, the multiple first perspectives are classified to obtain the set of multiple perspectives.

3. The method according to claim 2, characterized in that, The process of classifying the multiple first-viewpoints based on the preset interval duration and the multiple playback timestamps to obtain the set of multiple viewpoints includes: Based on the multiple playback timestamps, determine the arrangement order of the multiple first-person perspectives; Based on the preset interval duration, the multiple first perspectives are classified according to the arrangement order to obtain the multiple perspective sets.

4. The method according to claim 2, characterized in that, The determination of multiple playback timestamps associated with multiple first-viewpoints based on multiple first playback delays includes: Get the current playback timestamp of the first video; Based on the multiple first playback delays and the current playback timestamp, multiple playback timestamps associated with the multiple first perspectives are determined.

5. The method according to any one of claims 1-4, characterized in that, The fused perspective is determined based on the plurality of first perspectives and the plurality of perspective weights, including: Based on the multiple first perspectives and the multiple perspective weights associated with the multiple first perspectives, multiple sub-perspectives are determined; The multiple sub-viewpoints are fused to obtain the fused viewpoint.

6. The method according to claim 1, characterized in that, The first playback delay is inversely proportional to the viewpoint weight.

7. A video processing apparatus, characterized in that, It includes an acquisition module, a classification module, a determination module, and a prediction module, among which: The acquisition module is used to acquire multiple first playback delays of multiple users watching the first video and multiple first perspectives of the multiple users watching the first video, wherein the first playback delay is the delay between the playback progress of the first video watched by the user and the current streaming progress of the first video; The classification module is used to perform perspective classification processing on the multiple first perspectives based on the multiple first playback delays and preset interval durations to obtain multiple perspective sets. The first playback delay associated with the first perspective in the perspective set is within the playback delay interval associated with the perspective set, and the playback delay interval is an interval determined based on the preset interval duration. The determining module is used to determine the fusion view associated with each view set based on the first view within each view set, thereby obtaining multiple fusion views; The prediction module is used to predict the predicted perspective of the multiple users in a future time period based on the multiple fused perspectives; The determining module is specifically used to obtain the number of views of the first view within the view set; If the number of viewpoints is 1, then the first viewpoint within the viewpoint set is determined as the fused viewpoint; If the number of viewpoints is greater than 1, then the weights of multiple viewpoints associated with the multiple first viewpoints are determined based on the multiple first playback delays associated with the multiple first viewpoints; and the fused viewpoint is determined based on the multiple first viewpoints and the multiple viewpoint weights.

8. An electronic device, characterized in that, include: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the video processing method as described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the video processing method as described in any one of claims 1-6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the video processing method as described in any one of claims 1-6.

Images