Video processing method, apparatus, device, medium, and product

Abstract

Embodiments of the present disclosure provide a video processing method, device, equipment, medium and product. The method comprises: determining a continuous playing time length of a target video at a playing time in a target video playing process; determining first return information corresponding to the target video at the playing time according to the continuous playing time length, a first video cache time length corresponding to the playing time of the target video, and video attribute information of the target video; adjusting the first video cache time length based on at least one preset segment time length, determining second return information of a video segment corresponding to the at least one preset segment time length based on the continuous playing time length, the video attribute information, and the adjusted first video cache time length; and determining a target segment time length based on the second return information corresponding to the at least one preset segment time length and the first return information. The method can reduce waste of cache resources, reduce costs, and improve video playing fluency.

Description

Technical Field

[0001] This disclosure relates to the field of computer processing technology, and more particularly to a video processing method, apparatus, device, medium, and product. Background Technology

[0002] With the development of the internet, more and more users are watching various videos on mobile clients. When a user is watching a video on a client, they need to request the download of the video so that the client can receive and play the downloaded video.

[0003] Currently, methods for requesting video downloads typically include fixed-segment requests and dynamic-segment requests. Fixed-segment requests refer to requesting video segments of fixed duration each time; dynamic-segment requests usually determine whether to request new video segments and the size of the requested segments based on the current network speed and video caching status. However, when requesting video, the request information carries not only video data but also specific request headers and other information. The more communications there are, the fewer segments are downloaded per session, resulting in higher time costs and poor video playback smoothness; conversely, fewer communications result in more segments being downloaded per session, leading to higher wasted cached video. Summary of the Invention

[0004] This disclosure provides a video processing method, apparatus, device, medium, and product that can dynamically request cached video segments in segments based on the reward information corresponding to different preset segment durations during the playback of a target video. This reduces cache resource waste and lowers costs while improving video playback smoothness and ultimately enhancing the user experience.

[0005] In a first aspect, embodiments of this disclosure provide a video processing method, the method comprising:

[0006] During the playback of the target video, the duration of continuous playback of the target video at the playback time is determined based on the playback time of the target video.

[0007] Based on the continuous playback duration, the first video cache duration corresponding to the target video at the playback time, and the video attribute information of the target video, the first reward information corresponding to the target video at the playback time is determined; wherein, the first video cache duration is the duration of the cached but unplayed video.

[0008] The first video cache duration is adjusted based on at least one preset segment duration. Based on the continuous playback duration, the video attribute information, and the adjusted first video cache duration, second reward information is determined for the video segment corresponding to the at least one preset segment duration cached at the playback time. The video segment is a segment in the target video, and the starting cache time of the video segment is related to the first video cache duration before adjustment.

[0009] Based on the second report information corresponding to the at least one preset segment duration and the first report information, the target segment duration is determined, so as to determine the target video segment and cache it based on the target segment duration.

[0010] Secondly, embodiments of this disclosure also provide a video processing apparatus, the apparatus comprising:

[0011] The continuous playback duration determination module is used to determine the continuous playback duration of the target video at the playback time based on the playback time of the target video during the playback process;

[0012] The first reward information determination module is used to determine the first reward information corresponding to the target video at the playback time based on the continuous playback duration, the first video cache duration corresponding to the target video at the playback time, and the video attribute information of the target video; wherein, the first video cache duration is the duration of the cached but unplayed video.

[0013] The second reward information determination module is used to adjust the first video cache duration based on at least one preset segment duration, and determine the second reward information of the video segment corresponding to the at least one preset segment duration cached at the playback time based on the continuous playback duration, the video attribute information, and the adjusted first video cache duration; wherein, the video segment is a segment in the target video, and the starting cache time of the video segment is related to the first video cache duration before adjustment;

[0014] The target segment duration determination module is used to determine the target segment duration based on the second report information corresponding to the at least one preset segment duration and the first report information, so as to determine the target video segment based on the target segment duration and cache it.

[0015] Thirdly, embodiments of this disclosure also provide an electronic device, the electronic device comprising:

[0016] One or more processors;

[0017] Storage device for storing one or more programs.

[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the video processing method as described in any of the embodiments of this disclosure.

[0019] Fourthly, embodiments of this disclosure also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform the video processing method as described in any of the embodiments of this disclosure.

[0020] Fifthly, embodiments of this disclosure also provide a computer program product, including a computer program that, when executed by a processor, implements the video processing method as described in any of the embodiments of this disclosure.

[0021] The technical solution provided in this disclosure involves determining the continuous playback duration of the target video at the playback time during target video playback; determining first reward information corresponding to the target video at the playback time based on the continuous playback duration, the first video cache duration corresponding to the playback time, and the video attribute information of the target video; adjusting the first video cache duration based on at least one preset segment duration; and determining second reward information for video segments cached at least one preset segment duration at the playback time based on the continuous playback duration, video attribute information, and the adjusted first video cache duration; and determining second reward information for video segments cached at least one preset segment duration based on the second reward information for video segments cached at the playback time. The system uses both initial and final reward information to determine the target segment duration. Based on this duration, it identifies and caches the target video segment, resolving the issues of resource waste, high costs, and poor video playback smoothness caused by fixed and dynamic segmentation of video segment requests in existing technologies. The system determines the target segment duration based on the initial reward information corresponding to the target video at the playback moment, and the second reward information corresponding to video segments with different preset durations cached at the playback moment. This segmented request and caching of video segments based on the target segment duration reduces cache resource waste, lowers traffic costs, and ultimately improves video playback smoothness and ensures a better user experience. Attached Figure Description

[0022] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0023] Figure 1 This is a schematic flowchart of a video processing method provided in an embodiment of the present disclosure;

[0024] Figure 2This is a schematic diagram of the video processing method provided in the embodiments of this disclosure;

[0025] Figure 3 This is a schematic diagram provided by an embodiment of the present disclosure for characterizing and determining the duration of continuous playback;

[0026] Figure 4 This is a schematic flowchart of a video processing method provided in an embodiment of the present disclosure;

[0027] Figure 5 This is a schematic diagram of the structure of a video processing apparatus provided in an embodiment of the present disclosure;

[0028] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0029] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0030] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0031] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0032] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0033] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0034] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0035] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0036] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0037] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0038] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0039] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0040] Before introducing this technical solution, an exemplary application scenario can be provided. This technical solution can be applied to any scenario that requires segmented video download requests. For example, on certain platforms capable of acquiring videos, when watching a video on a client, video segments can be requested from the server for download during playback. In this case, the technical solution provided in the embodiments of this disclosure can be used to determine which segment needs to be downloaded and how much of it needs to be downloaded.

[0041] Figure 1 This is a flowchart illustrating a video processing method provided in an embodiment of the present disclosure. This embodiment is applicable to any scenario where video needs to be downloaded in segments. The method can be executed by a video processing device, which can be implemented in software and / or hardware. Optionally, it can be implemented by an electronic device, such as a mobile terminal, a PC, or a server.

[0042] like Figure 1 As shown, the method in this embodiment may specifically include:

[0043] S110. During the playback of the target video, determine the duration of continuous playback of the target video at the playback time.

[0044] The target video can refer to a video that is currently playing or whose playback information needs to be obtained. The playback time is related to the already played data within the target video. For example, the playback time can be a specific point in time during the playback of the target video, such as the current moment of playback. The continuous playback duration can refer to the length of time from a certain playback time until exiting video playback or reaching another specific playback time. For example, the continuous playback duration can be the predicted viewing time for continuing to watch the target video from the current playback time.

[0045] In this embodiment, the current playback time of the target video can be determined in real-time, periodically, or conditionally during the playback process, and this time can be used as the playback time. Furthermore, based on various factors, the duration of continued viewing of the target video by the target user from the playback time can be estimated, thereby predicting the revenue that the target video can generate at that playback time. These factors include, but are not limited to, the target user's user attribute information, the target video's video attribute information, current network information, the already played duration, and cached videos, etc.

[0046] For example, see Figure 2 The playback time can be defined as the end time of the already played data, and the duration between the playback time and the estimated exit time can be defined as the continuous playback duration. If the total duration of the target video is 10 minutes and the current playback time is 4 minutes, then the continuous playback duration of the target video from the current time can be the remaining 6 minutes; or 1 minute, 5 minutes, etc.

[0047] In this embodiment, determining the continuous playback duration of the target video at the playback time based on the playback time of the target video includes: determining the continuous playback duration of the target video at the playback time based on the playback time of the target video and a preset viewing duration distribution function.

[0048] The preset viewing duration distribution function can be used to characterize the probability of a target user watching the target video at different playback times, and can be used to estimate the duration a target user will continue watching the target video at any given playback time. The preset viewing duration distribution function is determined based on the target user and the target video. The target user refers to the user currently watching the target video.

[0049] In this embodiment, a preset viewing duration distribution function can be generated based on at least one of the target user's user attribute information, the target video's video attribute information, and the target user's historical video playback information. Furthermore, based on the preset viewing duration distribution function, the duration for which the target user will continue watching the target video at the current playback time can be estimated, thus obtaining the continuous playback duration.

[0050] For example, the probability of the event "the target user's viewing time for a single video playback is less than t" can be modeled using the Weibull distribution. Based on parameter estimation methods (such as maximum likelihood estimation, moment estimation, etc.), a corresponding preset viewing duration distribution function can be generated for each video on the video platform. Based on the preset viewing duration distribution function, the duration Δt for the target user to continue watching the target video at any playback time t is predicted according to a given probability p using the conditional probability formula. Δt is the continuous playback duration. See also... Figure 3 The horizontal axis represents the duration of the video, and the vertical axis represents the probability. Given the viewing probability of a target user at the playback time of the target video, the continuous playback duration can be estimated based on the preset viewing duration distribution function.

[0051] It should be noted that for each video or video category on the video platform, a preset viewing duration distribution function can be pre-determined for each target user within that video or video category to predict the duration the target user will continue watching the target video. It should also be noted that as video content becomes more diverse and user behavior changes, the preset viewing duration distribution function can be updated periodically.

[0052] S120. Based on the continuous playback duration, the first video cache duration corresponding to the target video at the playback time, and the video attribute information of the target video, determine the first reward information corresponding to the target video at the playback time.

[0053] The first video cache duration is the length of the cached but unplayed video, that is, the length of the cached but unplayed video before the playback time. For example, see [link to example]. Figure 2The time between the playback moment and the video cache location is the first video cache duration. Video attribute information can refer to information related to the target video, such as, but not limited to, the target video's resolution, aspect ratio, bitrate, frame rate, encoding format, color depth, audio attributes, and video type. The first reward information can be the reward information generated when playing the target video at the playback moment; that is, the reward information corresponding to the target video at the playback moment when the video segment corresponding to the current first video cache duration has been cached, and no other video segments have been cached. For example, the first reward information can be satisfaction, interaction attributes (such as the probability of liking, commenting, and sharing), conversion rate, revenue information, etc.; or, the first reward information can be the return on investment (ROI), used to reflect the proportional relationship between the cost invested in playing or downloading the target video at the current playback moment and the resulting revenue.

[0054] In this embodiment, a longer continuous playback duration indicates a higher level of interest in the target video content by the target user, or a stronger appeal of the target video, making the target user more willing to continue watching. Therefore, the first reward information corresponding to the target video at the playback time is considered to be greater. Alternatively, a longer first video buffering duration corresponding to the playback time indicates a lower likelihood of buffering or stuttering during playback, resulting in smoother viewing and a greater first reward information. Alternatively, higher resolution, higher bitrate, higher frame rate, or higher popularity of the target video's video attributes also indicate a greater first reward information. Furthermore, the first reward information corresponding to the target video at the playback time can be determined by combining the continuous playback duration, the first video buffering duration, and the target video's video attributes. This first reward information is then used to determine the video segment to be downloaded. For example, if the continuous playback duration is long, the first video buffering duration is sufficiently long, and the video attributes indicate good playback quality, then the first reward information can be determined to be high-reward information. Conversely, if the continuous playback duration is short, or the first video cache duration is insufficient, or the video attribute information indicates poor playback quality, then the first reward information can be determined to be low reward information.

[0055] S130. Adjust the first video cache duration based on at least one preset segment duration, and determine the second report information of the video segment corresponding to at least one preset segment duration cached at the playback time based on the continuous playback duration, video attribute information and the adjusted first video cache duration.

[0056] The preset segment duration can be any value within a pre-defined range. The video segment is a segment from the target video, and its starting cache time is related to the initial video cache duration before adjustment. The starting cache time of the video segment can be the end time of the initial video cache duration before adjustment. For example, the total duration of the target video is 10 minutes (0-10 minutes); the initial video cache duration before adjustment is 2 minutes (e.g., from the 3rd to the 5th minute within 0-10 minutes); the preset segment duration is 1 minute (from the 5th to the 6th minute within 0-10 minutes); the adjusted initial video cache duration is 3 minutes. The video segment corresponding to the preset segment duration is the segment between the 5th and 6th minute of the target video, with the 5th minute being the starting cache time of the video segment, which is also the end time of the initial video cache duration before adjustment. It should be noted that at least one preset segment duration is different, and at least one preset segment duration corresponds to the same starting cache time for the video segments. The second reward information is the reward information after caching a video segment corresponding to the first video cache duration, which has already been cached, and then caching another video segment corresponding to a preset segment duration.

[0057] In this embodiment, for each preset segment duration, the preset segment duration and the first video cache duration can be summed to obtain the adjusted first video cache duration. Further, at least one of the continuous playback duration, video attribute information, and the adjusted first video cache duration can be combined to determine the second reward information for caching the video segment corresponding to the preset segment duration at the playback time. Accordingly, the second reward information for caching the video segment corresponding to each preset segment duration at the playback time can be obtained. It should be noted that the method for determining the second reward information is similar to the method for determining the first reward information, and will not be elaborated here. It should also be noted that in this embodiment, the second reward information for caching the video segment corresponding to each preset segment duration at the playback time can be determined in parallel or sequentially, without limitation.

[0058] To ensure the reasonableness of the determined video segment duration each time, and to avoid it being too long or too short, the step size can be adjusted according to the preset segment duration range and the segment duration adjustment step size to determine at least one segment duration, and at least one segment duration can be used as at least one preset segment duration.

[0059] The segment duration range can be used to constrain the duration of a single downloaded video segment. The segment duration adjustment step size refers to the amount of time added or subtracted each time the segment duration is adjusted within the range of segment duration values. For example, the step size can be set to 1 second, 2 seconds, or 5 seconds, etc.

[0060] In this embodiment, the range of segment duration values ​​and the adjustment step size can be determined based on experience or various factors affecting segment duration. For example, factors affecting segment duration values ​​include, but are not limited to, target user viewing behavior information, network information, and video attribute information. Furthermore, starting from the initial value of the segment duration range, multiple segment durations can be generated sequentially, incrementing by the photo segment duration adjustment step size, until the end value of the segment duration range is reached or exceeded. The determined segment duration can be used as a preset segment duration to determine the second reward information for caching the video segment corresponding to the preset segment duration at the playback time.

[0061] For example, suppose the segment duration ranges from [d] to [1]. min d max ], d min d max These represent the minimum and maximum values ​​within the range of segment duration values. Each time a segment duration is determined, the range is iterated according to the segment duration adjustment step size. The preset segment duration is then limited to this range to find the preset segment duration that maximizes the positive reward gain information. For example, assuming the segment duration range is 5 to 15 seconds and the step size is 3 seconds, the generated segment durations can be 5 seconds, 8 seconds, 12 seconds, and 15 seconds respectively. The technical solution provided in this embodiment, by pre-setting the segment duration range and the segment duration adjustment step size, constrains the length of downloaded video segments, ensuring that each determined video segment meets the user's viewing needs while reducing video download costs.

[0062] S140. Determine the target segment duration based on the second report information and the first report information corresponding to at least one preset segment duration, so as to determine the target video segment based on the target segment duration and cache it.

[0063] In this embodiment, the target reward information for caching the video segment corresponding to the preset segment duration at the playback time can be evaluated based on the second reward information and the first reward information corresponding to the same preset segment duration. The preset segment duration corresponding to the largest target reward information can be used as the target segment length. The video segment corresponding to the target segment duration is then used as the target video segment. By combining the target video segment and its corresponding target segment duration, the target video segment is downloaded and cached on the user's local device or server, so that the corresponding video content can be quickly provided when the user requests video.

[0064] In this embodiment, determining the target segment duration based on the second reward information and the first reward information corresponding to at least one preset segment duration includes: determining the difference information between the second reward information and the first reward information corresponding to at least one preset segment duration to obtain reward gain information; and taking the preset segment duration corresponding to the maximum and positive reward gain information as the target segment duration.

[0065] The reward gain information refers to the incremental revenue generated by downloading a video segment of a preset duration. A positive value is a positive number greater than 0.

[0066] Specifically, the second and first reward information corresponding to the same preset segment duration can be interpolated, and the resulting difference can be used as the reward gain information corresponding to that preset segment duration. Correspondingly, the reward gain information corresponding to each preset segment duration can be obtained. Furthermore, the maximum reward gain information among each reward gain information can be taken. If the maximum reward gain information is positive, then the preset segment duration corresponding to the maximum reward gain information can be used as the target segment duration. The advantage of this setting is that it maximizes the reward gain information of the target video segment corresponding to the target segment duration, ensuring a positive reward and maximizing the benefits of segmented video downloading.

[0067] For example, the formula for calculating the reward gain information corresponding to the preset segment duration can be expressed as:

[0068] Where ΔROI represents the reward gain information (i.e., the difference information of the preset segment duration); Δt represents the continuous playback duration; τ represents the first video buffer duration; t0 represents the playback time; and d represents the preset segment duration. This indicates the second report information of the video segment corresponding to the preset segment duration d at the playback time; This indicates the first report information corresponding to the target video at playback time t0.

[0069] In this embodiment, a target optimization function can also be used. Based on a search algorithm (such as a greedy search), the step size is adjusted according to the segment duration within the range of segment duration values ​​to find a preset segment duration. The preset segment duration corresponding to the maximum reward gain information that is positive is then identified and used as the target segment duration. For example, the target optimization function can be expressed as: Where, d opt arg max represents the target segment duration; arg max represents maximization.

[0070] In this embodiment, determining and caching a target video segment based on the target segment duration includes: determining segment information of the target video segment according to the target segment duration and the first video caching duration; and sending the segment information to the downloader so that the downloader can perform the operation of obtaining the target video segment corresponding to the segment information.

[0071] The segment information may include the start and end time range of the target video segment within the target video. The downloader can be a server providing the target video; it can also be a component used to obtain video content from a video source (such as a server).

[0072] Specifically, the start time of the target video segment can be taken as the end time of the cached segment corresponding to the first video cache duration. Adding the target segment duration to the start time yields the end time of the target video segment. Then, based on the start and end times of the target video segment, the segment information is determined. This segment information can be sent to the downloader, which, upon receiving the information, downloads the corresponding target video segment from the target video and stores it in local cache or memory for subsequent playback. The advantage of this setup is that it avoids repeatedly downloading cached content, ensuring the accuracy of video segment downloads and guaranteeing smooth video playback.

[0073] It should be noted that after obtaining the target video segment corresponding to the segment information, the step of determining the continuous playback duration of the target video at the playback time based on the playback time of the target video can be repeated; alternatively, during the playback of the target video, the step of determining the continuous playback duration of the target video at the playback time based on the playback time can be repeatedly executed based on a timed task, so as to determine the first report information corresponding to the target video at the playback time, the second report information of the video segment corresponding to at least one preset segment duration cached at the playback time, and the target segment duration based on the continuous playback duration, so as to continue to determine the target video segment caching based on the target segment duration.

[0074] The technical solution provided in this disclosure involves determining the continuous playback duration of the target video at the playback time during target video playback; determining first reward information corresponding to the target video at the playback time based on the continuous playback duration, the first video cache duration corresponding to the playback time, and the video attribute information of the target video; adjusting the first video cache duration based on at least one preset segment duration; and determining second reward information for video segments cached at least one preset segment duration at the playback time based on the continuous playback duration, video attribute information, and the adjusted first video cache duration; and determining second reward information for video segments cached at least one preset segment duration based on the second reward information for video segments cached at the playback time. The system uses both initial and final reward information to determine the target segment duration. Based on this duration, it identifies and caches the target video segment, resolving the issues of resource waste, high costs, and poor video playback smoothness caused by fixed and dynamic segmentation of video segment requests in existing technologies. The system determines the target segment duration based on the initial reward information corresponding to the target video at the playback moment, and the second reward information corresponding to video segments with different preset durations cached at the playback moment. This segmented request and caching of video segments based on the target segment duration reduces cache resource waste, lowers traffic costs, and ultimately improves video playback smoothness and ensures a better user experience.

[0075] Figure 4 This is a schematic flowchart illustrating a video processing method provided in an embodiment of this disclosure. Based on the above embodiments, the technical solution of this embodiment further refines "S120," and its specific implementation can be found in the detailed description of the embodiments of this disclosure. Technical features that are the same as or similar to those in the foregoing embodiments will not be repeated here.

[0076] like Figure 4 As shown, the method in this embodiment may specifically include:

[0077] S210. During the playback of the target video, determine the duration of continuous playback of the target video at the playback time.

[0078] S220. Determine the bandwidth utilization rate corresponding to the playback time based on the playback time, the first video buffer duration, and the preset viewing duration distribution function.

[0079] Bandwidth utilization can be used to characterize the probability that the bandwidth cost incurred in the current caching state (i.e., the video corresponding to the first video cache duration that has been cached but not yet played) will not be wasted. A higher bandwidth utilization rate indicates a lower probability of bandwidth being wasted.

[0080] In this embodiment, a preset viewing duration distribution function can be used to determine the probability P that a target user continues watching from the playback moment for a duration greater than or equal to the first video buffer duration. This probability value can be used to approximate the bandwidth utilization corresponding to the playback moment. For example, the formula for calculating the bandwidth utilization corresponding to the playback moment can be expressed as:

[0081] in; τ represents the bandwidth utilization rate corresponding to playback time t0; τ is the first video buffer duration; F represents the preset viewing duration distribution function, and t is a random variable.

[0082] S230. Determine the stuttering coefficient corresponding to the playback moment based on the continuous playback duration, the first video buffer duration, and the video bitrate and video download bandwidth in the video attribute information.

[0083] Among these, video bitrate can be defined as the amount of data transmitted per unit of time; for example, a higher video bitrate indicates higher video quality and a larger video file size. Video download bandwidth can be the predicted download bandwidth at the time of playback, used to characterize the speed at which data is transmitted over the network; for example, a higher video bandwidth indicates a faster video download speed. The stuttering factor can be used to characterize the impact of a certain level of stuttering on the duration of playback for a target user; for example, a higher stuttering factor indicates a greater impact on the duration of playback for a target user; a lower stuttering factor indicates a smaller impact; and a stuttering factor of 0 indicates no impact on the duration of playback for a target user.

[0084] In this embodiment, the continuous playback duration and the first video buffer duration can be compared. If the continuous playback duration is greater than the first video buffer duration, the stuttering intensity can be determined based on the video bitrate and video download bandwidth in the video attribute information, as well as the continuous playback duration and the first video buffer duration. If the continuous playback duration is less than or equal to the first video buffer duration, the stuttering intensity is determined to be a preset first threshold (e.g., the preset first threshold is 0). Further, the stuttering coefficient corresponding to the playback moment can be determined based on the intensity influence coefficient and the stuttering intensity. This can be done as follows: if the stuttering intensity is greater than the reciprocal of the intensity influence coefficient, the stuttering coefficient is determined to be a preset second threshold (e.g., the preset second threshold is 1); if the stuttering intensity is less than or equal to the reciprocal of the intensity influence coefficient, the stuttering coefficient is determined based on the product of the intensity influence coefficient and the stuttering intensity. The stuttering intensity can be used to characterize the ratio of the time required to download to the estimated viewing position to the estimated continued viewing duration (i.e., continuous playback duration). The larger the ratio, the higher the probability and intensity of stuttering.

[0085] For example, the formula for determining the intensity of the clatter can be expressed as:

[0086] Where σ represents the stuttering intensity; τ represents the first video buffer duration; R represents the video bitrate; and Δt represents the continuous playback duration. This indicates the video download bandwidth; 0 indicates the preset first threshold.

[0087] The formula for determining the stuttering factor can be expressed as:

[0088] Where k represents the intensity influence coefficient; ω(σ) represents the stuttering coefficient; and 1 represents the preset second threshold.

[0089] S240. Based on bandwidth utilization, stuttering factor, video bitrate, and preset adjustment factor, determine the first report information of the target video at the playback moment.

[0090] The preset adjustment coefficient can be 1.

[0091] In this embodiment, multiple factors such as bandwidth utilization, stuttering coefficient, video bitrate, and preset adjustment coefficient can be considered to determine the first report information of the target video at the playback moment. For example, a higher bandwidth utilization may indicate a potential decrease in network performance, making video playback more prone to buffering or stuttering, resulting in a lower first report information. Alternatively, a higher stuttering coefficient indicates more severe stuttering during video playback, which has a greater impact on the continuous playback duration, resulting in a lower first report information.

[0092] In this embodiment, the first reward information of the target video at the playback time is determined based on bandwidth utilization, stuttering coefficient, video bitrate, and a preset adjustment coefficient. This includes: determining first data based on the difference between the preset adjustment coefficient and the stuttering coefficient; determining second data based on the cost constraint coefficient, video bitrate, and bandwidth utilization; and determining the first reward information based on the first and second data. The cost constraint coefficient can be used to characterize the exchange relationship between the unit cost of bandwidth and the service value per unit playback duration.

[0093] Specifically, the cost constraint coefficient and video bitrate can be multiplied to obtain a first intermediate value; then, the first intermediate value and bandwidth utilization can be divided to obtain a second intermediate value; the difference between the preset adjustment coefficient and the second intermediate value is determined and used as the second data. Simultaneously, the difference between the preset adjustment coefficient and the stuttering coefficient is determined and used as the first data. Further, the first and second data can be multiplied to obtain the first report information. The advantage of this setup is that it improves the accuracy of determining the first report information.

[0094] For example, the formula for determining the first return information can be expressed as:

[0095] in,

[0096] This represents the first reward information of the target video at the time of playback; α represents the cost constraint coefficient.

[0097] S250. Adjust the first video cache duration based on at least one preset segment duration, and determine the second report information of the video segment corresponding to at least one preset segment duration cached at the playback time based on the continuous playback duration, video attribute information and the adjusted first video cache duration.

[0098] For example, the formula for determining the second return information can be expressed as:

[0099] τ+d refers to the adjusted first video buffer duration; This refers to the second report information of the video segment corresponding to the preset segment duration d at the playback time. The method for determining the second report information is similar to that for determining the first report information, and will not be elaborated here.

[0100] S260. Determine the target segment duration based on the second report information and the first report information corresponding to at least one preset segment duration, so as to determine the target video segment based on the target segment duration and cache it.

[0101] The technical solution provided in this disclosure determines the bandwidth utilization rate corresponding to the playback time based on the playback time, the first video buffer duration, and a preset viewing duration distribution function. Then, it determines the stuttering coefficient corresponding to the playback time based on the continuous playback duration, the first video buffer duration, and the video bitrate and video download bandwidth in the video attribute information. Combining the bandwidth utilization rate, stuttering coefficient, video bitrate, and a preset adjustment coefficient, it determines the first reward information of the target video at the playback time. Similarly, it determines the second reward information of the video segment corresponding to at least one preset segment duration cached at the playback time. Based on the second reward information and the first reward information corresponding to each preset segment duration, it determines the target segment duration from the preset segment durations. This target segment duration is the duration of the target video segment requested for download, maximizing the benefits of video processing while improving video playback smoothness.

[0102] Figure 5 This is a schematic diagram of the structure of a video processing apparatus provided in an embodiment of the present disclosure, as shown below. Figure 5As shown, the device includes: a continuous playback duration determination module 310, a first report information determination module 320, a second report information determination module 330, and a target segment duration determination module 340.

[0103] The continuous playback duration determination module 310 is used to determine the continuous playback duration of the target video at the playback time based on the playback time of the target video during playback. The first reward information determination module 320 is used to determine the first reward information corresponding to the target video at the playback time based on the continuous playback duration, the first video cache duration corresponding to the target video at the playback time, and the video attribute information of the target video; wherein the first video cache duration is the duration of cached but unplayed video. The second reward information determination module 330 is used to adjust based on at least one preset segment duration. The first video cache duration is determined based on the continuous playback duration, the video attribute information, and the adjusted first video cache duration to determine the second reward information of the video segment corresponding to the at least one preset segment duration at the playback time; wherein, the video segment is a segment in the target video, and the starting cache time of the video segment is related to the first video cache duration before adjustment; the target segment duration determination module 340 is used to determine the target segment duration based on the second reward information corresponding to the at least one preset segment duration and the first reward information, so as to determine the target video segment and cache it based on the target segment duration.

[0104] Optionally, based on the above-mentioned device, the continuous playback duration determination module 310 is used to determine the continuous playback duration of the target video at the playback time according to the playback time of the target video and a preset viewing duration distribution function; wherein, the preset viewing duration distribution function is determined based on the target user and the target video.

[0105] Based on the above-mentioned device, optionally, the first report information determination module 320 includes:

[0106] A bandwidth utilization determination unit is used to determine the bandwidth utilization corresponding to the playback time based on the playback time, the first video buffer duration, and a preset viewing duration distribution function.

[0107] The stuttering coefficient determination unit is used to determine the stuttering coefficient corresponding to the playback moment based on the continuous playback duration, the first video buffer duration, and the video bitrate and video download bandwidth in the video attribute information.

[0108] The first report information determination unit is used to determine the first report information of the target video at the playback time based on the bandwidth utilization rate, the stuttering coefficient, the video bitrate, and the preset adjustment coefficient.

[0109] Based on the above-mentioned device, optionally, the first report information determining unit includes:

[0110] The first data determining unit is used to determine the first data based on the difference between the preset adjustment coefficient and the lag coefficient;

[0111] The second data determination unit is used to determine the second data based on the cost constraint coefficient, the video bitrate, and the bandwidth utilization rate.

[0112] The first report information determination subunit is used to determine the first report information based on the first data and the second data.

[0113] Optionally, based on the above-described apparatus, the apparatus may further include:

[0114] The preset segment duration determination unit is used to determine at least one segment duration based on a preset segment duration value range and segment duration adjustment step size, and to use the at least one segment duration as the at least one preset segment duration.

[0115] Based on the above-mentioned device, the target segment duration determination module 340 optionally includes:

[0116] The reward gain information determination unit is used to determine the difference information between the second reward information and the first reward information corresponding to the at least one preset segment duration, and to obtain the reward gain information;

[0117] The target segment duration determination unit is used to determine the preset segment duration corresponding to the maximum positive value of the reward gain information as the target segment duration.

[0118] Optionally, based on the above-described apparatus, the apparatus may further include:

[0119] The segment information determination unit is used to determine the segment information of the target video segment based on the target segment duration and the first video buffer duration;

[0120] The segment information sending unit is used to send the segment information to the downloader, so that the downloader can perform the operation of obtaining the target video segment corresponding to the segment information.

[0121] The technical solution of this disclosure embodiment involves determining the continuous playback duration of the target video at the playback time during target video playback; determining first reward information corresponding to the target video at the playback time based on the continuous playback duration, the first video cache duration corresponding to the target video at the playback time, and the video attribute information of the target video; adjusting the first video cache duration based on at least one preset segment duration; determining second reward information for the video segment corresponding to at least one preset segment duration cached at the playback time based on the continuous playback duration, video attribute information, and the adjusted first video cache duration; and determining second reward information based on the second reward information corresponding to at least one preset segment duration. This technology uses information and first reward information to determine the target segment duration. Based on the target segment duration, it determines and caches the target video segment, solving the problems of resource waste, high cost, and poor video playback smoothness caused by fixed segmentation and dynamic segmentation of video segment requests in existing technologies. It enables the determination of the target segment duration during the target video playback process based on the first reward information corresponding to the target video at the playback moment, and the second reward information corresponding to the video segments with different preset segment durations cached at the playback moment. By requesting and caching video segments in segments according to the target segment duration, it reduces cache resource waste, lowers traffic costs, and achieves the technical effect of improving video playback smoothness and ensuring user experience.

[0122] The video processing apparatus provided in this disclosure can execute the video processing method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the method.

[0123] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.

[0124] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Figure 6 As shown, electronic device 400 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 401, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 402 or a program loaded from storage device 408 into random access memory (RAM) 403. The RAM 403 also stores various programs and data required for the operation of electronic device 400. The processing device 401, ROM 402, and RAM 403 are interconnected via bus 404. Input / output (I / O) interface 404 is also connected to bus 404.

[0125] Typically, the following devices can be connected to I / O interface 405: input devices 406 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 407 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 408 including, for example, magnetic tapes, hard disks, etc.; and communication devices 409. Communication device 409 allows electronic device 400 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 6 An electronic device 400 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0126] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 409, or installed from storage device 408, or installed from ROM 402. When the computer program is executed by processing device 401, it performs the functions defined in the methods of embodiments of this disclosure.

[0127] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0128] The electronic device provided in this disclosure and the video processing method provided in the above embodiments belong to the same inventive concept. Technical details not described in detail in this disclosure can be found in the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.

[0129] This disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the video processing method provided in the above embodiments.

[0130] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0131] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0132] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0133] The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to:

[0134] During the playback of the target video, the duration of continuous playback of the target video at the playback time is determined based on the playback time of the target video.

[0135] Based on the continuous playback duration, the first video cache duration corresponding to the target video at the playback time, and the video attribute information of the target video, the first reward information corresponding to the target video at the playback time is determined; wherein, the first video cache duration is the duration of the cached but unplayed video.

[0136] The first video cache duration is adjusted based on at least one preset segment duration. Based on the continuous playback duration, the video attribute information, and the adjusted first video cache duration, second reward information is determined for the video segment corresponding to the at least one preset segment duration cached at the playback time. The video segment is a segment in the target video, and the starting cache time of the video segment is related to the first video cache duration before adjustment.

[0137] Based on the second report information corresponding to the at least one preset segment duration and the first report information, the target segment duration is determined, so as to determine the target video segment and cache it based on the target segment duration.

[0138] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0139] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0140] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0141] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0142] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0143] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0144] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0145] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A video processing method, characterized in that, include: During the playback of the target video, the duration of continuous playback of the target video at the playback time is determined based on the playback time of the target video. Based on the continuous playback duration, the first video cache duration corresponding to the target video at the playback time, and the video attribute information of the target video, the first reward information corresponding to the target video at the playback time is determined; wherein, the first video cache duration is the duration of the cached but unplayed video. The first video cache duration is adjusted based on at least one preset segment duration. Based on the continuous playback duration, the video attribute information, and the adjusted first video cache duration, second reward information is determined for the video segment corresponding to the at least one preset segment duration cached at the playback time. The video segment is a segment in the target video, and the starting cache time of the video segment is related to the first video cache duration before adjustment. Based on the second report information corresponding to the at least one preset segment duration and the first report information, the target segment duration is determined, so as to determine the target video segment and cache it based on the target segment duration.

2. The method according to claim 1, characterized in that, Determining the duration of continuous playback of the target video at the playback time based on the playback time of the target video includes: Based on the playback time of the target video and the preset viewing duration distribution function, determine the continuous playback duration of the target video at the playback time; The preset viewing duration distribution function is determined based on the target user and the target video.

3. The method according to claim 1, characterized in that, The step of determining the first reward information corresponding to the target video at the playback time based on the continuous playback duration, the first video buffer duration corresponding to the target video at the playback time, and the video attribute information of the target video includes: The bandwidth utilization rate corresponding to the playback time is determined based on the playback time, the first video buffer duration, and the preset viewing duration distribution function. The stuttering coefficient corresponding to the playback moment is determined based on the continuous playback duration, the first video buffer duration, and the video bitrate and video download bandwidth in the video attribute information. Based on the bandwidth utilization, the stuttering coefficient, the video bitrate, and the preset adjustment coefficient, the first report information of the target video at the playback time is determined.

4. The method according to claim 3, characterized in that, The step of determining the first report information of the target video at the playback time based on the bandwidth utilization rate, the stuttering coefficient, the video bitrate, and the preset adjustment coefficient includes: The first data is determined based on the difference between the preset adjustment coefficient and the lag coefficient; The second data is determined based on the cost constraint coefficient, the video bitrate, and the bandwidth utilization rate; The first reward information is determined based on the first data and the second data.

5. The method according to claim 1, characterized in that, The method further includes: Based on the preset range of segment duration values ​​and the segment duration adjustment step size, at least one segment duration is determined, and the at least one segment duration is used as the at least one preset segment duration.

6. The method according to claim 1, characterized in that, The step of determining the target segment duration based on the second reward information corresponding to the at least one preset segment duration and the first reward information includes: The difference between the second reward information and the first reward information corresponding to the at least one preset segment duration is determined to obtain the reward gain information; The preset segment duration corresponding to the maximum positive value of the reward gain information is taken as the target segment duration.

7. The method according to claim 1, characterized in that, The step of determining and caching the target video segment based on the target segment duration includes: Based on the target segment duration and the first video buffer duration, the segment information of the target video segment is determined; The segment information is sent to the downloader, so that the downloader can perform the operation of obtaining the target video segment corresponding to the segment information.

8. A video processing apparatus, characterized in that, include: The continuous playback duration determination module is used to determine the continuous playback duration of the target video at the playback time based on the playback time of the target video during the playback process; The first reward information determination module is used to determine the first reward information corresponding to the target video at the playback time based on the continuous playback duration, the first video cache duration corresponding to the target video at the playback time, and the video attribute information of the target video; wherein, the first video cache duration is the duration of the cached but unplayed video. The second reward information determination module is used to adjust the first video cache duration based on at least one preset segment duration, and determine the second reward information of the video segment corresponding to the at least one preset segment duration cached at the playback time based on the continuous playback duration, the video attribute information, and the adjusted first video cache duration; wherein, the video segment is a segment in the target video, and the starting cache time of the video segment is related to the first video cache duration before adjustment; The target segment duration determination module is used to determine the target segment duration based on the second report information corresponding to the at least one preset segment duration and the first report information, so as to determine the target video segment based on the target segment duration and cache it.

9. An electronic device, characterized in that, The electronic device includes: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the video processing method as described in any one of claims 1-7.

10. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the video processing method as described in any one of claims 1-7.

11. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the video processing method as described in any one of claims 1-7.

Images