Live streaming processing methods and device, and storage medium
By obtaining the clarity information and image quality data of live video and dynamically determining super-resolution information based on device performance data, the flexibility problem of super-resolution processing in live broadcast scenarios is solved, dynamic adjustment of image quality and smoothness is achieved, and the viewing experience of live video is improved.
Patent Information
- Application Number
- PCT/CN2025/084394
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-22
- Filing Date
- 2025-03-24
- Publication Date
- 2025-09-25
AI Technical Summary
In live broadcast scenarios, existing technologies cannot flexibly adjust the use and multiples of super-resolution processing, resulting in the inability to meet the image quality and smoothness requirements in different situations, especially when the live broadcast room picture and device status are complex and changeable.
By obtaining the clarity information and image quality data of the target live video and combining it with the device performance data to dynamically determine the super-resolution information, dynamic super-resolution processing of the live video can be achieved to meet the super-resolution requirements in different situations and ensure image quality and smoothness.
It achieves dynamic adjustment of super-resolution processing according to image quality and device performance in live broadcast scenarios, improving the image quality and smoothness of live video, while taking into account the battery life and temperature performance of the device, and enhancing the viewing experience.
Smart Images

Figure CN2025084394_25092025_PF_FP_ABST
Abstract
Description
Live broadcast processing method, device and storage medium
[0001] This application claims priority to Chinese Patent Application No. 202410339764.7 filed on March 22, 2024, and the contents of the above-mentioned Chinese patent application disclosure are hereby incorporated by reference in their entirety as a part of this application. Technical Field
[0002] The embodiments of the present disclosure relate to a live broadcast processing method, device, and storage medium. Background Art
[0003] Image super-resolution processing technology is a method used to reconstruct a low-resolution image into a corresponding high-resolution image to improve the resolution of the original image. This technology can meet the needs of high-definition image display, and the super-resolution multiple is the multiple of the original image resolution increased during the super-resolution processing process.
[0004] Whether to use super-resolution processing and the determination of the super-resolution multiple are usually controlled by the user or planned in advance. It is not flexible enough to meet the super-resolution processing needs in different situations, especially in live broadcast scenarios. The live broadcast room picture and device status are complex and changeable. In live broadcast scenarios, the super-resolution processing process is controlled or planned in a unified manner by the user, which cannot guarantee the picture quality and smoothness of the live broadcast room. Summary of the Invention
[0005] The embodiments of the present disclosure provide a live broadcast processing method, device, and storage medium to determine an appropriate super-resolution multiple in a live broadcast scenario.
[0006] In a first aspect, an embodiment of the present disclosure provides a live broadcast processing method, applied to a first device, the method comprising:
[0007] Obtain the target clarity information corresponding to the target live video;
[0008] Acquire image quality data corresponding to the target live video and the target definition information, and determine first super-resolution information according to the image quality data corresponding to the target definition information;
[0009] Target super-resolution information is determined based on the first super-resolution information and current device performance data corresponding to the first device, and the target live video image is processed based on the target super-resolution information.
[0010] In a second aspect, an embodiment of the present disclosure provides a live broadcast processing method, which is applied to a server, and the method includes:
[0011] Obtain the image quality data corresponding to each definition information of the target live video;
[0012] Send the image quality data corresponding to the target live video and target clarity information to the first device, so that the first device determines the first super-resolution information based on the image quality data corresponding to the target clarity information, and determines the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device.
[0013] In a third aspect, an embodiment of the present disclosure provides a live broadcast processing device, including:
[0014] An acquisition unit, configured to acquire target definition information corresponding to a target live video;
[0015] a super-resolution information determining unit, configured to obtain image quality data corresponding to the target live video and the target definition information, determine first super-resolution information based on the image quality data corresponding to the target definition information; and determine target super-resolution information based on the first super-resolution information and current device performance data corresponding to the first device;
[0016] A super-resolution execution unit is used to process the target live video according to the target super-resolution information.
[0017] In a fourth aspect, an embodiment of the present disclosure provides a live broadcast processing device, including:
[0018] An acquisition unit, configured to acquire image quality data corresponding to each definition information of a target live video;
[0019] A sending unit is used to send the image quality data corresponding to the target live video and the target clarity information to the first device, so that the first device determines the first super-resolution information based on the image quality data corresponding to the target clarity information, and determines the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device.
[0020] In a fifth aspect, an embodiment of the present disclosure provides an electronic device, including: at least one processor and a memory;
[0021] The memory stores computer-executable instructions;
[0022] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the live broadcast processing method described in the first aspect and various possible designs of the first aspect, or the live broadcast processing method described in the second aspect and various possible designs of the second aspect.
[0023] In a sixth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the live broadcast processing method described in the first aspect and various possible designs of the first aspect, or the live broadcast processing method described in the second aspect and various possible designs of the second aspect is implemented.
[0024] In the seventh aspect, an embodiment of the present disclosure provides a computer program product, including computer execution instructions. When a processor executes the computer execution instructions, it implements the live broadcast processing method described in the first aspect and various possible designs of the first aspect, or the live broadcast processing method described in the second aspect and various possible designs of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0026] FIG1 is a diagram illustrating an example scenario of a live broadcast processing method provided by an embodiment of the present disclosure;
[0027] FIG2 is a flow chart of a live broadcast processing method provided by an embodiment of the present disclosure;
[0028] FIG3 is a flow chart of a live broadcast processing method provided by another embodiment of the present disclosure;
[0029] FIG4 is a structural block diagram of a live broadcast processing device provided by an embodiment of the present disclosure;
[0030] FIG5 is a structural block diagram of a live broadcast processing device provided by another embodiment of the present disclosure; and
[0031] FIG6 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0032] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.
[0033] Whether to use super-resolution processing and the determination of the super-resolution multiple are usually controlled by the user or planned in advance. It has poor flexibility and cannot meet the super-resolution processing needs in different situations. Especially in live broadcast scenarios, the live broadcast room (live video) picture and device status are complex and changeable. In live broadcast scenarios, the super-resolution processing process is controlled or planned in a unified manner by the user, and the picture quality and smoothness of the live broadcast room (live video) cannot be guaranteed.
[0034] For example, in one technical solution, whether to use video super-resolution processing is completely planned based on physical parameters such as device model, video resolution, and frame rate. In live broadcast scenarios, this technical solution has the following drawbacks.
[0035] First, uniformly turning on and off video super-resolution processing according to the physical parameters of the video image (video resolution and frame rate) cannot achieve true on-demand use. For example, in some scenes, the image quality is already very saturated and there is no need for super-resolution processing enhancement. In some scenes, the image quality requirements are not high and there is no need to use high-intensity super-resolution capabilities.
[0036] Secondly, whether to enable super-resolution depends on the device model. However, device performance also changes dynamically. Indicators such as CPU, GPU, power consumption, and heat generation may change significantly during use. When device performance deteriorates, using super-resolution processing or a high super-resolution multiple will affect smoothness.
[0037] In order to solve the above technical problems, the embodiments of the present disclosure provide a live broadcast processing method, so that when super-resolution processing is performed in a live broadcast scene, dynamic super-resolution processing of the live video picture can be achieved based on the picture quality of the live video and the performance indicators of the device, so as to meet the super-resolution processing requirements in different situations, ensure the picture quality and smoothness of the live video, and take into account the performance of the device such as battery life and temperature, thereby improving the viewing experience. Specifically, the target clarity information corresponding to the target live video can be obtained; the picture quality data corresponding to the target live video and the target clarity information can be obtained, and the first super-resolution information can be determined according to the picture quality data corresponding to the target clarity information; the target super-resolution information can be determined according to the first super-resolution information and the current device performance data corresponding to the first device, and the picture of the target live video can be processed according to the target super-resolution information.
[0038] The image quality data corresponding to the target clarity information includes real-time image quality data and optimal image quality data of the target clarity information. The real-time image quality data is obtained based on the image quality data of the target live video of multiple second devices that use the target clarity information to play the target live video.
[0039] The live broadcast processing method provided by the embodiment of the present disclosure can be applied to the scenario shown in FIG1 , which includes a server, a first device capable of watching the target live broadcast video, and multiple second devices.
[0040] Among them, multiple second devices can use any clarity information to play the target live video. The server can obtain the real-time picture quality data of the target live video sent by multiple second devices that use any clarity information to play the target live video (live video in the target live room), and determine the final real-time picture quality data of the clarity information based on multiple real-time picture quality data. In addition, the server can also obtain the best picture quality data of any clarity information of the target live video, and based on the real-time picture quality data and the best picture quality data of any clarity information of the target live video, obtain the picture quality data corresponding to any clarity information of the target live video.
[0041] After the first device starts playing the target live video (for example, entering the target live video), or during the process of the first device playing the target live video, the user can select the target clarity information, or can use the default clarity information or historical clarity information as the target clarity information; in addition, the first device can also obtain the image quality data corresponding to the target clarity information from the server, or obtain the image quality data corresponding to each clarity information of the target live video from the server, and then obtain the image quality data corresponding to the target live video and the target clarity information from the image quality data corresponding to each clarity information of the target live video.
[0042] Furthermore, the first device can determine the first super-resolution information based on the image quality data corresponding to the target clarity information, determine the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device, and process the target live video picture based on the target super-resolution information.
[0043] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0044] The live broadcast processing method disclosed herein will be described in detail below with reference to specific embodiments.
[0045] Refer to Figure 2, which is a flow chart of a live broadcast processing method provided by an embodiment of the present disclosure. The method of this embodiment can be applied to a first device, which can be any device capable of viewing a target live broadcast video. The live broadcast processing method includes:
[0046] S201. Obtain target clarity information corresponding to a target live video.
[0047] In this embodiment, after the first device starts playing the target live video (for example, the user of the first device enters the live broadcast room corresponding to the target live video by operating the first device), or at any time during the playback of the target live video, the user of the first device can select the clarity information. For example, the user can select clarity information such as Blu-ray, ultra-high definition, high definition, and standard definition. The first device can determine the selected target clarity information according to the user's selection instruction. Of course, if the user does not select the clarity information, the default clarity information or historical clarity information can be used as the target clarity information corresponding to the target live video, or the target clarity information corresponding to the target live video can be determined by any other possible method.
[0048] S202: Obtain image quality data corresponding to the target live video and the target clarity information, and determine first super-resolution information based on the image quality data.
[0049] In this embodiment, the first device can obtain the image quality data corresponding to the target live video and the target clarity information in advance from the server (or through other channels, such as through other devices), wherein the image quality data corresponding to the target clarity information includes real-time image quality data and optimal image quality data of the target clarity information. The real-time image quality data is obtained based on the image quality data of the target live video at the target clarity of multiple second devices that use the target clarity information to play the target live video. For example, it can be the average of the image quality scores of the target live video by multiple second devices that use the target clarity information to play the target live video in the live broadcast room corresponding to the target live video. The optimal image quality data can be the score corresponding to the expected optimal image quality of the target live video at the target clarity, which can be manually set (for example, set by the anchor, etc., or set by the audience users of multiple second devices), or it can be obtained based on the best image quality scores of other live videos similar to the target live video.
[0050] In an optional embodiment, the first device may obtain image quality data corresponding to the target live video and the target definition information from the server based on the target definition information. In a specific implementation, the first device may send a request to the server for obtaining image quality data corresponding to the target definition information, which includes the target definition information. The server may then send the image quality data corresponding to the target live video and the target definition information to the first device based on the request. The server may obtain the image quality data corresponding to each definition information of the target live video in advance (or in real time).
[0051] In another optional embodiment, after the first device starts playing the target live video, for example, after entering the live broadcast room corresponding to the target live video (before selecting the target clarity information, or not limited to before selecting the target clarity information, at any time), the first device may also obtain the image quality data corresponding to each clarity information of the target live video from the server, wherein the image quality data corresponding to any clarity information includes the real-time image quality data and the best image quality data of the clarity information, and the image quality data corresponding to each clarity information of the target live video may be cached; accordingly, when the first device obtains the image quality data corresponding to the target live video and the target clarity information, the image quality data corresponding to the target live video and the target clarity information may be queried from the image quality data corresponding to each clarity information of the target live video that has been obtained.
[0052] Furthermore, after obtaining the image quality data corresponding to the target live video and the target definition information, the first super-resolution information can be determined based on the image quality data corresponding to the target definition information. The first super-resolution information is a super-resolution multiple and may also include other super-resolution related parameters. Specifically, the first super-resolution information can be determined using the following process:
[0053] S2021, determining a target image quality data difference between the optimal image quality data of the target definition information and the real-time image quality data;
[0054] S2022. According to a mapping relationship between a preset image quality data difference and preset super-resolution information, search for the preset super-resolution information corresponding to the target image quality data difference, and determine the preset super-resolution information corresponding to the target image quality data difference as the first super-resolution information.
[0055] In this embodiment, considering that different super-resolution factors may improve image quality data differently, a mapping relationship between a preset image quality data difference and preset super-resolution information may be predetermined. For example, the mapping relationship may be obtained by pre-determining the image quality data improvement values when different super-resolution factors are used. Specifically, the mapping relationship between the preset image quality data difference and the preset super-resolution information may be determined independently by the first device, or the server may determine the mapping relationship between the preset image quality data difference and the preset super-resolution information and then send the mapping relationship between the preset image quality data difference and the preset super-resolution information to the first device. The first device may then obtain a data difference between the optimal image quality data of the target definition information and the real-time image quality data, recorded as the target image quality data difference. Based on the mapping relationship between the preset image quality data difference and the preset super-resolution information, the first device may search for the preset super-resolution information corresponding to the target image quality data difference, and determine the preset super-resolution information corresponding to the target image quality data difference as the first super-resolution information. This allows the image quality data to be improved from the real-time image quality data to the optimal image quality data when super-resolution processing is performed using the first super-resolution information, thereby achieving the optimal image quality of the target live video at the target definition information.
[0056] S203: Determine target super-resolution information based on the first super-resolution information and current device performance data corresponding to the first device, and process the target live video according to the target super-resolution information.
[0057] In this embodiment, considering that during super-resolution processing, the higher the super-resolution multiple, the greater the performance consumption of the device, and the first super-resolution multiple is determined only based on the image quality, the current performance of the first device may support the first super-resolution multiple, or may not support the first super-resolution multiple (for example, problems such as stuttering and delay may occur). Therefore, after determining the first super-resolution information, the current device performance data corresponding to the first device can also be combined to determine the final target super-resolution information, where the current performance indicators include but are not limited to CPU usage, GPU usage, power, temperature, etc. For example, the first super-resolution information can be adjusted according to the current device performance data corresponding to the first device.
[0058] Optionally, determining target super-resolution information according to the first super-resolution information and current device performance data corresponding to the first device may specifically include:
[0059] If it is determined that the current device performance data corresponding to the first device meets the first preset performance indicator threshold, the first super-resolution information is determined as the target super-resolution information, that is, the current performance of the first device is fully sufficient to support super-resolution processing using the first super-resolution information, wherein the first preset performance indicator threshold can be set according to actual conditions and is not limited here; or
[0060] If it is determined that the current device performance data corresponding to the first device does not meet the first preset performance indicator threshold, the second super-resolution information that the first device can currently support is determined based on the current device performance data corresponding to the first device, and the target super-resolution information is determined based on the first super-resolution information and the second super-resolution information. That is, when the current device performance data corresponding to the first device does not meet the first preset performance indicator threshold, the current performance of the first device may be insufficient to support super-resolution processing of the first super-resolution information. At this time, the second super-resolution information that the first device can currently support can be determined based solely on the current device performance data corresponding to the first device, and the target final super-resolution information is determined in combination with the first super-resolution information and the second super-resolution information.
[0061] When determining the target super-resolution information based on the first super-resolution information and the second super-resolution information, the minimum super-resolution information between the first super-resolution information and the second super-resolution information (i.e., the minimum super-resolution multiple between the first super-resolution multiple and the second super-resolution multiple) can be determined, and the minimum super-resolution information can be determined as the final target super-resolution information. Specifically, when the second super-resolution information is greater than or equal to the first super-resolution information, it indicates that the current performance of the first device can support super-resolution processing of the first super-resolution information, and therefore the first super-resolution information can be selected as the target super-resolution information; when the second super-resolution information is less than the first super-resolution information, it indicates that the current performance of the first device is insufficient to support super-resolution processing of the first super-resolution information, but can support super-resolution processing of the second super-resolution information, and therefore the second super-resolution information can be selected as the target super-resolution information.
[0062] Optionally, in the above embodiment, determining the second super-resolution information currently supported by the first device according to the current device performance data corresponding to the first device may specifically include:
[0063] Determining a target device performance data difference between a second preset performance indicator threshold and current device performance data corresponding to the first device;
[0064] According to the mapping relationship between the preset device performance data difference and the preset super-resolution information, the preset super-resolution information corresponding to the target device performance data difference is searched, and the preset super-resolution information corresponding to the target device performance data difference is determined as the second super-resolution information.
[0065] In this embodiment, considering that different super-resolution information consumes different performance of devices, a mapping relationship between a preset device performance data difference and the preset super-resolution information may be predetermined. Specifically, the first device may determine the mapping relationship between the preset device performance data difference and the preset super-resolution information on its own, or the server may determine the mapping relationship between the preset device performance data difference and the preset super-resolution information and then send it to the first device. The first device may then obtain a performance indicator difference between a second preset performance indicator threshold (which may be less than or equal to the first preset performance indicator threshold) and the current device performance data corresponding to the first device, and record it as the target device performance data difference (if there are multiple performance indicators, the performance indicator differences corresponding to the multiple performance indicators may be weighted summed, or the target device performance data difference may be determined by other means). Based on the mapping relationship between the preset device performance data difference and the preset super-resolution information, the preset super-resolution information corresponding to the target device performance data difference is searched, and the preset super-resolution information corresponding to the target device performance data difference is determined as the second super-resolution information, so that when super-resolution processing is performed using the second super-resolution information, the performance of the second device can reach the second preset performance indicator threshold (not exceeding the second preset performance indicator threshold).
[0066] Optionally, if it is determined that the current device performance data corresponding to the first device does not meet the third preset performance indicator threshold, where the third preset performance indicator threshold is smaller than the above-mentioned first preset performance indicator threshold, the second super-resolution information that the first device can currently support can be directly determined based on the current device performance data corresponding to the first device, and the second super-resolution information can be determined as the target super-resolution information; optionally, if it is determined that the current device performance data corresponding to the first device does not meet the fourth preset performance indicator threshold, where the fourth preset performance indicator threshold is smaller than the above-mentioned third preset performance indicator threshold, super-resolution processing may not be enabled.
[0067] The live broadcast processing method provided in this embodiment obtains target clarity information corresponding to a target live broadcast video; obtains image quality data corresponding to the target live broadcast video and the target clarity information, and determines first super-resolution information based on the image quality data corresponding to the target clarity information; determines target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device, and processes the image of the target live broadcast video based on the target super-resolution information. The disclosed embodiment can realize dynamic super-resolution processing of the live broadcast video image based on the image quality of the live broadcast video and the device performance indicators, meet the super-resolution processing requirements in different situations, ensure the image quality and smoothness of the live broadcast video, and take into account the performance of the device such as battery life and temperature, thereby improving the viewing experience.
[0068] Based on any of the above embodiments, the method may further include:
[0069] Acquire multiple frames of original screen images of the target live video, determine real-time image quality data when playing the target live video with the target clarity information based on the multiple frames of original screen images, and send them to the server, thereby providing real-time image quality data for other devices when playing the target live video.
[0070] In this embodiment, while the first device is playing the target live video with the target clarity information, it can also perform real-time picture quality data on the target live video under the target clarity information. Specifically, it can collect multiple frames of original picture images of the target live video played under the target clarity information, that is, the original picture images that have not been super-resolution processed, and then use the preset data method to perform data, and send the obtained real-time picture quality data to the server. The server can receive the real-time picture quality data of the target live video played under different clarity information sent by different devices in the target live video, and then the server can obtain the real-time picture quality data in the picture quality data corresponding to each clarity information of the target live video.
[0071] Based on any of the above embodiments, the above live broadcast processing method can also be dynamically executed while the first device is playing the target live video, and of course it can also be executed again after the first device switches the target clarity information to achieve dynamic super-resolution processing.
[0072] In another optional embodiment, after the first device enters the live broadcast room corresponding to the target live video and confirms the selected target clarity information, it can send a super-resolution information acquisition request to the server. The server can obtain the image quality data corresponding to the target live video and the target clarity information, determine the first super-resolution information based on the image quality data corresponding to the target clarity information, and send the first super-resolution information to the first device. After receiving the first super-resolution information sent by the server, the first device can determine the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device, and perform super-resolution processing on the target live video image based on the target super-resolution information. That is, the process of determining the first super-resolution information in the above process can be executed by the first device or by the server. Of course, the process of determining the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device can also be executed by the server.
[0073] Refer to Figure 3, which is a flowchart of a live broadcast processing method provided by an embodiment of the present disclosure. The method of this embodiment can be applied in a server, and the live broadcast processing method includes:
[0074] S301: Obtain image quality data corresponding to each clarity information of the target live video.
[0075] In this embodiment, the server can obtain the image quality data corresponding to each clarity information of the target live video, wherein the image quality data corresponding to any clarity information includes the real-time image quality data and the best image quality data of the clarity information. The real-time image quality data of the clarity information can be obtained based on the image quality data of the target live video sent to the server by multiple second devices using the clarity information in the target live video, wherein each second device can perform real-time image quality data according to a preset data method based on multiple frames of original screen images of the target live video and send it to the server, and the server can determine the real-time image quality data of the clarity information by calculating the average value or other methods; and the best image quality data of the clarity information can be manually set (for example, set by the anchor, etc., or set by the audience users of multiple second devices), or can be obtained based on the best image quality data of other live videos similar to the target live video.
[0076] Optionally, obtaining the image quality data corresponding to each definition information of the target live video may specifically include:
[0077] Receiving real-time image quality data of the target live video sent by multiple second devices that use any definition information to play the live video of the target live broadcast room, and determining final real-time image quality data of the definition information based on the multiple real-time image quality data;
[0078] Obtaining optimal image quality data corresponding to any definition information of a plurality of second live videos similar to the target live video, and determining optimal image quality data of any definition information of the target live video based on the optimal image quality data corresponding to any definition information of the plurality of second live videos;
[0079] According to the real-time picture quality data and the best picture quality data of any clarity information of the target live video, the picture quality data corresponding to any clarity information of the target live video is obtained.
[0080] In this embodiment, the server can receive real-time picture quality data of the target live video sent by multiple second devices that use any clarity information to play the live video of the target live room, and determine the final real-time picture quality data of the clarity information based on the multiple real-time picture quality data, such as calculating the average value; and the best picture quality data of any clarity information of the target live video can be determined based on the best picture quality data corresponding to any clarity information of multiple second live videos similar to the target live video, where the multiple second live videos similar to the target live video can be second live videos of the same or similar type, or second live videos using the same or similar live parameters (such as frame rate, etc.), and the best picture quality data corresponding to any clarity information of the multiple second live videos can be obtained, where the best picture quality data can be the highest picture quality data within a preset time period of any clarity information of the second live video.
[0081] S302. Send image quality data corresponding to the target live video and target clarity information to the first device, so that the first device determines first super-resolution information based on the image quality data corresponding to the target clarity information, and determines target super-resolution information based on the first super-resolution information and current device performance data corresponding to the first device.
[0082] In this embodiment, after the first device enters the target live video, the first device can select the target clarity information, and then send a request to the server, with the target clarity information carried in the request. The server can send the target live video and the image quality data corresponding to the target clarity information to the first device; or, after the first device enters the target live video, regardless of whether the target clarity information is selected, the server will include the image quality data corresponding to each clarity information of the target live video, and the image quality data corresponding to each clarity information of the target live video includes the image quality data corresponding to the target clarity information. After the user selects the target clarity information, the image quality data corresponding to the target clarity information can be obtained from the image quality data corresponding to each clarity information of the target live video. Further, the first device can execute the above-mentioned method embodiment on the first device side, which will not be repeated here.
[0083] Based on the above embodiment, the step of obtaining the image quality data corresponding to each definition information of the target live video includes:
[0084] Receiving real-time image quality data of the target live video sent by multiple second devices that use any definition information to play the live video of the target live broadcast room, and determining final real-time image quality data of the definition information based on the multiple real-time image quality data;
[0085] Obtaining optimal image quality data corresponding to any definition information of a plurality of second live videos similar to the target live video, and determining optimal image quality data of any definition information of the target live video based on the optimal image quality data corresponding to any definition information of the plurality of second live videos;
[0086] According to the real-time picture quality data and the best picture quality data of any clarity information of the target live video, the picture quality data corresponding to any clarity information of the target live video is obtained.
[0087] In this embodiment, the server can obtain real-time picture quality data of the target live video sent by multiple second devices that use any clarity information to play the live video of the target live room. The server can calculate the average value or other methods of the real-time picture quality data of the same clarity information to determine the final real-time picture quality data of the target live video at the clarity information.
[0088] In addition, the server can also determine the best picture quality data corresponding to any clarity information of multiple second live videos similar to the target live video, where the multiple second live videos similar to the target live video can be second live videos of the same or similar type, or second live videos using the same or similar live parameters (such as frame rate, etc.), and the best picture quality data corresponding to any clarity information of the multiple second live videos can be obtained, where the best picture quality data can be the highest picture quality data within a preset time period of any clarity information of the second live video.
[0089] Furthermore, the server may associate the real-time image quality data and the best image quality data of the same definition information of the target live video to obtain the image quality data corresponding to any definition information of the target live video.
[0090] In another optional embodiment, after the first device enters the target live video and confirms the selected target clarity information, it can send a super-resolution information acquisition request to the server. The server can obtain the image quality data corresponding to the target live video and the target clarity information, determine the first super-resolution information based on the image quality data corresponding to the target clarity information, and send the first super-resolution information to the first device. After receiving the first super-resolution information sent by the server, the first device can determine the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device, and process the image of the target live video based on the target super-resolution information. That is, the process of determining the first super-resolution information in the above process can be performed by the first device or by the server.
[0091] Corresponding to the live broadcast processing method on the first device side of the above embodiment, Figure 4 is a block diagram of the live broadcast processing device provided by the embodiment of the present disclosure. For ease of illustration, only the portions relevant to the embodiment of the present disclosure are shown. Referring to Figure 4 , the live broadcast processing device 400 includes: an acquisition unit 401, a super-resolution information determination unit 402, and a super-resolution execution unit 403.
[0092] The acquisition unit 401 is configured to acquire target definition information corresponding to the target live video;
[0093] The super-resolution information determining unit 402 is configured to obtain image quality data corresponding to the target live video and the target definition information, determine first super-resolution information based on the image quality data corresponding to the target definition information, and determine target super-resolution information based on the first super-resolution information and current device performance data corresponding to the first device.
[0094] The super-resolution execution unit 403 is configured to process the target live video according to the target super-resolution information.
[0095] In one or more embodiments of the present disclosure, the picture quality data corresponding to the target clarity information includes real-time picture quality data and optimal picture quality data of the target clarity information, and the real-time picture quality data is obtained based on the picture quality data of the target live video of multiple second devices that use the target clarity information to play the target live video.
[0096] In one or more embodiments of the present disclosure, when determining the first super-resolution information according to the image quality data corresponding to the target definition information, the super-resolution information determining unit 402 is configured to:
[0097] Determining a target image quality data difference between the optimal image quality data of the target definition information and the real-time image quality data;
[0098] According to a mapping relationship between a preset image quality data difference and preset super-resolution information, the preset super-resolution information corresponding to the target image quality data difference is determined as the first super-resolution information.
[0099] In one or more embodiments of the present disclosure, the super-resolution information determining unit 402 is further configured to:
[0100] Obtaining image quality data corresponding to each definition information of the target live video from the server, wherein the image quality data corresponding to any definition information includes real-time image quality data and optimal image quality data of the definition information;
[0101] Accordingly, when acquiring the image quality data corresponding to the target live video and the target definition information, the super-resolution information determining unit 402 is configured to:
[0102] The image quality data corresponding to the target live video and the target clarity information is obtained from the image quality data corresponding to each clarity information of the target live video.
[0103] In one or more embodiments of the present disclosure, when determining target super-resolution information based on the first super-resolution information and current device performance data corresponding to the first device, the super-resolution information determining unit 402 is configured to:
[0104] If it is determined that the current device performance data corresponding to the first device meets a first preset performance indicator threshold, determining the first super-resolution information as the target super-resolution information; or
[0105] If it is determined that the current device performance data corresponding to the first device does not meet the first preset performance indicator threshold, the second super-resolution information that the first device can currently support is determined based on the current device performance data corresponding to the first device, and the target super-resolution information is determined based on the first super-resolution information and the second super-resolution information.
[0106] In one or more embodiments of the present disclosure, when determining target super-resolution information according to the first super-resolution information and the second super-resolution information, the super-resolution information determining unit 402 is configured to:
[0107] Minimum super-resolution information between the first super-resolution information and the second super-resolution information is determined, and the minimum super-resolution information is determined as the target super-resolution information.
[0108] In one or more embodiments of the present disclosure, when determining the second super-resolution information currently supported by the first device based on the current device performance data corresponding to the first device, the super-resolution information determining unit 402 is configured to:
[0109] Determining a target device performance data difference between a second preset performance indicator threshold and current device performance data corresponding to the first device;
[0110] According to the mapping relationship between the preset device performance data difference and the preset super-resolution information, the preset super-resolution information corresponding to the target device performance data difference is searched, and the preset super-resolution information corresponding to the target device performance data difference is determined as the second super-resolution information.
[0111] In one or more embodiments of the present disclosure, the device further includes an image quality data unit, configured to:
[0112] Acquire multiple frames of original screen images of the target live video, determine the real-time image quality data of the target live video at the target definition information based on the multiple frames of original screen images, and send the data to the server.
[0113] In one or more embodiments of the present disclosure, when acquiring target clarity information corresponding to a target live video, the acquiring unit is configured to:
[0114] After the first device starts playing the target live video or during the playback of the target live video, in response to a clarity setting instruction, determining target clarity information corresponding to the target live video; or
[0115] Default definition information or historical definition information is obtained as target definition information corresponding to the target live video.
[0116] The device provided in this embodiment can be used to execute the technical solution of the method embodiment on the first device side mentioned above. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.
[0117] Corresponding to the server-side live broadcast processing method described above, Figure 5 is a block diagram of the live broadcast processing device provided by the present embodiment. For ease of illustration, only the portions relevant to the present embodiment are shown. Referring to Figure 5 , the live broadcast processing device 500 includes an acquisition unit 501 and a transmission unit 502.
[0118] The acquisition unit 501 is configured to acquire image quality data corresponding to each definition information of the target live video;
[0119] The sending unit 502 is used to send the image quality data corresponding to the target live video and the target clarity information to the first device, so that the first device determines the first super-resolution information based on the image quality data corresponding to the target clarity information, and determines the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device.
[0120] In one or more embodiments of the present disclosure, when acquiring the image quality data corresponding to each definition information of the target live video, the acquiring unit 501 is configured to:
[0121] Receiving real-time image quality data of the target live video sent by multiple second devices that use any definition information to play the live video of the target live broadcast room, and determining final real-time image quality data of the definition information based on the multiple real-time image quality data;
[0122] Obtaining optimal image quality data corresponding to any definition information of a plurality of second live videos similar to the target live video, and determining optimal image quality data of any definition information of the target live video based on the optimal image quality data corresponding to any definition information of the plurality of second live videos;
[0123] According to the real-time picture quality data and the best picture quality data of any clarity information of the target live video, the picture quality data corresponding to any clarity information of the target live video is obtained.
[0124] The device provided in this embodiment can be used to execute the technical solution of the method embodiment on the server side. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.
[0125] Referring to FIG6 , a schematic diagram of the structure of an electronic device 600 suitable for implementing an embodiment of the present disclosure is shown. The electronic device 600 may be a device or a server. The device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG6 is merely an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.
[0126] As shown in Figure 6, the electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 into a random access memory (RAM) 603. Various programs and data required for the operation of the electronic device 600 are also stored in the RAM 603. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.
[0127] Typically, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 608 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. Although FIG. 6 shows an electronic device 600 having various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.
[0128] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 609, or installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processing device 601, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.
[0129] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.
[0130] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0131] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.
[0132] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).
[0133] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0134] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."
[0135] The functions described above in the present disclosure may be performed at least in part by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0136] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0137] In a first aspect, according to one or more embodiments of the present disclosure, a live broadcast processing method is provided, which is applied to a first device, and the method includes:
[0138] Obtain the target clarity information corresponding to the target live video;
[0139] Acquire image quality data corresponding to the target live video and the target definition information, and determine first super-resolution information according to the image quality data corresponding to the target definition information;
[0140] Target super-resolution information is determined based on the first super-resolution information and current device performance data corresponding to the first device, and the target live video image is processed based on the target super-resolution information.
[0141] According to one or more embodiments of the present disclosure, the picture quality data corresponding to the target clarity information includes real-time picture quality data and optimal picture quality data of the target clarity information, and the real-time picture quality data is obtained based on the picture quality data of the target live video of multiple second devices that use the target clarity information to play the target live video.
[0142] According to one or more embodiments of the present disclosure, determining the first super-resolution information according to the image quality data corresponding to the target definition information includes:
[0143] Determining a target image quality data difference between the optimal image quality data of the target definition information and the real-time image quality data;
[0144] According to a mapping relationship between a preset image quality data difference and preset super-resolution information, the preset super-resolution information corresponding to the target image quality data difference is determined as the first super-resolution information.
[0145] According to one or more embodiments of the present disclosure, the method further includes:
[0146] Obtaining image quality data corresponding to each definition information of the target live video from the server, wherein the image quality data corresponding to any definition information includes real-time image quality data and optimal image quality data of the definition information;
[0147] Accordingly, the step of obtaining the image quality data corresponding to the target live video and the target definition information includes:
[0148] The image quality data corresponding to the target live video and the target clarity information is obtained from the image quality data corresponding to each clarity information of the target live video.
[0149] According to one or more embodiments of the present disclosure, determining target super-resolution information based on the first super-resolution information and current device performance data corresponding to the first device includes:
[0150] If it is determined that the current device performance data corresponding to the first device meets a first preset performance indicator threshold, determining the first super-resolution information as the target super-resolution information; or
[0151] If it is determined that the current device performance data corresponding to the first device does not meet the first preset performance indicator threshold, the second super-resolution information that the first device can currently support is determined based on the current device performance data corresponding to the first device, and the target super-resolution information is determined based on the first super-resolution information and the second super-resolution information.
[0152] According to one or more embodiments of the present disclosure, determining target super-resolution information according to the first super-resolution information and the second super-resolution information includes:
[0153] Minimum super-resolution information between the first super-resolution information and the second super-resolution information is determined, and the minimum super-resolution information is determined as the target super-resolution information.
[0154] According to one or more embodiments of the present disclosure, determining, based on current device performance data corresponding to the first device, second super-resolution information currently supported by the first device includes:
[0155] Determining a target device performance data difference between a second preset performance indicator threshold and current device performance data corresponding to the first device;
[0156] According to the mapping relationship between the preset device performance data difference and the preset super-resolution information, the preset super-resolution information corresponding to the target device performance data difference is searched, and the preset super-resolution information corresponding to the target device performance data difference is determined as the second super-resolution information.
[0157] According to one or more embodiments of the present disclosure, the method further includes:
[0158] Acquire multiple frames of original screen images of the target live video, determine the real-time image quality data of the target live video at the target definition information based on the multiple frames of original screen images, and send the data to the server.
[0159] According to one or more embodiments of the present disclosure, obtaining target clarity information corresponding to a target live video includes:
[0160] After the first device starts playing the target live video or during the playback of the target live video, in response to a clarity setting instruction, determining target clarity information corresponding to the target live video; or
[0161] Default definition information or historical definition information is obtained as target definition information corresponding to the target live video.
[0162] In a second aspect, according to one or more embodiments of the present disclosure, a live broadcast processing method is provided, which is applied to a server, and the method includes:
[0163] Obtain the image quality data corresponding to each definition information of the target live video;
[0164] Send the image quality data corresponding to the target live video and target clarity information to the first device, so that the first device determines the first super-resolution information based on the image quality data corresponding to the target clarity information, and determines the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device.
[0165] According to one or more embodiments of the present disclosure, obtaining image quality data corresponding to each clarity information of the target live video includes:
[0166] Receiving real-time image quality data of the target live video sent by multiple second devices that use any definition information to play the live video of the target live broadcast room, and determining final real-time image quality data of the definition information based on the multiple real-time image quality data;
[0167] Obtaining optimal image quality data corresponding to any definition information of a plurality of second live videos similar to the target live video, and determining optimal image quality data of any definition information of the target live video based on the optimal image quality data corresponding to any definition information of the plurality of second live videos;
[0168] According to the real-time picture quality data and the best picture quality data of any clarity information of the target live video, the picture quality data corresponding to any clarity information of the target live video is obtained.
[0169] In a third aspect, according to one or more embodiments of the present disclosure, a live broadcast processing device is provided, including:
[0170] An acquisition unit, configured to acquire target definition information corresponding to a target live video;
[0171] a super-resolution information determining unit, configured to obtain image quality data corresponding to the target live video and the target definition information, determine first super-resolution information based on the image quality data corresponding to the target definition information; and determine target super-resolution information based on the first super-resolution information and current device performance data corresponding to the first device;
[0172] A super-resolution execution unit is used to process the target live video according to the target super-resolution information.
[0173] According to one or more embodiments of the present disclosure, the picture quality data corresponding to the target clarity information includes real-time picture quality data and optimal picture quality data of the target clarity information, and the real-time picture quality data is obtained based on the picture quality data of the target live video of multiple second devices that use the target clarity information to play the target live video.
[0174] According to one or more embodiments of the present disclosure, when determining the first super-resolution information based on the image quality data corresponding to the target definition information, the super-resolution execution unit is configured to:
[0175] Determining a target image quality data difference between the optimal image quality data of the target definition information and the real-time image quality data;
[0176] According to a mapping relationship between a preset image quality data difference and preset super-resolution information, the preset super-resolution information corresponding to the target image quality data difference is determined as the first super-resolution information.
[0177] According to one or more embodiments of the present disclosure, the super-resolution execution unit is further configured to:
[0178] Obtaining image quality data corresponding to each definition information of the target live video from the server, wherein the image quality data corresponding to any definition information includes real-time image quality data and optimal image quality data of the definition information;
[0179] Accordingly, when acquiring the image quality data corresponding to the target live video and the target definition information, the super-resolution execution unit is configured to:
[0180] The image quality data corresponding to the target live video and the target clarity information is obtained from the image quality data corresponding to each clarity information of the target live video.
[0181] According to one or more embodiments of the present disclosure, when determining target super-resolution information based on the first super-resolution information and current device performance data corresponding to the first device, the super-resolution execution unit is configured to:
[0182] If it is determined that the current device performance data corresponding to the first device meets a first preset performance indicator threshold, determining the first super-resolution information as the target super-resolution information; or
[0183] If it is determined that the current device performance data corresponding to the first device does not meet the first preset performance indicator threshold, the second super-resolution information that the first device can currently support is determined based on the current device performance data corresponding to the first device, and the target super-resolution information is determined based on the first super-resolution information and the second super-resolution information.
[0184] According to one or more embodiments of the present disclosure, when determining target super-resolution information according to the first super-resolution information and the second super-resolution information, the super-resolution execution unit is configured to:
[0185] Minimum super-resolution information between the first super-resolution information and the second super-resolution information is determined, and the minimum super-resolution information is determined as the target super-resolution information.
[0186] According to one or more embodiments of the present disclosure, when determining, based on current device performance data corresponding to the first device, second super-resolution information that the first device can currently support, the super-resolution execution unit is configured to:
[0187] Determining a target device performance data difference between a second preset performance indicator threshold and current device performance data corresponding to the first device;
[0188] According to the mapping relationship between the preset device performance data difference and the preset super-resolution information, the preset super-resolution information corresponding to the target device performance data difference is searched, and the preset super-resolution information corresponding to the target device performance data difference is determined as the second super-resolution information.
[0189] According to one or more embodiments of the present disclosure, the device further includes an image quality data unit, configured to:
[0190] Acquire multiple frames of original screen images of the target live video, determine the real-time image quality data of the target live video at the target definition information based on the multiple frames of original screen images, and send the data to the server.
[0191] According to one or more embodiments of the present disclosure, when acquiring target definition information corresponding to a target live video, the acquiring unit is configured to:
[0192] After the first device starts playing the target live video or during the playback of the target live video, in response to a clarity setting instruction, determining target clarity information corresponding to the target live video; or
[0193] Default definition information or historical definition information is obtained as target definition information corresponding to the target live video.
[0194] In a fourth aspect, according to one or more embodiments of the present disclosure, a live broadcast processing device is provided, including:
[0195] An acquisition unit, configured to acquire image quality data corresponding to each definition information of a target live video;
[0196] A sending unit is used to send the image quality data corresponding to the target live video and the target clarity information to the first device, so that the first device determines the first super-resolution information based on the image quality data corresponding to the target clarity information, and determines the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device.
[0197] According to one or more embodiments of the present disclosure, when acquiring the image quality data corresponding to each clarity information of the target live video, the acquisition unit is configured to:
[0198] Receiving real-time image quality data of the target live video sent by multiple second devices that use any definition information to play the live video of the target live broadcast room, and determining final real-time image quality data of the definition information based on the multiple real-time image quality data;
[0199] Obtaining optimal image quality data corresponding to any definition information of a plurality of second live videos similar to the target live video, and determining optimal image quality data of any definition information of the target live video based on the optimal image quality data corresponding to any definition information of the plurality of second live videos;
[0200] According to the real-time picture quality data and the best picture quality data of any clarity information of the target live video, the picture quality data corresponding to any clarity information of the target live video is obtained.
[0201] In a fifth aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;
[0202] The memory stores computer-executable instructions;
[0203] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the live broadcast processing method described in the first aspect and various possible designs of the first aspect, or the live broadcast processing method described in the second aspect and various possible designs of the second aspect.
[0204] In the sixth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer execution instructions are stored. When the processor executes the computer execution instructions, the live broadcast processing method described in the first aspect and various possible designs of the first aspect, or the live broadcast processing method described in the second aspect and various possible designs of the second aspect is implemented.
[0205] In the seventh aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, comprising computer execution instructions. When a processor executes the computer execution instructions, the live broadcast processing method described in the first aspect and various possible designs of the first aspect, or the live broadcast processing method described in the second aspect and various possible designs of the second aspect is implemented.
[0206] The above description is merely an example of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.
[0207] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0208] Although the present disclosure has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.
Claims
1. A live broadcast processing method, applied to a first device, comprising: Obtain the target clarity information corresponding to the target live video; Acquire image quality data corresponding to the target live video and the target definition information, and determine first super-resolution information based on the image quality data; Target super-resolution information is determined based on the first super-resolution information and current device performance data corresponding to the first device, and the target live video image is processed based on the target super-resolution information.
2. The method according to claim 1, wherein The picture quality data includes real-time picture quality data and optimal picture quality data. The real-time picture quality data is obtained based on the picture quality data of the target live video of multiple second devices that use target clarity information to play the target live video.
3. The method according to claim 2, wherein: The determining of the first super-resolution information according to the image quality data corresponding to the target definition information includes: Determining a target image quality data difference between the optimal image quality data of the target definition information and the real-time image quality data; According to a mapping relationship between a preset image quality data difference and preset super-resolution information, the preset super-resolution information corresponding to the target image quality data difference is determined as the first super-resolution information.
4. The method according to claim 2 or 3, further comprising: Obtaining image quality data corresponding to each definition information of the target live video from the server, wherein the image quality data corresponding to any definition information includes real-time image quality data and optimal image quality data of the definition information; Accordingly, the step of obtaining the image quality data corresponding to the target live video and the target definition information includes: The image quality data corresponding to the target live video and the target clarity information is obtained from the image quality data corresponding to each clarity information of the target live video.
5. The method according to any one of claims 2 to 4, wherein: The determining target super-resolution information according to the first super-resolution information and current device performance data corresponding to the first device includes: If it is determined that the current device performance data corresponding to the first device meets a first preset device performance data threshold, determining the first super-resolution information as the target super-resolution information; or If it is determined that the current device performance data corresponding to the first device does not meet the first preset device performance data threshold, the second super-resolution information that the first device can currently support is determined based on the current device performance data corresponding to the first device, and the target super-resolution information is determined based on the first super-resolution information and the second super-resolution information.
6. The method according to claim 5, wherein: The determining target super-resolution information according to the first super-resolution information and the second super-resolution information includes: Minimum super-resolution information between the first super-resolution information and the second super-resolution information is determined, and the minimum super-resolution information is determined as the target super-resolution information.
7. The method according to claim 5 or 6, wherein: The determining, according to current device performance data corresponding to the first device, second super-resolution information currently supported by the first device includes: determining a target device performance data difference between a second preset device performance data threshold and current device performance data corresponding to the first device; According to the mapping relationship between the preset device performance data difference and the preset super-resolution information, the preset super-resolution information corresponding to the target device performance data difference is searched, and the preset super-resolution information corresponding to the target device performance data difference is determined as the second super-resolution information.
8. The method according to claim 4, further comprising: Acquire multiple frames of original screen images of the target live video, determine the real-time image quality data of the target live video at the target definition information based on the multiple frames of original screen images, and send the data to the server.
9. The method according to any one of claims 1 to 8, wherein: The obtaining target definition information corresponding to the target live video includes: After the first device starts playing the target live video or during the playback of the target live video, in response to a definition setting instruction, determining target definition information corresponding to the target live video; or Default definition information or historical definition information is obtained as target definition information corresponding to the target live video.
10. A live broadcast processing method, applied to a server, comprising: Obtain the image quality data corresponding to each definition information of the target live video; Send the image quality data corresponding to the target live video and the target clarity information to the first device, so that the first device determines the first super-resolution information based on the image quality data corresponding to the target clarity information, and determines the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device.
11. The method according to claim 10, wherein: The obtaining of image quality data corresponding to each definition information of the target live video includes: receiving real-time image quality data of the target live video sent by multiple second devices that use any definition information to play the target live video, and determining final real-time image quality data of any definition information based on the multiple real-time image quality data; Obtaining optimal image quality data corresponding to any definition information of a plurality of second live videos similar to the target live video, and determining optimal image quality data of any definition information of the target live video based on the optimal image quality data corresponding to any definition information of the plurality of second live videos; According to the real-time picture quality data and the best picture quality data of any clarity information of the target live video, the picture quality data corresponding to any clarity information of the target live video is obtained.
12. A live broadcast processing device, comprising: an acquiring unit, configured to acquire target definition information corresponding to a target live video; a super-resolution information determining unit configured to obtain image quality data corresponding to the target live video and the target definition information, determine first super-resolution information based on the image quality data corresponding to the target definition information; and determine target super-resolution information based on the first super-resolution information and current device performance data corresponding to the first device; The super-resolution execution unit is configured to process the target live video according to the target super-resolution information.
13. A live broadcast processing device, comprising: an acquiring unit configured to acquire image quality data corresponding to each definition information of a target live video; The sending unit is configured to send the image quality data corresponding to the target live video and the target clarity information to the first device, so that the first device determines the first super-resolution information based on the image quality data corresponding to the target clarity information, and determines the target super-resolution information based on the first super-resolution information and the current device performance data corresponding to the first device.
14. An electronic device comprising at least one processor and a memory, wherein: The memory stores computer-executable instructions; The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the live broadcast processing method as described in any one of claims 1-11.
15. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer-executable instructions. When the processor executes the computer-executable instructions, the live broadcast processing method according to any one of claims 1 to 11 is implemented.
16. A computer program product comprising computer-executable instructions, wherein: When the processor executes the computer-executable instruction, the live broadcast processing method according to any one of claims 1 to 11 is implemented.
Citation Information
Patent Citations
Video display method and device, terminal and storage medium
CN113055742A
Video transmission method, device and system
CN114401422A
Video gear determination method and device, storage medium and electronic equipment
CN115633199A
Image super-resolution method and device, server and storage medium
CN115775204A
Image processing method, system, electronic device and computer readable storage medium
WO2022007862A1