Video display method and device, equipment and storage medium
By dividing the video image area and adjusting the pixels, the problem of poor video image quality of electronic devices at low network transmission rates is solved, and the dynamic adaptation of video images with user needs is achieved, improving the stability of video display and users' Experience.
Patent Information
- Application Number
- CN202310629896.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-30
- Publication Date
- 2024-12-03
AI Technical Summary
When presenting video images, existing electronic devices are limited by device size, antenna performance and battery capacity, and network transmission rate affects the quality of video images, and cannot effectively adapt to user needs in different scenarios.
By obtaining the original video screen, dividing the area and adjusting pixels for each sub-region according to the current network transmission rate, dynamically adjusting the clarity to form a target video screen to adapt to the network transmission rate and user needs.
It improves the stability and smoothness of the video image at low network transmission rates, meets the user's clarity needs in different scenarios, and enhances the adaptability and user experience of video display.
Smart Images

Figure CN119071543A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to terminal device technology, and relate to but are not limited to a video display method and apparatus, equipment, and storage medium. Background Art
[0002] With the development of video technology, video calls and live broadcasts have gradually become an important part of many people's daily lives. In real life, users can present video images through built-in cameras and wireless networks in electronic devices.
[0003] Among them, some electronic devices are limited by device size, and their antenna performance and battery capacity are limited, which will affect the presentation of video images; in addition, the network transmission rate will also directly affect the presentation of video images, and users also have specific requirements for the presentation of video images in different scenarios.
[0004] However, the video image presentation function provided by current electronic devices cannot adapt well to the current network transmission rate and user needs. Summary of the invention
[0005] In view of this, the video display method, device, equipment, and storage medium provided in the embodiments of the present application can make the presented video images more adaptable to the current network transmission rate and user needs. The video display method, device, equipment, and storage medium provided in the embodiments of the present application are implemented as follows:
[0006] The video display method provided in the embodiment of the present application includes:
[0007] Get the original video picture;
[0008] Dividing the original video image into regions to obtain a plurality of sub-regions;
[0009] According to the current network transmission rate, pixel adjustment is performed on each of the sub-areas to obtain a plurality of adjustment areas, wherein the plurality of adjustment areas have different sharpnesses;
[0010] A target video screen consisting of a plurality of the adjustment areas is displayed.
[0011] In some embodiments, the original video screen is divided into regions to obtain multiple sub-regions, including:
[0012] Identifying the content of the original video image;
[0013] According to the importance of the content of the picture, the original video picture is divided into regions to obtain the multiple sub-regions with different importance.
[0014] In some embodiments, according to the current network transmission rate, pixel adjustment is performed on each of the sub-areas to obtain multiple adjustment areas, including:
[0015] Determining a first weight for pixel adjustment of the original video picture according to the current network transmission rate, wherein the lower the network transmission rate, the smaller the first weight;
[0016] Determining a second weight for pixel adjustment of each sub-region according to the importance of each sub-region, wherein the higher the importance of the sub-region, the greater the second weight corresponding to the sub-region;
[0017] According to the first weight and the second weight corresponding to each of the sub-regions, pixel adjustment is performed on each of the sub-regions to obtain the multiple adjustment regions.
[0018] In some embodiments, pixel adjustment is performed on each of the sub-regions according to the first weight and the second weight corresponding to each of the sub-regions to obtain the multiple adjustment regions, including:
[0019] Obtaining a target weight corresponding to each of the sub-regions according to the first weight and the second weight corresponding to each of the sub-regions;
[0020] According to the target weight corresponding to each of the sub-regions, pixel adjustment is performed on each of the sub-regions to obtain the multiple adjustment regions.
[0021] In some embodiments, when the current network transmission rate is greater than a network speed threshold, the data volume of the target video picture is greater than the data volume of the original video picture; when the current network transmission rate is less than or equal to the network speed threshold, the data volume of the target video picture is less than the data volume of the original video picture.
[0022] In some embodiments, performing pixel adjustment on each sub-region separately to obtain multiple adjustment regions includes: performing bit rate adjustment and / or resolution adjustment on each sub-region separately to obtain multiple adjustment regions.
[0023] In some embodiments, the picture content includes a human face, and the original video picture is divided into regions according to the importance of the picture content to obtain the multiple sub-regions with different importance, including:
[0024] The face area in the picture content is determined as the first sub-area, the torso area in the picture content is determined as the second sub-area, and the background area in the picture content is determined as the third sub-area, the importance of the first sub-area is greater than the importance of the second sub-area, and the importance of the second sub-area is greater than the importance of the third sub-area.
[0025] In some embodiments, the method further comprises:
[0026] receiving a pixel adjustment instruction for a target adjustment area, wherein the target adjustment area is any area among the multiple adjustment areas;
[0027] In response to the pixel adjustment instruction, the pixel density of the target adjustment area is adjusted to obtain an adjusted target adjustment area, wherein the clarity of the adjusted target adjustment area is greater than the clarity of the target adjustment area.
[0028] In some embodiments, the original video screen is collected during a video call, and the original video screen is divided into regions to obtain multiple sub-regions, including:
[0029] According to the key information of the call content collected during the video call, the original video screen is divided into regions to obtain the multiple sub-regions with different importance levels.
[0030] In some embodiments, the original video screen is divided into regions to obtain multiple sub-regions, including:
[0031] Acquire scene information in the original video picture;
[0032] The original video screen is divided into regions according to the scene information to obtain the multiple sub-regions with different importance levels.
[0033] The video display device provided in the embodiment of the present application includes:
[0034] An acquisition module is used to acquire the original video image;
[0035] A division module, used for dividing the original video image into regions to obtain a plurality of sub-regions;
[0036] An adjustment module, configured to adjust pixels of each sub-region according to a current network transmission rate to obtain a plurality of adjustment regions, wherein the plurality of adjustment regions have different sharpnesses;
[0037] The display module is used to display a target video picture composed of a plurality of the adjustment areas.
[0038] The computer device provided in the embodiment of the present application includes a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, the method described in the embodiment of the present application is implemented.
[0039] The computer-readable storage medium provided in the embodiment of the present application stores a computer program thereon, and when the computer program is executed by a processor, the method provided in the embodiment of the present application is implemented.
[0040] The video display method, device, computer equipment and computer-readable storage medium provided in the embodiments of the present application obtain the original video screen and divide the original video screen into regions to obtain multiple sub-regions; then, according to the current network transmission rate, each sub-region is pixel-adjusted to obtain multiple adjustment regions, and the clarity of the multiple adjustment regions is different, and finally the target video screen composed of multiple adjustment regions is displayed. In this way, the clarity of each sub-region can be dynamically adjusted and presented according to the network transmission rate and the sub-regions of the divided video screen, so that the presented video screen can be more adapted to the current network transmission rate and user needs, thereby solving the problems raised in the background technology. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application.
[0042] Figure 1 An application scenario diagram of the video display method provided in an embodiment of the present application;
[0043] Figure 2 A schematic diagram of an implementation flow of a video display method provided in an embodiment of the present application;
[0044] Figure 3 A schematic diagram of the implementation flow of another video display method provided in an embodiment of the present application;
[0045] Figure 4 A schematic diagram of the implementation process of the screen area division method provided in an embodiment of the present application;
[0046] Figure 5 A schematic diagram of the result of dividing the screen area provided in the embodiment of the present application;
[0047] Figure 6 A schematic diagram of the result of adjusting the picture area provided in an embodiment of the present application;
[0048] Figure 7 A schematic diagram of the implementation process of the screen area adjustment method provided in the embodiment of the present application;
[0049] Figure 8 A schematic diagram of the implementation process of the screen area adjustment method provided in the embodiment of the present application;
[0050] Fig. 9 A schematic diagram of the structure of a video display device provided in an embodiment of the present application;
[0051] Fig.10 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0052] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the specific technical scheme of the present application will be further described in detail below in conjunction with the drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application, but are not used to limit the scope of the present application.
[0053] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.
[0054] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0055] It should be pointed out that the terms "first\second\third" involved in the embodiments of the present application are used to distinguish similar or different objects, and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.
[0056] In real life, users can watch video images presented on electronic devices to meet various life needs such as video calls and watching live broadcasts.
[0057] However, when presenting video images, some electronic devices are limited by the size of the device, and their antenna performance and battery capacity are limited, which will affect the presentation of the video images. For example, in order to improve the battery life of electronic devices, some electronic devices will reduce the power consumption of the network by supporting lower-speed communication modules. For example, connecting to the network through LTE Cat.1, it becomes a challenge to realize the video call function under low-speed network connection. Alternatively, due to the influence of antenna performance, the network transmission rate will also directly affect the presentation of the video image. For example, the network connection of electronic devices is often unstable, resulting in a decrease in communication rate, which often causes the video image to be stuck or blurred when presented. In addition, users also have specific requirements for the presentation of video images in different scenarios. For example, in some scenarios, users need to watch clearer video images, while in some scenarios, they need to watch relatively blurry video images.
[0058] However, the video image presentation function provided by current electronic devices cannot adapt well to the current network transmission rate and user needs.
[0059] In view of this, an embodiment of the present application provides a video display method, which is applied to an electronic device with a built-in camera. Figure 1 FIG. 1 is an application scenario diagram of a video display method provided in an embodiment. Figure 1 As shown, the user can carry, wear or use an electronic device 10, which may include but is not limited to a mobile phone, a wearable device (such as a smart watch, a smart bracelet, smart glasses, etc.), a tablet computer, a laptop computer, a vehicle terminal, a PC (Personal Computer), etc. The function implemented by the method can be implemented by calling a program code by a processor in the electronic device, and of course the program code can be stored in a computer storage medium. It can be seen that the electronic device at least includes a processor and a storage medium.
[0060] Figure 2 The following is a schematic diagram of the implementation process of the video display method provided in the embodiment of the present application. Figure 2 As shown, the method may include the following steps 201 to 204:
[0061] Step 201, obtaining the original video image.
[0062] It should be noted that the method provided in the embodiments of the present application can be applied to scenarios where real-time transmission of video images occurs, such as application scenarios such as video calls or watching live video broadcasts.
[0063] In the embodiment of the present application, there is no limitation on the timing of acquiring the original video picture. For example, it can be acquired before the original video picture is presented on the electronic device, that is, before the original video picture is transmitted to the electronic device; it can also be acquired after the original video picture is presented on the electronic device.
[0064] Similarly, based on the different timings of acquiring the original video images, the triggering timing of executing the video display method in the embodiments of the present application may also be different.
[0065] For example, it can be automatically triggered and implemented before the original video screen is presented on the electronic device, that is, during the transmission process of the original video screen; it can also be automatically triggered and implemented in response to the trigger instruction before the original video screen is presented on the electronic device and after receiving the trigger instruction (that is, the execution instruction for starting the video display method), during the transmission process of the original video screen; it can also be automatically triggered and implemented after the original video screen is presented on the electronic device; or the video display method can be implemented after the original video screen is presented on the electronic device and the trigger instruction (that is, the execution instruction for starting the video display method) is received, etc.
[0066] Of course, there is no limitation on the device that sends the trigger instruction. For example, in the application scenario of video call or video live broadcast, the device that sends the trigger instruction can be the initiator of the video call or video live broadcast, or the receiver of the video call or video live broadcast.
[0067] Step 202: divide the original video image into regions to obtain a plurality of sub-regions.
[0068] It is understandable that in different application scenarios, users may have different requirements for the clarity of video images; further, in the same application scenario, users may have different requirements for the clarity of different areas in the same video image.
[0069] Based on this, in an embodiment of the present application, after the original video picture is obtained, the original video picture can be divided into regions to obtain multiple sub-regions to meet different needs of users.
[0070] Step 203 , according to the current network transmission rate, pixel adjustment is performed on each sub-region to obtain multiple adjustment regions, and the multiple adjustment regions have different sharpness.
[0071] It is understandable that electronic devices often experience unstable connections during the network connection process, that is, the network transmission rate is low, which will cause the communication rate to drop, and then cause the video display function to often be stuck; alternatively, if the current network transmission rate of the electronic device is higher, it can also support higher communication rates and video display clarity.
[0072] Therefore, in order to better adapt to the current network transmission rate, the original video image can be adjusted according to the current network transmission rate. For example, when the current network transmission rate is low, the clarity of the original video image can be lowered to reduce the amount of communication data and improve the stability and smoothness of video image transmission and display; or, when the current network transmission rate is high, the clarity of the original video image can be increased to improve the user's viewing experience while adapting to the current network transmission rate.
[0073] Furthermore, since users have different clarity requirements for different sub-areas of the same video screen, pixels of each sub-area can be adjusted separately under the current network transmission rate to obtain multiple adjustment areas with different clarity, so that the presented video screen is more adapted to the current network transmission rate and user needs.
[0074] In some embodiments, step 203 may be implemented by executing steps 303 to 305 in the following embodiments.
[0075] Step 204: display the target video screen composed of multiple adjustment areas.
[0076] In the embodiment of the present application, the original video screen is obtained and divided into regions to obtain multiple sub-regions; then, according to the current network transmission rate, each sub-region is pixel-adjusted to obtain multiple adjustment regions, and the clarity of the multiple adjustment regions is different, and finally the target video screen composed of multiple adjustment regions is displayed. In this way, the clarity of each sub-region can be dynamically adjusted and presented according to the network transmission rate and the sub-regions of the divided video screen, so that the presented video screen can be more adapted to the current network transmission rate and user needs.
[0077] Figure 3 The following is a schematic diagram of the implementation process of the video display method provided in the embodiment of the present application. Figure 3 As shown, the method may include the following steps 301 to 305:
[0078] Step 301, obtaining the original video image.
[0079] Step 302: divide the original video image into regions to obtain a plurality of sub-regions with different importance levels.
[0080] In the embodiments of the present application, the specific division method of dividing the original video screen into regions varies according to different application scenarios.
[0081] For example, in some embodiments, the area division of the picture can be achieved by executing the following steps 401 to 402:
[0082] Step 401, identifying the picture content in the original video picture.
[0083] It is understandable that for the same original video screen, the user's attention to the content of different regions in the video screen is generally different. Therefore, the screen content in the original video screen can be identified first, and the regions can be divided according to the importance of the screen content.
[0084] Here, the specific method for identifying the content of the original video screen is not limited, for example, the method may be based on a network recognition model or a region of interest extraction method.
[0085] Step 402: divide the original video image into regions according to the importance of the image content to obtain a plurality of sub-regions with different importance.
[0086] Here, there is no limitation on the method for determining the importance of the screen content. For example, it can be determined based on the user's attention or the screen composition form.
[0087] When determining the importance of a picture based on the user's attention, the importance of the picture content can be determined by detecting the duration of the user's gaze. The longer the duration of the gaze, the higher the importance of the corresponding area. Alternatively, it can be determined based on the user's historical behavior habits. For example, if analysis shows that the user pays more attention to the central area of the video screen in historical behavior, the central sub-area of the video area can be determined as the most important sub-area, etc.
[0088] It can be understood that for video call scenarios or video live broadcast scenarios, in the above process, the user's face area is the subject captured by the camera of the electronic device. Therefore, in a specific embodiment, if the screen content of the original video screen includes a face, the face area in the screen content can be determined as the first sub-area, the torso area in the screen content can be determined as the second sub-area, and the background area in the screen content can be determined as the third sub-area. Among them, the importance of the first sub-area is greater than the importance of the second sub-area, and the importance of the second sub-area is greater than the importance of the third sub-area.
[0089] For example, if Figure 5 As shown, Figure 5The original video screen is shown. The image recognition algorithm is implemented on the original video screen by the processor of the electronic device to identify the face area in the original video image and mark it as the first sub-area A; identify the torso area in the picture content and mark it as the second sub-area B; identify the surrounding environment area (i.e., the background area) in the picture content and mark it as the third sub-area C, and the importance of the first sub-area can be set to be greater than that of the second sub-area, and the importance of the second sub-area can be set to be greater than that of the third sub-area.
[0090] In other embodiments, if the original video screen is collected during a video call, the original video screen can be divided into regions according to key information of the call content collected during the video call to obtain multiple sub-regions with different importance.
[0091] Here, the area division is performed based on the key information of the call content collected during the call. For example, if the video call content collected is "Do you think my brooch is beautiful?", the importance of the brooch area can be determined through the call content; or if the video call content collected is "Look at how green the tree behind me is", the importance of the background area in the original video screen can be determined through the call content.
[0092] In some further embodiments, scene information in the original video picture may also be obtained; the original video picture may be divided into regions according to the scene information to obtain a plurality of sub-regions with different importance levels.
[0093] Here, the region division is performed based on the scene information in the original video screen. For example, if the scene information of the original video screen obtained is a concert scene, the background area including the concert scene can be determined as the key area, so that the importance of the background area can be determined to be high.
[0094] Step 303: Determine a first weight for pixel adjustment of the original video image according to the current network transmission rate. The lower the network transmission rate, the smaller the first weight.
[0095] It should be noted that, in the embodiment of the present application, when the pixels of the original video picture are adjusted according to the current network transmission rate, the pixels of the entire original video picture are adjusted based on the current network transmission rate.
[0096] For example, if the current network transmission rate is greater than the network threshold, then when the pixels of the original video picture are adjusted, the pixel value of the original video picture can be adjusted higher, that is, the larger the first weight is, the value less than 1 can be; if the current network transmission rate is less than or equal to the network threshold, then when the pixels of the original video picture are adjusted, the pixel value of the original video picture can be adjusted lower, that is, the larger the first weight is, the value greater than 1 can be.
[0097] Therefore, it can be seen that when the current network transmission rate is greater than the network speed threshold, the data volume of the target video picture obtained after adjustment is greater than the data volume of the original video picture; when the current network transmission rate is less than or equal to the network speed threshold, the data volume of the target video picture obtained after adjustment is less than the data volume of the original video picture.
[0098] Here, there is no limitation on the specific value of the network threshold, which can be set arbitrarily according to actual needs.
[0099] Step 304: Determine a second weight for pixel adjustment of each sub-region according to the importance of each sub-region. The higher the importance of the sub-region, the greater the second weight corresponding to the sub-region.
[0100] It should be noted that, when adjusting the pixels of each sub-region according to the importance of each sub-region, each sub-region corresponds to a second weight, and the second weights may be the same or different.
[0101] For example, the second weight corresponding to each sub-region can be set to 0.8; or, the second weight corresponding to the first sub-region is set to 0.8, the second weight corresponding to the second sub-region is set to 0.5, the second weight corresponding to the third sub-region is set to 0.3, and so on; or, the second weight corresponding to the first sub-region and the second sub-region is set to 0.8, the second weight corresponding to the third sub-region is set to 0.5, and so on.
[0102] Of course, the specific setting of the second weight is related to the importance of the sub-region. The higher the importance of the sub-region, the greater the second weight corresponding to the sub-region.
[0103] Generally, the value of the second weight can be set to any value less than or equal to 1.
[0104] For example, if Figure 6 As shown, the second weight of the first sub-area A before adjustment can be set to 1, and the pixels of the corresponding adjustment area A after adjustment remain unchanged (clarity remains unchanged); the second weight of the second sub-area B before adjustment can be set to 0.5, and the pixels of the corresponding adjustment area B after adjustment are reduced to 50% of the previous ones; the second weight of the third sub-area C before adjustment can be set to 0.25, and the pixels of the corresponding adjustment area C after adjustment are reduced to 25% of the previous ones.
[0105] Step 305 , adjusting pixels of each sub-region according to the first weight and the second weight corresponding to each sub-region, to obtain a plurality of adjustment regions, wherein the clarity of the plurality of adjustment regions is different.
[0106] It is understandable that the clarity of the picture display is at least related to the bit rate and resolution. When the bit rate is constant, the resolution is inversely proportional to the clarity: the higher the resolution, the less clear the image is; the lower the resolution, the clearer the image is. When the resolution is constant, the bit rate is directly proportional to the clarity: the higher the bit rate, the clearer the image is; the lower the bit rate, the less clear the image is.
[0107] Therefore, in the embodiment of the present application, when performing pixel adjustment on each sub-region, the bit rate adjustment and / or the resolution adjustment may be performed on each sub-region respectively, so as to obtain a plurality of adjustment regions.
[0108] In some embodiments, step 305 may be implemented by executing steps 701 to 702 as follows:
[0109] Step 701: Obtain a target weight corresponding to each sub-region according to the first weight and the second weight corresponding to each sub-region.
[0110] Here, the specific method for determining the target weight is not limited. For example, the first weight and the second weight corresponding to each sub-region may be multiplied to obtain the target weight corresponding to each sub-region; or, the first weight and the second weight corresponding to each sub-region may be added to obtain the target weight corresponding to each sub-region; further, the first weight and each second weight may be allocated a ratio to obtain the target weight corresponding to each sub-region, such as the first weight allocation coefficient is 0.7, the second weight allocation coefficient is 0.3, then the target weight corresponding to each sub-region is 0.7*first weight+0.3*second weight.
[0111] Step 702 , according to the target weight corresponding to each sub-region, pixel adjustment is performed on each sub-region to obtain a plurality of adjustment regions.
[0112] The pixel adjustment for each sub-region may be to adjust the bit rate and / or the resolution for each sub-region respectively, so as to obtain a plurality of adjustment regions.
[0113] In some embodiments, each sub-region may be subjected to a first pixel adjustment based on a first weight to obtain a first adjustment region; and then the first adjustment region may be subjected to a pixel adjustment again based on a second weight corresponding to each sub-region to obtain a second adjustment region corresponding to each sub-region.
[0114] Step 306: display the target video screen composed of multiple adjustment areas.
[0115] It can be understood that whether the data volume of the target video picture is greater than the data volume of the original video picture is related to both the network transmission rate and the user's needs. Generally, when the current network transmission rate is greater than the network speed threshold, the data volume of the target video picture obtained after adjustment is greater than the data volume of the original video picture; when the current network transmission rate is less than or equal to the network speed threshold, the data volume of the target video picture obtained after adjustment is less than the data volume of the original video picture.
[0116] Please refer to Figure 6 , such as Figure 6 By adjusting the weight ratio of each sub-area provided, the data volume of the target video screen obtained after adjustment can be much smaller than the data volume of the original video screen, but in the user's subjective vision, the difference between the two video screens is small. Based on this, the data size of each frame of the video screen when the camera is shooting can be effectively reduced, so that the video display function has better fluency and stability when the network rate is limited.
[0117] It is understandable that after implementing the video display method provided in the embodiment of the present application, since the obtained target video picture is automatically adjusted, the clarity of each sub-area in the target video picture may not meet the actual needs of the user.
[0118] Based on this, in some embodiments, if the user is not satisfied with the displayed target video image, adjustments can be made by performing the following steps 801 to 802:
[0119] Step 801: receiving a pixel adjustment instruction for a target adjustment area, where the target adjustment area is any area among a plurality of adjustment areas.
[0120] Here, there is no limitation on the implementation method of the pixel adjustment instruction. For example, the pixel adjustment instruction may be a click instruction, that is, the user clicks the target adjustment area to trigger the pixel adjustment instruction; the pixel adjustment instruction may also be a voice instruction or a gesture instruction.
[0121] Step 802 , in response to the pixel adjustment instruction, adjusting the pixel density of the target adjustment area to obtain an adjusted target adjustment area, wherein the clarity of the adjusted target adjustment area is greater than the clarity of the target adjustment area before the adjustment.
[0122] After receiving a pixel adjustment instruction, the electronic device can respond to the pixel adjustment instruction and adjust the clarity of the corresponding target adjustment area. Of course, the adjustment instruction can be to increase the clarity of the target adjustment area or to decrease the clarity of the target adjustment area, which can be executed according to user needs.
[0123] In the embodiment of the present application, the original video screen is obtained and divided into regions to obtain multiple sub-regions of different importance; then, according to the current network transmission rate, the first weight for pixel adjustment of the original video screen is determined; then, according to the importance of each sub-region, the second weight for pixel adjustment of each sub-region is determined, so that according to the first weight and the second weight corresponding to each sub-region, each sub-region is pixel adjusted respectively to obtain multiple adjustment regions with different clarity; finally, the target video screen composed of multiple adjustment regions is displayed. In this way, the clarity of each sub-region can be dynamically adjusted and presented according to the network transmission rate and the importance of each sub-region in the video screen, so that the presented video screen can be more adapted to the current network transmission rate and user needs.
[0124] It should be understood that, although the steps in the above-mentioned flowcharts are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the above-mentioned flowcharts may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.
[0125] Based on the foregoing embodiments, an embodiment of the present application provides a video display device, which includes the modules included and the units included in the modules, which can be implemented by a processor; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.
[0126] Fig. 9 A schematic diagram of the structure of a video display device provided in an embodiment of the present application is shown in FIG. Fig. 9 As shown, the device 900 includes an acquisition module 901, a division module 902, an adjustment module 903 and a display module 904, wherein:
[0127] The acquisition module 901 is used to acquire the original video image;
[0128] A division module 902 is used to divide the original video image into regions to obtain multiple sub-regions;
[0129] An adjustment module 903, configured to perform pixel adjustment on each of the sub-regions according to the current network transmission rate, to obtain a plurality of adjustment regions, wherein the plurality of adjustment regions have different sharpnesses;
[0130] The display module 904 is used to display a target video screen composed of a plurality of the adjustment areas.
[0131] In some embodiments, the division module 902 also includes an identification module and a division sub-module, wherein the identification module is used to identify the picture content in the original video picture; the division sub-module is used to divide the original video picture into regions according to the importance of the picture content to obtain the multiple sub-regions with different importance.
[0132] In some embodiments, the adjustment module 903 includes a determination module and an adjustment submodule, wherein the determination module is used to determine a first weight for pixel adjustment of the original video image according to the current network transmission rate, wherein the lower the network transmission rate, the smaller the first weight; and the second weight for pixel adjustment of each subregion is determined according to the importance of each subregion, wherein the higher the importance of the subregion, the larger the second weight corresponding to the subregion; and the adjustment submodule is used to perform pixel adjustment on each subregion according to the first weight and the second weight corresponding to each subregion, to obtain the multiple adjustment regions.
[0133] In some embodiments, the adjustment submodule is specifically used to obtain a target weight corresponding to each of the sub-regions based on the first weight and the second weight corresponding to each of the sub-regions; and to perform pixel adjustments on each of the sub-regions according to the target weight corresponding to each of the sub-regions to obtain the multiple adjustment regions.
[0134] In some embodiments, when the current network transmission rate is greater than a network speed threshold, the data volume of the target video picture is greater than the data volume of the original video picture; when the current network transmission rate is less than or equal to the network speed threshold, the data volume of the target video picture is less than the data volume of the original video picture.
[0135] In some embodiments, the adjustment submodule is further configured to perform bit rate adjustment and / or resolution adjustment on each of the sub-regions to obtain the multiple adjustment regions.
[0136] In some embodiments, the division submodule is specifically used to determine the face area in the picture content as the first sub-area, the torso area in the picture content as the second sub-area, and the background area in the picture content as the third sub-area, and the importance of the first sub-area is greater than the importance of the second sub-area, and the importance of the second sub-area is greater than the importance of the third sub-area.
[0137] In some embodiments, the device also includes a receiving module and a response module, the receiving module is used to receive a pixel adjustment instruction for a target adjustment area, the target adjustment area is any area among the multiple adjustment areas; the response module is used to adjust the pixel density of the target adjustment area in response to the pixel adjustment instruction to obtain an adjusted target adjustment area, the clarity of the adjusted target adjustment area is greater than the clarity of the target adjustment area.
[0138] In some embodiments, the original video screen is collected during a video call, and the division submodule is specifically used to divide the original video screen into regions according to key information of the call content collected during the video call to obtain the multiple sub-regions with different importance.
[0139] In some embodiments, the division submodule is further used to obtain scene information in the original video picture; and divide the original video picture into regions according to the scene information to obtain the multiple sub-regions with different importance levels.
[0140] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.
[0141] It should be noted that in the embodiments of this application Fig. 9 The division of modules in the video display device shown is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional unit in each embodiment of the present application may be integrated into a processing unit, or may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of a software functional unit. It may also be implemented in the form of a combination of software and hardware.
[0142] It should be noted that in the embodiment of the present application, if the above method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application can be essentially or partly embodied in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including several instructions to enable an electronic device to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific combination of hardware and software.
[0143] The embodiment of the present application provides a computer device, which may be a server, and its internal structure diagram may be as follows: Fig.10 As shown. The computer device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, the above method is implemented.
[0144] An embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps in the method provided in the above embodiment are implemented.
[0145] An embodiment of the present application provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute the steps of the method provided in the above method embodiment.
[0146] Those skilled in the art will understand that Fig.10 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0147] In one embodiment, the video display device provided by the present application can be implemented in the form of a computer program. The computer program can be Fig.10The computer device shown in the figure is run. The memory of the computer device can store various program modules constituting the above-mentioned device. The computer program composed of various program modules enables the processor to execute the steps in the method of each embodiment of the present application described in this specification.
[0148] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium, storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.
[0149] It should be understood that "one embodiment" or "an embodiment" or "some embodiments" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in one embodiment" or "in some embodiments" appearing throughout the specification may not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments. The above description of each embodiment tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. For the sake of brevity, this article will not repeat them.
[0150] The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there may be three relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist at the same time, and object B exists alone.
[0151] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.
[0152] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as: multiple modules or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or modules can be electrical, mechanical or other forms.
[0153] The modules described above as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules; they may be located in one place or distributed on multiple network units; some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.
[0154] In addition, all functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may be a separate unit, or two or more modules may be integrated into one unit; the above-mentioned integrated modules may be implemented in the form of hardware or in the form of hardware plus software functional units.
[0155] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.
[0156] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling an electronic device to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.
[0157] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.
[0158] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.
[0159] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.
[0160] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A video display method, characterized in that: The method comprises: Get the original video picture; Dividing the original video image into regions to obtain a plurality of sub-regions; According to the current network transmission rate, pixel adjustment is performed on each of the sub-areas to obtain a plurality of adjustment areas, wherein the plurality of adjustment areas have different sharpnesses; A target video screen consisting of a plurality of the adjustment areas is displayed.
2. The method according to claim 1, characterized in that The original video screen is divided into regions to obtain a plurality of sub-regions, including: Identifying the content of the original video image; According to the importance of the content of the picture, the original video picture is divided into regions to obtain the multiple sub-regions with different importance.
3. The method according to claim 2, characterized in that The pixel adjustment is performed on each of the sub-areas according to the current network transmission rate to obtain a plurality of adjustment areas, including: Determining a first weight for pixel adjustment of the original video picture according to the current network transmission rate, wherein the lower the network transmission rate, the smaller the first weight; Determining a second weight for pixel adjustment of each sub-region according to the importance of each sub-region, wherein the higher the importance of the sub-region, the greater the second weight corresponding to the sub-region; According to the first weight and the second weight corresponding to each of the sub-regions, pixel adjustment is performed on each of the sub-regions to obtain the multiple adjustment regions.
4. The method according to claim 3, characterized in that The step of adjusting pixels of each of the sub-regions according to the first weight and the second weight corresponding to each of the sub-regions to obtain the plurality of adjustment regions comprises: Obtaining a target weight corresponding to each of the sub-regions according to the first weight and the second weight corresponding to each of the sub-regions; According to the target weight corresponding to each of the sub-regions, pixel adjustment is performed on each of the sub-regions to obtain the multiple adjustment regions.
5. The method according to claim 4, characterized in that When the current network transmission rate is greater than the network speed threshold, the data volume of the target video picture is greater than the data volume of the original video picture; when the current network transmission rate is less than or equal to the network speed threshold, the data volume of the target video picture is less than the data volume of the original video picture.
6. The method according to any one of claims 1 to 5, characterized in that: The step of performing pixel adjustment on each of the sub-regions to obtain the plurality of adjustment regions comprises: The bit rate and / or resolution are adjusted for each of the sub-regions respectively to obtain the multiple adjustment regions.
7. The method according to claim 1, characterized in that The picture content includes a human face, and the original video picture is divided into regions according to the importance of the picture content to obtain the multiple sub-regions with different importance, including: The face area in the picture content is determined as the first sub-area, the torso area in the picture content is determined as the second sub-area, and the background area in the picture content is determined as the third sub-area, the importance of the first sub-area is greater than the importance of the second sub-area, and the importance of the second sub-area is greater than the importance of the third sub-area.
8. The method according to claim 1, characterized in that The method further comprises: receiving a pixel adjustment instruction for a target adjustment area, wherein the target adjustment area is any area among the multiple adjustment areas; In response to the pixel adjustment instruction, the pixel density of the target adjustment area is adjusted to obtain an adjusted target adjustment area, wherein the clarity of the adjusted target adjustment area is greater than the clarity of the target adjustment area.
9. The method according to claim 1, characterized in that: The original video screen is collected during the video call, and the original video screen is divided into regions to obtain multiple sub-regions, including: According to the key information of the call content collected during the video call, the original video screen is divided into regions to obtain the multiple sub-regions with different importance levels.
10. The method according to claim 1, characterized in that The original video screen is divided into regions to obtain a plurality of sub-regions, including: Acquire scene information in the original video picture; The original video screen is divided into regions according to the scene information to obtain the multiple sub-regions with different importance levels.
11. A video display device, characterized in that: include: An acquisition module is used to acquire the original video image; A division module, used for dividing the original video image into regions to obtain a plurality of sub-regions; An adjustment module, configured to adjust pixels of each sub-region according to a current network transmission rate, to obtain a plurality of adjustment regions, wherein the plurality of adjustment regions have different sharpnesses; The display module is used to display a target video picture composed of a plurality of the adjustment areas.
12. A computer device comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, wherein: When the processor executes the program, the steps of the method according to any one of claims 1 to 10 are implemented.
13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.
Citation Information
Cited By
Video picture optimization method and device, equipment and medium
CN121644889A
