Display control method, display control device, display control apparatus, and display apparatus

By dividing the display area of ​​the display device into multiple display zones and determining the corresponding refresh rate output based on the changes in the sub-images, the problem of increased power consumption due to high refresh rates across the entire screen is solved, achieving both stability and low power consumption for high refresh rate displays.

CN116564214BActive Publication Date: 2025-12-23KUNSHAN GO VISIONOX OPTO ELECTRONICS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310618094.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-05-29
Publication Date
2025-12-23
Estimated Expiration
2043-05-29

AI Technical Summary

Technical Problem

A full-screen high refresh rate increases the power consumption of the display device, leading to increased heat generation, reduced stability of the high refresh rate display effect, and increased device complexity and cost.

Method used

The display area is divided into multiple display zones. The refresh rate of the corresponding display zone is determined based on the image changes of each group of sub-images. Each display zone is controlled to output according to the matching refresh rate, so that the display zone with fast image changes outputs a high refresh rate and the display zone with slow changes outputs a low refresh rate.

Benefits of technology

It reduces the overall power consumption of the display device, alleviates the heat generation effect, improves the stability and visual enjoyment of high refresh rate displays, and reduces device complexity and cost.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116564214B_ABST
    Figure CN116564214B_ABST
Patent Text Reader

Abstract

The application provides a display control method, a display control device, a display control equipment and a display equipment. The display control method comprises the following steps: acquiring M continuous frames of images, M being an integer greater than or equal to 1; dividing each frame of image in the M frames of images into N sub-images, so that the i-th sub-image of the M frames of images forms the i-th group of sub-images, thereby obtaining N groups of sub-images; N being an integer greater than or equal to 2, i being an integer greater than or equal to 1 and less than or equal to N, the N groups of sub-images corresponding to N display areas one by one, and the N display areas being divided by a display area of the display equipment; determining a refresh rate of a corresponding display area based on image changes of each group of sub-images; and outputting the corresponding refresh rate to each display area, so as to control each display area to output according to the corresponding refresh rate. The application can realize a high refresh rate display effect with low power consumption.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display, and particularly relates to a display control method, a display control device, a display control equipment and a display equipment. BACKGROUND

[0002] With the development of display technology, high refresh rate display equipment is widely applied to scenes with high real-time requirements such as video monitoring, entertainment video playing, real-time video connection and the like. However, full-screen high refresh rate increases the power consumption of the display equipment. SUMMARY

[0003] Therefore, the present application provides a display control method, a display control device, a display control equipment and a display equipment, the refresh rate of each display area is determined based on the image change of each group of sub-images, and each display area is controlled to output according to the corresponding refresh rate, so that the refresh rate of the display area matches the actual refresh rate required by each group of sub-images. In this way, the overall power consumption of the display equipment can be reduced, the display effect of high refresh rate is realized with lower power consumption, and the problem that full-screen high refresh rate increases the power consumption of the display equipment in the prior art is solved.

[0004] To solve the above technical problem, the first aspect of the present application provides a display control method, comprising: acquiring M consecutive frames of images, M being an integer not less than 1; dividing each frame of image in the M frames of images into N sub-images, so that the i-th sub-image of the M frames of images constitutes the i-th group of sub-images, to obtain N groups of sub-images; wherein N is an integer not less than 2, i is an integer not less than 1 and less than or equal to N, the N groups of sub-images correspond to N display areas one by one, and the N display areas are obtained by dividing the display area of the display equipment; determining the refresh rate of the corresponding display area based on the image change of each group of sub-images; and outputting the corresponding refresh rate to each display area to control each display area to output according to the corresponding refresh rate.

[0005] In an implementation form of the first aspect, the refresh rate of the corresponding display area is determined based on the image change of each group of sub-images, comprising: determining the corresponding image change rate based on the image data of the M frames of sub-images of each group of sub-images; and determining the refresh rate of the corresponding display area based on the image change rate of each group of sub-images.

[0006] In an implementation form of the first aspect, the display control method further comprises: performing feature extraction on the M frames of sub-images of each group of sub-images to obtain M frames of feature images, the feature images representing the features of the eye-sensitive area in the sub-images; and taking the image data of the M frames of feature images of each group of sub-images as the image data of the M frames of sub-images.

[0007] In an implementation form of the first aspect, the determining the corresponding image change rate based on the image data of the M frames of sub-images of each group of sub-images comprises: determining an image data change rate matrix of the 2nd frame of sub-images to the Mth frame of sub-images relative to the 1st frame of sub-images based on the image data of the M frames of sub-images of each group of sub-images; and determining the corresponding image change rate based on the image data change rate matrix.

[0008] In an implementation form of the first aspect, the plurality of refresh rates have a one-to-one correspondence with a plurality of preset change intervals, and the determining the refresh rate of the corresponding display area based on the image change rate of each group of sub-images comprises: determining a first change interval in which the image change rate of each group of sub-images is located based on the correspondence; and taking the refresh rate corresponding to the first change interval as the refresh rate of the corresponding display area.

[0009] In an implementation form of the first aspect, the plurality of refresh rates have a one-to-one correspondence with a plurality of preset change intervals, and the determining the refresh rate of the corresponding display area based on the image change rate of each group of sub-images comprises: determining a first change interval in which the image change rate of each group of sub-images is located based on the correspondence; and taking the refresh rate corresponding to the first change interval as the refresh rate of the corresponding display area.

[0010] In an implementation form of the first aspect, each display area is respectively configured with a control component, and the respective refresh rates are output to the respective display areas to control the respective display areas to output according to the respective refresh rates, which comprises: determining the frame rate of each group of sub-images based on the refresh rate of each display area; determining the corresponding target image based on the frame rate of each group of sub-images; and outputting the respective refresh rates and the corresponding target images to the respective control components, so that the control components control the display areas to output the target images according to the respective refresh rates.

[0011] The second aspect of the present application provides a display control device, comprising an acquisition module, an image segmentation module, a determination module and an output module. The acquisition module is configured to acquire M consecutive frames of images, M being an integer not less than 1. The image segmentation module is configured to segment each frame of image in the M frames of images into N sub-images, so that the i-th sub-image of the M frames of images constitutes the i-th group of sub-images, thereby obtaining N groups of sub-images. N is an integer not less than 2, i is an integer not less than 1 and not more than N, the N groups of sub-images correspond one-to-one to N display areas, and the N display areas are obtained by dividing a display area of a display device. The determination module is configured to determine a refresh rate of the corresponding display area based on image change of each group of sub-images. The output module is configured to output the corresponding refresh rate to each display area to control each display area to output according to the corresponding refresh rate.

[0012] In an implementation form of the second aspect, the determining module comprises a first sub-determining module and a second sub-determining module, the first sub-determining module is configured to determine the image change rate of each group of sub-images based on the image data of M frames of sub-images of each group of sub-images; and the second sub-determining module is configured to determine the refresh rate of the corresponding display area based on the image change rate of each group of sub-images.

[0013] In an implementation form, the display control device further comprises a feature extraction module and a setting module, the feature extraction module is configured to extract features of M frames of sub-images of each group of sub-images to obtain M frames of feature images, the feature images represent features of the human eye sensitive area in the sub-images; and the setting module is configured to use the image data of the M frames of feature images of each group of sub-images as the image data of the M frames of sub-images.

[0014] In an implementation form of the second aspect, the first sub-determining module comprises a first determining unit and a second determining unit, the first determining unit is configured to determine the image data change rate matrix of the 2nd frame of sub-images to the Mth frame of sub-images relative to the 1st frame of sub-images based on the image data of M frames of sub-images of each group of sub-images; and the second determining unit is configured to determine the image change rate of each group of sub-images based on the image data change rate matrix.

[0015] In an implementation form of the second aspect, the plurality of refresh rates have a one-to-one correspondence with a plurality of preset change intervals, and the second sub-determining module comprises a third determining unit and a first setting unit, the third determining unit is configured to determine the first change interval in which the image change rate of each group of sub-images is located based on the correspondence; and the first setting unit is configured to use the refresh rate corresponding to the first change interval as the refresh rate of the corresponding display area.

[0016] In an implementation form of the second aspect, the plurality of refresh rates have a one-to-one correspondence with a plurality of preset change intervals, and the second sub-determining module comprises a third determining unit and a first setting unit, the third determining unit is configured to determine the first change interval in which the image change rate of each group of sub-images is located based on the correspondence; and the first setting unit is configured to use the refresh rate corresponding to the first change interval as the refresh rate of the corresponding display area.

[0017] In an implementation form of the second aspect, each display area is respectively configured with a control component, and the output module comprises a third sub-determination module, a fourth sub-determination module and a sub-output module. The third sub-determination module is configured to determine the frame rate of each group of sub-images based on the refresh rate of each display area. The fourth sub-determination module is configured to determine the corresponding target image based on the frame rate of each group of sub-images. The sub-output module is configured to output the corresponding refresh rate and the corresponding target image to each control component, respectively, so that the control component controls the display area to output the target image according to the corresponding refresh rate.

[0018] The third aspect of the present application provides a display control device, comprising a processor and a memory, the memory stores instructions, the instructions are loaded and executed by the processor to implement the method of any one of the implementation forms of the first aspect.

[0019] The fourth aspect of the present application provides a display device, comprising a display panel and N control components, the display panel has a display area, the display area is configured as N display areas; the N control components correspond to the N display areas one by one; wherein the N control components correspond to the N refresh rates output by the display control device of the third aspect one by one, so that each control component controls the corresponding display area to output display according to the corresponding refresh rate.

[0020] The fifth aspect of the present application provides a computer readable storage medium, the computer readable storage medium stores a computer program, the computer program is executed by the processor to implement the method of any one of the implementation forms of the first aspect.

[0021] In the display control method, the display control device, the display control equipment and the display device provided in the present application, based on the case that the display area is divided into multiple display areas, each frame of image in the continuous multiple frames of images is segmented and grouped to obtain multiple groups of sub-images corresponding to the multiple display areas, so that the refresh rate of the corresponding display area can be determined based on the image change of each group of sub-images, and each display area is controlled to output according to the corresponding refresh rate, so that the refresh rate of the display area matches the actual refresh rate required by each group of sub-images. In this way, the corresponding group of sub-images with fast image change can be output at a high refresh rate, and the corresponding group of sub-images with slow image change can be output at a low refresh rate, which can reduce the overall power consumption of the display device, and realize high refresh rate display effect with low power consumption. BRIEF DESCRIPTION OF DRAWINGS

[0022] The drawings incorporated into the specification and forming part of the present application show embodiments consistent with the present application and, together with the specification, serve to explain the principles of the present application. In addition, these drawings and the written description are not intended to limit the scope of the inventive concept in any way, but to illustrate the inventive concept for those skilled in the art by reference to specific embodiments.

[0023] Figure 1A A flowchart of a display control method according to an embodiment of the present application is shown.

[0024] Figure 1B A schematic diagram showing a display area of a display device being divided into multiple display regions.

[0025] Figure 1C A schematic diagram showing the segmentation and grouping of M-frame images.

[0026] Figure 2 A schematic diagram showing Figure 1A A flowchart of step S13.

[0027] Figure 3 A schematic diagram showing Figure 2 A partial flowchart of a display control method before step S21.

[0028] Figure 4 A schematic diagram showing Figure 2 A flowchart of step S22.

[0029] Figure 5 A schematic diagram showing Figure 2 Another flowchart of step S22.

[0030] Figure 6 A block diagram of a display control apparatus according to an embodiment of the present application is shown.

[0031] Figure 7 A block diagram of a display control apparatus according to an embodiment of the present application is shown.

[0032] Figure 8 A schematic diagram showing a display control apparatus according to an embodiment of the present application outputting a refresh rate and a target image to a display device. DETAILED DESCRIPTION

[0033] With the development of display technology, high refresh rate display devices are widely used in video monitoring, entertainment video and audio playback, real-time video connection and other scenarios with high real-time requirements. In order to display images more clearly, the prior art usually increases the refresh rate of the display device, for example, increases the full-screen refresh rate of the display device from 60Hz to 75Hz, 90Hz or 120Hz, or even experimentally to 144Hz. However, with the increase of the full-screen refresh rate of the display device, the power consumption of the display device is increased.

[0034] Therefore, the display control method, the display control device, the display control equipment and the display equipment are provided. Based on the case that the display area is divided into multiple display areas, each frame of image in continuous multiple frames of image is segmented and grouped to obtain multiple groups of sub-images corresponding to the multiple display areas. Therefore, the refresh rate of the corresponding display area can be determined based on the image change of each group of sub-images, and each display area is controlled to output according to the corresponding refresh rate, so that the refresh rate of the display area matches the actual required refresh rate of each group of sub-images. In this way, the corresponding group of sub-images with fast image change can be output at a high refresh rate, and the corresponding group of sub-images with slow image change can be output at a low refresh rate. In this way, the overall power consumption of the display equipment can be reduced to realize the display effect of high refresh rate with low power consumption.

[0035] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0036] Figure 1A A flowchart of a display control method according to an embodiment of the present application is shown. Figure 1B A schematic diagram of a display area of a display equipment divided into multiple display areas is shown. Figure 1C A flowchart of segmentation and grouping of M frames of image is shown. In at least one embodiment of the present application, as shown in Figure 1A The display control method includes the following steps S11-S14.

[0037] Step S11, M frames of continuous image are obtained, M is an integer not less than 1. Exemplarily, M frames of continuous image can be obtained from a video according to a preset acquisition period, for example, 1 acquisition per M frames of image. The number of M can be set according to actual needs, for example, M is set to 100, then 100 frames of continuous image are obtained. It should be noted that the acquisition period and the number of M can be selected and adjusted according to actual needs, and the embodiments of the present application do not limit this.

[0038] Step S12, each frame of image in M frames of image is segmented into N sub-images, the i-th sub-image of M frames of image constitutes the i-th group of sub-images, N groups of sub-images are obtained; wherein, N is an integer not less than 2, i is an integer not less than 1 and less than or equal to N, N groups of sub-images correspond to N display areas one by one, and N display areas are divided by the display area of the display equipment 10.

[0039] Exemplarily, as shown in Figure 1BAs shown, the entire display area A of the display device 10 can be pre-divided into N display areas, for example, the N display areas are A1, A2, ..., AN. Each frame of the M-frame image can be segmented based on the N display areas divided in the display area A, for example, by using the following formula (1) to segment each frame of the image:

[0040] I o =I / P formula (1);

[0041] Where I represents a frame of image, P is the image segmentation matrix, and P can be a 1×N matrix or an N×1 matrix, I o N sub-images are obtained by segmenting a single frame of an image.

[0042] The following is combined Figure 1C Explain the segmentation and grouping methods of the M-frame images, such as... Figure 1C As shown, the M consecutive frames are designated as I1, I2, ..., I... M For I1, I2, ..., I M Image segmentation is performed using the formula (1) above, resulting in N sub-images of I1, denoted as I. 11 I 12 ... I 1N The N sub-images of I2 are I 21 I 22 ... I 2N And so on, we get I M The N sub-images are I M1 I M2 ... I MN Let I1, I2, ..., I M The first sub-image I 11 I 21 ... I M1 As the first group of sub-images, I1, I2, ..., I M The second sub-image I 12 I 22 ... I M2 As the second group of sub-images, and so on, I1, I2, ..., I M The Nth sub-image I 1N I 2N ... I MN As the Nth sub-image group, N sub-image groups are obtained. Among them, the first sub-image group corresponds to the first display area A1, the second sub-image group corresponds to the second display area A2, and so on, with the Nth sub-image group corresponding to the Nth display area AN.

[0043] Step S13, determining the refresh rate of the corresponding display area based on the image change of each group of sub-images. Illustratively, step S13 can be: determining the refresh rate of the corresponding display area based on the image change speed of each group of sub-images, so that the size of the refresh rate is adapted to the image change speed. For example, the first group of sub-images is M frames of sub-images of fish swimming, which has a faster image change, and the refresh rate of the corresponding display area can be determined as 90Hz; the second group of sub-images is M frames of sub-images of a calm sea surface, which has a slower image change, and the refresh rate of the corresponding display area can be determined as 60Hz.

[0044] Step S14, outputting the corresponding refresh rate to each display area to control each display area to output according to the corresponding refresh rate.

[0045] The above scheme determines the refresh rate of the corresponding display area based on the image change speed of each group of sub-images, and outputs the corresponding refresh rate to each display area, so that the refresh rate of each display area is matched with the image change speed of the sub-image actually needed to be displayed, which can reduce the overall power consumption of the display device 10, and realize high refresh rate display effect with lower power consumption.

[0046] It should be noted that the prior art full-screen high refresh rate increases the power consumption of the display device, which will cause the display panel and control components of the display device to have greater heating effect (temperature rise effect), thereby reducing the stability of the high refresh rate display effect. The above scheme of the embodiments of the present application reduces the overall power consumption of the display device 10, which is more helpful to alleviate the heating effect of the display panel and control components, increase the stability of the high refresh rate display effect, and improve the visual enjoyment.

[0047] In addition, the prior art usually alleviates the temperature rise effect caused by the increase in power consumption by improving the material or hardware capability, which not only consumes a long development and verification time, but also increases the overall structure size and complexity of the display device, is not conducive to the lightweight design of the display device, and also causes the cost to increase. The way of alleviating the temperature rise effect of the embodiments of the present application can also effectively alleviate the above problems of the prior art.

[0048] In an embodiment, as shown in Figure 2 Step S13 includes steps S21-S22.

[0049] Step 21, determining the corresponding image change rate based on the image data of the M frames of sub-images of each group of sub-images.

[0050] In one example, step S21 can include steps S221-S222.

[0051] Step S221, respectively determining the image data change rate matrix of the second frame of sub-images to the Mth frame of sub-images relative to the first frame of sub-images based on the image data of the M frames of sub-images of each group of sub-images.

[0052] Exemplarily, the image data can be pixel values of each pixel point, and step S221 can be: subtracting the pixel values of each pixel point of the second frame of sub-images from the pixel values of each pixel point of the first frame of sub-images one by one to obtain a pixel difference value matrix of each pixel point of the second frame of sub-images relative to the first frame of sub-images; and dividing the pixel difference value matrix by the pixel values of each pixel point of the first frame of sub-images one by one to obtain a pixel change rate matrix of the second frame of sub-images relative to the first frame of sub-images. In this way, the pixel change rate matrix of the Mth frame of sub-images relative to the first frame of sub-images can be determined.

[0053] For example, the pixel change rate of the second frame of sub-images of the first group of sub-images relative to the first frame of sub-images can be determined by the following formulas (2) to (5):

[0054]

[0055] wherein, I 11 (PI) is a pixel value matrix of I 11 , a1, a2, a3, a4 are respectively pixel values of each pixel point in I 11 , I 21 (PI) is a pixel value matrix of I 21 , b1, b2, b3, b4 are respectively pixel values of each pixel point in I 21 , ΔI 11 (PI) is a pixel difference value matrix of I 21 relative to each pixel point in I 11 , f 11 is a pixel change rate matrix of I 21 relative to I 11 , and PI represents a pixel point.

[0056] Step S222: determining a corresponding image change rate based on each image data change rate matrix.

[0057] Exemplarily, step S222 can be: determining an average value matrix of the corresponding image data change rate matrix based on each image data change rate matrix; and adding each average value in the average value matrix to obtain the corresponding image change rate.

[0058] For example, continuing to take the first group of sub-images as an example, the average value matrix of the pixel change rate matrix of the first group of sub-images can be determined by the following formula (6), and the image change rate of the first group of sub-images can be determined by formula (7):

[0059]

[0060] f 1ck =c1+c2+c3+c4 formula (7);

[0061] Among them, f 21 For I 31 Relative to I 11 The pixel change rate, f (M-1)2 For I M1 Relative to I 11 The pixel change rate, c1, c2, c3, and c4 are the average pixel change rates of each pixel in the M frames of the first group of sub-images, f 1ck The image change rate of the first group of sub-images.

[0062] It should be noted that, for the purpose of clearly illustrating the determination of the image change rate, the above example only uses a 2×2 matrix for the pixel value matrix of the sub-image. However, in practical applications, a 4×4 matrix is ​​usually used for the calculation of the pixel value matrix of the sub-image. The pixel value matrix of the sub-image in this embodiment can be a 4×4 matrix. The above example is not intended to limit the type of the pixel value matrix of the sub-image or the types of other matrices involved in the calculation. The pixel value matrix of the sub-image and other matrices involved in the calculation in this embodiment can be adjusted according to actual needs, and this embodiment does not impose any restrictions on this.

[0063] Step S22: Determine the refresh rate of the corresponding display area based on the image change rate of each group of sub-images.

[0064] In one implementation, such as Figure 3 As shown, before step S21, the display control method further includes the following steps S31 to S32.

[0065] Step S31: Extract features from the M-frame sub-images of each group of sub-images to obtain M-frame feature images. The feature images represent the features of the human eye-sensitive area in the sub-images.

[0066] For example, step S31 may involve using a feature extraction matrix to extract pixel values ​​of pixels located in the human eye-sensitive region from the M-frame sub-images of each group of sub-images. For instance, the pixel value matrix of the M-frame sub-images of each group of sub-images is a 4×4 rectangle. Taking the first frame sub-image of the first group as an example, I is represented by the following formula (8). 11 pixel value matrix I 11 (PI), the feature extraction matrix R is represented by the following formula (9), and the feature extraction matrix R is used to extract I. 11 After feature extraction by (PI), I is obtained. 11 Feature image I' 11 pixel value matrix I' 11 (PI) is expressed by the following formula (10):

[0067]

[0068] wherein, d 11 , d 12 , d 13 , d 14 , d 21 , …, d 44 are respectively pixel values of each pixel point in I 11 .

[0069] It should be noted that the human eye can quickly capture the pixel points at the four corners and the center region of the image 4, and thus the sensitivity of the human eye to these regions is higher, and the sensitivity of the human eye to the pixel points at the four edges of the image 4 is lower. The embodiment of the present application extracts the features of each group of M frames of sub-images using the feature extraction matrix described above, and can effectively obtain the human eye sensitivity features in each sub-image.

[0070] In step S32, the image data of the M frames of feature images of each group of sub-images is taken as the image data of the M frames of sub-images.

[0071] The above scheme takes the image data of the M frames of feature images corresponding to each group of sub-images as the image data for determining the image change rate, which not only effectively retains the features of the M frames of sub-images of each group, but also reduces the amount of image data calculation and improves the calculation speed, thereby speeding up the determination of the image change rate.

[0072] In an embodiment, as shown in FIG. 2, the plurality of refresh rates and the plurality of preset change intervals have a one-to-one correspondence relationship, and step S22 can include the following steps S41-S42. Figure 4

[0073] In step S41, based on the correspondence relationship, the first change interval in which the image change rate of each group of sub-images is located is determined.

[0074] For example, the correspondence relationship between the plurality of refresh rates and the plurality of preset change intervals can be represented by the following Table 1.

[0075] Table 1: Correspondence relationship between the plurality of refresh rates and the plurality of preset change intervals

[0076] Variation interval Refresh rate [1.5,2] 120 Hz [0.9,1.2] 90 Hz [0.75,0.8] 75 Hz [0.5,0.6] 60 Hz

[0077] In one example, after the image change rate of each group of sub-images is determined, the image change rate of a certain group of sub-images is taken as an example, and the image change rate is 0.76. Based on the above correspondence relationship, it can be determined that the first change interval in which the image change rate is located is [0.75, 0.8].

[0078] ​In another example, step S41 can also be: when the image change rate of each group of sub-images is outside each change interval, determine the neighboring interval of the corresponding image change rate from multiple change intervals; and take the neighboring interval with the larger interval value as the first change interval in which the corresponding image change rate is located. For example, if the image change rate of a group of sub-images is 0.7, its neighboring intervals can be determined from multiple change intervals as [0.5, 0.6] and [0.75, 0.8], and then [0.75, 0.8] is taken as the first change interval in which 0.7 is located. This ensures that the finally determined refresh rate meets the display requirements of the corresponding group of sub-images, avoiding a reduction in display quality.

[0079] Step S42: Use the refresh rate corresponding to the first change interval as the refresh rate of the corresponding display area.

[0080] For example, after determining the first variation range as [0.75, 0.8], 75Hz is used as the refresh rate of the corresponding display area.

[0081] The above scheme directly determines the refresh rate of the corresponding display area by the image change rate of each group of sub-images, which can match the refresh rate of each display area with the image change of the corresponding group of sub-images.

[0082] In one implementation, such as Figure 5 As shown, multiple refresh rates correspond to multiple preset change ranges, and step S22 may include the following steps S51 to S54.

[0083] Step S51: Determine the corresponding average rate of change based on the image change rates of the N sub-images. For example, step S51 can be determined using the following formula (11):

[0084] fc = (f 1ck +f 2ck +L+f Nck ) / N formula (11);

[0085] Among them, f 1ck The image change rate of the first group of sub-images, f 2ck f represents the rate of change of the second group of sub-images, and so on. Nck Let be the rate of change of the Nth sub-image.

[0086] Step S52: Based on the correspondence, determine the first change interval of the image change rate and the second change interval of the average change rate of each group of sub-images.

[0087] Step S52 can be implemented by referring to the above-mentioned implementation process of step S41, and will not be repeated here.

[0088] Step S53, determining a target variation interval of each group of sub-images based on the difference between the first variation interval and the second variation interval.

[0089] In one example, step S53 can be: in the case that the first variation interval and the second variation interval are adjacent intervals, taking the first variation interval as the target variation interval. For example, the first variation interval is [0.5, 0.6] and the second variation interval is [0.75, 0.8], then [0.5, 0.6] is taken as the target variation interval.

[0090] In another example, step S53 can be: in the case that there is at least one interval between the first variation interval and the second variation interval, taking the adjacent interval of the first variation interval adjacent to the second variation interval as the target variation interval. For example, the first variation interval is [0.5, 0.6] and the second variation interval is [0.9, 1.2] or [1.5, 2], then [0.75, 0.8] is taken as the target variation interval.

[0091] Step S54, taking the refresh rate corresponding to the target variation interval as the refresh rate of the corresponding display area.

[0092] The above scheme compares the image variation rate of each sub-image with the average variation rate, adjusts the first variation interval based on the difference after comparison, obtains the target variation interval, and takes the refresh rate corresponding to the target variation interval as the refresh rate of the corresponding display area. Thus, the refresh rate of each display area can tend to the average refresh rate, and the difference in refresh rate between each display area can be reduced, which is conducive to improving the display effect and improving the visual enjoyment.

[0093] In one embodiment, each display area is respectively configured with a control component, and step S14 can include:

[0094] Based on the refresh rate of each display area, the frame rate of each group of sub-images is determined to match the frame rate of each group of sub-images with the corresponding refresh rate;

[0095] Based on the frame rate of each group of sub-images, the corresponding target image is determined; for example, based on the frame rate of each group of sub-images, frames are extracted from the corresponding group of sub-images to form N groups of target images (for reference Figure 8 ), and the number of frames of each group of target images can be less than or equal to M;

[0096] The corresponding refresh rate and the corresponding target image are respectively output to each control component, so that the control component controls the display area to output the target image according to the corresponding refresh rate. For example, referring to Figure 8 , the corresponding refresh rate and the target image of each control component are respectively output.

[0097] The functions of each module in each device in the embodiments of the present application can be referred to the corresponding description in the above method, which will not be repeated here.

[0098] To solve the above technical problems, the display control device provided by the embodiments of the present application comprises: Figure 6 As shown in the figure, the display control device 60 comprises an acquisition module 61, an image segmentation module 62, a determination module 63 and an output module 64. The acquisition module 61 is configured to acquire M consecutive frames of images, M being an integer not less than 1. The image segmentation module 62 is configured to segment each frame of image in the M frames of images into N sub-images, so that the i-th sub-image of the M frames of images constitutes the i-th group of sub-images, thereby obtaining N groups of sub-images, wherein N is an integer not less than 2, i is an integer not less than 1 and not more than N, the N groups of sub-images correspond to N display areas one by one, and the N display areas are obtained by dividing the display area of a display device. The determination module 63 is configured to determine the refresh rate of the corresponding display area based on the image change of each group of sub-images. The output module 64 is configured to output the corresponding refresh rate to each display area, so as to control each display area to output according to the corresponding refresh rate.

[0099] In an embodiment, the determination module 63 comprises a first sub-determination module and a second sub-determination module. The first sub-determination module is configured to determine the image change rate of each group of sub-images based on the image data of the M frames of sub-images of each group of sub-images. The second sub-determination module is configured to determine the refresh rate of the corresponding display area based on the image change rate of each group of sub-images.

[0100] In an embodiment, the display control device 60 further comprises a feature extraction module and a setting module. The feature extraction module is configured to perform feature extraction on the M frames of sub-images of each group of sub-images, thereby obtaining M frames of feature images, wherein the feature images represent the features of the human eye sensitive area in the sub-images. The setting module is configured to use the image data of the M frames of feature images of each group of sub-images as the image data of the M frames of sub-images.

[0101] In an embodiment, the first sub-determination module comprises a first determination unit and a second determination unit. The first determination unit is configured to determine the image data change rate matrix of the 2nd frame of sub-image to the Mth frame of sub-image relative to the 1st frame of sub-image based on the image data of the M frames of sub-images of each group of sub-images. The second determination unit is configured to determine the image change rate of each group of sub-images based on the image data change rate matrix.

[0102] In an embodiment, the plurality of refresh rates have a one-to-one correspondence with a plurality of preset change intervals, and the second sub-determination module comprises a third determination unit and a first setting unit. The third determination unit is configured to determine the first change interval in which the image change rate of each group of sub-images is located based on the correspondence. The first setting unit is configured to use the refresh rate corresponding to the first change interval as the refresh rate of the corresponding display area.

[0103] In one implementation, multiple refresh rates correspond to multiple preset variation intervals. The second sub-determination module includes a fourth determination unit, a fifth determination unit, a sixth determination unit, and a second setting unit. The fourth determination unit is used to determine the corresponding average variation rate based on the image variation rates of N groups of sub-images. The fifth determination unit is used to determine, based on the correspondence, the first variation interval where the image variation rate of each group of sub-images falls and the second variation interval where the average variation rate falls. The sixth determination unit is used to determine the target variation interval for each group of sub-images based on the difference between the first and second variation intervals. The second setting unit is used to use the refresh rate corresponding to the target variation interval as the refresh rate of the corresponding display area.

[0104] In one embodiment, each display area is configured with a control component, and the output module 64 may include a third sub-determination module, a fourth sub-determination module, and a sub-output module. The third sub-determination module is used to determine the frame rate of each group of sub-images based on the refresh rate of each display area. The fourth sub-determination module is used to determine the corresponding target image based on the frame rate of each group of sub-images. The sub-output module is used to output the corresponding refresh rate and the corresponding target image to each control component, so that the control components control the display areas to output the target image according to the corresponding refresh rate.

[0105] Figure 7 A structural block diagram of a display control device according to an embodiment of this application is shown. Figure 7 As shown, the display control device includes a memory 71 and a processor 72. The memory 71 stores a computer program that can run on the processor 72. When the processor 72 executes the computer program, it implements the display control method in the above embodiments. The number of memories 71 and processors 72 can be one or more.

[0106] The display control device also includes a communication interface 73, which is used to communicate with external devices and perform data exchange and transmission. If the memory 71, processor 72, and communication interface 73 are implemented independently, they can be interconnected via a bus to complete communication with each other. This bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0107] Optionally, in a specific implementation, if the memory 71, processor 72, and communication interface 73 are integrated on a single chip, then the memory 71, processor 72, and communication interface 73 can communicate with each other through an internal interface.

[0108] This application also provides a display device, such as... Figure 8 As shown, the display device 10 includes a display panel ( Figure 8 (Unlabeled) and N control components. For example, the N control components are IC1, IC2, ..., ICN.

[0109] The display panel has a display area A, which is configured into N display zones, for example, the N display zones are the first display zone A1, the second display zone A2, ..., the Nth display zone AN. N control components correspond one-to-one with the N display zones; that is, IC1 corresponds to A1, IC2 corresponds to A2, and so on, with ICN corresponding to AN. Each of the N control components receives N refresh rates output by the display control device of any of the above embodiments, so that each control component controls the corresponding display zone to output and display according to the corresponding refresh rate. For example, IC1 receives the refresh rate determined based on the first group of sub-images and controls A1 to output and display the first group of sub-images according to that refresh rate. This reduces the overall power consumption of the display device 10, achieving a high refresh rate display effect with lower power consumption. Furthermore, the reduced overall power consumption of the display device 10 effectively alleviates the heat generation of the display panel and the N control components, thereby improving the stability of the high refresh rate display effect.

[0110] This application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method provided in this application.

[0111] It should be appreciated that the above-described processor can be a graphics processing unit (GPU) or a central processing unit (CPU), and can also be other general purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gates or transistor logic, discrete hardware components, or the like. The general purpose processor can be a microprocessor or any conventional processor, and the like. It is worth noting that the processor can be an advanced RISC machines (ARM) architecture processor.

[0112] Further, the above-described memory can include a read-only memory and a random access memory, and can also include a non-volatile random access memory. The memory can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. The non-volatile memory can include a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically EPROM (EEPROM), or a flash memory. The volatile memory can include a random access memory (RAM) used as an external cache. By way of example, but not limitation, many forms of RAM can be used. For example, a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous DRAM (SDRAM), a double data rate SDRAM (DDR SDRAM), an enhanced SDRAM (ESDRAM), a Synchlink DRAM (SLDRAM), and a direct Rambus RAM (DR RAM) can be used.

[0113] It should be understood that the technical terms or scientific terms used in the embodiments of the present application should be the usual meanings understood by those skilled in the art to which the embodiments of the present application belong. The "first", "second", and similar words used in the embodiments of the present application do not represent any order, quantity, or importance, but are set to avoid confusion of the constituent elements.

[0114] Unless otherwise required by context, "plurality" means "at least two" throughout the specification. "Comprising" is to be interpreted as encompassing the open, inclusive meaning of "including but not limited to" throughout the specification. In the description of the specification, the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific example" or "some examples" are intended to mean that the particular feature, structure, material, or characteristic associated with that embodiment or example includes at least one embodiment or example of the present application. The illustrative representations of the above terms do not necessarily refer to the same embodiment or example.

[0115] The technical features of the above embodiments can be combined in any manner. To make the description concise, not all possible combinations of the technical features in the above embodiments are described, but as long as the combinations of the technical features do not contradict, they should be considered within the scope of the present application.

[0116] The above embodiments only express several implementation manners of the present application, and the description is specific and detailed, but it should not be understood as a limitation on the scope of the solutions provided by the embodiments of the present application. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the protection scope of the present application. Therefore, the protection scope of the present patent should be subject to the appended claims.

Claims

1. A display control method, characterized in that, include: Get M consecutive frames of images, where M is an integer not less than 1; Each frame of the M-frame images is divided into N sub-images, such that the i-th sub-image of the M-frame images forms the i-th group of sub-images, resulting in N groups of sub-images; where N is an integer not less than 2, and i is an integer not less than 1 and less than or equal to N. The N groups of sub-images correspond one-to-one with N display areas, and the N display areas are obtained by dividing the display area of ​​the display device. Based on the image changes of each group of sub-images, determine the refresh rate of the corresponding display area; Output the corresponding refresh rate to each display area to control each display area to output according to the corresponding refresh rate; Based on the image changes of each group of sub-images, the refresh rate of the corresponding display area is determined, including: Based on the image data of M frames of sub-images in each group of sub-images, determine the corresponding image change rate; The refresh rate of the corresponding display area is determined based on the image change rate of each group of sub-images; Multiple refresh rates correspond to multiple preset variation ranges. Based on the image variation rate of each group of sub-images, the refresh rate of the corresponding display area is determined, including: Based on the image change rates of the N groups of sub-images, determine the corresponding average change rate; Based on the correspondence, the first variation interval of the image change rate of each group of sub-images and the second variation interval of the average change rate are determined respectively; Based on the difference between the first change interval and the second change interval, the target change interval of each group of sub-images is determined; The refresh rate corresponding to the target change range is used as the refresh rate of the corresponding display area.

2. The display control method according to claim 1, characterized in that, The display control method further includes: Feature extraction is performed on M frames of sub-images from each group of sub-images to obtain M frames of feature images, where the feature images represent the features of the human eye-sensitive region in the sub-images; The image data of the M-frame feature images of each group of sub-images are used as the image data of the M-frame sub-images.

3. The display control method according to claim 2, characterized in that, Based on the image data of M frames of sub-images in each group of sub-images, determine the corresponding image change rate, including: Based on the image data of the M-frame sub-images of each group of sub-images, determine the image data change rate matrix of the second to the M-frame sub-images relative to the first frame sub-image; Based on the image data change rate matrix, the corresponding image change rate is determined.

4. The display control method according to claim 1, characterized in that, Each of the aforementioned display areas is configured with a control component, which outputs a corresponding refresh rate to each display area to control each display area to output according to the corresponding refresh rate, including: Based on the refresh rate of each display area, the frame rate of each group of sub-images is determined. Based on the frame rate of each group of sub-images, the corresponding target image is determined; The corresponding refresh rate and the corresponding target image are output to each of the control components, so that the control components control the display area to output the target image according to the corresponding refresh rate.

5. A display control device, characterized in that, include: The acquisition module is used to acquire M consecutive frames of images, where M is an integer not less than 1; The image segmentation module is used to segment each frame of the M-frame images into N sub-images, such that the i-th sub-image of the M-frame images forms the i-th group of sub-images, resulting in N groups of sub-images; where N is an integer not less than 2, and i is an integer not less than 1 and less than or equal to N, and the N groups of sub-images correspond one-to-one with N display areas, which are obtained by dividing the display area of ​​the display device; The determination module is used to determine the refresh rate of the corresponding display area based on the image changes of each group of sub-images; The output module is used to output the corresponding refresh rate to each display area, so as to control each display area to output according to the corresponding refresh rate; The determining module includes a first sub-determining module and a second sub-determining module. The first sub-determining module is used to determine the corresponding image change rate based on the image data of the M frames of sub-images in each group of sub-images. The second determining module is used to determine the refresh rate of the corresponding display area based on the image change rate of each group of sub-images. Multiple refresh rates correspond to multiple preset change intervals. The second sub-determination module includes a fourth determination unit, a fifth determination unit, a sixth determination unit, and a second setting unit. The fourth determination unit is used to determine the corresponding average change rate based on the image change rates of N groups of sub-images. The fifth determination unit is used to determine the first change interval where the image change rate of each group of sub-images is located and the second change interval where the average change rate is located, based on the correspondence. The sixth determination unit is used to determine the target change interval of each group of sub-images based on the difference between the first change interval and the second change interval. The second setting unit is used to use the refresh rate corresponding to the target change interval as the refresh rate of the corresponding display area.

6. A display control device, characterized in that, include: A processor and a memory, wherein instructions are stored in the memory and loaded and executed by the processor to implement the method as described in any one of claims 1 to 4.

7. A display device, characterized in that, include: A display panel having a display area, wherein the display area is configured as N display zones; There are N control components, each corresponding to one of the N display areas; The N control components receive N refresh rates output by the display control device according to claim 6, so that each control component controls the corresponding display area to output and display according to the corresponding refresh rate.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method as described in any one of claims 1-4.

Citation Information

Patent Citations

  • Display method and device

    CN108320723A

  • Display control method and display device

    US20220309977A1