Display content identification method and device, electronic equipment and storage medium

Abstract

The invention provides a display content identification method and device, electronic equipment and a computer readable storage medium. The method comprises the steps that display data aiming at a plurality of pixels in a screen are obtained, the bit depth of the display data of each pixel is N bits, N-1 bits are used for describing color data processed through a preset offset, and the remaining 1 bit is used for describing the size relation between the processed color data and the preset offset; n is an integer greater than 1; and based on the size relationship of each pixel in the plurality of pixels, counting the number of target pixels, meeting the condition that the processed color data is greater than the preset offset, in the plurality of pixels, and performing display content identification according to the number of the target pixels. The display content identification can be realized only by traversing the 1-bit data of each pixel, so that the processing resources are saved and the power consumption is reduced.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to a display content recognition method, device, electronic device, and computer-readable storage medium. Background Art

[0002] A screen is a device or appliance used to display images and colors. It is widely used in mobile phones, computers, monitors, TVs, and devices with image or text display functions. The different contents displayed on the screen will directly affect the power consumption of the screen. Therefore, it is necessary to identify the contents displayed on the screen so that relevant measures can be taken based on the identification results to optimize power consumption and performance.

[0003] In the related art, the method for identifying the display content of the screen is to understand the currently displayed content by analyzing the color value of each pixel on the screen, which requires a large amount of processing resources. Summary of the invention

[0004] To overcome the problems existing in the related art, the present disclosure provides a display content recognition method, device, electronic device and computer-readable storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a method for identifying display content is provided, the method comprising:

[0006] Obtaining display data for a plurality of pixels in a screen, wherein the bit depth of the display data of each pixel is N bits, wherein N-1 bits are used to describe color data processed by a preset offset, and the remaining 1 bit is used to describe the magnitude relationship between the processed color data and the preset offset; N is an integer greater than 1;

[0007] Based on the size relationship of each pixel among the plurality of pixels, the number of target pixels among the plurality of pixels satisfying the requirement that the processed color data is greater than the preset offset is counted, and display content recognition is performed according to the number of target pixels.

[0008] In this embodiment, only 1 bit of data of each pixel needs to be traversed to realize display content recognition, which reduces the amount of data processing, helps to save processing resources and reduce power consumption, and by counting the number of target pixels that meet the conditions, it is possible to more accurately capture key information on the screen. Counting the number of target pixels can be used as a reliable indicator, reflecting the characteristics of the content displayed on the screen, thereby improving the accuracy of recognition.

[0009] In some embodiments, the method further comprises:

[0010] Dividing the screen into regions;

[0011] The step of counting the number of target pixels in the plurality of pixels satisfying that the processed color data is greater than the preset offset based on the size relationship of each pixel in the plurality of pixels, and performing display content recognition according to the number of target pixels, includes:

[0012] For each divided area, based on the size relationship of the pixels in the area, the number of target pixels in the area that meet the requirement that the processed color data is greater than the preset offset is counted, and the display content of the area is identified according to the number of target pixels.

[0013] This embodiment realizes the recognition of displayed content by region, which can focus more on the details in each region, thereby improving the recognition accuracy of the displayed content in each region.

[0014] In some embodiments, the method is applied to an electronic device, the electronic device comprising a first register and a second register, the first register being written with the preset offset, and the second register being written with different processing modes corresponding to the size relationship;

[0015] The method further comprises:

[0016] For each pixel among the plurality of pixels, according to the display data of the pixel, the preset offset stored in the first register, and different processing methods corresponding to the size relationship stored in the second register, the original color data of the pixel is restored;

[0017] For each region, after display content recognition is performed on the region according to the number of target pixels to obtain a display content recognition result, the original color data of the pixels in the region are optimized according to the display content recognition result.

[0018] This embodiment can perform targeted processing on the original color data of the pixels in each area according to the display content recognition result of the area, which is beneficial to improving the display effect of the pixels in each area.

[0019] In some embodiments, the optimizing the original color data of the pixels in the area according to the display content recognition result includes:

[0020] Determining target optimization parameters according to the display content recognition result and the pre-stored mapping relationship between different display content recognition results and optimization parameters;

[0021] The target optimization parameters are used to optimize the original color data of the pixels in the area.

[0022] This embodiment can directly map to the corresponding optimization parameters by searching for the mapping between the display content recognition results and the optimization parameters, thereby avoiding complex calculation and analysis processes, improving the pixel optimization processing speed, and also helping to reduce the calculation burden.

[0023] In some embodiments, the electronic device further includes a third register code table; different third registers in the third register code table are used to store optimization parameters corresponding to different display content recognition results.

[0024] In some embodiments, the method is applied to an electronic device, the electronic device includes a fourth register, the fourth register is written with the number of area divisions of the screen; wherein the value of the number of area divisions of the screen is greater than or equal to 1;

[0025] The dividing the screen into regions includes: dividing the screen into regions according to the number of region divisions stored in the fourth register.

[0026] In some embodiments, the identifying the display content according to the number of the target pixels includes:

[0027] A display content recognition result is obtained according to the number of target pixels and the pre-stored mapping relationship between different numbers of target pixels and display content.

[0028] This embodiment can directly map to the corresponding display content by searching for the mapping between the target pixel quantity and the display content, thereby avoiding complex calculation and analysis processes, improving the speed of obtaining the recognition results, and also helping to reduce the calculation burden.

[0029] In some embodiments, the display data of each pixel includes display data of three color components, and the color depth of the display data of each color component is M bits, wherein M-1 bits are used to describe the color data corresponding to the color component after being processed by a preset offset, and the remaining 1 bit is used to describe the size relationship between the processed color data corresponding to the color component and the preset offset; M is an integer greater than 1;

[0030] The step of counting the number of target pixels in the plurality of pixels satisfying that the processed color data is greater than the preset offset based on the size relationship of each pixel in the plurality of pixels, and performing display content recognition according to the number of target pixels, includes:

[0031] For each color component of each pixel among the plurality of pixels, based on the size relationship of the pixel in the color component, counting the number of target pixels corresponding to the color component that satisfy the requirement that the processed color data is greater than the preset offset;

[0032] Display content identification is performed according to the number of the target pixels corresponding to at least one color component.

[0033] This embodiment can more carefully understand the distribution of target pixels in each color component by statistically analyzing the size relationship of each color component, which helps to improve the sensitivity to color information and achieve more accurate display content recognition.

[0034] In some embodiments, the method is applied to a display driver of an electronic device; wherein the electronic device further includes an application processor, and the display data for a number of pixels in the screen is sent by the application processor to the display driver.

[0035] According to a second aspect of an embodiment of the present disclosure, a display content recognition device is provided, the device comprising:

[0036] A display data acquisition module, used to acquire display data for a number of pixels in the screen, wherein the bit depth of the display data of each pixel is N bits, wherein N-1 bits are used to describe color data processed by a preset offset, and the remaining 1 bit is used to describe the size relationship between the processed color data and the preset offset; N is an integer greater than 1;

[0037] The display content recognition module is used to count the number of target pixels among the plurality of pixels that satisfy the condition that the processed color data is greater than the preset offset based on the size relationship of each pixel among the plurality of pixels, and perform display content recognition according to the number of target pixels.

[0038] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0039] processor;

[0040] a memory for storing a computer program executable by the processor;

[0041] Wherein, when the processor executes the program, the steps of any method described in the first aspect are implemented.

[0042] According to a fourth aspect of an embodiment of the present disclosure, there is provided a computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the steps of any one of the methods described in the first aspect.

[0043] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1is a structural block diagram of an electronic device according to an exemplary embodiment of the present disclosure;

[0045] Figure 2 is a flow chart of a display content recognition method according to an exemplary embodiment of the present disclosure;

[0046] Figure 3 is a flowchart of another display content recognition method according to an exemplary embodiment of the present disclosure;

[0047] Figure 4 is a structural block diagram of another electronic device according to an exemplary embodiment of the present disclosure;

[0048] Figure 5 is a flowchart of another display content recognition method according to an exemplary embodiment of the present disclosure;

[0049] Figure 6 is a structural block diagram of a display content recognition device according to an exemplary embodiment of the present disclosure;

[0050] Figure 7 It is a structural block diagram of another electronic device according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0051] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0052] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0053] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0054] A screen is a device or appliance used to display images and colors. It is widely used in mobile phones, computers, monitors, televisions, and devices with image or text display functions. There are many types of screens, including liquid crystal displays (LCD), organic light-emitting diode displays (OLED), electronic ink screens, etc.

[0055] Among them, different display contents on the screen will directly affect the power consumption of the screen. The impact of different display contents on screen power consumption mainly involves the display brightness, color and pixel changes. The following are some influencing factors:

[0056] (1) Brightness: The brightness level of the screen is a factor that directly affects power consumption. Higher brightness usually means more energy consumption.

[0057] (2) Color: Displaying different colors may require different amounts of energy. For example, in an LCD display, white pixels typically require more energy, while an OLED display may have different power consumption for displaying different colors.

[0058] (3) Pixel changes: When the displayed content changes, the state of the pixel will also change. Frequent pixel changes may lead to increased power consumption, especially in technologies such as LCD displays.

[0059] Therefore, it is necessary to identify the screen display content so as to adjust some parameters of the device based on the identification results to optimize power consumption and performance.

[0060] In the related art, the method for identifying the display content of the screen is to understand the currently displayed content by analyzing the color value of each pixel on the screen. For example, the proportion of the color values ​​of all pixels on the screen is counted in a statistical way of a data histogram, and the display content is identified based on the proportion of the color values ​​of all pixels on the screen. When the number of pixels is large or the bit depth of the color value of the pixel is large, a large amount of processing resources is required to perform statistics, and the power consumption is large.

[0061] Based on this, an embodiment of the present disclosure provides a display content recognition method, which can process the original color data of several pixels in the screen into N bits of display data, wherein N-1 bits are used to describe the color data processed by a preset offset, and the remaining 1 bit is used to describe the size relationship between the processed color data and the preset offset; the preset offset plays a role in color filtering, and the color can be divided into two parts through the preset offset, for example, the part of the processed color data greater than the offset and the part of the processed color data less than the offset, which helps to subsequently determine which pixels are considered to be target pixels.

[0062] After obtaining the display data for several pixels in the screen, the number of target pixels in the several pixels that meet the requirement that the processed color data is greater than the preset offset can be counted based on the size relationship between the processed color data corresponding to each pixel in the several pixels and the preset offset, and the display content can be identified according to the number of target pixels. This embodiment only needs to traverse 1 bit of data of each pixel to realize display content identification, which reduces the amount of data processing, helps to save processing resources and reduce power consumption, and by counting the number of target pixels that meet the conditions, it is possible to capture key information on the screen more accurately. The number of target pixels can be used as a reliable indicator to reflect the characteristics of the content displayed on the screen, thereby improving the accuracy of identification.

[0063] In some embodiments, see Figure 1 The electronic device includes an application processor 10 and a display driver 20 , and the display content recognition method provided in the embodiment of the present disclosure can be applied to the display driver 20 .

[0064] The application processor 10 is the main processor in the electronic device, responsible for running applications and handling general computing tasks of the device. It is the core processing unit of the device, usually composed of one or more processing cores. In devices such as smartphones and tablets, the application processor 10 executes the operating system and applications, processes user input, manages memory and storage, and performs various computing tasks.

[0065] The display driver 20 is a key component related to screen display. It is responsible for controlling each pixel of the screen (such as an LCD screen or an OLED screen, etc., but not limited thereto) to ensure that the correct color and brightness are displayed. The display driver contains the circuits and logic required to drive the screen and is responsible for converting the graphic data from the application processor 10 into pixels that are actually displayed on the screen.

[0066] In some other embodiments, the display content recognition method provided by the embodiments of the present disclosure may also be executed by other processors in the electronic device, such as a central processing unit (CPU) in the electronic device, but is not limited thereto.

[0067] Among them, electronic devices include but are not limited to smart phones / mobile phones, tablet computers, personal digital assistants (PDAs), laptop computers, desktop computers, media content players, video game stations / systems, virtual reality systems, augmented reality systems, wearable devices (e.g., watches, glasses, gloves, headwear (e.g., hats, helmets, virtual reality headsets, augmented reality headsets, head-mounted devices (HMDs), headbands), pendants, armbands, leg bands, shoes, vests), remote controls, or any other type of device.

[0068] See also Figure 2 , Figure 2 FIG. 1 is a flowchart of a method for identifying display content according to an exemplary embodiment of the present disclosure. The method is exemplarily described by applying the method to a display driver in an electronic device. The method includes:

[0069] In S101, display data for a number of pixels in the screen is obtained, and the bit depth of the display data of each pixel is N bits, wherein N-1 bits are used to describe the color data processed by a preset offset, and the remaining 1 bit is used to describe the size relationship between the processed color data and the preset offset; N is an integer greater than 1.

[0070] For example, after obtaining the original color data for several pixels in the screen, the application processor can process the original color of each pixel using a preset offset to obtain display data for several pixels in the screen and send it to the display driver, so that the display driver executes the display content recognition method provided in the embodiment of the present disclosure.

[0071] Exemplarily, the preset offset acts as a color filter, and the color can be divided into two parts by the preset offset, for example, the part where the processed color data is greater than the offset and the part where the processed color data is less than the offset, which helps to subsequently determine which pixels are considered to be target pixels.

[0072] In S102, based on the size relationship of each pixel among the plurality of pixels, the number of target pixels among the plurality of pixels satisfying the requirement that the processed color data is greater than a preset offset is counted, and display content recognition is performed according to the number of target pixels.

[0073] This embodiment can realize display content recognition by only traversing 1-bit data representing the size relationship of each pixel, which reduces the amount of data processing, helps to save processing resources and reduce power consumption, especially when processing a large amount of pixel data, and by counting the number of target pixels that meet the conditions, it can more accurately capture key information on the screen. Counting the number of target pixels can be used as a reliable indicator, reflecting the characteristics of the content displayed on the screen, thereby improving the accuracy of recognition.

[0074] In some embodiments, the preset offset may be specifically set according to the actual application scenario.

[0075] In one example, the preset offset may be a fixed value set by a user.

[0076] In another example, the application processor can pre-store the correspondence between different image types and preset offsets; in the actual application process, after obtaining the image data to be displayed on the screen, the application processor can determine the preset offset for the image data according to the image type information carried in the image data and the above-mentioned correspondence; then use the preset offset for the image data to process the original color data of each pixel in the image data to obtain processed color data, compare the processed color data with the preset offset for the image data to determine the size relationship between the two, and obtain the display data of the pixel based on the processed color data and the determined size relationship. In addition, the application processor will inform the display driver of the preset offset used for the image data so that the display driver can restore the original color information of the pixel. In this embodiment, the preset offset is dynamically determined according to the image type, and the application processor can perform personalized image processing according to different image types, which is conducive to improving the accuracy of display content recognition.

[0077] Exemplarily, after obtaining the original color data for each of the several pixels on the screen, the application processor can process the original color data of each pixel using a preset offset to obtain processed color data for each pixel, for example, the processed color data of each pixel is the difference between the preset offset and the original color data of each pixel, and then compare the difference with the preset offset to determine the size relationship between the two, thereby obtaining display data for each pixel, and the bit depth of the display data of each pixel is N bits, of which N-1 bits are the difference between the preset offset and the original color data of the pixel, and the remaining 1 bit is used to describe the size relationship between the difference and the preset offset; for example, one of 0 and 1 can be used to indicate that the difference is greater than or equal to the preset offset, and the other of 0 and 1 can be used to indicate that the difference is less than the preset offset.

[0078] For example, the original color data of the pixel is set to X, the preset offset is offset, and the processed color data of the pixel is set to Y, then Y = |X-offset|, and the size relationship between the processed color data and the preset offset is set to roy, if Y is greater than or equal to offset, roy = 1; if Y is less than offset, roy = 0. Among them, roy can be at a preset bit position of the display data of the pixel, for example, roy can be at the lowest bit position or other bit positions of the display data of the pixel, and this embodiment does not impose any limitation on this.

[0079] In one example, assuming that the bit depth of the original color data of the pixel is 8 bits, the original color data is set to X, if the preset offset is 128, the processed color data of the pixel is set to Y, then Y = |X-128|, 7+1 bits can be used to transmit the display data of the pixel, of which 7 bits are used to transmit Y, and 1 bit is used to transmit the size relationship between Y and 128, such as Y greater than or equal to 128, represented by 1, and Y less than 128, represented by 0. The size relationship roy can be described in the lowest bit of the pixel display data, then the original color data of the pixel is 129, and the corresponding display data is 11, and the original color data of the pixel is 127, and the corresponding display data is 10.

[0080] In another example, assuming that the bit depth of the original color data of the pixel is 8 bits, the original color data is set to X, if the preset offset is 200, and the processed color data of the pixel is set to Y, then Y = |X-200|, 8+1 bits can be used to transmit the display data of the pixel, where 8 bits are used to transmit Y, and 1 bit is used to transmit the size relationship between Y and 200, such as Y greater than or equal to 200, represented by 1, and Y less than 200, represented by 0. The size relationship roy can be described in the lowest bit of the pixel display data, then the original color data of the pixel is 199, and the corresponding display data is 10, and the original color data of the pixel is 198, and the corresponding display data is 100.

[0081] In some embodiments, for S102, a counter can be used to count the number of target pixels among the plurality of pixels that satisfy the condition that the processed color data is greater than the preset offset, and then the screen can be judged whether it is a bright scene or a dark scene, or different types of image content, based on different numbers of target pixels.

[0082] Exemplarily, the mapping relationship between different target pixel numbers and display content can be pre-stored. After the number of target pixels is determined, the display content recognition result can be obtained according to the number of target pixels and the pre-stored mapping relationship between different target pixel numbers and display content. This embodiment can directly map to the corresponding display content by searching for the mapping between the number of target pixels and the display content, thereby avoiding complex calculation and analysis processes, improving the speed of obtaining the recognition result, and also helping to reduce the calculation burden.

[0083] In some embodiments, to improve the accuracy of display content recognition, please refer to Figure 3 , the method further comprises:

[0084] In S103, the screen is divided into regions. Then S102 includes: for each divided region, based on the size relationship of pixels in the region, counting the number of target pixels in the region that meet the requirement that the processed color data is greater than a preset offset, and identifying the display content of the region according to the number of target pixels.

[0085] This embodiment realizes the recognition of displayed content by region, which can focus more on the details in each region, thereby improving the recognition accuracy of the displayed content in each region. Moreover, the recognition of displayed content by region can further reduce the computational complexity, which is beneficial for improving processing efficiency, reducing power consumption and accelerating the content recognition process. Furthermore, the recognition of displayed content by region can make the recognition process of different regions be carried out in parallel, improving concurrency.

[0086] In some embodiments, the display content recognition method is applied to an electronic device, and the electronic device includes a fourth register, and the fourth register is written with the number of area divisions of the screen. Figure 4 The display content recognition method is applied to a display driver of an electronic device, and a fourth register is set in the display driver. The application processor can write the number of area divisions for the screen into the fourth register according to user requirements. The display driver can divide the screen into areas according to the number of area divisions stored in the fourth register.

[0087] Among them, the value of the number of area divisions of the screen is greater than or equal to 1. The number of area divisions of the screen can be specifically set according to the actual application scenario, and different numbers of area divisions can be written in the fourth register according to different scenario requirements. When the value of the number of area divisions of the screen is 1, the entire screen is regarded as one area; when the value of the number of area divisions of the screen is greater than or equal to 2, the display driver can divide the screen into at least two areas.

[0088] In some embodiments, the electronic device includes a first register and a second register, the first register is written with a preset offset, and the second register is written with different processing methods corresponding to the size relationship. Figure 4 The display content recognition method is applied to a display driver of an electronic device, and a first register and a second register are set in the display driver. The application processor can write a preset offset in the first register, and write different processing methods corresponding to the size relationship between the processed color data and the preset offset in the second register.

[0089] See also Figure 5 , the method further comprises:

[0090] In S104, for each pixel among the plurality of pixels, original color data of the pixel is restored according to different processing methods corresponding to the display data of the pixel, the preset offset stored in the first register, and the size relationship stored in the second register.

[0091] Exemplarily, the original color data of the pixel is restored by using the stored contents in the first register and the second register, thereby achieving accurate restoration of the true color of the pixel.

[0092] In S105 , for each region, after display content recognition is performed on the region according to the number of target pixels to obtain a display content recognition result, the original color data of the pixels in the region are optimized according to the display content recognition result.

[0093] In this embodiment, the original color data of the pixels in each area can be processed specifically according to the display content recognition result of the area, which is helpful to improve the display effect of the pixels in each area.

[0094] Exemplarily, for S104, assuming that the processed color data of the pixel is the difference between a preset offset and the original color data of the pixel, the different processing methods corresponding to the size relationship stored in the second register include: when the difference is greater than or equal to the preset offset, the processing method is to add the preset offset and the difference; when the difference is less than the preset offset, the processing method is to subtract the preset offset from the difference.

[0095] Assume that the original color data of the pixel is set to X, the preset offset is offset, the processed color data of the pixel is set to Y, and the size relationship is set to roy. If Y is greater than or equal to offset, roy = 1; if Y is less than offset, roy = 0. Then when roy = 1, X = offset + Y; when roy = 0, X = offset - Y.

[0096] In an example, assuming that roy is located at the lowest bit of the display data of the pixel, the display data of the pixel is 11, and the preset offset is 128, wherein the processed color data Y=1, the size relationship roy=1, then X=128+1=129.

[0097] In another example, assuming that roy is located at the lowest bit of the display data of the pixel, the display data of the pixel is 10, and the preset offset is 128, wherein the processed color data Y=1, the size relationship roy=0, then X=128-1=127.

[0098] In another example, assuming that roy is located at the lowest bit of the display data of the pixel, the display data of the pixel is 10, and the preset offset is 200, wherein the processed color data Y=1, the size relationship roy=0, then X=200-1=199.

[0099] Exemplarily, for S105, the mapping relationship between different display content recognition results and optimization parameters can be pre-stored. After obtaining the display content recognition results of each area and the original color data of the pixels in the area, the target optimization parameters can be determined according to the display content recognition results and the pre-stored mapping relationship between the different display content recognition results and the optimization parameters; and then the original color data of the pixels in the area are optimized using the target optimization parameters. This embodiment can directly map to the corresponding optimization parameters by searching for the mapping between the display content recognition results and the optimization parameters, thereby avoiding complex calculation and analysis processes, improving the optimization processing speed of pixels, and also helping to reduce the calculation burden.

[0100] In some embodiments, after obtaining the optimized color data for a number of pixels of the screen, an image may be displayed on the screen based on the optimized color data for a number of pixels of the screen.

[0101] In some embodiments, see Figure 4 The driver display in the electronic device also includes a third register code table; the third register code table includes multiple third drivers, and different third registers in the third register code table are used to store optimization parameters corresponding to different display content recognition results.

[0102] For example, assuming that the original color data of the pixel is dataX, and the color data of the pixel after optimization processing is dataY, assuming that each third driver stores 4 optimization parameters, set to QPA, QPB, QPC and QPD, the optimization processing method is: dataY = QPC*(QPA*dataX+QPD)+QPB. It can be understood that this optimization processing method is only for illustration and does not constitute a limitation on the optimization processing method. The number of optimization parameters can include one or more than one, and can be set according to the rendering requirements. For example, when the rendering requirements are reduced, QPC can be set to 1 and QPB can be set to 0, thereby reducing the rendering complexity and reducing power consumption.

[0103] In actual applications, according to different settings of optimization parameters such as QPA, QPB, QPC and QPD mentioned above, different rendering methods can be used according to different scenes. For example, when the number of target pixels is within the first threshold range, it is set to a portrait scene, and the corresponding optimization parameters in the third register can be set to a portrait rendering method to enhance the whiteness of the skin. For another example, when the number of target pixels is within the second threshold range, it is set to a landscape scene, and the corresponding optimization parameters in the third register can be set to a landscape rendering method.

[0104] In some embodiments, the display driver can obtain display data for several pixels in the screen, and the display data of each pixel includes display data of three color components. The color depth of the display data of each color component is M bits, wherein M-1 bits are used to describe the color data corresponding to the color component after being processed by a preset offset, and the remaining 1 bit is used to describe the size relationship between the processed color data corresponding to the color component and the preset offset; M is an integer greater than 1.

[0105] For each color component of each pixel among the plurality of pixels, the display driver can count the number of target pixels corresponding to the color component that satisfy the processed color data greater than a preset offset based on the size relationship of the pixel in the color component; finally, display content identification is performed based on the number of target pixels corresponding to at least one color component.

[0106] In this embodiment, by counting the size relationship of each color component, the display driver can more carefully understand the distribution of target pixels in each color component, which helps to improve the sensitivity to color information and achieve more accurate display content recognition. By identifying the display content based on the number of target pixels corresponding to at least one color component, the display driver can comprehensively utilize the information of multiple color components, thereby improving the accuracy of overall display content recognition.

[0107] The preset offsets corresponding to the various color components may be the same, or different preset offsets may be set according to the characteristics of the various color components. When the preset offsets corresponding to the various color components are the same, the number of bits of the color depth of the display data of the various color components is the same; and if the preset offsets corresponding to the various color components are different, the number of bits of the color depth of the display data of the various color components may also be different.

[0108] Assume that the three color components are R (red), G (green) and B (blue), and the bit depth of the original color data of the pixel in the three color components is 8 bits. If the preset offset of the R (red) component of the pixel is 128, 7+1 bits are required to transmit the display data of the R (red) component. If the preset offset of the G (red) component of the pixel is 200, 8+1 bits are required to transmit the display data of the R (red) component. If the preset offset of the B (red) component of the pixel is 100, 8+1 bits are required to transmit the display data of the R (red) component.

[0109] The various technical features in the above embodiments can be arbitrarily combined as long as there is no conflict or contradiction between the combinations of features. However, due to space limitations, they are not described one by one. Therefore, any combination of the various technical features in the above embodiments also falls within the scope of this specification.

[0110] Corresponding to the above-mentioned embodiment of the display content recognition method, the present disclosure also provides a display content recognition device, which can be applied to an electronic device, such as a display driver of an electronic device. Figure 6 As shown, Figure 6 1 is a structural block diagram of a display content recognition device according to an exemplary embodiment of the present disclosure. The device includes:

[0111] The display data acquisition module 201 is used to acquire display data for a plurality of pixels in the screen, wherein the bit depth of the display data of each pixel is N bits, wherein N-1 bits are used to describe the color data processed by the preset offset, and the remaining 1 bit is used to describe the size relationship between the processed color data and the preset offset; N is an integer greater than 1;

[0112] The display content recognition module 202 is used to count the number of target pixels among the plurality of pixels that satisfy the condition that the processed color data is greater than the preset offset based on the size relationship of each pixel among the plurality of pixels, and perform display content recognition according to the number of target pixels.

[0113] In some embodiments, the device further includes a screen division module for dividing the screen into regions.

[0114] The display content recognition module 202 is specifically used to: for each divided area, based on the size relationship of the pixels in the area, count the number of target pixels in the area that meet the condition that the processed color data is greater than the preset offset, and identify the display content of the area according to the number of target pixels.

[0115] In some embodiments, the apparatus is applied to an electronic device, and the electronic device includes a first register and a second register, the first register is written with the preset offset, and the second register is written with different processing modes corresponding to the size relationship.

[0116] The device also includes a color restoration module and an optimization processing module.

[0117] The color restoration module is used to restore the original color data of each pixel among the plurality of pixels according to different processing methods corresponding to the display data of the pixel, the preset offset stored in the first register and the size relationship stored in the second register.

[0118] The optimization processing module is used to optimize the original color data of the pixels in each area according to the display content recognition result after performing display content recognition on the area according to the number of target pixels to obtain the display content recognition result.

[0119] In some embodiments, the optimization processing module is specifically used to determine the target optimization parameters according to the display content recognition result and the pre-stored mapping relationship between different display content recognition results and optimization parameters; and optimize the original color data of the pixels in the area using the target optimization parameters.

[0120] In some embodiments, the electronic device further includes a third register code table; different third registers in the third register code table are used to store optimization parameters corresponding to different display content recognition results.

[0121] In some embodiments, the device is applied to an electronic device, and the electronic device includes a fourth register, and the fourth register is written with the number of area divisions of the screen; wherein the value of the number of area divisions of the screen is greater than or equal to 1. The screen division module is specifically configured to divide the screen into areas according to the number of area divisions stored in the fourth register.

[0122] In some embodiments, the display content recognition module 202 is specifically configured to obtain a display content recognition result according to the number of target pixels and a pre-stored mapping relationship between different numbers of target pixels and display content.

[0123] In some embodiments, the display data of each pixel includes display data of three color components, and the color depth of the display data of each color component is M bits, wherein M-1 bits are used to describe the color data corresponding to the color component after being processed by a preset offset, and the remaining 1 bit is used to describe the size relationship between the processed color data corresponding to the color component and the preset offset; M is an integer greater than 1.

[0124] The display content recognition module 202 is specifically configured to, for each color component of each pixel among the several pixels, based on the magnitude relationship of the pixel in the color component, count the number of target pixels corresponding to the color component that satisfy the processed color data being greater than the preset offset; and perform display content recognition according to the number of target pixels corresponding to at least one color component.

[0125] In some embodiments, the device is applied to a display driver of an electronic device; wherein, the electronic device further includes an application processor, and the display data for several pixels in the screen is sent from the application processor to the display driver.

[0126] For the specific implementation process of the functions and roles of each unit in the above device, refer to the implementation process of the corresponding steps in the above method in detail, which will not be elaborated here.

[0127] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to the partial descriptions of the method embodiments. The device embodiments described above are only illustrative, where the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units.

[0128] Corresponding to the embodiments of the foregoing display content recognition method, the present disclosure further provides an electronic device with a display content recognition device. The electronic device includes:

[0129] A processor;

[0130] A memory for storing a computer program executable by the processor;

[0131] Wherein, when the processor executes the program, it implements the display content recognition method described in any of the above embodiments.

[0132] As Figure 7 shown, Figure 7 FIG. is a structural block diagram of an electronic device with a skipping rope data processing device shown by the present disclosure according to an exemplary embodiment. The electronic device 700 may include one or more of the following components: a processing component 701, a memory 702, a power supply component 703, a multimedia component 704, an audio component 705, an input / output (I / O) interface 706, a sensor component 707, and a communication component 708.

[0133] The processing component 701 generally controls the overall operation of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 701 may include one or more processors 709 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 701 may include one or more modules to facilitate the interaction between the processing component 701 and other components. For example, the processing component 701 may include a multimedia module to facilitate the interaction between the multimedia component 704 and the processing component 701.

[0134] The memory 702 is configured to store various types of data to support operations on the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, videos, etc. The memory 702 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0135] The power supply component 703 provides power to various components of the electronic device 700. The power supply component 703 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 700.

[0136] The multimedia component 704 includes a screen that provides an output interface between the electronic device 700 and the user. The screen may include a touch panel (TP) implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 704 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0137] The audio component 705 is configured to output and / or input audio signals. For example, the audio component 705 includes a microphone (MIC), and when the electronic device 700 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 702 or sent via the communication component 708. In some embodiments, the audio component 705 also includes a speaker for outputting audio signals.

[0138] I / O interface 706 provides an interface between processing component 701 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0139] The sensor assembly 707 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 707 can detect the open / closed state of the electronic device 700, the relative positioning of the components, such as the display and keypad of the electronic device 700, and the sensor assembly 707 can also detect the position change of the electronic device 700 or a component of the electronic device 700, the presence or absence of contact between the user and the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and the temperature change of the electronic device 700. The sensor assembly 707 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 707 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 707 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, a temperature sensor, a photoelectric sensor, or a GPS sensor.

[0140] The communication component 708 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G LTE, 7G NR (7G NewRadio) or a combination thereof. In an exemplary embodiment, the communication component 708 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 708 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0141] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above method.

[0142] For the implementation processes of the functions and roles of the various components in the above device, refer to the implementation processes of the corresponding steps in the above method for details, which will not be elaborated here.

[0143] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can be referred to the partial description of the method embodiment. The device embodiments described above are only illustrative. The components described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the present disclosure solution. Those of ordinary skill in the art can understand and implement it without creative efforts.

[0144] Corresponding to the foregoing embodiments of the display content recognition method, the present disclosure also provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by the processor 509 of the above electronic device, the steps of the display content recognition method recorded in any of the foregoing embodiments are implemented.

[0145] The present disclosure may be in the form of a computer program product implemented on one or more storage media (including but not limited to disk memories, CD-ROMs, optical memories, etc.) containing program codes. The computer-usable storage media include permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. The information may be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include but are not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information accessible by a computing device.

[0146] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0147] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

[0148] The above description is only a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure shall be included in the scope of protection of the present disclosure.

Claims

1. A display content recognition method, It is characterized in that include: Obtaining display data for a plurality of pixels in a screen, wherein the bit depth of the display data of each pixel is N bits, wherein N-1 bits are used to describe color data processed by a preset offset, and the remaining 1 bit is used to describe the magnitude relationship between the processed color data and the preset offset; N is an integer greater than 1; Based on the size relationship of each pixel among the plurality of pixels, the number of target pixels among the plurality of pixels satisfying the requirement that the processed color data is greater than the preset offset is counted, and display content recognition is performed according to the number of target pixels.

2. The method according to claim 1, It is characterized in that The method further comprises: Dividing the screen into regions; The step of counting the number of target pixels in the plurality of pixels satisfying that the processed color data is greater than the preset offset based on the size relationship of each pixel in the plurality of pixels, and performing display content recognition according to the number of target pixels, includes: For each divided area, based on the size relationship of the pixels in the area, the number of target pixels in the area that meet the requirement that the processed color data is greater than the preset offset is counted, and the display content of the area is identified according to the number of target pixels.

3. The method according to claim 2, It is characterized in that The method is applied to an electronic device, the electronic device comprising a first register and a second register, the first register being written with the preset offset, and the second register being written with different processing modes corresponding to the size relationship; The method further comprises: For each pixel among the plurality of pixels, according to the display data of the pixel, the preset offset stored in the first register, and different processing methods corresponding to the size relationship stored in the second register, the original color data of the pixel is restored; For each region, after display content recognition is performed on the region according to the number of target pixels to obtain a display content recognition result, the original color data of the pixels in the region are optimized according to the display content recognition result.

4. The method according to claim 3, It is characterized in that The optimizing the original color data of the pixels in the area according to the display content recognition result includes: Determining target optimization parameters according to the display content recognition result and the pre-stored mapping relationship between different display content recognition results and optimization parameters; The target optimization parameters are used to optimize the original color data of the pixels in the area.

5. The method according to claim 4, It is characterized in that The electronic device further comprises a third register code table; Different third registers in the third register code table are used to store optimization parameters corresponding to different display content recognition results.

6. The method according to claim 2, It is characterized in that The method is applied to an electronic device, the electronic device comprises a fourth register, the fourth register is written with the number of area divisions of the screen; wherein the value of the number of area divisions of the screen is greater than or equal to 1; The dividing the screen into regions includes: The screen is divided into regions according to the number of region divisions stored in the fourth register.

7. The method according to claim 1, It is characterized in that The identifying the display content according to the number of the target pixels includes: A display content recognition result is obtained according to the number of target pixels and the pre-stored mapping relationship between different numbers of target pixels and display content.

8. The method according to claim 1, It is characterized in that The display data of each pixel includes display data of three color components, and the color depth of the display data of each color component is M bits, wherein M-1 bits are used to describe the color data corresponding to the color component after being processed by a preset offset, and the remaining 1 bit is used to describe the size relationship between the processed color data corresponding to the color component and the preset offset; M is an integer greater than 1; The step of counting the number of target pixels in the plurality of pixels satisfying that the processed color data is greater than the preset offset based on the size relationship of each pixel in the plurality of pixels, and performing display content recognition according to the number of target pixels, includes: For each color component of each pixel among the plurality of pixels, based on the size relationship of the pixel in the color component, counting the number of target pixels corresponding to the color component that satisfy the requirement that the processed color data is greater than the preset offset; Display content identification is performed according to the number of the target pixels corresponding to at least one color component.

9. The method according to any one of claims 1 to 8, It is characterized in that The method is applied to a display driver of an electronic device; wherein the electronic device further comprises an application processor, and the display data for a plurality of pixels in the screen is sent by the application processor to the display driver.

10. A display content recognition device, It is characterized in that include: A display data acquisition module, used to acquire display data for a number of pixels in the screen, wherein the bit depth of the display data of each pixel is N bits, wherein N-1 bits are used to describe color data processed by a preset offset, and the remaining 1 bit is used to describe the size relationship between the processed color data and the preset offset; N is an integer greater than 1; The display content recognition module is used to count the number of target pixels among the plurality of pixels that satisfy the condition that the processed color data is greater than the preset offset based on the size relationship of each pixel among the plurality of pixels, and perform display content recognition according to the number of target pixels.

11. An electronic device, It is characterized in that include: processor; a memory for storing a computer program executable by the processor; Wherein, when the processor executes the program, the steps of the method according to any one of claims 1 to 9 are implemented.

12. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

Images