Display content identification method and device, electronic equipment and storage medium

Abstract

The invention relates to a display content identification method and device, electronic equipment and a storage medium. The method comprises the steps that a screen is divided into at least one display area, and each display area comprises corresponding display content; based on the pixel parameters of the pixel points of the display content in the display area, the display content type to which the display content belongs is recognized, and the pixel parameters are used for representing the colors of the pixel points. The display content in each display area is recognized, regional recognition is achieved, and recognition is more flexible.

Description

Technical Field

[0001] The present disclosure relates to the technical field of content recognition, and in particular to a method, device, electronic device and storage medium for recognizing displayed content. Background Art

[0002] OLED (Organic Light-Emitting Diode) is a commonly used material for electronic device screens. Due to the current-driven characteristics of OLED screens, the display content on the OLED screen will directly affect the power consumption of the OLED screen. Therefore, it is extremely important for electronic devices to recognize the display content on the OLED screen. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a method, device, electronic device and storage medium for identifying display content.

[0004] According to a first aspect of an embodiment of the present disclosure, a method for identifying display content is provided.

[0005] Dividing the screen into at least one display area, each display area containing corresponding display content;

[0006] Based on pixel parameters of pixels of the display content in the display area, the display content type to which the display content belongs is identified, wherein the pixel parameters are used to characterize the color of the pixel.

[0007] In some embodiments, the identifying the display content type to which the display content belongs based on the pixel parameter of each pixel in the display content corresponding to the display area includes:

[0008] Obtaining pixel parameters of each pixel among a plurality of pixels of the displayed content, the pixel parameters comprising a reference color value and a corresponding identifier, the reference color value being an absolute value of a difference between a color value of the pixel and a preset value, and the identifier being used to characterize the positive or negative of the difference;

[0009] Determine the number of the identifiers in the plurality of pixel parameters that are preset identifiers;

[0010] The display content type to which the display content belongs is determined based on the number of the preset identifiers and the preset corresponding relationship, wherein the preset corresponding relationship is used to characterize the corresponding relationship between the number of the preset identifiers and the display content type.

[0011] In some embodiments, the color value of the pixel point includes sub-color values ​​corresponding to multiple channels, the pixel parameters include multiple reference sub-color values ​​and an identifier corresponding to each of the reference sub-color values, the reference sub-color value is the absolute value of the difference between the sub-color value and the corresponding preset value, and each of the sub-color value has a corresponding preset value.

[0012] In some embodiments, determining that the identifier in the plurality of pixel parameters is a number of preset identifiers includes:

[0013] Respectively determine the number of identifiers corresponding to the reference sub-color values ​​corresponding to each channel in the plurality of pixel parameters as the preset identifiers;

[0014] The determining, based on the number of the preset identifiers and the preset corresponding relationship, the display content type to which the display content belongs includes:

[0015] Based on the number of identifiers corresponding to the reference sub-color values ​​corresponding to at least one channel being the preset identifiers and the preset corresponding relationship, the display content type to which the display content belongs is determined.

[0016] In some embodiments, the maximum byte occupied by the reference color value is 7 bits, and the byte occupied by the identifier is 1 bit.

[0017] According to a second aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising a display driver chip,

[0018] The display driver chip is configured to divide the screen into at least one display area, each of which contains corresponding display content;

[0019] The display driver chip is further configured to identify the display content type to which the display content belongs based on pixel parameters of the pixel points of the display content in the display area, wherein the pixel parameters are used to characterize the color of the pixel points.

[0020] In some embodiments, the display driver chip is further configured to obtain pixel parameters of each pixel of the plurality of pixels of the display content, the pixel parameters including a reference color value and a corresponding identifier, the reference color value being an absolute value of a difference between a color value of the pixel and a preset value, and the identifier being used to characterize the positive or negative value of the difference;

[0021] The display driver chip is further configured to determine the number of the identifiers in the plurality of pixel parameters that are preset identifiers;

[0022] The display driver chip is further configured to determine the display content type to which the display content belongs based on the number of the preset identifiers and a preset corresponding relationship, wherein the preset corresponding relationship is used to characterize the corresponding relationship between the number of the preset identifiers and the display content type.

[0023] In some embodiments, the electronic device further comprises an application processor,

[0024] The application processor is configured to determine the pixel parameter of each pixel based on a preset rule and a color value of each pixel, wherein the preset rule is used to indicate that the pixel parameter is represented by the reference color value and the identifier;

[0025] The application processor is further configured to send each pixel parameter to the display driver chip.

[0026] In some embodiments, the display driver chip includes a first register, a second register, and a third register;

[0027] The first register is configured to store the preset value;

[0028] The second register is configured to store an identifier in each of the pixel parameters;

[0029] The third register is configured to count the number of the preset identifiers.

[0030] In some embodiments, the display driver chip further includes a fourth register;

[0031] The fourth register is configured to divide the screen into the at least one display area.

[0032] According to a third aspect of an embodiment of the present disclosure, a device for identifying display content is provided, the device comprising:

[0033] A region division module, configured to divide the screen into at least one display region, each of the display regions containing corresponding display content;

[0034] The type determination module is configured to identify the display content type to which the display content belongs based on pixel parameters of the pixel points of the display content in the display area, wherein the pixel parameters are used to characterize the color of the pixel points.

[0035] In some embodiments, the type determination module includes:

[0036] a pixel parameter acquisition unit, configured to acquire a pixel parameter of each pixel point among a plurality of pixel points of the display content, the pixel parameter including a reference color value and a corresponding identifier, the reference color value being an absolute value of a difference between a color value of the pixel point and a preset value, and the identifier being used to characterize a positive or negative sign of the difference;

[0037] a quantity determining unit, configured to determine the quantity of the identifiers as preset identifiers in the plurality of pixel parameters;

[0038] The type determination unit is configured to determine the display content type to which the display content belongs based on the number of the preset identifiers and a preset corresponding relationship, wherein the preset corresponding relationship is used to characterize the corresponding relationship between the number of the preset identifiers and the display content type.

[0039] In some embodiments, the color value of the pixel point includes sub-color values ​​corresponding to multiple channels, the pixel parameters include multiple reference sub-color values ​​and an identifier corresponding to each of the reference sub-color values, the reference sub-color value is the absolute value of the difference between the sub-color value and the corresponding preset value, and each of the sub-color value has a corresponding preset value.

[0040] In some embodiments, the quantity determination unit is configured to:

[0041] Respectively determine the number of identifiers corresponding to the reference sub-color values ​​corresponding to each channel in the plurality of pixel parameters as the preset identifiers;

[0042] The type determination unit is configured to:

[0043] Based on the number of identifiers corresponding to the reference sub-color values ​​corresponding to at least one channel being the preset identifiers and the preset corresponding relationship, the display content type to which the display content belongs is determined.

[0044] In some embodiments, the maximum byte occupied by the reference color value is 7 bits, and the byte occupied by the identifier is 1 bit.

[0045] According to a fourth aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0046] processor;

[0047] a memory for storing processor-executable instructions;

[0048] The processor is configured to execute the method as described in the first aspect of the embodiment of the present disclosure.

[0049] According to a fifth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method described in the first aspect of the embodiment of the present disclosure.

[0050] The above method of the present disclosure has the following beneficial effects:

[0051] The method provided by the embodiment of the present disclosure divides the screen into at least one display area, each display area contains corresponding display content; based on the pixel parameters of the pixel points of the display content in the display area, the display content type to which the display content belongs is identified, and the pixel parameters are used to characterize the color of the pixel points. The display content in each display area is identified, and regional identification is realized, and the identification is more flexible. Moreover, when there are multiple display areas, compared with identifying the display content type to which the display content in the entire screen belongs, the display content type to which the display content in each display area belongs is identified separately, and the amount of data processed is smaller, and the identification speed is faster.

[0052] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0054] Figure 1 is a flow chart showing a method for identifying display content according to an exemplary embodiment;

[0055] Figure 2 is a flow chart showing another method for identifying display content according to an exemplary embodiment;

[0056] Figure 3 is a flow chart showing another method for identifying display content according to an exemplary embodiment;

[0057] Figure 4 is a flow chart showing another method for identifying display content according to an exemplary embodiment;

[0058] Figure 5 is a flow chart showing a process of identifying display content according to an exemplary embodiment;

[0059] Figure 6 is a block diagram of a display content recognition device according to an exemplary embodiment;

[0060] Figure 7It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0061] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0062] OLED is a commonly used material for screens of electronic devices. Due to the current-driven characteristics of OLED screens, the display content on the OLED screen will directly affect the power consumption of the OLED screen. Therefore, it is extremely important for electronic devices to recognize the display content on the OLED screen. In one scenario, after identifying the scene of the display content, in order to make the display content displayed on the screen have a better visual effect, the display content can be rendered and displayed using the rendering method corresponding to the scene for different scenes.

[0063] In the related art, electronic devices count the data of all pixels on the screen. For example, if the screen size is 1080*2400, it is necessary to traverse all the pixel data of the entire screen 1080*2400*3, and then count the proportion of each grayscale to identify the scene of the displayed content. This recognition consumes a lot of power. For example, the pixel data is shown in Table 1:

[0064] Table 1

[0065] 1 2 3 4 5 6 … 1 0 255 128 255 128 128 … 2 0 255 128 255 128 128 … 3 0 255 128 255 128 128 … 4 0 255 128 255 128 128 … … … … … … … … …

[0066] Table 1 lists the pixel data of the first pixel and the second pixel in rows 1-4 of the screen, where columns 1-3 are the RGB (Red Green Blue) data of the first pixel, columns 4-6 are the RGB data of the second pixel, and the RGB data of the subsequent pixels are arranged in sequence in the table. The final table includes 1080*2400*3 data.

[0067] It can be seen from Table 1 that for the display content on the entire screen, the amount of pixel data of the display content is very large. Moreover, the range of pixel data is 0-255, that is, the maximum byte occupied by each data is 8 bits.

[0068] The method provided by the embodiments of the present disclosure is applied to an electronic device, which may be a mobile phone, a tablet computer, a notebook computer, a wearable device, a smart home device, or the like, which may be a device that can display content through a screen.

[0069] Figure 1 is a flowchart of a method for identifying display content according to an exemplary embodiment, which is executed by an electronic device, see Figure 1 , the method comprises the following steps:

[0070] Step S101, dividing the screen into at least one display area, each display area containing corresponding display content.

[0071] There are one or more display areas, and the display content contained in each display area refers to the display content to be displayed in the display area. The display content can be any content, for example, the display content can be text, images, video frames, etc., and the embodiment of the present disclosure does not limit the display content.

[0072] In some embodiments, a preset number of display areas is preset, and the electronic device divides the screen into a preset number of display areas according to the preset number. For example, the preset number is any number between 1-32.

[0073] Step S102 : identifying the display content type to which the display content belongs based on pixel parameters of the pixel points of the display content in the display area, where the pixel parameters are used to characterize the color of the pixel points.

[0074] The display content includes a plurality of pixels, and the number of pixels in the display content matches the size of the corresponding display area. For example, if the size of the display area is 270*600, the display content includes 270*600 pixels. For each pixel, it is necessary to display the pixel on the screen according to the pixel parameter of the pixel, and the pixel parameter is used to characterize the color of the pixel. Optionally, the pixel parameter can be the color value of the pixel, and the color value at least includes the RGB value of the pixel, or the pixel parameter is other parameters that characterize the color of the pixel determined according to the color value of the pixel.

[0075] For display content, the display content type to which the display content belongs can be identified by counting the pixel parameters of the pixels of the display content, that is, by counting the colors of the pixels of the display content. The display content types include skin color, greenery, landscape, people, etc. For example, if it is found that the color represented by the pixel parameters of most of the pixels of the display content is skin color, then the display content type of the display content can be determined to be skin color.

[0076] The method provided by the embodiment of the present disclosure divides the screen into at least one display area, identifies the display content in each display area, thereby realizing regional identification and making identification more flexible. Moreover, when there are multiple display areas, compared with identifying the display content type to which the display content in the entire screen belongs, separately identifying the display content type to which the display content in each display area belongs requires less data to be processed and has a faster identification speed.

[0077] In some embodiments, when identifying the display content type to which the display content belongs based on the pixel parameters of the pixel points of the display content, the pixel parameters can be represented in the form of a reference color value plus an identifier, and then the display content type to which the display content belongs is identified by counting the number of preset identifiers. There is no need to count a large number of pixel parameters, the identification method is simpler, and the power consumption during identification is reduced.

[0078] Figure 2 is a flowchart of another method for identifying display content according to an exemplary embodiment, which is executed by an electronic device, see Figure 2 , the method comprises the following steps:

[0079] Step S201, obtaining pixel parameters of each pixel among multiple pixels of the display content, the pixel parameters including a reference color value and a corresponding identifier, the reference color value is the absolute value of the difference between the color value of the pixel and a preset value, and the identifier is used to represent the positive or negative of the difference.

[0080] For each pixel, it is necessary to display the pixel on the screen according to the color value of the pixel, and the color value includes at least the RGB value of the pixel. The color value of the pixel is represented by a reference color value and a corresponding identifier. The reference color value is the absolute value of the difference between the color value of the pixel and the preset value, and the identifier is used to characterize the positive and negative of the difference. Among them, the reference color value is 0 or a positive integer, the preset value is a pre-set value, and the preset value is less than 255. For example, the preset value can be 128, 120, 114, etc. The color value of the pixel is any value in 0-255. The difference between the color value and the preset value may be greater than 0 or less than 0. In order to be able to indicate the positive and negative of the difference, a corresponding identifier is set. For example, when the identifier is 0, it means that the difference is less than 0, and when it is 1, it means that the difference is greater than 0. Optionally, when the difference between the color value and the preset value is equal to 0, the identifier can be any one of the identifiers indicating positive and negative.

[0081] Step S202: determining the number of the plurality of pixel parameters that are identified as preset identifiers.

[0082] When identifying the displayed content, it can be identified based on the color in the displayed content. In the embodiment of the present disclosure, since the identifier represents the positive or negative of the difference, and the positive or negative of the difference can indicate whether the color value is greater than the preset value or less than the preset value, when the color value is greater than the preset value, it means that the color value is larger and the color of the pixel is lighter, and when the color value is less than the preset value, it means that the color value is smaller and the color of the pixel is darker. Therefore, the color depth of the pixel can be determined by the positive or negative represented by the identifier. Among them, the preset identifier is an identifier representing a positive difference, and the number of the preset identifiers in the multiple pixel parameters is the number of the pixel parameters with positive differences in the multiple pixel parameters; or, the preset identifier is an identifier representing a negative difference, and the number of the preset identifiers in the multiple pixel parameters is the number of the pixel parameters with negative differences in the multiple pixel parameters.

[0083] Step S203, determining the display content type to which the display content belongs based on the number of preset identifiers and the preset corresponding relationship, where the preset corresponding relationship is used to characterize the corresponding relationship between the number of preset identifiers and the display content type.

[0084] The preset corresponding relationship is a preset corresponding relationship between the quantity representing the preset identifier and the display content type. For example, when the quantity is the first quantity, it corresponds to the first display content type, and when the quantity is the second quantity, it corresponds to the second display content type. One quantity corresponds to one display content type, and one display content type can correspond to multiple quantities.

[0085] The method provided by the embodiment of the present disclosure obtains pixel parameters of each pixel point among multiple pixel points of display content, where the pixel parameters include a reference color value and a corresponding identifier, where the reference color value is the absolute value of the difference between the color value of the pixel point and a preset value, and the identifier is used to characterize the positive and negative of the difference, and the number of preset identifiers in the multiple pixel parameters is determined, and then based on the number of preset identifiers and the preset correspondence, the display content type to which the display content belongs is determined, and the preset correspondence is used to characterize the correspondence between the number of preset identifiers and the display content type, that is, the display content type to which the display content belongs is identified by counting the number of preset identifiers, without the need to count a large amount of pixel point data, the identification method is simpler, and the power consumption during identification is reduced.

[0086] It should be noted that Figure 2 In the embodiment shown, only the identification process of the display content in one display area is described. In another embodiment, the identification process of the display content in each display area can be used. Figure 2 The embodiment shown is identified.

[0087] exist Figure 2Based on the embodiment shown, the color value may include sub-color values ​​corresponding to multiple channels, and correspondingly, the pixel parameter includes multiple reference sub-color values ​​and an identifier corresponding to each reference sub-color value. Therefore, the display content can be identified based on the multiple reference sub-color values ​​corresponding to the pixel points of the display content and the identifier corresponding to each reference sub-color value.

[0088] Figure 3 is a flowchart of another method for identifying display content according to an exemplary embodiment, which is executed by an electronic device, see Figure 3 , the method comprises the following steps:

[0089] Step S301, obtaining pixel parameters of each pixel among multiple pixels of displayed content, wherein the color value of each pixel includes sub-color values ​​corresponding to multiple channels, and the pixel parameters include multiple reference sub-color values ​​and an identifier corresponding to each reference sub-color value.

[0090] In the disclosed embodiment, considering that the color value of a pixel point may include parameters such as RGB value, brightness value, and transparency value for describing the pixel point, the sub-color values ​​corresponding to multiple channels of each pixel point may be obtained respectively, and the channels include R channel, G channel, B channel, brightness channel, transparency channel, etc. Among them, the reference sub-color value is the absolute value of the difference between the sub-color value and the corresponding preset value, each sub-color value has a corresponding preset value, and the preset values ​​corresponding to the sub-color values ​​corresponding to different channels may be the same or different. For example, for the three RGB channels, the preset value corresponding to the R channel is 128, the preset value corresponding to the G channel is 124, and the preset value corresponding to the B channel is 110; or, the preset values ​​corresponding to the three RGB channels are all 128. The method for determining each reference sub-color value is the same as the method for determining the reference color value, and the method for determining the identifier corresponding to each reference sub-color value is the same as the method for determining the identifier corresponding to the reference color value, and for the identifier, the identifiers of different reference sub-color values ​​are represented in the same way.

[0091] In some embodiments, the preset values ​​corresponding to the three RGB channels may be set as preset values ​​corresponding to specific colors. For example, if the specific color is yellow, the preset values ​​may be set as RGB values ​​corresponding to yellow.

[0092] Step S302 , respectively determining the number of preset identifiers corresponding to the reference sub-color values ​​corresponding to each channel in the plurality of pixel parameters.

[0093] Considering that different channels have different effects on the color finally displayed by the pixel, for each channel, the number of reference sub-color values ​​corresponding to each channel that are identified as preset identifiers is counted. For example, for the three RGB channels, the number of reference sub-color values ​​corresponding to the R channel that are identified as preset identifiers, the number of reference sub-color values ​​corresponding to the G channel that are identified as preset identifiers, and the number of reference sub-color values ​​corresponding to the B channel that are identified as preset identifiers are counted.

[0094] In some embodiments, a counter is provided for each channel, and each time a reference sub-color value identified as a preset identifier is detected, the counter is incremented by 1 until all reference sub-color values ​​corresponding to the channel are counted, thereby obtaining the number of reference sub-color values ​​corresponding to the channel identified as the preset identifier.

[0095] In some embodiments, the maximum byte occupied by the reference color value is 7 bits, and the byte occupied by the identifier is 1 bit. For example, if the color value is 255 and the preset value is 128, the pixel parameter is "1111111" + "1", where 1111111 is the reference color value and 1 is the identifier. For another example, if the color value is 0 and the preset value is 128, the pixel value is "1111111" + "0", where 1111111 is the reference color value and the identifier is 0. Similarly, the maximum byte occupied by the reference sub-color value is 7 bits, and the byte occupied by the identifier is 1 bit. Compared with the original reference color value represented by 8 bits, this representation method in the embodiment of the present disclosure does not increase the amount of data, and the identifier is represented separately, which is more convenient for quantitative statistics.

[0096] Step S303 : determining the display content type to which the display content belongs based on the number of preset identifiers corresponding to the reference sub-color values ​​corresponding to at least one channel and the preset corresponding relationship.

[0097] When identifying the display content type to which the display content belongs, the quantity corresponding to at least one of the multiple channels may be considered, for example, the R channel may be considered, or the G channel may be considered, or the B channel may be considered, or the three RGB channels may be considered.

[0098] In some embodiments, the preset correspondence includes a correspondence between the quantity corresponding to at least one channel and the display content type, that is, for multiple channels, a correspondence between the combined quantity of the quantity corresponding to at least one channel and the display content type is preset, for example, if the quantity corresponding to the R channel is the first quantity, the quantity corresponding to the G channel is the second quantity, and the quantity corresponding to the B channel is the third quantity, then the display content type is the first type; if the quantity corresponding to the R channel is the second quantity, the quantity corresponding to the G channel is the first quantity, and the quantity corresponding to the B channel is the third quantity, then the display content type is the second type.

[0099] Optionally, the preset corresponding relationship is used to characterize the corresponding relationship between the quantity range and the display content type, that is, different quantity ranges correspond to different display content types. When determining the display content type, the quantity range in which the quantity of the preset mark is located is first determined, and the display content type corresponding to the quantity range is the display content type corresponding to the quantity of the preset mark. Similarly, the preset corresponding relationship includes the corresponding relationship between the quantity range corresponding to at least one channel and the display content type.

[0100] In some embodiments, considering that different screen sizes may be different, that is, the number of pixels in different screens may be different, in order to make the preset correspondence relationship universal, the preset correspondence relationship is used to characterize the correspondence between the number of preset identifiers, the number of multiple pixels of the displayed content, and the type of displayed content, that is, the preset correspondence relationship is used to characterize the correspondence between the ratio between the number of preset identifiers and the number of multiple pixels of the displayed content and the type of displayed content. For example, if the ratio is the first ratio, the displayed content type is the first type; if the ratio is the second ratio, the displayed content type is the second type. Similarly, the preset correspondence relationship includes the correspondence between the ratio corresponding to at least one channel and the type of displayed content.

[0101] Optionally, the preset corresponding relationship is used to characterize the corresponding relationship between the ratio range and the display content type, that is, different ratio ranges correspond to different display content types. When determining the display content type, first determine the ratio range in which the ratio between the number of preset identifiers and the number of multiple pixel points of the display content lies, and the display content type corresponding to the ratio range is the display content type corresponding to the number of preset identifiers. Similarly, the preset corresponding relationship includes the corresponding relationship between the ratio range corresponding to at least one channel and the display content type.

[0102] In the embodiment of the present disclosure, taking into account that the color value of a pixel point includes sub-color values ​​of multiple channels, the number of identifiers corresponding to the reference sub-color values ​​corresponding to each channel in the multiple pixel parameters is counted for different channels respectively, and then the display content type to which the display content belongs is determined based on the number of identifiers corresponding to the reference sub-color values ​​corresponding to at least one channel and the preset correspondence. The display content type to which the display content belongs is identified by counting the number of preset identifiers corresponding to at least one channel, without the need to count a large amount of pixel point data, so that the identification method is simpler, the power consumption during identification is reduced, and the conditions of different channels are taken into consideration, so that the identification result is more accurate, and different display content types can be identified.

[0103] Furthermore, in the embodiments of the present disclosure, the amount of data to be counted is relatively small, and the statistical purpose can be achieved without increasing the IC (Integrated Circuit) design cost.

[0104] Figure 4 is a flowchart of another method for identifying display content according to an exemplary embodiment, which is executed by an electronic device, the electronic device including a display driver integrated circuit (DDIC), see Figure 4 , the method comprises the following steps:

[0105] Step S401: The display driver chip divides the screen into at least one display area, each display area containing corresponding display content.

[0106] In some embodiments, the display driver chip includes a fourth register; the fourth register divides the screen into at least one display area. Optionally, the fourth register stores a preset number of display areas, and the screen is divided into the preset number of display areas according to the preset number, for example, the fourth register is an Area register.

[0107] Step S402 : The display driver chip identifies the display content type to which the display content belongs based on pixel parameters of the pixels of the display content in the display area, where the pixel parameters are used to represent the color of the pixels.

[0108] The implementation of steps S401-S402 is shown in the above Figure 1 The embodiment shown is similar to the above Figure 1 The difference between the illustrated embodiment and the embodiment shown is that the execution subject of steps S401 - S402 is a display driver chip in the electronic device.

[0109] In some embodiments, the display driver chip obtains pixel parameters of each pixel point among multiple pixel points of the display content; determines the number of preset identifiers in the multiple pixel parameters; and the display driver chip determines the display content type to which the display content belongs based on the number of preset identifiers and the preset correspondence.

[0110] In some embodiments, the electronic device further includes an application processor (AP), which determines the pixel parameters of each pixel based on preset rules and the color value of each pixel, and sends each pixel parameter to the display driver chip. The preset rules are used to indicate that the pixel parameters are represented by reference color values ​​and identifiers, and the preset rules are agreed upon by the application processor and the display driver chip. In other words, the application processor first obtains the color value of each pixel, and then based on the preset rules, represents the color value of each pixel in the form of pixel parameters, and then transmits it to the display driver chip. When the display driver chip receives the pixel parameters, it can determine the reference color value and identifier in the pixel parameters according to the preset rules.

[0111] Optionally, the electronic device further includes a transmission module, and the application processor sends pixel parameters to the display driver chip through the transmission module.

[0112] In some embodiments, the display driver chip includes a first register, a second register and a third register; the first register is configured to store a preset value, that is, the preset value is stored in the first register, so that the display driver chip can determine the original color value of each pixel by reading the preset value in the first register, for example, the first register can be an offset register; the second register is configured to store an identifier in each pixel parameter, that is, the identifier is stored in the second register, for example, the second register can be a roy register; the third register is configured to count the number of preset identifiers, that is, the third register counts the number of preset identifiers according to the identifier in the second register, for example, the third register is a tuning register.

[0113] Figure 5 is a flowchart showing a process of identifying display content according to an exemplary embodiment, see Figure 5 First, the AP determines the statistical content according to the preset value in the offset register. The statistical content refers to the preset value according to which the reference color value needs to be determined. Then, according to the number of display areas set in the Area register, it is determined whether regional identification is required. When regional identification is required, according to the number of display areas, the pixel parameters of each pixel in the display content of each display area are sent separately in a 7+1 bit manner (the reference color value occupies 7 bits and the identifier occupies 1 bit). After the DDIC receives the pixel parameters of each pixel in the display content of each display area, it counts the number of preset identifiers corresponding to each display area, and then identifies the display content type to which the display content belongs.

[0114] Figure 6 is a block diagram of a display content recognition device according to an exemplary embodiment, which is configured in an electronic device, see Figure 6 , the device comprises:

[0115] The area division module 601 is configured to divide the screen into at least one display area, each display area containing corresponding display content;

[0116] The type determination module 602 is configured to identify the display content type to which the display content belongs based on pixel parameters of the pixels of the display content in the display area, where the pixel parameters are used to characterize the color of the pixels.

[0117] In some embodiments, the type determination module 602 includes:

[0118] A pixel parameter acquisition unit is configured to acquire a pixel parameter of each pixel point among a plurality of pixel points of the display content, wherein the pixel parameter includes a reference color value and a corresponding identifier, wherein the reference color value is an absolute value of a difference between a color value of the pixel point and a preset value, and the identifier is used to characterize a positive or negative sign of the difference;

[0119] A quantity determination unit, configured to determine the quantity of the plurality of pixel parameters identified as a preset identification;

[0120] The type determination unit is configured to determine the display content type to which the display content belongs based on the number of preset identifiers and a preset corresponding relationship, where the preset corresponding relationship is used to characterize the corresponding relationship between the number of preset identifiers and the display content type.

[0121] In some embodiments, the color value of a pixel point includes sub-color values ​​corresponding to multiple channels, the pixel parameters include multiple reference sub-color values ​​and an identifier corresponding to each reference sub-color value, the reference sub-color value is the absolute value of the difference between the sub-color value and the corresponding preset value, and each sub-color value has a corresponding preset value.

[0122] In some embodiments, the quantity determination unit is configured to:

[0123] Determine respectively the number of preset identifiers corresponding to the reference sub-color values ​​corresponding to each channel in the plurality of pixel parameters;

[0124] The type determination unit is configured to:

[0125] Based on the number of preset identifiers corresponding to the reference sub-color values ​​corresponding to at least one channel and the preset corresponding relationship, a display content type to which the display content belongs is determined.

[0126] In some embodiments, the maximum byte occupied by the reference color value is 7 bits, and the byte occupied by the identifier is 1 bit.

[0127] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0128] An embodiment of the present disclosure further provides an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to execute the method for identifying display content in the above embodiment.

[0129] Figure 7 is a block diagram of an electronic device 700 according to an exemplary embodiment.

[0130] Reference Figure 7, the electronic device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0131] The processing component 702 generally controls the overall operation of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0132] The memory 704 is configured to store various types of data to support operations on the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, videos, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0133] The power supply component 706 provides power to various components of the electronic device 700. The power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 700.

[0134] The multimedia component 708 includes a screen that provides an output interface between the electronic device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0135] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0136] I / O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0137] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 can detect the open / closed state of the electronic device 700, the relative positioning of components, such as the display and keypad of the electronic device 700, and the sensor assembly 714 can also detect the position change of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and the temperature change of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0138] The communication component 716 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0139] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0140] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by a processor 720 of an electronic device 700 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0141] The embodiments of the present disclosure also provide a non-temporary computer-readable storage medium. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute the method for identifying display content in the above embodiment.

[0142] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0143] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A method for identifying display content, characterized in that: The method comprises: Dividing the screen into at least one display area, each display area containing corresponding display content; Based on pixel parameters of pixels of the display content in the display area, the display content type to which the display content belongs is identified, wherein the pixel parameters are used to characterize the color of the pixel.

2. The method according to claim 1, characterized in that The identifying the display content type to which the display content belongs based on the pixel parameter of each pixel in the display content corresponding to the display area includes: Obtaining pixel parameters of each pixel among a plurality of pixels of the displayed content, the pixel parameters comprising a reference color value and a corresponding identifier, the reference color value being an absolute value of a difference between a color value of the pixel and a preset value, and the identifier being used to characterize the positive or negative of the difference; Determine the number of the identifiers in the plurality of pixel parameters that are preset identifiers; The display content type to which the display content belongs is determined based on the number of the preset identifiers and the preset corresponding relationship, wherein the preset corresponding relationship is used to characterize the corresponding relationship between the number of the preset identifiers and the display content type.

3. The method according to claim 2, characterized in that The color value of the pixel point includes sub-color values ​​corresponding to multiple channels, and the pixel parameter includes multiple reference sub-color values ​​and an identifier corresponding to each of the reference sub-color values. The reference sub-color value is the absolute value of the difference between the sub-color value and the corresponding preset value, and each of the sub-color values ​​has a corresponding preset value.

4. The method according to claim 3, characterized in that The determining that the identifier in the plurality of pixel parameters is the number of preset identifiers includes: Respectively determine the number of identifiers corresponding to the reference sub-color values ​​corresponding to each channel in the plurality of pixel parameters as the preset identifiers; The determining, based on the number of the preset identifiers and the preset corresponding relationship, the display content type to which the display content belongs includes: Based on the number of identifiers corresponding to the reference sub-color values ​​corresponding to at least one channel being the preset identifiers and the preset corresponding relationship, the display content type to which the display content belongs is determined.

5. The method according to claim 2, characterized in that: The maximum byte occupied by the reference color value is 7 bits, and the byte occupied by the identifier is 1 bit.

6. An electronic device, characterized in that: The electronic device comprises a display driver chip, The display driver chip is configured to divide the screen into at least one display area, each of which contains corresponding display content; The display driver chip is further configured to identify the display content type to which the display content belongs based on pixel parameters of the pixel points of the display content in the display area, wherein the pixel parameters are used to characterize the color of the pixel points.

7. The electronic device according to claim 6, characterized in that: The display driver chip is further configured to obtain pixel parameters of each pixel of the plurality of pixels of the display content, the pixel parameters including a reference color value and a corresponding identifier, the reference color value being an absolute value of a difference between a color value of the pixel and a preset value, and the identifier being used to characterize the positive or negative value of the difference; The display driver chip is further configured to determine the number of the identifiers in the plurality of pixel parameters that are preset identifiers; The display driver chip is further configured to determine the display content type to which the display content belongs based on the number of the preset identifiers and a preset corresponding relationship, wherein the preset corresponding relationship is used to characterize the corresponding relationship between the number of the preset identifiers and the display content type.

8. The electronic device according to claim 7, characterized in that: The electronic device further comprises an application processor, The application processor is configured to determine the pixel parameter of each pixel based on a preset rule and a color value of each pixel, wherein the preset rule is used to indicate that the pixel parameter is represented by the reference color value and the identifier; The application processor is further configured to send each pixel parameter to the display driver chip.

9. The electronic device according to claim 7, characterized in that: The display driver chip includes a first register, a second register and a third register; The first register is configured to store the preset value; The second register is configured to store an identifier in each of the pixel parameters; The third register is configured to count the number of the preset identifiers.

10. The electronic device according to any one of claims 6 to 9, characterized in that: The display driver chip also includes a fourth register; The fourth register is configured to divide the screen into the at least one display area.

11. A display content recognition device, characterized in that: The device comprises: A region division module, configured to divide the screen into at least one display region, each of the display regions containing corresponding display content; The type determination module is configured to identify the display content type to which the display content belongs based on pixel parameters of the pixel points of the display content in the display area, wherein the pixel parameters are used to characterize the color of the pixel points.

12. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the method as claimed in any one of claims 1 to 5.

13. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method as claimed in any one of claims 1 to 5.

Images