Information identification method and device
By setting a color sensor at the bottom of the screen, real-time pixel light brightness value recognition display content is solved, and real-time identification and privacy information protection is achieved without user operations.
Patent Information
- Application Number
- CN202010607511.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-06-30
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2040-11-22
AI Technical Summary
In the prior art, when identifying whether an image or text contains privacy information, the user needs to take screenshots and operate them first, which increases the complexity, and the clarity of the screenshots affects the recognition results and cannot meet the needs of rapid identification.
Using a color sensor set at the bottom of the screen, real-time recognition of content in the display area is achieved by obtaining the brightness value of each pixel point, real-time recognition without user triggering.
It improves the efficiency of information identification, reduces user operations, ensures that the displayed content contains privacy information in real time, and prevents information leakage.
Smart Images

Figure CN111860497B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of communication technology, and specifically relates to an information identification method and device. Background Art
[0002] With the gradual improvement of electronic equipment hardware configuration and the expansion of functions, electronic equipment has become an indispensable necessity in people's daily life. Users use electronic devices for social interaction more and more frequently. For example, users can share pictures or texts with other users through electronic devices. If these pictures or texts contain sensitive information such as private information or payment QR code information, they will be shared with other users without the user's knowledge, which will lead to the leakage of private information and cause unnecessary losses.
[0003] At present, the main method for identifying whether an image or text contains private information is to determine whether the image features in the screenshot containing the private information meet certain preset conditions. If the image features meet certain preset conditions, it is determined that the screenshot contains private information. However, this method requires the user to take a screenshot first, and then identify the image features in the screenshot, which increases the complexity of the user's operation; in addition, the clarity of the screenshot will affect the recognition result, which is not applicable in some scenarios, such as when you want to quickly identify information. Summary of the invention
[0004] The purpose of the embodiments of the present application is to provide an information identification method and device, which can solve the problem of cumbersome and low efficiency in identifying information.
[0005] In order to solve the above technical problems, this application is implemented as follows:
[0006] In a first aspect, an embodiment of the present application provides an information recognition method, which is applied to an electronic device, wherein the electronic device includes a first color sensor disposed below a screen, and the method includes:
[0007] Acquire a first target brightness value of the first display area collected by the first color sensor, where the first target brightness value is the luminous brightness value of each pixel in the first display area;
[0008] According to a first target brightness value of the first display area, display content in the first display area is identified.
[0009] In a second aspect, an embodiment of the present application provides an information recognition device, which is applied to an electronic device, wherein the electronic device includes a first color sensor disposed below a screen, and the device includes:
[0010] A first acquisition module, used to acquire a first target brightness value of the first display area collected by the first color sensor, where the first target brightness value is a luminous brightness value of each pixel in the first display area;
[0011] The identification module is used to identify the display content in the first display area according to the first target brightness value of the first display area.
[0012] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the method steps involved in the first aspect.
[0013] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the method steps involved in the first aspect are implemented.
[0014] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method steps involved in the first aspect.
[0015] In the embodiment of the present application, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. Since the user will keep the display area always on when using the electronic device, the brightness value of the display area in the electronic device can be acquired in real time, so that the display content in the display area can be identified in real time without the user triggering the identification operation, thereby improving the identification efficiency and reducing the user operation. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 A schematic diagram of an application scenario of an information identification method provided in an embodiment of the present application;
[0017] Figure 2 A flowchart of an information identification method provided in an embodiment of the present application;
[0018] Figure 3 A schematic diagram of an information identification interface provided in an embodiment of the present application;
[0019] Figure 4 A schematic diagram of the structure of an information identification device provided in an embodiment of the present application;
[0020] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0021] Figure 6 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0022] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0023] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here. And the objects distinguished by "first", "second", etc. are usually a class, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally represents that the objects associated before and after are in an "or" relationship.
[0024] Based on this, the following Figure 1-Figure 3 , the information identification method provided by the embodiment of the present application is described in detail through specific embodiments and their application scenarios.
[0025] This application proposes an application scenario of an information identification method, referring to Figure 1 First, an electronic device is provided in an embodiment of the present application, and the electronic device includes a first color sensor such as a color temperature sensor arranged under the screen. Among them, the color temperature sensor is placed under the organic light-emitting diode (OLED) screen of the electronic device to collect the first target brightness value of each pixel in the OLED screen. The first target brightness value may include the luminous brightness value of the RGB color mode, and / or detect the brightness value of each pixel in the display area of the OLED screen of the electronic device. Here, specifically, the luminous brightness value of the RGB (such as red, green, and blue) components of each pixel corresponding to the display area can be collected. It should be noted that the collected RGB luminous brightness values are in a unified unit.
[0026] In the embodiment of the present application, the principle of using a color temperature sensor to identify target information can be to collect the RGB components (such as red, green and blue color components) in the luminous amount of the luminous object through the color temperature sensor to identify the color of the object. Then, the OLED screen in the embodiment of the present application itself can emit light. When the content displayed on it is different, the RGB light emitted by each pixel will also be different. In the embodiment of the present application, the content displayed in the current display area can be analyzed and identified by collecting the RGB light luminance value of each pixel (or, the brightness value of each pixel in the display area).
[0027] Based on this, the display content in the first display area identified by the color temperature sensor is obtained, such as the first display area 10 where a picture, a short message, a video, etc. are located; then, according to the first target brightness value of the first display area, the shape of at least one object in the first display area is constructed; according to the shape of the at least one object, the display content in the first display area is identified.
[0028] When it is determined that the displayed content includes target information, such as the user's private information or sensitive information, which the user does not want to share or publicly display, a prompt message is displayed. The prompt message is used to prompt that the displayed content includes target information that needs to be hidden to prevent the user from showing it to others or leaking private information when sending pictures or texts.
[0029] Based on this, in the embodiment of the present application, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. In this way, when the user uses the electronic device, the display area is always on, and the brightness value of the display area in the electronic device can be acquired in real time, so that the display content in the display area can be identified in real time without the user triggering the identification operation, thereby reducing user operations and improving identification efficiency.
[0030] In addition, the embodiments of the present application can realize the identification operation without the user triggering it. In this way, it can reduce user operations and can also identify in real time whether the displayed content includes target information such as privacy information or sensitive information. When it is determined that the displayed content includes the target information, the user is prompted that the first information includes privacy information to prevent the user from leaking privacy information when sending pictures or texts.
[0031] It should be noted that, in addition to the above-mentioned scenario of identifying privacy information according to the identification method provided by the present application, the scenarios involved in the embodiments of the present application can also be applied to any scenario in which the brightness value of the display area is collected by a first color sensor such as a color temperature sensor to identify information by brightness value, such as in video editing, by the above method, sensitive information in the video or user preset information (such as the name of an advertiser who does not want to appear in the video) is identified. Thus, a new identification method of identifying information by brightness value is provided, which improves the efficiency of identifying information while ensuring that user privacy information is not easily leaked.
[0032] According to the above application scenarios, the following Figure 2-Figure 3 The information identification method provided in the embodiment of the present application is described in detail.
[0033] Figure 2 A flowchart of an information identification method provided in an embodiment of the present application.
[0034] like Figure 2 As shown, the information recognition method can be applied to an electronic device, and the electronic device includes a first color sensor arranged below a screen. Based on this, the method can specifically include the following steps:
[0035] First, in step 210, a first target brightness value of a first display area collected by a first color sensor is obtained, where the first target brightness value is the luminous brightness value of each pixel in the first display area.
[0036] Then, in step 220, the display content in the first display area is identified according to the first target brightness value of the first display area.
[0037] Therefore, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. In this way, when the user uses the electronic device, the display area is always on, and the brightness value of the display area in the electronic device can be acquired in real time, so that the display content in the display area can be identified in real time without the user triggering the identification operation, thereby improving the identification efficiency and reducing the user operation.
[0038] The above steps are described in detail below:
[0039] First, in step 220, the present application provides the following three methods for identifying the display content in the first display area, as shown below:
[0040] Mode (1), in a possible embodiment, the display content in the first display area is identified by obtaining a first target brightness value through a first color sensor disposed below the screen of the electronic device. Here, the first color sensor is, for example, a color temperature sensor.
[0041] Among them, based on the first target brightness value of each pixel in the first display area collected by the color temperature sensor, the shape of at least one object in the first display area is constructed; according to the shape of the at least one object, the display content in the first display area is identified.
[0042] For example, a full-screen color temperature sensor is used to detect in real time in the first display area, and a channel group composed of RGB components of each pixel in the first display area is obtained to determine the brightness value corresponding to each pixel. Then, based on the brightness value corresponding to each pixel, the shape of at least one object in the first display area is obtained, such as the shape of "3". Based on the shape of at least one object, the display content in the first display area is identified, such as identifying the shape of "3" as the number "3".
[0043] Mode (2), in another possible embodiment, in some scenarios, in order to ensure the accuracy of identifying the display content in the first display area, so as to improve the accuracy of determining the display content. Thus, in the case where the electronic device further includes a second color sensor disposed above the screen, identifying the display content in the first display area may specifically include:
[0044] A second target brightness value collected by the second color sensor is acquired, where the second target brightness value is the brightness value of the environment in which the electronic device is located; and display content in the first display area is identified according to the first target brightness value and the second target brightness value.
[0045] The shape of at least one object in the first display area may be constructed according to the first target brightness value and the second target brightness value; and the display content in the first display area may be identified according to the shape of the at least one object.
[0046] For example, two different brightness values are obtained, namely, the first target brightness value corresponding to each pixel point collected in real time by the color temperature sensor of the full screen, and the second target brightness value of the environment in which the electronic device is located collected by the second color sensor such as the ambient light sensor. Because, in some scenes, the ambient light will affect the display brightness of the first display area, such as if the ambient light is too high, the display brightness of the first display area will be reduced, and vice versa, if the ambient light is too dark, the display brightness of the first display area will be increased. Therefore, it can be understood that the second target brightness value will affect the first target brightness value to a certain extent. In this way, in order to ensure the accuracy of identifying the displayed content, the shape of at least one object such as the shape "3" can be obtained with higher accuracy according to the first target brightness value and the second target brightness value corresponding to each pixel point in the first display area; according to the shape of at least one object, the display content in the first display area is identified, such as identifying the shape as the number "3" according to the shape "3".
[0047] It should be noted that the ambient light sensor in the embodiment of the present application can be set on the screen of the electronic device to detect and obtain the brightness value of the environment in which the electronic device is located.
[0048] Method (3) Based on method (2), in another possible embodiment, the embodiment of the present application can provide a method for identifying display content according to the first target brightness value and the second target brightness value, as shown below:
[0049] Based on the second target brightness value, the brightness value of each pixel corresponding to the first target brightness value is adjusted to obtain a third target brightness value of each pixel;
[0050] constructing a shape of at least one object in the first display area based on a third target brightness value of each pixel;
[0051] Display content in the first display area is identified based on a shape of at least one object.
[0052] Based on this, the luminous brightness value and the brightness value of each pixel are adjusted respectively based on the second target brightness value to obtain the third target brightness value of each pixel in the first display area for example:
[0053] First, the luminous brightness value of each pixel in the first display area collected in real time by the full-screen color temperature sensor and such as RGB channel groups (red, green, blue) [R1, R2, R3...Rn], [G1, G2, G3...Gn], [B1, B2, B3...Bn] are obtained; then, the second target brightness value of the environment in which the electronic device is located collected by the ambient light sensor is obtained, such as RGB (LR, LG, LB).
[0054] Then, the second target brightness value after filtering out the ambient light influence in the RGB channel group is obtained, namely, [(R1-LR), (R2-LR), (R3-LR)…(Rn-LR)], [(G1-LG), (G2-LG), (G3-LG)…Gn-LG], [(B1-LB), (B2-LG), (B3-LG)…Bn-LG], thereby obtaining the third target brightness value of each pixel point on the first display area.
[0055] Based on this, the shape of at least one object in the first display area can be constructed based on the third target brightness value of each pixel point determined above; and the display content in the first display area can be identified according to the shape of the at least one object.
[0056] For example, the shape of at least one object in the first display area is separated and identified by using the third target brightness value obtained as above.
[0057] The first display area can be distinguished by displaying different colors on each pixel, and the information in the first display area can be determined according to the third target brightness value of each pixel. The following is explained by taking the identification of the number 3 as an example.
[0058] First, assume that the value 3 is displayed in the form of white text on a black background on the screen of the electronic device, wherein the size of the first display area on the screen is 30*30 pixels.
[0059] Next, the third target brightness value corresponding to the 30*30 pixel point is obtained. That is, the third target brightness value of the 900 pixel points corresponding to the 30*30 pixel point can be expressed as: [(R1-LR), (R2-LR), (R3-LR) ... (R900-LR)], [(G1-LG), (G2-LG), (G3-LG) ... G900-LG], [(B1-LB), (B2-LG), (B3-LG) ... B900-LG].
[0060] Then, distinguish the background color area and the numerical area, and define the boundary. Among them, the following process can be used to distinguish the background color and the color of the number. The third target brightness value corresponding to the 900 pixels is traversed, and all the pixels with the same luminous amount (or brightness value) are counted and classified. Assuming that this example has only black and white colors, the number of white pixels is 300 and the number of black pixels is 600. This distinguishes the color of the digital display area and the color of the background color area. In the embodiment of the present application, it is assumed that the number of pixels is the background color, then black is the background color and white is the digital color. It should be noted that the above process can also be used to distinguish the background color and the digital color for the more complex information in the first display area. In this application, it can be distinguished by presetting different thresholds. Then, the shape of the number is identified by the component occupied by the third target brightness value of 900 pixels in the entire display screen.
[0061] It should be noted that if the first target brightness value is used to separate and identify the shape of at least one object in the first display area, the third target brightness value involved in this example can be replaced by the first target brightness value, and the first target brightness value of 900 pixels corresponding to the 30*30 pixels can be expressed as: [(R1), (R2), (R3)…(R900)], [(G1), (G2), (G3)…G900], [(B1), (B2), (B3)…B900], so the principle is as shown in the above example and will not be repeated here.
[0062] In another possible embodiment, the steps of constructing the shape of at least one object in the first display area according to the third target brightness value in the above methods (1) to (3) may specifically include:
[0063] In the first display area, obtaining coordinate information of a pixel point corresponding to each third target brightness value;
[0064] The shape of at least one object in the first display area is constructed according to the coordinate information.
[0065] For example, continuing with the above example, the background color and the color of the numbers are obtained in the above manner, where the number of color sets of the numbers, that is, the set of RGB third target brightness values corresponding to the 300 white pixels above, is obtained by obtaining the coordinate values of the 300 white pixels corresponding to the display screen [(x1,y1),(x2,y2)....(x300,y300)], looping through the coordinate values of the 300 white pixels, and calculating the Euclidean distance between two adjacent coordinates, and connecting the two adjacent points to obtain a rough shape.
[0066] Then, the data of the approximate shape obtained above is input into the target recognition model to obtain the similarity between the approximate shape and the preset shape, and when the similarity satisfies the preset similarity, the approximate shape is determined as a value of "3". Similarly, according to the above method, all at least one object in the first display area is identified, so as to identify the display content in the first display area according to the shape of the at least one object.
[0067] Therefore, the brightness values obtained by the color temperature sensor and the ambient light sensor can be combined to further perform content recognition, that is, the influence of the brightness value of the environment in which the electronic device is located in the brightness value obtained by the color temperature sensor can be eliminated. In this way, while ensuring the accuracy of the target luminous brightness value, the accuracy of determining the target information is improved.
[0068] Based on any one of the above methods (1)-(3), the display content in the first display area is identified. The embodiment of the present application also provides a scenario for implementing text recognition based on the above information recognition method, that is, after step 220, the method also includes: through the above recognition method, identifying whether the display content in the first display area includes target information, where the target information may include at least one of the following information: sensitive information, privacy information, and user preset information.
[0069] Therefore, when the above steps identify that the displayed content includes the target information, prompt information is displayed, and the prompt information is used to prompt that the displayed content includes information that needs to be hidden; a first input for the prompt information is received; in response to the first input, when the displayed content is sent to the first user, the target information is hidden so that the target information is displayed in a non-plaintext manner in the second display area displayed on the device corresponding to the first user.
[0070] For example, according to the shape of at least one object, it is determined that the displayed content includes target information that meets the preset rules. The preset rules may include at least one of the following: whether the shape of at least one object matches 11 consecutive digits of a phone number, matches commonly used sensitive characters such as identity card numbers, bank card numbers, etc., and sensitive information preset by the user.
[0071] Then, if Figure 3 As shown, when receiving a first input from a user triggering a screen capture action, a screenshot action, or target information to be sent, a prompt message is displayed to prompt the user whether to display the target information in a non-plaintext manner or in a plaintext manner in the second display area of the first user when sending the target information to the first user.
[0072] When receiving the user's selection of "display in non-plain text at the first user", Figure 3As shown in the figure on the right, the target information is displayed in a non-plain text manner in the second display area displayed on the device corresponding to the first user. Based on this, when the first information is sent to the first user, the target information is hidden so that the target information is displayed in a non-plain text manner in the second display area displayed on the device corresponding to the first user.
[0073] In this way, the color temperature sensor can be used to improve the display effect of the display screen of the electronic device, and the color temperature sensor can be used to identify the characteristics of RGB in the light source. The display content of the current display area can be dynamically identified through algorithm simulation. Compared with other methods of identifying information, it has certain fast characteristics and power saving characteristics. In addition, it can also remind the user in real time whether there is target information in the current display area, thereby improving the user experience.
[0074] In summary, in the embodiment of the present application, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. Since the user will keep the display area always on when using the electronic device, the brightness value of the display area in the electronic device can be acquired in real time, so that the display content in the display area can be identified in real time without the user triggering the identification operation, thereby improving the identification efficiency and reducing the user operation.
[0075] In addition, it is possible to identify in real time whether the displayed content includes target information such as privacy information or sensitive information without the user triggering the recognition operation. When it is determined that the displayed content includes the target information, the user is prompted that the first information includes privacy information to prevent the user from leaking privacy information when sending pictures or texts.
[0076] It should be noted that the information identification method provided in the embodiment of the present application can be executed by an information identification device or a control module in the information identification device for executing the information identification method. Figure 4 The information identification device provided in the embodiment of the present application is described.
[0077] Figure 4 A schematic diagram of the structure of an information identification device provided in an embodiment of the present application.
[0078] like Figure 4 As shown, the information identification device 40 may specifically include:
[0079] A first acquisition module 401 is used to acquire a first target brightness value of a first display area collected by a first color sensor, where the first target brightness value is a luminous brightness value of each pixel in the first display area;
[0080] The identification module 402 is configured to identify display content in the first display area according to a first target brightness value of the first display area.
[0081] Therefore, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. Since the user will keep the display area always on when using the electronic device, the brightness value of the display area in the electronic device can be acquired in real time, so that the display content in the display area can be identified in real time without the user triggering the identification operation, thereby improving the identification efficiency and reducing the user operation.
[0082] The information identification device 40 is described in detail below, as follows:
[0083] In a possible embodiment, the information identification device 40 also includes a second acquisition module 403, which is used to obtain a second target brightness value collected by the second color sensor when the electronic device also includes a second color sensor arranged above the screen, and the second target brightness value is the brightness value of the environment in which the electronic device is located.
[0084] Based on this, the identification module 402 is specifically configured to identify the display content in the first display area according to the first target brightness value and the second target brightness value.
[0085] In a possible embodiment, the identification module 402 is specifically configured to adjust the brightness value of each pixel corresponding to the first target brightness value based on the second target brightness value to obtain a third target brightness value of each pixel;
[0086] constructing a shape of at least one object in the first display area based on a third target brightness value of each pixel;
[0087] Display content in the first display area is identified based on a shape of at least one object.
[0088] In another possible embodiment, the identification module 402 is specifically configured to obtain, in the first display area, coordinate information of a pixel point corresponding to each third target brightness value;
[0089] The shape of at least one object in the first display area is constructed according to the coordinate information.
[0090] In addition, in another possible embodiment, the information identification device 40 further includes a display module 404, a receiving module 405 and a processing module 406; wherein,
[0091] The display module 404 is used to display prompt information when it is identified that the displayed content includes the target information, and the prompt information is used to indicate that the displayed content includes the information that needs to be hidden;
[0092] The receiving module 405 is used to receive a first input of the prompt information;
[0093] The processing module 406 is used to, in response to the first input, hide the target information when sending the display content to the first user, so that the target information is displayed in a non-plain text manner in the second display area displayed on the device corresponding to the first user.
[0094] The information identification device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in an electronic device. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0095] The information identification device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0096] The information identification device provided in the embodiment of the present application can achieve Figures 1 to 3 To avoid repetition, the various processes implemented by the method embodiment are not described here.
[0097] In summary, in the embodiment of the present application, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. In this way, when the user uses the electronic device, the display area is always on, and the brightness value of the display area in the electronic device can be acquired in real time, so that the display content in the display area can be identified in real time without the user triggering the identification operation, thereby improving the identification efficiency and reducing the user operation.
[0098] In addition, it can be achieved without the user triggering the recognition operation, which can reduce user operations. It can also identify in real time whether the displayed content includes target information such as privacy information or sensitive information. When it is determined that the displayed content includes the target information, the user is prompted that the first information includes privacy information to prevent the user from leaking privacy information when sending pictures or texts.
[0099] Optional, such as Figure 5 As shown, an embodiment of the present application also provides an electronic device 500, including a processor 501, a memory 502, and a program or instruction stored in the memory 502 and executable on the processor 501. When the program or instruction is executed by the processor 501, each process of the above-mentioned information identification method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0100] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
[0101] Figure 6 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.
[0102] The electronic device 600 includes but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, and a processor 610.
[0103] Those skilled in the art will appreciate that the electronic device 600 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 610 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0104] Wherein, the sensor 605 is used to obtain a first target brightness value of the first display area collected by the first color sensor, where the first target brightness value is the luminous brightness value of each pixel in the first display area;
[0105] The processor 610 is configured to identify display content in the first display area according to a first target brightness value of the first display area.
[0106] Therefore, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. Since the user will keep the display area always on when using the electronic device, the brightness value of the display area in the electronic device can be acquired in real time, so that the display content in the display area can be identified in real time without the user triggering the identification operation, thereby improving the identification efficiency and reducing the user operation.
[0107] It should be understood that in the embodiment of the present application, the sensor 605 may include a first color sensor such as a color temperature sensor and / or a second color sensor such as an ambient light sensor for obtaining a brightness value. The input unit 604 may include a graphics processing unit (GPU) 6041 and a microphone 6042, and the graphics processor 6041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 607 includes a touch panel 6071 and other input devices 6072. The touch panel 6071 is also called a touch screen. The touch panel 6071 may include two parts, a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 609 may be used to store software programs and various data, including but not limited to applications and operating systems. The processor 610 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 610.
[0108] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned information identification method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0109] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0110] In addition, an embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned information identification method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0111] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0112] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.
[0113] In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
[0114] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods of each embodiment of the present application.
[0115] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. An information recognition method, applied to an electronic device, wherein the electronic device comprises a first color sensor arranged below a screen, It is characterized in that include: Acquire a first target brightness value of the first display area collected by the first color sensor, where the first target brightness value is a luminous brightness value of each pixel in the first display area; In a case where the electronic device further includes a second color sensor disposed above the screen, acquiring a second target brightness value collected by the second color sensor, where the second target brightness value is a brightness value of an environment in which the electronic device is located; According to the first target brightness value and the second target brightness value of the first display area, display content in the first display area is identified, where the display content includes target information, and the target information is information that a user does not want to share or publicly display.
2. The method according to claim 1, It is characterized in that The identifying the display content in the first display area according to the first target brightness value and the second target brightness value of the first display area includes: Based on the second target brightness value, respectively adjust the brightness value of each pixel corresponding to the first target brightness value to obtain a third target brightness value of each pixel; constructing a shape of at least one object in the first display area based on the third target brightness value of each pixel; Display content in the first display area is identified according to the shape of the at least one object.
3. The method according to claim 2, It is characterized in that The constructing the shape of at least one object in the first display area based on the third target brightness value of each pixel point includes: In the first display area, obtaining coordinate information of a pixel point corresponding to each third target brightness value; The shape of at least one object in the first display area is constructed according to the coordinate information.
4. The method according to claim 1, It is characterized in that After identifying the display content in the first display area, the method further includes: In the case where it is identified that the displayed content includes target information, prompt information is displayed, where the prompt information is used to prompt that the displayed content includes information that needs to be hidden; receiving a first input of the prompt information; In response to the first input, when the display content is sent to the first user, the target information is hidden so that the target information is displayed in a non-plain text manner in a second display area displayed on a device corresponding to the first user.
5. An information recognition device, applied to an electronic device, the electronic device comprising a first color sensor arranged below a screen, It is characterized in that include: A first acquisition module, configured to acquire a first target brightness value of the first display area acquired by the first color sensor, where the first target brightness value is a luminous brightness value of each pixel in the first display area; A second acquisition module, configured to acquire, when the electronic device further includes a second color sensor disposed above the screen, a second target brightness value acquired by the second color sensor, the second target brightness value being a brightness value of an environment in which the electronic device is located; An identification module is used to identify display content in the first display area according to a first target brightness value and a second target brightness value of the first display area, wherein the display content includes target information, and the target information is information that a user does not want to share or publicly display.
6. The device according to claim 5, It is characterized in that The recognition module is specifically configured to adjust the brightness value of each pixel corresponding to the first target brightness value based on the second target brightness value to obtain a third target brightness value of each pixel; constructing a shape of at least one object in the first display area based on the third target brightness value of each pixel; Display content in the first display area is identified according to the shape of the at least one object.
7. The device according to claim 6, It is characterized in that The recognition module is specifically used to obtain, in the first display area, coordinate information of a pixel point corresponding to each third target brightness value; The shape of at least one object in the first display area is constructed according to the coordinate information.
8. The device according to claim 5, It is characterized in that The information identification device also includes a display module, a receiving module and a processing module; wherein, The display module is used to display prompt information when it is recognized that the displayed content includes target information, wherein the prompt information is used to prompt that the displayed content includes information that needs to be hidden; The receiving module is used to receive a first input of the prompt information; The processing module is used to, in response to the first input, hide the target information when sending the display content to the first user, so that the target information is displayed in a non-plaintext manner in a second display area displayed on a device corresponding to the first user.
