Method and system for adjusting human skin color in display screen

Abstract

The invention discloses a method for adjusting the skin color of a person in a display screen, which comprises the following steps of: firstly, determining the scene classification credibility of an image currently displayed on the display screen, then determining whether the currently displayed image comprises the person according to the scene classification credibility, if so, carrying out color space sum conversion on the image to obtain an HSV value, and if not, carrying out color space sum conversion on the HSV value; determining the skin color category of the person according to the HSV value, and finally adjusting the HSV value based on a preset scheme according to the skin color category to complete skin color adjustment. The method is high in real-time performance, skin color enhancement can be dynamically carried out according to the current display content, and the character skin color display effect can be effectively improved.

Description

Technical Field

[0001] The present invention relates to the technical field of display screens, and in particular to a method and system for adjusting the skin color of a person in a display screen. Background Art

[0002] With the development of the smart car industry, users have an increasing demand for smart cockpits, and the cockpit display is an extremely important component of the smart cockpit. On the one hand, it can display the status of the car, such as driving speed, fuel consumption, temperature inside the car, etc. On the other hand, it can also meet users' needs for infotainment, etc. At present, the cockpit display is developing towards large screens and multi-functions.

[0003] During the driving process of the car, the lighting and other conditions inside the car may change at any time. In addition, the display effects required by the cockpit display screen are also different for different functional requirements. In order to achieve better display effects and user experience, the cockpit display screen can dynamically adjust the effect of displaying the skin color of the person. However, the display of existing car cockpit displays is mostly based on traditional image enhancement methods, and mainly based on subjective experience to adjust the display of the skin color of the person. This makes the debuggers may set different skin color enhancement schemes according to different test streams and pictures, and finally meet the corresponding needs by seeking a balance point, but it is difficult to dynamically adjust the skin color to the optimal effect according to the image content. Summary of the invention

[0004] In view of some or all of the problems in the prior art, the present invention provides a method for adjusting the skin color of a person in a display screen in a first aspect, comprising:

[0005] Determining the scene classification confidence of the image currently displayed on the display screen;

[0006] Determine whether a person is included in the currently displayed image according to the scene classification confidence, and if included, perform color space conversion on the image to obtain an HSV value;

[0007] Determining the skin color category of the person according to the HSV value; and

[0008] According to the skin color category, the HSV value is adjusted based on a preset scheme to complete the skin color adjustment.

[0009] Furthermore, if the content currently displayed on the display screen is a video, the scene classification confidence of each frame of the picture is determined frame by frame.

[0010] Furthermore, determining the scene classification trust of the content currently displayed on the display screen includes:

[0011] The content is identified through a scene-based classification model, and scores of the content corresponding to N preset scenes are determined based on the identification results as scene classification confidence levels of the content.

[0012] Furthermore, the sum of the scores of the content corresponding to the preset N scenarios is 100.

[0013] Furthermore, the value of N is 10, and the N scenes include: distant views of natural scenery, close views of natural scenery, urban buildings, street vehicles, close-ups of people, animals, fruits and vegetables, cartoon images, instrument displays, and industrial films.

[0014] Furthermore, the skin color categories include white skin, yellow skin, brown skin and black skin.

[0015] Further, determining the skin color category of the person according to the HSV value includes:

[0016] If the H value is in the range of [0,40], the S value is in the range of [0.15,0.5], and the V value is in the range of [0.75,1], then the skin color category of the person is determined to be white skin;

[0017] If the H value is in the range of [20,50], the S value is in the range of [0.25,0.7], and the V value is in the range of [0.75,1], then the skin color category of the person is determined to be yellow skin;

[0018] If the H value is in the range of [20, 40], the S value is in the range of [0.3, 0.8], and the V value is in the range of [0.4, 0.8], then the skin color category of the person is determined to be brown skin; and

[0019] If the H value is in the range of [0, 20], the S value is in the range of [0.3, 0.8], and the V value is in the range of [0.15, 0.4], then the skin color category of the person is determined to be dark skin.

[0020] Furthermore, the preset scheme includes: increasing the hue value H, and / or increasing the saturation S.

[0021] A second aspect of the present invention provides a system for adjusting the skin color of a person in a display screen, comprising:

[0022] A recognition module, which is used to determine the scene classification confidence of the image currently displayed on the display screen to determine whether there is a person;

[0023] A skin color determination module, which is used to perform color space conversion on the image to obtain an HSV value, and determine the skin color category of the person according to the HSV value; and

[0024] The skin color adjustment module is used to adjust the HSV value according to the skin color category based on a preset scheme to complete the skin color adjustment.

[0025] The present invention provides a method and system for adjusting the skin color of a person in a display screen, which dynamically adjusts the skin color enhancement effect based on the currently displayed image content to achieve the best skin color display effect of the person. The method has strong real-time performance and can effectively improve the display effect of the display screen. Moreover, it can be implemented directly using existing hardware in intelligent driving without the need to design additional hardware modules, which reduces the development difficulty and has obvious cost advantages. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] To further illustrate the above and other advantages and features of various embodiments of the present invention, a more specific description of various embodiments of the present invention will be presented with reference to the accompanying drawings. It will be understood that these drawings only depict typical embodiments of the present invention and are therefore not to be considered as limiting the scope thereof. In the accompanying drawings, for clarity, identical or corresponding parts will be represented by identical or similar reference numerals.

[0027] Figure 1 A schematic flow chart of a method for adjusting the skin color of a person on a display screen according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0028] In the following description, the present invention is described with reference to various embodiments. However, those skilled in the art will recognize that the various embodiments can be implemented without one or more specific details or with other replacement and / or additional methods or components. In other cases, well-known structures or operations are not shown or described in detail to avoid blurring the inventive point of the present invention. Similarly, for the purpose of explanation, specific numbers and configurations are set forth to provide a comprehensive understanding of the embodiments of the present invention. However, the present invention is not limited to these specific details. In addition, it should be understood that the various embodiments shown in the drawings are illustrative representations and are not necessarily drawn in correct proportions.

[0029] In this specification, reference to "one embodiment" or "the embodiment" means that a particular feature, structure, or characteristic described in conjunction with the embodiment is included in at least one embodiment of the present invention. The phrase "in one embodiment" appearing in various places in this specification does not necessarily all refer to the same embodiment.

[0030] It should be noted that the embodiments of the present invention describe the method steps in a specific order, but this is only for the purpose of illustrating the specific embodiment, rather than limiting the order of the steps. On the contrary, in different embodiments of the present invention, the order of the steps can be adjusted according to actual needs.

[0031] In the present invention, each module of the system according to the present invention can be implemented using software, hardware, firmware or a combination thereof. When the module is implemented using software, the function of the module can be implemented by a computer program flow, for example, the module can be implemented by a code segment (such as a code segment of a language such as C, C++) stored in a storage device (such as a hard disk, a memory, etc.), wherein the corresponding function of the module can be implemented when the code segment is executed by a processor. When the module is implemented using hardware, the function of the module can be implemented by setting a corresponding hardware structure, for example, the function of the module can be implemented by hardware programming a programmable device such as a field programmable gate array (FPGA), or the function of the module can be implemented by designing an application-specific integrated circuit (ASIC) including electronic devices such as a plurality of transistors, resistors and capacitors. When the module is implemented using firmware, the function of the module can be written into a read-only memory such as an EPROM or EEPROM of the device in the form of a program code, and the corresponding function of the module can be implemented when the program code is executed by a processor. In addition, some functions of the module may need to be implemented by separate hardware or by collaboration with the hardware, for example, the detection function is implemented by corresponding sensors (such as proximity sensors, acceleration sensors, gyroscopes, etc.), the signal transmission function is implemented by corresponding communication devices (such as Bluetooth devices, infrared communication devices, baseband communication devices, Wi-Fi communication devices, etc.), the output function is implemented by corresponding output devices (such as displays, speakers, etc.), and so on.

[0032] In order to dynamically adjust the skin color enhancement effect of a person based on the current image content and thus achieve a better display effect, the present invention provides a method and system for adjusting the skin color of a person in a display screen. The method and system are based on the existing embedded neural network processor NPU hardware and classification model in intelligent driving, without the need for additional hardware modules, thus simplifying the overall structure of the intelligent driving system and having obvious cost advantages.

[0033] The scheme of the present invention is further described below in conjunction with the accompanying drawings of the embodiments.

[0034] Figure 1 A flow chart of a method for adjusting the skin color of a person on a display screen according to an embodiment of the present invention is shown. Figure 1 As shown, a method for adjusting the skin color of a person in a display screen includes:

[0035] First, in step 101, scene recognition. The scene of the content currently displayed on the display screen is determined for recognition, and its scene classification confidence is determined. In one embodiment of the present invention, the scene classification confidence of the content currently displayed on the display screen is determined mainly by identifying the content through a scene-based classification model, and determining the score of the content corresponding to the preset N scenes based on the recognition result as the scene classification confidence of the content. In order to facilitate subsequent calculations, in one embodiment of the present invention, the sum of the scores of the content corresponding to the preset N scenes is 100. In one embodiment of the present invention, the N scenes may include, for example, 10 scenes such as: distant views of natural scenery, close views of natural scenery, urban buildings, street vehicles, close-ups of people, animals, fruits and vegetables, cartoon images, instrument displays, and industrial movies. In one embodiment of the present invention, the scene-based classification model directly uses the existing NPU hardware and classification model in intelligent driving, specifically a model based on TensorFlowRT, to identify the current scene situation. In one embodiment of the present invention, the scene classification trust w[0], w[1], ....., w[9] is converted according to the inference output result of the NPU, and the inference output result of the NPU is a one-dimensional vector, in which each item corresponds to the possibility value of a scene. Taking the 10 scenes mentioned above as an example, if the inference output result is [0.01, 0.01, 0.01, 0.01, 0.91, 0.01, 0.01, 0.01, 0.01], it can be converted into the trust of the 10 scenes 1, 1, 1, 1, 91, 1, 1, 1, 1, 1, that is, the content corresponds to the distant view of natural scenery, the close view of natural scenery, urban buildings, street vehicles, close-ups of people, animals, fruits and vegetables, cartoon images, instrument displays, and industrial movies. The scene classification trust is 1, 1, 1, 1, 91, 1, 1, 1, 1, 1, respectively. It can be seen that its trust as a close-up of a person is the highest and exceeds 90. In one embodiment of the present invention, the current display content of the display screen may be a picture or a video. If it is a picture, the scene recognition is directly performed. If it is a video, the scene classification confidence of each frame of the picture is determined frame by frame. After obtaining the scene classification confidence, it can be determined whether the currently displayed image includes a person according to the scene classification confidence. In one embodiment of the present invention, when the confidence corresponding to the close-up of the person is the highest, it is considered that the currently displayed image includes a person, and then step 102 is entered;

[0036] Next, in step 102, color space conversion is performed. When the currently displayed image includes a person, the image is converted into a color space to obtain an HSV value;

[0037] Next, in step 103, the skin color category is determined. The skin color category of the person is determined according to the HSV value. In one embodiment of the present invention, the skin color category includes white skin, yellow skin, brown skin and black skin. Based on this, in one embodiment of the present invention, determining the skin color category of the person according to the HSV value includes:

[0038] If the H value is in the range of [0,40], the S value is in the range of [0.15,0.5], and the V value is in the range of [0.75,1], then the skin color category of the person is determined to be white skin;

[0039] If the H value is in the range of [20,50], the S value is in the range of [0.25,0.7], and the V value is in the range of [0.75,1], then the skin color category of the person is determined to be yellow skin;

[0040] If the H value is in the range of [20, 40], the S value is in the range of [0.3, 0.8], and the V value is in the range of [0.4, 0.8], then the skin color category of the person is determined to be brown skin; and

[0041] If the H value is in the range of [0, 20], the S value is in the range of [0.3, 0.8], and the V value is in the range of [0.15, 0.4], then the skin color category of the person is determined to be dark skin; and

[0042] Finally, in step 104, the skin color is adjusted. According to the skin color category, the HSV value is adjusted based on a preset scheme to complete the skin color adjustment. The skin color adjustment is generally adjusted to a more ruddy, healthier and more natural direction. Based on this, in one embodiment of the present invention, the hue (H, Hue) value can be slightly increased to make it more reddish orange, and / or the saturation (S, Saturation) can be increased to make the skin color look healthier and more natural.

[0043] In order to realize the dynamic adjustment method as described above, the present invention also provides a system for adjusting the skin color of a person in a display screen, which includes an identification module, a skin color judgment module and a skin color adjustment module, wherein the identification module is used to determine the scene classification trust of the image currently displayed on the display screen to determine whether there is a person, the skin color judgment module is used to perform color space conversion on the image to obtain an HSV value, and determine the skin color category of the person based on the HSV value, and the skin color adjustment module is used to adjust the HSV value based on a preset scheme according to the skin color category to complete the skin color adjustment.

[0044] Although various embodiments of the present invention are described above, it should be understood that they are presented as examples only and not as limitations. It is obvious to those skilled in the relevant art that various combinations, modifications and changes can be made thereto without departing from the spirit and scope of the present invention. Therefore, the breadth and scope of the present invention disclosed herein should not be limited by the exemplary embodiments disclosed above, but should only be defined according to the attached claims and their equivalents.

Claims

1. A method for adjusting the skin color of a person in a display screen, characterized in that: Includes steps: Determining the scene classification confidence of the image currently displayed on the display screen; Determine whether a person is included in the currently displayed image according to the scene classification confidence, and if included, perform color space conversion on the image to obtain an HSV value; Determine the skin color category of the person according to the HSV value; as well as According to the skin color category, the HSV value is adjusted based on a preset scheme to perform skin color adjustment.

2. The method according to claim 1, characterized in that If the content currently displayed on the display screen is a video, the scene classification confidence of each frame of the picture is determined frame by frame.

3. The method according to claim 1, characterized in that Determining the scene classification confidence of the content currently displayed on the display includes the steps of: The content is identified through a scene-based classification model, and scores of the content corresponding to N preset scenes are determined based on the identification results as scene classification confidence levels of the content.

4. The method according to claim 3, characterized in that The total score of the content corresponding to the preset N scenarios is 100.

5. The method according to claim 3, characterized in that The value of N is 10, and the N scenes include: distant views of natural scenery, close views of natural scenery, urban buildings, street vehicles, close-ups of people, animals, fruits and vegetables, cartoon images, instrument displays, and industrial films.

6. The method according to claim 1, characterized in that The skin color categories include white skin, yellow skin, brown skin and black skin.

7. The method according to claim 1, characterized in that Determining the skin color category of the person according to the HSV value includes the following steps: If the H value is in the range of [0,40], the S value is in the range of [0.15,0.5], and the V value is in the range of [0.75,1], then the skin color category of the person is determined to be white skin; If the H value is in the range of [20,50], the S value is in the range of [0.25,0.7], and the V value is in the range of [0.75,1], then the skin color category of the person is determined to be yellow skin; If the H value is in the range of [20, 40], the S value is in the range of [0.3, 0.8], and the V value is in the range of [0.4, 0.8], then the skin color category of the person is determined to be brown skin; and If the H value is in the range of [0, 20], the S value is in the range of [0.3, 0.8], and the V value is in the range of [0.15, 0.4], then the skin color category of the person is determined to be dark skin.

8. The method according to claim 1, characterized in that The preset scheme includes the steps of increasing the hue value H and / or increasing the saturation S.

9. A system for adjusting the skin color of a person in a display screen, characterized in that: include: a recognition module configured to determine a scene classification confidence of an image currently displayed on the display screen to determine whether a person exists; A skin color determination module is configured to perform color space conversion on the image to obtain an HSV value, and determine the skin color category of the person according to the HSV value; as well as The skin color adjustment module is configured to adjust the HSV value according to the skin color category based on a preset scheme to complete the skin color adjustment.

Images