Image processing method, image processing system, and display

Abstract

An image processing method includes the following operations. An environmental image is captured by a web camera. And the web camera calculates an automatic photographing parameter according to the environment image, wherein the automatic photographing parameter comprises an automatic white balance parameter, an automatic exposure parameter or an automatic focusing parameter. And the automatic photographing parameters are transmitted to a controller chip of the display by the network camera. And the controller chip executes a modulation function according to the automatic photographing parameters so as to adjust a display picture of the display.

Description

Technical Field

[0001] The present disclosure relates to an image processing method and system, and more particularly to a method and system for performing various modulation functions on a display using automatic photographic parameters obtained by a network camera. Background Art

[0002] With the advancement of technology, many electronic devices now include displays. These displays may have various built-in modulation functions that adjust certain display settings (such as brightness, color saturation, and blue light filtering). These display settings can be manually adjusted by the user to suit personal preferences or specific usage scenarios (daytime, nighttime, low-light bedroom, high-light exhibition space, etc.). Summary of the Invention

[0003] Some embodiments of the present disclosure relate to an image processing method comprising the following operations: A network camera captures an ambient image; the network camera calculates automatic photography parameters based on the ambient image, the automatic photography parameters including automatic white balance parameters, automatic exposure parameters, or automatic focus parameters; the network camera transmits the automatic photography parameters to a controller chip of a display; and the controller chip performs a modulation function based on the automatic photography parameters to adjust a display image on the display.

[0004] Some embodiments of the present disclosure relate to an image processing system comprising a webcam and a display. The webcam is configured to capture an image of an environment and includes an image processor configured to calculate automatic photography parameters based on the image. The automatic photography parameters include at least one of automatic white balance parameters, automatic exposure parameters, and automatic focus parameters. The display comprises a display panel and a controller chip. The controller chip is coupled to the display panel and is in communication with the image processor. The controller chip receives the automatic photography parameters from the webcam's image processor, performs a modulation function based on the automatic photography parameters, and outputs a display image to the display panel based on the result of the modulation function.

[0005] Some embodiments of the present disclosure relate to a display comprising a display panel and a controller chip. The controller chip is coupled to the display panel and is in communication with an image processor of a network camera. The controller chip is configured to receive automatic photography parameters from the image processor of the network camera, perform a modulation function based on the automatic photography parameters, and output a display image to the display panel based on the result of the modulation function. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] To make the above and other objects, features, advantages and embodiments of the present disclosure more apparent and understandable, the accompanying drawings are described as follows:

[0007] Figure 1 A schematic diagram illustrating a display system according to some embodiments of the present disclosure is shown;

[0008] Figure 2 Graphic Figure 1 The functional block diagram of the system is shown in the figure;

[0009] Figure 3 A flowchart illustrating an image processing method in some embodiments of the present disclosure;

[0010] Figure 4 A schematic diagram illustrating a color temperature modulation function of an image processing method according to an automatic white balance parameter in an automatic photography parameter in some embodiments of the present disclosure;

[0011] Figure 5 A schematic diagram illustrating a blue light modulation function performed according to an automatic white balance parameter in an automatic photography parameter in an image processing method in some embodiments of the present disclosure;

[0012] Figure 6 A schematic diagram illustrating a display brightness modulation function according to an automatic exposure parameter in an automatic photography parameter in an image processing method in some embodiments of the present disclosure;

[0013] Figure 7 A schematic diagram illustrating a method for image processing in some embodiments of the present disclosure that performs a zone dimming function according to an automatic exposure parameter in an automatic photography parameter;

[0014] Figure 8 A schematic diagram illustrating an image processing method in some embodiments of the present disclosure that performs a health reminder function according to an autofocus parameter in an automatic photography parameter;

[0015] Figure 9 A schematic diagram illustrating an image processing method according to some embodiments of the present disclosure that performs image processing functions according to automatic photography parameters; and

[0016] Figure 10 A schematic diagram illustrating a feedback function according to automatic photography parameters in an image processing method in some embodiments of the present disclosure. DETAILED DESCRIPTION

[0017] As used herein, the term “coupled” may also refer to “electrically coupled,” and the term “connected” may also refer to “electrically connected.” “Coupled” and “connected” may also refer to two or more components cooperating or interacting with each other.

[0018] See also Figure 1 , Figure 1 FIG2 is a schematic diagram of an image processing system 100 according to some embodiments of the present disclosure. The image processing system 100 includes a webcam 120 and a display 140 .

[0019] The display 140 is configured to display a corresponding display image (SCN) based on an input data signal. In one embodiment, the display 140 may have multiple built-in modulation functions, such as brightness modulation (adjusting the brightness of the display 140 to make the display image (SCN) brighter or dimmer), contrast modulation (controlling the contrast between black and white in the display image (SCN), color temperature modulation (adjusting the color temperature of the display image (SCN), such as to cool or warm tones), color calibration (allowing for customized color calibration of red, green, and blue colors), sharpness modulation (adjusting the sharpness of the display image (SCN), making the image clearer or softer), screen ratio modulation (adjusting the aspect ratio of the display image (SCN), such as 16:9 or 4:3, to suit different content or needs), and blue light filtering (reducing blue light radiation to help reduce eye fatigue and sleep disturbances). These modulation functions allow the performance of the display 140 to be manually adjusted based on the user's personal preferences or specific usage scenarios.

[0020] In some cases, in order for the display to automatically adjust its function as the surrounding environment changes, the display needs to be equipped with an additional built-in optical sensor (Optical Sensor) or proximity sensor (Proximity Sensor) to sense the state of the display's surrounding environment and automatically control the above-mentioned built-in modulation functions based on the sensing results. In these cases, the display requires additional space and cost to embed the optical sensor or proximity sensor, and the user may inadvertently block the optical sensing chip, causing the automatic modulation function to fail or be adjusted incorrectly.

[0021] With the popularity of remote working and video conferencing, webcams 120 are used in many application scenarios. The webcams 120 are used to record or capture real-time streaming images to facilitate users to interact with others.

[0022] exist Figure 1 In the embodiment shown, the webcam 120 is mounted on the display 140, that is, the webcam 120 and the display 140 are arranged adjacent to each other. The image captured by the webcam 120 can reflect the surrounding environment of the display 140 (such as the surrounding brightness, the distance of the person in front, the surrounding color temperature, etc.). Figure 2 , Figure 2 Graphic Figure 1 FIG. 1 is a functional block diagram of the image processing system 100. Figure 2 As shown, the network camera 120 includes a lens module 122 , an image sensor 124 , and an image processor 126 .

[0023] In practical applications, the lens module 122 may include an optical lens, a corresponding lens zoom structure, an aperture and aperture modulation structure, etc., which are well known to those skilled in the art and will not be described in detail here. The image sensor 124 may include a complementary metal oxide semiconductor (CMOS) photosensitive component or a charge-coupled device (CCD) photosensitive component. The image processor 126 may be an image signal processor (ISP) or a microcontroller (MCU) with image processing capabilities.

[0024] Please also refer to Figure 3 , which illustrates a method flow chart of an image processing method 200 in some embodiments of the present disclosure. In some embodiments, Figure 3 The image processing method 200 shown in FIG. Figure 1 and Figure 2 The image processing system 100 shown is executed.

[0025] like Figure 3 As shown, the image processing method 200 first performs step S210, where the network camera 120 captures the environment image IMG. Figure 2 As shown, ambient light around the network camera 120 is transmitted to the image sensor 124 through the lens module 122 . The image sensor 124 senses the ambient light and captures an ambient image IMG, which is then transmitted to the image processor 126 .

[0026] like Figure 2 and Figure 3 As shown, the image processing method 200 proceeds to step S220, where the image processor 126 of the network camera 120 calculates the automatic photography parameters PA according to the environment image IMG. The automatic photography parameters PA include the automatic white balance parameters P AWB , automatic exposure parameter P AE With the autofocus parameter P AF At least one of them.

[0027] In one embodiment, the image processor 126 can execute an automatic white balance algorithm, an automatic exposure algorithm, and an auto-focus algorithm according to the ambient image IMG. The above three algorithms are also called 3A algorithms, and obtain the automatic white balance parameters P and P, respectively. AWB , automatic exposure parameter P AE With the autofocus parameter P AFFor example, the autofocus algorithm may adopt contrast detection auto focus (CDAF), phase detection auto focus (PDAF), or other similar focus algorithms. For example, the autoexposure algorithm may adopt high-dynamic-range histogram (HDH) autoexposure, median autoexposure, or other similar exposure algorithms. For example, the autowhite balance algorithm may adopt a gray-world algorithm or other similar white balance algorithms.

[0028] In one embodiment, the image processor 126 may be configured to automatically adjust the exposure parameters P AE The image processor 126 can control the aperture of the lens module 122 and the signal gain of the image sensor 124 according to the auto-focus parameter P. AF Feedback controls the focus distance of the lens module 122. In addition, according to the automatic white balance parameter P AWB The automatic white balance origin of the environment image IMG output by the image processor 126 is controlled, that is, by correcting the color temperature in the environment image IMG, so that the white area in the environment image IMG looks more real and neutral.

[0029] Figure 3 As shown, the image processing method 200 proceeds to step S230, where the network camera 120 transmits the automatic photography parameter PA to the controller chip 142 of the display 140. Figure 2 In the embodiment shown, the image processor 126 may obtain the automatic photographic parameters PA (including the automatic white balance parameters P AWB , automatic exposure parameter P AE With the autofocus parameter P AF At least one of the above) is transmitted to the display 140 via the transmission interface 128.

[0030] On the other hand, the display 140 includes a controller chip 142 , a display panel 144 , and a transmission interface 148 . The controller chip 142 of the display 140 receives the automatic photography parameters PA from the image processor 126 through the transmission interface 148 .

[0031] In one embodiment, the webcam 120 may be an external webcam mounted outside the display 140. The transmission interface 128 and the transmission interface 148 may be a universal serial bus (USB), a high-definition multimedia interface (HDMI), a display port (DisplayPort), or a network transmission interface (such as Bluetooth, WiFi, etc.). The image processor 126 of the webcam 120 transmits the automatic photography parameter PA to the controller chip 142 of the display 140 via the transmission interface between the above devices.

[0032] In another embodiment, the webcam 120 may be a built-in webcam built into the display 140 , and the transmission interface 128 and the transmission interface 148 may be an Inter-Integrated Circuit (I2C) bus circuit or a Serial Peripheral Interface Bus (SPI). The image processor 126 transmits the automatic photography parameter PA to the controller chip 142 via the transmission bus between different integrated circuits within the above device.

[0033] like Figure 2 and Figure 3 As shown, the image processing method 200 proceeds to step S240 , where the controller chip 142 performs a modulation function based on the automatic imaging parameters PA, thereby adjusting the display image SCN of the display 140. In actual applications, based on the various information provided by the automatic imaging parameters PA, the controller chip 142 can automatically trigger different modulation functions on the display 140, thereby generating display images SCN with different effects for different application scenarios. The automatic imaging parameters PA and the corresponding modulation functions performed by the controller chip 142 will be further described in subsequent embodiments.

[0034] See also Figure 4 , which illustrates an image processing method 200A in some embodiments of the present disclosure according to an automatic white balance parameter P in the automatic photography parameter PA. AWB Schematic diagram of the color temperature modulation function. Figure 4 The image processing method 200A shown is Figure 3 A specific application example of the image processing method 200 is shown.

[0035] like Figure 2 and Figure 4 As shown, in step S220, the image processor 126 of the network camera 120 calculates the automatic photography parameters PA according to the environment image IMG, including the automatic white balance parameter P AWB In step S230A, the network camera 120 sets the automatic white balance parameter P AWBThe signal is transmitted to the controller chip 142 of the display 140 .

[0036] like Figure 2 and Figure 4 As shown, the controller chip 142 of the display 140 executes step S240A to perform a modulation function according to the automatic photography parameter PA and thereby adjust the display image SCN of the display 140. In this embodiment, step S240A includes steps S241A, S242A, and S243A.

[0037] First, in step S241A, the controller chip 142 of the display 140 adjusts the automatic white balance parameter P from the network camera 120. AWB Obtaining the ambient color temperature. Since the ambient image IMG captured by the network camera 120 reflects the color temperature characteristics of the ambient light at that time, such as warm tones, cold tones, green tones, red tones, etc., the controller chip 142 can adjust the ambient color temperature according to the automatic white balance parameter P AWB The ambient color temperature of the surrounding environment is obtained. Step S242A is executed, and the controller chip 142 calculates the ambient color temperature of the surrounding environment according to the automatic white balance parameter P. AWB The obtained ambient color temperature performs the display color temperature modulation function of the display 140, so that the display color temperature of the display image SCN approaches the ambient color temperature. AWB When the ambient color temperature is known to be 6700K (slightly cool and bluish), the controller chip 142 modulates the average color temperature of the display image SCN to make it close to 6700K. AWB When the ambient color temperature is 2500 K (warmer, yellower), the controller chip 142 modulates the average color temperature of the display image SCN to approach 2500 K. In step S243A, the controller chip 142 outputs the color temperature-modulated display image SCN to the display panel 144 for display.

[0038] See also Figure 5 , which illustrates an image processing method 200B in some embodiments of the present disclosure according to the automatic white balance parameter P in the automatic photography parameter PA. AWB Schematic diagram of blue light modulation function. Figure 5 The image processing method 200B shown is Figure 3 A specific application example of the image processing method 200 is shown.

[0039] like Figure 2 and Figure 5 As shown, in step S220, the image processor 126 of the network camera 120 calculates the automatic photography parameters PA (eg, including the automatic white balance parameters P) according to the environmental image IMG. AWB And automatic exposure parameter PAE In step S230B, the network camera 120 transmits the automatic photography parameter PA to the controller chip 142 of the display 140. Figure 2 and Figure 5 As shown, the controller chip 142 of the display 140 executes step S240B to perform a modulation function according to the automatic photography parameter PA and thereby adjust the display image SCN of the display 140. In this embodiment, step S240B includes steps S241B to S245B.

[0040] First, in step S241B, the controller chip 142 of the display 140 adjusts the automatic white balance parameter P from the network camera 120. AWB Calculate the ambient blue light hazard value. Since the environmental image IMG captured by the network camera 120 reflects the color temperature characteristics of the ambient light at that time, such as warm tones, cold tones, green tones, red tones, etc., the controller chip 142 can calculate the ambient blue light hazard value according to the automatic white balance parameter P AWB The blue light intensity, red light intensity, and green light intensity of the automatic white balance origin (ie, the white point) of the surrounding environment at this time are obtained.

[0041] In one embodiment, the ambient blue light hazard value EB can be obtained according to the following formula (1):

[0042]

[0043] That is to say, when the proportion of blue light intensity in the automatic white balance origin is higher, the ambient blue light hazard value EB is greater; conversely, when the proportion of blue light intensity in the automatic white balance origin is lower, the ambient blue light hazard value EB is smaller.

[0044] Alternatively, in another embodiment, in step S241B, the controller chip 142 generates an automatic white balance parameter P from the network camera 120. AWB And the automatic exposure parameter P AE Calculate the ambient blue light hazard value EB. The ambient blue light hazard value EB can be obtained according to the following formula (2):

[0045]

[0046] Where Av(R) is the intensity of red light, Av(G) is the intensity of green light, and Av(B) is the intensity of blue light. It is the total energy between the wavelength of plus or minus 20 nanometers of the blue light peak. is the total energy of red light, is the total energy of green light, In the embodiment of using the above formula (2) to calculate the ambient blue light hazard value EB, it is necessary to know the spectrum distribution of the ambient light source (i.e. In some examples, the controller chip 142 can be configured to automatically adjust the white balance parameters P according to the automatic white balance parameters P. AWB Knowing the spectrum distribution of the ambient light source, the controller chip 142 can automatically adjust the exposure parameters P AE Get the brightness of the ambient light source.

[0047] In other examples, the automatic exposure parameter P generated by the network camera 120 is AE It can provide accurate brightness information, but it may be difficult for the network camera 120 to accurately measure the spectrum distribution (ie, the spectrum distribution determined by the automatic white balance parameter P AWB It is difficult to obtain a spectrum distribution with sufficient accuracy. In this case, the spectrum distribution information needs to be collected through offline experiments and based on the automatic exposure parameter P AE The brightness of the ambient light source is known, and a table is looked up to convert the current ambient blue light hazard value EB. For example, in an environment with a light-emitting diode light source, a fluorescent tube light source, or other light source, an instrument that can measure the spectrum (such as a spectrometer or a spectroradiometer) is set up to measure the spectrum distribution and brightness, and the spectrum under different light sources and brightness is obtained. It can be substituted into formula (2) to obtain the ambient blue light hazard value EB, and the offline collected data is recorded in the lookup table, and the lookup table can be written into the memory in the controller chip 142 (not shown in the figure) or the memory unit coupled to the controller chip 142 (not shown in the figure). During the actual operation of the controller chip 142, the automatic exposure parameter P can be used to determine the ambient blue light hazard value EB. AE The brightness is obtained by looking up a table to output the most approximate ambient blue light hazard value EB for the current environment.

[0048] In step S242B, the controller chip 142 of the display 140 calculates the blue light hazard value based on the data signal corresponding to the display image SCN. The data signal records the blue grayscale brightness, red grayscale brightness, and green grayscale brightness of multiple pixels in the display image SCN. In one embodiment, the blue light hazard value DB can be obtained according to the following formula (3):

[0049]

[0050] In step S243B, the low blue light modulation function is executed based on the ambient blue light hazard value and the screen blue light hazard value. For example, when the sum of the ambient blue light hazard value and the screen blue light hazard value is greater than a threshold, the controller chip 142 executes the low blue light modulation function. For example, when the sum of the ambient blue light hazard value and the screen blue light hazard value is less than the threshold, the controller chip 142 does not execute the low blue light modulation function.

[0051] For example, when the controller chip 142 determines that the low blue light modulation function needs to be executed, in step S244B, the controller chip 142 may increase the blue light gain value, or decrease the red light gain value or the green light gain value. The controller chip 142 multiplies the increased blue light gain value (or decreased red light gain value or green light gain value) by the data signal corresponding to the display image SCN, and adjusts the blue light intensity ratio of the display image SCN based on the adjusted blue light gain value (or red light gain value or green light gain value).

[0052] In step S245B, the controller chip 142 outputs the display image SCN after the blue light intensity ratio is modulated to the display panel 144 .

[0053] On the other hand, if the controller chip 142 determines that the low blue light modulation function is not necessary (the sum of the ambient blue light hazard value and the screen blue light hazard value does not reach the threshold), the controller chip 142 does not adjust the blue light gain value, the red light gain value, or the green light gain value in step S244B. The controller chip 142 does not adjust the blue light intensity ratio of the display screen SCN.

[0054] See also Figure 6 , which illustrates an image processing method 200C in some embodiments of the present disclosure according to an automatic exposure parameter P in the automatic photography parameter PA. AE Schematic diagram of display brightness modulation function. Figure 6 The image processing method 200C shown is Figure 3 A specific application example of the image processing method 200 is shown.

[0055] like Figure 2 and Figure 6 As shown, in step S220, the image processor 126 of the network camera 120 calculates the automatic photography parameters PA including the automatic exposure parameters P according to the environment image IMG. AE In step S230C, the network camera 120 automatically sets the exposure parameter P AE Transmitted to the controller chip 142 of the display 140. Figure 2 and Figure 6 As shown, the controller chip 142 of the display 140 executes step S240C to perform a modulation function according to the automatic photography parameter PA and thereby adjust the display image SCN of the display 140. In this embodiment, step S240C includes steps S241C to S243C.

[0056] First, in step S241C, the controller chip 142 of the display 140 sets the automatic exposure parameter P from the network camera 120. AEObtaining the ambient brightness. Since the ambient image IMG captured by the network camera 120 reflects the ambient light brightness of the surrounding environment at that time, the controller chip 142 can automatically adjust the exposure parameters P AE Get the ambient brightness of the surrounding environment at this time.

[0057] In step S242C, the controller chip 142 of the display 140 performs a display brightness modulation function based on the ambient brightness, so that the modulated display brightness of the display image SCN is positively correlated with the ambient brightness. For example, when the ambient brightness is high, the controller chip 142 increases the display brightness of the display image SCN; when the ambient brightness is low, the controller chip 142 decreases the display brightness of the display image SCN. The controller chip 142 is used to control the display brightness of the display image SCN to adjust according to the ambient brightness.

[0058] In step S243C, the controller chip 142 outputs the display image SCN after display brightness modulation to the display panel 144 .

[0059] In this way, when the ambient brightness is high (e.g., in strong sunlight or when used outdoors), the display brightness of the display image SCN can be increased to prevent the user from being unable to clearly see the display image SCN on the display panel 144 due to ambient reflections. On the other hand, when the ambient brightness is low (e.g., late at night or when used in a low-light indoor environment), the display brightness of the display image SCN can be reduced accordingly to prevent the display panel 144 from being too bright and causing light pollution or excessive irritation to the user's eyes.

[0060] See also Figure 7 , which illustrates an image processing method 200D in some embodiments of the present disclosure according to an automatic exposure parameter P in the automatic photography parameter PA. AE Schematic diagram of the zone dimming function. Figure 7 The image processing method 200D shown is Figure 3 A specific application example of the image processing method 200 is shown.

[0061] like Figure 2 and Figure 7 As shown, in step S220, the image processor 126 of the network camera 120 calculates the automatic photography parameters PA including the automatic exposure parameters P according to the environment image IMG. AE In step S230D, the network camera 120 automatically sets the exposure parameter P AE Transmitted to the controller chip 142 of the display 140. Figure 2 and Figure 7As shown, the controller chip 142 of the display 140 executes step S240D to perform a modulation function according to the automatic photography parameter PA and thereby adjust the display image SCN of the display 140. In this embodiment, step S240D includes steps S241D to S243D.

[0062] First, in step S241D, the controller chip 142 of the display 140 sets the automatic exposure parameter P from the network camera 120. AE Get the ambient brightness.

[0063] In step S242D, the controller chip 142 of the display 140 performs a zone dimming function based on the ambient brightness, so that the maximum block brightness of the multiple display blocks of the modulated display image SCN is positively correlated with the ambient brightness. In this zone dimming function, the display panel 144 can be divided into multiple dimming blocks. For example, the display panel 144 can be divided into 256 dimming blocks with 16*16 segments. The controller chip 142 can set a block gain for each dimming block, thereby affecting the brightness of each dimming block.

[0064] For example, assuming that the grayscale brightness is between 0 and 255, 0 is the lowest brightness and 255 is the highest brightness. When the ambient brightness is high, the controller chip 142 can set the maximum block brightness to 255. At this time, the pixel brightness of each dimming block can vary between 0 and 255, and different block gains can be further applied between individual dimming blocks. When the ambient brightness is medium, the controller chip 142 can set the maximum block brightness to 180. At this time, the pixel brightness of each dimming block can vary between 0 and 180, and different block gains can be further applied between individual dimming blocks. When the ambient brightness is low, the controller chip 142 can set the maximum block brightness to 100. At this time, the pixel brightness of each dimming block can vary between 0 and 100, and different block gains can be further applied between individual dimming blocks. In other words, with different ambient brightness, the controller chip 142 will apply appropriate zone dimming effects.

[0065] See also Figure 8 , which illustrates the image processing method 200E in some embodiments of the present disclosure according to the auto-focus parameter P in the automatic photography parameter PA AF Schematic diagram of the health reminder function. Figure 8 The image processing method 200E shown is Figure 3 A specific application example of the image processing method 200 is shown.

[0066] like Figure 2 and Figure 8As shown, in step S220, the image processor 126 of the network camera 120 calculates the automatic photography parameters PA including the automatic focus parameters P according to the environment image IMG. AF In step S230E, the network camera 120 sets the auto-focus parameter P AF Transmitted to the controller chip 142 of the display 140. Figure 2 and Figure 8 As shown, the controller chip 142 of the display 140 executes step S240E to perform a modulation function according to the automatic photography parameter PA and thereby adjust the display image SCN of the display 140. In this embodiment, step S240E includes steps S241E to S243E.

[0067] First, in step S241E, the controller chip 142 of the display 140 adjusts the focus according to the auto-focus parameter P from the network camera 120. AF Obtaining the distance to the object. Assuming that the user is in front of the network camera 120, the foreground object captured by the environment image IMG captured by the network camera 120 may be the user's portrait. At this time, the auto-focus parameter P AF The corresponding focus distance may correspond to the object distance (ie, the distance between the user and the network camera 120). The controller chip 142 can adjust the focus according to the auto-focus parameter P AF (The focal length in between) to obtain the above object distance.

[0068] In step S242E, the controller chip 142 executes the health reminder function according to the distance of the object. In step S243E, the controller chip 142 generates and outputs reminder information based on the health reminder function.

[0069] In one embodiment, when the object distance is determined to be less than a threshold (e.g., less than 50 cm), the controller chip 142 generates a reminder signal based on the health reminder function, such as a text window reminder "It is recommended to adjust your sitting posture or maintain an appropriate distance from the screen" displayed on the display panel 144. In another embodiment, the reminder signal generated by the controller chip 142 may also include an audible reminder, such as a warning sound emitted by a speaker on the display 140, or a reminder audio message.

[0070] In another embodiment, when it is determined that the distance to the object remains unchanged and the duration exceeds a threshold time (for example, more than 30 minutes), the controller chip 142 may also generate a reminder signal based on the health reminder function, such as a text window reminder "It is recommended to adjust your sitting posture or temporarily leave your seat" displayed on the display panel 144.

[0071] See also Figure 9, which is a schematic diagram illustrating an image processing method 200F in some embodiments of the present disclosure that performs image processing functions according to automatic photography parameters PA. Figure 9 The image processing method 200F shown is Figure 3 A specific application example of the image processing method 200 is shown.

[0072] like Figure 2 and Figure 9 As shown, in step S220, the image processor 126 of the network camera 120 calculates the automatic photography parameters PA according to the environment image IMG, including the automatic white balance parameter P AWB , automatic exposure parameter P AE With the autofocus parameter P AF In step S230F, the network camera 120 transmits the automatic photography parameter PA and the captured environment image IMG to the controller chip 142 of the display 140. Figure 2 and Figure 9 As shown, the controller chip 142 of the display 140 executes step S240F to perform a modulation function according to the automatic photography parameter PA and thereby adjust the display image SCN of the display 140. In this embodiment, step S240F includes steps S241F to S242F.

[0073] First, in step S241F, the controller chip 142 can further optimize the image processing of the environment image IMG according to the automatic photography parameters PA. The automatic photography parameters PA include the automatic white balance parameters P AWB , automatic exposure parameter P AE With the autofocus parameter P AF At least one of the above automatic white balance parameters P AWB , automatic exposure parameter P AE With the autofocus parameter P AF The color temperature, brightness, object distance, and other information of the environmental image IMG can be displayed. In step S242F, the environmental image IMG after image processing by the controller chip 142 is used as the display screen SCN (or the image-processed environmental image IMG is embedded in the display screen SCN as part of the display screen SCN) and output to the display panel 144.

[0074] For example, the controller chip 142 can further adjust the color temperature of the ambient image IMG based on the panel characteristics of the display panel 144 (whether the panel color temperature is cool or warm), compensate the color temperature of the ambient image IMG, and generate a compensated display image SCN. Alternatively, the controller chip 142 can further adjust the average brightness of the ambient image IMG based on the native brightness of the display panel 144, compensate the brightness of the ambient image IMG, and generate a compensated display image SCN.

[0075] See also Figure 10 , which illustrates a schematic diagram of the feedback function performed according to the automatic photography parameters PA in the image processing method 200G in some embodiments of the present disclosure. Figure 10 The image processing method 200G shown is Figure 3 A specific application example of the image processing method 200 is shown.

[0076] like Figure 2 and Figure 10 As shown, in step S220, the image processor 126 of the network camera 120 calculates the automatic photography parameters PA according to the environment image IMG, including the automatic white balance parameter P AWB , automatic exposure parameter P AE With the autofocus parameter P AF In step S230G, the network camera 120 transmits the automatic photography parameter PA and the captured environment image IMG to the controller chip 142 of the display 140. Figure 2 and Figure 10 As shown, the controller chip 142 of the display 140 executes step S240G to perform a modulation function according to the automatic photography parameter PA and thereby adjust the display image SCN of the display 140. In this embodiment, step S240G includes steps S241G to S249G.

[0077] First, in step S241G, the controller chip 142 can further optimize the image processing of the environment image IMG according to the automatic photography parameter PA to generate an adjusted environment image. AWB , automatic exposure parameter P AE With the autofocus parameter P AF It can represent information such as color temperature, brightness, object distance, etc. of the environmental image IMG. In step S242G, the controller chip 142 determines whether there is any abnormality in the adjusted environmental image.

[0078] In one embodiment, determining whether the adjusted environment image has an abnormality may include determining whether the adjusted environment image has an abnormal overexposure condition. For example, if the pixel brightness of the adjusted environment image exceeds the maximum brightness of the display 140, or if a large area of ​​pixels (e.g., more than 30% of the pixels) in the adjusted environment image have a brightness that is equal to the maximum brightness of the display 140, then the adjusted environment image may be determined to have an abnormal overexposure condition.

[0079] In another embodiment, determining whether the adjusted environmental image has an abnormality may include determining whether the adjusted environmental image has an abnormal out-of-focus condition. For example, the controller chip 142 performs spectral analysis on the adjusted environmental image. If the spectral analysis finds that the pixel content is concentrated in low-frequency components and high-frequency components are scarce, it means that the adjusted environmental image is likely out-of-focus and has not been correctly focused on the foreground object. In this case, the adjusted environmental image has a problem of insufficient sharpness, and it can be determined that the adjusted environmental image has an abnormal out-of-focus condition.

[0080] In another embodiment, determining whether there is an abnormality in the adjusted ambient image may be determining whether the color temperature in the adjusted ambient image exceeds a reasonable range. If the color temperature exceeds the reasonable range, it may be determined that there is an abnormality in the white balance of the adjusted ambient image.

[0081] If no abnormality is found, step S243G is executed, and the controller chip 142 uses the adjusted environmental image after image processing by the controller chip 142 as the display screen SCN (embedded into the display screen SCN) and outputs it to the display panel 144.

[0082] If an abnormality is found, step S244G is executed, and the controller chip 142 generates a feedback signal FB according to the abnormality found. In one embodiment, when an abnormality of overexposure is found, the controller chip 142 can generate a feedback signal FB for the automatic exposure parameter P AE When the out-of-focus abnormality is detected, the controller chip 142 can generate an auto-focus parameter P AF When the white balance is found to be abnormal, the controller chip 142 can generate a parameter P for the automatic white balance. AWB The feedback signal FB is not limited to a single abnormal condition, but may also correspond to multiple abnormal conditions at the same time.

[0083] In step S245G, the controller chip 142 transmits the feedback signal FB back to the image processor 126 of the network camera 120 through the transmission interface 148 and the transmission interface 128. In step S246G, the image processor 126 can calibrate the automatic photography parameters PA (including the automatic white balance parameters PA) according to the feedback signal FB.AWB , automatic exposure parameter P AE Or autofocus parameter P AF ) to obtain the corrected automatic photography parameters. Next, in step S247G, a corrected environment image IMGc is generated based on the corrected automatic photography parameters. For example, the original environment image IMG is recalculated based on the corrected automatic photography parameters to obtain the corrected environment image IMGc, or the environment image is recaptured and then algorithmically calculated based on the corrected automatic photography parameters to obtain the corrected environment image IMGc.

[0084] Next, in step S248G, the network camera 120 transmits the corrected environment image IMGc to the controller chip 142 of the display 140. In step S249G, the controller chip 142 may output a display frame SCN to the display panel 144 according to the corrected environment image IMGc.

[0085] In summary, the automatic photography parameters PA (such as the automatic white balance parameters P AWB , automatic exposure parameter P AE With the autofocus parameter P AF ) can be transmitted to the display 140, serving as a trigger signal and judgment criterion for the display 140 to perform the automatic modulation function. This eliminates the need for additional optical sensors or proximity sensors embedded in the display 140, saving manufacturing costs and space for the display 140. The automatic imaging parameters PA of the webcam 120 can be utilized to achieve a similar automatic modulation function. Furthermore, the webcam 120's shooting range and angle (compared to optical sensors or proximity sensors) are less susceptible to accidental obstruction, and any accidental obstruction is more easily detected by the user, preventing the automatic modulation function from being erroneously triggered.

[0086] Although the present disclosure has been disclosed above in the form of an embodiment, it is not intended to limit the present disclosure. Anyone with ordinary knowledge in the art can make various changes and modifications without departing from the spirit and scope of the present disclosure. Therefore, the scope of protection of the present disclosure shall be determined by the scope of the attached patent application.

[0087]

Explanation of symbols

[0088] 100: Image processing system

[0089] 120: Webcam

[0090] 122: Lens module

[0091] 124: Image sensor

[0092] 126: Image Processor

[0093] 128: Transmission interface

[0094] 140: Display

[0095] 142: Controller chip

[0096] 144: Display panel

[0097] 148:Transmission interface

[0098] 200,200A,200B,200C,200D:Image processing method

[0099] 200E, 200F, 200G: Image processing methods

[0100] FB: Feedback signal

[0101] IMG: Environment Image

[0102] IMGc: Corrected environment image

[0103] PA: Automatic photography parameters

[0104] P AE : Automatic exposure parameters

[0105] P AF :Autofocus parameters

[0106] P AWB : Automatic white balance parameters

[0107] SCN: Display screen

[0108] S210, S220, S230, S240: Steps

[0109] S230A, S230B, S230C, S230D: Steps

[0110] S230E, S230F, S230G: Steps

[0111] S240A, S240B, S240C, S240D: Steps

[0112] S240E, S240F, S240G: Steps

[0113] S241A, S242A, S243A: Steps

[0114] S241B, S242B, S243B, S244B, S245B: Steps

[0115] S241C, S242C, S243C: Steps

[0116] S241D, S242D, S243D: Steps

[0117] S241E, S242E, S243E: Steps

[0118] S241F, S242F: Steps

[0119] S241G, S242G, S243G, S244G, S245G: Steps

[0120] S246G, S247G, S248G, S249G: Steps

Claims

1. An image processing method, comprising: The environment image is captured by a webcam; Calculating automatic photography parameters by the network camera according to the environmental image, the automatic photography parameters including at least one of an automatic white balance parameter, an automatic exposure parameter, and an automatic focus parameter; a controller chip for transmitting the automatic photography parameters from the network camera to a display; and The controller chip performs a modulation function according to the automatic photography parameters, thereby adjusting the display image of the display.

2. The image processing method according to claim 1 , wherein the automatic photography parameters include the automatic white balance parameters, and the controller chip performing the modulation function according to the automatic photography parameters comprises: Obtaining the ambient color temperature according to the automatic white balance parameters; as well as A display color temperature modulation function is performed according to the ambient color temperature, so that the display color temperature of the display image approaches the ambient color temperature.

3. The image processing method according to claim 1 , wherein the automatic photography parameters include the automatic white balance parameters and the automatic exposure parameters, and the controller chip performing the modulation function according to the automatic photography parameters comprises: Calculating an ambient blue light hazard value according to the automatic white balance parameter and the automatic exposure parameter; Calculating a blue light hazard value of the display according to a data signal corresponding to the display image; executing a low blue light modulation function according to the ambient blue light hazard value and the screen blue light hazard value, and adjusting a red light gain value, a green light gain value, and a blue light gain value by the low blue light modulation function; as well as The blue light intensity ratio of the display image is adjusted based on the red light gain value, the green light gain value, and the blue light gain value.

4. The image processing method according to claim 1 , wherein the automatic photography parameters include the automatic exposure parameters, and the controller chip performing the modulation function according to the automatic photography parameters comprises: Obtaining ambient brightness according to the automatic exposure parameters; as well as A display brightness modulation function is performed according to the ambient brightness, so that the display brightness of the display image is positively correlated with the ambient brightness.

5. The image processing method according to claim 1 , wherein the automatic photography parameters include the automatic exposure parameters, and the controller chip performing the modulation function according to the automatic photography parameters comprises: Obtaining ambient brightness according to the automatic exposure parameters; as well as A zone dimming function is performed according to the ambient brightness, so that the maximum value of the block brightness of the plurality of display blocks in the display image is positively correlated with the ambient brightness.

6. The image processing method according to claim 1 , wherein the automatic photography parameters include the autofocus parameters, and the controller chip performing the modulation function according to the automatic photography parameters comprises: Obtaining an object distance according to the autofocus parameters; Executing a health reminder function according to the distance of the object; as well as Prompt information is generated according to the health reminder function, and the prompt information is output by the display.

7. The image processing method according to claim 1 , wherein the network camera transmits the automatic photography parameters and the environment image to the controller chip, and the controller chip performs the modulation function according to the automatic photography parameters, comprising: The controller chip performs an image processing function according to the automatic photography parameters to generate an adjusted environmental image according to the environmental image; as well as The adjusted environment image is displayed on the display screen of the display.

8. The image processing method according to claim 1 , wherein the network camera transmits the automatic photography parameters and the environment image to the controller chip, and the controller chip performs the modulation function according to the automatic photography parameters, comprising: The controller chip performs an image processing function according to the automatic photography parameters to generate an adjusted environmental image according to the environmental image; The controller chip determines whether the adjusted environmental image has an abnormality; When it is determined that the adjusted environmental image has the abnormality, the controller chip generates a feedback signal; The controller chip transmits the feedback signal to the network camera; Correcting the automatic photography parameters by the network camera according to the feedback signal to generate corrected automatic photography parameters; The network camera generates a corrected environment image based on the corrected automatic photography parameters; transmitting the corrected environment image to the controller chip of the display by the network camera; as well as The display generates the display image according to the corrected environment image.

9. An image processing system comprising: A network camera for capturing an environment image, the network camera comprising an image processor for calculating automatic photography parameters based on the environment image, the automatic photography parameters comprising at least one of an automatic white balance parameter, an automatic exposure parameter, and an automatic focus parameter; as well as Display, including: Display panel; as well as A controller chip is coupled to the display panel and is in communication with the image processor. The controller chip is used to receive the automatic photography parameters from the image processor of the network camera, perform a modulation function according to the automatic photography parameters, and output a display image to the display panel according to the result of the modulation function.

10. A display comprising: Display panel; as well as A controller chip is coupled to the display panel and is in communication with a network camera. The controller chip is used to receive automatic photography parameters from the network camera, perform a modulation function according to the automatic photography parameters, and output a display image to the display panel according to the result of the modulation function.

Images