Information processing device, information processing method, and program

The information processing device addresses the issue of reflections on display screens by using environmental and reflection feature acquisition to perform image quality correction, improving image clarity.

WO2025197374A1PCT designated stage Publication Date: 2025-09-25SONY GROUP CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2025/004725
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-03-18
Filing Date
2025-02-13
Publication Date
2025-09-25

AI Technical Summary

Technical Problem

Reflections from the environment on display screens make it difficult for users to view images clearly.

Method used

An information processing device that acquires environmental features and reflection features using cameras and sensors, and performs image quality correction processing to reduce the impact of reflections on the display screen.

Benefits of technology

The device effectively reduces the difficulty in viewing images by adjusting brightness and color based on environmental and reflection data, enhancing image clarity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2025004725_25092025_PF_FP_ABST
    Figure JP2025004725_25092025_PF_FP_ABST
Patent Text Reader

Abstract

This invention reduces the difficulty in seeing a display image due to the reflection of the environment on a display screen. An environmental feature amount in an environment on the front side of a display screen is acquired. A reflection feature amount is acquired on the basis of the environmental feature amount and information on the range of reflection on the display screen, the range of reflection being with respect to the environment in front of the display screen. On the basis of the reflection feature amount, image quality correction processing is performed on an image signal for displaying an image on the display screen. For example, the environmental feature amount may be environmental brightness, the reflection feature amount may be reflection brightness, and brightness correction processing may be performed on an image signal on the basis of the reflection brightness.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing device, information processing method, and program

[0001] The present technology relates to an information processing device, an information processing method, and a program, and more particularly to an information processing device or the like that can reduce difficulty in viewing a displayed image due to reflections on a display screen.

[0002] In a video display device such as a television receiver, if the environment is significantly reflected on the display screen, the user may be bothered by the reflection and find it difficult to see the displayed image. For example, Patent Document 1 describes that the degree of reflection of ambient light or surrounding objects on the display unit (display surface) may be detected based on imaging information from an imaging device, and brightness, color depth, etc. may be set to reduce the reflection.

[0003] International Publication No. 2023 / 127514

[0004] The purpose of this technology is to reduce the difficulty in viewing a displayed image caused by the reflection of the environment on the display screen.

[0005] The concept of the present technology lies in an information processing device comprising: an environmental feature acquisition unit that acquires environmental feature amounts in the environment in front of a display screen; a reflection feature acquisition unit that acquires reflection feature amounts based on the environmental feature amounts and information on the range of reflection on the display screen from the environment in front of the display screen; and an image quality correction processing unit that performs image quality correction processing on an image signal for displaying an image on the display screen based on the reflection feature amounts.

[0006] In the present technology, an environmental feature acquisition unit acquires environmental feature values ​​for an environment in front of a display screen. For example, the environmental feature acquisition unit may acquire environmental feature values ​​corresponding to each of a plurality of areas obtained by dividing a rectangular region including the environment in front of the display screen. In this case, for example, the environmental feature value acquisition unit may acquire environmental feature values ​​corresponding to each of the plurality of areas based on a camera output signal. In addition, in this case, for example, the environmental feature acquisition unit may acquire environmental feature values ​​corresponding to each of the plurality of areas based on an output signal of a directional image quality sensor.

[0007] The reflection feature acquisition unit acquires reflection features based on the environmental feature and information on the reflection range of the environment in front of the display screen that is reflected on the display screen. For example, the reflection feature acquisition unit may calculate the information on the reflection range based on information on the user's position and the size of the room. In this case, for example, the reflection feature acquisition unit may acquire the information on the user's position and the size of the room based on a camera output signal. In addition, in this case, for example, the reflection feature acquisition unit may acquire the information on the user's position and the size of the room based on a ranging sensor output signal. In this case, for example, the reflection feature acquisition unit may use fixed information as the information on the user's position and the size of the room.

[0008] For example, the reflection feature acquisition unit may acquire the reflection feature by extracting and averaging the environmental feature of an area included in the reflection range from the environmental feature corresponding to each of the multiple areas. In this case, for example, the reflection feature acquisition unit may acquire the reflection feature by multiplying the environmental feature corresponding to each of the multiple areas by a weighting coefficient set based on information about the reflection range and performing weighted averaging.

[0009] Here, for example, the weighting coefficients by which the environmental feature quantities corresponding to each of the multiple areas are multiplied may be set to "1" for areas corresponding to the reflection range, and may approach "0" for areas corresponding to ranges peripheral to the reflection range as the distance from the reflection range increases. This makes it possible to acquire reflection feature quantities corresponding to the actual reflection range, even when the reflection range information indicates a range that is shifted from the actual reflection range. Furthermore, for example, the weighting coefficients by which the environmental feature quantities corresponding to each of the multiple areas are multiplied may be set to "1" for areas corresponding to the reflection range, and may be set to "0" for areas corresponding to ranges peripheral to the reflection range. When the reflection range information indicates the actual reflection range, this makes it possible to acquire reflection feature quantities corresponding to the actual reflection range.

[0010] Furthermore, for example, when the environmental feature acquisition unit acquires environmental feature amounts corresponding to each of a plurality of areas obtained by dividing a rectangular area including the environment in front of the display screen, the rectangular area may be included in the reflection range, and the reflection feature acquisition unit may acquire the reflection feature amount by averaging the environmental feature amounts corresponding to each of the plurality of areas. In this case, it is possible to eliminate the need for processing to extract the environmental feature amount for the area included in the reflection range from the environmental feature amounts corresponding to each of the plurality of areas.

[0011] The image quality correction processing unit performs image quality correction processing on an image signal for displaying an image on a display screen based on the reflection feature. For example, the image quality correction processing unit may acquire a reflection-corrected image quality based on an environmental feature of an environment in which the display screen is placed and a ratio of a reflection feature to the environmental feature, or based on an environmental feature of an environment in which the display screen is placed and a reflection feature, and perform image quality correction processing on an image signal for displaying an image on the display screen based on the reflection-corrected image quality. In this case, for example, the image quality correction processing unit may acquire the reflection-corrected image quality by referring to a table (lookup table) that stores correspondences between the reflection feature and the ratio, or between the reflection feature and the environmental feature and the reflection feature, and the reflection-corrected image quality.

[0012] For example, the environmental feature acquisition unit may acquire the brightness of the environment in front of the display screen, the reflection feature acquisition unit may acquire the reflection brightness, and the image quality correction processing unit may perform brightness correction processing on the image signal based on the reflection brightness. As a result, the greater the brightness of the reflection range in the environment in front of the display screen, the greater the brightness correction amount, making it possible to reduce difficulty in viewing the displayed image due to the reflection of the environment on the display screen.

[0013] In this case, for example, the image quality correction processing unit may obtain a reflection correction amount according to the ambient illuminance of the environment in which the display screen is placed and the ratio of reflection brightness to this ambient illuminance, or the ambient illuminance of the environment in which the display screen is placed and the reflection brightness, and perform luminance correction processing on the image signal based on this reflection correction amount.Here, for example, the image quality correction processing unit may set a tone curve for luminance correction based on the reflection correction amount, and perform luminance correction processing so as to raise the luminance on the low gradation side.

[0014] Furthermore, for example, the image quality correction processing unit may change the amount of luminance correction for the image signal based on the brightness of the reflection, depending on the brightness of the image displayed on the display screen. For example, when the image displayed on the display screen is bright, the difficulty in seeing the displayed image due to the reflection of the environment on the display screen is small to begin with, and the amount of luminance correction for raising the luminance on the low gradation side may be small.

[0015] Furthermore, for example, the image quality correction processing unit may change the amount of luminance correction for the image signal based on the reflection brightness depending on whether or not the image signal contains a high-gradation signal. In this way, when the image signal contains a high-gradation signal, the amount of luminance correction is reduced, making it possible to prevent gradation collapse (whiteout) on the high-gradation side.

[0016] Furthermore, for example, the image quality correction processing unit may change the amount of luminance correction for the image signal based on the brightness of reflections depending on whether or not a human face is included in the image displayed on the display screen. In this way, when a human face is included in the image displayed on the display screen, the amount of luminance correction is reduced in consideration of the high sensitivity to gradation for human faces, making it possible to prevent excessive differences in brightness and darkness in the human face, which would lead to an unnatural appearance.

[0017] Furthermore, for example, the environmental feature acquisition unit may acquire color information of the environment in front of the display screen, the reflection feature acquisition unit may acquire reflection color information, and the image quality correction processing unit may perform color correction processing on the image signal based on the reflection color information. As a result, for example, the greater the saturation of a specific color in the reflection range of the environment in front of the display screen, the greater the amount of saturation correction for that specific color, making it possible to reduce difficulty in viewing the displayed image due to the environment being reflected on the display screen.

[0018] Furthermore, for example, in a case where the environmental feature acquisition unit acquires environmental feature values ​​corresponding to each of a plurality of areas obtained by dividing a rectangular region including the environment in front of the display screen, the reflection feature acquisition unit may acquire the environmental feature value of each area included in the reflection range as a reflection feature value from the environmental feature values ​​corresponding to each of the plurality of areas, and the image quality correction processing unit may perform image quality correction processing on the image signal based on the environmental feature value of each area included in the reflection range, thereby locally correcting the image quality of the image displayed on the display screen. In this case, it is possible to effectively reduce reflections from each area of ​​the reflection range onto the display screen by setting an appropriate amount of image quality correction for each area.

[0019] In this way, with this technology, reflection features are acquired based on environmental features of the environment in front of the display screen and information on the range of the environment in front of the display screen that is reflected on the display screen, and image quality correction processing is performed on the image signal for displaying an image on the display screen based on these reflection features, making it possible to reduce the difficulty in seeing the displayed image due to the reflection of the environment on the display screen.

[0020] Another concept of the present technology resides in an information processing method having: a step of acquiring environmental features in the environment in front of a display screen; a step of acquiring reflection features based on the environmental features and information on a range of the environment in front of the display screen that is reflected on the display screen; and a step of performing image quality correction processing on an image signal for displaying an image on the display screen based on the reflection features.

[0021] Another concept of the present technology resides in a program for causing a computer to execute an information processing method, the program comprising: a procedure for acquiring environmental features in the environment in front of a display screen; a procedure for acquiring reflection features based on the environmental features and information on a range of reflections on the display screen from the environment in front of the display screen; and a procedure for performing image quality correction processing on an image signal for displaying an image on the display screen based on the reflection features.

[0022] 1 is a diagram illustrating an example of the appearance of a television receiver. It is a block diagram illustrating an example of the internal configuration of a television receiver. It is a block diagram illustrating an example of the configuration of an image control unit. It is a diagram illustrating an example of the environment in front of a display screen and an imaging rectangular area. It is an image diagram illustrating an example of the ambient brightness corresponding to each of a plurality of areas obtained by dividing the imaging rectangular area into a 16-row (R1 to R16) x 16-column (C1 to C16) grid. It is a diagram for explaining an example of creating a horizontal filter. It is a diagram for explaining an example of creating a vertical filter. It is an image diagram illustrating an example of a weighting filter created by multiplying a horizontal filter and a vertical filter. It is a diagram for explaining how to obtain the reflection brightness (average reflection brightness) AVE_LUMI from the ambient brightness (16*16 area) and the weighting coefficient (16*16 area). It is a diagram for explaining another example of creating a horizontal filter. It is a diagram for explaining another example of creating a vertical filter. It is a diagram illustrating an example of a table (lookup table) for obtaining the reflection correction illuminance according to the ambient illuminance and the ratio of the reflection brightness to the ambient illuminance. FIG. 1 is a diagram showing an example of a correspondence relationship between on / off of glare correction and illuminance correction and display luminance correction content. FIG. 2 is a diagram showing an example of a tone curve set based on on / off of glare correction and illuminance correction. FIG. 3 is a flowchart showing an example of a processing procedure of an image control unit. FIG. 4 is a flowchart showing an example of a processing procedure for tone curve setting. FIG. 5 is a block diagram showing an example of the hardware configuration of a computer.

[0023] The following describes modes for carrying out the invention (hereinafter referred to as "embodiments"). The description will be given in the following order: 1. Embodiment 1-1. Example of the appearance of a television receiver 1-2. Example of the internal configuration of a television receiver 1-3. Example of the configuration of an image control unit 1-3-1. Example of creating a weighting filter 1-3-2. Example of the processing procedure of the image control unit 1-4. Processing by software 2. Modified examples

[0024] 1 shows an example of the appearance of a television receiver 10. Note that, although the television receiver 10 will be used as an example for explanation, the present technology can be applied not only to the television receiver 10 but also to other video display devices such as monitor devices and mobile terminal devices.

[0025] The television receiver 10 has a display unit 11 and an illuminance sensor 12. A camera 13 is also installed on the top of the television receiver 10. The display unit 11 is configured, for example, with a liquid crystal display (LCD), an organic electroluminescence (EL) display, or the like. The display unit 11 displays images (moving images or still images) based on, for example, an image signal obtained from a tuner within the television receiver 10, an image signal supplied from an external device via an external input terminal such as an HDMI (High-Definition Multimedia Interface) terminal, or an image signal obtained from another device via the Internet via a communication unit. Here, the image signal may also be referred to as a video signal, a picture signal, or the like. Note that "HDMI" is a registered trademark.

[0026] The illuminance sensor 12 acquires, as the environmental illuminance, the illuminance of the environment in which the television receiver 10, and therefore the display unit 11, is placed. In this example, the illuminance sensor 12 is configured to be built into the television receiver 10, but the illuminance sensor 12 may be configured to be externally attached, or the television receiver 10 may receive the environmental illuminance acquired by the illuminance sensor 12 built into or externally attached to an external device near the television receiver 10.

[0027] Camera 13 captures an image of the environment in front of the display screen of display unit 11. The output signal (image signal) of camera 13 is used to acquire the brightness, color, and the like of the environment in front of the display screen as environmental feature quantities, and also to obtain information on the user's position and the size of the room. In this example, camera 13 is shown as an externally attached camera, but camera 13 may be built into television receiver 10, or may be built into or attached to an external device near television receiver 10, and television receiver 10 may receive an output signal from camera 13.

[0028] In this embodiment, the television receiver 10 performs image quality correction processing on the image signal for displaying an image on the display screen based on the environmental features acquired from the output signal of the camera 13 described above, information on the user's position and room size, and environmental illuminance acquired by the illuminance sensor 12, thereby reducing the difficulty in seeing the displayed image due to the reflection of the environment on the display screen.

[0029] 2 shows an example of the internal configuration of the television receiver 10. In addition to the display unit 11 and illuminance sensor 12 described above, the television receiver 10 is configured to include an image input unit 14, an image control unit 15, and a user operation unit 16. The display unit 11, illuminance sensor 12, image input unit 14, and user operation unit 16 are connected to the image control unit 15. The camera 13 is also connected to the image control unit 15.

[0030] The image input unit 14 is a unit that inputs an image signal. The image input unit 14 inputs an image signal from, for example, a tuner, an external input terminal, or a communication unit, and supplies the image signal to the image control unit 15. The user operation unit 16 is a unit that a user operates to perform various operations. For example, the user can select whether to turn on or off the glare correction according to the present technology by operating the user operation unit 16.

[0031] The image control unit 15 acquires an environmental feature, here environmental brightness, of the environment in front of the display screen of the display unit 11 based on the output signal of the camera 13. The image control unit 15 also acquires reflection brightness as a reflection feature based on the environmental brightness and information on the range of reflection on the display screen of the environment in front of the display screen of the display unit 11. Then, the image control unit 15 performs brightness correction processing as image quality correction processing on the image signal supplied from the image input unit 14 based on the reflection brightness, and supplies the processed image signal to the display unit 11. As a result, an image based on the image signal that has been subjected to the brightness correction processing is displayed on the display screen of the display unit 11, and difficulty in viewing the displayed image due to the reflection of the environment on the display screen is reduced.

[0032] 3 shows an example of the configuration of the image control unit 15. The image control unit 15 has an environment brightness acquisition unit 101, a reflection brightness acquisition unit 102, a reflection correction illuminance acquisition unit 103, a tone curve setting unit 104, and a display luminance correction unit 105. Here, the environment brightness acquisition unit 101 constitutes an environment feature amount acquisition unit, the reflection brightness acquisition unit 102 constitutes a reflection feature amount acquisition unit, and the reflection correction illuminance acquisition unit 103, the tone curve setting unit 104, and the display luminance correction unit 105 constitute an image quality correction processing unit.

[0033] The ambient brightness acquisition unit 101 acquires ambient brightness based on the output signal of the camera 13, i.e., the output signal of the image sensor. As shown in Fig. 4(a), the camera 13 captures an image of the environment in front of the display screen of the display unit 11 within the camera's angle of view. The captured area is not limited to a rectangular area, but Fig. 4(b) shows an image of a rectangular area captured by the camera 13 that includes the environment in front of the display screen of the display unit 11, i.e., an image of an captured rectangular area.

[0034] The ambient brightness acquisition unit 101 acquires the ambient brightness corresponding to each of a plurality of areas obtained by dividing the captured rectangular area into a grid (matrix), based on the output signal of the camera 13. In this case, for each of the plurality of areas, a plurality of pixel signals corresponding to that area are averaged, and the signal level is converted to brightness using a conversion coefficient according to the characteristics of the image sensor and the characteristics of the optical lens, thereby acquiring the ambient brightness of that area.

[0035] Here, if the output signal of the camera 13 is a signal after exposure adjustment using an AE (Automatic Exposure) function, the output signal (each pixel signal) of the camera 13 is normalized based on the camera AE parameters to obtain the ambient brightness in absolute values. For example, if the camera AE parameters are the shutter speed and the signal magnification, the output signal (each pixel signal) of the camera 13 is normalized by dividing by the shutter speed and the signal magnification.

[0036] FIG. 5 is an illustration showing an example of the ambient brightness corresponding to each of the multiple areas obtained by dividing the rectangular capture area into a 16-row (R1-R16) x 16-column (C1-C16) grid. In this example, the brightness level increases from black to white. While this example shows a 16-row x 16-column grid, the number of rows and columns is not limited to 16. The number of rows and columns may vary. The division may not be equal, for example, 5 divisions in a 3:2:1:2:3 ratio. The division may not be grid-shaped, for example, with smaller areas surrounding a larger area. Furthermore, the areas may not be rectangular, for example, with some areas being L-shaped or semicircular. In the following description, the rectangular capture area is assumed to be divided into a 16-row x 16-column grid.

[0037] Returning to Figure 3, the reflection brightness acquisition unit 102 acquires the reflection brightness by extracting and averaging the environmental brightness of the area included in the reflection range within the environment from the environmental brightness corresponding to each of the multiple areas obtained by dividing the captured rectangular area acquired by the environmental brightness acquisition unit 101 into a grid.

[0038] The portion of the captured rectangular area that is the reflection range can be determined based on information about the user (viewer)'s position and the size of the room. For example, the information about the user's position and the size of the room can be obtained by performing image analysis based on the output signal of the camera 13 to identify the user and the walls, ceiling, and floor of the room. Furthermore, for example, the information about the user's position and the size of the room can be obtained by performing semantic segmentation based on the output signal (three-dimensional point cloud) of a ranging sensor provided separately from the camera 13 to identify the user and the walls, ceiling, and floor of the room.

[0039] Note that the information on the user (viewer) position and room size is not limited to being acquired from the output signal of the camera 13 or the output signal of the distance measuring sensor, but may be information on the user position and room size that is preset in the storage unit (register). In this case, the storage unit (register) may be set with a plurality of combinations of information on the user position and room size, and the user may be able to select any combination by performing a selection operation on the user operation unit 16.

[0040] The reflection brightness acquisition unit 102 acquires the reflection brightness (average reflection brightness) by, for example, multiplying the environmental brightness corresponding to each of the multiple areas obtained by dividing the captured rectangular area acquired by the ambient brightness acquisition unit 101 into a grid by a weighting coefficient (filter coefficient) set based on the information on the reflection range, and performing weighted averaging.

[0041] "1-3-1. Example of creating a weighting filter having a weighting coefficient" This section describes an example of creating a weighting filter having a weighting coefficient (filter coefficient) to be multiplied by the environmental brightness corresponding to each of the multiple areas acquired by the environmental brightness acquisition unit 101. This weighting filter is created by creating a horizontal filter and a vertical filter and multiplying them together.

[0042] 6 shows an example of creating a horizontal filter. This horizontal filter is created based on the horizontal angle of view of the camera 13, the position of the user (viewer), the horizontal size of the display screen of the display unit 11, the wall positions that constitute the room size information, etc. Fig. 6(a) shows the positional relationship of the horizontal reflection range with respect to the horizontal camera angle of view range.

[0043] The horizontal camera angle of view range is set to a wall position extending in the left-right direction based on the horizontal angle of view θh of the camera 13. The horizontal camera angle of view range ranges from the left end position CL to the right end position CR. The left end position RL of the horizontal reflection range is determined to be the position where the line of sight EL from the user toward the left end of the display screen is reflected on the display screen and reaches the wall. The right end position RR of the horizontal reflection range is determined to be the position where the line of sight ER from the user toward the right end of the display screen is reflected on the display screen and reaches the wall. The horizontal reflection range ranges from the left end position RL to the right end position RR. This determines the position of the horizontal reflection range within the horizontal camera angle of view range.

[0044] 6B shows an example of a horizontal filter that is set based on the positional relationship between the horizontal camera angle of view range and the horizontal reflection range determined as described above. In this case, the horizontal camera angle of view range is divided into 16 sections, and the horizontal filter has weighting coefficients (filter coefficients) H_COEF0 to H_COEF15 corresponding to each of the 16 divided sections. In this case, for example, the weighting coefficient (filter coefficient) corresponding to the reflection range is set to "1," and the weighting coefficients (filter coefficients) corresponding to the ranges surrounding the reflection range approach "0" as the distance from the reflection range increases.

[0045] In the figure, "0" indicates the center position of the horizontal camera angle of view range. "L_TH0" is a threshold position corresponding to the left edge position RL of the reflection range, and indicates the boundary position where the weighting coefficient (filter coefficient) changes from "1" to a value smaller than "1." "L_TH1" indicates the left side position where the weighting coefficient (filter coefficient) is set to "0," and is set to an arbitrary position. The farther "L_TH1" is positioned from "L_TH0," the more gradually the weighting coefficient (filter coefficient) corresponding to the surrounding range on the left side of the reflection range changes toward "0."

[0046] Furthermore, "R_TH0" is a threshold position corresponding to the right edge position RR of the reflection range, and indicates the boundary position where the weighting coefficient (filter coefficient) changes from "1" to a value smaller than "1." Furthermore, "R_TH1" indicates a right-side position where the weighting coefficient (filter coefficient) is set to "0," and is set to an arbitrary position. The farther "R_TH1" is positioned from "R_TH0," the more gradually the weighting coefficient (filter coefficient) corresponding to the range on the right side of the reflection range changes toward "0."

[0047] 6B corresponds to a case where the rectangular imaging area (corresponding to the camera's angle of view range) is divided into a 16-row (R1 to R16) x 16-column (C1 to C16) grid, and the ambient brightness is acquired for each of the resulting areas. If the number of columns is other than 16, the camera's angle of view range in the horizontal direction is divided by the number of columns, and a weighting coefficient (filter coefficient) is set for each divided area in the same way.

[0048] 7 shows an example of creating a vertical filter. This vertical filter is created based on the vertical angle of view of the camera 13, the position of the user (viewer), the vertical size of the display screen of the display unit 11, the wall positions that constitute the room size information, etc. Fig. 7(a) shows the positional relationship of the vertical reflection range with respect to the vertical camera angle of view range.

[0049] The vertical camera angle of view range is set to a wall position extending in the up-down direction based on the vertical angle of view θv of the camera 13. The vertical camera angle of view range ranges from the upper end position CU to the lower end position CD. The upper end position RU of the vertical reflection range is determined to be the position where the line of sight EU from the user toward the upper end of the display screen is reflected on the display screen and reaches the wall. Furthermore, the lower end position RD of the vertical reflection range is determined to be the position where the line of sight ED from the user toward the lower end of the display screen is reflected on the display screen and reaches the wall. The vertical reflection range ranges from the upper end position RU to the lower end position RD. This determines the position of the vertical reflection range within the vertical camera angle of view range.

[0050] 7B shows an example of a vertical filter that is set based on the positional relationship between the vertical camera angle of view range and the vertical reflection range determined as described above. In this case, the vertical camera angle of view range is divided into 16 ranges, and the vertical filter has weighting coefficients (filter coefficients) V_COEF0 to V_COEF15 corresponding to each of the 16 divided ranges. In this case, for example, the weighting coefficient (filter coefficient) corresponding to the reflection range is set to "1," and the weighting coefficient (filter coefficient) corresponding to the range surrounding the reflection range approaches "0" as the distance from the reflection range increases.

[0051] In the figure, "0" indicates the center position of the vertical camera angle of view range. "U_TH0" is a threshold position corresponding to the upper end position RU of the reflection range, and indicates the boundary position where the weighting coefficient (filter coefficient) changes from "1" to a value smaller than "1." "U_TH1" indicates the upper position where the weighting coefficient (filter coefficient) is "0," and is set to an arbitrary position. The farther "U_TH1" is positioned from "U_TH0," the more gradually the weighting coefficient (filter coefficient) corresponding to the upper peripheral range of the reflection range changes toward "0."

[0052] Furthermore, "D_TH0" is a threshold position corresponding to the lower end position RD of the reflection range, and indicates the boundary position where the weighting coefficient (filter coefficient) changes from "1" to a value smaller than "1." Furthermore, "D_TH1" indicates the lower position where the weighting coefficient (filter coefficient) is "0," and is set to an arbitrary position. The farther "D_TH1" is positioned from "D_TH0," the more gradually the weighting coefficient (filter coefficient) corresponding to the range around the lower side of the reflection range changes toward "0."

[0053] 7B corresponds to a case where the rectangular imaging area (corresponding to the camera's angle of view range) is divided into a 16-row (R1 to R16) x 16-column (C1 to C16) grid, and the ambient brightness is acquired for each of the resulting areas. If the number of rows is other than 16, the camera's angle of view range in the vertical direction is divided by the number of rows, and a weighting coefficient (filter coefficient) is set for each divided area in the same way.

[0054] As described above, the weighting filter is created by creating a horizontal filter and a vertical filter and multiplying them together. FIG. 8 is a conceptual diagram showing an example of a weighting filter created by multiplying a horizontal filter and a vertical filter. This weighting filter has weighting coefficients (filter coefficients) for multiple areas, 16 rows (R1 to R16) by 16 columns (C1 to C16), similar to the ambient brightness shown in FIG. 5 above. In this case, for example, the weighting coefficient (filter coefficient) for the white area is "1," the weighting coefficient (filter coefficient) for the black area is "0," and the weighting coefficient (filter coefficient) for the gray area is a value between "1" and "0," with the closer to white the area is, the closer to "1" the value is.

[0055] Because the horizontal and vertical filters of this weighting filter are created as described above (see FIGS. 6(b) and 7(b)), the weighting coefficient (filter coefficient) of the area corresponding to the reflection range is "1," and the weighting coefficient (filter coefficient) of the area corresponding to the range surrounding the reflection range approaches "0" as the area moves away from the reflection range. In this way, by setting the weighting coefficient (filter coefficient) of the area corresponding to the reflection range to "1," and the weighting coefficient (filter coefficient) of the area corresponding to the range surrounding the reflection range approaches "0" as the area moves away from the reflection range, it is possible to obtain the reflection brightness corresponding to the actual reflection range even if the reflection range information indicates a range that deviates from the actual reflection range.

[0056] 9, the reflection brightness acquisition unit 102 multiplies the ambient brightness corresponding to each of the multiple areas of 16 rows (R1 to R16) x 16 columns (C1 to C16) acquired by the ambient brightness acquisition unit 101 by the weighting coefficients (filter coefficients) corresponding to each of the multiple areas of 16 rows (R1 to R16) x 16 columns (C1 to C16) of the weighting filter created as described above to obtain a weighted average, thereby obtaining the reflection brightness (average reflection brightness) AVE_LUMI. The following equation (1) shows the calculation formula for the reflection brightness AVE_LUMI.

[0057] Σ (environmental brightness C * R * ×Weighting coefficient C * R * ) / Σ(weighting coefficient C * R * ) = AVE_LUMI ... (1)

[0058] In the above example, the weighting coefficient (filter coefficient) of the weighting filter is set based on information about the reflection range within the camera's angle of view, which is acquired based on the position of a single user (viewer) and the size of the room. When there are multiple viewers, a weighting coefficient (filter coefficient) may be calculated for each viewer and the average may be set as the overall weighting coefficient (filter coefficient), or the weighting coefficient (filter coefficient) may be set based on the distribution range of the viewers. Alternatively, the weighting coefficient (filter coefficient) may be set based on the position of a representative viewer or the average position of the viewers. Furthermore, instead of varying the weighting coefficient (filter coefficient) of the weighting filter based on the position of the user (viewer) and the size of the room, it is also possible to use a weighting filter with a fixed weighting coefficient (filter coefficient).

[0059] Furthermore, in the above example, the weighting filter has a weighting coefficient (filter coefficient) of "1" for the area corresponding to the reflection range, and the weighting coefficient (filter coefficient) for the area corresponding to the range surrounding the reflection range approaches "0" as the area moves away from the reflection range. However, for example, if information on the reflection range can be obtained in a way that accurately indicates the actual reflection range, it is also possible to set the weighting coefficient (filter coefficient) for the area corresponding to the range surrounding the reflection range to "0."

[0060] 10 and 11 show examples of creating horizontal and vertical filters in this case. FIG. 10( a) shows the positional relationship of the horizontal reflection range with respect to the horizontal camera angle of view range, similar to FIG. 6( a) described above. FIG. 10( b) shows an example of a horizontal filter. In this case, the weighting coefficient (filter coefficient) corresponding to the reflection range is set to "1," but the weighting coefficient (filter coefficient) corresponding to the range surrounding the reflection range is set to "0," unlike the example of FIG. 6( b). FIG. 11( a) shows the positional relationship of the vertical reflection range with respect to the vertical camera angle of view range, similar to FIG. 7( a) described above. FIG. 11( b) shows an example of a vertical filter. In this case, the weighting coefficient (filter coefficient) corresponding to the reflection range is set to "1," but the weighting coefficient (filter coefficient) corresponding to the range surrounding the reflection range is set to "0," unlike the example of FIG. 7( b).

[0061] 3 , the glare-corrected illuminance acquisition unit 103 acquires the glare-corrected illuminance based on the ambient illuminance of the environment in which the television receiver 10, and therefore the display unit 11 (display screen), is placed, as acquired by the illuminance sensor 12, and the ratio of the glare brightness acquired by the above-mentioned glare brightness acquisition unit 102 to this ambient illuminance. Here, the glare-corrected illuminance constitutes the amount of glare correction. The glare-corrected illuminance acquisition unit 103 acquires the glare-corrected illuminance, for example, by referring to a table (lookup table) that stores the correspondence between each combination of ambient illuminance and ratio and the glare-corrected illuminance.

[0062] Fig. 12 shows an example of a table (lookup table). In this case, the higher the ambient illuminance and the higher the ratio, the higher the illuminance indicated by the glare-corrected illuminance. Note that the glare-corrected illuminance corresponding to each value of ambient illuminance and ratio is not limited to the example shown in the table of Fig. 12, and other values ​​may be set. Furthermore, rather than obtaining the glare-corrected illuminance by referring to a table, it is also possible to obtain it using a calculation formula that uses the ambient illuminance and ratio as parameters, for example.

[0063] It is also possible for the glare-corrected illuminance acquisition unit 103 to acquire the glare-corrected illuminance based on the ambient illuminance of the environment in which the television receiver 10, and therefore the display unit 11 (display screen), is placed, as acquired by the illuminance sensor 12, and the glare brightness acquired by the glare brightness acquisition unit 102. In this case, the glare-corrected illuminance acquisition unit 103 acquires the glare-corrected illuminance, for example, by referring to a table that stores the correspondence between each combination of ambient illuminance and glare brightness and the glare-corrected illuminance. Although not shown, this table is similar to the table shown in FIG. 12 , except that the axis representing the ratio [%] of the glare brightness to the ambient illuminance is changed to the glare brightness. In this case, it is also possible to acquire the glare-corrected illuminance using a calculation formula that uses the ambient illuminance and the glare brightness as parameters, rather than by referring to a table. The above example illustrates the case in which the ambient illuminance is acquired by the illuminance sensor 12. However, if the environmental brightness that can be acquired by the environmental brightness acquisition unit 101 is correlated with the environmental illuminance, it is also possible to treat the environmental brightness acquired by the camera 13, rather than the illuminance sensor 12, as information equivalent to the environmental illuminance.

[0064] 3, the tone curve setting unit 104 sets a tone curve for raising the low gradation side in display luminance correction, based on the glare correction illuminance acquired by the glare correction illuminance acquisition unit 103 and the environmental illuminance acquired by the illuminance sensor 12. In this case, the tone curve is set in accordance with the on / off settings of the glare correction and illuminance correction performed by the user operating the user operation unit 16.

[0065] FIG. 13 shows an example of the correspondence between the on / off settings of glare correction and illuminance correction and the display luminance correction content. When glare correction is on and illuminance correction is on, display luminance correction is performed using the sum of the ambient illuminance and the glare correction illuminance. In this case, the tone curve setting unit 104 sets a tone curve based on the sum of the ambient illuminance and the glare correction illuminance. On the other hand, when glare correction is on and illuminance correction is off, display luminance correction is performed using the glare correction illuminance. In this case, the tone curve setting unit 104 sets a tone curve based on the value of the glare correction illuminance.

[0066] Furthermore, when glare correction is off and illuminance correction is on, display luminance correction is performed based on the ambient illuminance. In this case, the tone curve setting unit 104 sets a tone curve based on the ambient illuminance value. Furthermore, when glare correction is off and illuminance correction is off, display luminance correction is not performed. In this case, the tone curve setting unit 104 sets a y=x curve as the tone curve so that display luminance correction is not performed.

[0067] FIG. 14 shows an example of a tone curve set based on the on / off settings of glare correction and illuminance correction. The illustrated example shows a case where the ambient illuminance is 150 lx and the glare correction illuminance is 50 lx. FIG. 14( a) shows a tone curve (a tone curve for 150 lx) set by the tone curve setting unit 104 when glare correction is off and illuminance correction is on, indicated by a solid line TC1. FIG. 14( b) shows a tone curve (a tone curve for 200 lx) set by the tone curve setting unit 104 when glare correction is on and illuminance correction is on, indicated by a solid line TC2. In this case, the display luminance on the low gradation side is further increased by the amount of the glare correction illuminance, compared to a tone curve set based only on the ambient illuminance.

[0068] Returning to Figure 3, the display brightness correction unit 105 performs brightness correction processing on the image signal supplied from the image input unit 14 based on the tone curve set by the tone curve setting unit 104 so that the display brightness on the low gradation side is raised, and sends the processed image signal to the display unit 11.

[0069] Although not mentioned above, when the glare correction is set to off, the tone curve setting unit 104 does not need information on the glare correction illuminance, so the processing of the ambient brightness acquisition unit 101, the glare brightness acquisition unit 102, and the glare correction illuminance acquisition unit 103 does not need to be performed.

[0070] 1-3-2. Example of Processing Procedure of Image Control Unit The flowchart in FIG. 15 shows an example of processing procedure of the image control unit 15.

[0071] Image control unit 15 starts processing in step ST1. Next, image control unit 15 determines whether or not reflection correction is on in step ST2. If reflection correction is set to on, image control unit 15 acquires the environmental brightness in front of the display screen in step ST3 using ambient brightness acquisition unit 101 based on the output signal of camera 13, i.e., the output signal of the image sensor. In this case, ambient brightness corresponding to each of multiple areas obtained by dividing the captured rectangular area into a grid is acquired based on the output signal of camera 13 capturing an image of the front of the display screen.

[0072] Next, in step ST4, image control unit 15 acquires the reflection brightness (average reflection brightness) in reflection brightness acquisition unit 102 based on the environmental brightness acquired by environmental brightness acquisition unit 101 and information on the reflection range of the environment in front of the display screen. In this case, the reflection brightness is acquired by extracting and averaging the environmental brightness of the area included in the reflection range within the environment from the environmental brightness corresponding to each area obtained by dividing the captured rectangular area into a grid.

[0073] Next, in step ST5, the image control unit 15 causes the glare correction illuminance acquisition unit 103 to acquire the glare correction illuminance in accordance with the ambient illuminance of the environment in which the television receiver 10, and therefore the display unit 11 (display screen), is placed, acquired by the illuminance sensor 12, and the ratio of the glare brightness acquired by the above-mentioned glare brightness acquisition unit 102 to this ambient illuminance. In this case, the glare correction illuminance is acquired, for example, by referring to a table (see FIG. 12 ) that stores the correspondence between each combination of ambient illuminance and ratio and the glare correction illuminance.

[0074] After processing step ST5, image control unit 15 proceeds to processing step ST6. If glare correction is set to off in step ST2 described above, image control unit 15 immediately proceeds to processing step ST6. In step ST6, image control unit 15 sets a tone curve for raising the low gradation side in display luminance correction using tone curve setting unit 104, based on the glare correction illuminance acquired by glare correction illuminance acquisition unit 103 and the ambient illuminance acquired by illuminance sensor 12. In this case, the tone curve is set according to the on / off settings of glare correction and illuminance correction.

[0075] 16 shows an example of the tone curve setting process in step ST6. The image control unit 15 starts the process (tone curve setting process) in step ST11. Next, the image control unit 15 determines whether or not the reflection correction is on in step ST12.

[0076] If the glare correction is set to ON, the image control unit 15 determines in step ST13 whether the illuminance correction is ON. If the illuminance correction is set to ON, the image control unit 15 sets a tone curve (see FIG. 14B) adjusted by the sum of the ambient illuminance and the glare correction illuminance in step ST14. Thereafter, the image control unit 15 ends the process (tone curve setting process) in step ST15.

[0077] If the illuminance correction is set to OFF in step ST13, the image control unit 15 sets the tone curve adjusted with the value of the glare correction illuminance in step ST16. After that, the image control unit 15 ends the process (tone curve setting process) in step ST15.

[0078] Furthermore, if glare correction is set to OFF in step ST12, the image control unit 15 determines whether illuminance correction is ON in step ST17. If illuminance correction is set to ON, the image control unit 15 sets a tone curve (see FIG. 14A) adjusted based on the ambient illuminance value in step ST18. Thereafter, the image control unit 15 ends the process (tone curve setting process) in step ST15.

[0079] If the illuminance correction is set to OFF in step ST17, the image control unit 15 sets the tone curve (y=x) without luminance correction in step ST19. After that, the image control unit 15 ends the process (tone curve setting process) in step ST15.

[0080] Returning to FIG. 15 , after processing step ST6, in step ST7, the image control unit 15 causes the display brightness correction unit 105 to perform brightness correction processing on the image signal supplied from the image input unit 14 based on the tone curve set by the tone curve setting unit 104 so that the display brightness on the low gradation side is raised.

[0081] In the television receiver 10, the image control unit 15 does not necessarily have to perform the processes of steps ST3 to ST5 shown in the flowchart of FIG. 15 every time. That is, while the image quality correction process is performed continuously, the processes of steps ST3 to ST5 may be performed, for example, when the power is turned on, and thereafter may be performed every time a certain period of time has elapsed, every time the user (viewer) position changes to or exceeds a threshold value, every time the environmental illuminance changes to or exceeds a threshold value, every time the user (viewer) turns on / off the glare correction or illuminance correction, or when the user instructs to perform the process. Alternatively, among the processes of steps ST3 to ST5, step ST3 may be performed frequently, and steps ST4 and ST5 may be performed every time the acquired environmental brightness changes to or exceeds a threshold value. When the processes of steps ST6 and ST7 are performed in conjunction with updating the displayed image when steps ST3 to ST5 are not being performed, the processes of steps ST6 and ST7 are performed using the glare correction illuminance acquired during the previous process of step ST5. For example, power consumption can be reduced by having the camera 13 capture an image when the environmental illuminance acquired by the illuminance sensor 12 changes significantly.

[0082] "1-4. Processing by Software" The processing in the image control unit 15 described above can be performed by hardware, but can also be performed by software. When a series of processes is performed by software, the programs that make up the software are installed from a recording medium into a computer that is built into dedicated hardware, or into, for example, a general-purpose computer that can perform various functions by installing various programs.

[0083] 17 is a block diagram showing an example of the hardware configuration of a computer 600. The computer 600 has a CPU 601, a ROM 602, a RAM 603, a bus 604, an input / output interface 605, an input unit 606, an output unit 607, a storage unit 608, a drive 609, a connection port 610, and a communication unit 611. Note that the hardware configuration shown here is an example, and some of the components may be omitted. Furthermore, the computer 600 may further include components other than those shown here.

[0084] The CPU 601 functions as, for example, an arithmetic processing device or a control device, and controls the overall operation or part of the operation of each component based on various programs recorded in the ROM 602 , the RAM 603 , the storage unit 608 , or the removable recording medium 701 .

[0085] The ROM 602 is a means for storing programs to be read into the CPU 601, data to be used for calculations, etc. The RAM 603 temporarily or permanently stores, for example, the programs to be read into the CPU 601 and various parameters that change as appropriate when the programs are executed.

[0086] The CPU 601, ROM 602, and RAM 603 are connected to one another via a bus 604. On the other hand, various components are connected to the bus 604 via an input / output interface 605.

[0087] The input unit 606 may be, for example, a mouse, a keyboard, a touch panel, a button, a switch, a lever, etc. Furthermore, the input unit 606 may also be a remote controller (hereinafter referred to as a remote control) that is capable of transmitting control signals using infrared rays or other radio waves.

[0088] The output unit 607 is a device capable of visually or audibly notifying the user of acquired information, such as a display device such as a CRT (Cathode Ray Tube), LCD, or organic EL, an audio output device such as a speaker or headphones, a printer, a mobile phone, or a facsimile.

[0089] The storage unit 608 is a device for storing various types of data. For example, the storage unit 608 may be a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device.

[0090] The drive 609 is a device that reads information recorded on a removable recording medium 701 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, or writes information to the removable recording medium 701 .

[0091] The removable recording medium 701 is, for example, a DVD, a Blu-ray (registered trademark) disc, an HD DVD, various semiconductor storage media, etc. Of course, the removable recording medium 701 may also be, for example, an IC card equipped with a contactless IC chip, an electronic device, etc.

[0092] The connection port 610 is a port for connecting an external device 502, such as a Universal Serial Bus (USB) port, a High-Definition Multimedia Interface (HDMI) port, an IEEE 1394 port, a Small Computer System Interface (SCSI), an RS-232C port, or an optical audio terminal. The external device 702 is, for example, a printer, a portable music player, a digital camera, a digital video camera, or an IC recorder.

[0093] The communication unit 611 is a communication device for connecting to the network 703, such as a communication card for wired or wireless LAN, Bluetooth (registered trademark), or WUSB (Wireless USB), a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various types of communication.

[0094] The program executed by the computer may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.

[0095] As explained above, the image control unit 15 of the television receiver 10 shown in Figure 3 can obtain the reflection brightness based on the environmental brightness in the environment in front of the display screen and information about the range of the environment in front of the display screen that is reflected on the display screen, and can perform brightness correction processing on the image signal for displaying an image on the display screen based on this reflection brightness, making it possible to reduce the difficulty in seeing the displayed image due to the reflection of the environment on the display screen.

[0096] 2. Modifications In the above-described embodiment, an example has been shown in which the ambient brightness acquisition unit 101 of the image control unit 15 acquires the ambient brightness corresponding to each of a plurality of areas obtained by dividing a rectangular area (image capture rectangular area) including the environment in front of the display screen into a grid pattern, based on the output signal of the camera 13. However, it is also conceivable to similarly acquire the ambient brightness corresponding to each of the plurality of areas based on the output signal of a directional brightness sensor, rather than based on the output signal of the camera 13.

[0097] In addition, in the above-described embodiment, an example was shown in which the reflection brightness acquisition unit 102 acquires the reflection brightness by extracting and averaging the environmental brightness of the area included in the reflection range within the environment from the environmental brightness corresponding to each of multiple areas obtained by dividing a rectangular area (image capture rectangular area) including the environment in front of the display screen into a grid pattern.

[0098] However, it is conceivable to identify the reflection range within the environment from the viewing environment (user position, room size, etc.) (see FIGS. 6( a) and 7(a)), and then set the orientation of camera 13 and the imaging angle of view (direction of the directional brightness sensor) so that the rectangular area (imaged rectangular area) is included in the reflection range within the environment. In this case, ambient brightness acquisition unit 101 can acquire only the ambient brightness corresponding to each of the multiple areas included in the reflection range within the environment, and reflection brightness acquisition unit 102 can acquire the reflection brightness by averaging the ambient brightness corresponding to each of the multiple areas acquired by ambient brightness acquisition unit 101. In other words, in this case, the process of extracting the ambient brightness of the area included in the reflection range within the environment (filtering process) is not necessary.

[0099] Furthermore, in the above-described embodiment, an example was shown in which the ambient brightness acquisition unit 101 acquires the ambient brightness corresponding to each of a plurality of areas obtained by dividing a rectangular area (image capture rectangular area) including the environment in front of the display screen into a grid pattern, and the reflection brightness acquisition unit 102 averages the ambient brightness corresponding to each of the plurality of areas to acquire the reflection brightness (average reflection brightness), and performs brightness correction processing on the image signal based on this reflection brightness, i.e., display brightness correction is performed on the entire screen.

[0100] However, it is also conceivable that the reflection brightness acquisition unit 102 acquires the environmental brightness of each area included in the reflection range within the environment as the reflection brightness from the environmental brightness corresponding to each of the multiple areas obtained by dividing the rectangular area (image capture rectangular area) including the environment in front of the display screen acquired by the environmental brightness acquisition unit 101 into a grid, and performs luminance correction processing for each area on the image signal based on the environmental brightness of each area included in the reflection range within the environment to locally correct the luminance of the image displayed on the display screen. In this case, it is possible to effectively reduce the reflection of the environment from each area in the reflection range onto the display screen by optimizing the amount of luminance correction for each area.

[0101] In the above-described embodiment, an example has been shown in which the tone curve setting unit 104 sets a tone curve based on the glare correction illuminance acquired by the glare correction illuminance acquisition unit 103, and the display luminance correction unit 105 performs luminance correction processing based on the tone curve so as to raise the display luminance on the low gradation side. However, it is also possible to configure the system so that the overall luminance of the image displayed on the display screen is raised based on the glare correction illuminance. In the above-described embodiment, an example has been shown in which the glare correction amount is illuminance, but the glare correction amount is not limited to illuminance.

[0102] In the above-described embodiment, an example has been shown in which display brightness correction unit 105 performs brightness correction processing on an image signal for displaying an image on a display screen, based on the reflection brightness acquired by reflection brightness acquisition unit 102. Display brightness correction unit 105 may further change the amount of brightness correction for the image signal depending on the brightness of the image displayed on the display screen, for example, APL (Average Picture Level). For example, when the image displayed on the display screen is bright, the difficulty in seeing the displayed image due to reflection is originally small, and the amount of brightness correction may be small.

[0103] Furthermore, in the above-described embodiment, an example has been shown in which display brightness correction unit 105 performs brightness correction processing on an image signal for displaying an image on a display screen, based on the reflection brightness acquired by reflection brightness acquisition unit 102. Display brightness correction unit 105 may further change the amount of brightness correction for the image signal depending on whether or not the image signal contains a signal on the high gradation side. As a result, when the image signal contains a signal on the high gradation side, the amount of brightness correction is reduced, making it possible to prevent gradation collapse (whiteout) on the high gradation side.

[0104] Furthermore, in the above-described embodiment, an example has been shown in which display brightness correction unit 105 performs brightness correction processing on an image signal for displaying an image on the display screen, based on the reflection brightness acquired by reflection brightness acquisition unit 102. Display brightness correction unit 105 may further change the amount of brightness correction for the image signal depending on whether or not a human face is included in the image displayed on the display screen. As a result, when a human face is included in the image displayed on the display screen, the amount of brightness correction is reduced in consideration of the high sensitivity to gradation for human faces, making it possible to prevent excessive differences in brightness and darkness in the human face, which could lead to an unnatural appearance.

[0105] In addition, in the above-described embodiment, an example was described in which the environmental brightness in the environment in front of the display screen is obtained from the output signal of camera 13, and the reflection brightness is obtained based on this environmental brightness and information on the range of the environment in front of the display screen that is reflected on the display screen, and brightness correction processing is performed on the image signal for displaying an image on the display screen based on this reflection brightness, thereby reducing the difficulty in seeing the displayed image due to reflection on the display screen.

[0106] However, it is also possible to reduce the difficulty in viewing a displayed image due to the reflection of the environment on the display screen by performing color correction processing on the image signal for displaying the image on the display screen. For example, if a red environment is reflected on the display screen, color correction processing may be performed to increase the saturation of red in the displayed image.

[0107] In this case, color information of the environment in front of the display screen is obtained from the output signal of the camera 13, and reflection color information is obtained based on this color information and information on the range of the environment in front of the display screen that is reflected on the display screen, and color correction processing is performed on the image signal for displaying an image on the display screen based on this reflection color information.As a result, for example, the greater the saturation of a specific color in the range of reflection in the environment in front of the display screen, the greater the amount of saturation correction for that specific color, making it possible to reduce the difficulty in seeing the displayed image due to the environment of that specific color being reflected on the display screen.

[0108] Furthermore, while the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0109] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that will be apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects.

[0110] The present technology may also be configured as follows: (1) An information processing device including: an environmental feature acquisition unit that acquires environmental feature amounts in an environment in front of a display screen; a reflection feature acquisition unit that acquires reflection feature amounts based on the environmental feature amounts and information on a range of reflections on the display screen from the environment in front of the display screen; and an image quality correction processing unit that performs image quality correction processing on an image signal for displaying an image on the display screen based on the reflection feature amounts. (2) The information processing device described in (1), in which the environmental feature acquisition unit acquires environmental feature amounts corresponding to each of a plurality of areas obtained by dividing a rectangular area including the environment in front of the display screen. (3) The information processing device described in (2), in which the environmental feature acquisition unit acquires environmental feature amounts corresponding to each of the plurality of areas based on a camera output signal. (4) The information processing device described in (2), in which the environmental feature acquisition unit acquires environmental feature amounts corresponding to each of the plurality of areas based on an output signal from a directional image quality sensor. (5) The information processing device described in any of (2) to (4), wherein the reflection feature acquisition unit acquires the reflection feature by extracting environmental feature values ​​of areas included in the reflection range from environmental feature values ​​corresponding to the plurality of areas and averaging them. (6) The information processing device described in (5), wherein the reflection feature acquisition unit acquires the reflection feature values ​​by multiplying the environmental feature values ​​corresponding to the plurality of areas by weighting coefficients set based on information about the reflection range and performing weighted averaging. (7) The information processing device described in (6), wherein the weighting coefficients by which the environmental feature values ​​corresponding to the plurality of areas are multiplied are set to "1" in areas corresponding to the reflection range, and approach "0" in areas corresponding to ranges surrounding the reflection range as they move away from the reflection range. (8) The information processing device described in (6), wherein the weighting coefficient multiplied by the environmental feature corresponding to each of the plurality of areas is set to "1" in the area corresponding to the reflection range and to "0" in the area corresponding to the range surrounding the reflection range.(9) The information processing device according to (2), wherein the rectangular area is included in the reflection range, and the reflection feature acquisition unit acquires the reflection feature by averaging environmental feature amounts corresponding to each of the multiple areas. (10) The information processing device according to any of (1) to (9), wherein the reflection feature acquisition unit calculates the information on the reflection range based on information on a user's position and a room size. (11) The information processing device according to (10), wherein the reflection feature acquisition unit acquires the information on the user's position and the room size based on a camera output signal. (12) The information processing device according to (10), wherein the reflection feature acquisition unit acquires the information on the user's position and the room size based on a ranging sensor output signal. (13) The information processing device according to any one of (1) to (12), wherein the image quality correction processing unit acquires glare-corrected image quality according to an environmental feature of an environment in which the display screen is placed and a ratio of the glare feature to the environmental feature, or according to an environmental feature of the environment in which the display screen is placed and the glare feature, and performs image quality correction processing on an image signal for displaying an image on the display screen based on the glare-corrected image quality. (14) The information processing device according to (13), wherein the image quality correction processing unit acquires the glare-corrected image quality by referring to a table storing a correspondence relationship between the environmental feature and the ratio, or between the environmental feature and the glare-corrected image quality and the glare-corrected image quality. (15) The information processing device according to any one of (1) to (14), wherein the environmental feature acquisition unit acquires brightness of the environment in front of the display screen, the glare feature acquisition unit acquires reflection brightness, and the image quality correction processing unit performs brightness correction processing on the image signal based on the reflection brightness. (16) The information processing device described in (15), wherein the image quality correction processing unit acquires a reflection correction amount according to the ambient illuminance of the environment in which the display screen is placed and the ratio of the reflection brightness to the ambient illuminance, or the ambient illuminance of the environment in which the display screen is placed and the reflection brightness, and performs brightness correction processing on the image signal based on the reflection correction amount.(17) The information processing device according to (16), wherein the image quality correction processing unit sets a tone curve for luminance correction based on the amount of glare correction and performs luminance correction processing so as to raise luminance on the low gradation side. (18) The information processing device according to any of (15) to (17), wherein the image quality correction processing unit changes the amount of luminance correction for the image signal based on the glare brightness in accordance with the brightness of the image displayed on the display screen. (19) The information processing device according to any of (15) to (17), wherein the image quality correction processing unit changes the amount of luminance correction for the image signal based on the glare brightness in accordance with whether or not the image signal includes a signal on the high gradation side. (20) The information processing device according to any of (15) to (17), wherein the image quality correction processing unit changes the amount of luminance correction for the image signal based on the glare brightness in accordance with whether or not the image displayed on the display screen includes a human face. (21) The information processing device according to any one of (1) to (14), wherein the environmental feature acquisition unit acquires color information of the environment in front of the display screen, the reflection feature acquisition unit acquires reflection color information, and the image quality correction processing unit performs color correction processing on the image signal based on the reflection color information. (22) The information processing device according to (2), wherein the reflection feature acquisition unit acquires environmental feature amounts of each area included in the reflection range as the reflection feature amounts from environmental feature amounts corresponding to the plurality of areas, and the image quality correction processing unit performs image quality correction processing on the image signal based on the environmental feature amounts of each area included in the reflection range, to locally correct the image quality of the image displayed on the display screen. (23) An information processing method comprising: a step of acquiring environmental features in an environment in front of a display screen; a step of acquiring reflection features based on the environmental features and information on a range of reflections in the environment in front of the display screen on the display screen; and a step of performing image quality correction processing on an image signal for displaying an image on the display screen based on the reflection features.(24) A program for causing a computer to execute an information processing method, the program comprising: a step of acquiring environmental features in the environment in front of a display screen; a step of acquiring reflection features based on the environmental features and information on the range of reflection on the display screen in the environment in front of the display screen; and a step of performing image quality correction processing on an image signal for displaying an image on the display screen based on the reflection features.

[0111] DESCRIPTION OF SYMBOLS 10: Television receiver 11: Display unit 12: Illuminance sensor 13: Camera 14: Image input unit 15: Image control unit 16: User operation unit 101: Ambient brightness acquisition unit 102: Reflection brightness acquisition unit 103: Reflection correction illuminance acquisition unit 104: Tone curve setting unit 105: Display brightness correction unit

Claims

1. An information processing device comprising: an environmental feature acquisition unit that acquires environmental features of the environment in front of a display screen; a reflection feature acquisition unit that acquires reflection features based on the environmental features and information on the range of reflections on the display screen from the environment in front of the display screen; and an image quality correction processing unit that performs image quality correction processing on an image signal for displaying an image on the display screen based on the reflection features.

2. The information processing device according to claim 1, wherein the environmental feature acquisition unit acquires environmental feature values ​​corresponding to each of a plurality of areas obtained by dividing a rectangular area including the environment in front of the display screen.

3. The information processing device according to claim 2, wherein the reflection feature acquisition unit acquires the reflection feature by extracting and averaging the environmental feature of the area included in the reflection range from the environmental feature corresponding to each of the plurality of areas.

4. The information processing device according to claim 3, wherein the reflection feature acquisition unit acquires the reflection feature by multiplying the environmental feature corresponding to each of the plurality of areas by a weighting coefficient set based on the information on the reflection range and performing weighted averaging.

5. The information processing device according to claim 4, wherein the weighting coefficients multiplied by the environmental features corresponding to the plurality of areas are set to "1" in the area corresponding to the reflection range, and approach "0" in the areas corresponding to the range surrounding the reflection range as they move away from the reflection range.

6. An information processing device as described in claim 4, wherein the weighting coefficients multiplied by the environmental features corresponding to the plurality of areas are set to "1" in the area corresponding to the reflection range and to "0" in the area corresponding to the range surrounding the reflection range.

7. The information processing device according to claim 2, wherein the rectangular area is included in the reflection range, and the reflection feature acquisition unit acquires the reflection feature by averaging the environmental feature corresponding to each of the multiple areas.

8. The information processing device according to claim 1, wherein the reflection feature acquisition unit calculates the reflection range information based on the user's position and information about the size of the room.

9. The information processing device according to claim 1, wherein the image quality correction processing unit obtains a reflection-corrected image quality according to an environmental feature of the environment in which the display screen is placed and the ratio of the reflection feature to the environmental feature, or according to the environmental feature of the environment in which the display screen is placed and the reflection feature, and performs image quality correction processing on an image signal for displaying an image on the display screen based on the reflection-corrected image quality.

10. The information processing device according to claim 9, wherein the image quality correction processing unit obtains the glare-corrected image quality by referring to a table storing the correspondence between the environmental feature and the ratio, or the environmental feature and the glare feature, and the glare-corrected image quality.

11. The information processing device according to claim 1, wherein the environmental feature acquisition unit acquires the brightness of the environment in front of the display screen, the reflection feature acquisition unit acquires reflection brightness, and the image quality correction processing unit performs brightness correction processing on the image signal based on the reflection brightness.

12. The information processing device according to claim 11, wherein the image quality correction processing unit obtains a reflection correction amount according to the ambient illuminance of the environment in which the display screen is placed and the ratio of the reflection brightness to the ambient illuminance, or the ambient illuminance of the environment in which the display screen is placed and the reflection brightness, and performs brightness correction processing on the image signal based on the reflection correction amount.

13. The information processing device according to claim 12, wherein the image quality correction processing section sets a tone curve for performing luminance correction based on the amount of glare correction, and performs luminance correction processing so as to raise the luminance on the low gradation side.

14. The information processing device according to claim 11, wherein the image quality correction processing section changes the amount of luminance correction for the image signal based on the reflection brightness in accordance with the brightness of the image displayed on the display screen.

15. The information processing device according to claim 11, wherein the image quality correction processing section changes the amount of luminance correction for the image signal based on the reflection brightness, depending on whether or not the image signal contains a signal on the high gradation side.

16. The information processing device according to claim 11, wherein the image quality correction processing unit changes the amount of luminance correction for the image signal based on the reflection brightness depending on whether or not a human face is included in the image displayed on the display screen.

17. An information processing device as described in claim 1, wherein the environmental feature acquisition unit acquires color information of the environment in front of the display screen, the reflection feature acquisition unit acquires reflection color information, and the image quality correction processing unit performs color correction processing on the image signal based on the reflection color information.

18. The information processing device described in claim 2, wherein the reflection feature acquisition unit acquires the environmental feature of each area included in the reflection range as the reflection feature from the environmental feature corresponding to each of the multiple areas, and the image quality correction processing unit performs image quality correction processing on the image signal based on the environmental feature of each area included in the reflection range, thereby locally correcting the image quality of the image displayed on the display screen.

19. An information processing method comprising: a step of acquiring environmental features in the environment in front of a display screen; a step of acquiring reflection features based on the environmental features and information on the range of reflections on the display screen from the environment in front of the display screen; and a step of performing image quality correction processing on an image signal for displaying an image on the display screen based on the reflection features.

20. A program for causing a computer to execute an information processing method, the method comprising: a step of acquiring environmental features in the environment in front of a display screen; a step of acquiring reflection features based on the environmental features and information on the range of reflection on the display screen from the environment in front of the display screen; and a step of performing image quality correction processing on an image signal for displaying an image on the display screen based on the reflection features.

Citation Information

Patent Citations

  • Image display system and image displaying method

    JP2007180979A

  • Display control device, image display system, and display control method

    JP2012198464A

  • Display device

    JP2015194567A

  • Display device

    WO2014027569A1