Display device, method for controlling display device, program, and recording medium
Patent Information
- Application Number
- JP2025065816
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-19
- Filing Date
- 2025-04-11
- Publication Date
- 2026-01-07
Smart Images

Figure 2026001691000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a display device and the like. [Background technology]
[0002] For example, as disclosed in Patent Document 1, an image processing device is known that can generate an image in which fluctuations in luminance or saturation are suppressed for an image that may induce photosensitive attacks. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication No. 2015 / 107880 Summary of the Invention [Problem to be solved by the invention]
[0004] An object of the present disclosure is to provide a display device or the like that allows a user to view video in optimal conditions regardless of brightness, for example. [Means for solving the problem]
[0005] The display device of the present disclosure includes a display unit, an acquisition unit that acquires external factors, and a control unit that displays an image on the display unit by suppressing the fluctuation range of brightness or saturation in accordance with an input signal based on the acquired external factors.
[0006] The control method for a display device of the present disclosure includes a display step, an acquisition step of acquiring external factors, and a control step of displaying an image by suppressing the fluctuation range of brightness or saturation of the display step in accordance with an input signal based on the acquired external factors.
[0007] The program disclosed herein implements in a computer a display means, an acquisition means for acquiring external factors, and a control means for displaying an image by suppressing the fluctuation range of the brightness or saturation of the display means in accordance with an input signal based on the acquired external factors. [Effects of the Invention]
[0008] According to the present disclosure, it is possible to provide, for example, a display device or the like that allows a user to view video in optimal conditions regardless of brightness. [Brief explanation of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram illustrating an overview of a display device according to a first embodiment. [Figure 2] FIG. 2 is a diagram illustrating the hardware configuration of the display device according to the first embodiment. [Figure 3] FIG. 2 is a diagram illustrating the configuration of a broadcast control unit in the first embodiment. [Figure 4] FIG. 2 is a diagram illustrating a software configuration according to the first embodiment. [Figure 5] 3A and 3B are diagrams illustrating an example of system setting information and an example of fluctuation range information, respectively, in the first embodiment. [Figure 6] FIG. 2 is a diagram illustrating a processing flow in the first embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of operation in the first embodiment. [Figure 8] FIG. 2 is a diagram illustrating an example of operation in the first embodiment. [Figure 9] FIG. 10 is a diagram illustrating a processing flow in the second embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of operation in the second embodiment. [Figure 11] FIG. 10 is a diagram illustrating an example of operation in the second embodiment. [Figure 12] FIG. 10 is a diagram for explaining an outline of a system according to a third embodiment. [Figure 13]FIG. 10 is a diagram illustrating a software configuration according to a third embodiment. [Figure 14] FIG. 11 is a diagram illustrating an example of illuminance information in the third embodiment. [Figure 15] FIG. 10 is a diagram illustrating a processing flow in the third embodiment. [Figure 16] FIG. 10 is a diagram illustrating an example of operation in the third embodiment. [Figure 17] FIG. 10 is a diagram for explaining a software configuration in a fourth embodiment. [Figure 18] FIG. 13 is a diagram illustrating an example of genre restriction information in the fourth embodiment. [Figure 19] FIG. 10 is a diagram illustrating a processing flow in the fourth embodiment. [Figure 20] FIG. 10 is a diagram illustrating an example of operation in the fourth embodiment. [Figure 21] FIG. 10 is a diagram illustrating the hardware configuration of a display device according to a fifth embodiment. [Figure 22] FIG. 13 is a diagram illustrating a processing flow in the fifth embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0010] 2. Description of the Related Art Display devices are generally known that are capable of displaying content such as programs received as broadcast waves, videos recorded on a recording medium, and videos distributed on video distribution sites as video.
[0011] When a user watches an image, for example, an image displayed on a display device, some images can have adverse effects on the body. For example, when a user watches an image with large fluctuations in brightness or saturation, such as strong flickering or drastic changes in color intensity, some users may experience physical abnormalities such as dizziness, convulsions, or loss of consciousness.
[0012] Here, as an example of an image that does not cause body aberrations, a method in which a display device generates an image with reduced saturation fluctuations is known. However, the frequency with which body aberrations, such as photosensitive seizures, are induced varies not only depending on the fluctuation range of the image's brightness and saturation, but also on external factors such as the ambient brightness and the distance between the display device and the user viewing the image. Therefore, even if a display device processes only the input image information, there are problems such as being unable to suppress body aberrations caused by external factors other than the image itself, or excessive image processing resulting in undesirable image quality.
[0013] A display device that solves these problems will be described below in the following embodiments with reference to the drawings. Note that the following embodiments are merely examples of the invention described in the claims, and the technical scope of the present disclosure is not limited to the description of the following embodiments.
[0014] [1. First embodiment] A first embodiment will be described below. Note that the first embodiment will be described using the following as an example. In the following embodiment, a display device according to the present disclosure will be described.
[0015] [1.1 Overall structure] 1 is a diagram illustrating an overview of a display device 10. The display device 10 is a device capable of displaying content, and may be, for example, a television capable of receiving broadcast waves and displaying programs, or a monitor connected to a network (NW) and capable of displaying video content from a video distribution site or the like. Alternatively, the display device 10 may be a projector that projects a display screen onto a screen.
[0016] Here, the content may be anything that can be displayed by the display device 10. For example, the content may be a program received from terrestrial / BS / CS broadcasting, demodulated, and displayed, a video selected by a user on a video distribution site, or a video input from an external device via HDMI (registered trademark) (High-Definition Multimedia Interface) or USB (Universal Serial Bus), etc.
[0017] Furthermore, the network (NW) connecting the display device 10 may be any type of communication line or communication system, such as a wired or wireless LAN (Local Area Network), VLAN (Virtual Local Area Network), the Internet, a public line network, mobile communications (e.g., mobile communications such as 4G / 5G / 6G), or a next-generation telephone network.
[0018] Furthermore, the display device 10 has a device for acquiring external factors of the environment in which the display device 10 is installed. In this embodiment, the external factors include the surroundings of the display device 10 and / or the user viewing the content, for example, the distance between the user and the display device 10. The external factors may also include, for example, the brightness of the environment in which the user is viewing.
[0019] Here, the external factors refer to factors in the display device 10 and / or the user's surroundings that affect the user's viewing of content. Examples of external factors include the distance between the user and the display device 10, the brightness of the environment in which the user views content, and the color temperature of the lighting in the environment in which the user views content.
[0020] The display device 10 has, for example, a camera 12 as a device for acquiring external factors. Here, one or more cameras 12 may be provided. Furthermore, instead of the camera 12, the display device 10 may have, for example, a human presence sensor, a depth sensor, a distance sensor, an illuminance sensor, etc.
[0021] [1.2 Hardware Configuration] The hardware configuration will be described below with reference to Fig. 2. Fig. 2 is a diagram showing an example of a display device 10.
[0022] The display device 10 has a control unit 100, a storage unit (memory device) including storage 110, ROM (Read Only Memory) 120, and RAM (Random Access Memory) 130, an operation control unit 102, a broadcast control unit 140, a display unit 150, an audio output unit 160, a communication unit 170, and a shooting unit 180.
[0023] The control unit 100 controls the entire display device 10. The control unit 100 realizes various functions by reading and executing various programs stored in a memory unit (for example, a storage 110 or a ROM 120). The control unit 100 may be realized by one or more control devices / arithmetic units (CPUs (Central Processing Units), SoCs (System on a Chip)). The control unit 100 may also be configured by one or more control circuits.
[0024] The operation control unit 102 receives an operation from the user and provides operation instructions to each functional unit. For example, the operation control unit 102 may notify the user of an operation signal corresponding to the operation received by the control unit 100. The operation control unit 102 may be, for example, a unit receiving an operation signal from a remote control, or may be an operation switch provided on the display device 10.
[0025] The storage 110 is a non-volatile storage device capable of storing programs and data. For example, the storage 110 may be configured as one or more storage devices such as an HDD or an SSD. The storage 110 may also be configured as an external device such as a USB memory or a portable HDD that can be connected to the display device 10. The storage 110 may also be a storage area on the cloud, for example.
[0026] The ROM 120 is a non-volatile memory that can retain programs and data even when the power is turned off.
[0027] The RAM 130 is a main memory that is mainly used when the control unit 100 executes processing. The RAM 130 is a rewritable memory that temporarily stores programs read from the storage 110 or the ROM 120, and data including execution results.
[0028] The broadcast control unit 140 receives broadcast waves transmitted by a broadcast station selected by the user, decodes video data from the broadcast waves, and outputs the video signal to the display unit 150, and decodes audio data from the broadcast waves and outputs the audio signal to the audio output unit 160. The broadcast control unit 140 may have a configuration including, for example, a digital tuner unit (terrestrial / BS / CS, etc.), an OFDM (orthogonal frequency-division multiplexing) demodulation unit, a separation unit (for example, a DEMUX: demultiplexer), an MPEG2 (Moving Picture Experts Group phase 2) decoding unit, etc.
[0029] The display unit 150 can display images included in the content. Furthermore, the display unit 150 can display various types of information and various screens such as execution screens. The display unit 150 may be, for example, a device capable of displaying images, such as a liquid crystal display (LCD), an organic electroluminescence (EL) display, or an electrophoretic display.
[0030] The display unit 150 also includes an interface to which the display device 10 can be connected. For example, the display unit 150 may further include an external display device connected to the display device 10 via HDMI, DVI (Digital Visual Interface), or Display Port. The display unit 150 may also be a projection device such as a projector.
[0031] The audio output unit 160 outputs audio included in the content. The audio output unit 160 may be configured with devices such as an amplifier, a speaker, and headphones. In addition to the audio included in the content, the audio output unit 160 can also output general sounds such as music, environmental sounds, and notification sounds.
[0032] The communication unit 170 is a communication interface for communicating with other devices. For example, it may be a network interface that can provide wired or wireless connection. In this embodiment, communication with other devices is possible via a network (NW).
[0033] The image capturing unit 180 is an image capturing device that captures images of the surroundings around where the display device 10 is installed, and is, for example, a camera 12 in this embodiment. The image capturing unit 180 may be composed of one or more image capturing devices. The image capturing unit 180 outputs the captured images as image data. The image capturing unit 180 may also output one or more images as continuous video data. The image capturing unit 180 may be, for example, an environment acquisition unit having a plurality of sensors.
[0034] (Broadcast Control Unit) A simplified configuration of the broadcast control unit 140 will be described with reference to Fig. 3. The broadcast control unit 140 has a tuner unit 400, an OFDM demodulation unit 410, a separation unit 420, a video decoding unit 430, a subtitle decoding unit 440, an image processing unit 450, and an audio decoding unit 460.
[0035] The tuner unit 400 acquires broadcast waves of digital broadcasts such as terrestrial waves, BS, and CS received from an antenna or the like, and outputs the broadcast waves to the OFDM demodulation unit 410 .
[0036] The OFDM demodulation unit 410 demodulates the broadcast wave input from the tuner unit 400, for example, by fast Fourier transform, and outputs content data, for example, TS (Transport Stream) packets after error correction, etc. The OFDM demodulation unit 410 outputs the TS packets to the demultiplexer 420.
[0037] The separator 420 separates the TS packets input from the OFDM demodulator 410. If the separated TS packets contain video data, the separator 420 outputs them to the video decoder 430, and if they contain audio data, the separator 420 outputs them to the audio decoder 460. The separator 420 also outputs TS packets containing data related to subtitles to the subtitle decoder 440.
[0038] The video decoding unit 430 decodes the video data from the TS packets containing the video data input from the separation unit 420, and outputs the video signal to the image processing unit 450. Similarly, the subtitle decoding unit 440 decodes the subtitle data from the TS packets containing the subtitle data input from the separation unit 420, and outputs the subtitle information to the image processing unit 450.
[0039] The image processing unit 450 outputs to the display unit 150 a video signal obtained by superimposing, as necessary, the subtitle information input from the subtitle decoding unit 440 onto the video signal input from the video decoding unit 430 .
[0040] Furthermore, the audio decoding unit 460 decodes the audio data from the TS packets containing the audio data input from the separation unit 420 , and outputs the audio signal to the audio output unit 160 .
[0041] 3 is a schematic illustration of a typical broadcast control unit 140, and other configurations are also possible. There may also be a program information decoding unit that decodes and acquires program information, for example, EPG (Electronic Program Guide) data, from TS packets.
[0042] [1.3 Software Configuration] The software configuration will be described below with reference to Fig. 4. Note that the software configuration shown in Fig. 4 mainly describes the configuration required in this embodiment, and other configurations are omitted.
[0043] The control unit 100 can realize an image determination unit 1010 and a display control unit 1020 by reading and executing a program stored in a memory unit (storage 110, ROM 120).
[0044] The image determination unit 1010 determines the illuminance and the viewing distance, for example, based on image data acquired from the imaging unit 180. Here, the illuminance determined by the image determination unit 1010 refers to, for example, the illuminance around the display device 10. The image determination unit 1010 determines the illuminance, for example, based on the luminance of the image data.
[0045] On the other hand, the viewing distance refers to, for example, the distance from the display device 10 to the user viewing the content (e.g., video). The image determination unit 1010 determines the viewing distance from an image (e.g., a floor) that serves as an index from the acquired image data and the position of the user. Alternatively, the viewing distance may be determined from the physique (height, face size, body type, etc.) of the user included in the image. The image determination unit 1010 can also determine the viewing distance by using any other known method.
[0046] The display control unit 1020 controls, for example, the brightness and / or saturation of a video or image displayed on the display unit 150. The display control unit 1020 can, for example, change the brightness of a backlight, or change the brightness and saturation of a video (for example, a color difference signal or a luminance signal) using a color space such as YCbCr, YPbPr, or RGB. The display control unit 1020 may, for example, combine the control of the brightness of a backlight with the control of the brightness and saturation using a color space. The display control unit 1020 may also set the brightness and saturation using, for example, an LUT (Look Up Table). The display control unit 1020 can also control the brightness and / or saturation of a video using any other known method.
[0047] The storage 110 also allocates a system setting information storage area 1110 for storing system setting information. The system setting information is, for example, information related to settings required for the operation of the display device 10. Here, FIG. 5(a) is a diagram showing an example of the system setting information stored in the system setting information storage area 1110. The system setting information stores setting items (for example, "backlight brightness") and setting values (for example, "80%") for the display device 10. The system setting information may also store other information such as volume, whether or not a suppression setting is enabled, and the channel to be viewed.
[0048] The storage 110 also reserves a fluctuation range information storage area 1120 for storing fluctuation range information. The fluctuation range information is information that the display device 10 uses to set the fluctuation range of the brightness or saturation of an image output to the display unit 150 of the display device 10, for example. FIG. 5(b) is a diagram showing an example of fluctuation range information stored in the fluctuation range information storage area 1120. The fluctuation range information stores a suppression level (for example, "1") and a fluctuation range magnification (for example, "0.9").
[0049] Here, the fluctuation range refers to, for example, the amplitude indicating the time displacement of the brightness or saturation value. Furthermore, the suppression degree refers to the degree to which the fluctuation range is restricted. For example, the suppression degree may be set to a plurality of levels. For example, the display device 10 may display the brightness or saturation fluctuation range as the suppression level increases (stronger suppression) and as the suppression level decreases (weaker suppression) the brightness or saturation fluctuation range increases. The fluctuation range magnification indicates a ratio for restricting (suppressing) the brightness or saturation value. The fluctuation range magnification is, for example, the gain of brightness or saturation, and may be stored as a decimal point less than 1 or in dB (decibels).
[0050] [1.4 Processing flow] The processing flow in this embodiment will be described below with reference to Fig. 6. Note that each component described in Fig. 2 or Fig. 4 may execute the processing of each step.
[0051] First, the control unit 100 sets the suppression level to no suppression (S=0) (S102). Next, the control unit 100 determines whether or not to suppress the fluctuation range based on the system setting information (S104). If the control unit 100 determines that the fluctuation range should be suppressed, it increases the suppression level by one level (S104; Yes → S106).
[0052] Next, the control unit 100 acquires image data of the surrounding environment from the camera of the image capturing unit 180 as an external factor, for example, from the image capturing unit 180 (S108). Next, the control unit 100 specifies the illuminance from the acquired image data using the image determination unit 1010 (S110). Next, the control unit 100 determines whether the specified illuminance satisfies a threshold value (S112).
[0053] Here, if the specified illuminance is greater than the threshold, the control unit 100 determines that the illuminance satisfies the threshold. An example of the illuminance threshold may be an illuminance of 200 Lx, preferably 100 Lx, and more preferably 50 Lx. If the control unit 100 determines that the specified illuminance does not satisfy the threshold, it increases the suppression level by one level (S112; No → S114).
[0054] On the other hand, if the control unit 100 determines that the identified illuminance satisfies the threshold, it determines the viewing distance from the acquired image data using the image determination unit 1010 (S112; Yes → S116). Next, the control unit 100 determines whether the identified viewing distance satisfies the threshold (S118).
[0055] Here, if the identified viewing distance is greater than the threshold, the control unit 100 determines that the threshold is satisfied. The threshold for the viewing distance may be set based on the height H of the display unit 150 of the display device 10, and an example of the threshold for the viewing distance may be twice the height H. If the control unit 100 determines that the identified viewing distance does not satisfy the threshold, it increases the level of the suppression degree by one level (S118; No → S120).
[0056] Next, the control unit 100 applies a fluctuation range magnification corresponding to the level of suppression based on the fluctuation range information, and sets the fluctuation range of the image brightness using the display control unit 1020 (S122). Note that the control unit 100 executes the process of S122 even when it determines that the specified viewing distance satisfies the threshold (S112; Yes) or when it determines that the fluctuation range should not be suppressed (S104; No).
[0057] [1.5 Example of operation] FIG. 7 is a diagram showing a schematic diagram of the change in brightness of the image displayed on the display device 10 in this embodiment, and FIG. 8 is a diagram showing a schematic diagram of the status of the user of the display device 10 and the operation results based on the status of the user.
[0058] 7(a) is a graph G100 of brightness change, showing the change in brightness over time when the suppression level is set to no suppression, with brightness on the vertical axis and time on the horizontal axis. The control unit 100 sets a brightness setting value V100, such as the brightness of a backlight. The control unit 100 varies the brightness of the image within a fluctuation width W100, with the brightness setting value V100 as the maximum value, and outputs the image.
[0059] Fig. 7(b) is a diagram showing a graph G102 of brightness changes in the case of a weak suppression level, where the suppression level is increased by one level from that in Fig. 7(a). Based on the ratio of the fluctuation range magnification, the control unit 100 sets, for example, a brightness setting value V102 lower than the brightness setting value V100 in Fig. 7(a). The control unit 100 varies the brightness of the image within a fluctuation range W102, with the brightness setting value V102 as the maximum value, and outputs the image (for example, by suppressing the backlight brightness).
[0060] Fig. 7(c) is a diagram showing a graph G104 of brightness changes when the suppression level is increased by one level from Fig. 7(b), that is, when the suppression level is intermediate (medium) between weak and strong suppression. Based on the ratio of the fluctuation range magnification, the control unit 100 sets, for example, the brightness setting value V104 lower than the brightness setting value V104 in Fig. 7(b). The control unit 100 changes the brightness of the image within a fluctuation range W104, with the brightness setting value V104 as the maximum value, and outputs the image.
[0061] Fig. 7(d) is a diagram showing a graph G106 of brightness changes when the suppression level is increased by one level from Fig. 7(c), resulting in a strong degree of suppression. Based on the ratio of the fluctuation range magnification, the control unit 100 sets, for example, the brightness setting value V106 lower than the brightness setting value V104 of Fig. 7(c). The control unit 100 varies the brightness of the image within a fluctuation range W106, with the brightness setting value V106 as the maximum value, and outputs the image with the brightness fluctuation range most suppressed.
[0062] Next, FIGS. 8(a) and 8(c) are diagrams showing situations of users viewing images displayed on the display device 10. In FIG. 8(a), the users are viewing images in a bright environment (e.g., illuminance of 250 Lx). User Usr01 is viewing images from a position far from the display device 10A (e.g., a viewing distance three times the height H of the display device 10A). On the other hand, user Usr02 is viewing images from a position close to the display device 10B (e.g., a viewing distance the same as the height H of the display device 10B). In this embodiment, the threshold for the viewing distance is set to twice the height H, and the threshold for the illuminance is set to 200 Lx.
[0063] FIG. 8(b) is a diagram schematically illustrating the results of applying the processing of FIG. 6 to the display devices 10A and 10B depending on the user situations shown in FIG. 8(a). The display device 10A in FIG. 8(b) determines that the user Usr01 is in a distant position (satisfying the viewing distance threshold) and that the environment is bright (satisfying the illuminance threshold). The display device 10A weakens the suppression level and sets a large luminance fluctuation range, for example, as shown in FIG. 7(b). On the other hand, the display device 10B in FIG. 8(b) determines that the user Usr02 is in a close position (not satisfying the viewing distance threshold) and that the environment is bright. The display device 10B sets a medium suppression level and a medium luminance fluctuation range, for example, as shown in FIG. 7(c).
[0064] In Fig. 8(c), the users are viewing in a dark environment (for example, illuminance of 30 Lx). User Usr01 is viewing the video at a position far from display device 10A. On the other hand, user Usr02 is viewing the video at a position close to display device 10B.
[0065] FIG. 8(d) is a diagram showing the results of the operation of the display devices 10A and 10B depending on the user situation shown in FIG. 8(c). The display device 10A in FIG. 8(d) determines that the user Usr01 is located far away and in a dark environment (the illuminance threshold is not met). The display device 10A sets the suppression level to a medium level, for example, as shown in FIG. 7(c), and the brightness fluctuation range to a medium level. On the other hand, the display device 10B in FIG. 8(d) determines that the user Usr02 is located close and in a dark environment. The display device 10B sets the suppression level to a high level, for example, as shown in FIG. 7(d), and the brightness fluctuation range to a low level.
[0066] In this way, it is possible to display an image with a reduced fluctuation range in luminance in response to an external input signal such as a broadcast program or VOD (Video On Demand) content based on an external factor.
[0067] In this embodiment, the control unit 100 sets the fluctuation range of the brightness of the image, but for example, the control unit 100 may set the fluctuation range of the saturation of the image in accordance with the fluctuation range magnification, and further, the control unit 100 may set the fluctuation range of the brightness and saturation of the image.
[0068] In this embodiment, an example in which only one threshold value is used is shown, but for example, the control unit 100 may make the determination using multiple illuminance threshold values or multiple viewing distance threshold values. Also, the user may arbitrarily set the viewing distance threshold value or the illuminance threshold value.
[0069] [1.6 Effects, etc.] In this way, control unit 100 can suppress the fluctuation range of the luminance of content (e.g., video) displayed on display unit 150 based on the illuminance and viewing distance. Users (viewers) can enjoy content (video) with better image quality in their preferred viewing environment without worrying about physical discomfort.
[0070] In addition, the control unit 100 measures external factors (e.g., ambient brightness, distance to the viewer's screen) and limits the range of brightness fluctuations (increases the degree of suppression) when the distance is close compared to when the distance is far, and when the brightness is low compared to when the brightness is high, thereby suppressing physical abnormalities (e.g., induction of photosensitive seizures) without excessive image processing.
[0071] [2. Second Embodiment] The second embodiment will be described below. The second embodiment is an embodiment that suppresses the fluctuation range of the luminance and saturation of an image when multiple users are viewing content displayed on one display device 10, and suppresses the fluctuation range of the luminance and saturation of an image based on the viewing distance of the closest viewer.
[0072] In the second embodiment, explanations of the same hardware and software configurations as those in the first embodiment will be omitted, and the explanation will focus on the differences from the first embodiment.
[0073] [2.1 Processing flow] Fig. 9 is a diagram for explaining the flow of processing in this embodiment. Fig. 9 replaces Fig. 6 of the first embodiment. S202 is executed instead of S116 in Fig. 6, and S204 is executed instead of S122.
[0074] The control unit 100 identifies the viewing distance of the nearest user from the acquired image data using the image determination unit 1010 (S202). The control unit 100 also sets the fluctuation range of the luminance and saturation by applying a fluctuation range magnification corresponding to the level of the suppression degree (S204).
[0075] [2.2 Example of operation] FIG. 10 is a diagram showing a schematic diagram of the change in saturation of the image displayed on the display device 10 in this embodiment, and FIG. 11 is a diagram showing a schematic diagram of the status of the user of the display device 10 and the operation results based on the status of the user.
[0076] FIG. 10(a) is a graph G200 showing a change in saturation over time when the suppression level is set to no suppression, with saturation on the vertical axis and time on the horizontal axis. The control unit 100 sets, for example, a setting value V200 for color saturation. Here, the setting value V200 for color saturation is, for example, a setting value that schematically represents saturation. For example, it may also be a setting value that schematically represents saturation in the HSV color space. The control unit 100 changes the saturation of the image within a variation width W200, with the setting value V200 for color saturation as the maximum value, and outputs the image.
[0077] Fig. 10(b) is a diagram showing a graph G202 of changes in saturation in the case of a weak degree of suppression, where the level of suppression is increased by one level from that in Fig. 10(a). Based on the ratio of the fluctuation range magnification, the control unit 100 sets, for example, a color saturation setting value V202 that is lower than the color saturation setting value V200 in Fig. 10(a). The control unit 100 changes the saturation of the image within a fluctuation range W202, with the color saturation setting value V202 as the maximum value, and outputs the image (for example, displays the image with the change in saturation suppressed).
[0078] Fig. 10(c) shows a graph G204 of saturation changes when the suppression level is increased by one level from that of Fig. 10(b), that is, when the suppression level is medium. Based on the ratio of the fluctuation range magnification, the control unit 100 sets, for example, the color saturation setting value V204 lower than the color saturation setting value V202 of Fig. 10(b). The control unit 100 changes the saturation of the image within the fluctuation range W204, with the color saturation setting value V204 as the maximum value, and outputs the image.
[0079] Fig. 10(d) shows a graph G206 of saturation changes when the suppression level is increased by one level from that of Fig. 10(c), resulting in a stronger suppression. Based on the ratio of the fluctuation range magnification, the control unit 100 sets, for example, the color saturation setting value V206 lower than the color saturation setting value V204 of Fig. 10(c). The control unit 100 varies the saturation of the image within a fluctuation range W106 with the color saturation setting value V206 as the maximum value, and outputs the image with the saturation fluctuation range most suppressed.
[0080] In this embodiment, in addition to the saturation of the image, the luminance of the image is also output with the fluctuation range suppressed as shown in FIG. 7, similarly to the first embodiment.
[0081] 11(a), 11(b), 11(c), and 11(d) are diagrams schematically illustrating the situation of a user viewing a video displayed on the display device 10 and the results of the display device 10 applying the process of FIG. 9. In FIG. 11(a), the user Usr03 is viewing the video from a location far from the display device 10 in a bright environment. The control unit 100 determines that the user Usr03 is viewing the video from a location far from the display device 10 in a bright environment. The control unit 100 weakens the suppression level and, for example, sets a large fluctuation range for the brightness and saturation of the video, as shown in FIG. 7(b) and FIG. 10(b).
[0082] In FIG. 11(b), user Usr03 is viewing a video from a position far from the display device 10, while user Usr04 is viewing a video from a position close to the display device 10. In FIG. 11(b), the surrounding environment is bright. The control unit 100 determines the viewing distances of users Usr03 and Usr04. Next, the control unit 100 makes a determination based on the viewing distance of user Usr04, who is viewing a video from a position closer than user Usr03. The control unit 100 determines that user Usr04 is viewing from a close position in a bright environment. The control unit 100 sets the suppression level to a medium level, and, for example, sets the fluctuation range of the brightness and saturation of the video to a medium level, as shown in FIG. 7(c) and FIG. 10(c).
[0083] In Fig. 11(c), user Usr03 is viewing an image in a dark environment at a distance from the display device 10. The control unit 100 determines that user Usr03 is viewing an image at a distance and in a dark environment. The control unit 100 sets the fluctuation range of the image brightness and saturation to a medium level, for example, as shown in Fig. 7(c) and Fig. 10(c).
[0084] In FIG. 11(d), user Usr03 is viewing the video from a position far from the display device 10, while user Usr04 is viewing the video from a position close to the display device 10. In FIG. 11(b), the surrounding environment is dark. As in FIG. 11(b), the control unit 100 makes a determination based on the viewing distance of user Usr04, who is viewing the video from a closer viewing distance. The control unit 100 determines that user Usr04 is viewing the video from a closer position and in a dark environment. The control unit 100 increases the degree of suppression and, for example, sets a small fluctuation range for the brightness and saturation of the video, as shown in FIG. 7(d) and FIG. 10(d).
[0085] In this way, it is possible to display an image in which the fluctuation range of luminance or saturation is suppressed in accordance with an external input signal such as a broadcast program or VOD (Video On Demand) content based on an external factor.
[0086] [2.3 Effects, etc.] In this way, the control unit 100 suppresses the brightness and saturation of the image. The user can view an image with suppressed brightness and saturation. Furthermore, the control unit 100 identifies the viewing distance of the closest user, thereby realizing a display device that multiple users can view with peace of mind without experiencing any physical discomfort.
[0087] 3. Third Embodiment The third embodiment will be described below. In the third embodiment, when a user is viewing content displayed on the display device 10, not only is the fluctuation range of brightness suppressed, but also lighting connected to the display device 10 is controlled.
[0088] In the third embodiment, the description of the same hardware and software configurations as those in the first embodiment will be omitted, and the description will focus on the differences from the first embodiment.
[0089] [3.1 Overall System] FIG. 12 is a diagram illustrating an overview of a system 1 including a display device 10 and an illumination device 20. As shown in FIG.
[0090] The lighting device 20 is a general lighting device that uses an LED element or a fluorescent lamp, and includes, for example, at least a control unit, a memory unit (storage, ROM, RAM), a light source unit, and a communication unit.
[0091] Furthermore, the lighting device 20 may be equipped with sensors such as a motion sensor, an illuminance sensor, and a depth sensor, and may also have a dimming function. The lighting device 20 may be connected to the display device 10 via a connection method such as a signal line, infrared rays, or a network (NW). Furthermore, the lighting device 20 may include one or more lighting devices 20.
[0092] [3.2 Software Configuration] The main software configuration of the system 1 will be described with reference to Fig. 13. The storage 110 allocates an illuminance information storage area 1140 for storing illuminance information. The illuminance information is, for example, information relating to the suppression of the brightness (illuminance) of the lighting device 20.
[0093] An example of illuminance information stored in the illuminance information storage area 1140 will now be described with reference to FIG. 14. A suppression level (e.g., "3") and a set illuminance value (e.g., "100") are stored. Here, the set illuminance value may be, for example, the illuminance of the lighting device 20, the brightness level of the lighting device 20, or the input power to the light source, corresponding to the value of the suppression level. Note that if there are multiple lighting devices 20, a set illuminance value may be stored for each of them, for example.
[0094] [3.3 Processing flow] Fig. 15 is a diagram for explaining the processing flow in this embodiment. Fig. 15 replaces Fig. 9 in the first embodiment. S302 to S308 are executed between S102 and S122 in Fig. 9.
[0095] The control unit 100, for example, displays a display screen on the display unit 150 as a setting screen on which the level of suppression can be changed (S302). Next, the control unit 100, for example, receives an input of the level of suppression on the setting screen and sets the received level of suppression (S304). Next, the control unit 100 determines whether the level of suppression is no suppression (S=0) (S306). If the level of suppression is no suppression, the control unit 100 sets the fluctuation range of luminance by applying the fluctuation range magnification for the level of suppression of no suppression based on the fluctuation range information (S306; Yes → S122).
[0096] If the level of suppression is not no suppression, the control unit 100 controls the brightness of the lighting device 20, for example, based on the level of suppression and the illuminance information, by connecting to the lighting device 20 via the communication unit 170 and operating the lighting device 20 (S306: No → S308).
[0097] [3.4 Example of operation] Figures 16(a) and 16(b) are diagrams that schematically show the situation of a user watching a video displayed on the display device 10 and the results of the display device 10 applying the processing of Figure 15 depending on the user's situation.
[0098] In FIG. 16(a), display device 10, lighting device 20A, and lighting device 20B are installed, and user Usr05 is viewing display device 10. Here, user Usr05 operates display device 10 and sets the suppression level to, for example, medium. Control unit 100 operates, for example, the brightness of lighting device 20A and lighting device 20B in accordance with the suppression level and illuminance information, to increase the brightness (increase the illuminance) if the suppression level is strong, and decrease the brightness (decrease the illuminance) if the suppression level is weak. Finally, the brightness of the image displayed on display unit 150 of display device 10 is also suppressed to a luminance fluctuation range in accordance with the set suppression level.
[0099] In FIG. 16(b), a display device 10, a nearby lighting device 20A, a nearby lighting device 20B, a distant lighting device 20C, and a distant lighting device 20D are installed, and a user Usr05 watches the display device 10 from nearby, while a user Usr06 watches from far away. Here, user Usr05 operates the display device 10, for example, setting the suppression level to a medium level. In accordance with the suppression level and the illuminance information, the control unit 100 operates the nearby lighting devices 20A and 20B to brighten them (increase their illuminance) and the distant lighting devices 20C and 20D to darken them (decrease their illuminance). Finally, the brightness of the image displayed on the display unit 150 of the display device 10 is also suppressed to a certain extent to match the set suppression level.
[0100] By operating the lighting device 20, the display device 10 can be viewed with a moderate degree of suppression no matter where the user is viewing.
[0101] In this embodiment, control unit 100 also suppresses the fluctuation range of luminance, but for example, it may change only the ambient brightness (illuminance of lighting device 20) without suppressing the fluctuation range of the luminance or saturation of the image.
[0102] Furthermore, when the control unit 100 includes, for example, the image determination unit 1010, it may identify the viewing distance of the user and operate the brightness (illuminance) of the lighting device 20 in accordance with the viewing distance, or it may operate only the lighting device 20 closest to the user.
[0103] Furthermore, the control unit 100 may, for example, register the face and physique of a user who is prone to photosensitive seizures in the display device 10, and determine the registered user (registered user) using the image determination unit 1010. The control unit 100 may determine the viewing position of the registered user and operate the lighting device 20 so as to brighten only the lighting device 20 closest to the registered user. On the other hand, the control unit 100 may, for example, operate the lighting device 20 so as to dim only the lighting device 20 closest to the viewing position of a user who is unlikely to suffer from photosensitive seizures.
[0104] [3.5 Effects] In this way, the control unit 100 operates the lighting device 20 in accordance with the suppression level, so that the user can enjoy the video at a desired position and with a desired brightness.
[0105] [4. Fourth Embodiment] The fourth embodiment will be described below. The fourth embodiment is an embodiment in which brightness is suppressed depending on the genre (type of program) of content (for example, program) displayed on the display device 10 and the contents of subtitles.
[0106] In the fourth embodiment, the description of the same hardware and software configurations as those of the first embodiment will be omitted, and the description will focus on the differences from the first embodiment.
[0107] [4.1 Software Configuration] The software configuration will be described below with reference to Fig. 17. Note that the software configuration shown in Fig. 17 mainly describes the configuration required in this embodiment, and other configurations are omitted.
[0108] The control unit 100 can realize a genre identification unit 1030 and a subtitle determination unit 1040 by reading and executing a program stored in a memory unit (storage 110, ROM 120).
[0109] The genre identification unit 1030 identifies the genre of the program being viewed, for example, from the program information acquired from the broadcast control unit 140. The program information refers to information including the title, genre, and description of the program, which is included in an EPG (Electronic Program Guide) acquired by the broadcast control unit 140 from the broadcast wave, for example.
[0110] The subtitle determination unit 1040 determines whether or not a specific subtitle, such as subtitle information (subtitle information) that warns users watching a video, is displayed in the program being watched based on the subtitle data acquired from the subtitle decoding unit 440.
[0111] The storage 110 also allocates a genre suppression information storage area 1130 for storing genre suppression information. An example of genre suppression information stored in the genre suppression information storage area 1130 will be described with reference to FIG. 18. The suppression level (e.g., "3") and genre information stored in the program information (e.g., "anime, special effects, live concert") may be stored. Here, the genre information may store multiple genres for one suppression level.
[0112] [4.2 Processing flow] Fig. 19 is a diagram for explaining the flow of processing in this embodiment. Fig. 19 replaces Fig. 9 of the first embodiment. S402 to S410 are executed between S102 and S120 in Fig. 9.
[0113] The control unit 100 acquires information about the program that the user is watching, for example, from an electronic program guide (S402). Next, the control unit 100 sets the level of suppression from the acquired program information (S404). Here, as a method for setting the level of suppression, for example, the control unit 100 compares the program information acquired by the genre identification unit 1030 with the genre suppression information, and sets the level of suppression corresponding to the genre included in the acquired program information.
[0114] Next, the control unit 100 determines whether the genre of the acquired program information is animation (S406). If the control unit 100 determines that the genre of the acquired program information is animation, it determines whether the information on the era of the program satisfies the era threshold (S406; Yes → S408).
[0115] The information about the era of a program may be, for example, the title of the program, the year the program was produced stored in the program description, and information indicating a rebroadcast. As an example of the determination by the control unit 100 as to whether the era threshold is satisfied, the control unit 100 may determine that the threshold is satisfied if the year the program was produced is a program produced before a predetermined era. Here, the predetermined era may be, for example, before 2000, or preferably before the 1990s.
[0116] If the control unit 100 determines that the genre information is not animation (S406; No), or if it determines that the program era information does not satisfy the era threshold (S408; No), it uses the subtitle determination unit 1040 to determine whether a specific subtitle has been displayed (S410).
[0117] When the control unit 100 determines that the information on the era of the program satisfies the era threshold (S408; Yes), or when it determines that a specific subtitle is displayed (S410; Yes), it increases the suppression level by one level (S120). On the other hand, when it determines that a specific subtitle is not displayed, it sets the brightness fluctuation range based on the suppression level (S410; No → S122).
[0118] [4.3 Example of operation] Figures 20(a) and 20(b) are diagrams that schematically show the status of users viewing programs by genre displayed on display device 10A and display device B, and the results of display device 10A and display device 10B applying the processing of Figure 19.
[0119] In Figure 20(a), display device 10A displays a news program, which is being viewed by user Usr07. Meanwhile, display device 10B displays an anime program, which is being viewed by user Usr08. Display device 10A sets the suppression level corresponding to the news program genre based on the program information to a low level, and displays the image with a large fluctuation range in brightness. Meanwhile, display device 10B sets the suppression level corresponding to the anime program genre based on the program information to a medium level, and displays the image with a medium fluctuation range in brightness.
[0120] In FIG. 20(b), display device 10A displays a news program, which is being viewed by user Usr07. Here, display device 10A displays a specific subtitle, which is a warning to the user viewing the video. Meanwhile, display device 10B displays an old anime program, which is being viewed by user Usr08. Here, display device 10A sets the suppression level corresponding to the genre of the news program to weak based on the program information. Next, display device 10A determines that a specific subtitle is being displayed, and increases the suppression level by one level, setting the suppression level to medium. Display device 10A displays the video with a medium fluctuation range for the brightness.
[0121] On the other hand, display device 10B sets the suppression level corresponding to the genre of the anime program from the program information to a medium level. Next, it determines the era of the program and increases the suppression level by one level to set it to a strong suppression level. Display device 10A displays the image by suppressing the fluctuation range of the luminance to a small value.
[0122] [4.4 Effects] In this way, the control unit 100 can determine the degree of suppression based on the program information, and can suppress the range of brightness fluctuations in accordance with the image displayed on the display unit 150. Users (viewers) can enjoy content with better image quality in their preferred viewing environment without worrying about physical abnormalities.
[0123] [5. Fifth Embodiment] The fifth embodiment will be described below. In the fifth embodiment, the display device 10 acquires external factors using a sensor instead of a camera.
[0124] In the fifth embodiment, the description of the same hardware and software configurations as those of the first embodiment will be omitted, and the description will focus on the differences from the first embodiment.
[0125] [5.1 Hardware Configuration] The hardware configuration will be described below with reference to Fig. 21. Fig. 21 is a diagram showing an example of a display device 10. The display device 10 has a sensor unit 190 instead of an imaging unit 180.
[0126] The sensor unit 190 is a sensor device that senses the surrounding conditions around the display device 10. The sensor unit 190 may be configured with a plurality of sensor devices, such as an illuminance sensor, a distance sensor, a color temperature sensor, a human presence sensor, and a depth sensor.
[0127] In this embodiment, the sensor unit 190 has a distance sensor and an illuminance sensor, but a different combination may be used. For example, the sensor unit 190 may have a color temperature sensor instead of the distance sensor. The illuminance sensor may acquire illuminance and a change in illuminance (light flicker) as external factors.
[0128] The sensor unit 190 may use, as a distance sensor, for example, an ultrasonic distance sensor, an infrared distance sensor, a millimeter-wave distance sensor, a laser distance sensor, etc. Furthermore, the sensor unit 190 may use, as an illuminance sensor, for example, a phototransistor-type illuminance sensor, a photodiode-type illuminance sensor, etc.
[0129] The sensor unit 190 outputs various data such as illuminance, the user's viewing distance, and color temperature acquired by the various sensors as external factors.
[0130] [5.2 Processing flow] Fig. 22 is a diagram illustrating the flow of processing in this embodiment. Fig. 22 replaces Fig. 9 of the first embodiment. S502 is executed instead of S108 and S110 in Fig. 9, and S504 is executed instead of S116.
[0131] The control unit 100 determines the illuminance from the illuminance sensor of the sensor unit 190 (S502). The control unit 100 also determines the viewing distance from the user from the distance sensor of the sensor unit 190 (S504).
[0132] Note that the above-described operational flow is an example, and some different processing may be performed. For example, instead of the processing of S504, the control unit 100 may identify the color temperature from the color temperature sensor of the sensor unit 190, and determine whether the color temperature threshold is met instead of S118. For example, if the color temperature of the environment in which the user is viewing exceeds daylight white (4500K), it may be determined that the color temperature threshold is met.
[0133] [5.3 Example of operation] According to this embodiment, the display device 10 can suppress the fluctuation range of the luminance of the content displayed on the display unit 150 based on external factors, without performing image determination from image data. Furthermore, it becomes possible to obtain, as an external factor, changes in illuminance such as light flicker, which cannot be obtained from image data.
[0134] [6. Modifications] The present disclosure is not limited to the above-described embodiments, and various modifications are possible. In other words, embodiments obtained by combining technical means that are appropriately modified within the scope of the present disclosure are also included in the technical scope.
[0135] The above-described embodiment has been described as an example of a display device. However, the display device can also be applied to other devices. For example, an example of a display device may be an information processing device such as a smartphone or a tablet.
[0136] Although the above-mentioned embodiments are described separately for convenience of explanation, they can be combined to the extent possible. Furthermore, the present invention intends to obtain rights to any of the technologies described in the specification through amendments or divisional applications, etc.
[0137] In addition, the programs that run on each device in each embodiment are programs that control the CPU, etc. (programs that make a computer function) so as to realize the functions of the above-described embodiments. Information handled by these devices is temporarily stored in a temporary storage device (e.g., RAM) during processing, and then stored in various storage devices such as ROMs and HDDs, and is read, modified, and written by the CPU as needed.
[0138] Here, the recording medium for storing the program may be any of semiconductor media (e.g., ROM, non-volatile memory card, etc.), optical recording media / magneto-optical recording media (e.g., DVD (Digital Versatile Disc), CD (Compact Disc), BD (Blu-ray (registered trademark) Disc), etc.), magnetic recording media (e.g., magnetic tape, flexible disk, etc.), etc.
[0139] Furthermore, when distributing the program in the market, the program can be stored in a portable recording medium and distributed, or transferred to a server computer connected via a network such as the Internet. In this case, the storage device of the server device is also included in the present disclosure.
[0140] Furthermore, the above-mentioned data may not be stored within the device, but may be stored in an external device and called up as needed. For example, the data may be stored in a network attached storage (NAS) or on the cloud.
[0141] The scope of the present disclosure is not limited to the configurations explicitly described in the specification, but also includes combinations of the technologies disclosed in the specification. The configurations of the present disclosure for which a patent is sought are set forth in the appended claims, but it is not intended to exclude them from the technical scope on the grounds that they are not set forth in the claims.
[0142] Furthermore, in the above-mentioned specification, the statements "in the case of" and "when" are given as examples and are not intended to limit the configuration to the described contents. The disclosure also includes configurations that are not in these cases or situations, even if they would be obvious to a person skilled in the art, and the applicant intends to obtain rights to them.
[0143] Furthermore, the order of the processes and data flow described in the specification is not limited to the order described. For example, the patent also discloses configurations in which some processes are deleted or the order is changed, and the patent holder intends to obtain the rights to such configurations.
[0144] Furthermore, although the functions described in the embodiments are executed by each device, they may be realized by one device or may further utilize an external server.
[0145] Furthermore, each functional block or feature of the device used in the above-described embodiments may be implemented or performed by an electrical circuit, for example, an integrated circuit or multiple integrated circuits. The electrical circuit designed to perform the functions described herein may include a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or a combination thereof. The general-purpose processor may be a microprocessor, or a conventional processor, controller, microcontroller, or state machine. The electrical circuit may be composed of digital circuits or analog circuits. Furthermore, as advances in semiconductor technology emerge, one or more aspects of the present disclosure may utilize new integrated circuits based on that technology. [Explanation of symbols]
[0146] 10 Display device 12 Camera 20 Lighting equipment 100 control section 110 Storage 120 ROM 130 RAM 102 Operation control section 140 Broadcast Control Section 150 Display section 160 Audio output section 170 Communications Department 180 Photography Department 190 Sensor unit
Claims
1. A display unit; an acquisition unit that acquires external factors; a control unit that displays an image on the display unit by suppressing a fluctuation range of luminance or saturation in accordance with an input signal based on the acquired external factor; A display device comprising:
2. The display device according to claim 1 , wherein the control unit determines and sets a set value for suppressing the fluctuation range by making a determination for each of the external factors.
3. The display device according to claim 2 , wherein the control unit determines the setting value by making a judgment based on a threshold value determined for each of the external factors.
4. The display device according to claim 3 , wherein the control unit determines the setting value based on the threshold value of illuminance and the threshold value of viewing distance as the external factors.
5. The display device according to claim 4 , wherein, when there are a plurality of users, the control unit determines the setting value based on the viewing distance of the closest user among the users.
6. the acquisition unit acquires program information and subtitle information of the video as the external factors; The display device according to claim 2 , wherein the control unit determines the setting value based on the program information and the subtitle information.
7. The display device according to claim 1 , wherein the control unit suppresses the fluctuation range by controlling the brightness of a backlight.
8. The display device according to claim 1 , wherein the control unit suppresses the fluctuation range by controlling a luminance signal or a color difference signal.
9. a lighting device connected to the display device; The display device according to claim 1 , wherein the control unit controls the brightness of the lighting device.
10. A display step; an acquisition step of acquiring external factors; a control step of suppressing a fluctuation range of the luminance or saturation of the display step in accordance with an input signal based on the acquired external factor and displaying the image; A method for controlling a display device comprising:
11. On the computer, A display means; An acquisition means for acquiring external factors; a control means for displaying an image by suppressing a fluctuation range of the luminance or saturation of the display means in accordance with an input signal based on the acquired external factor; A program to achieve this.
12. A recording medium on which the program of claim 11 is recorded.
Citation Information
Patent Citations
Image processing device, image processing method, and recording medium containing program
WO2015107880A1