Image display system, image display method, and computer-readable non-transitory recording medium

Abstract

This invention enables image display in the use of multiple display screens to control the appropriate brightness of one display screen based on the brightness of another display screen. An image display system (1) is provided, which displays an image in a display area. The image display system includes a first display area (3), a second display area (4), and a brightness determination unit (22). The brightness determination unit determines the brightness of the second display area based on the brightness of the first display area and the positional relationship between the first and second display areas and the user, and displays the second display area at the specified brightness.

Description

Technical Field

[0001] This invention relates to an image display system, an image display method, and an image display program. Background Technology

[0002] Patent document 1 discloses an image display device that can determine the brightness of the display screen at which the viewer begins to feel glare based on the illuminance near the display screen, information about the viewer, and the viewing distance.

[0003] Prior art literature

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2007-279405 Summary of the Invention

[0006] (The problem the invention aims to solve)

[0007] Here, we assume a scenario where a user is using multiple display areas simultaneously. The inventors discovered through experiments that, in this situation, while the user visually confirms one display area, the optimal brightness of the other display area changes according to the brightness of the first one.

[0008] The present invention was made in view of the following situation, and the object of the present invention is to achieve appropriate brightness control of the display area of ​​another display area based on the brightness of the display area of ​​one display area when multiple display areas are used, while the user visually confirms the display area of ​​one display area.

[0009] (Technical solution used to solve the problem)

[0010] According to the present invention, an image display system is provided, which displays an image in a display area. The image display system includes a first display area, a second display area, and a brightness determination unit. The brightness determination unit determines the brightness of the second display area based on the brightness of the first display area and the positional relationship between the first display area, the second display area, and the user, and displays the second display area at the brightness.

[0011] With this structure, the brightness of one display screen can be controlled to adjust the brightness of the other display screen.

[0012] Various embodiments of the present invention are illustrated below. The embodiments shown below can be combined with each other. Furthermore, each feature independently constitutes the invention.

[0013] Preferably, it also includes a data acquisition unit, and the brightness determination unit further determines the brightness of the second display area based on the illuminance acquired by the data acquisition unit.

[0014] Preferably, the brightness determination unit determines the brightness of the second display area based on the light stimulation index perceived by the user.

[0015] Preferably, the indicator of light stimulation is the indicator of glare perceived by the user.

[0016] Preferably, the brightness determination unit determines the brightness of the second display area based on at least one of the following: the size of the second display area, the distance between the first display area and the second display area, the solid angle when the user views the second display area, and the distance between the user and the first display area.

[0017] Preferably, the first display area is a display for displaying medical images.

[0018] Preferably, the upper and lower limits of the brightness of the second display area are preset.

[0019] Preferably, the first display area and the second display area are arranged side by side in one display.

[0020] Preferably, the first display area and the second display area are arranged overlappingly within a single display.

[0021] According to another aspect of the invention, a method is provided that enables a computer to function as an image display system displaying images in a display area. The method includes a data acquisition step and a brightness determination step. In the data acquisition step, the computer acquires the illuminance of an environment in which first and second display areas of the image display system are provided. In the brightness determination step, the computer determines the brightness of the second display area based on the illuminance acquired in the data acquisition step, the brightness of the first display area, and the positional relationship between the first and second display areas and the user, and displays the second display area at the brightness.

[0022] According to another aspect of the present invention, a program is provided that enables a computer to function as an image display system displaying images in a display area. The program enables the computer to perform a data acquisition step and a brightness determination step. In the data acquisition step, the computer acquires the illuminance of the environment in which the first and second display areas of the image display system are provided. In the brightness determination step, the computer determines the brightness of the second display area based on the illuminance acquired in the data acquisition step, the brightness of the first display area, and the positional relationship between the first and second display areas and the user. Attached Figure Description

[0023] Figure 1 This is a diagram showing the hardware structure of the image display system 1 according to the first embodiment.

[0024] Figure 2 This is a block diagram illustrating the functional structure of the image display system 1 according to the first embodiment.

[0025] Figure 3 It is a diagram showing the positional relationship between the user and the image interpretation display 3 and the reference display 4.

[0026] Figure 4 This is a graph representing the degree of glare corresponding to the UGR value.

[0027] Figure 5 middle, Figure 5 A is a graph representing the luminance Lt of the reference display 4 when the target UGR value is 6. Figure 5 B is a graph representing the luminance Lt of the reference display 4 when the target UGR value is 9.

[0028] Figure 6 This is a block diagram illustrating the functional structure of the image display system 1 according to the second embodiment. Detailed Implementation

[0029] <1. First Embodiment>

[0030] (1.1. Hardware structure of image display system 1)

[0031] Reference Figure 1 This describes the hardware structure of image display system 1. For example... Figure 1 As shown, the image display system 1 includes a processing unit 2, an image interpretation display 3 as a first display area, and a reference display 4 as a second display area. An illuminance sensor 5 is mounted on the upper part of the front display surface of the image interpretation display 3. The image display system 1 is installed, for example, in an image interpretation room within a hospital. The image interpretation display 3 displays medical images such as chest X-rays or mammograms. The reference display 4 displays text and / or image data information such as medical records.

[0032] The processing unit 2 can communicate with the image interpretation display 3 and the reference display 4 via video signal line 11 and control signal line 12. Image data from the processing unit 2 is transmitted to the image interpretation display 3 and the reference display 4 via video signal line 11.

[0033] Image data based on the processing unit 2 is displayed on display screen 3a of the image interpretation display 3 and display screen 4a of the reference display 4. Control signals or data are transmitted and received between the processing unit 2 and the image interpretation display 3 and the reference display 4 via control signal line 12.

[0034] (1.2. Functional Structure of Image Display System 1)

[0035] Reference Figure 2 The functional structure of the image display system 1 is explained below. As described above, the image display system 1 includes a processing unit 2, an image interpretation display 3, a reference display 4, and an illuminance sensor 5. The processing unit 2 includes a data acquisition unit 21, a brightness determination unit 22, and an image output unit 23. The illuminance sensor 5 installed on the image interpretation display 3 detects the illuminance (ambient illuminance) in the environment, and the image interpretation display 3 outputs the detected ambient illuminance to the processing unit 2.

[0036] The data acquisition unit 21 acquires the ambient illuminance detected by the illuminance sensor 5. Additionally, the data acquisition unit 21 acquires information about the image interpretation display 3 and the reference display 4. Specifically, this includes information about the brightness of the image interpretation display 3, the size of the image interpretation display 3 and the reference display 4, and the position of the image interpretation display 3 and the reference display 4 relative to the user. This information is stored in the storage unit (memory, HDD, or SSD, etc.) built into the computing processing device 2, and can also be acquired by the data acquisition unit 21 as needed, or by settings configured by the user or manufacturer.

[0037] The brightness determination unit 22 determines the brightness of the reference display 4 based on indicators of light stimulation perceived by the user. The processing of the brightness determination unit 22 will be explained in detail later. The brightness control unit 41 of the reference display 4 displays the display screen 4a at the brightness determined by the brightness determination unit 22.

[0038] The image output unit 23 outputs image data displayed on the image interpretation display 3 and the reference display 4. This image data may be, for example, a color image comprising color components consisting of the three primary colors of red, green, and blue, or a monochrome image such as an X-ray image.

[0039] The image interpretation display 3 is a display that displays medical image data such as X-ray images, and may be composed of, for example, liquid crystal displays, organic EL displays, touch panel displays, electronic paper, and other displays.

[0040] Reference display 4 is a display that displays text and / or image data such as medical records, and may be composed of a liquid crystal display, an organic EL display, a touch panel display, electronic paper, or other displays.

[0041] The aforementioned components can be implemented via software or hardware. In the case of software implementation, various functions can be achieved by executing a computer program through the CPU. The program can be stored in the built-in storage of the arithmetic processing unit 2, or it can be stored on a computer-readable, non-transitory recording medium.

[0042] Furthermore, programs stored on external storage can also be read, through what is known as cloud computing. In the case of hardware implementation, it can be achieved using various circuits such as ASICs, FPGAs, or DRPs.

[0043] (1.3. Processing of brightness determination unit 22)

[0044] Reference Figure 3 The following explanation describes the processing of the brightness determination unit 22. It should be noted that the processing of the brightness determination unit 22 shown in the following explanation is an example and is not limited to the calculations described below.

[0045] As described above, the brightness determination unit 22 controls the brightness of the reference display 4 based on an index of light stimulation from a high-brightness light-emitting body (hereinafter referred to as a light-emitting body) within the user U's field of view. It should be noted that in this embodiment, it is assumed that the reference display 4 is a high-brightness light-emitting body.

[0046] In this embodiment, glare is calculated as an indicator of light stimulation, serving as an indicator of the glare perceived by the user U. Here, glare refers to a state in which a high-brightness light source within the field of vision makes it difficult to see visually recognizable objects or causes glare. Various formulas for quantitatively calculating glare are widely known. As an example, in this embodiment, glare is calculated based on the UGR index (hereinafter also referred to as the UGR value). The UGR index is defined by the following formula (1).

[0047]

Number 1

[0048]

[0049] In equation (1), Lb represents the background brightness, ω represents the solid angle, P represents the position index, and Lt represents the luminous brightness. These will be explained in turn below.

[0050] Background brightness Lb represents the uniform brightness in the space surrounding the user U within the field of view excluding glare from light-emitting sources. In this embodiment, considering the influence of the image interpretation display 3, background brightness Lb is calculated using the following equations (2) and (3).

[0051]

Number 2

[0052] L b =L d +L amb (2)

[0053]

Number 3

[0054] L amb =I amb ×kc (3)

[0055] In equations (2) and (3), Ld is the set brightness of the image interpretation display 3, and Lamb is the ambient brightness. Furthermore, Iamb is the ambient illuminance detected by the illuminance sensor 5, and kc is the illuminance conversion coefficient.

[0056] The solid angle ω is defined by the area of ​​the display screen 4a, which is the light-emitting part, and the distance from the user U to the light-emitting body. In this embodiment, the solid angle ω is calculated by the following equation (4).

[0057]

Number 4

[0058]

[0059] In equation (4), Ap is the display area of ​​the display screen 4a of the reference display 4, and r is the length from the user U to the center point P3 of the reference display 4. Furthermore, Lh is the horizontal length of the display screen 4a, Lv is the vertical length of the display screen 4a, and D is the vertical distance from the user U to the reference display 4 (i.e., the length of the vertical line from the user U to the vertex P2 of the reference display 4).

[0060] The position index P is a coefficient defined by the positional relationship between user U and the luminous body and user U's point of interest. In this embodiment, the position index P is calculated by the following equation (5).

[0061]

Number 5

[0062]

[0063] In equation (5), T is the length from the center point P1 of the image interpretation display 3 to the center point P3 of the reference display 4. R is the length from the center point P1 of the image interpretation display 3 to the user U. Here, it is assumed that the center point P1 is the focus of the user U. It should be noted that the focus of the user U can be changed appropriately. For example, when the user U focuses on the left half of the image interpretation display 3, the center point of the left half of the screen can also be P1. It should be noted that when the image interpretation display 3 and the reference display 4 are separated in the vertical direction, their vertical length can also be considered when setting the position index.

[0064] The luminance Lt represents the luminance of the light-emitting body within the field of view. That is, in this embodiment, the luminance Lt is equivalent to the luminance of the reference display 4. Based on equation (1), the luminance Lt can be calculated by the following equation (6).

[0065]

Number 6

[0066]

[0067] Thus, by calculating the background brightness Lb, solid angle ω, and position index P, and by using the preset target UGR value (hereinafter also referred to as the target UGR value), the luminous brightness Lt of the reference display 4 used to achieve the target UGR value can be obtained.

[0068] like Figure 4 As shown, how an observer perceives each UGR value is predefined. The brightness determination unit 22 controls the luminance Lt of the reference display 4 to achieve the preset target UGR value.

[0069] For example, in LCD displays, the brightness of the backlight is controlled to control the luminous intensity Lt, while in OLED displays, the luminous intensity Lt is controlled by controlling the current value of the LEDs. The luminous intensity Lt can also be controlled by controlling the display's gain or the video signal. Furthermore, a combination of these methods can be used for control.

[0070] (1.4. Example)

[0071] Figure 5 A is a graph showing the relationship between the set brightness Ld of the image interpretation display 3 and the ambient illuminance Iamb and luminous intensity Lt when the target UGR value is 10. From Figure 5 As can be seen from A, based on the ambient illuminance Iamb and the set brightness Ld of the image interpretation display 3, the value of the luminance Lt of the reference display 4 when the target UGR value is 10 changes. Here, the lower limit value of the luminance Lt of the reference display 4 is set to 50 (cd / m²). 2 The upper limit is 150 (cd / m³). 2 Thus, by referring to the upper and lower limits of the luminance Lt of the display 4, abrupt changes in the luminance Lt can be suppressed.

[0072] Figure 5 B is the value that makes the target UGR value 12. Figure 5 Similar diagrams to A. Below, we compare... Figure 5 A and Figure 5 B will be examined. First, as an example, we will verify the case where the target UGR value is 10 and the ambient illuminance Iamb is 100 (lux).

[0073] The image interpretation monitor's brightness setting is 35 (cd / m²). 2 When, such as Figure 5 As shown at point G2 in reference A, the luminance Lt of the reference display 4 is approximately 125 (cd / m²). 2 On the other hand, the brightness setting Ld of the image interpretation display is (cd / m²). 2 When, such as Figure 5 As shown at point G1 in reference A, the luminance Lt of the reference display 4 is approximately 90 (cd / m²). 2 ).

[0074] Thus, under the same conditions of ambient illuminance and target UGR value, the control is as follows: the higher the set brightness Ld of the image interpretation display 3, the higher the luminous brightness Lt of the reference display 4.

[0075] Next, as another example, we verified that the ambient illuminance Iamb was 100 (lux) and the image interpretation display's set brightness Ld was 35 (cd / m²). 2 (The situation is as follows.)

[0076] When the target UGR value is 10, such as Figure 5 As shown at point G2 in reference A, the luminance Lt of the reference display 4 is approximately 125 (cd / m²). 2 On the other hand, when the target UGR value is 12, such as Figure 6 As shown at point G3 in B, the upper limit of the luminance Lt of the reference display 4 is 150 (cd / m²). 2 ).

[0077] Thus, when the ambient illuminance (Iamb) and the image interpretation display's set brightness (Ld) are the same, the control is as follows: the higher the target UGR value, the higher the luminous intensity (Lt).

[0078] Thus, in this embodiment, the brightness determination unit 22 controls the brightness of the reference display 4 based on the ambient illuminance obtained by the illuminance sensor 5 and the positional relationship between the image interpretation display 3, the reference display 4, and the user U. Therefore, the brightness of one display screen can be controlled to take into account the brightness of the other display screen.

[0079] Furthermore, since rooms where X-ray images are interpreted, such as those equipped with the image display system 1 of this embodiment, are relatively dark, glare is easily perceived, making it easier to enjoy the effects of the present invention. That is, since glare from reference images such as low-priority medical cases can be reduced, users can focus on high-priority medical images. Moreover, when the medical image of interest is dark and the uninterested image is bright, the contrast increases and glare is more easily perceived, but by applying the present invention, glare can be reduced.

[0080] <2. Second Implementation>

[0081] Reference ​ The second embodiment of the present invention will be described focusing on its differences from the embodiments described above. In the second embodiment, the location where the image display system 1 is installed inside the vehicle differs from that in the first embodiment.

[0082] Specifically, in the second embodiment, the rear display 13 corresponds to the first display area, and the digital mirror 14 corresponds to the second display area. The image output unit 23 outputs rear image data to the rear display 13 and outputs mirror image data to the digital mirror 14. It should be noted that the rear display 13 refers to a display that shows images taken by a camera when the car is reversing, and is typically located in the center in front of the driver's seat. Furthermore, the digital mirror 14 refers to a display that shows images from a camera used to confirm the rear view while the car is moving, and is typically located in the center of the upper part of the windshield (the so-called rearview mirror position) or on either side of the car (the so-called side mirror position).

[0083] In this embodiment, brightness control of the digital mirror 14 via the brightness determination unit 22 is primarily performed when the car is reversing (driving backward). When reversing, the driver focuses on the rear display 13; if the light intensity from the digital mirror 14 is too high, the rear display 13 will be difficult to see. Therefore, the brightness determination unit 22 controls the brightness of the digital mirror 14 based on the ambient illuminance of the illuminance sensor 5, the brightness of the rear display, and the positional relationship between the rear display 13, the digital mirror 14, and the driver.

[0084] <3. Other Implementation Methods>

[0085] The application of this invention is not limited to the embodiments described above. For example, UGR can be used as an indicator of glare, but it is not limited to this method. Specifically, other indicators such as DGI, GI, BGI, and CGI can also be used. Furthermore, in addition to light stimulation indicators or glare indicators, indicators determined experimentally can also be used. For example, the brightness of the second display area can be determined based on statistical data such as race and age.

[0086] Furthermore, in the first embodiment, the image display system 1 includes an image interpretation display 3 as a first display area and a reference display 4 as a second display area, but is not limited to this embodiment. For example, the image display system may also have multiple first display areas and multiple second display areas.

[0087] Furthermore, the image display system 1 can also be implemented in a so-called PbyP (Picture by Picture) manner, where the first display area and the second display area are arranged side by side in a single monitor. Alternatively, it can be implemented in a so-called PinP (Picture in Picture) manner, where the area of ​​either the first display area or the second display area in a single monitor includes the other.

[0088] Furthermore, in the first embodiment, the illuminance sensor 5 is mounted on the image interpretation display 3, but this is not a limitation. For example, the illuminance sensor 5 may also be mounted on the reference display 4, or it may be disposed externally on the image interpretation display 3. Alternatively, an ambient illuminance set by the user or manufacturer may be used instead of an illuminance sensor.

[0089] Furthermore, the brightness of the second display area can be determined without using ambient illuminance. In this case, only the background brightness Lb is a variable in equation (2), and other constants can be appropriately determined. Thus, even in an environment without an illuminance sensor, glare in the second display area can be reduced.

[0090] Furthermore, in the first embodiment, the set brightness used for the brightness of the image interpretation display 3 can be, for example, a set brightness value (e.g., in the case of a liquid crystal display, the ratio relative to the backlight output value or the maximum backlight output value) or a brightness value. The brightness of the image interpretation display 3 can also be determined based on information about its intended use. Specifically, the brightness of the image interpretation display 3 can be determined based on its intended use, such as mammography or ultrasound, and / or the image data. For example, the brightness of the image interpretation display 3 can be determined based on the brightness value for the intended use, the value of a portion or center of the image data frame, the mode, center value, or average value of the histogram calculated from the image data, etc. The brightness of the image interpretation display 3 can also be determined based on information about the type of display.

[0091] Furthermore, in the first embodiment, the brightness of the image interpretation display 3 is set using a specific brightness setting, but this method is not limited to this. For example, the brightness of the image interpretation display 3 may be determined based on image data and the relationship between image data and brightness, or the brightness of the image interpretation display 3 may be determined by measuring the brightness of the display screen or the backlight using a brightness sensor.

[0092] Furthermore, in the first embodiment, the distance between the user U and the image interpretation display 3 and the reference display 4 can be a preset value, a value input by the user or manufacturer, or a value obtained by a distance sensor.

[0093] Furthermore, in the second embodiment, the rear display 13 corresponds to the first display area and the digital mirror 14 corresponds to the second display area, but this is not a limitation. For example, the head-up display shown on the windshield could also be the first display area and the digital mirror the second display area.

[0094] Alternatively, a display showing in-car TV, in-car DVD, or online information can be used as the primary display area to replace the head-up display. Alternatively, a car navigation display or dashboard (speedometer, etc.) can be used as the secondary display area to replace the digital mirror.

[0095] In addition, the present invention can be implemented as a program that enables a computer to function as the aforementioned image display system.

[0096] In addition, the present invention can be implemented as a computer-readable non-transitory recording medium storing the above-described program.

[0097] Various embodiments of the present invention have been described, but these are merely illustrative and do not limit the scope of the invention. Various omissions, substitutions, and modifications may be made to these novel embodiments without departing from the spirit of the invention. These embodiments or variations thereof are included within the scope or spirit of the invention, and are also included within the scope of the claims and their equivalents.

[0098] (Symbol Explanation)

[0099] 1: Image display system

[0100] 2: Processing unit

[0101] 3: Image interpretation monitor

[0102] 3a: Display screen

[0103] 4: Refer to the monitor

[0104] 4a: Display screen

[0105] 5: Illuminance sensor

[0106] 11: Video signal cable

[0107] 12: Control signal line

[0108] 13: Rear Display

[0109] 14: Digital mirror

[0110] 21: Data Acquisition Department

[0111] 22: Brightness Determination Section

[0112] 23: Image Output Section

[0113] 41: Brightness control unit.

Claims

1. An image display system that displays an image in a display area, The image display system includes a first display area, a second display area, and a brightness determination unit. The brightness determination unit determines the brightness of the second display area based on the brightness of the first display area and the positional relationship between the first display area, the second display area and the user, in a manner that the index value of the light stimulation perceived by the user from the second display area when the user visually confirms the first display area reaches a preset index value, and displays the second display area at the brightness.

2. The image display system according to claim 1, wherein, It also has a data acquisition department. The brightness determination unit further determines the brightness of the second display area based on the illuminance acquired by the data acquisition unit.

3. The image display system according to claim 1, wherein, The indicator of light stimulation is the indicator of the glare perceived by the user.

4. The image display system according to any one of claims 1 to 3, wherein, The brightness determination unit determines the brightness of the second display area based on at least one of the following: the size of the second display area, the distance between the first display area and the second display area, the solid angle of the user when viewing the second display area, and the distance between the user and the first display area.

5. The image display system according to any one of claims 1 to 3, wherein, The first display area is a monitor that displays medical images.

6. The image display system according to any one of claims 1 to 3, wherein, The upper and lower limits of the brightness of the second display area are preset.

7. The image display system according to any one of claims 1 to 3, wherein, The first display area and the second display area are arranged side by side in one monitor.

8. The image display system according to any one of claims 1 to 3, wherein, The first display area and the second display area are overlapped and disposed within a single display.

9. An image display method that enables a computer to function as an image display system that displays images in a display area. The image display method includes a data acquisition step and a brightness determination step. In the data acquisition step, the computer acquires the illuminance in the environment where the first display area and the second display area of ​​the image display system are set. In the brightness determination step, the computer determines the brightness of the second display area based on the illuminance acquired in the data acquisition step, the brightness of the first display area, and the positional relationship between the first display area, the second display area, and the user, in a manner that the index value of the light stimulation perceived by the user from the second display area when the user visually confirms the first display area, and displays the second display area at the brightness.

10. A computer-readable, non-transitory recording medium storing a program that enables a computer to function as an image display system for displaying images in a display area. The program causes the computer to perform a data acquisition step and a brightness determination step. In the data acquisition step, the computer acquires the illuminance in the environment where the first display area and the second display area of ​​the image display system are located. In the brightness determination step, the computer determines the brightness of the second display area based on the illuminance acquired in the data acquisition step, the brightness of the first display area, and the positional relationship between the first display area, the second display area, and the user, in a manner that the index value of the light stimulation perceived by the user from the second display area when the user visually confirms the first display area, achieves a preset index value.

Images