Image interpretation control device, image interpretation control method, and program

Abstract

To properly adjust the luminance of a screen according to a region of an image.SOLUTION: A controller 20 includes: a display control unit 25 for controlling so that a plurality of images are displayed in a display unit 12; a detection unit 21 for detecting the line of sight of a user on the display unit 12; a region determination unit 22 for determining in which one of regions formed by dividing the images the line of sight of the user is located; and a luminance adjusting unit 24 for adjusting the luminance of the images. The luminance adjusting unit 24 adjusts the luminance by increasing the luminance of each region specified by the line of sight of the user in the plurality of images.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image interpretation control device, an image interpretation control method, and a program. [Background technology]

[0002] 2. Description of the Related Art There is known a technique for adjusting the brightness of a displayed image content using a plurality of image contents with different brightnesses in accordance with a user's gaze point (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-254358 A Summary of the Invention [Problem to be solved by the invention]

[0004] Since image reading devices that display image readings perform image reading in a dark room, high screen brightness is likely to cause eye strain. In the technology of Patent Document 1, the brightness of the entire screen becomes bright, which is not preferable for image reading devices. In addition, although a method of adjusting the brightness of the image reading device by operating an input device such as a mouse is known, it is desirable to adjust the brightness more intuitively.

[0005] The present invention has been made in consideration of the above, and aims to provide an interpretation control device, an interpretation control method, and a program capable of appropriately adjusting the brightness of a screen according to the area of ​​an image. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objective, the interpretation control device of the present invention comprises a display control unit that controls the display unit to display multiple images, a detection unit that detects the user's gaze on the display unit, an area determination unit that determines where the user's gaze is located in each of multiple areas divided into the image, and a brightness adjustment unit that adjusts the brightness of the images, and the brightness adjustment unit adjusts by increasing the brightness of each area specified by the user's gaze in the multiple images.

[0007] The interpretation control method of the present invention includes a display control step of controlling the display unit to display multiple images, a detection step of detecting the user's gaze on the display unit, an area determination step of determining where the user's gaze is located in each of multiple areas divided into the image, and a brightness adjustment step of adjusting the brightness of the images, wherein the brightness adjustment step adjusts by increasing the brightness of each area specified by the user's gaze in the multiple images.

[0008] The program of the present invention includes a display control step of controlling the display unit to display multiple images, a detection step of detecting the user's gaze on the display unit, an area determination step of determining where the user's gaze is located in each of multiple areas divided into the image, and a brightness adjustment step of adjusting the brightness of the images, wherein the brightness adjustment step is performed by a computer operating as an interpretation control device to increase and adjust the brightness of each area specified by the user's gaze in the multiple images. Effect of the Invention

[0009] According to the present invention, the brightness of the screen can be appropriately adjusted depending on the area of ​​the image. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of an image reading apparatus having an image reading control apparatus according to the first embodiment. [Diagram 2]FIG. 2 is a diagram illustrating an example of an image displayed on the display unit. [Diagram 3] FIG. 3 is a diagram illustrating another example of an image displayed on the display unit. [Figure 4] FIG. 4 is a diagram illustrating another example of an image displayed on the display unit. [Diagram 5] FIG. 5 is a diagram illustrating another example of an image displayed on the display unit. [Figure 6] FIG. 6 is a flowchart showing an example of processing in the image interpretation control device according to the first embodiment. [Figure 7] FIG. 7 is a block diagram showing an example of the configuration of an image reading apparatus having an image reading control apparatus according to the second embodiment. [Figure 8] FIG. 8 is a diagram illustrating another example of an image displayed on the display unit. [Figure 9] FIG. 9 is a flowchart showing an example of processing in the image interpretation control apparatus according to the second embodiment. [Figure 10] FIG. 10 is a block diagram showing an example of the configuration of an image reading apparatus having an image reading control apparatus according to the third embodiment. [Figure 11] FIG. 11 is a flowchart showing an example of processing in the image interpretation control device according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of an image interpretation control device, an image interpretation control method, and a program according to the present invention will be described with reference to the drawings. Note that the present invention is not limited to the following embodiment.

[0012] [First embodiment] (Image reading device) FIG. 1 is a block diagram showing an example of the configuration of an image reading device 10 having a control unit 20 according to the first embodiment. The image reading device 10 is a device that reads images such as X-rays or mammograms. When reading an image, the image reading device 10 detects gaze position information indicating the gaze position of a user on a display unit 12. The image reading device 10 partially adjusts the brightness of the image to be read and displays it according to the gaze position information. The image reading device 10 has a camera 11, a display unit 12, and a control unit (image reading control device) 20.

[0013] In this embodiment, the multiple images are multiple read images that are arranged side by side for comparison in interpretation. The multiple images are, for example, multiple read images of the same part of the human body. The multiple images may be stored as multiple image data files. The multiple images may be stored as one image data file. In this embodiment, a case where there are two images will be described.

[0014] The camera 11 is a camera that captures an image of a user. The camera 11 is disposed in a position where it can capture an image of the face of a user viewing the display unit 12 of the image reading device 10. The camera 11 is configured, for example, as a visible light camera, a far-infrared camera, or a near-infrared camera. The camera 11 may be configured, for example, as a combination of a visible light camera and a far-infrared camera or a near-infrared camera. The camera 11 constantly captures an image of the user while an image is being displayed. The camera 11 outputs the captured image of the user to the detection unit 21 of the control unit 20.

[0015] The display unit 12 is a device that displays various types of information. The display unit 12 is, for example, a display including a liquid crystal display (LCD) or an organic electro-luminescence (EL) display. The display unit 12 displays an image based on an image signal output from a display control unit 25 of the control unit 20. In this embodiment, the display unit 12 displays a plurality of read images. The display unit 12 displays the read images with luminance adjusted according to the gaze position of the user.

[0016] The display unit 12 displays a plurality of images. The display unit 12 has a vertical or horizontal display screen. There may be one or more display units 12. The plurality of display units 12 may be arranged with no gaps between them, or may be arranged with a distance of about several centimeters between them. The plurality of display units 12 may be arranged side by side, and different images may be displayed on each display unit 12. A plurality of images may be displayed side by side on one display unit 12.

[0017] To display an image in a plurality of parts means to display the plurality of images side by side so that they can be compared. The plurality of images may be displayed with some parts overlapping each other as long as they can be compared.

[0018] The control unit 20 is an arithmetic processing device (control device) constituted by, for example, a CPU (Central Processing Unit) and the like. The control unit 20 loads a stored program into memory and executes instructions contained in the program. The control unit 20 includes an internal memory (not shown), which is used for temporary storage of data in the control unit 20, and the like. The control unit 20 detects gaze position information indicating the gaze position of the user on the display unit 12 during interpretation. The control unit 20 controls the brightness of the interpretation image to be adjusted and displayed according to the gaze position information. The control unit 20 includes a detection unit 21, an area determination unit 22, a determination unit 23, a brightness adjustment unit 24, and a display control unit 25.

[0019] The detection unit 21 detects the user's gaze position on the display unit 12. The detection unit 21 detects the user's gaze position on the display unit 12 on which an image of the image reading device 10 used by the user is displayed. In this embodiment, the detection unit 21 detects the user's gaze position on the image, which indicates where the user is looking in the image. The detection unit 21 acquires a user image from the camera 11. The detection unit 21 performs image processing on the acquired user image, and detects the user's gaze on the display unit 12 from the image of the user's eye. The detection unit 21 detects the user's gaze by various methods, such as detecting the gaze based on the position of the user's pupil and the position of the corneal reflection, or detecting the gaze based on the position of the user's inner corner and the position of the iris. In this way, the detection unit 21 detects gaze position information indicating the position of the user's gaze on the image.

[0020] The area determination unit 22 determines where the user's gaze is located in each of the areas obtained by dividing the image into a plurality of areas. The area determination unit 22 determines a gaze area, which is an area on the image where the user's gaze is located, based on gaze position information detected by the detection unit 21. The gaze area is an area specified by the user's gaze. The determination of the gaze area will be described below.

[0021] The area determination unit 22 may, for example, divide the display screen of the display unit 12 into a plurality of areas, determine an area in which the user's gaze position exists, and output the area as a gaze area. In this embodiment, the area determination unit 22 divides the display screen of the display unit 12 into a plurality of areas. The area determination unit 22 may, for example, divide an image displayed on the display screen of the display unit 12 into a plurality of areas, determine an area in which the user's gaze position exists, and output the area as a gaze area. The area determination unit 22 determines in which area the gaze position detected by the detection unit 21 is located. The area of ​​the area may be changed depending on the size of the display screen of the display unit 12 or the size of the area of ​​the displayed image. For example, the area of ​​the area may be made larger as the area of ​​the display screen or the area of ​​the image becomes larger.

[0022] The area determination unit 22 may determine an area of ​​a predetermined shape, such as a rectangle or a circle, centered on the user's gaze position, and output it as a gaze area in which the user's gaze position exists. The area of ​​the area of ​​the predetermined shape may be changed according to the size of the display screen of the display unit 12 or the size of the area of ​​the displayed image. For example, the area of ​​the area of ​​the predetermined shape may be made larger as the area of ​​the display screen or image becomes larger.

[0023] For example, the area determination unit 22 may determine an area on the image that the user has specified by moving the gaze position, and output it as the gaze area where the user's gaze position exists. For example, the area determination unit 22 may determine a rectangular area on the image whose diagonal line is the straight line along which the user has moved the gaze position, and output it as the gaze area where the user's gaze position exists.

[0024] The area determination unit 22 may output an area in which it is determined that the user's gaze position remains for a predetermined threshold time or more as a gaze area.

[0025] Determination unit 23 determines whether a single image or multiple images are displayed on display unit 12. Determination unit 23 may determine that multiple images are displayed when multiple images are displayed on one display unit 12. Determination unit 23 may determine that multiple images are displayed when images are displayed on multiple display units 12, for example.

[0026] The determination unit 23 may determine that a plurality of images are displayed on the display unit 12 based on, for example, an image signal output from the display control unit 25. The determination unit 23 may determine that a plurality of images are displayed by, for example, performing an image recognition process on the image displayed on the display unit 12 and detecting a frame or the like indicating the boundary of the image. The determination unit 23 may determine that a plurality of images are displayed based on a photographed object included in the image by, for example, performing an image recognition process on the image displayed on the display unit 12. The determination unit 23 may determine that a plurality of images are displayed based on the number of images selected to be displayed on the display unit 12 based on, for example, operation information from an operation unit (not shown). The method by which the determination unit 23 recognizes the number of images displayed on the display unit 12 may be a known method and is not limited.

[0027] The luminance adjustment unit 24 adjusts the luminance of the image. When an area is specified in the image by the user's line of sight, the luminance adjustment unit 24 adjusts the brightness so as to lower the overall luminance of the screen from the initial state. More specifically, when the determination unit 23 determines that a plurality of images are displayed, the luminance adjustment unit 24 adjusts the luminance of each area specified by the user's line of sight for the plurality of images by increasing it. The luminance adjustment unit 24 adjusts the luminance of the area specified by the user's line of sight for the image that the user is paying attention to by increasing it from the luminance outside the area. The luminance adjustment unit 24 adjusts the luminance of the area outside the area by decreasing it from the luminance of the initial state when the image is displayed on the display unit 12. Then, when the user's line of sight moves to another image, the adjustment of the luminance of the original image before the line of sight movement is maintained. Then, the luminance adjustment unit 24 adjusts the luminance of the area specified by the user's line of sight for the other image to which the user's line of sight has moved by increasing it from the luminance outside the area. In this manner, the luminance of each area of ​​the plurality of images is increased.

[0028] The luminance adjustment unit 24 generates a control signal that controls the luminance of the backlight of the display unit 12. The luminance adjustment unit 24 outputs a control signal that makes the luminance of an area higher than the luminance outside the area. When the luminance of the backlight is increased, the luminance of the screen when an image is displayed on the display unit 12 increases. When the luminance of the backlight is decreased, the luminance of the screen when an image is displayed on the display unit 12 decreases.

[0029] Alternatively, the brightness adjustment unit 24 generates an image in which the brightness of each pixel of the image is adjusted. The brightness adjustment unit 24 generates an image in which the brightness of pixels in a region of the image is made higher than the brightness of pixels outside the region. In this case, the image whose brightness has been corrected by the brightness adjustment unit 24 is displayed on the display unit 12 by the display control unit 25.

[0030] The luminance adjustment unit 24 resets the luminance of the image. More specifically, when the luminance adjustment unit 24 determines that the user's line of sight has moved, it resets the luminance. For example, when the luminance of an area of ​​one image is adjusted and the user's line of sight moves to another area in the image, the area of ​​the image whose luminance has been adjusted changes in accordance with the line of sight. For example, when the luminance of areas of multiple images is adjusted and the user's line of sight moves to another area, the luminance of the areas of the multiple images is reset. Then, in the image where the line of sight has moved to another area, the luminance of the area specified by the user's line of sight is increased and adjusted. Resetting the luminance of an image means returning it to the initial luminance state of the image.

[0031] The display control unit 25 controls the display unit 12 to display a plurality of images. The display control unit 25 controls the display unit 12 to display an image divided into a plurality of parts. The display control unit 25 controls, for example, one display unit 12 to display a plurality of images divided into a plurality of parts. In other words, the display control unit 25 controls, for example, one display unit 12 to display a plurality of images side by side. The display control unit 25 controls, for example, the plurality of display units 12 to display different images. The display control unit 25 controls the brightness adjustment unit 24 to display an image whose brightness has been adjusted. The display control unit 25 outputs an image signal that causes the display unit 12 to output the image.

[0032] Fig. 2 is a diagram illustrating an example of an image 100 displayed on the display unit 12. In this embodiment, two images 100 are displayed on one display unit 12. In the state shown in Fig. 2, no area is specified by the user's line of sight, and the brightness of the screen is in the initial state. Images 1001 and 1002 are displayed on the display unit 12. The brightness of the images 1001 and 1002 has been adjusted by increasing the overall brightness.

[0033] Fig. 3 is a diagram illustrating another example of image 100 displayed on display unit 12. In the state shown in Fig. 3, an area is specified by the user's gaze E. Images 1001 and 1002 have their brightness adjusted by lowering the overall brightness. Image 1001 has its brightness adjusted by increasing only the area 1001P in the upper left corner of image 1001, which is specified by the user's gaze E.

[0034] Fig. 4 is a diagram illustrating another example of image 100 displayed on display unit 12. In the state shown in Fig. 4, an area is specified by the user's gaze E. Images 1001 and 1002 have their brightness adjusted by lowering the overall brightness. Image 1001 has been adjusted by increasing the brightness of only area 1001P specified by the user's gaze E in Fig. 3. Image 1002 has been adjusted by increasing the brightness of only area 1002P specified by the user's gaze E. In this way, the brightness of areas 1001P and 1002P is increased.

[0035] Fig. 5 is a diagram illustrating another example of image 100 displayed on display unit 12. In the state shown in Fig. 5, an area is specified by the user's gaze E. Images 1001 and 1002 have their brightness adjusted by lowering the overall brightness. Image 1001 has its brightness adjusted by increasing only the area 1001P at the bottom left of image 1001, which is specified by the user's gaze E.

[0036] (Processing in image reading device) Next, the process in the image reading device 10 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the process in the control unit 20 according to the first embodiment. When the image reading device 10 is started up and a process of displaying an image on the display unit 12 is being performed, the process of the flowchart shown in Fig. 6 is performed.

[0037] The control unit 20 displays an image (step S101). More specifically, the control unit 20 controls the display control unit 25 to display an image on the display unit 12, which displays the image divided into multiple parts. In this embodiment, the control unit 20 controls the display control unit 25 to display two images side by side on one display unit 12. The control unit 20 proceeds to step S102.

[0038] In step S101, for example, an image 1001 and an image 1002 shown in FIG.

[0039] The control unit 20 judges whether or not a plurality of images are displayed (step S102). More specifically, the control unit 20 judges whether or not a plurality of images are displayed on the display unit 12 by the judgment unit 23, for example, based on an image signal output from the display control unit 25. The control unit 20 judges that a plurality of images are displayed by performing, for example, image recognition processing on the image displayed on the display unit 12 by the judgment unit 23, and detects a frame or the like indicating the boundary of the image. The control unit 20 judges that a plurality of images are displayed by performing, for example, image recognition processing on the image displayed on the display unit 12 by the judgment unit 23, and judges that a plurality of images are displayed based on a photographed object included in the image. The control unit 20 judges that a plurality of images are displayed by the judgment unit 23, for example, based on operation information from an operation unit not shown, based on the number of images selected to be displayed on the display unit 12. When the control unit 20 judges that a plurality of images are displayed by the judgment unit 23 (Yes in step S102), the control unit 20 proceeds to step S103. When the determination unit 23 does not determine that a plurality of images are being displayed (No in step S102), the control unit 20 ends the process.

[0040] When it is determined that a plurality of images are being displayed (Yes in step S102), the control unit 20 starts gaze detection (step S103). More specifically, the control unit 20 causes the detection unit 21 to perform image processing on the user image to calculate the user's gaze position on the display unit 12 of the image reading device 10 used by the user. The control unit 20 causes the detection unit 21 to calculate gaze position information indicating the user's gaze position on the image. The control unit 20 proceeds to step S104.

[0041] The control unit 20 starts the area determination (step S104). More specifically, the control unit 20 determines the area in which the user's gaze is located, using the area determination unit 22, based on the gaze position information detected by the detection unit 21. The control unit 20 proceeds to step S105.

[0042] The control unit 20 adjusts the brightness of the image (step S105). More specifically, the control unit 20 adjusts the brightness of the area of ​​the image designated by the user's line of sight by increasing it using the brightness adjustment unit 24. The control unit 20 proceeds to step S106.

[0043] In step S105, for example, images 1001 and 1002 shown in Fig. 3 are displayed on the display unit 12. The overall brightness of the screen when the images 1001 and 1002 are displayed is lower than that in Fig. 2. The brightness of only the upper left region 1001P of the image 1001 is adjusted by increasing it.

[0044] The control unit 20 determines whether the gaze has moved to another image (step S106). More specifically, the control unit 20 determines whether the user's gaze has moved to another image based on the gaze position information detected by the detection unit 21. When the control unit 20 determines that the gaze has moved to another image (Yes in step S106), the control unit 20 proceeds to step S107. When the control unit 20 does not determine that the gaze has moved to another image (No in step S106), the control unit 20 proceeds to step S111.

[0045] When it is determined that the gaze has moved to another image (Yes in step S106), the control unit 20 adjusts the luminance of the other image (step S107). More specifically, the control unit 20 adjusts the luminance of the area designated by the user's gaze in the other image by increasing it using the luminance adjustment unit 24. The control unit 20 proceeds to step S108.

[0046] 4 are displayed on the display unit 12. In addition to the upper left region 1001P of the image 1001, the upper left region 1002P of the image 1002 is adjusted to have an increased brightness.

[0047] The control unit 20 determines whether the gaze has moved to another area (step S108). More specifically, the control unit 20 determines whether the user's gaze has moved to another area based on the gaze position information detected by the detection unit 21. The other area is, for example, an area other than an area in which the brightness of the original image or another image has been adjusted. If the control unit 20 determines that the gaze has moved to another area (Yes in step S108), the control unit 20 proceeds to step S109. If the control unit 20 does not determine that the gaze has moved to another area (No in step S108), the control unit 20 proceeds to step S111.

[0048] When it is determined that the line of sight has moved to another area (Yes in step S108), control unit 20 resets the luminance (step S109). More specifically, control unit 20 resets the luminance of the area where luminance adjustment unit 24 has increased and adjusted the screen luminance of the image displayed on display unit 12. Control unit 20 proceeds to step S110.

[0049] The control unit 20 adjusts the brightness of the image (step S110). More specifically, the control unit 20 adjusts the brightness of another area specified by the user's line of sight by increasing it using the brightness adjustment unit 24. The control unit 20 proceeds to step S111.

[0050] 5 are displayed on the display unit 12. The brightness adjusted in steps S105 and S107 has been reset. The brightness of only the lower left area 1001P of the image 1001 has been adjusted to be higher.

[0051] The control unit 20 determines whether or not to end the process (step S111). More specifically, the control unit 20 determines to end the process when, for example, an operation to end the process of displaying an image is performed, an operation to change the image to be displayed is performed, or the power supply of the image reading device 10 is turned off. When the control unit 20 determines to end the process (Yes in step S111), it ends the process. When the control unit 20 does not determine to end the process (No in step S111), it executes the process of step S106 again.

[0052] (effect) As described above, in this embodiment, when multiple images are displayed on the display unit 12, the brightness of only the area of ​​the multiple images specified by the user's line of sight can be increased and adjusted. This embodiment can reduce the area of ​​the area where the brightness is increased. According to this embodiment, the brightness of the screen can be appropriately adjusted according to the area of ​​the image. According to this embodiment, eye strain caused by high brightness can be suppressed.

[0053] In this embodiment, the user can specify an area by the line of sight without needing to operate the input device by the user. According to this embodiment, the user can specify an area intuitively.

[0054] [Second embodiment] With reference to Figs. 7 to 9, the image reading device 10A having the control unit 20A according to this embodiment will be described. Fig. 7 is a block diagram showing an example of the configuration of the image reading device 10A having the control unit 20A according to the second embodiment. Fig. 8 is a diagram for explaining another example of an image displayed on the display unit 12. Fig. 9 is a flowchart showing an example of processing in the control unit 20A according to the second embodiment. The image reading device 10A has a basic configuration similar to that of the image reading device 10 of the first embodiment. In the following description, the same or corresponding reference symbols are used for the same components as those of the image reading device 10, and detailed description thereof will be omitted. The control unit 20A of this embodiment differs from the first embodiment in that it has a distance measurement unit 26A and in the processing in the brightness adjustment unit 24A.

[0055] The distance measurement unit 26A measures the distance between each area specified by the user's line of sight for each image. In this embodiment, the distance measurement unit 26A measures the distance between each area when the user specifies areas in multiple images. The method of measuring the distance between areas may be to measure the distance between the points where a line connecting the centers of each area intersects with the boundary of each area.

[0056] When the distance is equal to or greater than a threshold, the brightness adjustment unit 24A adjusts the brightness by increasing the brightness of each region of the multiple images. More specifically, when the distance is equal to or greater than a threshold, the brightness adjustment unit 24A adjusts the brightness of the region specified by the user's line of sight and the portion connecting the region, based on the measurement result of the distance measurement unit 26A. When the distance is equal to or greater than a threshold, the user's line of sight passes through a dark region when moving between regions, and pupil accommodation is required. In order to compare multiple regions, it is easier to see the difference if the regions are compared without pupil accommodation. Therefore, in order to avoid pupil accommodation, the brightness of the range through which the user's line of sight passes is increased and adjusted when the distance is equal to or greater than a threshold.

[0057] When the regions of the multiple images are at the same height on the display screen, the luminance of the portions between the regions extending horizontally across the multiple images is adjusted by increasing the luminance, and when the regions of the multiple images are at different heights on the display screen, the luminance of the portions between the regions extending diagonally across the multiple images is adjusted by increasing the luminance.

[0058] The threshold value is a constant value even if the size of the display screen of the display unit 12 or the size of the area of ​​the displayed image changes. For example, a threshold value may be set for each user who compares images.

[0059] Another example of image 100 displayed on display unit 12 will be described with reference to Fig. 8. In the state shown in Fig. 8, an area is specified by the user's gaze E. Images 1001 and 1002 have their brightness adjusted by lowering the overall brightness. Image 100 has its brightness adjusted by increasing the brightness of area 1001P at the top left of image 1001 and area 1002P at the top left of image 1002, which are specified by the user's gaze E, and the portion connecting these areas.

[0060] Next, the process in the image reading apparatus 10A will be described with reference to Fig. 9. The processes in steps S121 to S126 and steps S130 to S134 are similar to the processes in steps S101 to S106 and steps S107 to S111 in the flowchart shown in Fig. 6.

[0061] Control unit 20A measures the distance between the regions (step S127). More specifically, control unit 20A measures the distance between the regions designated by the user's line of sight for the multiple images using distance measurement unit 26A. Control unit 20A proceeds to step S128.

[0062] The control unit 20A determines whether the distance is equal to or greater than the threshold (step S128). More specifically, when the control unit 20A determines that the distance is equal to or greater than the threshold (Yes in step S128), the process proceeds to step S129. When the control unit 20A does not determine that the distance is equal to or greater than the threshold (No in step S128), the process proceeds to step S130.

[0063] When it is determined that the distance is equal to or greater than the threshold (Yes in step S128), control unit 20A adjusts the luminance by connecting the regions (step S129). More specifically, control unit 20A adjusts the luminance by increasing the luminance of the portion connecting the region designated by the user's line of sight on the other image and the region in which the luminance adjustment of the original image before the line of sight was maintained. Control unit 20A proceeds to step S131.

[0064] 8 are displayed on the display unit 12. The brightness of an upper left area 1001P of the image 1001 and an upper left area 1002P of the image 1002, and the portion connecting these areas, is adjusted by increasing the brightness.

[0065] As described above, in this embodiment, when the distance between the areas specified by the user's gaze is equal to or greater than a threshold, the brightness of the portion connecting the areas can be adjusted by increasing it. According to this embodiment, when the user's gaze moves between the areas to compare two images, there is no difference in brightness, making it easy to compare without pupil accommodation.

[0066] [Third embodiment] With reference to Figs. 10 and 11, the image reading device 10B having the control unit 20B according to this embodiment will be described. Fig. 10 is a block diagram showing an example of the configuration of the image reading device 10B having the control unit 20B according to the third embodiment. Fig. 11 is a flowchart showing an example of processing in the control unit 20B according to the third embodiment. The image reading device 10B has a basic configuration similar to that of the image reading device 10 of the first embodiment. In the following description, the same or corresponding reference symbols are used for components similar to those of the image reading device 10, and detailed description thereof will be omitted. The control unit 20B of this embodiment differs from the first embodiment in that it has a pupil measurement unit 27B and in the processing in the brightness adjustment unit 24B.

[0067] The pupil measurement unit 27B measures the size of the user's pupil. More specifically, the pupil measurement unit 27B measures the size of the user's pupil from the user image captured by the camera 11. A known method can be used as a method for measuring the size of the user's pupil from the user image, and is not limited thereto.

[0068] When the user alternately views each area specified by the user's gaze on the multiple images, if the size of the pupil exceeds a threshold, the brightness adjustment unit 24B adjusts by increasing the brightness of the part connecting the areas specified by the user's gaze on the multiple images. More specifically, when the detection unit 21 detects that the gaze is moving between each area specified by the user's gaze on the multiple images and the measurement result of the pupil measurement unit 27B shows that the size of the pupil exceeds a threshold, the brightness adjustment unit 24B adjusts by increasing the brightness of the part connecting the areas.

[0069] When the size of the user's pupil exceeds a threshold, pupil accommodation is performed. Therefore, in order to enable comparison of multiple images without pupil accommodation, the brightness of the area through which the user's line of sight passes is increased and adjusted when the size of the pupil exceeds a threshold.

[0070] The threshold value of the pupil size may be, for example, a predetermined size that is determined in advance. The threshold value of the pupil size may be, for example, a size equal to or larger than a predetermined percentage of the pupil size when viewing an image of normal brightness.

[0071] Next, the process in the image reading device 10B will be described with reference to Fig. 11. The processes in steps S141 to S147 and steps S151 to S154 are similar to the processes in steps S101 to S107 and steps S108 to S111 in the flowchart shown in Fig. 6.

[0072] The control unit 20B measures the size of the pupil (step S148). More specifically, the control unit 20B measures the size of the pupil of the user by the pupil measurement unit 27B. The control unit 20B proceeds to step S149.

[0073] The control unit 20B determines whether the pupil size exceeds the threshold value (step S149). More specifically, if the control unit 20B determines that the pupil size exceeds the threshold value (Yes in step S149), the process proceeds to step S150. If the control unit 20B does not determine that the pupil size exceeds the threshold value (No in step S149), the process proceeds to step S151.

[0074] When it is determined that the pupil size exceeds the threshold value (Yes in step S149), the control unit 20B adjusts the luminance by connecting the areas (step S150). More specifically, the control unit 20B adjusts the luminance by increasing the luminance of the part connecting the areas specified by the user's line of sight for the multiple images using the luminance adjustment unit 24B. The control unit 20B proceeds to step S151.

[0075] In step S149, for example, an image 1001 and an image 1002 shown in FIG.

[0076] As described above, in this embodiment, when the user alternately views areas specified by the user's line of sight on multiple images, if the size of the pupil exceeds a threshold, the brightness of the part connecting the areas can be increased and adjusted. According to this embodiment, since there is no difference in brightness when the user's line of sight moves between areas, the change in pupil size can be reduced.

[0077] Each component of the illustrated image reading device is a functional concept, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of the device may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0078] The configuration of the image reading device is realized, for example, as software, by a program loaded into a memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms by only hardware, only software, or a combination of both.

[0079] The components described above include those that a person skilled in the art can easily imagine and those that are substantially the same. Furthermore, the configurations described above can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible without departing from the scope of the present invention.

[0080] 9, after the determination in step S126 is Yes, step S130 may be executed before proceeding to step S127. In this case, after adjusting the luminance of the region of the other image in step S130, the distance between the regions may be measured in step S127.

[0081] This disclosure includes matters that contribute to the realization of the Sustainable Development Goals (SDGs) of "Good health and well-being for all," and contribute to value creation through healthcare products and services. [Explanation of symbols]

[0082] 10 Image Reading Device 11 Camera 12 Display section 20 Control unit (image reading control device) 21 Detection unit 22 Area determination section 23 Judgment section 24 Brightness adjustment section 25 Display control section 100 images 100P area E line of sight

Claims

1. A display control unit that controls the display unit to display a plurality of images; A detection unit that detects a user's line of sight on the display unit; an area determination unit that determines where the user's gaze is located in each of a plurality of divided areas of the image; A brightness adjustment unit that adjusts the brightness of the image; Equipped with The brightness adjustment unit adjusts the brightness of each of the areas designated by the user's line of sight in the plurality of images by increasing the brightness. Image reading control device.

2. a distance measurement unit that measures the distance between each of the regions designated by the user's line of sight in the plurality of images; Equipped with The brightness adjustment unit adjusts the brightness by increasing the brightness of a portion connecting the regions where the distance is equal to or greater than a threshold value. The image interpretation control device according to claim 1 .

3. a pupil measurement unit for measuring the size of the user's pupil; Equipped with When the detection unit detects that the user's line of sight is moving between the areas designated in each of the images, and the size of the pupil measured by the pupil measurement unit exceeds a threshold value, the brightness adjustment unit increases and adjusts the brightness of the portion connecting the designated areas. The image interpretation control device according to claim 1 .

4. a display control step of controlling the display unit to display a plurality of images; A detection step of detecting a line of sight of a user on the display unit; an area determination step of determining where the user's gaze is located in each of a plurality of areas obtained by dividing the image; a brightness adjustment step of adjusting the brightness of the image; Including, The brightness adjustment step adjusts the brightness of each of the areas designated by the user's line of sight in the plurality of images by increasing the brightness. Image reading control method.

5. a display control step of controlling the display unit to display a plurality of images; A detection step of detecting a line of sight of a user on the display unit; an area determination step of determining where the user's gaze is located in each of a plurality of areas obtained by dividing the image; a brightness adjustment step of adjusting the brightness of the image; Including, The brightness adjustment step adjusts the brightness of each of the areas designated by the user's line of sight in the plurality of images by increasing the brightness. A program executed by a computer operating as an image interpretation control device.

Images