Information display device, information display method, and program

Abstract

To improve visibility even when it is bright around an information display device.SOLUTION: An information display device is mounted on the head of a user, and comprises: a display unit; a light blocking unit that is arranged in front of the display unit and facing the display unit, and transmits or blocks incident light; a first imaging unit that picks up an image of the front of the user who views the display unit; an imaging control unit that detects the display device from the picked-up image, and determines an area including the detected display device as a specific frame area; a light blocking control unit that sets, in the light blocking unit, an area other than an area corresponding to the specific frame area as a light blocking area, and performs light blocking control on the light blocking area; a storage unit that stores in advance assistance information for assisting image reading; a display control unit that sets, in the display unit, the area other than the area corresponding to the specific frame area as a display setting area, and displays the assistance information in the display setting area; and an information acquisition unit that acquires the assistance information from the storage unit on the basis of the image displayed on the display device detected by the imaging control unit.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information display device, an information display method, and a program. [Background technology]

[0002] There are known display devices that are worn on the user's head when used. For example, Patent Document 1 discloses a head-mounted display device that can suppress degradation of image quality caused by the incidence of external light. For example, Patent Document 2 discloses a technology for displaying an augmented reality image by adjusting the opacity of a transmission lens of a head-mounted display. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6003903 [Patent Document 2] Patent No. 5801401 Summary of the Invention [Problem to be solved by the invention]

[0004] By the way, when a doctor reads a medical image displayed on a medical monitor, the doctor may read the image in a dark environment to improve visibility. It is desirable to improve visibility in a bright environment without making the environment dark.

[0005] An object of the present invention is to provide an information display device, an information display method, and a program that can improve visibility even in bright surroundings. [Means for solving the problem]

[0006] The information display device of the present invention is an information display device worn on a user's head, comprising: a display unit; a light shielding unit disposed in front of the display unit facing the display unit and transmitting or shielding incident light entirely or partially; a first imaging unit that captures an image in front of a user viewing the display unit; an imaging control unit that detects a display device from the captured image and determines an area including the detected display device as a specific frame area; a light shielding control unit that sets an area in the light shielding unit other than an area corresponding to the specific frame area as a light shielding area and controls light shielding of the set light shielding area; The device comprises a memory unit that pre-stores the positional relationship between the position of the imaging area, the position of the maximum display area which is the area in which the display unit can display, and the position of the maximum light-shielding area which is the area in which the light-shielding unit can block light, as well as auxiliary information which is an image signal to assist in interpretation; a display control unit that sets an area in the display unit other than the area corresponding to the specific frame area as a display setting area, and controls the display unit to display the auxiliary information in the set display setting area; and an information acquisition unit that acquires the auxiliary information from the memory unit based on the image displayed on the display device detected by the imaging control unit.

[0007] The information display method of the present invention includes the steps of capturing an image in front of a user, detecting a display device from the captured image and determining an area including the detected display device as a specific frame area, setting an area other than the area corresponding to the specific frame area as a shading area and controlling shading of the set shading area, setting an area other than the area corresponding to the specific frame area as a display setting area, acquiring auxiliary information based on the image displayed on the display device, and controlling the auxiliary information to be displayed in the set display setting area.

[0008] The program of the present invention causes a computer to execute the steps of capturing an image in front of a user, detecting a display device from the captured image and determining an area including the detected display device as a specific frame area, setting an area other than the area corresponding to the specific frame area as a shading area and performing shading control on the set shading area, setting an area other than the area corresponding to the specific frame area as a display setting area, acquiring auxiliary information based on the image displayed on the display device, and controlling the display of the auxiliary information in the set display setting area. Effect of the Invention

[0009] According to the present invention, visibility can be improved even in bright surroundings. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an information display system according to the first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the information display device according to the first embodiment. [Diagram 3] FIG. 3 is a block diagram showing an example of the configuration of the information display device according to the first embodiment. [Figure 4] FIG. 4 is a diagram for explaining the positional relationship between the imaging region, the maximum display region, and the maximum light-shielded region according to the first embodiment. [Diagram 5] FIG. 5 is a flowchart showing the flow of the information display process according to the first embodiment. [Figure 6] FIG. 6 is a diagram for explaining a method for determining a specific frame region according to the first embodiment. [Figure 7] FIG. 7 is a diagram for explaining a method for determining a light-blocking region according to the first embodiment. [Figure 8] FIG. 8 is a diagram for explaining a method for determining a display setting region according to the first embodiment. [Figure 9]FIG. 9 is a diagram for explaining a method for displaying auxiliary information according to the first embodiment. [Figure 10] FIG. 10 is a flowchart showing the flow of information display processing according to the second embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of the configuration of an information processing system according to the third embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of an information display device according to the third embodiment. [Figure 13] FIG. 13 is a block diagram showing an example of the configuration of an information display device according to the third embodiment. [Figure 14] FIG. 14 is a flowchart showing the flow of information display processing according to the third embodiment. [Figure 15] FIG. 15 is a flowchart showing the flow of gaze detection processing according to the third embodiment. [Figure 16] FIG. 16 is a block diagram showing an example of the configuration of a display device according to the third embodiment. [Figure 17] FIG. 17 is a flowchart showing the flow of display processing of the display device according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to this embodiment, and in the following embodiments, the same components are designated by the same reference numerals, and duplicated explanations will be omitted.

[0012] [First embodiment] (Information Display System) The information display system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of the information display system according to the first embodiment.

[0013] 1, the information display system 1 includes a display device 10 and an information display device 12. The information display system 1 is a system used when a doctor interprets a medical image.

[0014] The display device 10 is a medical monitor that displays medical images such as X-rays or mammograms. A doctor examines a patient by reading the radiographed image displayed on the display device 10.

[0015] The information display device 12 is a display device that displays various types of auxiliary information for assisting in reading when a doctor reads using the display device 10. The information display device 12 displays auxiliary information corresponding to the medical image displayed on the display device 10. The information display device 12 is, for example, a device worn on the head of a user (e.g., a doctor). The information display device 12 is, for example, a glasses-type device such as AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, or MR (Mixed Reality) glasses. The information display device 12 may be, for example, a goggle-type device. The information display device 12 may be, for example, a head-mounted type device such as a VR head-mounted display. A doctor can appropriately diagnose a patient by visually recognizing the auxiliary information displayed on the information display device 12 while visually recognizing the medical image displayed on the display device 10. Hereinafter, it will be described assuming that the user wearing the information display device 12 is a doctor.

[0016] (Information display device) The information display device according to the first embodiment will be described with reference to FIGS. 2 and 3. FIG. 2 is a diagram showing an example of the information display device according to the first embodiment. FIG. 3 is a block diagram showing a configuration example of the information display device according to the first embodiment.

[0017] As shown in FIGS. 2 and 3, the information display device 12 includes a first imaging unit 20, a display unit 24, a light shielding unit 26, a storage unit 28, and a control unit 30. As shown in FIG. 2, the information display device 12 is, for example, a glasses-type device. The information display device 12 is worn by a doctor.

[0018] The first imaging unit 20 is a camera provided to capture an image in front of the information display device 12. The first imaging unit 20 captures an image of the display device 10 when a doctor interprets the medical image IM displayed on the display device. The first imaging unit 20 captures an image of the medical image IM displayed on the display device 10 when a doctor interprets the medical image IM displayed on the display device 10. The range of the image captured by the first imaging unit 20 is called the imaging area.

[0019] The display unit 24 displays various types of information. The display unit 24 is a transparent display that transmits light and allows the view ahead to be seen through. The display unit 24 is, for example, a self-luminous display such as an organic EL (Electro Luminescence) display. The display unit 24 displays auxiliary information corresponding to the medical images IM captured by the first imaging unit 20, to assist a doctor in interpreting the medical images IM. The maximum range that the display unit 24 can display is called the maximum display area.

[0020] The light shielding portion 26 is disposed in front of the display portion 24. The light shielding portion 26 is disposed facing the display portion 24. The light shielding portion 26 shields light incident on the information display device 12. The light shielding portion 26 is composed of, for example, a liquid crystal element. In this case, the light shielding portion 26 changes the orientation state of the liquid crystal due to the applied voltage, and transmits or blocks light incident on the information display device 12. The light shielding portion 26 can change the orientation state of the liquid crystal at any location. That is, the light shielding portion 26 can transmit or block incident light at any location. The maximum range that the light shielding portion 26 can block light is called the maximum light shielding region. The area of ​​the maximum light shielding region is the same as or larger than the area of ​​the maximum display region.

[0021] The storage unit 28 stores various types of information. For example, the storage unit 28 stores information such as the contents of calculations and programs of the control unit 30. For example, the storage unit 28 includes at least one of a RAM (Random Access Memory), a main storage device such as a ROM (Read Only Memory), and an external storage device such as an HDD (Hard Disk Drive).

[0022] The storage unit 28 stores auxiliary information for assisting a doctor in interpreting a medical image IM in association with the medical image IM. The auxiliary information may include various types of information, such as text, graphs, tables, and photographs. The auxiliary information may include, for example, patient information on a patient corresponding to the medical image IM. The patient information may include various biological information of the patient. The patient information may include, for example, information on age, sex, blood type, disease suffered from, administered medication, and hospital history. The auxiliary information may include, for example, a diagnosis result by AI (Artificial Intelligence) for the target medical image IM. In this case, the diagnosis result may be generated by an AI model that inputs the medical image IM and outputs the diagnosis result. The auxiliary information may include multiple diagnosis results by multiple AIs for the same medical image IM.

[0023] The storage unit 28 stores, for example, information regarding the positional relationship between the imaging area of ​​the image captured by the first imaging unit 20, the maximum display area on the display unit 24, and the maximum light-shielding area of ​​the light-shielding unit 26. FIG. 4 is a diagram for explaining the positional relationship between the imaging area, the maximum display area, and the maximum light-shielding area according to the first embodiment. FIG. 4 shows an imaging area 200, a maximum display area 201, and a maximum light-shielding area 202. The maximum display area 201 is the entire area of ​​the screen of the display unit 24. The maximum light-shielding area 202 is the entire area of ​​the light-shielding unit 26. The area of ​​the maximum light-shielding area 202 is the same as or larger than the area of ​​the maximum display area 201. That is, the light-shielding unit 26 can cover the entire display unit 24.

[0024] The storage unit 28 may store, for example, shape information of the display device 10. The storage unit 28 may store, for example, shape information for each model number of the display device 10. The storage unit 28 may store, for example, model number information for each display device 10.

[0025] The control unit 30 controls each unit of the information display device 12. The control unit 30 has, for example, an information processing device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM or a ROM. The control unit 30 executes a program that controls the operation of the information display device 12. The control unit 30 may be realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 30 may be realized by a combination of hardware and software.

[0026] The control unit 30 includes an imaging control unit 40, a light blocking control unit 42, an information acquisition unit 44, and a display control unit 46.

[0027] The imaging control unit 40 controls the first imaging unit 20 to capture an image. For example, the imaging control unit 40 executes an image recognition process on the captured image, and detects the display device 10 within the imaging region 200 based on the shape information stored in the storage unit 28. When the imaging control unit 40 detects a display device, it determines an area including the detected display device 10 as a specific frame region.

[0028] The imaging control unit 40 may detect the display device 10 by detecting a bezel (frame) of the display device 10, for example.

[0029] The light-shielding control unit 42 applies a voltage to the light-shielding unit 26 to control the state of the light-shielding unit 26. The light-shielding control unit 42 sets, as a light-shielding region, the region of the light-shielding unit 26 other than the region corresponding to the specific frame region. The light-shielding control unit 42 controls the light-shielding region to a light-shielded state.

[0030] The information acquisition unit 44 acquires auxiliary information for assisting in interpretation of the medical image IM based on the medical image IM captured by the first imaging unit 20. For example, the information acquisition unit 44 acquires the auxiliary information associated with the medical image IM from the storage unit 28.

[0031] The display control unit 46 controls the display unit 24 to display various information. The display control unit 46 sets an area other than the area corresponding to the specific frame area as a display setting area on the display unit 24. The display control unit 46 controls the display unit 24 to display auxiliary information in the display setting area.

[0032] (Information display processing) The information display process according to the first embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the flow of the information display process according to the first embodiment.

[0033] The imaging control unit 40 controls the first imaging unit 20 to capture an image in front of the information display device 12 (step S10). The imaging control unit 40 acquires the image captured by the first imaging unit 20. Then, the process proceeds to step S12.

[0034] The imaging control unit 40 detects the display device 10 displaying the medical image IM from the image in front of the information display device 12 (step S12). The imaging control unit 40 detects the display device 10, for example, by performing image recognition processing on the image acquired by the imaging control unit 40. Then, the process proceeds to step S14.

[0035] The imaging control unit 40 determines the area including the display device 10 detected within the imaging area 200 as the specific frame area (step S14). FIG. 6 is a diagram for explaining a method for determining the specific frame area according to the first embodiment. In the example shown in FIG. 6, the light blocking unit 26 and the display unit 24 are in a transparent state. The doctor wearing the information display device 12 visually checks the state ahead through the light blocking unit 26 and the display unit 24. The imaging control unit 40 specifies the area including the display device 10 displaying the medical image IM visually recognized by the doctor. Then, for example, when the display device 10 visually recognized by the doctor and the display device 10 displaying the detected medical image IM are the same, the imaging control unit 40 determines the area including the display device 10 as the specific frame area 210. Whether the display device 10 visually recognized by the doctor and the display device 10 displaying the detected medical image IM are the same or not may be determined by the imaging control unit 40, for example, by image recognition processing or the like. Then, the process proceeds to step S16.

[0036] The light blocking control unit 42 determines whether or not the specific frame region is within the maximum light blocking region (step S16). Specifically, the light blocking control unit 42 determines whether or not the specific frame region 210 shown in Fig. 6 is included within the maximum light blocking region 202 shown in Fig. 4. If it is determined that the specific frame region is within the maximum light blocking region (step S16; Yes), the process proceeds to step S18. If it is determined that the specific frame region is outside the maximum light blocking region (step S16; No), the process of step S16 is repeated.

[0037] The light blocking control unit 42 determines a light blocking region in the light blocking unit 26 (step S18). Specifically, in the example shown in Fig. 6, the light blocking control unit 42 determines the region 211 other than the specific frame region 210 in the light blocking unit 26 as the light blocking region. Then, the process proceeds to step S20.

[0038] The light-shielding control unit 42 blocks the light-shielded area (step S20). FIG. 7 is a diagram for explaining a method of blocking light from the light-shielded area according to the first embodiment. As shown in FIG. 7, the light-shielding control unit 42 controls the light-shielding unit 26 of the area 211 determined as the light-shielded area to block light. Specifically, the light-shielding control unit 42 applies a voltage to the light-shielding unit 26 to put the area of ​​the light-shielding unit 26 corresponding to the area 211 into a light-shielding state. As a result, the specific frame area 210 is in a transmissive state in which light is transmitted, and the area 211 is in a light-shielded state in which light is blocked. That is, the doctor wearing the information display device 12 is in a state in which he cannot see anything other than the display device 10 on which the medical image IM is displayed. Then, the process proceeds to step S22.

[0039] The display control unit 46 determines a display setting area in the display unit 24 (step S22). FIG. 8 is a diagram for explaining a method for determining a display setting area according to the first embodiment. As shown in FIG. 8, the display control unit 46 sets a display setting area 212 in an area 211. The size of the display setting area 212 may be arbitrary. The display control unit 46 may set a plurality of display setting areas 212 in the area 211. Then, the process proceeds to step S24.

[0040] The information acquisition unit 44 acquires auxiliary information to be displayed in the display setting area from the storage unit (step S24). Specifically, in the example shown in Fig. 8, the information acquisition unit 44 acquires auxiliary information to be displayed in the display setting area 212 from the storage unit 28. For example, based on the medical image IM detected by the imaging control unit 40, the information acquisition unit 44 acquires auxiliary information for assisting in the interpretation of the medical image IM from the storage unit 28. The type of auxiliary information acquired by the information acquisition unit 44 may be automatically determined by the information acquisition unit 44, or may be set by the doctor wearing the information display device 12. Then, the process proceeds to step S26.

[0041] The display control unit 46 displays the auxiliary information in the display setting area (step S26). FIG. 9 is a diagram for explaining a method of displaying auxiliary information according to the first embodiment. As shown in FIG. 9, the display control unit 46 displays the auxiliary information 213 in the display setting area 212. The display control unit 46 may display, for example, a plurality of types of auxiliary information 213 in the display setting area 212. The display control unit 46 may be capable of switching the type of auxiliary information 213 to be displayed in the display setting area 212, for example, based on an instruction from a doctor wearing the information display device 12. This allows the doctor wearing the information display device 12 to interpret the medical image IM in the specific frame area 210 while checking the auxiliary information 213. Then, the process proceeds to step S28.

[0042] The control unit 30 determines whether or not to end the process (step S28). For example, the control unit 30 determines to end the process when the doctor's interpretation is completed or when the information display device 12 is turned off. If it is determined to end the process (step S28; Yes), the process of Fig. 5 ends. If it is determined not to end the process (step S28; No), the process returns to step S10.

[0043] As described above, in the first embodiment, when interpreting a medical image, incident light around the display device is blocked and auxiliary information for assisting interpretation is displayed. As a result, in the first embodiment, the visibility of interpretation by a doctor can be improved, and the doctor can more appropriately diagnose a patient by interpreting the medical image while checking the auxiliary information.

[0044] [Modification of the first embodiment] A modified example of the first embodiment will be described. In the first embodiment, the doctor wearing the information display device 12 interprets the medical image displayed on the display device 10, but the present invention is not limited to this.

[0045] In a modification of the first embodiment, for example, when the resolution of the display unit 24 is sufficient to display a medical image, the medical image may be displayed on the display unit 24. In this case, the medical image and auxiliary information can be displayed on the display unit 24, thereby improving the visibility of the interpretation by the doctor.

[0046] [Second embodiment] A description will be given of the second embodiment. The configurations of the information display system and the information processing device according to the second embodiment are the same as those of the first embodiment, and therefore the description will be omitted.

[0047] (Information display processing) The information display process according to the second embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of the information display process according to the second embodiment.

[0048] The processes from step S40 to step S54 are the same as the processes from step S10 to step S22 shown in FIG. 5, respectively, and therefore will not be described.

[0049] The light blocking control unit 42 determines whether the entire specific frame region is within the maximum light blocking region (step S55). Specifically, the light blocking control unit 42 determines whether the entire specific frame region 210 shown in Fig. 6 is included within the maximum light blocking region 202 shown in Fig. 4. If it is determined that the entire specific frame region is within the maximum light blocking region (step S55; Yes), the process proceeds to step S56. If it is determined that a part of the specific frame region is outside the maximum light blocking region (step S55; No), the process proceeds to step S57.

[0050] The display control unit 46 causes the display unit 24 to display information encouraging the user to include the entire specific frame region in the maximum light-blocking region (step S57). For example, the display control unit 46 causes the display unit 24 to display text information such as "Please look at the display unit 10 so that the entire display unit 10 fits within the display unit 24." This makes it possible to block light from areas other than the area including the display unit 10 while including the entire display unit 10, and to appropriately set the display setting region. Then, the process proceeds to step S46.

[0051] The processes from step S56 to step S60 are the same as the processes from step S24 to step S28 shown in FIG. 5, respectively, and therefore will not be described.

[0052] As described above, the second embodiment can fit the entire display device that is viewed by the doctor into the display unit while shading the area other than the display device. This allows the second embodiment to improve the visibility of the doctor's interpretation, and allows the display setting area to be appropriately set and auxiliary information to be appropriately displayed.

[0053] [Third embodiment] An information display system according to the third embodiment will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of the configuration of an information processing system according to the third embodiment.

[0054] 11, the information display system 1A includes a display device 10 and an information display device 12A. The display device 10A and the information display device 12A are communicatively connected via a wireless or wired network N. The information display device 12A transmits auxiliary information to the display device 10 via the network N, for example.

[0055] (Information display device) An information display device according to a third embodiment will be described with reference to Fig. 12 and Fig. 13. Fig. 12 is a diagram showing an example of the information display device according to the third embodiment. Fig. 13 is a block diagram showing an example of the configuration of the information display device according to the third embodiment.

[0056] As shown in FIGS. 12 and 13, an information display device 12A differs from the information display device 12 shown in FIGS. 2 and 3 in that an information display device 12A includes a second imaging section 32 and a communication section .

[0057] The second imaging unit 32 captures an image of the eyeball of the doctor wearing the information display device 12A. As shown in FIG. 12, the second imaging unit 32 is provided around the display unit 24. The second imaging unit 32 is configured, for example, with a visible light camera or an infrared camera. The second imaging unit 32 may be configured with a combination of a visible light camera and an infrared camera. The second imaging unit 32 outputs the captured image of the doctor's eyeball to the control unit 30A.

[0058] The communication unit 34 controls communication between the information display device 12A and an external device. The communication unit 34 executes communication between the information display device 12A and the display device 10A, for example. The communication unit 34 is realized by, for example, a communication circuit.

[0059] The control unit 30A differs from the control unit 30 shown in FIG.

[0060] The gaze detection unit 48 detects the gaze direction of the doctor wearing the information display device 12A. For example, the gaze detection unit 48 detects the gaze direction of the doctor by performing image recognition processing on the image captured by the second imaging unit 32 to identify the direction in which the doctor's eyes are facing. The gaze detection unit 48 determines, for example, whether the detected gaze direction is directed toward auxiliary information displayed in the display setting area on the display unit 24.

[0061] The communication control unit 50 controls the communication unit 34 to transmit and receive various information to and from the display device 10. For example, when the gaze detection unit 48 determines that the doctor's gaze is directed toward the auxiliary information, the communication control unit 50 controls transmission of the auxiliary information to the display device 10 via the communication unit 34.

[0062] (Information display processing) The information display process according to the third embodiment will be described with reference to Fig. 14. Fig. 14 is a flowchart showing the flow of the information display process according to the third embodiment.

[0063] The processes from step S70 to step S82 are the same as the processes from step S10 to step S22 shown in FIG. 5, respectively, and therefore will not be described.

[0064] The information acquisition unit 44 acquires auxiliary information to be displayed in the display setting area (step S84). Specifically, the information acquisition unit 44 acquires the auxiliary information to be displayed in the display setting area 212 (see FIG. 8) from an external server device or the like via the storage unit 28 or the communication unit 34. Then, the process proceeds to step S86.

[0065] The process of step S86 is the same as the process of step S26 shown in FIG. 5, and therefore a description thereof will be omitted.

[0066] The control unit 30A executes gaze detection processing (step S88). The flow of the gaze detection processing according to the third embodiment will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the flow of the gaze detection processing according to the third embodiment.

[0067] The imaging control unit 40 controls the second imaging unit 32 to capture an image of the eyeball of the doctor wearing the information display device 12A (step S100). The imaging control unit 40 acquires the image captured by the second imaging unit 32. Then, the process proceeds to step S102.

[0068] The line of sight detection section 48 detects the line of sight of the doctor wearing the information display device 12A based on the image captured by the second imaging section 32 (step S102).Then, the process proceeds to step S104.

[0069] The gaze detection unit 48 determines whether the gaze direction of the doctor wearing the information display device 12A is within the display setting area of ​​the display unit 24 (step S104). Specifically, the gaze detection unit 48 determines whether the gaze direction of the doctor wearing the information display device 12A is within the display setting area of ​​the display unit 24. If it is determined that the gaze direction of the doctor wearing the information display device 12A is within the display setting area of ​​the display unit 24 (step S104; Yes), the process proceeds to step S106. If it is not determined that the gaze direction of the doctor wearing the information display device 12A is within the display setting area of ​​the display unit 24 (step S104; No), the process proceeds to step S90 shown in FIG. 14.

[0070] If it is determined as Yes in step S104, the display control unit 46 identifies the auxiliary information displayed in the direction of the doctor's line of sight on the information display device 12A (step S106), and then proceeds to step S108.

[0071] The communication control unit 50 transmits the auxiliary information specified by the display control unit 46 to the display device 10 via the communication unit 34 (step S108). Then, the process proceeds to step S90 shown in FIG.

[0072] Returning to the description of Fig. 14, the process of step S90 is the same as the process of step S28 shown in Fig. 5, and therefore a description thereof will be omitted.

[0073] (display device) A configuration example of the display device according to the third embodiment will be described with reference to Fig. 16. Fig. 16 is a block diagram showing a configuration example of the display device according to the third embodiment.

[0074] As shown in FIG. 16, the display device 10A includes a display unit 62, a storage unit 64, a communication unit 66, and a control unit 68.

[0075] The display unit 62 displays various types of information. The display unit 62 displays medical images. The display unit 62 is realized by, for example, a liquid crystal display or an organic EL display.

[0076] The storage unit 64 stores various types of information. For example, the storage unit 64 stores information such as the contents of calculations performed by the control unit 68 and programs. For example, the storage unit 64 stores medical images such as X-rays or mammograms. For example, the storage unit 64 includes at least one of a RAM, a main storage device such as a ROM, and an external storage device such as a HDD.

[0077] The communication unit 66 executes communication between the display device 10A and an external device. The communication unit 66 executes communication between the display device 10A and the information display device 12A, for example. The communication unit 66 can be realized by, for example, a communication circuit.

[0078] The control unit 68 controls each unit of the display device 10. The control unit 68 has, for example, an information processing device such as a CPU or an MPU, and a storage device such as a RAM or a ROM. The control unit 68 executes a program that controls the operation of the display device 10. The control unit 68 may be realized by, for example, an integrated circuit such as an ASIC or an FPGA. The control unit 68 may be realized by a combination of hardware and software.

[0079] The control unit 68 includes a medical image acquisition unit 70 , an auxiliary information acquisition unit 72 , and a display control unit 74 .

[0080] The medical image acquiring section 70 acquires the medical images from the storage section 64. The medical image acquiring section 70 may acquire the medical images from an external server device or the like via the communication section 66.

[0081] The auxiliary information acquisition unit 72 acquires the auxiliary information from the information display device 12A via the communication unit 66.

[0082] The display control unit 74 controls the display unit 62 to display various types of information. For example, the display control unit 74 causes the display unit 62 to display medical images. For example, the display control unit 74 causes the display unit 62 to display auxiliary information acquired by the auxiliary information acquisition unit 72.

[0083] (Display processing) The processing contents of the display device according to the third embodiment will be described with reference to Fig. 17. Fig. 17 is a flowchart showing the processing contents of the display device according to the third embodiment.

[0084] The medical image acquisition unit 70 acquires a target medical image (step S120), and the process proceeds to step S122.

[0085] The display control unit 74 causes the display unit 62 to display the medical images acquired by the medical image acquisition unit 70 (step S122).

[0086] The auxiliary information acquisition unit 72 determines whether or not auxiliary information has been acquired from the information display device 12A (step S124). If it is determined that auxiliary information has been acquired (step S124; Yes), the process proceeds to step S126. If it is determined that auxiliary information has not been acquired (step S124; No), the process proceeds to step S128.

[0087] If the answer is Yes in step S124, the display control unit 74 causes the display unit 62 to display the auxiliary information acquired by the auxiliary information acquisition unit 72 (step S126). Specifically, the display control unit 74 may cause the display unit 62 to display the auxiliary information together with the medical image, or may cause the display unit 62 to display only the auxiliary information instead of the medical image. Then, the process proceeds to step S128.

[0088] The control unit 68 determines whether or not to end the process (step S128). Specifically, the control unit 68 determines to end the process when interpretation of the medical image is completed, when the display device 10A is powered off, or the like. When it is determined to end the process (step S128; Yes), the process of Fig. 17 ends. When it is not determined to end the process (step S128; No), the process proceeds to step S120.

[0089] As described above, the third embodiment can display auxiliary information visually recognized by a doctor on an information processing device on a display device that displays medical images. This can improve the visibility of image interpretation by a doctor.

[0090] [Modification of the third embodiment] A modification of the third embodiment will be described. In the modification of the third embodiment, for example, in accordance with the surrounding situation of the information display device 12A, various processes may be requested to the display device 10A in order to make the display device 10A easier to detect.

[0091] For example, when the imaging control unit 40 detects that the brightness around the information display device 12 is low, the imaging control unit 40 may request the display device 10A to transmit model number information. In this case, the imaging control unit 40 may detect the display device 10 when the model number information received by the information display device 12 from the display device 10A is stored in the storage unit 28. This allows the imaging control unit 40 to properly detect the display device 10A even in a situation where the brightness around the information display device 12A is low and the display device 10A cannot be properly detected by image recognition processing.

[0092] For example, when the imaging control unit 40 detects that the brightness around the information display device 12 is low, the imaging control unit 40 may request the display device 10A to display a display frame that surrounds the display screen of the display unit 62. In this case, the imaging control unit 40 may detect the display device 10A by displaying the display frame displayed by the information display device 12, and may cause the display frame to be recognized as a specific frame area. This also allows the imaging control unit 40 to properly detect the display device 10A even in a situation where the brightness around the information display device 12A is low and the display device 10A cannot be properly detected by image recognition processing.

[0093] Each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc. This distribution and integration configuration may be performed dynamically.

[0094] Although the embodiments of the present invention have been described above, the present invention is not limited to the contents of these embodiments. The above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments. [Explanation of symbols]

[0095] 1,1A Information Display System 10,10A display device 12 Information display device 20 First imaging unit 24,62 Display section 26 Light shielding section 28,64 Storage part 30,68 Control section 32 Second imaging unit 34,66 Communications Department 40 Imaging control section 42 Light blocking control section 44 Information Acquisition Department 46 Display control section 48 Gaze detection unit 50 Communication control section 70 Medical Image Acquisition Department 72 Auxiliary information acquisition unit 74 Display control section

Claims

1. An information display device to be worn on a user's head, A display unit; a light-shielding portion disposed in front of the display portion and facing the display portion, the light-shielding portion being configured to transmit or block incident light entirely or partially; A first imaging unit that captures an image in front of a user viewing the display unit; an imaging control unit that detects a display device from the captured image and determines an area including the detected display device as a specific frame area; a light-shielding control unit that sets an area other than the area corresponding to the specific frame area in the light-shielding unit as a light-shielding area and controls the light-shielding of the set light-shielding area; a storage unit that stores in advance a positional relationship between a position of an imaging area captured by the first imaging unit, a position of a maximum display area that is an area where the display unit can display, and a position of a maximum light blocking area that is an area where the light blocking unit can block light, and auxiliary information that is an image signal for assisting interpretation; a display control unit that sets an area other than the area corresponding to the specific frame area on the display unit as a display setting area and controls the display unit to display the auxiliary information in the set display setting area; an information acquisition unit that acquires the auxiliary information from the storage unit based on the image displayed on the display device detected by the imaging control unit; An information display device comprising:

2. When the entirety of the specific frame region is not included within the maximum light-shielded region of the light-shielding portion, the display control unit causes information prompting the entirety of the specific frame region to be included within the maximum light-shielded region to be displayed on the display unit. The information display device according to claim 1 .

3. A second imaging unit, a gaze detection unit, and a communication unit, The second imaging unit captures an image of the user's eye, The gaze detection unit detects a gaze direction of the user from an image captured by the second imaging unit, the display control unit, when the gaze direction detected by the gaze detection unit is directed into the display setting area, identifies auxiliary information that is being displayed in the gaze direction of the user, The communication unit transmits the auxiliary information to the display device.

3. The information display device according to claim 1 or 2.

4. capturing an image in front of a user; detecting a display device from the captured image, and determining an area including the detected display device as a specific frame area; setting an area other than the area corresponding to the specific frame area as a light-shielding area, and controlling the light-shielding of the set light-shielding area; A step of setting an area other than the area corresponding to the specific frame area as a display setting area; and a step of acquiring auxiliary information based on the image displayed on the display device. a step of controlling the display of the auxiliary information in the set display setting area; A method for displaying information, comprising:

5. capturing an image in front of a user; detecting a display device from the captured image, and determining an area including the detected display device as a specific frame area; setting an area other than the area corresponding to the specific frame area as a light-shielding area, and controlling the light-shielding of the set light-shielding area; A step of setting an area other than the area corresponding to the specific frame area as a display setting area; and a step of acquiring auxiliary information based on the image displayed on the display device. a step of controlling the display of the auxiliary information in the set display setting area; A program that causes a computer to execute the following.

Images