Image interpretation support server, image interpretation support system, image interpretation support method, image interpretation support program, and image interpretation terminal
The image interpretation support server optimizes collaborative image interpretation by classifying user operations and selectively sharing results, addressing inefficiencies and oversights in conventional systems.
Patent Information
- Application Number
- JP2023502522
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-02-26
- Filing Date
- 2022-02-25
- Publication Date
- 2025-08-27
- Estimated Expiration
- 2042-02-25
AI Technical Summary
Conventional image interpretation technologies fail to efficiently support multiple users in interpreting images due to variations in image processing and display conditions, leading to potential oversights and inefficiencies in collaborative interpretation tasks.
An image interpretation support server that classifies user operations into display and hide operations, allowing real-time sharing of interpretation results among users while preventing unnecessary processing results from being displayed, thereby optimizing collaborative image interpretation.
Enables multiple users to efficiently interpret images by ensuring that each user operates under desired conditions and reduces the likelihood of oversights by selectively sharing interpretation results.
Smart Images

Figure 0007730359000001 
Figure 0007730359000002 
Figure 0007730359000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a technique for assisting in the interpretation of an image of an object. [Background technology]
[0002] In various fields, so-called "image interpretation" (where users inspect or diagnose an object using an image) is performed, and technologies to support this image interpretation are known. For example, Patent Document 1 describes a technology that supports the inspection of defects using images of the industrial product being inspected. Furthermore, Patent Document 2 describes a technology for collating the results of medical image interpretations by multiple users. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] WO2018 / 034057 publication [Patent Document 2] Japanese Patent Application Laid-Open No. 2004-199691 Summary of the Invention [Problem to be solved by the invention]
[0004] Depending on the situation, even experienced users may have difficulty interpreting images, and defects, abnormalities, lesions, etc. may be overlooked. For this reason, multiple users may interpret the same image. However, if multiple users interpret images separately and then compare their results, each user cannot refer to the interpretation results of other users, and it takes a significant amount of time to complete all interpretations. Furthermore, the image processing and image display conditions for interpretation may vary depending on the purpose of interpretation, the nature of the subject, and the user. For multiple users to perform efficient interpretations, these circumstances must be taken into consideration. However, conventional technologies such as those described in Patent Documents 1 and 2 above do not take these circumstances into consideration.
[0005] As described above, with conventional techniques, it has been difficult for multiple users to perform image interpretation efficiently.
[0006] The present invention has been made in consideration of the above circumstances, and aims to provide an interpretation support server, an interpretation support system, an interpretation support method, an interpretation support program, and an interpretation terminal that allow multiple users to perform interpretation efficiently. [Means for solving the problem]
[0007] In order to achieve the above-mentioned object, the interpretation support server according to a first aspect of the present invention is an interpretation support server equipped with a processor, which executes the following operations: an image display process for displaying an image of an object to be interpreted on a first terminal connected to the interpretation support server and a second terminal different from the first terminal; an operation reception process for receiving operations performed on the first terminal and the second terminal for the displayed image to be interpreted; a self-terminal result display process for displaying the results of processing based on the operation received from the first terminal on the first terminal in real time, and displaying the results of processing based on the operation received at the second terminal on the second terminal in real time; a classification process for classifying the operations received from the first terminal into display operations and hide operations; and an other-terminal result display process for, if a display operation is performed on the first terminal, displaying the results of the performed display operation on the second terminal in real time, and, if a hide operation is performed on the first terminal, prohibiting the results of the performed hide operation from being displayed on the second terminal.
[0008] The interpretation support server of the first aspect can classify operations on a first terminal (a terminal used by a user) among multiple terminals (a first terminal and a second terminal) that should be communicated to all other users as ``display operations,'' and operations that have different settings for each user or that do not need to be communicated to all other users as ``hidden operations.''
[0009] The image interpretation support server displays the results of the display operation in real time on the second terminal (a terminal used by another user) according to this classification result, so that the user can grasp the results of the display operation by other users in real time. Also, the image interpretation support server prohibits the display of the results of the hide operation on the second terminal, so that other users (users of the second terminal) do not have to see unnecessary processing results, etc.
[0010] In this way, the interpretation support server according to the first aspect allows multiple users to perform interpretation efficiently. Note that in the first aspect and each of the following aspects, terminals with different users, terminals where displays are performed independently, and terminals that the interpretation support server can recognize as separate (even if the hardware and software configurations are the same) can be recognized as a "first terminal" and a "second terminal different from the first terminal." In other words, the "first terminal" and the "second terminal" can be regarded as a "specific terminal" and a "terminal other than the specific terminal," and each interpretation terminal can be regarded as either a first terminal or a second terminal depending on whether a specific operation is received.
[0011] In addition, in the first aspect and each of the following aspects, "real-time" means a quick response, such as instantaneous or immediate, and also includes cases where unavoidable time delays occur due to processing at the first and second terminals or the interpretation support server, or communications between these devices.
[0012] In the image interpretation support server according to the second aspect, in the first aspect, the processor classifies, in a classification process, an operation by the users of the first and second terminals to input information indicating the interpretation result of the image to be interpreted as a display operation, and an operation by the user of the first terminal to input information regarding the processing of the image to be interpreted as a non-display operation. According to the second aspect, by classifying an operation to input information indicating the interpretation result as a "display operation" and displaying the result on the second terminal, other users can easily understand the interpretation result of one user, thereby reducing the possibility of interpretation errors or oversights. Furthermore, the image interpretation support server classifies an operation to input information regarding the processing of the image to be interpreted as a "non-display operation" and prohibits the display of the operation result on the second terminal.
[0013] In the image interpretation support server according to the third aspect, the processor, in the classification process, accepts at least one of the number, position, type, severity, and reason for determining the severity of defects in the image to be interpreted as information indicating the interpretation result, and accepts at least one of the following operations for enlarging or reducing, moving, rotating, transforming, changing gradation, setting the interpretation range, specifying defects, and setting the interpretation content as information regarding the processing of the image to be interpreted. The third aspect further specifies display operations and non-display operations, and by accepting information such as the number and position of defects as "information indicating the interpretation result" and classifying it as "display operations," advantageous effects such as preventing defects from being overlooked are achieved. Furthermore, since the appropriate conditions for operations such as enlarging the image to be interpreted vary depending on the user, accepting such operations as "information regarding processing" and classifying them as "non-display operations" allows each user to perform image interpretation under desired conditions.
[0014] In the third aspect, instead of or in addition to defects, information about damage, deformation, lesions, or "areas of interest" that are candidates for these may be accepted as "information indicating the interpretation results" and "information regarding the processing of the image to be interpreted."
[0015] In the image interpretation support server according to the fourth aspect, in the third aspect, the processor receives, in the classification process, an operation for setting an interpretation range in the image to be interpreted as information related to the processing of the image to be interpreted, and performs a notification process for notifying the user of the confirmation result as to whether or not the area in the image to be interpreted in which the object is shown is entirely covered by the set interpretation range. Note that in the fourth aspect, the image interpretation support server can notify the confirmation result by screen display, voice, etc.
[0016] In the image interpretation support server according to the fifth aspect, in any one of the second to fourth aspects, the processor, in the other terminal result display process, associates information indicating the image interpretation result with the fact that the image interpretation result has been input from the first terminal, and displays it in an identifiable manner on the second terminal. Image interpretation The support server can display different characters, numbers, symbols, figures, etc. for each user, and the color of the display may be different for each user.
[0017] In the interpretation support server according to a sixth aspect, in any one of the first to fifth aspects, the processor, in the operation reception processing, receives designation of a third terminal different from the first terminal and the second terminal, which is permitted to display the result of the hide operation, and in the image display processing, causes the third terminal to display the image to be interpreted, and in the other terminal result display processing, causes the third terminal to display the result of the hide operation in real time. According to the sixth aspect, the result of the hide operation can be shared between the user of the first terminal and the user of the third terminal. The processor can determine whether a certain terminal is the third terminal based on the designation of the user of the first terminal.
[0018] In the interpretation support server according to a seventh aspect, in any one of the first to sixth aspects, the processor, in the operation reception processing, receives designation of a fourth terminal different from the first terminal and the second terminal, which is permitted to display the result of a specific hide operation, which is a designated operation among the hide operations; in the image display processing, causes the fourth terminal to display the image to be interpreted; and in the other terminal result display processing, causes the fourth terminal to display the result of the specific hide operation in real time. According to the seventh aspect, the result of the hide operation can be shared between the user of the first terminal and the user of the fourth terminal. Note that the processor can determine whether a certain terminal is the fourth terminal based on the designation of the user of the first terminal.
[0019] The image interpretation support server according to an eighth aspect is any one of the first to seventh aspects, in which the processor causes the first terminal and the second terminal to display, as an image to be interpreted, any one of an image of a building, an image of an industrial product, and a medical image of a living body. The eighth aspect specifically defines the image to be interpreted.
[0020] In the eighth aspect, a panoramic composite image of individual images may be used as the image to be interpreted. Depending on the shape and size of the object, images are often captured in segments, and in such cases, multiple users may share the interpretation of a wide range. By using a composite image in such cases, the advantageous effect of the present invention is achieved, which is that "multiple users can efficiently interpret images by preventing oversights and dividing up the work range."
[0021] In order to achieve the above-mentioned object, a ninth aspect of the present invention provides an interpretation support system comprising an interpretation support server having a processor, a first terminal connected to the interpretation support server and displaying an image to be interpreted, and a second terminal connected to the interpretation support server and displaying the image to be interpreted, the second terminal being different from the first terminal, wherein the processor executes an image display process for displaying an image to be interpreted of an object on the first terminal connected to the interpretation support server and the second terminal different from the first terminal, an operation reception process for accepting operations performed on the first terminal and the second terminal for the displayed image to be interpreted, a self-terminal result display process for displaying the results of processing based on the operation received from the first terminal on the first terminal in real time and the results of processing based on the operation received at the second terminal on the second terminal in real time, a classification process for classifying the operations received from the first terminal into display operations and hide operations, and an other-terminal result display process for, if a display operation is performed on the first terminal, displaying the results of the display operation on the second terminal in real time, and, if a hide operation is performed on the first terminal, prohibiting the results of the hide operation from being displayed on the second terminal. According to the ninth aspect, similarly to the first aspect, multiple users can efficiently perform interpretation. In the interpretation support system according to the ninth aspect, the interpretation support server may have the same configuration as the second to eighth aspects.
[0022] In order to achieve the above-mentioned object, a tenth aspect of the present invention provides an image interpretation support method using an image interpretation support server, comprising: an image display step of displaying an image of an object to be interpreted on a first terminal connected to the image interpretation support server and a second terminal different from the first terminal; an operation receiving step of receiving operations performed on the first terminal and the second terminal with respect to the displayed image to be interpreted; a self-terminal result display step of displaying in real time on the first terminal a result processed based on the operation received from the first terminal and displaying in real time on the second terminal a result processed based on the operation received from the second terminal; a classification step of classifying the operations received from the first terminal into a display operation and a hide operation; and an other-terminal result display step of displaying in real time on the second terminal the result of the display operation performed on the first terminal if the display operation was performed on the first terminal and prohibiting the result of the hide operation from being displayed on the second terminal if the hide operation was performed on the first terminal. According to the tenth aspect, multiple users can perform image interpretation efficiently, as in the first aspect. The image interpretation support method according to the tenth aspect may have the same configuration (contents of the process executed by the image interpretation support server) as the second to eighth aspects.
[0023] In order to achieve the above-mentioned object, the reading support program of the eleventh aspect is a reading support program that causes a reading support server to execute a reading support method, and the reading support method includes an image display step of displaying an image of an object to be read on a first terminal connected to the reading support server and a second terminal different from the first terminal; an operation reception step of receiving operations performed on the first terminal and the second terminal for the displayed image to be read; a self-terminal result display step of displaying the results of processing based on the operation received from the first terminal on the first terminal in real time and displaying the results of processing based on the operation received at the second terminal on the second terminal in real time; a classification step of classifying the operations received from the first terminal into display operations and hide operations; and an other-terminal result display step of, if a display operation is performed on the first terminal, displaying the results of the performed display operation on the second terminal in real time, and, if a hide operation is performed on the first terminal, prohibiting the display of the results of the performed hide operation on the second terminal.
[0024] According to the eleventh aspect, multiple users can perform interpretation efficiently, as in the first aspect. Note that the interpretation support method executed by the interpretation support program according to the present invention may have the same configuration (contents of the processing executed by the interpretation support server) as the second to eighth aspects. In addition, a non-transitory recording medium on which computer-readable code of the above-mentioned interpretation support program is recorded can also be cited as an aspect of the present invention.
[0025] In order to achieve the above-mentioned object, the reading terminal of the 12th aspect is an reading terminal connected to an reading support server and is equipped with a processor, and the processor executes a terminal-side image display process that displays an image of the object to be read in accordance with the control of the reading support server, a terminal-side operation reception process that receives user operations on the image to be read, and a terminal-side result display process that displays the results processed by the reading support server depending on the classification result in the reading support server as to whether the received operation is a display operation that allows the display of the operation results on other reading terminals connected to the reading support server, or a hide operation that prohibits the display of the operation results on other reading terminals, and the terminal-side result display process executes a first result display process that displays the results of the display operation received by the reading terminal and the results of the hide operation received by the reading terminal, or a second result display process that displays the results of the display operation received by other reading terminals.
[0026] A plurality of image interpretation terminals according to the twelfth aspect may be connected to the image interpretation support server, and in this case, a plurality of users can efficiently perform image interpretation. 12 The image interpretation terminal according to the third aspect may be connected to the image interpretation support server according to the first to eighth aspects. support method), a program that executes the method on the image reading terminal (image reading support A program, and a non-transitory recording medium on which a computer-readable code of the program is recorded, can also be cited as an aspect of the present invention. [Effects of the Invention]
[0027] As described above, the interpretation support server, interpretation support system, interpretation support method, interpretation support program, and interpretation terminal according to the present invention enable multiple users to access and interpret the same image simultaneously, thereby enabling efficient interpretation. [Brief explanation of the drawings]
[0028] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of an image interpretation support system according to the first embodiment. [Figure 2] FIG. 2 is a diagram showing the configuration of the image interpretation support server. [Figure 3] FIG. 3 is a diagram showing the configuration of the image interpretation terminal. [Figure 4] FIG. 4 is a flowchart showing the processing in the image interpretation support server. [Figure 5] FIG. 5 is a diagram showing how the reading range is set and whether there are any gaps is checked. [Figure 6] FIG. 6 is a diagram showing an example of a non-display operation for an image to be interpreted. [Figure 7] FIG. 7 is a diagram showing how the interpretation results are input and displayed on the entire display screen. [Figure 8] FIG. 8 is a diagram showing an example of a display of the progress of image interpretation. [Figure 9] FIG. 9 is another diagram showing an example of displaying the progress of image interpretation. [Figure 10] FIG. 10 shows screens displayed on a plurality of monitors. [Figure 11] FIG. 11 is a diagram showing how images of a plurality of objects are interpreted. [Figure 12] FIG. 12 is another flowchart showing the processing in the image interpretation support server. [Figure 13] FIG. 13 is yet another flowchart showing the processing in the image interpretation support server. DETAILED DESCRIPTION OF THE INVENTION
[0029] The following describes embodiments of an image interpretation support server, an image interpretation support system, an image interpretation support method, an image interpretation support program, and an image interpretation terminal according to the present invention. In the description, the accompanying drawings will be referenced as necessary. For the sake of convenience, some components may be omitted from the accompanying drawings.
[0030] [First embodiment] [Configuration of the image interpretation support system] FIG. 1 is a diagram showing a schematic configuration of an interpretation support system 10 (interpretation support system) according to the first embodiment. The interpretation support system 10 is a system that supports multiple users in interpreting images (images to be interpreted) of an object (target). In the first embodiment, a case will be described in which the images to be interpreted are radiographic images of industrial products; however, the interpretation support system according to the present invention can also be applied to other objects and other images to be interpreted, as will be described later. The industrial products that are the targets of interpretation are not particularly limited to materials such as metal or resin, and may be unprocessed or processed, or may be parts or assembled products.
[0031] 1, the image interpretation support system 10 includes an image interpretation support server 100 (image interpretation support server, processor), multiple image interpretation terminals 200 (first terminal, second terminal, third terminal, fourth terminal), an imaging system 300, and a database 400. When it is necessary to distinguish between the multiple image interpretation terminals 200, the image interpretation terminals 200 may be referred to as image interpretation terminal 200A, image interpretation terminal 200B, image interpretation terminal 200C, and image interpretation terminal 200D.
[0032] The above-mentioned elements are connected via a network NW, and communication between the elements is performed as needed. The connection may be wired or wireless. Furthermore, these components may be housed in a single housing, or may be housed separately in multiple housings. Although four image interpretation terminals 200 are shown in FIG. 1, the number of image interpretation terminals 200 (assuming multiple terminals) is not limited.
[0033] [Configuration of image interpretation support server] 2 is a diagram showing the configuration of the image interpretation support server 100. The image interpretation support server 100 includes a processor 110, a ROM 120 (Read Only Memory: ROM), a RAM 130 (Random Access Memory: RAM), and a recording device 140. The processor 110 has the functions of an image acquisition unit 110A, an image display processing unit 110B, an operation reception processing unit 110C, a self-terminal result display processing unit 110D, a classification processing unit 110E, an other-terminal result display processing unit 110F, a matching processing unit 110G, a notification processing unit 110H, and a communication control unit 110I.
[0034] [Processor feature summary] The image acquisition unit 110A acquires an image of the object to be interpreted from the imaging system 300 or the database 400, and the image display processing unit 110B displays the image to be interpreted on the display device of the interpretation terminal 200. The operation reception processing unit 110C receives an operation performed on the interpretation terminal 200 as the first terminal for the displayed image to be interpreted. When an operation is received from the interpretation terminal 200, the own terminal result display processing unit 110D displays the results of processing based on the received operation on the interpretation terminal 200 (own terminal) that received the operation in real time. The classification processing unit 110E classifies the received operation into a display operation that displays the operation results on the interpretation terminal 200 as the second terminal (other terminal), a first non-display operation that displays the operation results only on some of the interpretation terminals 200 (second terminal), and a second non-display operation that displays the operation results on the interpretation terminal that received the operation. End 2 The other terminal result display processing unit 110F displays the operation results in real time on the interpretation terminal 200 depending on whether the received operation is a display operation or a first or second non-display operation.
[0035] The matching processing unit 110G performs matching processing of the interpretation range and interpretation results set in the interpretation terminal 200, and the notification processing unit 110H notifies the user of these matching results. The communication control unit 110I controls communication between the interpretation support server 100 and the interpretation terminal 200, and communication between the interpretation terminals 200.
[0036] The processing by each of the above-mentioned units will be described in detail later.
[0037] The functions of the processor 110 described above can be realized using various processors and recording media. The various processors include, for example, a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) to realize various functions, a GPU (Graphics Processing Unit), which is a processor specialized for image processing, and a programmable logic device (PLD), such as an FPGA (Field Programmable Gate Array), whose circuit configuration can be changed after manufacturing. Each function may be realized by a single processor, or by multiple processors of the same or different types (e.g., multiple FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU). Furthermore, multiple functions may be realized by a single processor. The hardware structure of these various processors is, more specifically, an electric circuit made up of a combination of circuit elements such as semiconductor elements.
[0038] When the processor or electrical circuit described above executes software (programs), computer-readable code for the software to be executed (e.g., various processors and electrical circuits constituting the processor 110, and / or a combination thereof) is stored in a non-transitory recording medium (memory) such as flash memory or ROM 120 (Read Only Memory), and the computer references the software. The programs to be executed include a program (interpretation assistance program) for executing a method (interpretation assistance method) according to one aspect of the present invention. Furthermore, when the software is executed, information stored in the recording device 140 (image to be interpreted, execution conditions for the interpretation assistance method and the interpretation assistance program, execution results, etc.) is used as necessary. Furthermore, when the software is executed, RAM 130 (Random Access Memory) is used as a temporary storage area.
[0039] [Imaging system configuration] The imaging system 300 is an apparatus that irradiates an object (subject) with X-rays, receives the resulting transmitted radiation, and captures a radiological image (image to be interpreted). The obtained radiological image is recorded in the recording device 140 and / or the database 400 of the interpretation support server 100.
[0040] [Information stored in the database] The database 400 is composed of various types of magneto-optical recording media, semiconductor memories, and their control units, and records information about the object, images to be interpreted, interpretation results, and the like.
[0041] [Configuration of image reading terminal] FIG. 3 is a diagram showing the configuration of the image interpretation terminal 200. The image interpretation terminal 200 includes a processor 210, a ROM 220, a RAM 230, a recording device 240, a display device 250, and an operation unit 260, and is connected to the image interpretation support server 100 via a network NW (see FIG. 1). In operation of the image interpretation terminal 200, the processor 210 references programs and data stored in the ROM 220 and uses the RAM 230 as a temporary processing area. Information such as processing conditions, processing results, and operation history is recorded in the recording device 240. The display device 250 is configured as a device such as a liquid crystal display, and can display, under the control of the image interpretation support server 100, the image to be interpreted, information indicating the image interpretation results, information for performing image interpretation, the results of the display operation, and the results of the first and second non-display operations. A user can input the information described above via the operation unit 260, such as a keyboard or mouse. The display device 250 may be configured as a touch panel monitor, and the user may give instructions via the touch panel.
[0042] The processor 210 includes a terminal-side image display processing unit 210A, a terminal-side operation reception processing unit 210B, a terminal-side result display processing unit 210C, and a communication control unit 210D. These functions can be realized using various processors and recording media, similar to the above-described processor 110 of the image interpretation support server 100.
[0043] The image interpretation terminal 200 having the above-described configuration operates as the first terminal and the second terminal in the present invention.
[0044] [Processing in the image interpretation support system] [Display of image to be interpreted] The processing in the interpretation support system 10 will be described. FIG. 4 is a flowchart showing the processing in the interpretation support server 100. The processor 110 (image acquisition unit 110A, image display processing unit 110B) of the interpretation support server 100 displays an image of the object to be interpreted on a plurality of interpretation terminals 200 (display devices 250) connected to the interpretation support server 100 (step S100: image display step, image display processing). The processor 210 (terminal-side image display processing unit 210A) of the interpretation terminal 200 displays the image to be interpreted on the display device 250 under the control of the interpretation support server 100. The image to be interpreted may be an image directly acquired by the interpretation support server 100 from the imaging system 300, an image recorded in the database 400, or an image recorded in the recording device 140 of the interpretation support server 100. Furthermore, the interpretation support server 100 may sequentially display images stored in a predetermined folder as images to be interpreted, or may display images designated by the user via the interpretation terminal 200. Under the control of the processor 110, the images to be interpreted are displayed on the interpretation terminal 200 (see FIGS. 5 to 11; terminal-side image display processing, terminal-side image display step).
[0045] The image interpretation support server 100 recognizes the image interpretation terminal 200 that has accepted a user operation as a "first terminal," and the other image interpretation terminals (image interpretation terminals different from the first terminal) as "second terminals." Since any image interpretation terminal 200 can accept a user operation, the recognition of the first terminal and the second terminal is not fixed. Even if a specific image interpretation terminal 200 (e.g., image interpretation terminal 200A) is recognized as the first terminal for a certain operation, another image interpretation terminal 200 (e.g., image interpretation terminal 200B) may be recognized as the first terminal for another operation. Furthermore, when an operation is accepted when multiple image interpretation terminals 200 are close to each other, one image interpretation terminal 200 can be recognized as the first terminal, and the other image interpretation terminals 200 can be recognized as the second terminal.
[0046] [Accepting operations and displaying results on your device] When a user operates the interpretation terminal 200 via the operation unit 260, the processor 210 (terminal-side operation reception processing unit 210B) receives the operation. In response, the processor 110 (operation reception processing unit 110C) of the interpretation support server 100 determines whether an operation performed on the interpretation terminal 200 (first terminal and second terminal) for the displayed image to be interpreted has been received (step S110: operation reception processing, operation reception step). If an operation has been received (YES in step S110), the processor 110 (own-terminal result display processing unit 110D) performs processing based on the operation received from the interpretation terminal 200 and displays the processed result in real time on the first terminal that received the operation (step S115: own-terminal result display processing, own-terminal result display step). For example, the processor 110 performs processing based on the operation received from the interpretation terminal 200A and displays the processed result in real time on the interpretation terminal 200A (for example, on an individual display screen, which will be described later). Similarly, the processor 110 performs processing based on an operation received from the interpretation terminal 200B, and causes the processing result to be displayed in real time on the interpretation terminal 200B. The same applies when the interpretation terminal 200C receives an operation.
[0047] The processor 110 (own terminal result display processing unit 110D) displays the result of a display operation performed on the first terminal in real time on the first terminal on which the display operation was performed. For example, when the interpretation terminal 200A (own terminal, first terminal) accepts a display operation, the interpretation terminal 200A displays the result of the display operation on itself (own terminal, first terminal) (step S115: own terminal result display processing, own terminal result display step). The processor 210 (terminal-side result display processing unit 210C) displays the result of the display operation on the display device 250 (own terminal, first terminal) under the control of the processor 110 (terminal-side result display processing, terminal-side result display step, first result display processing, first result display step). The processor 210 can display the result of the display operation on its own terminal, for example, on an entire display screen (see FIGS. 5 to 11).
[0048] [Operation Classification] When an operation is received at the image interpretation terminal 200 (YES in step S110), the processor 110 (classification processing unit 110E) determines whether or not a display operation input has been received (step S120: classification processing, classification step). Specifically, the processor 110 (classification processing unit 110E) classifies the operation received from the image interpretation terminal 200 (first terminal) into a display operation that permits the display of the operation result at another image interpretation terminal 200 (second terminal) and a non-display operation that prohibits the display of the operation result at another image interpretation terminal 200 (step S120: classification processing, classification step). For example, the processor 110 classifies an operation (operation accepted in the terminal-side operation acceptance process or terminal-side operation acceptance step) accepted by the image interpretation terminal 200A (first terminal) into a display operation that allows the operation result to be displayed on the image interpretation terminals 200B and 200C (other second terminals) and a non-display operation that prohibits the operation result from being displayed on the image interpretation terminals 200B and 200C (other second terminals). Also, for example, when an operation is accepted by the image interpretation terminal 200B (first terminal), the processor 110 classifies the operation into a display operation that allows the operation result to be displayed on the image interpretation terminals 200A and 200C (other second terminals) and a non-display operation that prohibits the operation result from being displayed on the image interpretation terminals 200A and 200C (other second terminals).
[0049] In step S120 (classification processing, classification step), the processor 110 (classification processing unit 110E) receives information indicating the interpretation results of the image to be interpreted from the first terminal and the second terminal. An operation of accepting at least one of the number, position, type, degree, and reason for determining the degree of defects in the image to be interpreted as "information indicating the interpretation result" and inputting the information can be classified as a "display operation," and an operation of accepting at least one of the operations of enlarging or reducing, moving, rotating, transforming, changing gradation, setting the interpretation range, specifying the defect, and setting the interpretation content as "information regarding the processing of the image to be interpreted" and inputting the information can be classified as a "hidden operation."
[0050] [Display operation results (for display operations)] If it is determined in step S120 that the "accepted operation is a display operation" (the determination result is YES), the processor 110 (other-terminal result display processing unit 110F) of the interpretation support server 100 causes the second terminal (other terminal) to display the result of the display operation performed on the first terminal (own terminal) in real time. For example, when the interpretation terminal 200A (own terminal, first terminal) accepts a display operation, the result of the display operation is displayed on the interpretation terminals 200B and 200C (other terminal, second terminal) (step S130: other-terminal result display processing, other-terminal result display step, first result display processing, first result display step). The processor 210 (terminal-side result display processing unit 210C) of the interpretation terminal 200 causes the display device 250 to display the result of the display operation under the control of the processor 110 according to the classification result of the operation (terminal-side result display processing, terminal-side result display step, second result display processing, second result display step). The processor 210 can display the results of the display operation on the entire display screen of the display device 250 (other terminal) (see FIGS. 5 to 11, which will be described later).
[0051] [Show operation results (for hidden operations)] If it is determined in step S120 that "the accepted operation is a hide operation" (the determination result is NO), the processor 110 (own terminal result display processing unit 110D) of the interpretation support server 100 prohibits the second terminal from displaying the result of the hide operation performed in the first terminal (step S140: own terminal result display processing, own terminal result display step). For example, if the interpretation terminal 200A (first terminal) accepts a hide operation, the processor 110 prohibits the interpretation terminals 200B and 200C (second terminals) from displaying the result of the hide operation. Similarly, if the interpretation terminal 200B (first terminal) accepts a hide operation, the processor 110 prohibits the interpretation terminals 200A and 200C (second terminals) from displaying the result of the hide operation. The same applies when the interpretation terminal 200C (first terminal) accepts a hide operation.
[0052] The processor 210 (terminal-side result display processing unit 210C) of the interpretation terminal 200 displays the result of the non-display operation on the display device 250 under the control of the processor 110 according to the classification result of the operation (terminal-side result display processing, terminal-side result display step, first result display processing, first result display step). The processor 210 can display the result of the non-display operation on an individual display screen (see FIGS. 5 to 11 described later).
[0053] [End of process] When the display of the operation result is finished, the processor 110 determines whether the interpretation is finished (step S150) and whether the interpretation of all the images to be interpreted is finished (step S160). The processor 110 may determine whether the interpretation is finished based on an operation to "end interpretation" on the interpretation terminal 200 (for example, clicking the "end interpretation" button, etc.), or the interpretation support server 100 may determine that the interpretation is finished (for example, when the interpretation progress status reaches the state shown in FIG. 9). The processor 110 may also determine that the interpretation of all the images to be interpreted is finished when the interpretation of all the images stored in a predetermined folder or all the specified images (for example, flagged as images to be interpreted) is finished.
[0054] [Example of screen display on a radiology terminal] [Setting the reading range and checking for gaps] Next, a specific example of a screen display on the image interpretation terminal will be described. Fig. 5 is a diagram showing how the image interpretation range is set and gaps are checked. Part (a) of Fig. 5 shows the screen 502A of the display device 250 of the image interpretation terminal 200A (assuming the user is Technologist A). The screen 502A is made up of an overall display screen 522A and an individual display screen 524A, and in the example shown in the figure, an image of a cylindrical object 600 (image to be interpreted) is displayed (results of image display processing, terminal-side image display processing, etc.). The overall display screen 522A is a screen on which the results of display operations on the own terminal and other terminals are displayed, and the individual display screen 524A is a screen on which the results of a hide operation by the user of the image interpretation terminal 200A are displayed.
[0055] 5(b) is a screen 502B of the display device 250 of the interpretation terminal 200B (assuming the user is Technologist B). The screen 502B is made up of an entire display screen 522B and an individual display screen 524B.
[0056] In the above-described situation, assume that an operation to set the image reading range 520A is performed on the image reading terminal 200A, and an operation to set the image reading range 520B is performed on the image reading terminal 200B. The processor 110 then accepts the operation to set the image reading ranges 520A and 520B in the image to be read as "information related to the processing of the image to be read" (operation reception process, operation reception step) and classifies it as a "non-display operation" (classification process, classification step). The processor 110 (matching process unit 110G, notification process unit 110H) checks whether the area of the image to be read, in which the object 600 is shown, is entirely covered by the set image reading ranges 520A and 520B (matching process, matching step), and notifies the user of the image reading terminal 200 of the confirmation result (notification process, notification step). The image reading terminal 200 (terminal-side result display process unit 210C) notifies the user of the image reading terminal 200 via the display device 250 under the control of the processor 110. The notification may be made by voice using a speaker (not shown).
[0057] Part (c) of Figure 5 shows an example of notification (the screen of the interpretation terminal 200A) (similar notifications can be given at other interpretation terminals 200). In this example, no interpretation range has been set for area 526 at any of the interpretation terminals, so the processor 110 distinguishably displays area 526 with a frame and displays a message 528 indicating that no interpretation range has been set. This notification allows the user to easily recognize missing interpretation ranges and prevents them from occurring.
[0058] [Example of the result of a hide operation] FIG. 6 is a diagram showing an example of the display result of a hide operation. Part (a) of FIG. 6 shows a state (before the operation) in which the object 600 is displayed on the overall display screen 522A and the individual display screen 524A, as in FIG. 5. In this state, if the image is rotated and the brightness is changed (an example of a hide operation) on the individual display screen 524A, the processor 110 classifies these operations as a hide operation and displays the operation result on the image reading terminal 200A (own terminal) only on the image reading terminal 200A (the state shown in part (b) of FIG. 6), but not on the image reading terminals 200B and 200C (other terminals) (step S140: own terminal result display process, own terminal result display step). Furthermore, if the image reading terminal 200B accepts the image rotation and brightness change, the processor 110 does not display the results on the image reading terminals 200A and 200C, and if the image reading terminal 200C accepts these operations, the processor 110 does not display the results on the image reading terminals 200A and 200B. In this way, in the interpretation support system 10, operations that have different conditions depending on the user or operations that do not require the results to be shared are not displayed on the overall display screen, but are displayed only on the individual display screen, allowing multiple users to efficiently perform interpretation under their desired conditions.
[0059] [Example of display operation results (input of image reading results)] 7 is a diagram showing an example of the display result of a display operation. Part (a) of FIG. 7 shows the screen 504A (overall display area 512A, individual display area 514A) of the interpretation terminal 200A, and part (b) of the same figure shows the screen 504B (overall display area 512B, individual display area 514B) of the interpretation terminal 200B. The overall display areas 512A and 512B display an image of the object 600 (image to be interpreted) and its interpretation results, while the individual display areas 514A and 514B display the image of the object 600 (image to be interpreted). The users of the interpretation terminals 200A and 200B interpret the image to be interpreted by enlarging it, etc., in the individual display areas 514A and 514B as necessary, and input the results. 7, the user of the image interpretation terminal 200A inputs in the individual display area 514A that an air bubble (an example of a defect) exists in the area 530A, and the user of the image interpretation terminal 200B inputs in the individual display area 514B that a crack (an example of a defect) exists in the area 530B. In addition, it is assumed that the user of the image interpretation terminal 200C inputs that a foreign object has been mixed in the area 530C.
[0060] In this case, the processor 110 accepts input operations at each interpretation terminal and classifies them as “operations for inputting interpretation results,” or “display operations.” The processor 110 then displays the results of the operations at the interpretation terminal 200A on the interpretation terminal 200A (own terminal, first terminal) and the interpretation terminals 200B and 200C (other terminals, second terminals) in real time, displays the results of the operations at the interpretation terminal 200B (own terminal, first terminal) on the interpretation terminal 200B (own terminal, first terminal) and the interpretation terminals 200A and 200C (other terminals, second terminals) in real time, and displays the results of the operations at the interpretation terminal 200C (own terminal, first terminal) on the interpretation terminals 200C (own terminal, first terminal) and the interpretation terminals 200A and 200B (other terminals, second terminals) in real time. The processor 210 displays the interpretation results in the entire display areas 512A and 512B under the control of the interpretation support server 100 (similarly, the interpretation terminal 200C also displays the interpretation results, but this is not shown in FIG. 7).
[0061] The processor 110 displays the image interpretation results in the area 530A in a distinctive manner, associating them with the fact that they were input from the image interpretation terminal 200A. The processor 110 displays the image interpretation results in the area 530B in a distinctive manner, associating them with the fact that they were input from the image interpretation terminal 200B. Specifically, the processor 110 distinguishes the image interpretation results of each image interpretation terminal by displaying the borders of the areas 530A and 530B in different line styles. The processor 110 can associate and distinguish the image interpretation results using letters, numbers, symbols, figures, or combinations thereof, and may change the color and brightness of the display for each image interpretation terminal. Furthermore, as shown in FIG. 7, the processor 110 can display the user's name or ID, such as "Technologist A," "Technologist B," or "Technologist C," on the image interpretation terminal in association with the image interpretation results (the same applies to other figures). In FIG. 7, the different line styles used to indicate the image interpretation results of different users indicate different users, but the color of the line style may also be changed depending on the user.
[0062] By displaying the interpretation results in this way, each user can easily understand which user performed what interpretation, thereby reducing the possibility of incorrect interpretation.
[0063] [Example of reading progress display] 8 and 9 are diagrams showing examples of displaying the progress of image interpretation (when image interpretation is performed on the image interpretation terminals 200A and 200B). Fig. 8 shows the state in which image interpretation is in progress, and Fig. 9 shows the state when image interpretation has been completed for the entire range of an image to be interpreted.
[0064] 8A shows the screen of the interpretation terminal 200A (whole display area 526A, individual display area 528A; display device 250), and FIG. 8B shows the screen of the interpretation terminal 200B (whole display area 526B, individual display area 528B; display device 250). When interpretation is performed for areas 540A and 540B in the individual display areas 528A and 528B of the interpretation terminals 200A and 200B, respectively, the processors 110 and 210 display the results in the whole display areas 526A and 526B in real time. Also, as shown in FIG. 9A, when interpretation is completed for areas 542A and 542B in the interpretation terminals 200A and 200B, respectively, the processors 110 and 210 display the results in the whole display areas 526A and 526B in real time.
[0065] When displaying the interpretation progress status, the processor 110 can treat the interpretation progress status as “information indicating the interpretation result,” that is, as “display operation.” The processor 110 can also determine the progress or end of interpretation based on an operation on the interpretation terminals 200A and 200B (for example, clicking a button indicating that interpretation for a specified area has been completed).
[0066] Such a display allows the user to easily grasp the progress of the image interpretation and also prevents the user from missing any part of the image interpretation (FIG. 9 shows an example in which there are no gaps in the image interpretation range).
[0067] [Other examples of images to be interpreted] 5 to 9 show examples in which the entire display area and the individual display area are displayed on one screen (window), but the entire display area and the individual display area may be displayed on separate screens (windows) in the interpretation support system 10. Also, as shown in Fig. 10, the entire display area 550A and the individual display area 552A may be displayed on two display devices 252A and 254A, respectively.
[0068] In addition, in the image interpretation support system 10, a plurality of images to be interpreted may be displayed on the image interpretation terminal 200, or an image showing a plurality of objects may be displayed. 2A 11 shows an example of how images of multiple objects are displayed in the individual display areas 564A and 566B. In the example of FIG. 11, four images of the object 600 are displayed in the overall display area 562A, and four users (Technologists A to D) are each responsible for interpreting one of the objects 600. Each user inputs the interpretation results (the location and type of defect) in areas 566A to 566D. For example, when Technologist A, a user of the image interpretation terminal 200A, inputs area 566A in the individual display area 564A as "an area where bubbles exist," the processor 110 classifies the operation as a "display operation" and displays the processing results on all image interpretation terminals in real time. This allows each user to easily recognize the results of the display operations performed by other users, and multiple users can efficiently perform image interpretation, as in the above-mentioned embodiment.
[0069] When images of a plurality of objects are displayed, the objects may be of the same type or different types.
[0070] [Effects of the first embodiment] As described above, in the image interpretation support system 10 according to the first embodiment, the image interpretation support server 100 (processor 110) classifies operations received by the image interpretation terminal 200 into display operations and non-display operations (first display operations, second display operations), and causes the local terminal and other terminals to display results according to this classification. Operation results (display operation results) that all users must confirm, such as inputting image interpretation results, are displayed in real time on the overall display screen, while individual operation results (the results of the first display operation and the second display operation), such as image enlargement and reduction, are displayed in real time on individual display screens. This reduces the possibility of image interpretation omissions or errors, and allows users to perform image interpretation under desired conditions without being bothered by unnecessary displays. In this way, according to the first embodiment, multiple users can simultaneously access the same image and perform image interpretation efficiently.
[0071] [Variation: Sharing the results of the hide operation] 12 is a flowchart showing the process performed when a user wishes to share the results of a hide operation with some other users during image interpretation.
[0072] For example, suppose that the user of the image interpretation terminal 200A (Technologist A) wishes to share the results of a hide operation only with the user of the image interpretation terminal 200B (Technologist B), and the user of the image interpretation terminal 200B (Technologist B) agrees to this (conversely, if Technologist B wishes to share the operation results with Technologist A, the same processing can be performed). For example, Technologist A may wish to consult or ask questions about the information entered by Technologist B, or may wish to perform image interpretation using common screen display conditions (such as image enlargement / reduction, rotation, movement, and brightness change) for both Technologists A and B. In this case, Technologist A operates the image interpretation terminal 200A to specify that the operation results be shared with the image interpretation terminal 200B. The terminal-side operation reception processing unit 210B (processor 210) of the image interpretation terminal 200A receives the user's operation (including the operation content and the specification of the user or image interpretation terminal with whom the operation will be shared) (terminal-side operation reception processing, terminal-side operation reception step).
[0073] The operation reception processing unit 110C (processor 110) of the interpretation support server 100 receives the operation performed on the interpretation terminal 200A (YES in step S110: operation reception processing, operation reception step). This operation includes designation of a third terminal, different from the first and second terminals, that is permitted to display the results of the hide operation. The classification processing unit 110E determines whether the interpretation terminal to be processed has received input from an interpretation terminal (a third terminal different from the first and second terminals) that is permitted to display the results of the hide operation (step S142: other terminal result display processing, other terminal result display step). In the above example, the interpretation terminal 200B is determined to be the third terminal.
[0074] The other terminal result display processing unit 110F (processor 110) displays the results of the hide operation in real time on the display device 250 of the reading terminal 200B (third terminal, other terminal) (step S144: other terminal result display processing, other terminal result display step, first result display processing, first result display step), and prohibits the display of the results of the hide operation on reading terminals not designated by Technologist A (in this case, reading terminal 200C).
[0075] The display of the operation results described above is also performed in the same way for the operation by Technologist B (interpretation terminal 200B), and the display operation results on the interpretation terminal 200B are displayed on the interpretation terminal 200A. When the operation results are shared among some users in this way, the interpretation support server 100 can display the operation results in individual display areas on the display device 250.
[0076] By sharing the results of operations in this way, a user (in this case, Technologist A) can easily and accurately understand the thoughts and interpretation results of another user (Technologist B). This function can be used, for example, when an inexperienced technician is performing an interpretation with the support of a more experienced technician. Meanwhile, the remaining user (Technologist C) can proceed with the interpretation work as usual without being influenced by the thoughts and interpretation results of other users. This allows all users to perform interpretation efficiently according to the situation.
[0077] It is preferable that the results of the hide operation be shared among some users only when all users who wish to share the results agree. For example, in the above example, if Technologist A wishes to share the operation results with Technologist B, it is preferable that the above-mentioned processing be performed when Technologist B agrees to the sharing. The interpretation support server 100 notifies Technologist B (interpretation terminal 200B) that Technologist A wishes to share the operation results with Technologist B, and when Technologist B performs an operation to agree via the operation unit 260, it can be determined that such agreement has been reached.
[0078] Instead of or in addition to the above-described mode in which the results of the hide operation are shared among some users, a certain user (e.g., the interpretation terminal 200A) may share the results of only a specified operation (hereinafter referred to as a "specific hide operation") among the hide operations with other users (e.g., the interpretation terminal 200B). For example, a process may be performed in which "the operation results of enlarging / reducing or moving the image to be interpreted are shared with other users, but the operation results of changing the brightness of the image to be interpreted are not shared with other users." In this case, as shown in FIG. 13, the operation reception processing unit 110C (processor 110) of the interpretation support server 100 receives the operation performed on the interpretation terminal 200A (YES in step S110: operation reception processing, operation reception step). This operation includes specifying a fourth terminal, different from the first terminal and the second terminal, that is permitted to display the results of the specified hide operation, which is one of the hide operations. The classification processing unit 110E (processor) determines whether or not it has received an input from a terminal (fourth terminal) that is permitted to display the result of the specific hide operation (step S142A: classification processing, classification step). That is, the classification processing unit 110E (processor) determines whether or not the hide operation is a specific hide operation (step S142A: classification processing, classification step), causes the result of the specific hide operation to be displayed in real time on another interpretation terminal 200 (another terminal, a fourth terminal different from the first terminal and the second terminal) (step S144A: other terminal result display processing, other terminal result display step), and prohibits the display of the operation result on the other interpretation terminal 200 for hide operations other than the specific hide operation (step S146A: other terminal result display processing, other terminal result display step). The classification processing unit 110E can determine whether or not it has received an input from a terminal that is permitted to display the result of the specific hide operation, i.e., whether or not the hide operation is a specific hide operation, based on, for example, the operation of Technologist A, the user of the interpretation terminal 200A. In addition, the users (interpretation terminal 200, fourth terminal) who share the results of the specific hide operation may be all other users (for example, technicians B, C, and D when focusing on technician A), or only some users (for example, technician D (interpretation terminal 200D) when focusing on technician A).
[0079] [User / Reading Device Level Settings] In the first embodiment and the modified example, when multiple users perform image interpretation, the image interpretation support system 10 (image interpretation support server 100) may set administrator authority for some users (or image interpretation terminals) and allow those users to perform operations that other users cannot. For example, it is conceivable to accept operations from users with administrator authority, such as instructions to start and end image interpretation and designation of images to be interpreted.
[0080] [Communication between image reading terminals] In the first embodiment and the modified example, the processor 110 (communication control unit 110I) The processor 210 (communication control unit 210D) may also allow communication between the interpretation terminals. When multiple users are performing interpretation in parallel, the interpretation can be performed more efficiently if communication is possible, and users in remote locations can easily participate in the interpretation. Such communication can be performed using images, audio, text, etc.
[0081] [Other examples of imaging devices and images to be interpreted] In the first embodiment and the modified example described above, a radiological image of an industrial product is used as the image to be read. However, in the present invention, an image captured in a wavelength band other than a radiological image, such as visible light or ultrasound, may also be used as the image to be read.
[0082] In addition, in the present invention, images of objects other than industrial products can also be used as the image to be interpreted. Specifically, the image to be interpreted may be an image of a building (an example of an object; also referred to as a building or a structure) captured using wavelength bands such as visible light, infrared light, or millimeter waves. Examples of "buildings" include bridges, bridge piers, roads, tunnels, dams, and buildings. The building may be made of concrete. In addition, in the present invention, the image to be interpreted may be a medical image of a living body (an example of an object) captured by an imaging device such as an endoscope, ultrasound device, CT (Computed Tomography), or MRI (Magnetic Resonance Imaging). The image to be interpreted may also be obtained from a system such as a Hospital Information System (HIS) or a Radiology Information System (RIS).
[0083] In addition, in images to be interpreted that have buildings or medical images as the object, damage or deformations to buildings such as cracks, peeling, water leaks, etc., lesions or their candidates in medical images, regions of interest (ROIs, also called regions of interest) such as organs and blood vessels can be treated in the same way as "defects" in the first embodiment.
[0084] Furthermore, when multiple images obtained by photographing an object in segments are used as the image to be interpreted, the images may be synthesized, for example, as a panoramic image, and the synthesized image may be used as the image to be interpreted. Depending on the shape and size of the object, the object may be photographed multiple times, in which case multiple images covering a wide area may be synthesized into one. Furthermore, multiple users may share the interpretation of such a wide-area image. According to the present invention, even in such a case, multiple users can simultaneously access the same image and perform efficient interpretation.
[0085] Although the embodiments and modifications of the present invention have been described above, the present invention is not limited to the above-described aspects, and various modifications are possible without departing from the spirit of the present invention. [Explanation of symbols]
[0086] 10. Image interpretation support system 100 Image interpretation support server 110 processors 110A Image acquisition unit 110B Image display processing unit 110C Operation reception processing unit 110D Self-terminal result display processing unit 110E Classification processing unit 110F Other terminal result display processing unit 110G verification processing unit 110H Notification processing section 110I Communication control unit 120 ROM 130 RAM 140 Recording Device 200 image reading terminals 200A Image Reading Terminal 200B Image Reading Terminal 200C Image Reading Terminal 200D Image Reading Terminal 210 processor 210A Terminal side image display processing unit 210B terminal side operation reception processing unit 210C Terminal side result display processing unit 210D Communication control unit 220 ROM 230 RAM 240 Recording Device 250 Display device 252A Display device 254A Display device 260 Operation section 300 Imaging System 400 databases 502A screen 502B screen 504A screen 504B screen 512A Entire display area 512B Entire display area 514A Individual display area 514B Individual display area 520A Reading Range 520B Reading Range 522A overall display screen 522B Overall display screen 524A Individual display screen 524B Individual display screen 526 areas 526A Entire display area 526B Entire display area 528 Messages 528A Individual display area 528B Individual display area 530A area 530B area 530C area 540A area 540B area 542A area 542B area 550A entire display area 552A Individual display area 560A screen 562 Entire display area 562A Entire display area 564A Individual display area 566A area 566B area 566C area 566D area 600 objects NW Network S100~S160 Each step of the interpretation support method S142A, S144A, S146A Each step of the interpretation support method
Claims
1. An image interpretation support server including a processor, The processor: an image display process for displaying an image of an object to be interpreted on a first terminal connected to the image interpretation support server and a second terminal different from the first terminal; an operation reception process for receiving operations performed on the first terminal and the second terminal with respect to the displayed image to be interpreted; a self-terminal result display process for displaying, on the first terminal in real time, a result of processing based on an operation received from the first terminal, and displaying, on the second terminal in real time, a result of processing based on an operation received at the second terminal; a classification process of classifying the operation received from the first terminal into a display operation and a non-display operation; an other-terminal result display process that, when the display operation is performed on the first terminal, causes the second terminal to display a result of the performed display operation in real time, and, when the hide operation is performed on the first terminal, prohibits the second terminal from displaying a result of the performed hide operation; An image interpretation support server that executes the above.
2. In the classification process, the processor An operation by the users of the first terminal and the second terminal to input information indicating an interpretation result of the image to be interpreted is classified as the display operation; The image interpretation support server according to claim 1 , wherein an operation by the user of the first terminal to input information regarding processing of the image to be interpreted is classified as the non-display operation.
3. In the classification process, the processor Accept at least one of the number, position, type, degree, and reason for determining the degree of defects in the image to be interpreted as information indicating the interpretation result; The image interpretation support server of claim 2 accepts at least one of the following operations for enlarging or reducing the image to be interpreted, moving, rotating, transforming, changing the gradation, setting the interpretation range, specifying a defect, and setting the interpretation content as information regarding the processing of the image to be interpreted.
4. The processor: In the classification process, an operation of setting the image interpretation range in the image to be interpreted is received as information regarding processing of the image to be interpreted; The image interpretation support server according to claim 3, wherein a notification process is performed to notify a user of a confirmation result as to whether or not the area in the image to be interpreted that includes the object is completely covered by the set image interpretation range.
5. The interpretation support server according to any one of claims 2 to 4, wherein, in the other terminal result display process, the processor associates information indicating the interpretation result with the fact that the interpretation result was input from the first terminal and displays it in an identifiable manner on the second terminal.
6. The processor: In the operation acceptance process, accepting designation of a third terminal that is different from the first terminal and the second terminal and that is permitted to display a result of the non-display operation; In the image display process, the third terminal is caused to display the image to be interpreted; The image interpretation support server according to claim 1 , wherein the result of the non-display operation is displayed in real time on the third terminal in the other terminal result display process.
7. The processor: In the operation reception process, a designation of a fourth terminal that is different from the first terminal and the second terminal and that is permitted to display a result of a specific hide operation that is a designated operation among the hide operations is received; In the image display process, the fourth terminal is caused to display the image to be interpreted; The image interpretation support server according to claim 1 , wherein the result of the specific non-display operation is displayed in real time on the fourth terminal in the other terminal result display process.
8. The interpretation support server according to any one of claims 1 to 7, wherein the processor displays on the first terminal and the second terminal one of an image of a building, an image of an industrial product, and a medical image of a living body as the image to be interpreted.
9. an image interpretation support server including a processor; a first terminal connected to the image interpretation support server and displaying an image to be interpreted; a second terminal connected to the image interpretation support server and displaying the image to be interpreted, the second terminal being different from the first terminal; An image interpretation support system comprising: The processor: an image display process for displaying an image of an object to be interpreted on a first terminal connected to the image interpretation support server and a second terminal different from the first terminal; an operation reception process for receiving operations performed on the first terminal and the second terminal with respect to the displayed image to be interpreted; a self-terminal result display process for displaying, on the first terminal in real time, a result of processing based on an operation received from the first terminal, and displaying, on the second terminal in real time, a result of processing based on an operation received at the second terminal; a classification process of classifying the operation received from the first terminal into a display operation and a non-display operation; an other-terminal result display process that, when the display operation is performed on the first terminal, causes the second terminal to display a result of the performed display operation in real time, and, when the hide operation is performed on the first terminal, prohibits the second terminal from displaying a result of the performed hide operation; A radiology support system that performs the following:
10. A method for supporting image interpretation using an image interpretation support server, comprising: an image display step of displaying an image of an object to be interpreted on a first terminal connected to the image interpretation support server and a second terminal different from the first terminal; an operation receiving step of receiving operations performed on the first terminal and the second terminal with respect to the displayed image to be interpreted; a terminal result display step of displaying, in real time on the first terminal, a result of processing based on the operation received from the first terminal, and displaying, in real time on the second terminal, a result of processing based on the operation received at the second terminal; a classification step of classifying the operations received from the first terminal into display operations and non-display operations; an other terminal result display step of, when the display operation is performed on the first terminal, displaying a result of the performed display operation on the second terminal in real time, and, when the hide operation is performed on the first terminal, prohibiting display of the result of the performed hide operation on the second terminal; The image interpretation support method includes:
11. An image interpretation support program that causes an image interpretation support server to execute an image interpretation support method, The image interpretation support method includes: an image display step of displaying an image of an object to be interpreted on a first terminal connected to the image interpretation support server and a second terminal different from the first terminal; an operation receiving step of receiving operations performed on the first terminal and the second terminal with respect to the displayed image to be interpreted; a terminal result display step of displaying, in real time on the first terminal, a result of processing based on the operation received from the first terminal, and displaying, in real time on the second terminal, a result of processing based on the operation received at the second terminal; a classification step of classifying the operations received from the first terminal into display operations and non-display operations; an other terminal result display step of, when the display operation is performed on the first terminal, displaying a result of the performed display operation on the second terminal in real time, and, when the hide operation is performed on the first terminal, prohibiting display of the result of the performed hide operation on the second terminal; A radiology support program with:
12. A non-transitory computer-readable recording medium having the program according to claim 11 recorded thereon.
13. An image interpretation terminal connected to an image interpretation support server, a processor; The processor: A terminal-side image display process for displaying an image of the object to be interpreted under the control of the image interpretation support server; a terminal-side operation reception process for receiving a user's operation on the image to be interpreted; a terminal-side result display process for displaying a result processed by the image interpretation support server according to a classification result in the image interpretation support server as to whether the accepted operation is a display operation for which display of the operation result on another image interpretation terminal connected to the image interpretation support server is permitted, or a non-display operation for which display of the operation result on the other image interpretation terminal is prohibited, the terminal-side result display process being a first result display process for displaying a result of the display operation accepted by the image interpretation terminal and a result of the non-display operation accepted by the image interpretation terminal, or a second result display process for displaying a result of the display operation accepted by the other image interpretation terminal; A reading terminal that runs the following:
Citation Information
Patent Citations
Computer-assisted reconciliation of multiple image read contents
JP2004199691A
Medical information display system
JP2018180797A
Defect inspection apparatus, defect inspection method, and program
WO2018034057A1
Image processing device, radiation imaging system, image processing method, and image processing program
WO2019230807A1