Business support equipment and business support programs

Abstract

To enable increased efficiency in tasks related to the diagnosis of dynamic images. [Solution] The business support device comprises a display unit that displays an analysis image of the dynamic image of the subject to be processed obtained by radiation irradiation of the subject; a dialogue unit that performs a dialogue including receiving input of questions regarding the displayed analysis image and outputting a response to the input question; and an output unit that outputs case information corresponding to the dynamic image of the subject to be processed based on the displayed analysis image and the content of the performed dialogue.

Description

Technical Field

[0001] The present invention relates to a business support device and a business support program.

Background Art

[0002] There is known a support device that supports a doctor's diagnosis by analyzing a dynamic image obtained by irradiating a patient with radiation using a computer. For example, in the device described in Patent Document 1, a site suspected of having a disease is marked on a still image by image analysis, and a site corresponding to the site is marked on a dynamic image, and by providing such a still image and a dynamic image, it supports a doctor's diagnosis.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Diagnosis of a still image obtained by radiation irradiation is often performed by a specialized doctor called a radiologist. Therefore, even with the provision of a still image and a dynamic image as described above, it is often burdensome and time-consuming for a doctor with little experience to make a diagnosis based on a dynamic image. In addition, diagnosis based on a dynamic image is a relatively new diagnosis, and even a radiologist may sometimes require time for diagnosis. Therefore, not limited to marking a site suspected of having a disease, a business support device that supports operations related to diagnosis of a dynamic image and enables the efficiency of such operations is desired.

[0005] An object of the present invention is to provide a business support device and a business support program that can improve the efficiency of operations related to diagnosis of a dynamic image.

Means for Solving the Problems

[0006] The business support device according to the present invention is A display unit that displays an analysis image of the dynamic image of the object being processed, obtained by irradiating the subject with radiation, A dialogue unit that performs a dialogue including receiving input of questions regarding the displayed analysis image and outputting responses to the input questions, An output unit outputs case information corresponding to the dynamic image to be processed, based on the displayed analysis image and the content of the executed dialogue. It is equipped with.

[0007] The business support program according to the present invention is In the computer of a business support system that assists in case diagnosis of dynamic images of subjects obtained by radiation irradiation of subjects, A process to display an analyzed image for the dynamic image of the subject to processing, A process that performs a dialogue including receiving input questions regarding the displayed analysis image and outputting responses to the input questions, A process that outputs case information corresponding to the dynamic image of the subject to processing, based on the displayed analysis image and the content of the executed dialogue, Make it run. [Effects of the Invention]

[0008] According to the present invention, it is possible to improve the efficiency of tasks related to the diagnosis of dynamic images. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 illustrates an example of the configuration of a radiation image processing system. [Figure 2] Figure 2 is a block diagram illustrating an example of the functional configuration of the imaging control unit in a radiographic imaging device that constitutes a radiographic image processing system. [Figure 3] Figure 3 is a block diagram illustrating an example of the functional configuration of a radiography control device that constitutes a radiographic image processing system. [Figure 4] Figure 4 is a block diagram illustrating an example of the functional configuration of a radiation image analysis device that constitutes a radiation image processing system. [Figure 5] Figure 5 is a block diagram illustrating an example of the functional configuration of a client terminal that also functions as a business support device according to an embodiment of the present invention. [Figure 6] Figure 6 is a flowchart illustrating the business support program (business support method) implemented on the client terminal. [Figure 7] Figure 7 shows an example of a list of dynamic images displayed on the display unit. [Figure 8] Figure 8 shows an example of the analysis image and operation menu displayed on the display unit. [Figure 9] Figure 9 shows an example of an analysis image and dialogue area displayed on the display unit, and is a diagram showing an example of a question entered into the dialogue area. [Figure 10] Figure 10 is a diagram showing an example of an answer to a question entered in Figure 9, and is a diagram showing an example of an analysis image similar to the answer displayed in the dialogue area and the analysis image displayed in the display unit. [Figure 11] Figure 11 shows an example of a newly entered question and an answer to that question, as displayed on the display unit. [Figure 12] Figure 12 shows an example of an analysis image displayed on the display unit, an analysis image similar to the said analysis image, and an example of an operation menu. [Modes for carrying out the invention]

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0011] <Configuration of the Radiation Image Processing System> FIG. 1 is a diagram for explaining the radiation image processing system 1 of the present embodiment. The radiation image processing system 1 includes a radiation image imaging system 10, a radiation imaging control device (console device) 20, a radiation image analysis device 30, an image management device 40, and a client terminal 50.

[0012] In the example shown in FIG. 1, the radiation image imaging system 10 is arranged in the imaging room, and the radiation imaging control device 20 is arranged in the operation room. The radiation image imaging system 10, the radiation imaging control device 20, the radiation image analysis device 30, the image management device 40, and the client terminal 50 are connected to each other via a communication network N. As the communication network N, for example, a communication network conforming to the DICOM (Digital Image and Communications in Medicine) standard or the like is used.

[0013] In addition, a radiation information terminal 60 as a radiation information system for transmitting information related to radiation examinations, such as patient examination order information, etc., to the radiation image processing system 1 is connected to the communication network N. Examples of the radiation information terminal 60 include a RIS (Radiology Information System) or the like.

[0014] The radiography imaging system 10 performs dynamic radiography (hereinafter referred to as dynamic imaging), which is the acquisition of dynamic radiographic images (hereinafter referred to as dynamic images), based on the control of the radiography control device 20. The radiography control device 20 controls the radiography imaging system 10 based on examination order information, etc., transmitted from the radiography information terminal 60. The dynamic images generated by the radiography imaging system 10 are processed by the radiography control device 20 as described later and transmitted to the radiography image analysis device 30. The radiography image analysis device 30 performs dynamic analysis on the dynamic images. The dynamic images and the results of the dynamic analysis are transmitted to an image management device 40, which is a medical image management system, for management. The image management device 40 may be, for example, a PACS (Picture Archiving and Communication System). The dynamic images and the results of the dynamic analysis are transmitted to a client terminal 50 and viewed by medical professionals such as doctors.

[0015] In this embodiment, motion imaging refers to obtaining multiple frame images by repeatedly irradiating a subject with pulsed radiation (e.g., X-rays) at a predetermined frame rate (pulsed irradiation). Motion image refers to a series of frame images obtained by motion imaging. Motion analysis refers to analytical processing applied to motion images, and includes not only processing to analyze the movement of a subject based on the motion image, but also processing to enhance or reduce (remove) predetermined structures by analyzing the motion image.

[0016] The radiographic imaging system 10, the radiographic imaging control device 20, and the radiographic image analysis device 30 each have a processor and memory, and are a type of computer that realizes predetermined functions by reading, expanding, and executing programs stored in memory.

[0017] [Radiological imaging system 10] As shown in Figure 1, the radiation imaging system 10 comprises an imaging control unit 11, a radiation irradiation unit 12, an imaging table 13, a radiation detection unit 14, a display unit 15, and an audio output unit 16.

[0018] The imaging control unit 11 acquires setting information regarding dynamic imaging settings from the radiation imaging control device 20. Based on the setting information, the imaging control unit 11 sets the imaging conditions for dynamic imaging, and based on these imaging conditions, controls the radiation irradiation unit 12 to irradiate the patient M (subject) with radiation and perform imaging. The imaging control unit 11 is composed of a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), etc.

[0019] The setting information refers to information regarding the settings for performing dynamic imaging on patient M. For example, the setting information includes at least one of several types of dynamic analysis that the radiographic image analysis device 30 can perform on the dynamic image. If multiple types of dynamic analysis are combined, the setting information may also include information regarding that combination. The setting information is set in the radiographic imaging control device 20 (described later) by the operator of the radiographic image processing system 1, such as a radiographer.

[0020] The imaging conditions include various factors such as pulse rate, pulse width, pulse interval, number of frames per scan, radiation dose per unit time, patient M's position during imaging, and patient M's physical condition (respiratory status, etc.). The pulse rate is the number of radiation exposures per second and corresponds to the frame rate of the image data. The pulse width is the radiation exposure time per exposure. The pulse interval is the time from the start of one radiation exposure to the start of the next and corresponds to the time interval (frame interval) between multiple image data. The imaging conditions can be automatically determined by the imaging control unit 11 of the radiation imaging system 10 based on the setting information.

[0021] The radiation irradiation unit 12 is positioned opposite the radiation detection unit 14, which is fixed to the imaging table 13. The radiation irradiation unit 12 irradiates radiation according to the control of the imaging control unit 11.

[0022] The radiation detection unit 14 is composed of a semiconductor image sensor such as an FPD (Flat Panel Detector). The radiation detection unit 14 has a substrate on which multiple detection elements (pixels) are arranged in a matrix to detect radiation irradiated from the radiation irradiation unit 12 according to its intensity, and to convert the detected radiation into an electrical signal and store it. Each pixel on the substrate is composed of a switching unit such as a TFT (Thin Film Transistor).

[0023] The radiation detection unit 14 controls the switching unit of each pixel based on the image reading conditions input from the radiation imaging control device 20 to read the electrical signal accumulated in each pixel and outputs intensity information for each pixel to the image generation unit 113. The image reading conditions include, for example, the frame rate, frame interval, pixel size, and image size (matrix size). The frame rate is the number of frame images acquired per second and is the same as the pulse rate. The frame interval is the time from the start of one image data acquisition operation to the start of the next frame image acquisition operation and is the same as the pulse interval.

[0024] The imaging control unit 11 and the radiation detection unit 14 are connected to each other and exchange synchronization signals to synchronize the radiation irradiation operation and the image reading operation.

[0025] In this way, the radiation imaging system 10 performs dynamic imaging of radiation images by having the radiation irradiation unit 12 irradiate radiation under the control of the imaging control unit 11, and the radiation detection unit 14 generate image data based on the intensity of the irradiated radiation.

[0026] The display unit 15 and the audio output unit 16 provide instructions to patient M regarding the posture to be taken (shooting position), physical condition, respiratory condition, etc., when performing dynamic imaging of patient M. The display unit 15 is a display device such as a CRT (Cathode Ray Tube), liquid crystal display (Liquid Crystal Display), or organic EL (Electro Luminescence) display. The audio output unit 16 is an audio output device such as a speaker. The audio output unit 16 provides instructions to patient M regarding physical condition, respiratory condition, etc., for example, by auto-voice. The display unit 15 and the audio output unit 16 may each provide the same instructions to patient M, or only one of them may provide instructions.

[0027] Figure 2 is a block diagram illustrating an example of the functional configuration of the imaging control unit 11 in the radiation image acquisition system 10, which constitutes the radiation image processing system 1. The imaging control unit 11 includes a setting information acquisition unit 111, an imaging condition determination unit 112, an image generation unit 113, and a storage unit 114.

[0028] The setting information acquisition unit 111 acquires setting information from the radiation imaging control device 20.

[0029] The imaging condition determination unit 112 determines the imaging conditions for performing dynamic imaging of patient M based on the setting information. Information showing the correspondence between multiple types of dynamic analysis and imaging conditions suitable for each dynamic analysis is stored in advance in the storage unit 114. In addition, information showing the correspondence between combinations of multiple types of dynamic analysis and imaging conditions suitable for those combinations is also stored in advance in the storage unit 114. The imaging condition determination unit 112 simply needs to read the information showing the correspondence from the storage unit 114 for the dynamic analysis or combination of multiple types of dynamic analysis indicated by the setting information, and compare it with the setting information to determine the imaging conditions.

[0030] In addition, in cases such as screening or emergency situations, it may not be possible to set the dynamic analysis information. In such cases, the imaging condition determination unit 112 determines the imaging conditions by having the operator select at least one imaging condition from a plurality of predefined imaging conditions. The imaging condition determination unit 112 also has the operator select examination order information and determines the imaging conditions based on the selected examination order information. Thus, if dynamic analysis cannot be set before dynamic imaging, dynamic analysis is set after dynamic imaging with the imaging conditions selected by the operator, and dynamic analysis is performed using the radiographic image analysis device 30 (analysis by the analysis unit 312, described later).

[0031] The image generation unit 113 performs dynamic imaging of patient M based on the determined imaging conditions and generates multiple frames of radiographic images. Specifically, the image generation unit 113 controls the operation of the radiation irradiation unit 12 and the radiation detection unit 14 based on the imaging conditions, and generates image data by acquiring intensity information regarding the radiation intensity transmitted through the subject from the radiation detection unit 14 for each pixel.

[0032] As described above, the memory unit 114 pre-stores information such as the correspondence between multiple types of motion analysis and shooting conditions suitable for each motion analysis, and the correspondence between combinations of multiple types of motion analysis and shooting conditions suitable for those combinations.

[0033] [Radiography control device 20] The radiography control device 20 is, for example, a computer such as a PC (Personal Computer) or workstation. The radiography control device 20 may be a desktop computer, as shown in the example in Figure 1, or it may be a portable computer, such as a laptop computer or tablet computer.

[0034] The radiography control device 20 receives inspection order information from the radiography information terminal 60, etc., and transmits it to the radiography imaging system 10, thereby controlling the dynamic imaging of the radiography imaging system 10.

[0035] The examination order information includes various information related to the next dynamic imaging procedure to be performed, such as instructions regarding respiration and imaging position, patient information, examination information, imaging information, and data attributes. The examination information includes information such as the examination ID, the area to be examined (e.g., chest, especially the lungs or heart), and the type of analysis (e.g., ventilation analysis, pulmonary blood flow analysis, measurement of maximum ventilation). Examination order information is generated, for example, when a physician requests dynamic imaging of patient M from the radiographic image processing system 1.

[0036] Furthermore, the radiography control device 20 generates setting information indicating at least one of several types of dynamic analysis that the radiography image analysis device 30 can perform, based on the operator's input. When combining multiple types of dynamic analysis, the radiography control device 20 generates setting information indicating the combination of multiple types of dynamic analysis. The operator recognizes which of the multiple types of dynamic analysis to combine by, for example, referring to the contents of the examination order information, and performs an input operation to generate the setting information based on this. Alternatively, the operator may recognize which dynamic analysis to combine based on information conveyed by a physician or other person through another method.

[0037] Figure 3 is a block diagram illustrating an example of the functional configuration of the radiography control device 20 that constitutes the radiography image processing system 1. The radiography control device 20 includes a control unit 21, a storage unit 22, an operation unit 23, a display unit 24, and a communication unit 25. Each component of the radiography control device 20 is connected to the others by a bus 26.

[0038] The radiography control device 20 outputs setting conditions set by the operator and other personnel, as well as inspection order information previously acquired from the radiography information terminal 60, etc., to the radiography imaging system 10, and controls the imaging process performed by the radiography imaging system 10. The radiography control device 20 may also display the dynamic images generated by the radiography imaging system 10, for example, for the operator to review.

[0039] The control unit 21 is composed of a CPU and RAM, etc. In the control unit 21, the CPU reads system programs and various processing programs stored in the memory unit 22 in response to the operation of the operation unit 23, loads them into the RAM, and controls the operation of each part of the radiography control device 20 based on the loaded programs.

[0040] The storage unit 22 is composed of non-volatile semiconductor memory, a hard disk, or the like. The storage unit 22 stores various programs executed by the control unit 21, parameters necessary for processing by the programs, or data such as processing results (dynamic images, etc.). The various programs are stored in the form of readable program code, and the control unit 21 sequentially executes operations according to the program code.

[0041] Furthermore, the memory unit 22 stores image reading conditions for performing dynamic imaging. In addition, the memory unit 22 stores examination order information transmitted from the radiation information terminal 60, etc. When the radiation imaging control device 20 controls the dynamic imaging of the radiation imaging system 10, it reads the image reading conditions and examination order information corresponding to patient M from the memory unit 22 and transmits them.

[0042] The operation unit 23 is an operating device such as a keyboard equipped with cursor keys, number input keys, and various function keys, a pointing device such as a mouse or trackball, and a touch panel. The operation unit 23 generates instruction signals based on the operator's input and outputs them to the control unit 21.

[0043] The display unit 24 is composed of display devices such as a CRT, liquid crystal display, or organic EL display. The display unit 24 displays input instructions from the operation unit 23 and image data (such as motion images) generated by the radiation imaging system 10, in accordance with the instructions of the display signals input from the control unit 21.

[0044] The communications unit 25 transmits and receives data between the radiation image acquisition system 10, the radiation image analysis device 30, the radiation information terminal 60, etc.

[0045] [Radiation Image Analysis Device 30] The radiation image analysis device 30 is, for example, a computer such as a PC or workstation. The radiation image analysis device 30 may be a desktop computer or a portable computer, such as a laptop or tablet computer.

[0046] The radiation image analysis device 30 performs motion analysis on motion images captured by the radiation image acquisition system 10 based on the setting information set in the radiation imaging control device 20.

[0047] Figure 4 is a block diagram illustrating an example of the functional configuration of a radiation image analysis device 30 that constitutes the radiation image processing system 1. The radiation image analysis device 30 includes a control unit 31, a storage unit 32, an operation unit 33, a display unit 34, and a communication unit 35. Each component of the radiation image analysis device 30 is connected by a bus 36.

[0048] The control unit 31 is composed of a CPU and RAM, etc. In the control unit 31, the CPU reads system programs and various processing programs stored in the memory unit 32 in response to the operation of the operation unit 33, expands them into RAM, and performs operational control and dynamic analysis of each part of the radiation image analysis device 30 based on the expanded programs.

[0049] The control unit 31 includes an image acquisition unit 311 and an analysis unit 312.

[0050] The image acquisition unit 311 acquires dynamic images, which are multiple frames of radiographic images generated by the radiographic image acquisition system 10 and the radiographic image acquisition control device 20.

[0051] The analysis unit 312 performs motion analysis on a motion image containing multiple frame images, as configured in the settings information, obtains the analysis results, and generates an analysis image that displays the analysis results on the motion image. For example, the analysis unit 312 performs analysis based on signal changes in multiple frame images and displays the analysis results based on the signal changes on the motion image. In this case, if the analysis unit 312 cannot analyze the motion image (cannot obtain analysis results), it determines that analysis is not possible.

[0052] The analysis unit 312 has various types of dynamic analysis, such as blood flow analysis mode, ventilation analysis mode, adhesion analysis mode, diaphragm displacement analysis mode, and orthopedic-related measurement mode. Each mode is briefly described below.

[0053] The blood flow analysis mode visualizes signal changes within the lung field that are synchronized with the heartbeat.

[0054] The ventilation analysis mode extracts temporal signal changes in a specific time-frequency band and visualizes the behavior of lung tissue during respiration.

[0055] Adhesion analysis mode is a mode that visualizes the degree of adhesion in tissues.

[0056] The diaphragm displacement analysis mode tracks the vertical movement of the diaphragm during respiration.

[0057] The orthopedic measurement mode measures the positional changes of specified bones, such as in the limbs, and displays the trajectory of their movement.

[0058] The storage unit 32 is composed of non-volatile semiconductor memory, a hard disk, or the like. The storage unit 32 stores data such as various programs executed by the control unit 31, parameters necessary for processing by the programs, or processing results (dynamic images, analysis results, analysis images, etc.). The various programs are stored in the form of readable program code, and the control unit 31 sequentially executes operations according to the program code.

[0059] Furthermore, the memory unit 32 stores patient information, examination information, and list information indicating the status (for example, progress status such as receiving, dynamic analysis in progress, analysis completed, etc.) related to each dynamic image generated by the radiographic imaging system 10. In addition, the memory unit 32 stores analysis results and analyzed images associated with the dynamic images.

[0060] The operation unit 33 is an operating device such as a keyboard equipped with cursor keys, numeric input keys, and various function keys, a pointing device such as a mouse or trackball, and a touch panel. The operation unit 33 generates instruction signals based on the operator's input and outputs them to the control unit 31. The operation unit 33 may also be equipped with a touch panel on the display screen of the display unit 34, in which case it outputs instruction signals input via the touch panel to the control unit 31.

[0061] The display unit 34 is composed of a display device such as a CRT, liquid crystal display, or organic EL display. The display unit 34 displays input instructions from the operation unit 33 and image data (dynamic images, analysis results, analysis images, etc.) generated by the radiation imaging system 10, in accordance with the instructions of the display signals input from the control unit 31.

[0062] The communication unit 35 transmits and receives data between the radiography control device 20 and the image management device 40, etc.

[0063] [Client terminal 50] The client terminal 50 (business support device in this invention) is, for example, a computer such as a PC or workstation. The client terminal 50 may be a desktop computer or a portable computer, such as a notebook computer or a tablet computer.

[0064] The client terminal 50 is a computer used by a physician. The physician views the information such as the dynamic images, analysis results, and analyzed images described above on the client terminal 50. In this embodiment, the client terminal 50 is configured to support the physician's diagnosis based on the information such as the dynamic images, analysis results, and analyzed images, as described below.

[0065] Figure 5 is a block diagram illustrating an example of the functional configuration of a client terminal 50 that also functions as a business support device according to this embodiment.

[0066] The client terminal 50 includes a control unit 51, a storage unit 52, an operation unit 53, a display unit 54, and a communication unit 55. These components of the client terminal 50 are connected by a bus 56.

[0067] The control unit 51 is composed of a CPU and RAM, etc. In the control unit 51, the CPU reads system programs and various processing programs stored in the memory unit 52 in response to the operation of the operation unit 53, expands them into RAM, and performs processing for viewing information based on the expanded programs. In this embodiment, the control unit 51 executes, for example, a business support program described later as a processing program, and provides information to support the doctor's diagnosis.

[0068] The control unit 51 includes an information acquisition unit 511, a dialogue unit 512, and an output unit 513.

[0069] The information acquisition unit 511 acquires information such as dynamic images of the subject to processing, analysis results, and analysis images from the image management device 40 based on input operations by the physician.

[0070] The dynamic images, analysis results, and analysis images acquired by the information acquisition unit 511 are displayed on the display unit 54 and made available for viewing by the physician. In the following explanation, analysis images will be used as an example to illustrate the subject of display and questions, but these subjects may also be dynamic images or analysis results, or multiple or all of the dynamic images, analysis results, and analysis images.

[0071] The dialogue unit 512 performs a dialogue that includes receiving input questions regarding the analysis image of the dynamic image to be processed, which is displayed on the display unit 54 (hereinafter referred to as the analysis image to be processed), and outputting a response to the input question. The dialogue unit 512 displays a dialogue area 543 on the display unit 54, for example as shown in Figure 9 described later, and performs the above dialogue in the dialogue area 543.

[0072] The dialogue unit 512 may limit the number of dialogue repetitions to a predetermined number, in which case processing in the output unit 513 occurs after the predetermined number of dialogues. If the number of questions is too large, the accuracy of searching and extraction may decrease depending on the content of the questions, and the efficiency may also decrease, so for example, the predetermined number may be limited to three.

[0073] Furthermore, the dialogue unit 512 may have a template for receiving questions, in which case the doctor will input the questions according to the template.

[0074] Furthermore, although not shown in the diagram, the dialogue unit 512 has a natural language processing unit that recognizes the natural language input into the dialogue area 543 and processes it so that it can be used for searching and extraction in the output unit 513. The dialogue unit 512 may also have a speech recognition processing unit, in which case it performs speech recognition of the voice input from the voice input unit (e.g., microphone) of the client terminal 50 and inputs it into the dialogue area 543.

[0075] The output unit 513 searches for and extracts analysis images similar to the analysis image to be processed from the first search data, described later, stored in the storage unit 52, based on the analysis image to be processed and the content of the dialogue performed. The output unit 513 then outputs the dynamic image containing the extracted analysis image and its case information. If the number of dialogue repetitions is limited to a predetermined number of times, the output unit 513 only needs to extract analysis images similar to the analysis image to be processed based on the analysis image to be processed and the content of the dialogue performed a predetermined number of times. The output unit 513 may also extract multiple analysis images, in which case it may output multiple case candidates as case information. In this case, the output unit 513 may output multiple case candidates in order of their accuracy relative to the dynamic image to be processed.

[0076] Furthermore, the output unit 513, although not shown in the diagram, includes a learning unit and an extraction unit. The learning unit generates a learning model by machine learning the first search data. The extraction unit takes the analysis image to be processed and the content of the dialogue as input items and uses the learning model to search for and extract analysis images similar to the analysis image to be processed from the first search data. The input items are not limited to analysis images and the content of the dialogue; for example, information such as shooting conditions may also be included.

[0077] If the control unit 51 does not have an interaction unit 512, the output unit 513 will search and extract analysis images similar to the analysis image to be processed from the first search data, based on the analysis image to be processed. For example, the output unit 513 will use the analysis image to be processed as an input item and use a learning model to search and extract analysis images similar to the analysis image to be processed from the first search data. While a learning model is good at producing standardized outputs based on standardized inputs, it is difficult to obtain an output when the analysis image is atypical. Therefore, in this embodiment, the interaction unit 512 is used to search and extract similar analysis images in an interactive format, so that an appropriate output can be obtained even when the analysis image is atypical.

[0078] The storage unit 52 is composed of non-volatile semiconductor memory, a hard disk, or the like. The storage unit 52 stores various programs executed by the control unit 51, as well as parameters necessary for processing by those programs. The various programs are stored in the form of readable program code, and the control unit 51 sequentially executes operations according to the program code.

[0079] Furthermore, the memory unit 52 stores first search data, which includes multiple dynamic images and associated information (analysis images, shooting conditions, etc.) and the confirmed diagnostic results of cases based on each of the multiple dynamic images. The output unit 513 searches the first search data based on the analysis image to be processed and the content of the dialogue performed, and extracts analysis images similar to the analysis image to be processed. The memory unit 52 may update the first search data for multiple dynamic images based on confirmed diagnostic results of cases based on examinations other than dynamic images, in addition to the confirmed diagnostic results of cases based on dynamic images.

[0080] The first search data may also be held by the image management device 40. In this case, the output unit 513 may search for and extract similar analysis images from the first search data held by the image management device 40, and output case information of the dynamic image having said analysis image.

[0081] The operation unit 53 is an operating device such as a keyboard equipped with cursor keys, numeric input keys, and various function keys, a pointing device such as a mouse or trackball, and a touch panel. The operation unit 53 generates instruction signals based on the operator's input and outputs them to the control unit 51. The operation unit 53 may also be equipped with a touch panel on the display screen of the display unit 54, in which case it outputs instruction signals input via the touch panel to the control unit 51.

[0082] The display unit 54 is composed of a display device such as a CRT, liquid crystal display, or organic EL display. The display unit 54 displays input instructions from the operation unit 53, dynamic images, analysis results, and analysis images in accordance with the instructions of the display signals input from the control unit 31.

[0083] The communication unit 55 transmits and receives data with the image management device 40 and the like.

[0084] [Business Support Program (Business Support Methods)] Figure 6 is a flowchart illustrating the business support program (business support method) implemented on the client terminal 50. Figures 7 to 11 show examples of displays on the display unit. Here, we will explain using the case where the movement of the diaphragm is dynamically analyzed using the diaphragm displacement analysis mode described above as an example, but the following method can also be applied when dynamic analysis is performed using the other analysis modes described above.

[0085] (Step S11) The control unit 51 (information acquisition unit 511) of the client terminal 50 acquires a list 541 of motion images to be processed from the image management device 40 via the communication unit 55 and the communication network N. The control unit 51 displays the acquired list 541 of motion images on the display unit 54. For example, as shown in Figure 7, the control unit 51 displays a list 541 on the display unit 54 that includes the image ID, patient ID, etc., for each motion image. The control unit 51 accepts an input operation via the operation unit 53 to select a motion image to be processed from the list 541 displayed on the display unit 54.

[0086] For example, in Figure 7, if the dynamic image with image ID:3 is to be processed, the physician selects the dynamic image with image ID:3 from the list 541 displayed on the display unit 54, for example, using the mouse or cursor keys on the operation unit 53.

[0087] (Step S12) The control unit 51 reads the analysis results and the analyzed image along with the selected dynamic image of image ID:3 from the image management device 40 via the communication unit 55 and the communication network N, and displays the analyzed image of image ID:3 on the display unit 54. The analyzed image is played back as a video on the display unit 54, and the number of playbacks, playback speed, etc. can be changed by the physician viewing it.

[0088] Furthermore, the control unit 51 displays an operation menu 542 on the display unit 42 along with the analysis image of image ID:3, for example, as shown in Figure 8. Note that the analysis images shown in Figure 8 and Figures 9 to 12, which will be described later, are examples of color analysis images from a particular analysis mode being shown in black and white. In this embodiment, analysis images with analysis results in various display formats are displayed on the display unit 42 depending on the analysis mode.

[0089] When menu 542 is selected, multiple input items are displayed on the display unit 54, and the physician selects the desired item from among the multiple input items. The multiple input items include an input item to start entering the question.

[0090] (Step S13) The control unit 51 checks via the operation unit 53 whether there is an input operation to initiate the input of a question. In other words, the control unit 51 checks whether an input operation item to initiate the input of a question has been selected. If there is an input operation to initiate the question (YES), the process proceeds to step S14; if there is no input operation to initiate the question (NO), step S13 is repeated until an input operation to initiate the question is found.

[0091] (Step S14) The control unit 51 displays the dialogue area 543 on the display unit 54. For example, as shown in Figure 9, the control unit 51 displays the dialogue area 543 in a different area from the area where the analyzed image of image ID:3 is displayed.

[0092] (Step S15) The control unit 51 checks whether there is an input in the dialogue area 543 via the operation unit 53. If there is an input in the dialogue area 543 (YES), the process proceeds to step S16. If there is no input in the dialogue area 543 (NO), step S15 is repeated until there is an input in the dialogue area 543.

[0093] (Step S16) The control unit 51 (interaction unit 512) searches the first search data in the storage unit 52 for analysis images similar to the analysis image with image ID:3, based on the content of the input question, and extracts them.

[0094] For example, a doctor might input questions about an analysis image they are viewing, expressing any abnormalities or concerns they have. For instance, as shown in Figure 9, the question might be, "Is the diaphragm not moving properly?" In this case, the control unit 51 searches the first search data in the storage unit 52 for analysis images similar to the analysis image with image ID:3, and extracts them in relation to poor diaphragm movement.

[0095] (Step S17) The control unit 51 (output unit 513) reads the extracted analysis image and the case in the dynamic image containing the analysis image from the first search data in the storage unit 52, and displays them on the display unit 54 as the answer to the question.

[0096] For example, suppose there are multiple analysis images (e.g., images ID:X, ID:Y, ID:Z) that show similar poor diaphragm movement to the analysis image of image ID:3. In this case, as shown in Figure 10, the output unit 513 displays the analysis images of multiple images ID:X, ID:Y, and ID:Z along with the cases (e.g., case A, case B, case C) on the display unit 54.

[0097] Furthermore, as shown in Figure 10, the output unit 513 displays the response to the input question as text in the dialogue area 543. The response text includes, for example, the image ID, candidate cases, and the probability of each case. For example, in Figure 10, it reads: "Similar analysis images X, Y, and Z regarding poor diaphragmatic movement are displayed. The cases for analysis images X, Y, and Z are cases A, B, and C. The probability of case A is 40%. The probability of case B is 30%. The probability of case C is 5%."

[0098] (Step S18) The control unit 51 checks via the operation unit 53 whether there is an input operation to terminate the input of the question. For example, the control unit 51 checks whether there is a selection of the termination area 544 as shown in Figures 9 and 10. If there is a termination input operation (YES), the above process is terminated; if there is no termination input operation (NO), the process returns to step S15.

[0099] Returning to step S15, if a new question is entered, the control unit 51 repeats steps S16 and S17 described above with respect to the content of the newly entered question. In this case, if the content of the new question includes a predetermined term, such as "extraction cancellation," the control unit 51 cancels the motion images extracted so far and searches for and extracts the first search data based on the new question entered along with "extraction cancellation."

[0100] On the other hand, if the content of the new question does not include any predefined terms such as "extraction cancellation," the control unit 51 will repeat steps S16 and S17 described above with respect to the content of the new question, based on the extracted analysis image.

[0101] If you want to narrow down the list of potential cases for the analyzed images with relatively high accuracy, such as image ID:X and image ID:Y, you can narrow down the list by entering questions that compare differences, etc., as shown in Figure 11. In addition, regarding the diaphragm, in addition to the movement of the diaphragm as described above, you can narrow down the list of potential cases by entering questions that compare the rate of change in lung field area and the increase or decrease in lung field area.

[0102] In this case, the output unit 513 extracts the differences between the analyzed images of image ID:X and image ID:Y and the analyzed image of image ID:3, and displays the response regarding the extracted differences in text in the dialogue area 543, as shown in Figure 11. At this time, the control unit 51 may set the analyzed images displayed on the display unit 54 simultaneously with the analyzed image of image ID:3 to only the analyzed images of image ID:X and image ID:Y, so that the physician can easily compare these images visually.

[0103] If the dialogue is repeated and not all dialogue can be displayed within the dialogue area 543, the control unit 51 displays a scroll bar 545 next to the dialogue area 543, as shown in Figure 11, and allows the user to view all dialogue by operating the scroll bar 545.

[0104] By repeatedly engaging in dialogue with the client terminal 50, the physician can narrow down the list of potential cases for the dynamic images being processed, thereby enabling a more accurate diagnosis. In this embodiment, for example, the above-described dialogue allows for a highly accurate diagnosis of diaphragmatic laxity, in which case the client terminal 50 displays the diagnosis "diaphragmatic laxity" in the dialogue area 543. In other words, the client terminal 50 can support the physician's diagnostic work regarding the dynamic images being processed.

[0105] Furthermore, the control unit 51 may, for example, search and extract data from the image management device 40 regarding the narrowed-down case candidates, and display treatment plans and necessary subsequent examinations for similar cases on the display unit 54. This allows for support for physicians not only in diagnosing dynamic images but also in future medical work.

[0106] As described above, the client terminal 50 comprises a display unit 54, a dialogue unit 512, and an output unit 513. The display unit 54 displays an analysis image of the dynamic image obtained by radiation irradiation of patient M, who is the subject of the study. The dialogue unit 512 performs a dialogue that includes receiving input questions regarding the analysis image to be processed and outputting responses to the input questions. The output unit 513 outputs case information for the dynamic image to be processed based on the analysis image to be processed and the content of the performed dialogue.

[0107] The dialogue unit 512 and the output unit 513 output case information for the dynamic images being processed based on the dialogue; in other words, they output information that assists the physician's diagnosis. Therefore, it is possible to support the physician's work related to diagnosing the dynamic images being processed, and to improve the efficiency of that work. As a result, the physician can make a more accurate diagnosis of the dynamic images being processed.

[0108] <Example 1> In the above embodiment, the control unit 51 narrows down the candidate cases by repeatedly engaging in dialogue with the physician from the beginning with the dynamic images to be processed. In contrast, in this modified example, the control unit 51 first narrows down the candidate cases with the dynamic images to be processed, and then engages in dialogue with the physician.

[0109] For example, if the accuracy of the case candidates for the dynamic images to be processed is reasonably high, the control unit 51 can first narrow down the case candidates, and then the case candidates can be confirmed through dialogue with the physician and the final case information can be output, thereby enabling efficient diagnosis.

[0110] In this modified example, the control unit 51 further includes a filtering unit 514 (see Figure 5) for narrowing down the candidate cases. The filtering unit 514, for example, narrows down the analysis images from the first search data to candidates for analysis images, based on the analysis images of the dynamic images to be processed, to those similar to the said analysis images. In addition, the filtering unit 514 acquires dynamic images and cases that have analysis image candidates as dynamic image candidates and case candidates.

[0111] Here, the filtering unit 514 has a configuration similar to the output unit 513 described above, comprising a learning unit and an extraction unit. The extraction unit here takes the analyzed image as an input item and uses a learning model to search for and extract similar analyzed images from the first search data as candidate analyzed images.

[0112] Furthermore, the filtering unit 514 also determines the accuracy of each candidate case for the dynamic image to be processed, based on, for example, the similarity of the dynamic image to be processed to the analyzed image.

[0113] In this modified example, the filtering unit 514 displays, for example, the filtered image ID:3 along with the filtered image ID:Y, which are candidate images, as well as their cases and accuracy, on the display unit 54, as shown in Figure 12.

[0114] From this point onward, the process is the same as in the above embodiment. When an input operation item to start entering a question is selected from the menu 542 shown in Figure 12, the dialogue area 543 is displayed on the display unit 54, and the control unit 51 repeatedly engages in dialogue with the doctor, confirms the case candidates, and outputs the final case information.

[0115] In this way, the control unit 51 outputs case information for the dynamic images to be processed based on the filtering and interaction, thereby supporting the physician's work related to the diagnosis of the dynamic images to be processed and improving the efficiency of said work.

[0116] <Modification 2> In the above embodiment and modified example 1, dynamic analysis of the dynamic image is possible, and the analysis results and analyzed image can be obtained. However, if dynamic analysis of the dynamic image is not possible, and the analysis results and analyzed image cannot be obtained, that is, if there is no analyzed image for the dynamic image, the client terminal 50 supports the work by performing the following processing.

[0117] Specifically, the display unit 54 displays a motion image, not an analyzed image. The control unit 51 (dialogue unit 512) performs a dialogue that includes receiving input questions about the displayed motion image and outputting responses to the input questions. The control unit 51 (output unit 513) outputs information regarding the shooting conditions of the motion image based on the displayed motion image and the content of the performed dialogue.

[0118] In this modified example, the memory unit 52 further stores second search data, which includes multiple motion images taken when analysis results cannot be obtained, the shooting conditions for each of the multiple motion images, and the shooting conditions for reshooting. The output unit 513 searches the second search data based on the motion image to be processed and the content of the dialogue that was performed, and extracts motion images similar to the motion image to be processed.

[0119] The output unit 513 acquires the shooting conditions for the extracted motion image and the shooting conditions for reshooting, and displays motion images similar to the motion image to be processed, along with the shooting conditions for those motion images and the shooting conditions for reshooting, on the display unit 54. In addition, the second search data may also contain information about image defects in addition to the shooting conditions, and this information may be used for searching and extraction, or displayed on the display unit 54.

[0120] In this modified example, in the output unit 513, the learning unit generates a learning model by machine learning of the second search data. The extraction unit takes the dynamic image and the content of the dialogue as input items and uses the learning model to search and extract from the second search data dynamic images similar to the dynamic image to be processed, as well as the shooting conditions for that dynamic image and the shooting conditions for reshooting.

[0121] When the output unit 513 displays the shooting conditions for a motion image similar to the motion image to be processed, as well as the shooting conditions for reshooting, on the display unit 54, it displays them in a way that clearly shows the differences between the shooting conditions and the shooting conditions for reshooting (for example, red display, inverted display, flashing display, etc.). The shooting conditions include, as described above, the shooting position of patient M, the physical condition of patient M (respiratory condition, etc.), and other conditions.

[0122] In this modified example, similar to the above embodiment, the system repeatedly engages in dialogue, thereby searching for and extracting the shooting conditions for re-shooting when analysis results cannot be obtained for dynamic images, and displaying them on the display unit 54. This allows doctors and radiographers to support the dynamic image acquisition process and improve the efficiency of that process.

[0123] <Other variations> In the above embodiment and modified example 1, the control unit 51 of the client terminal 50 has a dialogue unit 512, an output unit 513, and a filtering unit 514. However, for example, the control unit 31 of the radiation image analysis device 30 may have a dialogue unit 512, an output unit 513, and a filtering unit 514. In this case, the dialogue processing, output processing, and filtering processing themselves are performed by the control unit 31, but the display associated with the dialogue processing, output processing, and filtering processing is displayed on the display unit 54 by the client terminal 50 (control unit 51) via the communication network N.

[0124] The embodiments and modifications described above are merely examples of how the present invention can be implemented, and the technical scope of the invention should not be interpreted as being limited by them. In other words, the present invention can be implemented in various forms without departing from its gist or its main features. [Explanation of symbols]

[0125] 1. Radiation Image Processing System 10. Radiation imaging system 11. Image capture control unit 12 Radiation irradiation area 13 Shooting platform 14. Radiation detection unit 15 Display 16 Audio output section 20. Radiography control device 21 Control Unit 22 Memory section 23 Control section 24 Display 25 Communications Department 26 bus 30. Radiation Image Analysis Device 31 Control Unit 32 Storage section 33 Operation section 34 Display section 35 Communications Department 36 bus 40 Image management device 50 client terminals 51 Control Unit 52 Storage section 53 Operation section 54 Display section 55 Communications Department 56 Bus 60 Radiation Information Terminal 111 Configuration Information Acquisition Unit 112 Shooting Condition Determination Unit 113 Image generation unit 114 Storage section 311 Image acquisition unit 312 Analysis Department 511 Information Acquisition Department 512 Dialogue Section 513 Output section 514 Refinement section 543 Dialogue Area

Claims

1. A display unit that displays an analysis image of the dynamic image of the object being processed, obtained by irradiating the subject with radiation, A dialogue unit that performs a dialogue including receiving input of questions regarding the displayed analysis image and outputting responses to the input questions, An output unit outputs case information corresponding to the dynamic image to be processed, based on the displayed analysis image and the content of the executed dialogue. Equipped with, Business support equipment.

2. The output unit outputs multiple candidate cases as case information. The business support device according to claim 1.

3. The output unit outputs the plurality of candidate cases in order of their accuracy with respect to the dynamic image of the subject to processing. The business support device according to claim 2.

4. The dialogue unit performs the dialogue for a predetermined number of times, The output unit outputs the case information based on the displayed analysis image and the content of the predetermined number of dialogues performed. The business support device according to claim 1.

5. The aforementioned reception has a template for receiving input of the aforementioned questions. The business support device according to claim 1.

6. The system further includes a storage unit that stores data containing multiple dynamic images and confirmed diagnostic results for each of the multiple dynamic images, The output unit outputs a plurality of candidate cases from the data. The business support device according to claim 2.

7. The memory unit updates the data for the plurality of dynamic images based on the confirmed diagnosis results of the cases, as well as the confirmed diagnosis results of cases based on examinations other than dynamic images. The business support device according to claim 6.

8. The output unit includes a learning unit that generates a learning model by machine learning of the data, and an extraction unit that takes the analyzed image and the content of the dialogue as input items and uses the learning model to extract the case information corresponding to the dynamic image of the processing target from the data. The business support device according to claim 6.

9. The system further includes a filtering unit that, based on the aforementioned analysis image, narrows down the analysis images from the data to candidates for analysis image that are similar to the aforementioned analysis image, and acquires the cases in the candidates for analysis image as candidates for cases. The display unit displays the analysis image, the candidate analysis image, and the candidate case together with the analysis image. The dialogue unit accepts input questions regarding the displayed analysis image candidates and case candidates. The output unit outputs the case information based on the displayed analysis image, the candidate analysis image, the candidate case, and the content of the executed dialogue. The business support device according to claim 6.

10. If the analysis image for the dynamic image to be processed does not exist, The display unit displays the dynamic image of the object to be processed. The dialogue unit receives input questions regarding the displayed dynamic image to be processed. The output unit outputs information regarding the shooting conditions of the motion image based on the displayed motion image to be processed and the content of the executed dialogue. The business support device according to claim 1.

11. In the computer of a business support system that assists in case diagnosis of dynamic images of subjects obtained by radiation irradiation of subjects, A process to display an analyzed image for the dynamic image of the subject to processing, A process that performs a dialogue including receiving input questions regarding the displayed analysis image and outputting responses to the input questions, A process that outputs case information corresponding to the dynamic image of the subject to processing, based on the displayed analysis image and the content of the executed dialogue, To execute Business support program.

Images