Activity information processing device, program, activity information processing method, and activity information processing system

Abstract

To shorten an examination time and improve efficiency of diagnosis.SOLUTION: A dynamic state information processing device 40 generates a dynamic analysis result by acquiring a dynamic image obtained by executing dynamic imaging by a radiation for a subject and executing dynamic analysis for the dynamic image. The dynamic state information processing device 40 receives selection of at least one of a first display mode, which is a display form with a character or a numerical value as a main constituent, and a second display mode, which is a display form with a diagram, a chart, or a graph as a main constituent on the dynamic analysis result. The dynamic state information processing device 40 outputs the information necessary for displaying the dynamic analysis result by the first display mode on a screen, or the information necessary for displaying the dynamic analysis result by the second display mode on the screen on the basis of the selection result.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a behavior information processing device, a program, a behavior information processing method, and a behavior information processing system. [Background technology]

[0002] In the medical field, diagnosis has traditionally been performed using medical images obtained by capturing an object using radiation. When a doctor diagnoses a patient while referring to the medical images, the medical images and their analysis results are displayed in a format suitable for the doctor's diagnosis.

[0003] On the other hand, when a doctor explains the contents of a medical examination to a patient, the display format suitable for the doctor's diagnosis may not be suitable. Therefore, at the doctor's discretion, the doctor may provide verbal supplementary explanations to the patient or include hand-drawn diagrams of the body (schemas).

[0004] As an example of a system in which the display for the doctor and the display for the patient are different, for example, a technology has been proposed in which, in a system equipped with a doctor's terminal and a patient's terminal in an examination room, the medical procedure entered by the doctor on the doctor's terminal and the medical fee corresponding to the medical procedure are displayed on the patient's terminal (see Patent Document 1).

[0005] In addition, a system has been proposed in which a doctor's terminal displays home medical information transmitted from home medical equipment, biometric measuring devices, and an instructor terminal (a terminal for the patient's instructor) installed in the home of a patient receiving home medical care (see Patent Document 2).

[0006] In recent years, dynamic images, which are images of the subject's movements captured continuously using radiation, have come to be used for diagnosis. Various methods are used to convert the movements of the target area, such as the lungs and heart, into numerical values ​​(such as displacement and speed) as analytical methods that contribute to the diagnosis of dynamic images. For doctors, the basic format is to display the results of dynamic analysis in the form of text and numbers, so that they can refer to more information. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2011-81747 A [Patent Document 2] JP 2003-116796 A Summary of the Invention [Problem to be solved by the invention]

[0008] However, because dynamic images are moving images and because analytic values ​​obtained by dynamic analysis are used for diagnosis, they contain a much larger amount of information than still images. Therefore, when the diagnosis target is a dynamic image, even if a doctor presents a screen with many analytic values ​​used for diagnosis to a patient, it is difficult for the patient to understand, and the information is not what the patient wants to see. Furthermore, even if a doctor wishes to show a schematic image of a dynamic image to a patient, it is difficult for the doctor to create the image by hand.

[0009] As a result, given the reality that consultation time per patient is limited, if the display is not suitable for explaining things to the patient, there is a risk that the explanation from the doctor to the patient, or the patient's understanding of the information, will be insufficient. On the other hand, increasing the time spent explaining things to patients in order to help them understand the doctor can result in problems such as longer hours for both doctors and patients and a decrease in the number of consultations per day.

[0010] The present invention has been made in consideration of the above-mentioned problems in the conventional technology, and an object of the present invention is to shorten the examination time and improve the efficiency of diagnosis. [Means for solving the problem]

[0011] In order to solve the above problem, the invention described in claim 1 includes an image acquisition unit that acquires a dynamic image obtained by performing dynamic imaging of a subject using radiation, a dynamic analysis unit that generates a dynamic analysis result by performing dynamic analysis on the dynamic image, a reception unit that can receive a selection of at least one of a first display mode, which is a display form mainly using characters or numbers, and a second display mode, which is a display form mainly using figures, charts, or graphs, for the dynamic analysis result, and an output unit that outputs information related to the first display mode or information related to the second display mode based on a selection result in the reception unit. The output unit outputs information about the first display mode to a display unit of a medical staff terminal, and outputs information about the second display mode to a display unit of a patient terminal. It is a dynamic information processing device.

[0012] The invention described in claim 2 is the behavior information processing device described in claim 1, The reception unit has a first selection unit corresponding to the first display mode and a second selection unit corresponding to the second display mode.

[0013] The invention described in claim 3 is The dynamic information processing device includes an image acquisition unit that acquires dynamic images obtained by performing dynamic imaging on a subject using radiation; a dynamic analysis unit that generates dynamic analysis results by performing dynamic analysis on the dynamic images; a reception unit that can accept a selection of at least one of a first display mode, which is a display form mainly consisting of characters or numbers, and a second display mode, which is a display form mainly consisting of figures, charts, or graphs, for the dynamic analysis results; and an output unit that outputs information related to the first display mode or information related to the second display mode based on the selection result in the reception unit, wherein the reception unit accepts a selection of at least one of the first display mode and the second display mode based on preset setting information, and the setting information is information that corresponds information specific to an output destination device of the output unit to at least one of the first display mode and the second display mode.

[0014] The invention described in claim 4 is The dynamic information processing device includes an image acquisition unit that acquires dynamic images obtained by performing dynamic imaging on a subject using radiation; a dynamic analysis unit that generates dynamic analysis results by performing dynamic analysis on the dynamic images; a reception unit that can accept a selection of at least one of a first display mode, which is a display form mainly consisting of characters or numbers, and a second display mode, which is a display form mainly consisting of figures, charts, or graphs, for the dynamic analysis results; and an output unit that outputs information related to the first display mode or information related to the second display mode based on the selection result in the reception unit, wherein the reception unit accepts a selection of at least one of the first display mode and the second display mode based on preset setting information, and the setting information is information that corresponds the orientation of a destination device of the output unit or the detection result of a sensor provided in the destination device to at least one of the first display mode and the second display mode.

[0015] The invention described in claim 5 is 3 or 4 In the behavior information processing device according to the present invention, The output unit outputs information about the first display mode to a first display unit, and outputs information about the second display mode to a second display unit. The invention described in claim 6 is the behavior information processing device described in claim 5, wherein the first display unit is a medical staff terminal, and the second display unit is a patient terminal. The invention described in claim 7 is a behavior information processing device described in claim 3 or 4, in which the output unit causes the display unit to display a screen based on at least one of information regarding the first display mode and information regarding the second display mode.

[0016] Claim 8 The invention described in claim 1 7 In the behavior information processing device according to any one of claims 1 to 5, The information regarding the first display mode and the information regarding the second display mode are information for simultaneously displaying the same content in different display methods.

[0017] Claim 9 The invention described in A program for causing a computer of a dynamic information processing device, which processes dynamic images obtained by performing dynamic imaging on a subject using radiation and dynamic analysis results generated by performing dynamic analysis on the dynamic images, to function as a reception unit capable of receiving a selection of at least one of a first display mode, which is a display form mainly consisting of characters or numbers, and a second display mode, which is a display form mainly consisting of figures, charts, or graphs, for the dynamic analysis results, and an output unit that outputs information related to the first display mode or information related to the second display mode based on the selection result in the reception unit, wherein the output unit outputs information related to the first display mode to a display unit of a medical staff terminal and outputs information related to the second display mode to a display unit of a patient terminal.

[0018] Claim 10 The invention described in A program for causing a computer of a dynamic information processing device, which processes dynamic images obtained by performing dynamic imaging on a subject using radiation and dynamic analysis results generated by performing dynamic analysis on the dynamic images, to function as a reception unit capable of receiving a selection of at least one of a first display mode, which is a display form mainly consisting of characters or numbers, and a second display mode, which is a display form mainly consisting of figures, charts, or graphs, for the dynamic analysis results, and an output unit that outputs information related to the first display mode or information related to the second display mode based on the selection result in the reception unit, wherein the reception unit receives a selection of at least one of the first display mode and the second display mode based on preset setting information, and the setting information is information that corresponds information specific to an output destination device of the output unit to at least one of the first display mode and the second display mode.

[0019] Claim 11 The invention described in A program for causing a computer of a dynamic information processing device, which processes dynamic images obtained by performing dynamic imaging on a subject using radiation and dynamic analysis results generated by performing dynamic analysis on the dynamic images, to function as a reception unit capable of receiving a selection of at least one of a first display mode, which is a display form mainly consisting of characters or numbers, and a second display mode, which is a display form mainly consisting of figures, charts, or graphs, for the dynamic analysis results, and an output unit that outputs information related to the first display mode or information related to the second display mode based on the selection result in the reception unit, wherein the reception unit receives a selection of at least one of the first display mode and the second display mode based on preset setting information, and the setting information is information that corresponds the orientation of a destination device of the output unit or the detection result of a sensor provided in the destination device to at least one of the first display mode and the second display mode.

[0020] Claim 12 The invention described in A dynamic information processing method for processing dynamic images obtained by performing dynamic imaging on a subject using radiation and dynamic analysis results generated by performing dynamic analysis on the dynamic images, the method including: a reception step for receiving a selection of at least one of a first display mode, which is a display form mainly consisting of characters or numbers, and a second display mode, which is a display form mainly consisting of figures, charts, or graphs, for the dynamic analysis results; and an output step for outputting information regarding the first display mode or information regarding the second display mode based on the selection result in the reception step, in which information regarding the first display mode is output to a display unit of a medical staff terminal, and information regarding the second display mode is output to a display unit of a patient terminal.

[0021] Claim 13 The invention described in is a dynamic information processing method for processing a dynamic image obtained by performing dynamic imaging of a subject using radiation and a dynamic analysis result generated by performing dynamic analysis on the dynamic image, the method including a receiving step of receiving a selection of at least one of a first display mode, which is a display form mainly using characters or numbers, and a second display mode, which is a display form mainly using figures, charts, or graphs, for the dynamic analysis result, and an output step of outputting information related to the first display mode or information related to the second display mode based on the selection result in the receiving step. In the receiving process, a selection of at least one of the first display mode and the second display mode is received based on preset setting information, and the setting information is information that corresponds information specific to the output destination device in the output process to at least one of the first display mode and the second display mode. The invention described in claim 14 is a dynamic information processing method for processing dynamic images obtained by performing dynamic imaging on a subject using radiation and dynamic analysis results generated by performing dynamic analysis on the dynamic images, and includes a reception process for receiving a selection of at least one of a first display mode, which is a display form mainly consisting of characters or numbers, and a second display mode, which is a display form mainly consisting of figures, charts, or graphs, for the dynamic analysis results, and an output process for outputting information related to the first display mode or information related to the second display mode based on the selection result in the reception process, wherein the reception process receives a selection of at least one of the first display mode and the second display mode based on preset setting information, and the setting information is information in which the orientation of a destination device in the output process or the detection result of a sensor provided in the destination device is associated with at least one of the first display mode and the second display mode.

[0022] Claim 15 The invention described in the above includes an image acquisition unit that acquires a dynamic image obtained by performing dynamic imaging of a subject using radiation, a dynamic analysis unit that generates a dynamic analysis result by performing dynamic analysis on the dynamic image, a reception unit that can receive a selection of at least one of a first display mode, which is a display form mainly using characters or numbers, and a second display mode, which is a display form mainly using figures, charts, or graphs, for the dynamic analysis result, and an output unit that outputs information related to the first display mode or the second display mode based on a selection result in the reception unit. The output unit outputs information about the first display mode to a display unit of a medical staff terminal, and outputs information about the second display mode to a display unit of a patient terminal. It is a dynamic information processing system. The invention described in claim 16 is a dynamic information processing system comprising an image acquisition unit that acquires dynamic images obtained by performing dynamic imaging on a subject using radiation; a dynamic analysis unit that generates dynamic analysis results by performing dynamic analysis on the dynamic images; a reception unit that can accept a selection of at least one of a first display mode, which is a display form mainly consisting of characters or numbers, and a second display mode, which is a display form mainly consisting of figures, charts, or graphs, for the dynamic analysis results; and an output unit that outputs information related to the first display mode or information related to the second display mode based on the selection result in the reception unit, wherein the reception unit accepts a selection of at least one of the first display mode and the second display mode based on preset setting information, and the setting information is information that corresponds information specific to an output destination device of the output unit to at least one of the first display mode and the second display mode. The invention described in claim 17 is a dynamic information processing system comprising an image acquisition unit that acquires dynamic images obtained by performing dynamic imaging on a subject using radiation; a dynamic analysis unit that generates dynamic analysis results by performing dynamic analysis on the dynamic images; a reception unit that can accept a selection of at least one of a first display mode, which is a display form mainly consisting of characters or numbers, and a second display mode, which is a display form mainly consisting of figures, charts, or graphs, for the dynamic analysis results; and an output unit that outputs information regarding the first display mode or information regarding the second display mode based on the selection result in the reception unit, wherein the reception unit accepts a selection of at least one of the first display mode and the second display mode based on preset setting information, and the setting information is information in which the orientation of a destination device of the output unit or the detection result of a sensor provided in the destination device is associated with at least one of the first display mode and the second display mode. Effect of the Invention

[0023] According to the present invention, examination time can be shortened and diagnosis can be made more efficient. [Brief description of the drawings]

[0024] [Figure 1]1 is a system configuration diagram of a behavior information processing system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing functional configurations of a behavior information processing device, a medical staff terminal, and a patient terminal. [Diagram 3] 1 is a ladder chart showing behavior information processing executed by a behavior information processing device, a medical staff terminal, and a patient terminal. [Figure 4] (a) is an example of a numerical value-oriented screen displayed on a medical staff terminal, and (b) is an example of a chart-oriented screen displayed on a patient terminal. [Diagram 5] 10 is a flowchart showing a display control process executed by the behavior information processing device. [Figure 6] (a) is an example of a numerical value-oriented screen displayed on a medical staff terminal, and (b) is an example of a chart-oriented screen displayed on a patient terminal. [Figure 7] (a) is an example of a numerical value-oriented screen displayed on a medical staff terminal, and (b) is an example of a chart-oriented screen displayed on a patient terminal. [Figure 8] FIG. 11 is a system configuration diagram of a behavior information processing system according to a second embodiment. [Figure 9] FIG. 13 is an image diagram showing a state in which a numerical value-oriented screen and a chart-oriented screen are displayed separately on the same monitor in the fourth embodiment. [Figure 10] (a) is an example of a status information screen including a numerical value-oriented screen, (b) is an example of a status information screen including a chart-oriented screen, and (c) is an example of a status information screen including a numerical value-oriented screen and a chart-oriented screen. [Figure 11] FIG. 13 is a block diagram showing a functional configuration of a medical staff terminal in a modified example of the fourth embodiment. [Figure 12] FIG. 13 is a diagram for explaining the orientation of a medical staff terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] [First embodiment] First, a first embodiment of a behavior information processing system according to the present invention will be described with reference to the drawings, although the scope of the invention is not limited to the illustrated example.

[0026] FIG. 1 shows the system configuration of a behavior information processing system 100. As shown in FIG. As shown in Fig. 1, the behavior information processing system 100 includes an imaging device 10, a console 20, an image management device 30, a behavior information processing device 40, a medical staff terminal 50, and a patient terminal 60. The imaging device 10, the console 20, the image management device 30, the behavior information processing device 40, the medical staff terminal 50, and the patient terminal 60 are connected to each other so as to be able to perform data communication via a communication network N such as a LAN (Local Area Network). The medical staff terminal 50 and the patient terminal 60 are installed in a consultation room where a doctor examines a patient. Note that the system configuration diagram shown in Fig. 1 is an example, and is not limited thereto.

[0027] The imaging device 10 irradiates radiation to a subject and performs dynamic imaging. Dynamic imaging refers to continuously imaging a moving subject multiple times to obtain a dynamic image consisting of multiple frame images that show the subject's dynamics. In dynamic imaging, the subject is repeatedly irradiated with pulsed radiation such as X-rays at a predetermined time interval, or is irradiated continuously and uninterruptedly with a low dose of radiation, thereby obtaining multiple images that show the dynamics of the subject. A series of images obtained by dynamic imaging is called a dynamic image.

[0028] The imaging device 10 includes a radiation irradiation unit, a radiation detection unit, an image reading unit, and the like. The radiation irradiation unit irradiates the subject with radiation. The radiation detection unit is composed of a semiconductor image sensor such as a Flat Panel Detector (FPD), and is provided to face the radiation irradiation unit across the subject. The radiation detection unit has a plurality of elements arranged in a matrix that detect radiation according to its intensity, convert it into an electrical signal, and store the signal. The image reading unit obtains image data by reading the electrical signal stored in each pixel of the radiation detection unit. This image data is each frame image of the dynamic image.

[0029] The console 20 outputs radiation irradiation conditions and image reading conditions to the imaging device 10 and controls the dynamic imaging operation of the imaging device 10 .

[0030] The image management device 30 manages the dynamic images captured by the imaging device 10, the dynamic analysis results for the dynamic images, etc. An example of the image management device 30 is a picture archiving and communication system (PACS). When an external device requests the image management device 30 to acquire a dynamic image or a dynamic analysis result, the image management device 30 transmits the requested dynamic image or dynamic analysis result to the external device in response to the acquisition request.

[0031] The dynamic information processing device 40 performs dynamic analysis on the dynamic image and controls the display form of the dynamic image and the dynamic analysis result. The dynamic information processing device 40 is a device that processes the dynamic image obtained by performing dynamic imaging on the subject using radiation and the dynamic analysis result generated by performing dynamic analysis on the dynamic image.

[0032] The medical staff terminal 50 is a computer device such as a PC (Personal Computer) used by a medical staff member such as a doctor. The medical staff terminal 50 is used as an input / output terminal when the behavior information processing device 40 executes behavior information processing (see FIG. 3) and the like.

[0033] The patient terminal 60 is used by a doctor to present information to a patient. The patient terminal 60 is mainly used as a display terminal that displays a patient screen that the patient refers to.

[0034] FIG. 2 shows the functional configuration of the behavior information processing device 40, the medical staff terminal 50, and the patient terminal 60. The behavior information processing device 40 includes a control unit 41, a storage unit 42, a communication unit 43, etc., and each unit is connected to each other via a bus.

[0035] The control unit 41 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), etc., and controls the overall processing of each unit of the behavior information processing device 40. Specifically, the CPU reads out various processing programs stored in the storage unit 42, expands them in the RAM, and performs various processes in cooperation with the programs.

[0036] The storage unit 42 is configured with a HDD (Hard Disk Drive), a non-volatile memory, etc., and stores various processing programs and various data required for executing the programs.

[0037] The communication unit 43 is configured with a network interface and the like, and transmits and receives data to and from external devices connected via the communication network N.

[0038] The control unit 41 (image acquisition unit) acquires, via the communication unit 43, from the console 20 (imaging device 10) or the image management device 30, dynamic images obtained by performing dynamic imaging of a subject using radiation.

[0039] The control unit 41 (dynamic analysis unit) generates a dynamic analysis result by performing a dynamic analysis on the dynamic image. For example, the control unit 41 obtains information indicating ventilation (a change in pixel value of low frequency synchronized with respiratory motion), blood flow (a change in pixel value of high frequency synchronized with heartbeat), lung motion (amount of movement at each position of the lung accompanying respiratory motion), thoracic width, heart width, cardiothoracic ratio (CTR value), diaphragm movement amount, airway diameter, lung field area, heart area, etc. Regarding the measurement values ​​of the thoracic width, heart width, cardiothoracic ratio, diaphragm movement amount, airway diameter, lung field area, heart area, etc., the dynamic analysis result includes the minimum and maximum values ​​(or the amount of change) of the measurement results. Furthermore, regarding the lung field area and the heart area, the dynamic analysis result may include a contour indicating an area corresponding to the area to be measured.

[0040] The control unit 41 (reception unit) accepts the selection of at least one of a first display mode (hereinafter sometimes referred to as a numerical value-oriented mode), which is a display form mainly using characters or numbers, and a second display mode (hereinafter sometimes referred to as a diagram-oriented mode), which is a display form mainly using figures, charts, or graphs, for the dynamic analysis results. A "display form mainly using characters or numbers" is a display form in which a relatively large portion of the display object is expressed by characters or numbers. A "display form mainly using figures, charts, or graphs" is a display form in which a relatively large portion of the display object is expressed by figures, charts, or graphs.

[0041] For example, the control unit 41 receives, via the communication unit 43, information indicating a selection result selected on the operation unit 54 of the medical staff terminal 50.

[0042] Alternatively, the control unit 41 accepts the selection of at least one of the first display mode and the second display mode based on preset setting information. The setting information is information in which information specific to the output destination device (healthcare worker terminal 50, patient terminal 60) is associated with at least one of a first display mode and a second display mode, and is stored in storage unit 42. The information specific to the output destination device may be any information capable of identifying the output destination device, and may be the serial number of the output destination device, the type of display monitor, etc. Here, as the setting information, the first display mode is associated with the healthcare worker terminal 50 (display unit 55), and the second display mode is associated with the patient terminal 60 (display unit 65).

[0043] The control unit 41 (output unit) outputs information about the first display mode or information about the second display mode based on the selection result between the first display mode and the second display mode. The information about the first display mode is information (display data such as HTML, JPEG, etc.) necessary for displaying the dynamic analysis results on the screen in the first display mode. The information about the second display mode is information necessary for displaying the dynamic analysis results on the screen in the second display mode.

[0044] The control unit 41 outputs information about the first display mode to the first display unit (display unit 55 of the medical staff terminal 50), and outputs information about the second display mode to the second display unit (display unit 65 of the patient terminal 60).

[0045] The information regarding the first display mode and the information regarding the second display mode are information for simultaneously displaying the same content in different display methods (emphasis on numerical values / emphasis on charts, etc.).

[0046] The medical staff terminal 50 comprises a control unit 51, a storage unit 52, a communication unit 53, an operation unit 54, a display unit 55, etc., and each unit is connected by a bus.

[0047] The control unit 51 is composed of a CPU, RAM, etc., and comprehensively controls the processing of each unit of the medical staff terminal 50. Specifically, the CPU reads out various processing programs stored in the storage unit 52, expands them in the RAM, and performs various processes in cooperation with the programs.

[0048] The storage unit 52 is configured with a HDD, a non-volatile memory, etc., and stores various processing programs and various data required for executing the programs.

[0049] The communication unit 53 is configured with a network interface or the like, and transmits and receives data to and from external devices connected via the communication network N.

[0050] The operation unit 54 is configured with a keyboard having cursor keys, letter / number input keys, various function keys, etc., and a pointing device such as a mouse, and outputs operation signals input by key operations on the keyboard or mouse operations to the control unit 51. The operation unit 54 may also have a touch panel on the display screen of the display unit 55, and in this case, outputs instruction signals input via the touch panel to the control unit 51.

[0051] The display unit 55 is configured to include a monitor such as an LCD (Liquid Crystal Display), and displays various screens according to instructions of a display signal input from the control unit 51.

[0052] The patient terminal 60 comprises a control unit 61, a storage unit 62, a communication unit 63, an operation unit 64, a display unit 65, etc., and each unit is connected by a bus. The configuration of the patient terminal 60 is similar to that of the medical staff terminal 50, and therefore a description thereof will be omitted.

[0053] Next, the operation of the behavior information processing system 100 will be described. FIG. 3 is a ladder chart showing the behavior information processing executed by the behavior information processing device 40, the medical staff terminal 50, and the patient terminal 60.

[0054] First, under the control of the console 20 based on the operation of the camera technician, the imaging device 10 performs dynamic imaging of the subject and generates a dynamic image. The console 20 transmits the dynamic image generated by the imaging device 10 to the dynamic information processing device 40 and the image management device 30. The image management device 30 stores and manages the dynamic image transmitted from the console 20 (imaging device 10).

[0055] The control unit 41 of the motion information processing device 40 acquires a motion image from the console 20 (imaging device 10) via the communication unit 43 (step S1). The control unit 41 may acquire a motion image from the image management device 30.

[0056] Next, the control unit 41 of the behavior information processing device 40 performs a behavior analysis on the behavior image to generate a behavior analysis result (step S2).

[0057] Next, the control unit 41 of the behavior information processing device 40 acquires the display modes associated with the medical staff terminal 50 and the patient terminal 60 from the setting information stored in the storage unit 42, thereby accepting the selection of the display mode for each of the medical staff terminal 50 and the patient terminal 60 (step S3). Here, a numerical value-oriented mode, which is a display form mainly featuring characters or numerical values, is selected as the display mode for the medical staff terminal 50, and a diagram-oriented mode, which is a display form mainly featuring figures, diagrams, or graphs, is selected as the display mode for the patient terminal 60.

[0058] Next, the control unit 41 of the behavior information processing device 40 outputs display data of the behavior image and the behavior analysis result to each terminal based on the selected display mode (selection result) (step S4). Specifically, the control unit 41 generates display data (information regarding the first display mode) for displaying the dynamic images and dynamic analysis results in a numerical emphasis mode, and transmits the display data related to the numerical emphasis mode to the medical staff terminal 50 via the communication unit 43. In addition, the control unit 41 generates display data (information regarding the second display mode) for displaying the dynamic images and dynamic analysis results in a chart-oriented mode, and transmits the display data related to the chart-oriented mode to the patient terminal 60 via the communication unit 43.

[0059] When the medical staff terminal 50 receives the display data related to the numerical value emphasis mode via the communication unit 53, the control unit 51 causes the display unit 55 to display a numerical value emphasis screen based on the display data (step S5). When the patient terminal 60 receives the display data relating to the chart emphasis mode via the communication unit 63, the control unit 61 causes the display unit 65 to display a chart emphasis screen based on the display data (step S6). This is the end of the behavior information processing.

[0060] FIG. 4(a) is an example of a numerical value-focused screen 551 displayed on the display unit 55 of the medical staff terminal 50, and FIG. 4(b) is an example of a chart-focused screen 651 displayed on the display unit 65 of the patient terminal 60.

[0061] The numerical value-oriented screen 551 includes a dynamic image display area 70 and an analysis result list area 71 . A dynamic image is displayed in the dynamic image display area 70. Note that in the dynamic image display area 70, each frame image constituting the dynamic image may be displayed consecutively, or a predetermined frame image may be displayed. In the analysis result list area 71, a list of numerical information on the dynamic analysis results is displayed.

[0062] The chart emphasis screen 651 includes a dynamic image display area 72 and an analysis result graph area 73 . In the dynamic image display area 72, a dynamic image is displayed. In the analysis result graph area 73, a graph based on the dynamic analysis result is displayed.

[0063] The doctor makes a diagnosis while looking at the numerical value-oriented screen 551 displayed on the display unit 55 of the medical staff terminal 50, and inputs the diagnosis result from the operation unit 54 as necessary. The control unit 41 of the behavior information processing device 40 acquires the diagnosis results inputted at the medical staff terminal 50, and transmits them to the image management device 30 together with the behavior analysis results. In the image management device 30, the dynamic analysis results and the diagnosis results are stored in association with the corresponding dynamic images.

[0064] 5 is a flowchart showing a display control process executed by the behavior information processing device 40. The display control process is a process for changing the display of the chart-oriented screen on the patient terminal 60 in response to an operation on the numerical value-oriented screen displayed on the medical staff terminal 50.

[0065] The control unit 41 of the behavior information processing device 40 determines whether or not an analysis result item has been selected by the doctor's operation from the operation unit 54 on the numerical emphasis screen displayed on the display unit 55 of the medical staff terminal 50 (step S11).

[0066] When an analysis result item is selected on the numerical value-oriented screen (step S11; YES), the control unit 41 highlights the graph of the selected analysis result on the chart-oriented screen displayed on the display unit 65 of the patient terminal 60 (step S12). Highlighting may be any display that makes the target area stand out, such as showing the periphery of the target area with a thick line or blinking the data on the graph.

[0067] FIG. 6(a) is an example of a numerical value-focused screen 552 displayed on the display unit 55 of the medical staff terminal 50, and FIG. 6(b) is an example of a chart-focused screen 652 displayed on the display unit 65 of the patient terminal 60. When an item 81 titled "Diaphragm displacement" (or the row for maximum movement amount) is selected (clicked) in the analysis result list area 80 on the numerical value-oriented screen 552, a frame 82 surrounding the diaphragm displacement graph and a frame 83 surrounding the graph of the change over time in the maximum movement amount of diaphragm displacement are displayed on the chart-oriented screen 652, and the graph corresponding to "Diaphragm displacement" is highlighted.

[0068] The diaphragm displacement graph is a graph in which the horizontal axis represents frame number and the vertical axis represents the displacement of the diaphragm on the left and right. The time-course graph is a graph in which the horizontal axis represents the imaging date and the vertical axis represents the maximum amount of movement of the diaphragm. The time-course graph is drawn based on the results of dynamic analysis of the dynamic image captured this time and the results of past dynamic analysis of the same patient obtained from the image management device 30.

[0069] After step S12, or in step S11, if an analysis result item is not selected on the numerical emphasis screen (step S11; NO), the control unit 41 determines whether or not a measurement value item has been selected by the doctor's operation from the operation unit 54 on the numerical emphasis screen displayed on the display unit 55 of the medical staff terminal 50 (step S13).

[0070] When a measurement value item is selected on the numerical value-oriented screen (step S13; YES), the control unit 41 displays the measurement target location related to the selected item on the image of the chart-oriented screen displayed on the display unit 65 of the patient terminal 60 (step S14).

[0071] FIG. 7(a) is an example of a numerical value-focused screen 553 displayed on the display unit 55 of the medical staff terminal 50, and FIG. 7(b) is an example of a chart-focused screen 653 displayed on the display unit 65 of the patient terminal 60. When an item 91 called "CTR" is selected (clicked) in the analysis result list area 90 of the numerical value-oriented screen 553, a measurement target point 93 related to the CTR is displayed on the dynamic image displayed in the dynamic image display area 92 on the diagram-oriented screen 653. Five line segments L1 to L5 are displayed as the measurement target points 93. Line segment L1 indicates the right end position of the thorax, line segment L2 indicates the right end position of the heart, line segment L3 indicates the midline, line segment L4 indicates the left end position of the heart, and line segment L5 indicates the left end position of the thorax. CTR is a value indicating the ratio of the width of the heart (the distance between line segment L2 and line segment L4) to the width of the thorax (the distance between line segment L1 and line segment L5).

[0072] After step S14, or in step S13, if a measurement value item is not selected on the numerical emphasis screen (step S13; NO), the control unit 41 determines whether or not the doctor has operated the operation unit 54 to instruct the display to end (step S15).

[0073] If the end of the display is not instructed (step S15; NO), the process returns to step S11 and the process is repeated. In step S15, if an instruction to end the display is given (step S15; YES), the display control process ends.

[0074] In addition, in the display control process, when an operation is performed on the numerical value-oriented screen displayed on the display unit 55 of the medical staff terminal 50, how the display of the chart-oriented screen on the display unit 65 of the patient terminal 60 changes is not limited to the above example.

[0075] For example, when a doctor selects (clicks) the lung field area values ​​at the maximum expiratory position and maximum inspiratory position on the numerically-oriented screen, a mark may be placed on the portion of the lung field area graph corresponding to the maximum expiratory position and maximum inspiratory position on the graph-oriented screen, a frame image corresponding to the maximum expiratory position and maximum inspiratory position may be displayed, or a contour line may be drawn around the lung field area on the image.

[0076] In addition, when a doctor selects (clicks) numerical information indicating the state of movement (speed or smoothness) of a specific part on the numerical value-oriented screen, the actual state of movement (dynamic image) of the specific part may be displayed on the diagram-oriented screen.

[0077] In addition, when a graph of the measurement value is displayed on the chart-emphasis screen for the measurement value item selected in step S13 of the display control process (see FIG. 5), the control unit 41 may highlight the graph of the measurement value on the chart-emphasis screen instead of or in addition to step S14.

[0078] As described above, according to the first embodiment, display data (information relating to the first display mode) for displaying the dynamic analysis results mainly as characters or numbers, and display data (information relating to the second display mode) for displaying the dynamic analysis results mainly as figures, charts or graphs are output based on the selection of the display mode, thereby shortening the examination time and improving the efficiency of diagnosis.

[0079] The behavioral information processing device 40 changes the display format from the viewpoint of how to efficiently display information included in the behavioral analysis results that is of different importance to doctors and patients. On the monitor screen where the doctor examines and diagnoses the patient, the display format is suitable for the doctor's diagnosis, and on the monitor screen used for explaining to the patient, the display format is suitable for explaining to the patient.

[0080] The behavior information processing device 40 can provide information to doctors in a form suitable for diagnosis by displaying a numerical value-oriented screen mainly consisting of characters and numerical values ​​on the display unit 55 of the medical staff terminal 50. This allows doctors to make diagnoses efficiently and shortens consultation times.

[0081] In addition, the behavior information processing device 40 can provide information to patients in a form that is easy to visually recognize by displaying a diagram-oriented screen mainly including figures, diagrams, and graphs on the display unit 65 of the patient terminal 60. This improves the patient's understanding and satisfaction, and shortens the time it takes for a doctor to explain things to the patient.

[0082] As a result, overall consultation times can be shortened, reducing the time doctors and patients spend in the hospital and increasing the number of consultations. In addition, by standardizing the display format within the hospital, it is possible to achieve unified medical examinations regardless of the attending doctor.

[0083] In addition, in the behavior information processing device 40, at least one of the first display mode and the second display mode can be selected based on setting information that associates the display mode with the output destination device (medical staff terminal 50, patient terminal 60) of the behavior analysis result.

[0084] The patient terminal 60 may be a PDA (Personal Digital Assistant) or the like. In addition, the patient does not need to meet the doctor face-to-face. When the patient receives an online diagnosis from home or the like, the patient may use a smartphone, tablet terminal, or the like that the patient owns as the patient terminal 60.

[0085] [Second embodiment] Next, a second embodiment to which the present invention is applied will be described. Fig. 8 shows the system configuration of a behavior information processing system 200 in the second embodiment. The behavior information processing system 200 has the same configuration as the behavior information processing system 100 shown in the first embodiment, so the common configuration is given the same reference numerals and the description is omitted. In addition, Fig. 2 is used for the functional configuration of the behavior information processing device 40, the medical staff terminal 50, and the patient terminal 60, and the description is omitted. The configuration and processing characteristic of the second embodiment will be described below.

[0086] In the second embodiment, prognosis predictions and the like are displayed on a diagram-oriented screen for explaining to patients. Prognosis is a medical prediction about the progress and outcome of a patient's illness.

[0087] As shown in FIG. 8, the image management device 30 includes an image database 31 and a related information storage unit 32. In the image database 31, a plurality of dynamic images taken by the imaging device 10 are stored and managed. The related information storage unit 32 stores related information related to the dynamic images stored in the image database 31 in association with the dynamic images. The related information includes, for example, patient information, dynamic analysis results, diagnosis results, progress information, self-management methods, and the like.

[0088] The patient information is information about the patient who is the subject of imaging, and includes age, sex, symptoms, and the like. The diagnosis result is a diagnosis made by a doctor based on the dynamic images and the dynamic analysis results. Progression information is information that indicates the progression of a patient's disease or illness over time. The self-management method is information indicating the self-management method that the patient performed, and is associated with the time when it was performed. For example, the self-management method may be quitting smoking, refraining from drinking alcohol, incorporating exercise into one's life, etc.

[0089] The control unit 41 of the behavior information processing device 40 obtains from the image management device 30 related information corresponding to a behavior image similar to the behavior image (diagnostic target behavior image) currently captured by the imaging device 10, and predicts the prognosis of the patient. Specifically, the control unit 41 transmits, via the communication unit 43, to the image management device 30 a request to acquire related information corresponding to a dynamic image similar to the diagnostic target dynamic image.

[0090] The image management device 30 identifies dynamic images similar to the diagnostic target dynamic image from the related information storage unit 32 based on the patient information (age, sex, symptoms, etc.) of the diagnostic target dynamic image, the dynamic analysis results, the diagnosis results, etc. Specifically, the image management device 30 identifies dynamic images whose age, sex, symptoms, dynamic analysis results, diagnosis results, etc. are similar (matching or belonging to the same range) to the diagnostic target dynamic image (patient), and extracts related information corresponding to the identified dynamic image. Then, the image management device 30 transmits to the dynamic information processing device 40 the related information (patient information, dynamic analysis results, diagnosis results, progress information, self-management methods, etc.) corresponding to the dynamic image similar to the diagnostic target dynamic image (similar image). The image management device 30 may transmit to the behavior information processing device 40 related information corresponding to the behavior image searched for under the conditions specified by the doctor.

[0091] When generating information regarding the second display mode (display data for the chart-oriented screen), the control unit 41 of the dynamic information processing device 40 generates display data for displaying in parallel related information of similar images (similar cases) in addition to the dynamic analysis results (mainly figures, charts, and graphs) of the dynamic image of the diagnostic target, and outputs the same to the patient terminal 60 via the communication unit 43. In this case, the dynamic analysis result of the diagnostic object dynamic image and the related information of the similar image are displayed side by side on the chart-oriented screen on the display unit 65 of the patient terminal 60. For example, a frequency distribution chart or a graph of change over time is displayed for a predetermined item included in the related information of the similar image.

[0092] The control unit 41 of the behavioral information processing device 40 predicts the prognosis of the patient to be diagnosed based on the current condition of the patient to be diagnosed (diagnostic target behavioral image, behavioral analysis result, diagnosis result, patient information) and related information of similar images (similar cases). For example, the control unit 41 generates a prognosis prediction result of the patient to be diagnosed based on the time-dependent change of the behavioral analysis result (analysis value) of the patient to be diagnosed and the progress information corresponding to the similar images (similar cases). The control unit 41 generates display data (information on the second display mode) for the chart emphasis screen including the prognosis prediction result of the patient to be diagnosed, and outputs it to the patient terminal 60 via the communication unit 43. In this case, the prognosis prediction result of the patient to be diagnosed is displayed on a chart-oriented screen on the display unit 65 of the patient terminal 60. For example, a graph of future predicted values ​​for a predetermined item related to prognosis prediction is displayed.

[0093] Furthermore, the control unit 41 of the behavior information processing device 40 proposes a self-care method to the patient to be diagnosed based on the prognosis prediction of the patient to be diagnosed and the self-care methods of similar images (similar cases). For example, the control unit 41 determines the self-care method to be proposed to the patient to be diagnosed based on the self-care methods corresponding to the similar images (similar cases). The control unit 41 generates display data (information on the second display mode) for the chart-oriented screen including a self-management method proposed to the patient to be diagnosed, and outputs the data to the patient terminal 60 via the communication unit 43. In this case, the display unit 65 of the patient terminal 60 displays the self-management method proposed to the patient to be diagnosed on a chart-oriented screen.

[0094] In addition, the control unit 41 of the behavioral information processing device 40 acquires past related information (behavioral analysis results, diagnosis results, etc.) of the patient to be diagnosed from the image management device 30, and obtains a value indicating the degree of improvement (amount of change, rate of change, etc.) by comparing it with the current situation of the patient to be diagnosed (behavioral analysis results, diagnosis results, etc.). The control unit 41 generates display data for the chart emphasis screen (information on the second display mode) including the degree of improvement of the patient to be diagnosed, and outputs the data to the patient terminal 60 via the communication unit 43. In this case, the display unit 65 of the patient terminal 60 displays the degree of improvement of the patient to be diagnosed on a chart-oriented screen. For example, a doctor may explain to a patient the degree of improvement before and after surgery, or the effect of rehabilitation while presenting the degree of improvement before and after rehabilitation. As the degree of improvement, a graph showing the change in the value indicating the degree of improvement may be displayed, or a rank according to the amount of change may be displayed.

[0095] As described above, according to the second embodiment, similarly to the first embodiment, it is possible to shorten the examination time and improve the efficiency of diagnosis. In addition, the behavioral information processing device 40 can provide useful information to the patient by displaying, on the display unit 65 of the patient terminal 60, a diagram-oriented screen including related information of similar images, predicted prognosis results for the patient being diagnosed, suggested self-management methods, the degree of improvement, etc.

[0096] In addition, in FIG. 8, the image management device 30 is illustrated as having the image database 31 and the related information storage unit 32, but the image database 31 and the related information storage unit 32 do not have to be separate. In addition, in the second embodiment, the dynamic information processing device 40 performs prognosis prediction, etc. in addition to dynamic analysis of the diagnostic object dynamic image, but the function of performing prognosis prediction, etc. may be realized by an independent device, or may be realized within a device other than the dynamic information processing device 40.

[0097] [Third embodiment] Next, a third embodiment to which the present invention is applied will be described. The behavior information processing system in the third embodiment has the same configuration as the behavior information processing system 100 shown in the first embodiment, so that the configuration will be omitted from illustration and description, and Fig. 1 and Fig. 2 will be used. The configuration and processing characteristic of the third embodiment will be described below.

[0098] The storage unit 42 of the dynamic information processing device 40 stores a schema template for each case (site, disease, etc.). A schema template is a template of a schema image that is simpler than an actual radiographic image, and is created so as to be easy to explain to a patient. Moving image data is prepared as a schema template for a dynamic image. A schema image is an image (line drawing, etc.) in which the outline of an organ is emphasized, an image in which bone enhancement / attenuation is performed, etc.

[0099] The control unit 41 of the dynamic information processing device 40 determines a schema template suitable for the current diagnostic target area, disease, etc. from among multiple schema templates prepared in the memory unit 42, based on the dynamic analysis results obtained by analyzing the dynamic images of the patient and the diagnosis results by the doctor. The control unit 41 enlarges, reduces, and deforms (matches) the determined schema template to match the actual dynamic image, thereby creating a schema image that matches the patient's body.

[0100] The control unit 41 generates display data for the diagram emphasis screen including the schematic image (information on the second display mode), and outputs the data to the patient terminal 60 via the communication unit 43. On the display unit 65 of the patient terminal 60, a schematic image is displayed on a diagram-oriented screen.

[0101] The timing for creating a schematic image may be when an operational instruction is received from a doctor, or when a chart-oriented screen is displayed on the patient terminal 60.

[0102] As described above, according to the third embodiment, similarly to the first embodiment, it is possible to shorten the examination time and improve the efficiency of diagnosis. Furthermore, the dynamic information processing device 40 can process a prepared schema template for case explanation to match an actual dynamic image of a patient, create a schema image for explaining to the patient, and display it on the display unit 65 of the patient terminal 60. By using a schema image (movie image data with a simple display) to explain to the patient, instead of showing the actual dynamic image to the patient, it becomes possible to display information with unnecessary information removed, making it easier for the patient to understand.

[0103] In addition, because a schematic image that matches the target area of ​​the patient is automatically generated from the dynamic image, the doctor does not need to draw the schematic image by hand. In addition, when the doctor needs to show the schematic image to the patient, he or she does not have to go through the trouble of showing the general shape of the area (still image) described in a book, etc. to explain it.

[0104] In the third embodiment, the dynamic information processing device 40 performs dynamic analysis of the diagnostic target dynamic image and creates a schematic image, but the schematic image creation function may be realized by an independent device or may be realized within a device other than the dynamic information processing device 40.

[0105] [Fourth embodiment] Next, a fourth embodiment to which the present invention is applied will be described. The behavior information processing system in the fourth embodiment has the same configuration as the behavior information processing system 100 shown in the first embodiment, and therefore, Figures 1 and 2 are used, and illustration and description of the configuration are omitted. However, in the fourth embodiment, both the doctor and the patient refer to the screen displayed on the display unit 55 of the medical staff terminal 50, and the patient terminal 60 is not required. The configuration and processing characteristic of the fourth embodiment will be described below.

[0106] In the fourth embodiment, as shown in FIG. 9, a numerical value-oriented screen 554A and a chart-oriented screen 554B can be displayed separately on the same monitor (display unit 55 of medical staff terminal 50).

[0107] The control unit 41 of the behavioral information processing device 40 accepts a selection of at least one of a first display mode (numerical emphasis mode) in which the display form mainly consists of characters or numbers, and a second display mode (diagram emphasis mode) in which the display form mainly consists of figures, charts or graphs, for the behavioral analysis results.

[0108] The control unit 41 has a first selection unit corresponding to the first display mode and a second selection unit corresponding to the second display mode. "Having a first selection unit" may mean that a button, icon, or the like corresponding to the first display mode is displayed to enable selection of the first display mode to be accepted, or that a selection of the first display mode can be accepted from a hardware switch. The same applies to the second selection unit.

[0109] Here, the control unit 41, as a first selection unit and a second selection unit, displays a button corresponding to the first display mode and a button corresponding to the second display mode on the display unit 55 of the medical staff terminal 50, and accepts selection of at least one of the first display mode and the second display mode through operation from the operation unit 54 of the medical staff terminal 50.

[0110] Based on the selection result, the control unit 41 causes the display unit (the display unit 55 of the medical staff terminal 50) to display a screen based on at least one of the information on the first display mode and the information on the second display mode.

[0111] 10(a) to (c) show an example of a behavior information screen 554 displayed on the display unit 55 of the medical staff terminal 50. The behavior information screen 554 includes a numerical value emphasis button B1 corresponding to the first display mode and a chart emphasis button B2 corresponding to the second display mode. 10(a), when the Numerical Value Emphasis button B1 is selected and the Chart Emphasis button B2 is not selected, a Numerical Value Emphasis screen 554A is displayed within the behavioral information screen 554. This state is suitable for a doctor to refer to the behavioral analysis results and make a diagnosis.

[0112] 10(b), when the Numerical Value Emphasis Button B1 is not selected and the Chart Emphasis Button B2 is selected, a Chart Emphasis Screen 554B is displayed within the Clinical Activity Information Screen 554. This state is suitable for a doctor to explain to a patient the results of a clinical activity analysis while presenting them in graphs or the like.

[0113] 10(c), when both the numerical value emphasis button B1 and the chart emphasis button B2 are selected, a numerical value emphasis screen 554A and a chart emphasis screen 554B are displayed within the behavior information screen 554. This state is suitable for a situation in which a doctor presents the chart emphasis screen 554B to a patient while referring to the numerical value emphasis screen 554A.

[0114] On the behavior information screen 554, it is possible to select whether to display or not the numerical value-oriented screen 554A and the chart-oriented screen 554B. A doctor uses the numerical value-oriented screen 554A for diagnosis and the chart-oriented screen 554B for explanation to the patient.

[0115] As described above, according to the fourth embodiment, the behavior information processing device 40 can accept the selection of at least one of the first display mode (numerical value emphasis mode) and the second display mode (diagram emphasis mode) by displaying the numerical value emphasis button B1 and the diagram emphasis button B2 on the display unit 55 of the medical staff terminal 50. In this way, when the doctor and the patient are viewing the same monitor (the display unit 55 of the medical staff terminal 50) and the doctor is explaining to the patient, the display / non-display of the numerical value emphasis screen and the diagram emphasis screen can be switched respectively. By selecting a display mode suitable for the purpose, the consultation time can be shortened and the efficiency of the diagnosis can be improved.

[0116] The first and second selection sections may be buttons displayed on the screen of the display unit 55 of the medical staff terminal 50, icons (figures, etc.), text, etc., and there are no limitations on what is displayed. The first and second selection sections may be physical mode selection switches provided on the medical staff terminal 50 or other devices.

[0117] In addition, a specific key included in the keyboard of the operation unit 54 of the medical staff terminal 50 may be associated with a display mode switching operation, and the first display mode and the second display mode may be switched each time this key is pressed. In addition, the display mode may be switched by acquiring voice data uttered by the user through a voice input unit such as a microphone provided on the medical staff terminal 50 and detecting specific terms, etc. from the voice data.

[0118] Furthermore, as in the first, second and third embodiments, when there are two output destination devices (the medical staff terminal 50, the patient terminal 60), a button corresponding to the first display mode and a button corresponding to the second display mode may be provided on the screen for each output destination device. For example, the display unit 55 of the medical staff terminal 50 may display mode selection buttons (numerical value emphasis button, chart emphasis button) for the medical staff terminal 50 and the patient terminal 60, respectively. Furthermore, the display unit 55 of the medical staff terminal 50 may display a mode selection button for the medical staff terminal 50, and the display unit 65 of the patient terminal 60 may display a mode selection button for the patient terminal 60.

[0119] [Variations] Next, a modification of the fourth embodiment will be described. In the fourth embodiment, the case where the display mode is selected by the Numerical Value Emphasis button B1 and the Chart Emphasis button B2 in the behavior information screen 554 displayed on the display unit 55 of the medical staff terminal 50 has been described, but in the modified example, the display mode is switched depending on the orientation of the medical staff terminal 50A (see FIG. 11). The following mainly describes the parts that are different from the fourth embodiment.

[0120] FIG. 11 shows the functional configuration of a medical staff terminal 50A in a modified example. As shown in FIG. 11, the medical staff terminal 50A is configured with a control unit 51, a memory unit 52, a communication unit 53, an operation unit 54, a display unit 55, an orientation detection unit 56, etc., and each unit is connected by a bus. The medical staff terminal 50A is a tablet terminal.

[0121] The orientation detection unit 56 detects the orientation of the medical staff terminal 50A (display unit 55). Specifically, the orientation detection unit 56 detects which side of the four sides of the rectangle that is the display area of ​​the display unit 55 is on the lower side in the vertical direction. A gyro sensor or the like is used as the orientation detection unit 56.

[0122] 12(a) to 12(d) show orientations D1 to D4 of the medical staff terminal 50A (display unit 55). The periphery of the display area of ​​the display unit 55 is formed by four sides 55A to 55D. Orientation D1 shown in FIG. 12(a) is a state in which side 55A is on the lower side in the vertical direction. Orientation D2 shown in FIG. 12(b) is a state rotated 90 degrees clockwise from the state in FIG. 12(a), in which side 55B is on the lower side in the vertical direction. Orientation D3 shown in FIG. 12(c) is a state rotated 90° clockwise from the state in FIG. 12(b), in which side 55C is on the lower side in the vertical direction. Orientation D4 shown in FIG. 12(d) is a state rotated 90 degrees clockwise from the state in FIG. 12(c), with side 55D facing downward in the vertical direction.

[0123] The control unit 51 of the medical staff terminal 50A transmits information indicating the orientation of the medical staff terminal 50A detected by the orientation detection unit 56 to the behavior information processing device 40 via the communication unit 53.

[0124] The control unit 41 of the behavior information processing device 40 acquires, via the communication unit 43, from the medical staff terminal 50A, information indicating the orientation of the medical staff terminal 50A.

[0125] The control unit 41 accepts the selection of at least one of the first display mode and the second display mode based on preset setting information.

[0126] The setting information is information in which the orientation of the output destination device (medical staff terminal 50A) is associated with at least one of the first and second display modes, and is stored in the storage unit 42. Here, the first display mode (numerical value-oriented mode) is associated with the orientations D1 and D3, and the second display mode (diagram-oriented mode) is associated with the orientations D2 and D4.

[0127] The control unit 41 outputs information about the first display mode or information about the second display mode based on the selection result between the first display mode and the second display mode.

[0128] Furthermore, for each of orientations D1 to D4, control unit 41 generates display data so that the orientation of the display screen matches the orientation of display unit 55. For example, in orientation D1, display data is generated so that side 55A is on the lower side of the screen. Note that the control of the screen orientation may be performed on the medical staff terminal 50A side.

[0129] That is, the display mode and the orientation of the display screen are switched depending on the orientation of the medical staff terminal 50A. In the case of orientation D1 shown in FIG. 12(a), the numerical value-oriented screen is displayed on the display unit 55 of the medical staff terminal 50A with side 55A facing downward. In the case of the orientation D2 shown in FIG. 12(b), the diagram-focused screen is displayed on the display unit 55 of the medical staff terminal 50A so that the side 55B faces downward. In the case of the orientation D3 shown in FIG. 12(c), the numerical value-oriented screen is displayed on the display unit 55 of the medical staff terminal 50A so that the side 55C is on the lower side. In the case of the orientation D4 shown in FIG. 12(d), the diagram-focused screen is displayed on the display unit 55 of the medical staff terminal 50A so that the side 55D faces downward.

[0130] In this manner, in the modified example, the screen can be switched depending on the orientation (up / down / portrait / landscape state) of the medical staff terminal 50A (display unit 55).

[0131] The setting information stored in the storage unit 42 may be information in which the detection result of a sensor provided in the output destination device (medical worker terminal 50A) is associated with at least one of the first display mode and the second display mode. As the sensor, for example, one that detects the orientation, inclination, position, etc. of the output destination device is used.

[0132] The above-described embodiments and modifications are merely examples of the behavior information processing device and behavior information processing system according to the present invention, and the present invention is not limited to these. The detailed configurations and operations of the devices constituting the system may be modified as appropriate without departing from the spirit of the present invention. For example, characteristic configurations or processes of each embodiment and modification may be combined.

[0133] In the above embodiments and modifications, the case where the behavior information processing device 40 displays each screen on the medical staff terminal 50 and the patient terminal 60 has been described, but the behavior information processing device 40 may have one or more display monitors and display each screen on the display monitors. Also, operation instructions for the behavior information processing device 40 may be input from an operation unit provided in the behavior information processing device 40. Also, all processing may be performed by the behavior information processing device 40 alone. Moreover, the image management device 30 may have the functions of the behavior information processing device 40 .

[0134] In addition, all or part of the functions of each device constituting the behavior information processing system 100, 200 may be integrated into one device, or the functions of each device constituting the behavior information processing system 100, 200 may be spread across multiple devices.

[0135] In addition, in each of the above embodiments, the display format of the dynamic analysis results is different for the doctor and the patient. However, the display format of the dynamic analysis results may be different depending on the medical department (internal medicine, surgery, etc.). In addition, the display format of the dynamic analysis results may be changed depending on the level of expertise and age of the medical staff.

[0136] In the first, second and third embodiments, the medical staff terminal 50 is used as the output destination device (first display unit) that outputs information related to the first display mode, and the patient terminal 60 is used as the output destination device (second display unit) that outputs information related to the second display mode. However, there is no intention to limit the people who view the display screens of the first display unit and the second display unit to medical staff (doctors, etc.) and patients. The output destination device may be a terminal used by the person who views the output destination device. For example, as described above, in the case where the display form is changed depending on the medical department, the first display unit may be a terminal used by an internal medicine doctor, and the second display unit may be a terminal used by a surgery doctor, etc. Furthermore, even in cases where a numerically-oriented screen and a chart-oriented screen can be displayed on the same monitor, as in the fourth embodiment and its modified examples, users are not limited to medical professionals (doctors, etc.) and patients.

[0137] The programs for executing the processes in each device may be stored in a portable recording medium. A carrier wave may be used as a medium for providing the program data via a communication line. [Explanation of symbols]

[0138] 10. Imaging Device 20 Console 30 Image management device 40. Dynamic information processing device 41 Control section 42 Storage section 43 Communications Department 50 Medical staff terminals 50A Medical Staff Terminal 54 Operation section 55 Display section 56 Orientation detection unit 60 Patient terminal 65 Display section 100 Dynamic Information Processing System 200 Dynamic Information Processing System N Communication Network

Claims

1. an image acquisition unit that acquires a dynamic image obtained by performing dynamic radiography on a subject; a dynamic analysis unit that performs dynamic analysis on the dynamic image to generate a dynamic analysis result; a reception unit capable of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values, and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output unit that outputs information about the first display mode or information about the second display mode based on a selection result in the reception unit; Equipped with The output unit outputs information about the first display mode to a display unit of a medical staff terminal, and outputs information about the second display mode to a display unit of a patient terminal.

2. The activity information processing apparatus according to claim 1 , wherein the accepting unit has a first selecting unit corresponding to the first display mode and a second selecting unit corresponding to the second display mode.

3. An image acquisition unit for acquiring dynamic images obtained by performing dynamic radiography on a subject; a dynamic analysis unit that performs dynamic analysis on the dynamic image to generate a dynamic analysis result; a reception unit capable of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values, and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output unit that outputs information about the first display mode or information about the second display mode based on a selection result in the reception unit; Equipped with the reception unit receives a selection of at least one of the first display mode and the second display mode based on preset setting information; The setting information is information in which information specific to an output destination device of the output unit is associated with at least one of the first display mode and the second display mode.

4. An image acquisition unit for acquiring a dynamic image obtained by performing dynamic radiography on a subject; a dynamic analysis unit that performs dynamic analysis on the dynamic image to generate a dynamic analysis result; a reception unit capable of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values, and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output unit that outputs information about the first display mode or information about the second display mode based on a selection result in the reception unit; Equipped with the reception unit receives a selection of at least one of the first display mode and the second display mode based on preset setting information; A dynamic information processing device, wherein the setting information corresponds to the orientation of the output destination device of the output unit or the detection result of a sensor provided in the output destination device, and at least one of the first display mode and the second display mode.

5. A dynamic information processing device as described in claim 3 or 4, wherein the output unit outputs information regarding the first display mode to the first display unit and outputs information regarding the second display mode to the second display unit.

6. The first display unit is a medical staff terminal, The apparatus according to claim 5 , wherein the second display unit is a patient terminal.

7. A dynamic information processing device as described in claim 3 or 4, wherein the output unit causes a screen based on at least one of information relating to the first display mode and information relating to the second display mode to be displayed on a display unit.

8. The activity information processing apparatus according to claim 1 , wherein the information regarding the first display mode and the information regarding the second display mode are information for simultaneously displaying the same content in different display methods.

9. a computer of a dynamic information processing device that processes a dynamic image obtained by performing dynamic imaging of a subject using radiation and a dynamic analysis result generated by performing dynamic analysis on the dynamic image; a reception unit capable of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values ​​and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output unit that outputs information about the first display mode or information about the second display mode based on a selection result in the reception unit; A program for causing the device to function as a The output unit is a program that outputs information about the first display mode to a display unit of a medical staff terminal and outputs information about the second display mode to a display unit of a patient terminal.

10. A computer of a dynamic information processing device that processes a dynamic image obtained by performing dynamic imaging of a subject using radiation and a dynamic analysis result generated by performing dynamic analysis on the dynamic image, a reception unit capable of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values ​​and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output unit that outputs information about the first display mode or information about the second display mode based on a selection result in the reception unit; A program for causing the device to function as a the reception unit receives a selection of at least one of the first display mode and the second display mode based on preset setting information; The setting information is information in which information specific to an output destination device of the output unit is associated with at least one of the first display mode and the second display mode.

11. A computer of a dynamic information processing device that processes a dynamic image obtained by performing dynamic imaging of a subject using radiation and a dynamic analysis result generated by performing dynamic analysis on the dynamic image, a reception unit capable of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values ​​and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output unit that outputs information about the first display mode or information about the second display mode based on a selection result in the reception unit; A program for causing the device to function as a the reception unit receives a selection of at least one of the first display mode and the second display mode based on preset setting information; The setting information is a program that corresponds the orientation of the output destination device of the output unit or the detection result of a sensor provided in the output destination device to at least one of the first display mode and the second display mode.

12. A dynamic information processing method for processing a dynamic image obtained by performing dynamic imaging of a subject using radiation and a dynamic analysis result generated by performing dynamic analysis on the dynamic image, comprising: a receiving step of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values, and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output step of outputting information about the first display mode or information about the second display mode based on a selection result in the receiving step; Including, In the output step, information regarding the first display mode is output to a display unit of a medical staff terminal, and information regarding the second display mode is output to a display unit of a patient terminal.

13. A dynamic information processing method for processing a dynamic image obtained by performing dynamic imaging on a subject using radiation and a dynamic analysis result generated by performing dynamic analysis on the dynamic image, comprising: a receiving step of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values, and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output step of outputting information about the first display mode or information about the second display mode based on a selection result in the receiving step; Including, In the receiving step, a selection of at least one of the first display mode and the second display mode is received based on preset setting information; The setting information is information in which information specific to an output destination device in the output process is associated with at least one of the first display mode and the second display mode.

14. A dynamic information processing method for processing a dynamic image obtained by performing dynamic imaging on a subject using radiation and a dynamic analysis result generated by performing dynamic analysis on the dynamic image, comprising: a receiving step of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values, and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output step of outputting information about the first display mode or information about the second display mode based on a selection result in the receiving step; Including, In the receiving step, a selection of at least one of the first display mode and the second display mode is received based on preset setting information; A dynamic information processing method, wherein the setting information is information in which the orientation of the output destination device in the output process or the detection result of a sensor provided on the output destination device is associated with at least one of the first display mode and the second display mode.

15. an image acquisition unit that acquires a dynamic image obtained by performing dynamic radiography on a subject; a dynamic analysis unit that performs dynamic analysis on the dynamic image to generate a dynamic analysis result; a reception unit capable of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values, and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output unit that outputs information about the first display mode or information about the second display mode based on a selection result in the reception unit; Equipped with The output unit outputs information regarding the first display mode to a display unit of a medical staff terminal, and outputs information regarding the second display mode to a display unit of a patient terminal.

16. An image acquisition unit for acquiring dynamic images obtained by performing dynamic radiography on a subject; a dynamic analysis unit that performs dynamic analysis on the dynamic image to generate a dynamic analysis result; a reception unit capable of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values, and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output unit that outputs information about the first display mode or information about the second display mode based on a selection result in the reception unit; Equipped with the reception unit receives a selection of at least one of the first display mode and the second display mode based on preset setting information; A dynamic information processing system, wherein the setting information is information in which information specific to an output destination device of the output unit is associated with at least one of the first display mode and the second display mode.

17. An image acquisition unit for acquiring dynamic images obtained by performing dynamic radiography on a subject; a dynamic analysis unit that performs dynamic analysis on the dynamic image to generate a dynamic analysis result; a reception unit capable of receiving a selection of at least one of a first display mode in which the dynamic analysis result is displayed mainly using characters or numerical values, and a second display mode in which the dynamic analysis result is displayed mainly using figures, charts, or graphs; an output unit that outputs information about the first display mode or information about the second display mode based on a selection result in the reception unit; Equipped with the reception unit receives a selection of at least one of the first display mode and the second display mode based on preset setting information; A dynamic information processing system, wherein the setting information corresponds to the orientation of the output destination device of the output unit or the detection result of a sensor provided in the output destination device, and at least one of the first display mode and the second display mode.

Images