Image processing device, terminal device, image processing system, image processing method, and program

Abstract

To reduce burden on a server and network.SOLUTION: An image processing device includes an image acquisition unit, a first image generation unit, a data generation unit, and a control unit. The image acquisition unit acquires three-dimensional image data. The first image generation unit generates a first processing image on the basis of the three-dimensional image data. The data generation unit generates image processed data whose data amount is smaller than the three-dimensional image data. The control unit executes communication control to cause a terminal device to generate a second processing image on the basis of the image processed data, and transmit, to the terminal device, the image processed data for displaying the second processing image on a display unit of the terminal device.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The embodiments disclosed in this specification and the drawings relate to an image processing apparatus, a terminal device, an image processing system, an image processing method, and a program.

Background Art

[0002] For example, when a user displays a medical image for inspection or diagnosis, there is a technology for generating an image displayed on a terminal by a server. In this technology, preprocessing and automatic analysis for displaying an image are performed by the server. Since the server performs these preprocessing and automatic analysis on medical images provided to a plurality of users, the load of preprocessing and automatic analysis increases, and necessary analysis may not be performed in a timely manner. From the user's perspective, the processing speed for operations may become slow, and this technology may not be used comfortably.

[0003] In recent years, terminal devices such as general personal computers have increasingly had sufficient specifications to perform image processing such as simple rendering of three-dimensional image data. Therefore, a user can also download a medical image from a server to a terminal device and perform image processing. However, in order to perform image processing such as rendering, expensive equipment may be required, and it has been difficult to use easily. Furthermore, medical images often have a large data capacity, which takes time to download and also tends to increase the load on the network.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The problem to be solved by the embodiments disclosed in this specification and the drawings is to reduce the load on servers and networks. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problems. It is also possible to position, as other problems, the problems corresponding to the respective effects of the respective configurations shown in the embodiments described later.

Means for Solving the Problems

[0006] The image processing apparatus according to the embodiment includes an image acquisition unit, a first image generation unit, a data generation unit, and a control unit. The image acquisition unit acquires three-dimensional image data. The first image generation unit generates a first processed image based on the three-dimensional image data. The data generation unit generates image processing target data having a smaller data amount than the three-dimensional image data. The control unit performs communication control to generate a second processed image on the terminal device based on the image processing target data and transmit the image processing target data for displaying the second processed image on the display unit of the terminal device to the terminal device.

Brief Description of the Drawings

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Modes for Carrying Out the Invention

[0008] Hereinafter, an image processing apparatus, a terminal apparatus, an image processing system, an image processing method, and a program according to embodiments will be described with reference to the drawings.

[0009] (First Embodiment) FIG. 1 is a block diagram showing an example of the configuration of a hospital internal system H including the medical image processing system 1. The hospital internal system H includes, for example, a hospital information system (hereinafter referred to as HIS) 10, a radiology information system (hereinafter referred to as RIS) 20, a medical image diagnostic apparatus (modality) 30, an image storage and communication system (PACS: Picture Archiving and Communication System) 40, a medical image processing server 100, and a plurality of client terminals 200, 200...

[0010] HIS 10, RIS 20, modality 30, PACS 40, medical image processing server 100, and a plurality of client terminals 200, 200... can communicate with each other via a network NW such as a LAN (Local Area Network). The medical image processing system 1 is configured to include the medical image processing server 100 and a plurality of client terminals 200, 200...

[0011] The medical image processing server 100 is an example of an image processing apparatus, and the client terminal 200 is an example of a terminal device. In the embodiment, the medical image processing system 1 is incorporated into the in-hospital system H. However, a part of the medical image processing system 1, for example, the medical image processing server, may be installed outside the hospital, detached from the in-hospital system H. The medical image processing system 1 is an example of an image processing system.

[0012] In the medical image processing system 1 of the first embodiment, an application program (hereinafter referred to as a diagnosis app) for displaying and using medical images when a technician, doctor, or the like (hereinafter referred to as a user) performs a diagnosis or the like is installed on the client terminal 200. The user can view a three-dimensional image based on three-dimensional image data and a rendering image generated based on the three-dimensional image data by starting the diagnosis app on the client terminal 200.

[0013] As the three-dimensional image data, three levels of low-resolution image data, medium-resolution image data, and high-resolution image data in ascending order of resolution are used. Among these, for example, the medium-resolution image data is generated by the modality 30. The low-resolution image data is generated by reducing the quality of the medium-resolution image data, and the high-resolution image data is generated by reducing the quality of the medium-resolution image data. The resolution of the three-dimensional image data is not limited to three levels, and may be two levels or four levels or more. The three-dimensional image data with different resolutions may be imaged independently by the modality 30.

[0014] In the first embodiment, a low-resolution rendering image, a medium-resolution rendering image, and a high-resolution rendering image are generated as the rendering images. The low-resolution rendering image is generated on the client terminal 200, and the medium-resolution rendering image and the high-resolution rendering image are generated on the medical image processing server 100. The rendering image data is an example of a processed image. The medium-resolution rendering image is an example of a first processed image. The low-resolution rendering image is an example of a second processed image.

[0015] The generated low-resolution rendering image, medium-resolution rendering image, and high-resolution rendering image are all displayed on the client terminal 200. In the first embodiment, the low-resolution rendering image displayed on the client terminal 200 is the one generated on the client terminal 200. On the other hand, the medium-resolution rendering image and the high-resolution rendering image are displayed on the client terminal 200 by, for example, remotely monitoring by the client terminal 200 the ones generated on the medical image processing server 100.

[0016] Before explaining the medical image processing system 1, elements other than the medical image processing system 1 in the in-hospital system H will be briefly explained.

[0017] HIS10 is a computer system for providing in-hospital business support. Specifically, HIS10 has various subsystems. Examples of the various subsystems include an electronic medical record system, a medical accounting system, a medical appointment system, a hospital reception system, and an admission / discharge management system.

[0018] HIS10 is a computer system for providing in-hospital business support. Specifically, HIS10 has various subsystems. Examples of the various subsystems include an electronic medical record system, a medical accounting system, a medical appointment system, a hospital reception system, and an admission / discharge management system.

[0019] HIS10 includes computers such as server devices and client terminals equipped with a processor such as a CPU (Central Processing Unit), a memory such as a ROM (Read Only Memory) and a RAM (Random Access Memory), a display, an input interface, and a communication interface.

[0020] The user inputs or refers to information regarding patients using the electronic medical record system included in HIS10. The user issues an imaging examination order to HIS10. HIS10 transfers order information corresponding to the imaging examination order to other systems such as RIS20.

[0021] RIS20 is a computer system that provides business support in the imaging diagnosis department. In addition to reservation management of imaging examination orders in cooperation with HIS10, RIS20 performs reservation information cooperation with examination equipment and management of examination information. RIS20 includes, for example, a server device equipped with a processor such as a CPU, a memory such as a ROM and a RAM, a display, an input interface, and a communication interface, and a computer such as a client terminal.

[0022] Modality 30 executes imaging (shooting) in accordance with shooting conditions (shooting protocol) determined based on, for example, imaging examination instructions. Examples of Modality 30 include an X-ray computed tomography device (X-ray CT device), an X-ray diagnostic device, a magnetic resonance imaging device, an ultrasonic diagnostic device, a nuclear medicine diagnostic device, etc. Medical images are, for example, X-ray CT images, magnetic resonance images, echo images, etc. Modality 30 is operated by, for example, a user. The medical images (image data) generated by the imaging of Modality 30 are transmitted to PACS40.

[0023] PACS40 is a computer system that receives the medical images transmitted by Modality 30 and stores them in a database. PACS40 transmits (transfers) the medical images stored in the database in response to a request from a client. PACS40 includes a server computer including a processor such as a CPU, a memory such as a ROM and a RAM, a display, an input interface, and a communication interface.

[0024] The configuration of the in-hospital system H is not limited to the above. The in-hospital system H may include, for example, a radiology report creation device or the like. Also, some elements of the in-hospital system H may be integrated. For example, HIS10 and RIS20 may be integrated into one system.

[0025] Next, the medical image processing system 1 will be described. First, the medical image processing server 100 will be described. FIG. 2 is a diagram showing an example of the configuration of the medical image processing server 100. The medical image processing server 100 includes, for example, a communication interface 110, an input interface 120, a display 130, a processing circuit 140, and a memory 150.

[0026] The communication interface 110 communicates with external devices such as client terminals 200 such as a LAN via the network NW (FIG. 1), for example. The communication interface 110 includes, for example, a communication interface such as a NIC (Network Interface Card). The network NW may include the Internet, a cellular network, a Wi-Fi network, a WAN (Wide Area Network), etc. instead of or in addition to the LAN.

[0027] The input interface 120 receives various input operations from an administrator who manages the medical image processing server 100 or the like. The input interface 120 converts the received input operation into an electrical signal and outputs it to the processing circuit 140. The input interface 120 generates information corresponding to the input operation when the input operation is performed by an administrator or the like. The input interface 120 outputs the generated information corresponding to the input operation to the processing circuit 140.

[0028] The input interface 120 includes, for example, a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch panel, etc. The input interface 120 may be a user interface that accepts voice input such as a microphone. When the input interface 120 is a touch panel, the input interface 120 may also have the display function of the display 130.

[0029] Note that in this specification, the input interface is not limited to those equipped with physical operation components such as a mouse and a keyboard. For example, a processing circuit for electrical signals that receives an electrical signal corresponding to an input operation from an external input device provided separately from the apparatus and outputs this electrical signal to the processing circuit 140 is also included in the examples of the input interface.

[0030] The display 130 displays various kinds of information. For example, the display 130 displays an image generated by the processing circuit 140, a GUI (Graphical User Interface) for accepting various input operations from the operator, etc. For example, the display 130 is an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube) display, an organic EL (Electro Luminescence) display, etc.

[0031] The processing circuit 140 includes, for example, an image acquisition function 141, an image generation function 142, a data generation function 143, and a control function 144. The processing circuit 140 realizes these functions by, for example, a hardware processor (computer) executing a program stored in the memory (storage circuit) 150.

[0032] A hardware processor means circuitry such as, for example, a CPU, a GPU (Graphics Processing Unit), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD) or a complex programmable logic device (CPLD), a field programmable gate array (FPGA)).

[0033] Instead of storing a program in the memory 150, it may be configured to directly incorporate the program into the circuitry of the hardware processor. In this case, the hardware processor realizes its functions by reading and executing the program incorporated in the circuitry. The above program may be stored in the memory 150 in advance, or may be stored in a non-transitory storage medium such as a DVD or a CD-ROM, and may be installed from the non-transitory storage medium into the memory 150 when the non-transitory storage medium is mounted on a drive device (not shown) of the medical image processing server 100.

[0034] The hardware processor is not limited to being configured as a single circuit, and may be configured as one hardware processor by combining a plurality of independent circuits so as to realize each function. Also, a plurality of components may be integrated into one hardware processor so as to realize each function. The hardware processor, the memory, etc. in the medical image processing server 100 are provided separately from the hardware processor, the memory, etc. of the HIS 10, but these may be common.

[0035] The memory 150 stores a three-dimensional image database (hereinafter referred to as DB) 151. The three-dimensional image DB 151 includes a plurality of medical image data composed of three-dimensional image data captured by the modality 30, for example. The three-dimensional image data included in the three-dimensional image DB 151 is, for example, an image transmitted by the modality 30 or the PACS 40.

[0036] The image acquisition function 141 acquires the app startup information transmitted by the client terminal 200. Based on the acquired app startup information, the image acquisition function 141 identifies the three-dimensional image data to be provided to the client terminal 200, and acquires the identified three-dimensional image data from the three-dimensional image DB 151 stored in the memory 150. The image acquisition function 141 is an example of an image acquisition unit.

[0037] The image generation function 142 generates a rendering image based on the three-dimensional image data acquired by the image acquisition function 141. The image generation function 142, for example, enhances the medium-resolution image data to generate high-resolution image data. The image generation function 142 generates a medium-resolution rendering image and a high-resolution rendering image based on the medium-resolution image data and the high-resolution image data.

[0038] The image generation function 142 generates medium-resolution rendering image monitoring data and high-resolution rendering image monitoring data for making the generated medium-resolution rendering image and high-resolution rendering image monitorable from an external device. The image generation function 142 transmits the generated medium-resolution rendering image monitoring data and high-resolution rendering image monitoring data to the client terminal 200 that transmitted the app startup information. The image generation function 142 is an example of a first image generation unit. The medium-resolution rendering image and the high-resolution rendering image are examples of a first processed image.

[0039] The data generation function 143 generates the image processing data to be processed with a smaller data volume than the three-dimensional image data acquired by the image acquisition function 141. For example, the data generation function 143 generates three-dimensional image data (hereinafter referred to as low-resolution image data) with a lower resolution than the medium-resolution image data acquired by the image acquisition function 141 as the image processing data to be processed. The data generation function 143 is an example of a data generation unit.

[0040] The control function 144 controls the communication interface 110 to transmit data to an external device. The control function 144 performs communication control to transmit the low-resolution image data generated by the data generation function 143 to the client terminal 200. The low-resolution image data is image data for causing the client terminal 200 to generate a low-resolution rendering image and display it on the display 230 (see FIG. 3). The control function 144 is an example of a control unit.

[0041] Subsequently, the client terminal 200 will be described. The plurality of client terminals 200, 200... are terminals used by users respectively. FIG. 3 is a block diagram showing an example of the configuration of the client terminal 200. The client terminal 200 includes, for example, a communication interface 210, an input interface 220, a display 230, a control circuit 240, and a memory 250.

[0042] The communication interface 210 communicates with an external device such as a medical image processing server 100 like a LAN via a network NW, for example. The communication interface 210 includes, for example, a communication interface such as a NIC.

[0043] The input interface 220 receives various input operations from the user. The input interface 220 converts the received input operation into an electrical signal and outputs it to the control circuit 240. For example, when an input operation is performed by a medical doctor or the like, the input interface 220 generates information corresponding to the input operation. The input interface 220 outputs the generated information corresponding to the input operation to the control circuit 240.

[0044] The input interface 220 includes, for example, a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch panel, etc. The input interface 220 may be a user interface that accepts voice input such as a microphone. When the input interface 220 is a touch panel, the input interface 220 may also have the display function of the display 230.

[0045] The display 230 displays various types of information. For example, the display 230 displays an image generated by the control circuit 240, a GUI for receiving various input operations from the operator, etc. For example, the display 230 is an LCD, a CRT display, an organic EL display, etc. The display 230 displays, for example, a low-resolution rendering image. The display 230 is an example of a display unit.

[0046] The control circuit 240 includes, for example, a startup control function 241, a terminal-side image generation function 242, and a display control function 243. The control circuit 240 realizes these functions by, for example, a hardware processor (computer) executing a program stored in the memory (storage circuit) 250. The memory 250 stores a diagnostic application 251 as a program.

[0047] Instead of storing the program in the memory 250, it may be configured to directly incorporate the program into the circuit of the hardware processor. In this case, the hardware processor realizes its functions by reading and executing the program incorporated in the circuit. The above program may be stored in the memory 250 in advance, or may be stored in a non-transitory storage medium such as a DVD or a CD-ROM, and may be installed from the non-transitory storage medium into the memory 250 by mounting the non-transitory storage medium on a drive device (not shown) of the medical image processing server 100. The hardware processor, memory, etc. in the client terminal 200 are provided separately from the hardware processor, memory, etc. of the HIS 10, but they may be common.

[0048] When the user performs an input operation to start the diagnostic application on the input interface 120, the startup control function 241 reads and starts the diagnostic application 251 from the memory 250. When starting the diagnostic application, the startup control function 241 transmits application startup information to the medical image processing server 100.

[0049] The terminal-side image generation function 242 acquires the low-resolution image data transmitted by the medical image processing server 100. Based on the acquired low-resolution image data, the terminal-side image generation function 242 generates a low-resolution rendering image. The low-resolution rendering image is an image with a lower resolution than the medium-resolution rendering image. The terminal-side image generation function 242 is an example of a second image generation unit.

[0050] The display control function 243 performs display control to display various images on the display 230. For example, the display control function 243 displays the low-resolution rendering image generated by the terminal-side image generation function 242 on the display 230. By monitoring the medical image processing server 100, the display control function 243 displays the medium-resolution rendering image and the high-resolution rendering image on the display 230. The display control function 243 is an example of a display control unit.

[0051] Next, the processing flow in the medical image processing system 1 of the first embodiment will be described. FIG. 4 is a sequence diagram showing an example of the processing flow in the medical image processing system 1. A user who wants to start a diagnosis using a diagnostic application first performs an input operation to start the diagnostic application on the input interface 120 in the client terminal 200.

[0052] The startup control function 241 in the client terminal 200 reads out and starts the diagnostic application 251 from the memory 250 in response to the user's input operation (step S101). The startup control function 241 transmits application startup information to the medical image processing server 100 along with the startup of the diagnostic application (step S103).

[0053] Upon receiving the application startup information, the medical image processing server 100 selects, in the image acquisition function 141, three-dimensional image data to be provided to the client terminal 200 based on the application startup information. The image acquisition function 141 reads out the specified three-dimensional image data from the three-dimensional image DB 151 stored in the memory 150 (step S105).

[0054] Subsequently, the data generation function 143 uses the read three-dimensional image data as medium-resolution image data, degrades the medium-resolution image data to generate low-resolution image data (step S107). The medium-resolution image data is, for example, image data of an X-ray CT image with 512×512 pixels, and the low-resolution image data is, for example, image data of an X-ray CT image with 64×64 pixels. The control function 144 transmits the low-resolution image data generated by the data generation function 143 to the client terminal 200 that sent the application startup signal by communication control (step S109).

[0055] The low-resolution image data transmitted by the control function 144 is acquired by the terminal-side image generation function 242 in the client terminal 200. The terminal-side image generation function 242 generates a low-resolution rendering image based on the acquired low-resolution image data (step S111).

[0056] Furthermore, the display control function 243 causes the display 230 to display the low-resolution rendering image generated by the terminal-side image generation function 242 as an image during processing that requires updating of the rendering image such as during rotation (step S115).

[0057] On the other hand, in the medical image processing server 100, when a rendering image of medium resolution or higher is required, such as when processing that requires updating of the rendering image such as rotation is completed, the image generation function 142 generates a medium-resolution rendering image based on the medium-resolution image data acquired by the image acquisition function 141 (step S117). The image generation function 142 generates medium-resolution rendering image monitoring data that enables monitoring of the generated medium-resolution rendering image, and transmits it to the client terminal 200 (step S119).

[0058] The client terminal 200 that has received the medium-resolution rendering image monitoring data enables monitoring by causing the display control function 243 to display the medium-resolution rendering image on the display 230 (step S121). The user can monitor the medium-resolution rendering image displayed on the display 230.

[0059] On the other hand, in the medical image processing server 100, when a rendering image of high resolution or higher is required, such as when medium-resolution rendering is completed, the image generation function 142 generates a high-resolution rendering image based on the high-resolution image data acquired by the generated image acquisition function 141 and the generated medium-resolution rendering image (step S123). The image generation function 142 generates high-resolution rendering image monitoring data that enables monitoring of the generated high-resolution rendering image, and transmits it to the client terminal 200 (step S125).

[0060] The client terminal 200 that has received the high-resolution rendering image monitoring data can be monitored by causing the display control function 243 to display the high-resolution rendering image on the display 230 (step S127). The user can monitor the high-resolution rendering image displayed on the display 230.

[0061] In the medical image processing system 1 of the first embodiment, when rendering the three-dimensional image data acquired by the medical image processing server 100, a low-resolution rendering image is generated by the client terminal 200. On the other hand, in the medical image processing system 1 of the first embodiment, a medium-resolution rendering image and a high-resolution rendering image are generated by the medical image processing server 100.

[0062] For this reason, the medical image processing server 100 does not need to generate a low-resolution rendering image, and there is no need to transmit data with a large data volume to the client terminal 200, so the load on the medical image processing server 100 and the network NW can be reduced. Furthermore, since the load on the medical image processing server 100 is reduced, even when the medical image processing system 1 includes a plurality of client terminals 200, it can contribute to the smoothness of processing.

[0063] (Second Embodiment) Next, the medical image processing system 1 of the second embodiment will be described. FIG. 5 is a block diagram showing an example of the configuration of the medical image processing server 100 of the second embodiment. FIG. 6 is a block diagram showing an example of the configuration of the client terminal 200 of the second embodiment. In the medical image processing server 100 of the second embodiment, the processing circuit 140 further includes a generation ability acquisition function 145 and a determination function 146. Also, in the client terminal 200 of the second embodiment, the control circuit 240 further includes a monitoring function 244 and a transmission control function 245. The second embodiment is mainly different from the first embodiment in these points, and the other points are common.

[0064] In the medical image processing server 100 according to the second embodiment, the generation ability acquisition function 145 acquires generation ability information transmitted by the client terminal 200. The generation ability includes, for example, the FPS (frames per second), free memory, and free capacity of the client terminal 200. The generation ability acquisition function 145 is an example of a generation ability acquisition unit.

[0065] Based on the generation ability information of the client terminal 200 acquired by the generation ability acquisition function 145, the determination function 146 determines the image data (hereinafter referred to as target image data) to be transmitted to the client terminal 200. For example, when the client terminal 200 does not have the ability to generate a medium-resolution rendering image in terms of its image generation ability, the determination function 146 determines that there is no target image data. For example, the greater the image generation ability of the client terminal 200, the determination function 146 determines the image data for generating a rendering image with a higher resolution as the target image data. The determination function 146 is an example of a determination unit.

[0066] The monitoring function 244 in the client terminal 200 according to the second embodiment monitors the generation ability to generate a rendering image of the client terminal 200 itself. Among the generation abilities of the client terminal 200, the FPS is a numerical value specified for each client terminal 200, but the free memory and free capacity are numerical values that vary depending on the processing load of the client terminal 200.

[0067] When the terminal-side image generation function 242 acquires the low-resolution image data transmitted by the medical image processing server 100, the monitoring function 244 calculates the necessary processing capacity required for processing the low-resolution image data. The monitoring function 244 subtracts a value corresponding to the calculation result of the necessary processing capacity from the generation ability provided by the client terminal 200 and updates the generation ability information 252 stored in the memory 250. The monitoring function 244 is an example of a monitoring unit.

[0068] When the terminal - side image generation function 242 acquires the low - resolution image data transmitted by the medical image processing server 100 and updates the generation ability information 252, the transmission control function 245 transmits the updated generation ability information to the medical image processing server 100 together with the low - resolution rendering image. The transmission control function 245 is an example of a transmission control unit.

[0069] Next, the processing flow in the medical image processing system 1 of the second embodiment will be described. FIG. 7 is a sequence diagram showing an example of the processing flow in the medical image processing system 1 of the second embodiment. Similar to the first embodiment, a user who intends to start a diagnosis using a diagnostic application first performs an input operation to start the diagnostic application on the input interface 120 in the client terminal 200.

[0070] In response to the user's input operation, the client terminal 200 reads out the diagnostic application 251 from the memory 250 and starts it by the startup control function 241 (step S201), and transmits the application startup information to the medical image processing server 100 (step S203). The medical image processing server 100 that has received the application startup information reads out, from the three - dimensional image DB 151, the three - dimensional image data selected based on the three - dimensional image data provided to the client terminal 200 based on the application startup information in the image acquisition function 141 (step S205).

[0071] Subsequently, the data generation function 143 generates low - resolution image data (step S207), and transmits the generated low - resolution image data to the client terminal 200 that has transmitted the application startup signal (step S209). The client terminal 200 that has received the low - resolution image data generates a low - resolution rendering image based on the acquired low - resolution image data by the terminal - side image generation function 242 (S211). The processing up to this point is common to the first embodiment.

[0072] Subsequently, the monitoring function 244 calculates the necessary processing capacity required for processing the low-resolution image data, and does so. The client terminal 200 subtracts the value corresponding to the calculation result of the necessary processing capacity from the generation capacity it has and updates the generation capacity information 252 (step S213). Subsequently, the transmission control function 245 transmits the generation capacity information updated by the monitoring function 244 to the medical image processing server 100 (step S215). Further, the display control function 243 causes the low-resolution rendering image generated by the terminal-side image generation function 242 to be displayed on the display 230 as an image for which the rendering image during rotation needs to be updated (step S217).

[0073] On the other hand, in the medical image processing server 100, the determination function 146 determines the image data to be transmitted to the client terminal 200 based on the generation capacity information of the client terminal 200 acquired by the generation capacity acquisition function 145 (step S219). For example, when the determination function 146 determines that the client terminal 200 does not have the ability to generate a medium-resolution rendering image in terms of its image generation ability, it determines that there is no target image data.

[0074] For example, when the determination function 146 determines that the image generation ability of the client terminal 200 is equal to or greater than the ability to generate a medium-resolution rendering image and less than the ability to generate a high-resolution rendering image, it determines that the target image data is medium-resolution image data. For example, when the determination function 146 determines that the image generation ability of the client terminal 200 is equal to or greater than the ability to generate a medium-resolution rendering image and a high-resolution rendering image, it determines that the target image data is medium-resolution image data and high-resolution image data.

[0075] The determination function 146 transmits the determined target image data to the client terminal 200 (step S221). Since the target image data is data with a relatively large data volume, while the transmission of the target image data is in progress, the medical image processing server 100 and the client terminal 200 sequentially perform the following processes.

[0076] When a process that requires updating a rendering image such as rotation is completed, or when a rendering image with a medium resolution or higher is required, the image generation function 142 generates a medium-resolution rendering image based on the medium-resolution image data acquired by the image acquisition function 141 in the image generation function 142 (step S223). The image generation function 142 generates medium-resolution rendering image monitoring data that enables monitoring of the generated medium-resolution rendering image, and transmits it to the client terminal 200 (step S225).

[0077] The client terminal 200 that has received the medium-resolution rendering image monitoring data can be monitored by causing the display control function 243 to display the medium-resolution rendering image on the display 230 (step S227). The user can monitor the medium-resolution rendering image displayed on the display 230.

[0078] On the other hand, in the medical image processing server 100, when a rendering image with a high resolution or higher is required, such as when the medium-resolution rendering is completed, the image generation function 142 generates a high-resolution rendering image based on the high-resolution image data acquired by the generated image acquisition function 141 and the generated medium-resolution rendering image (step S229). The image generation function 142 generates high-resolution rendering image monitoring data that enables monitoring of the generated high-resolution rendering image, and transmits it to the client terminal 200 (step S231).

[0079] The client terminal 200 that has received the high-resolution rendering image monitoring data can be monitored by causing the display control function 243 to display the high-resolution rendering image on the display 230 (step S233). The user can monitor the high-resolution rendering image displayed on the display 230.

[0080] When the determination function 146 determines in step S219 that there is target image data and transmits the target image data, the generation of the rendering image by the image generation function 142 based on the image data corresponding to the target image data may be aborted. In this case, the transmission and reception of the monitoring data of the rendering image that has not been generated may be aborted.

[0081] The client terminal 200 that has received the target image data generates a target resolution rendering image based on the image data corresponding to the transmitted target image data in the terminal-side image generation function 242 (step S235). The generated target resolution rendering image is displayed on the display 230 by the display control function 243. The transmission control function 245 transmits the target resolution rendering image generated by the terminal-side image generation function 242 to the medical image processing server 100 (step S237). The medical image processing server 100 receives the transmitted target resolution rendering image. The medical image processing system 1 thus ends the processing shown in FIG. 7.

[0082] The medical image processing system 1 of the second embodiment has the same operational effects as the medical image processing system 1 of the first embodiment. Furthermore, the medical image processing system 1 of the second embodiment determines the target image data to be transmitted to the client terminal 200 based on the generation processing ability in the client terminal 200. Therefore, the generation ability in the client terminal 200 can be utilized more effectively, and the load on the server and network can be further reduced.

[0083] (Third Embodiment) Next, a third embodiment will be described. The medical image processing system 1 of the third embodiment has the same configuration as the medical image processing system 1 of the second embodiment. The medical image processing system 1 of the third embodiment is mainly different from the second embodiment in that when the client terminal 200 transmits activation information to the medical image processing server 100, it also transmits generation ability information and related points. In the third embodiment, the generation ability information transmitted by the client terminal 200 is information based on the generation ability of the client terminal 200 obtained before the low-resolution image data is generated. Hereinafter, the processing of the medical image processing system 1 of the third embodiment will be mainly described centering on the differences from the medical image processing system 1 of the second embodiment.

[0084] FIG. 8 is a sequence diagram showing an example of the processing flow in the medical image processing system 1 of the third embodiment. Similar to the second embodiment, a user who wants to start a diagnosis using a diagnostic application first performs an input operation to start the diagnostic application on the input interface 120 in the client terminal 200.

[0085] In response to the user's input operation, the client terminal 200 reads out and activates the diagnostic application 251 from the memory 250 by the activation control function 241 (step S301). When the diagnostic application is activated, the monitoring function 244 reads out the generation ability information 252 stored in the memory 250 (step S303). Subsequently, the transmission control function 245 transmits the application activation information generated by the activation control function 241 and the generation ability information read out by the monitoring function 244 to the medical image processing server 100 (step S305).

[0086] Upon receiving the application activation information and the generation ability information, the medical image processing server 100 reads out and acquires, from the three-dimensional image DB 151, the three-dimensional image data specified based on the three-dimensional image data provided to the client terminal 200 based on the application activation information in the image acquisition function 141 (step S307).

[0087] Subsequently, the data generation function 143 generates low-resolution image data based on the read three-dimensional image data (step S309). The data generation function 143 transmits the generated low-resolution image data toward the client terminal 200 that transmitted the activation information (step S311).

[0088] Subsequently, the determination function 146 determines the target image data to be generated based on the generation ability information acquired by the image acquisition function 141 (step S313). The data generation function 143 generates the target image data determined by the determination function 146 based on the read three-dimensional image data (step S313). When the read three-dimensional image data corresponds to the target image data, the determination function 146 uses the read three-dimensional image data as the target image data as it is. Thereafter, the medical image processing system 1 of the third embodiment performs the same processing as the medical image processing system 1 of the second embodiment and ends the processing shown in FIG. 8.

[0089] The medical image processing system 1 of the third embodiment has the same operational effects as the medical image processing system 1 of the second embodiment. Further, the medical image processing system 1 of the third embodiment determines the target image data to be transmitted to the client terminal 200 based on the generation ability information corresponding to the generation ability (specifications) of the client terminal 200. For this reason, it is possible to determine a processing amount suitable for the generation ability originally provided in the client terminal 200, and thus it is possible to effectively reduce the load on the medical image processing server 100 and the network NW.

[0090] (Fourth Embodiment) Next, the medical image processing system 1 of the fourth embodiment will be described. FIG. 9 is a block diagram showing an example of the configuration of the client terminal 200 of the fourth embodiment. The client terminal 200 of the fourth embodiment mainly differs from the first embodiment in that the control circuit 240 further includes a vector information processing function 246. Other points are common to the first embodiment.

[0091] In the medical image processing system 1 according to the fourth embodiment, in the data generation function 143, the medical image processing server 100 generates vector information based on three-dimensional image data as the data to be image-processed. The data generation function 143 is performed, for example, during preprocessing in the medical image processing server 100 or when various data are loaded.

[0092] The vector information is information extracted from the three-dimensional image data and can be used as a basis for drawing a processed image such as a rendering image. The medical image processing server 100 transmits the vector information generated by the data generation function 143 to the client terminal 200. The vector information may be generated by selecting sparse data and dense data according to the resolution of the three-dimensional image data or the like. The vector information may be generated and transmitted together with the low-resolution image data, or the generated vector information and the low-resolution data may be selected and transmitted.

[0093] The vector information processing function 246 provided in the client terminal 200 generates a wireframe or a polygon based on the vector information transmitted by the medical image processing server 100. The display control function 243 causes the wireframe or polygon generated by the vector information processing function 246 to be displayed on the display 230.

[0094] The medical image processing system 1 according to the fourth embodiment has the same operational effects as the medical image processing system 1 according to the first embodiment. Further, in the medical image processing system 1 according to the fourth embodiment, since vector information is generated and transmitted instead of the low-resolution image data, the load on the medical image processing server 100 and the network NW can be further reduced.

[0095] Also, in the rendering process, data with a light processing amount, such as low-resolution image data, and data with a heavy processing amount, such as high-resolution image data, may be rendered in the relationship shown in FIG. 10. FIG. 10 is a diagram showing an example of a mode of the rendering process of data with different processing amounts in the rendering process. By performing the rendering process in the relationship shown in FIG. 10, it is possible to easily and appropriately distribute the processing amount in the medical image processing server 100 and the processing amount in the client terminal 200.

[0096] (Fifth Embodiment) Next, the medical image processing system 1 of the fifth embodiment will be described. FIG. 11 is a block diagram showing an example of the configuration of the client terminal 200 of the fifth embodiment. The client terminal 200 of the fifth embodiment is mainly different from the first embodiment in that the control circuit 240 further includes a multi-planar reformat (MPR) image generation function 247.

[0097] The MPR image generation function 247 generates an MPR image based on the low-resolution image data transmitted by the medical image processing server 100. The display control function 243 causes the generated MPR image to be displayed on the display 230 together with the low-resolution rendering image generated by the display control function 243. The MPR image generation function 247 is an example of a third image generation unit.

[0098] The medical image processing system 1 of the fifth embodiment has the same operational effects as the medical image processing system 1 of the first embodiment. Further, in the medical image processing system 1 of the fifth embodiment, the client terminal 200 generates an MPR image based on the low-resolution image data in the MPR image generation function 247. Therefore, the load on the medical image processing server 100 and the network NW can be further reduced.

[0099] In the above embodiment, the image to be processed is a medical image, but an image other than the medical image may be the object of image processing.

[0100] According to at least one embodiment described above, the image processing apparatus includes an image acquisition unit that acquires three-dimensional image data, a first image generation unit that generates a first processed image based on the three-dimensional image data, a data generation unit that generates image processing target data having a smaller data volume than the three-dimensional image data, and a control unit that performs communication control to cause a terminal device to generate a second processed image based on the image processing target data and to display the second processed image on a display unit of the terminal device, thereby reducing the load on a server or a network.

[0101] Although some embodiments have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, as well as in the invention described in the claims and the equivalent scope thereof.

Description of Reference Numerals

[0102] 1 Medical image processing system 10 HIS 20 RIS 30 Modality 40 PACS 100 Medical image processing server 110, 210 Communication interface 120, 220 Input interface 130, 230 Display 140 Processing circuit 141 Image acquisition function 142 Image generation function 143 Data generation function 144 Control function 145 Generation ability acquisition function 146 Judgment function 150, 250 Memory 151 3D Image DB 200 Client Terminal 240 Control Circuit 241 Startup Control Function 242 Terminal-side Image Generation Function 243 Display Control Function 244 Monitoring Function 245 Transmission Control Function 246 Vector Information Processing Function 247 MPR Image Generation Function 251 Diagnostic Application 252 Generation Capacity Information H In-hospital System NW Network

Claims

1. An image acquisition unit that acquires three-dimensional image data, a first image generation unit that generates a first processed image based on the three-dimensional image data, a data generation unit that generates image processing target data having a smaller data amount than the three-dimensional image data, a control unit that performs communication control to generate a second processed image on a terminal device based on the image processing target data and transmit the image processing target data for displaying the second processed image on a display unit of the terminal device, An image processing apparatus.

2. The image processing target data includes low-resolution image data having a lower resolution than the three-dimensional image data, The image processing apparatus according to claim 1.

3. The three-dimensional image data includes medical image data, The image processing apparatus according to claim 2.

4. The second processed image has a lower resolution than the first processed image, The image processing apparatus according to claim 1.

5. A generation ability acquisition unit that acquires the generation ability of the terminal device for the processed image transmitted by the terminal device, The image processing apparatus according to claim 1, further comprising a determination unit that determines the image processing target data to be transmitted to the terminal device based on the generation ability. The image processing apparatus according to claim 1.

6. The determination unit determines the image processing target data based on the generation ability acquired before the image processing target data is generated, The image processing apparatus according to claim 5.

7. The image processing target data includes vector information extracted from the three-dimensional image data, The image processing apparatus according to claim 1.

8. The processed image includes a rendering image, The image processing apparatus according to claim 1.

9. A second image generation unit that generates the second processed image based on the image processing target data transmitted by the image processing apparatus according to claim 1, A terminal device, comprising a display control unit that causes the display unit to display the generated second processed image. A terminal device.

10. The display control unit causes the display unit to display the second processed image being processed, The terminal device according to claim 9.

11. A second image generation unit that generates the second processed image based on the image processing target data transmitted by the image processing apparatus according to claim 5, a display control unit that causes the display unit to display the generated second processed image, a monitoring unit that monitors the generation ability of the own device, A terminal device, comprising a transmission control unit that performs transmission control to transmit the generation ability to the image processing apparatus. A terminal device.

12. A second image generation unit that generates the second processed image based on the image processing data to be processed transmitted by the image processing apparatus according to claim 7; A display control unit that causes the display unit to display the generated second processed image, and The display control unit causes the display unit to display at least one of a wireframe or a polygon generated based on the vector information. A terminal device.

13. The terminal device according to claim 9, further comprising a third image generation unit that generates an arbitrary multi-section reconstruction image based on the image processing data to be processed. The terminal device according to claim 9.

14. An image processing system comprising the image processing apparatus according to claim 1 and The terminal device according to claim 9. An image processing system.

15. A computer Acquires three-dimensional image data, Generates a first processed image based on the three-dimensional image data, Generates image processing data to be processed having a smaller data amount than the three-dimensional image data, and Performs communication control to transmit, to the terminal device, the image processing data to be processed for generating a second processed image based on the image processing data to be processed and causing the second processed image to be displayed on the display unit of the terminal device. An image processing method.

16. A computer Generates the second processed image based on the image processing data to be processed transmitted by the image processing apparatus according to claim 1, and Causes the generated second processed image to be displayed on the display unit. An image processing method.

17. Causes a computer to Acquire three-dimensional image data, Generate a first processed image based on the three-dimensional image data, Generate image processing data to be processed having a smaller data amount than the three-dimensional image data, and Perform communication control to transmit, to the terminal device, the image processing data to be processed for generating a second processed image based on the image processing data to be processed and causing the second processed image to be displayed on the display unit of the terminal device. A program.

18. Causes a computer to Generate the second processed image based on the image processing data to be processed transmitted by the image processing apparatus according to claim 1, and Cause the generated second processed image to be displayed on the display unit. A program.

Images