Remote rendering method of DICOM images based on WebSocket

Abstract

The present invention discloses a DICOM image remote rendering method based on WebSocket, which uses a hardware device including a client and a server that adopts WebSocket connection communication to complete the following steps: a. The client sends a browsing request to the server; b. The server retrieves the DICOM image of the designated examination and returns the examination information; c. The client initializes the display window layout and sends the window size and layout parameters to the server; d. The server generates a simulation window on the server; e. The client sends an image display command to the server; f. The server renders the DICOM image into the simulation window; g. The server generates a snapshot image of the current simulation window and pushes the snapshot image to the client; h. The client refreshes the display window and displays the snapshot image. The DICOM image remote rendering method based on WebSocket obtained by the present invention reduces the requirements for network speed and bandwidth, greatly reduces the memory occupied, better adapts to the actual equipment of medical institutions, ensures stable operation of the client, and improves the efficiency of diagnosis and treatment.

Description

Technical Field

[0001] The invention relates to an image display method, in particular to a DICOM image remote rendering method based on WebSocket. Background Art

[0002] With the rise of the concept of Internet digital film, there is an increasing demand for online DICOM image reading. Patients can view the radiological images of their hospital examinations online by scanning QR codes, and doctors can also perform remote imaging diagnosis through the Internet.

[0003] Currently, the web-based DICOM image browsing technology on the market all uses the method of transferring the original DICOM image file to the user's web browser, and then parsing the file and displaying the image on the browser. This processing method has the following problems:

[0004] 1) This method is limited by network transmission speed. Insufficient network speed and bandwidth on the server or client side will cause image browsing to be stuck, affecting user experience.

[0005] 2) The processing and computing performance of the browser is far behind that of the physical machine. Therefore, if you need to display some large images such as DX, MG, etc., it will take a long time to parse the file. Some images may even be unable to be displayed due to the maximum size limit of the browser-side Canvas.

[0006] 3) Since the memory management on the browser side cannot be controlled by Javascript scripts, if a large number of images are browsed and the client machine has insufficient memory configuration, it is easy to cause the browser to crash during the browsing process. At the same time, due to excessive memory usage, it will also cause low-configuration devices in medical institutions to freeze, affecting the viewing efficiency of both doctors and patients. Summary of the invention

[0007] The purpose of the present invention is to solve the above-mentioned deficiencies of the prior art and to provide a DICOM image remote rendering method based on WebSocket that saves network and hardware resources and improves loading efficiency.

[0008] In order to achieve the above object, the present invention is designed to implement a DICOM image remote rendering method based on WebSocket, which includes using a hardware device including a client and a server that use WebSocket connection communication to complete the following steps:

[0009] a. The client sends a request to the server to browse the DICOM images of the specified examination;

[0010] b. The server retrieves the DICOM image of the specified examination from the database based on the received request, extracts the examination information of the examination and returns it to the client;

[0011] c. The client initializes the layout of the display window according to the returned inspection information and the preset layout parameters corresponding to the inspection information, and sends the initialized window size and layout parameters to the server;

[0012] d. The server generates a simulated window on the server according to the received window size and layout parameters;

[0013] e. The client sends an image display command to the server, specifying the unique serial number of the DICOM image to be displayed;

[0014] f. The server renders the DICOM images in the specified sequence into the simulation window generated in step d according to the unique sequence number;

[0015] g. The server generates a snapshot image of the current simulation window and pushes the snapshot image to the client;

[0016] h. After receiving the snapshot image, the client refreshes the display window and displays the snapshot image.

[0017] In order to realize the operations of zooming in and out, selecting and moving DICOM images, this method also includes the method of operating the client image using input devices such as mouse, keyboard, touch screen, etc.:

[0018] i. The client has a variety of preset operating tools, and the server has background tools corresponding to the operating tools. The user specifies the operating tool to be used on the client, and the client sends an activation tool command to the server;

[0019] j. After receiving the activation tool command, the server activates the corresponding background tool in the simulation window;

[0020] k. The user uses the operation tool through the input device, and the client passes the user's operation behavior to the server as the front-end event parameter;

[0021] l. Based on the front-end event parameters, the back-end tool on the server performs corresponding operations on the DICOM images in the simulation window;

[0022] m. The server pushes the snapshot image of the simulated window after the operation to the client;

[0023] n. After receiving the snapshot image, the client refreshes the display window and displays the snapshot image.

[0024] To facilitate image processing, the snapshot image is in JPEG format.

[0025] The DICOM image remote rendering method based on WebSocket obtained by the present invention adopts the form of transmitting snapshot images instead of the original DICOM image file transmission and rendering, which greatly reduces the transmission traffic, and puts the DICOM image rendering on the server side, which improves the processing efficiency and reduces the requirements for network speed and bandwidth. At the same time, WebSocket connection is used for full-duplex real-time communication to ensure the real-time transmission. Since the snapshot image itself is small in size, the memory occupied when rendering in the client browser is greatly reduced, so it can better adapt to the actual equipment of the medical institution, ensure the stable operation of the client, and improve the diagnosis and treatment efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a timing diagram of rendering image display in the DICOM image remote rendering method based on WebSocket of the present invention;

[0027] Figure 2 The present invention is a flowchart of an input device operating a client image in a DICOM image remote rendering method based on WebSocket. DETAILED DESCRIPTION

[0028] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the specific implementation mode, structure, characteristics and effects of the present invention are described in detail below in combination with the accompanying drawings and preferred embodiments.

[0029] Embodiment 1:

[0030] The DICOM image remote rendering method based on WebSocket described in this embodiment is as follows: Figure 1 As shown, it includes using a hardware device that includes a client and a server that communicate using a WebSocket connection to complete the following steps:

[0031] a. The client sends a request to the server to browse the DICOM images of the specified examination; in actual use, each patient will generate multiple DICOM images after the examination, each study contains multiple series, each series contains a group of images, and the images contained in each sequence are usually continuous tomographic images of a certain part of the patient's body or images of the same tomographic part at different times; the aforementioned patient, study, series and image are all represented in coded form and stored in the DICOM file; sending a request in step a means that the client specifies the corresponding patient and study information to the server.

[0032] b. The server retrieves the DICOM image of the designated examination from the database according to the received request, extracts the examination information of the examination and returns it to the client; in this embodiment, the returned examination information is a unique number representing the study and the series, which can be a globally unique identifier assigned to the study and series by the server software system in actual implementation, or the Study Instance UID and Series Instance UID in the DICOM file can be used; after obtaining the examination information, the client can identify the type of the examination designated in step a and the series to be viewed, thereby knowing the layout that needs to be initialized in step c;

[0033] c. The client initializes the layout of the display window according to the returned examination information and the preset layout parameters corresponding to the examination information, and sends the initialized window size and layout parameters to the server; the layout parameters of the display window are set according to the viewing habits of doctors and patients during diagnosis and treatment. For example, if it is a Tianzi layout, four display windows in the Tianzi layout are presented in the client window, and the initialized window size is the size of each display window;

[0034] d. The server generates a simulated window on the server according to the received window size and layout parameters;

[0035] e. The client sends an image display command to the server, specifying the unique serial number of the DICOM image to be displayed; the unique serial number is the globally unique identifier of the series in step b or the SeriesInstance UID in the DICOM file, and the actual type used corresponds to step b;

[0036] f. The server renders the DICOM image under the specified sequence into the simulation window generated in step d according to the sequence unique number; that is, renders the image under the specified sequence into the simulation window;

[0037] g. The server generates a snapshot image of the current simulation window and pushes the snapshot image to the client; an image push thread is set on the server to monitor the image refresh in the simulation window. When the simulation window changes, the snapshot image of the changed simulation window is automatically pushed;

[0038] h. After receiving the snapshot image, the client refreshes the display window and displays the snapshot image.

[0039] In order to realize the operations of zooming in and out, selecting, moving, rotating, etc. on DICOM images, Figure 2 As shown, this method also includes a method for operating the client image using input devices such as a mouse, keyboard, and touch screen:

[0040] i. The client has a variety of preset operating tools, and the server has background tools corresponding to the operating tools. The user specifies the operating tool to be used on the client, and the client sends an activation tool command to the server;

[0041] j. After receiving the activation tool command, the server activates the corresponding background tool in the simulation window; for example, a mouse zoom tool is provided on the client, and the same background tool for simulating mouse zoom is provided in the simulation window of the server. When the client specifies to use the mouse zoom tool, the client simultaneously sends an activation tool command to activate the background tool for simulating mouse zoom on the server;

[0042] k. The user uses the operation tool through the input device, and the client passes the user's operation behavior to the server as the front-end event parameter;

[0043] l. Based on the front-end event parameters, the back-end tool on the server performs corresponding operations on the DICOM images in the simulation window; in actual operation, the front-end event parameters sent by the client are converted into back-end event parameters on the server, and the back-end tool operates according to the back-end event parameters;

[0044] m. The server pushes the snapshot image of the simulated window after the operation to the client;

[0045] n. After receiving the snapshot image, the client refreshes the display window and displays the snapshot image.

[0046] To facilitate image processing, the snapshot image is in JPEG format.

[0047] The WebSocket-based DICOM image remote rendering method provided in this embodiment adopts the form of transmitting snapshot images instead of transmitting and rendering the original DICOM image files, which greatly reduces the transmission traffic. The DICOM image rendering is placed on the server side, which improves the processing efficiency and reduces the requirements for network speed and bandwidth. At the same time, WebSocket connection is used for full-duplex real-time communication to ensure the real-time transmission. Since the snapshot image itself is small in size, the memory occupied when rendering in the client browser is greatly reduced. Therefore, it can better adapt to the actual equipment of medical institutions, ensure the stable operation of the client, and improve the efficiency of diagnosis and treatment.

[0048] The above description is only a preferred embodiment of the present invention and does not limit the present invention in any form. Although the present invention has been disclosed as a preferred embodiment as above, it is not used to limit the present invention. Any technical personnel in this field can make some changes or modify the technical contents disclosed above into equivalent embodiments without departing from the scope of the technical solution of the present invention. However, any brief modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention without departing from the content of the technical solution of the present invention are still within the scope of the technical solution of the present invention.

Claims

1. A DICOM image remote rendering method based on WebSocket, characterized in that: Using a hardware device that contains a client and server that communicate using a WebSocket connection, complete the following steps: a. The client sends a request to the server to browse the DICOM images of the specified examination; b. The server retrieves the DICOM image of the specified examination from the database based on the received request, extracts the examination information of the examination and returns it to the client; c. The client initializes the layout of the display window according to the returned inspection information and the preset layout parameters corresponding to the inspection information, and sends the initialized window size and layout parameters to the server; d. The server generates a simulated window on the server according to the received window size and layout parameters; e. The client sends an image display command to the server, specifying the unique serial number of the DICOM image to be displayed; f. The server renders the DICOM images in the specified sequence into the simulation window generated in step d according to the unique sequence number; g. The server generates a snapshot image of the current simulation window and pushes the snapshot image to the client; h. After receiving the snapshot image, the client refreshes the display window and displays the snapshot image; i. The client has a variety of preset operating tools, and the server has background tools corresponding to the operating tools. The user specifies the operating tool to be used on the client, and the client sends an activation tool command to the server; j. After receiving the activation tool command, the server activates the corresponding background tool in the simulation window; k. The user uses the operation tool through the input device, and the client passes the user's operation behavior to the server as the front-end event parameter; l. Based on the front-end event parameters, the back-end tool on the server performs corresponding operations on the DICOM images in the simulation window; m. The server pushes the snapshot image of the simulated window after the operation to the client; n. After receiving the snapshot image, the client refreshes the display window and displays the snapshot image; The snapshot image is in JPEG format.

Images