Medical imaging device, method of interacting with the device, apparatus, and storage medium

By simultaneously displaying the same medical image on monitors in the control room and operating room of the medical imaging equipment and displaying location marker information in areas of common interest, communication and understanding barriers between users are resolved, enabling efficient sharing of images and text and reducing radiation damage.

CN116092659BActive Publication Date: 2025-11-28BEIJING NEUSOFT MEDICAL EQUIP CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211659097.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-12-22
Publication Date
2025-11-28
Estimated Expiration
2042-12-22

AI Technical Summary

Technical Problem

There are significant communication and comprehension barriers between users in the control room and operating room of medical imaging equipment. Existing technologies such as voice devices, remote control laser pointers, and adding display devices and cameras have problems with insufficient accuracy or high cost.

Method used

By displaying the same medical image on monitors in the control room and operating room, and synchronously displaying positioning marker information in the common area of ​​interest, the system utilizes a pixel difference algorithm to achieve real-time synchronization of the cursor and drawing, and leverages the interactive methods of medical imaging equipment to reduce frequent user movement and radiation hazards.

Benefits of technology

It improves communication efficiency between the control room and the operating room, reduces radiation damage between users, and enhances the ease of use and accuracy of communication for medical imaging equipment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116092659B_ABST
    Figure CN116092659B_ABST
Patent Text Reader

Abstract

The application discloses a medical imaging device, an interaction method and device of the medical imaging device, and a storage medium. A first medical image is displayed on a display in a control room, a second medical image is displayed on a display in an operating room, and the first medical image and the second medical image are the same medical image formed by radiation emitted by the medical imaging device to an examination site. Further, positioning mark information is synchronously displayed at a common attention area of the first medical image and the second medical image. Through the positioning mark information, a user in the control room is reminded to know an interested area viewed by a user in the operating room, or a user in the operating room is reminded to know an interested area viewed by a user in the control room, so that the users in the control room and the operating room respectively view the common attention area. The interaction method based on the medical imaging device can effectively improve the communication efficiency between the operating room and the control room.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of medical equipment, and in particular to a medical imaging device, an interaction method and device of the medical imaging device, and a storage medium. BACKGROUND

[0002] With the development of medical imaging technology, some primary hospitals begin to carry out medical imaging device examination projects. Sometimes, experts need to be hired to guide medical staff in the operating room on site in the control room; sometimes, during clinical teaching, attending physicians will teach in the operating room, and learners will observe and learn in the control room. Whether it is on-site guidance or clinical teaching, users in the operating room and the control room need to communicate with each other.

[0003] In the related art, the operating room user and the control room user communicate and discuss the specific situation of the examination site in a voice manner with the help of a voice device.

[0004] However, in the related art, the operating room user and the control room user need to describe the area of interest in language, which may cause communication and understanding barriers. Therefore, the interaction between the operating room and the control room of the medical imaging device needs to be improved. SUMMARY

[0005] The embodiments of the present specification aim to solve at least one of the technical problems in the related art. To this end, a first object of the embodiments of the present specification is to provide a medical imaging device, an interaction method and device of the medical imaging device, and a storage medium.

[0006] The embodiments of the present specification provide an interaction method of a medical imaging device, the method comprising:

[0007] displaying a first medical image on the control room display and displaying at least part of a second medical image on the operating room display; wherein the first medical image and the second medical image are the same medical image formed by the medical imaging device emitting radiation rays to an examination site;

[0008] synchronously displaying positioning marker information at a common attention area of the first medical image and the second medical image; wherein the common attention area is an image area that needs to be viewed by users in the control room and the operating room at the same time; and the positioning marker information is used to visually prompt the users in the control room and the operating room to view the common attention area at the same time. The embodiments of the present specification provide an interaction device of a medical imaging device, the device comprising:

[0009] The medical image display module is configured to display a first medical image on the display in the control room and display at least part of a second medical image on the display in the operating room, wherein the first medical image and the second medical image are the same medical image formed by the medical imaging device emitting radiation to the examination site.

[0010] The region of interest determination module is configured to synchronously display positioning marker information at a common region of interest of the first medical image and the second medical image, wherein the common region of interest is an image region that needs to be viewed by users in the control room and the operating room simultaneously, and the positioning marker information is used to visually prompt the users in the control room and the operating room to view the common region of interest simultaneously.

[0011] The medical imaging device provided in the embodiments of the present specification includes a memory and one or more processors in communication connection with the memory, and the memory stores instructions executable by the one or more processors, and the instructions are executed by the one or more processors to enable the one or more processors to implement the steps of the method according to any one of the embodiments described above.

[0012] The embodiments of the present specification provide a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the steps of the method according to any one of the embodiments described above.

[0013] The embodiments of the present specification provide a computer program product, which includes instructions, and the instructions are executed by a processor of a computer device to enable the computer device to perform the steps of the method according to any one of the embodiments described above.

[0014] In the embodiments of the present specification, the first medical image is displayed on the display in the control room, the second medical image is displayed on the display in the operating room, and the first medical image and the second medical image are the same medical image formed by the medical imaging device emitting radiation to the examination site. Further, positioning marker information is synchronously displayed at a common region of interest of the first medical image and the second medical image. Through the positioning marker information, a user in the control room is reminded of a region of interest viewed by a user in the operating room, or a user in the operating room is reminded of a region of interest viewed by a user in the control room, so that the users in the control room and the operating room both view the common region of interest. Through the interactive method of the medical imaging device described above, the communication efficiency between the operating room and the control room can be effectively improved. BRIEF DESCRIPTION OF DRAWINGS

[0015] Figure 1aAn application scenario diagram of the interaction method of the medical imaging device provided in the embodiments of the present disclosure is shown.

[0016] Figure 1b A flow diagram of the interaction method of the medical imaging device provided in the embodiments of the present disclosure is shown.

[0017] Figure 2a A diagram of the synchronization marker switch control provided in the embodiments of the present disclosure is shown.

[0018] Figure 2b A diagram of the synchronization display of the cursor movement provided in the embodiments of the present disclosure is shown.

[0019] Figure 2c A diagram of the synchronization display of the cursor movement provided in the embodiments of the present disclosure is shown.

[0020] Figure 3a A diagram of the synchronization display of the drawing marker provided in the embodiments of the present disclosure is shown.

[0021] Figure 3b A diagram of the synchronization display of the drawing marker provided in the embodiments of the present disclosure is shown.

[0022] Figure 4 A diagram of the synchronization marker switch control in the closed state provided in the embodiments of the present disclosure is shown.

[0023] Figure 5a A diagram of the shortcut marker control region provided in the embodiments of the present disclosure is shown.

[0024] Figure 5b A diagram of the shortcut marker selection provided in the embodiments of the present disclosure is shown.

[0025] Figure 5c A diagram of the shortcut marker control region provided in the embodiments of the present disclosure is shown.

[0026] Figure 6a A diagram of the cursor asynchronous display provided in the embodiments of the present disclosure is shown.

[0027] Figure 6b A diagram of the cursor asynchronous display provided in the embodiments of the present disclosure is shown.

[0028] Figure 7 A flow diagram of the synchronization display of the positioning marker information provided in the embodiments of the present disclosure is shown.

[0029] Figure 8 A flow diagram of the interaction method of the medical imaging device provided in the embodiments of the present disclosure is shown.

[0030] Figure 9A flowchart of an interaction method of a medical imaging device provided for an embodiment of the present specification.

[0031] Figure 10 A schematic diagram of an interaction device of a medical imaging device provided for an embodiment of the present specification. DETAILED DESCRIPTION

[0032] Embodiments of the present application are described in detail below with reference to examples thereof illustrated in the attached drawings, in which like or similar designations denote like or similar elements or components throughout the drawings. The embodiments described below through reference to the drawings are illustrative in all aspects and are intended to explain the present application, and cannot be understood as limiting the present application.

[0033] In the related art, for implementing an interaction method of a medical imaging device, communication can be performed through a voice device, communication can be performed through a remote controller laser pen external auxiliary voice device, or communication can be performed through a display device and a camera added in a surgery room and a control room respectively, and a picture taken by the camera of the other party is displayed on the display to display the visual angle of the other party to assist the voice device in communication.

[0034] However, in the voice device-based mode, a specific position or a meaningful lesion area cannot be accurately positioned, so that users in the surgery room and the control room cannot accurately understand the meaning expressed by the other party, resulting in communication understanding barriers. In the remote controller laser pen-based mode, on the one hand, when the back of the display in the surgery room faces the control room, the remote controller laser pen cannot be used to assist the voice device in communication. On the other hand, when the user in the control room uses the remote controller laser pen, if the distance is too far, the desired effect cannot be achieved. In the mode of adding a display device and a camera, not only more space in the surgery room is occupied, but also the cost is increased.

[0035] Therefore, an interaction method of a medical imaging device is provided in an embodiment of the present specification. The medical imaging device includes a display for a control room and a display for a surgery room. A first medical image is displayed on the display for the control room, and a second medical image is displayed on the display for the surgery room. The first medical image and the second medical image are the same medical image formed by the medical imaging device emitting radiation rays to an examination site. Further, a positioning marker information is synchronously displayed at a common attention area of the first medical image and the second medical image. Through the positioning marker information, a user in the control room is reminded to know a region of interest viewed by a user in the surgery room, or a user in the surgery room is reminded to know a region of interest viewed by a user in the control room, so that the users in the control room and the surgery room respectively view the common attention area.

[0036] The interaction method of the medical imaging device provided in an embodiment of the present specification can be applied to Figure 1aIn the application scenario, the medical imaging device can be a digital subtraction angiograph (DSA) 110 in Figure 1a A medical worker performs a surgical operation in an operating room 120 in Figure 1a Guidance and learning personnel observe and learn in a control room 130 in Figure 1a The operating room and the control room are separated by a front glass 140 in Figure 1a The operating room 120 is equipped with an operating room display 150, and the control room is equipped with a control room display 160. A user in the operating room 120 implements functions such as marking and drawing of medical images through a remote control device 170 in Figure 1a A user in the control room 130 can perform functions such as marking and drawing of medical images through a mouse 180 in Figure 1a Further, the operating room and the control room can each add a camera to image capture the user in the control room and the user in the operating room, display image data captured by the operating room camera in the control room, and display image data captured by the control room camera in the operating room to display the perspective of the other party.

[0037] It can be understood that the medical imaging device can be a medical imaging device with a radiation source. It can be any one of a digital radiography (DR), a mobile digital radiography (Mobile-DR), a digital breast tomosynthesis (DBT), a C-arm X-ray device, or a digital subtraction angiograph (DSA), a CT device (Computed Tomography), or any other suitable medical imaging device.

[0038] The embodiments of the present specification provide an interaction method of a medical imaging device, please refer to Figure 1b The interaction method of the medical imaging device can include the following steps:

[0039] S110, display a first medical image on the control room display and display at least part of a second medical image on the operating room display.

[0040] The first medical image and the second medical image are the same medical image formed by a medical imaging device emitting radiation rays to an examination site. The medical imaging device includes a radiation source that emits radiation rays during operation of the medical imaging device. The radiation rays can penetrate the human body, and the penetrated human tissue structures have differences in density and thickness. Therefore, the degree of absorption of the radiation rays is different when penetrating different tissues of the human body, so that the remaining radiation rays are different. After the different remaining radiation rays undergo a developing process, such as an X-ray film, a screen, etc., a medical image with black and white contrast and level differences can be obtained. However, the medical imaging device with the radiation source can produce radiation, which can cause unnecessary damage to the bodies of medical workers. Therefore, in order to reduce the radiation impact on the bodies of medical workers, a lead glass that prevents radiation is used to divide the operating room and the control room. The lead glass that prevents radiation prevents the medical workers in the control room from being harmed by radiation.

[0041] In addition, the medical image is saved in a RAW format (RAW Image Format) in the storage unit. The RAW is an image format that is not processed or compressed. The operating room display and the control room display are different display devices of the same host computer. The operating room display can be an extended display screen of the control room display, or a duplicated display screen of the control room display.

[0042] Specifically, when the examination site of the patient enters the detection area range of the medical imaging device, the medical imaging device completes the preparation for photography, and the radiation source starts to emit radiation rays to the examination site. When the medical imaging device is exposed to stability, the medical imaging device saves the collected medical image to the host computer. The control room display and the operating room display read the data source of the medical image stored in the host storage unit, and then convert the read medical image data source to an image format through the image processing software respectively arranged on the control room display and the operating room display, and present the image on the display. The medical image displayed on the control room display is referred to as the first medical image, and the medical image displayed on the operating room display is referred to as the second medical image. Further, part or all of the second medical image can be displayed on the operating room display. For example, in response to a zoom operation on the common attention area, the second medical image in the common attention area is displayed on the operating room display.

[0043] S120, synchronously display the positioning mark information at the common attention area of the first medical image and the second medical image.

[0044] The common attention region is an image region that needs to be viewed by users in the control room and the operating room simultaneously. The positioning marker information is used to visually prompt users in the control room and the operating room to view the common attention region. The positioning marker information can be a moving cursor or a drawing marker displayed on the display, and the positioning marker information is instant feedback provided to the user on their operation on the element in the interface. The region in the first medical image and the second medical image where the positioning marker information is located can be the common attention region, which needs to be viewed by users in the control room and the operating room simultaneously. The common attention region can be a lesion region that needs to be focused on by the learning personnel in the control room during the surgical teaching process or a region that needs to be explained by the attending physician in the operating room, or a region that needs to be focused on by the operating personnel in the operating room when the expert in the control room is guiding.

[0045] Specifically, by moving the cursor or drawing the marker on any one of the display in the control room or the display in the operating room (denoted as display A), the cursor on the other display (denoted as display B) will move synchronously or draw the marker synchronously. The region in the display A and the display B where the drawing marker is drawn or the region outlined by the mouse movement is the region that needs to be focused on by the user in the operating room and the user in the control room, which is the common attention region of the first medical image and the second medical image.

[0046] It should be noted that the positioning marker information displayed in the common attention region of the first medical image and the positioning marker information displayed in the common attention region of the second medical image can use the same marker. Exemplarily, the cursor in the display in the operating room can be a cursor pattern (such as a control consistent with the appearance of the cursor), and the cursor in the display in the control room is a real cursor. Exemplarily, the cursor in the display in the control room can be a cursor pattern, and the cursor in the display in the operating room is a real cursor.

[0047] The positioning marker information displayed in the common attention region of the first medical image and the positioning marker information displayed in the common attention region of the second medical image can use different markers. Exemplarily, the cursor in the display in the operating room can be a non-cursor pattern (such as a control different from the appearance of the cursor), and the cursor in the display in the control room is a real cursor. Exemplarily, the cursor in the display in the operating room is a real cursor, and the cursor in the display in the control room can be a non-cursor pattern.

[0048] In the above-mentioned medical imaging device interaction method, the first medical image is displayed on the control room display, the second medical image is displayed on the operating room display, and the first medical image and the second medical image are the same medical image formed by the medical imaging device emitting radiation rays to the examination site. Further, the positioning marker information is synchronously displayed at the common attention area of the first medical image and the second medical image, reminding the user in the control room to know the region of interest viewed by the user in the operating room through the positioning marker information, or reminding the user in the operating room to know the region of interest viewed by the user in the control room, so that the users in the control room and the operating room respectively view the common attention area. Through the above-mentioned medical imaging device interaction method, on the one hand, the communication efficiency between the operating room and the control room is effectively improved through the positioning marker information, so that the medical staff can realize real-time sharing of images and texts when communicating. On the other hand, the frequent flow of users between the control room and the operating room is reduced, which not only reduces the radiation damage to the users, but also improves the use convenience of the medical imaging device.

[0049] In some embodiments, referring to Figure 2a , the display page of the first medical image has a synchronous marker switch control 202; synchronously displaying the positioning marker information can include the following steps: in the case that the synchronous marker switch control is in an open state, the cursor on the first medical image and the cursor pattern on the second medical image are synchronously moved in response to the cursor moving operation occurring on the first medical image; or, in the case that the synchronous marker switch control is in the open state, the cursor on the second medical image and the cursor pattern on the first medical image are synchronously moved in response to the cursor moving operation occurring on the second medical image.

[0050] The state change of the synchronous marker switch can be changed through the synchronous marker switch control on the first medical image display page.

[0051] Specifically, in the case that the synchronous marker switch control is in the open state, the cursors on the first medical image and the second medical image can be synchronously moved in real time. The user in the control room realizes the cursor moving operation on the first medical image by moving the mouse, and in response to the cursor moving operation on the first medical image, the marker pixel coordinates of the cursor on the second medical image can be calculated through the pixel difference value algorithm, so as to realize synchronous cursor moving on the same position of the second medical image and the first medical image; the user in the operating room realizes the cursor moving operation on the second medical image through the mouse function on the remote control device, and in response to the cursor moving operation on the second medical image, the marker pixel coordinates of the cursor on the first medical image can be calculated through the pixel difference value algorithm, so as to realize synchronous cursor moving on the same position of the first medical image and the second medical image.

[0052] Exemplarily, refer to FIG. 1. A display 210 in the control room is a display for the control room, and a display 220 in the operating room is a display for the operating room. The display 210 in the control room displays a first medical image, and the display 220 in the operating room displays a second medical image. When the synchronization mark switch control is in an open state, a cursor 230 on the first medical image moves in a position of the second medical image, and a cursor pattern 240 in the second medical image moves synchronously in the same position; or refer to FIG. 2. When a cursor 250 on the second medical image moves in a position of the first medical image, a cursor pattern 260 in the first medical image moves synchronously in the same position. Figure 2b . Figure 2b Figure 2b Figure 2b Figure 2b Figure 2c Figure 2c Figure 2c

[0053] In the above-mentioned medical imaging device interaction method, when the synchronization mark switch control is in an open state, the cursor movement information is synchronously displayed. By synchronously displaying the cursor movement information, ambiguity of voice interaction between the user in the operating room and the user in the control room can be reduced.

[0054] In some embodiments, the display page of the first medical image has a synchronization mark switch control; and synchronously displaying the positioning mark information can include the following steps: in a case where the synchronization mark switch control is in an open state, in response to a drawing mark event occurring on the first medical image, synchronously displaying drawing mark content generated by the drawing mark event on the first medical image and the second medical image; or in a case where the synchronization mark switch control is in an open state, in response to a drawing mark event occurring on the second medical image, synchronously displaying drawing mark content generated by the drawing mark event on the first medical image and the second medical image.

[0055] ​​​​​​​Specifically, when the synchronization marker switch control is in the on state, the drawing marker events on the first and second medical images can be synchronized in real time. Users in the control room can move the mouse to trigger drawing marker events on the first medical image. In response to these events, a pixel difference algorithm is used to obtain the pixel coordinates of the drawing markers on the second medical image. The converted pixel coordinate set is then parsed, and the corresponding drawing strokes are displayed based on the parsed set. Drawing markers are synchronously performed at the same positions on both the second and first medical images. Similarly, users in the operating room can use the air mouse function on the remote control device to trigger drawing marker events on the second medical image. In response to these events, a pixel difference algorithm is used to obtain the pixel coordinates of the drawing markers on the first medical image. The converted pixel coordinate set is then parsed, and the corresponding drawing strokes are displayed based on the parsed set. Drawing markers are synchronously performed at the same positions on both the second and first medical images.

[0056] For example, please refer to Figure 3a . Figure 3a The monitor 310 is a monitor for use in the control room. Figure 3a The monitor 320 is for use in the operating room. The control room monitor 310 displays a first medical image, and the operating room monitor 320 displays a second medical image. When the synchronization marker switch control is on, the drawing markers 330 on the first medical image... Figure 3a When the location is marked with a drawing, the same location will appear in the second medical image. Figure 3a The drawing markers 340 in the middle are drawn synchronously; or please refer to Figure 3b The second medical image has 350 painted markings. Figure 3b When marking the location with a drawing, the same location in the first medical image will have... Figure 3b The drawing markers on the control room monitor can be drawn synchronously at 360 degrees. For example, the drawing markers on the control room monitor can be drawn freely on the canvas by pressing the left mouse button and then moving the mouse; a straight line can be drawn on the canvas by pressing the Shift key and pressing the left mouse button at the same time and then moving the mouse; in the operating room, the operation of pressing the Shift key and the left mouse button at the same time can be achieved by using the air mouse function and the assistance of the buttons to draw a straight line on the canvas.

[0057] In the interaction method of the aforementioned medical imaging equipment, when the synchronization marker switch control is in the on state, the drawing marker event is displayed synchronously. This allows for precise location of specific areas or meaningful lesions, reducing communication and comprehension barriers.

[0058] In some embodiments, the display page of the first medical image has a synchronous marking switch control; the synchronous display of the positioning marking information comprises: in response to the closing operation of the synchronous marking switch control, the drawing marking content on the first medical image and the second medical image is synchronously cleared.

[0059] Specifically, the display page of the first medical image has a synchronous marking switch control. When the synchronous marking switch control changes from the on state to the off state, in response to the closing operation of the synchronous marking switch control, the control room display and the operating room display automatically exit the drawing board function, and after the drawing board function is exited, the drawing marking content on the first medical image and the second medical image is automatically cleared. For example, refer to Figure 4 , the control room display 310 displays the display page of the first medical image with a synchronous marking switch control 202, and after the control room user clicks the synchronous marking switch control 202, the drawing marking content displayed on the control room display 310 and the operating room display 320 is synchronously cleared.

[0060] In the above-mentioned interactive method of the medical imaging device, when the synchronous marking switch control is in the off state, the drawing marking content on the first medical image and the second medical image is synchronously cleared. Not only can the operation of erasing by the operating room user and the control room user be reduced, but also the workload of the user is reduced. Moreover, without the need for interaction, the operation of the control room user and the operating room user does not interfere with each other.

[0061] In some embodiments, the display page of the first medical image has a synchronous marking switch control; the synchronous display of the positioning marking information comprises: in response to the setting operation of the display style of the drawing marking content, the display style of the drawing marking content is updated.

[0062] Specifically, when the synchronous marking switch control is in the on state, the change of the display style is performed through the setting on the display page of the medical image, and in response to the setting operation of the display style of the drawing marking content, the display style of the drawing marking content on the medical image of the display is updated.

[0063] In some embodiments, refer to Figure 5a , the region 502 of the shortcut marking control in Figure 5a can be used to perform shortcut marking on the region of interest in the medical image, such as a five-pointed star, a rhombus, and the like. For example, refer to Figure 5bIf the control room user wants the operating room user to focus on the area 503, the control room user can select any shape of the marker pattern from the shortcut marker control area 502 to the area 503. For example, in some embodiments, the control room user can drag a five-pointed star to the area 503, and in other embodiments, the control room user can click the five-pointed star in the shortcut marker control area 502, press the left mouse button on the area, and draw the five-pointed star by moving the mouse to remind the operating room user that the control room user needs the operating room user to view the area. It should be noted that the display page of the first medical image and the display page of the second medical image can each have a shortcut marker control area. If the operating room user wants the control room user to focus on any area, the operating room user can also drag any shape of the marker pattern from the shortcut marker control area 502 to the area to remind the control room user that the operating room user needs the control room user to view the area.

[0064] In other embodiments, referring to Figure 5c , the control room user can change the drawing marker content color by using the color setting control 504 in Figure 5c , such as a yellow five-pointed star, a red diamond, a blue quadrilateral, etc. Medical images are generally black and white images, and the drawing marker can be made more obvious by changing the color and thickness of the line. The color of the line can be changed by using the color setting control 504 in Figure 5c , and the thickness of the line can be set by using the line setting control 506 in Figure 5c , such as a 6pt red line, an 8pt yellow line, etc. The shortcut key can be changed by using the setting control 508 in Figure 5c , and drawing a straight line can be changed to directly pressing the left mouse button, and double-clicking the mouse can be used to freely draw on the canvas. The mouse can be the real mouse of the control room or the mouse function of the remote control device of the operating room. In the above-mentioned medical imaging device interaction method, the display style of the drawing marker content is updated in response to the display style setting operation of the drawing marker content. By updating the display style of the drawing marker content, the user on one side can provide timely feedback on the operation needed by the user on the other side.

[0065] In some embodiments, the display page of the first medical image has a synchronous marker switch control. The method further includes one of the following: in the case where the synchronous marker switch control is in the off state, in response to a cursor movement operation occurring on the first medical image, the cursor on the first medical image moves, and there is no cursor pattern on the second medical image; or in the case where the synchronous marker switch control is in the off state, in response to a cursor movement operation occurring on the second medical image, the cursor on the second medical image moves, and there is no cursor pattern on the first medical image.

[0066] Specifically, when the synchronization marker switch control is in the off state, the cursors on the first and second medical images will not be synchronized in real time. Users in the control room move the cursor on the first medical image by moving the mouse; in response to this movement, the cursor on the first medical image moves, but the cursor on the second medical image does not move and therefore cannot be observed. Similarly, users in the operating room move the cursor on the second medical image using the air mouse function on the remote control device; in response, the cursor on the second medical image moves, but the cursor pattern is not displayed on the first medical image.

[0067] For example, please refer to Figure 6a . Figure 6a The monitor 610 in the text is a monitor for use in the control room. Figure 6a The monitor 620 is for use in the operating room. The control room monitor 610 displays a first medical image, and the operating room monitor 620 displays a second medical image. When the synchronization marker switch control is in the off state, the cursor 630 on the first medical image... Figure 6a When the location is moved, synchronized positioning marker information (such as a cursor pattern) will not be displayed at the same location on the second medical image on the operating room monitor 620; or please refer to Figure 6b The cursor 640 on the second medical image Figure 6b When the location is moved, the cursor pattern will not be displayed at the same location on the first medical image on the control room display 610.

[0068] In the interaction method of the aforementioned medical imaging equipment, when the synchronization marker switch control is in the off state, the cursors on the first and second medical images will not move synchronously. When the cursor moves on one medical image, the cursor pattern is not displayed on the other medical image. This can meet various user needs in different situations. When synchronous operation is not required, the operating room and control room can work independently without affecting each other.

[0069] In some embodiments, the medical imaging device further includes a control room mouse device and an operating room remote control device; the control room mouse device is used to move the cursor on the first medical image and to draw on the first medical image; the operating room remote control device is used to move the cursor on the second medical image and to draw on the second medical image.

[0070] Specifically, the user in the control room can realize the cursor moving operation on the first medical image through the mouse device, and also can realize the drawing on the first medical image through the mouse device; the user in the operating room can realize the cursor moving operation on the second medical image through the mouse function of the remote control device, and also can realize the drawing on the second medical image through the mouse function of the remote control device, and also can realize the function on the display through the keys on the remote control device.

[0071] In the above-mentioned interaction method of the medical imaging device, the mouse device in the control room is used for moving the cursor on the first medical image and drawing on the first medical image, and the remote control device in the operating room is used for moving the cursor on the second medical image and drawing on the second medical image. The users in the operating room and the control room can respectively control the cursor moving and drawing functions on the medical images, so that both users can timely assist the communication through the positioning mark information, and the communication understanding efficiency between the users is increased.

[0072] In some embodiments, the step of synchronously displaying the positioning mark information at the common attention region of the first medical image and the second medical image can include the following steps: if the common attention region of the first medical image has the positioning mark information, determining the display coordinates on the second medical image based on the pixel coordinates corresponding to the positioning mark information; and synchronously displaying the positioning mark information on the second medical image according to the display coordinates on the second medical image; or, if the common attention region of the second medical image has the positioning mark information, determining the display coordinates on the first medical image based on the pixel coordinates corresponding to the positioning mark information; and synchronously displaying the positioning mark information on the first medical image according to the display coordinates on the first medical image.

[0073] Specifically, if the common attention region of the first medical image has the positioning mark information, the positioning mark information corresponds to the first pixel coordinates on the first medical image, the first pixel coordinates are calculated through the pixel difference value algorithm to obtain the second pixel coordinates corresponding to the positioning mark information on the second medical image. The second pixel coordinates are the display coordinates of the positioning mark information on the second medical image, and therefore, the positioning mark information is synchronously displayed on the second medical image based on the display coordinates on the second medical image.

[0074] If the common attention region of the second medical image has the positioning mark information, the positioning mark information corresponds to the second pixel coordinates on the second medical image, the second pixel coordinates are calculated through the pixel difference value algorithm to obtain the first pixel coordinates corresponding to the positioning mark information on the first medical image. The first pixel coordinates are the display coordinates of the positioning mark information on the first medical image, and therefore, the positioning mark information is synchronously displayed on the first medical image based on the display coordinates on the first medical image.

[0075] It can be understood that the first medical image and the second medical image can be synchronously displayed with the positioning marker information based on WPF (Windows Presentation Foundation).

[0076] In the above-mentioned interaction method of the medical imaging device, the positioning marker information is synchronously displayed at the common attention area of the first medical image and the second medical image. By synchronously displaying the positioning marker information, ambiguity of voice interaction between users in the operating room and the control room can be reduced, and a specific position or a meaningful lesion area can be accurately positioned.

[0077] In some embodiments, the display coordinates on the second medical image are determined based on the pixel coordinates corresponding to the positioning marker information, including: calculating the display coordinates on the second medical image according to the pixel coordinates corresponding to the positioning marker information and a preset pixel coordinate difference value.

[0078] The image is composed of a series of orderly arranged pixels, and the first medical image and the second medical image both contain pixel points, so the positioning marker information has corresponding marker pixel coordinates. The content displayed on the display for the operating room and the content displayed on the display for the control room are different. The content displayed on the display for the operating room is the medical image collected after the medical imaging device is exposed, while the content displayed on the display for the control room not only has the medical image collected after the medical imaging device is exposed, but also has information such as menus, parameters, settings, etc. Therefore, the size and position of the first medical image and the second medical image on the display are not consistent. Since the position and size of the menus, parameters, settings, etc. on the display for the control room are fixed and the pixel coordinates of the image origin of the first medical image and the second medical image are different, the edge points can be taken as the coordinate origin. Therefore, there is a fixed pixel coordinate difference value between the first medical image and the second medical image, which has been preset in the host.

[0079] Specifically, the positioning marker information on the first medical image has its corresponding pixel coordinates marked as (X1, Y1), and the corresponding pixel coordinates (X2, Y2) on the second medical image can be obtained through the preset pixel coordinate difference value (X0, Y0) and the pixel coordinates (X1, Y1). The positions of the pixel coordinates (X1, Y1) and the pixel coordinates (X2, Y2) displayed on the medical image are the same.

[0080] In the above-mentioned interaction method of the medical imaging device, the display coordinates on the second medical image are calculated according to the pixel coordinates corresponding to the positioning marker information and a preset pixel coordinate difference value. This can make the cursor display the positioning marker information at the same position of the first medical image and the second medical image, and realize real-time sharing of images and texts.

[0081] In some embodiments, referring to Figure 7 , displaying the positioning marker information on the second medical image synchronously according to the display coordinates on the second medical image can include the following steps:

[0082] S710, displaying a transparent canvas on the second medical image.

[0083] S720, displaying a cursor pattern as the positioning marker information on the transparent canvas based on the display coordinates on the second medical image.

[0084] The transparent canvas can be a drawing canvas created by a control with a drawing canvas function in an operating system.

[0085] Specifically, the transparent canvas is deployed on both the first medical image and the second medical image. A real mouse cursor can be displayed on the transparent canvas of the first medical image. In order to realize the synchronous display between the first medical image and the second medical image, the cursor needs to be displayed on the same position of the transparent canvas of the second medical image. Therefore, the cursor displayed on the transparent canvas of the second medical image is a cursor pattern, rather than a real mouse cursor.

[0086] In the above-mentioned interaction method of the medical imaging device, the transparent canvas is displayed on the second medical image, and the cursor pattern is displayed as the positioning marker information on the transparent canvas based on the display coordinates. This can be used to realize the synchronous display of the positioning marker information between the operating room display and the control room display, thereby improving the communication and understanding efficiency.

[0087] The embodiments of the present specification also provide an interaction method of a medical imaging device, which includes a control room display, an operating room display. The medical imaging device also includes a control room mouse device, an operating room remote control device; the control room mouse device is used to move a cursor on the first medical image and draw on the first medical image; the operating room remote control device is used to move a cursor on the second medical image and draw on the second medical image. For example, referring to Figure 8 , the interaction method of the medical imaging device can include the following steps:

[0088] S802, displaying the first medical image on the control room display and displaying at least part of the second medical image on the operating room display.

[0089] The first medical image and the second medical image are both the same medical image formed by the medical imaging device emitting radiation rays to the examination site. The display page of the first medical image has a synchronous marker switch control.

[0090] S804, in a case where the synchronous marking switch control is in an open state, in response to a cursor moving operation occurring on the first medical image, calculating according to a pixel coordinate corresponding to the cursor and a preset pixel coordinate difference value to obtain a display coordinate on the second medical image.

[0091] S806, displaying a transparent canvas on the second medical image.

[0092] S808, displaying a cursor pattern as positioning mark information on the transparent canvas based on the display coordinate on the second medical image.

[0093] S810, in response to a drawing mark event occurring on the first medical image, synchronously displaying drawing mark content generated by the drawing mark event on the first medical image and the second medical image.

[0094] S812, in response to a display style setting operation of the drawing mark content, updating a display style of the drawing mark content.

[0095] S814, in response to a closing operation of the synchronous marking switch control, synchronously clearing the drawing mark content on the first medical image and the second medical image.

[0096] S816, in a case where the synchronous marking switch control is in a closed state, in response to a cursor moving operation occurring on the first medical image, the cursor moving on the first medical image and there being no cursor pattern on the second medical image.

[0097] The embodiments of the present specification further provide an interaction method of a medical imaging device, the medical imaging device comprising a control room display, an operating room display. The medical imaging device further comprises a control room mouse device, an operating room remote control device; the control room mouse device is used to move a cursor on the first medical image and draw on the first medical image; the operating room remote control device is used to move a cursor on the second medical image and draw on the second medical image. Exemplarily, please refer to Figure 9 , the interaction method of the medical imaging device can comprise the following steps:

[0098] S902, displaying the first medical image on the control room display and displaying at least part of the second medical image on the operating room display.

[0099] Wherein, the first medical image and the second medical image are both the same medical image formed by the medical imaging device emitting radiation rays to the examination site. The display page of the second medical image has a synchronous marking switch control.

[0100] S904, in a case where the synchronous marking switch control is in an open state, in response to a cursor moving operation occurring on the second medical image, determining a display coordinate on the first medical image according to a pixel coordinate corresponding to the cursor and a preset pixel coordinate difference value.

[0101] S906, displaying a transparent canvas on the first medical image.

[0102] S908, displaying a cursor pattern as the positioning marker information on the transparent canvas based on the display coordinate on the first medical image.

[0103] S910, in response to a drawing marker event occurring on the second medical image, synchronously displaying drawing marker content generated by the drawing marker event on the first medical image and the second medical image.

[0104] S912, in response to a display style setting operation of the drawing marker content, updating a display style of the drawing marker content.

[0105] S914, in response to a closing operation of the synchronous marking switch control, synchronously clearing the drawing marker content on the first medical image and the second medical image.

[0106] S916, in a case where the synchronous marking switch control is in a closed state, in response to a cursor moving operation occurring on the second medical image, the cursor moving on the second medical image and there being no cursor pattern on the first medical image.

[0107] The present specification embodiment provides an interactive device 1000 of a medical imaging device, please refer to Figure 10 , the interactive device 1000 of the medical imaging device comprises: a medical image display module 1100, a common focus area determination module 1200.

[0108] The medical image display module 1100 is used for displaying the first medical image on the control room display and displaying at least part of the second medical image on the operating room display; wherein the first medical image and the second medical image are the same medical image formed by the medical imaging device emitting radiation rays to an examination site;

[0109] The focus area determination module 1200 is used for synchronously displaying positioning marker information at a common focus area of the first medical image and the second medical image; wherein the common focus area is an image area that needs to be viewed by users in the control room and the operating room simultaneously; and the positioning marker information is used for visually prompting the users in the control room and the operating room to view the common focus area simultaneously.

[0110] Specific descriptions of the interactive device of the medical imaging apparatus can be found in the descriptions of the interactive method of the medical imaging apparatus above, and will not be repeated here.

[0111] One embodiment of the present specification provides a computer readable storage medium, which stores a computer program. The computer program is executed by a processor to implement the steps of the method in any one of the above embodiments.

[0112] One embodiment of the present specification provides a computer program product, which includes instructions. The instructions are executed by a processor of a computer device to enable the computer device to perform the steps of the method in any one of the above embodiments.

[0113] It should be noted that the logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a list of executable instructions for implementing logic functions, and can be specifically embodied in any computer readable medium for use by or in connection with an instruction execution system, apparatus or device, such as a computer-based system, a system including a processor or other system that can fetch the instructions from the instruction execution system, apparatus or device and execute the instructions, or in conjunction with such an instruction execution system, apparatus or device. For the purpose of the present specification, the "computer readable medium" can be any device that can contain, store, communicate, propagate or transport the program for use by or in connection with the instruction execution system, apparatus or device, or in conjunction with such an instruction execution system, apparatus or device. More specific examples (non-exhaustive list) of the computer readable medium include the following: electrical connections having one or more wires (electronic devices), portable computer disks (magnetic devices), random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memories), fiber optic devices, and portable compact disk read-only memories (CDROMs). In addition, the computer readable medium can even be paper or other suitable medium on which the program can be printed, as the program can be electronically obtained, for example, by optical scanning of the paper or other medium, followed by electronic conversion of the scanned data into a form that can be used by the computer, and then storing the data in a computer memory if necessary.

Claims

1. An interaction method of a medical imaging apparatus, characterized by, The medical imaging device comprises a control room display and an operating room display; and the method comprises: displaying a first medical image on the control room display and displaying at least part of a second medical image on the operating room display; wherein the first medical image and the second medical image are the same medical image formed by the medical imaging device emitting radiation rays to an examination site; synchronously displaying positioning marker information at a common attention region of the first medical image and the second medical image; wherein the common attention region is an image region that needs to be viewed by users in the control room and the operating room simultaneously; the positioning marker information is used to visually prompt the users in the control room and the operating room to view the common attention region simultaneously; and the display page of the first medical image has a synchronous marker switch control, which is used to change the state of a synchronous marker switch.

2. The method of claim 1, wherein, The synchronous display of the positioning marker information at least comprises one of the following: in a case where the synchronous marker switch control is in an open state, in response to a cursor moving operation occurring on the first medical image, a cursor on the first medical image and a cursor pattern on the second medical image are synchronously moved; or in a case where the synchronous marker switch control is in an open state, in response to a cursor moving operation occurring on the second medical image, a cursor on the second medical image and a cursor pattern on the first medical image are synchronously moved.

3. The method of claim 1, wherein, The synchronous display of the positioning marker information at least comprises one of the following: in a case where the synchronous marker switch control is in an open state, in response to a drawing marker event occurring on the first medical image, drawing marker content generated by the drawing marker event is synchronously displayed on the first medical image and the second medical image; or in a case where the synchronous marker switch control is in an open state, in response to a drawing marker event occurring on the second medical image, drawing marker content generated by the drawing marker event is synchronously displayed on the first medical image and the second medical image.

4. The method of claim 3, wherein, The method further comprises: in response to a closing operation of the synchronous marker switch control, the drawing marker content on the first medical image and the second medical image is synchronously cleared.

5. The method of claim 3, wherein, The method further comprises: in response to a display style setting operation of the drawing marker content, the display style of the drawing marker content is updated.

6. The method of claim 1, wherein, The method at least further comprises one of the following: in a case where the synchronous marker switch control is in a closed state, in response to a cursor moving operation occurring on the first medical image, a cursor on the first medical image moves, and there is no cursor pattern on the second medical image; or in a case where the synchronous marker switch control is in a closed state, in response to a cursor moving operation occurring on the second medical image, a cursor on the second medical image moves, and there is no cursor pattern on the first medical image. ​ 7. The method of claim 1, wherein, The medical imaging device further comprises a control room mouse device and an operating room remote control device; the control room mouse device is used for moving a cursor on the first medical image and drawing on the first medical image; The operating room remote control device is used for moving a cursor on the second medical image and drawing on the second medical image.

8. The method according to any one of claims 1 to 7, characterized in that, The step of synchronously displaying positioning marker information at a common attention region of the first medical image and the second medical image at least comprises one of the following: If the common attention region of the first medical image has positioning marker information, display coordinates on the second medical image are determined based on pixel coordinates corresponding to the positioning marker information; and the positioning marker information is synchronously displayed on the second medical image according to the display coordinates on the second medical image; Or, If the common attention region of the second medical image has positioning marker information, display coordinates on the first medical image are determined based on pixel coordinates corresponding to the positioning marker; and the positioning marker information is synchronously displayed on the first medical image according to the display coordinates on the first medical image.

9. The method of claim 8, wherein, The step of determining display coordinates on the second medical image based on pixel coordinates corresponding to the positioning marker information comprises: The display coordinates on the second medical image are obtained by calculating the pixel coordinates corresponding to the positioning marker information and a preset pixel coordinate difference value.

10. The method of claim 9, wherein, The step of synchronously displaying the positioning marker information on the second medical image according to the display coordinates on the second medical image comprises: A transparent canvas is displayed on the second medical image; A cursor pattern as the positioning marker information is displayed on the transparent canvas based on the display coordinates on the second medical image.

11. An interaction device of a medical imaging apparatus, characterized in that, The medical imaging device comprises a control room display and an operating room display; and the device comprises: A medical image display module configured to display a first medical image on the control room display and display at least part of a second medical image on the operating room display; wherein the first medical image and the second medical image are the same medical image formed by the medical imaging device emitting radiation rays to an examination site; An attention region determination module configured to synchronously display positioning marker information at a common attention region of the first medical image and the second medical image; wherein the common attention region is an image region that needs to be viewed by users in a control room and an operating room at the same time; the positioning marker information is used for visually prompting the users in the control room and the operating room to view the common attention region at the same time; and the display page of the first medical image has a synchronous marker switch control, which is used for changing the state of a synchronous marker switch.

12. A medical imaging device comprising a memory and a processor, the memory storing a computer program, characterized in that, The processor executes the computer program to implement the steps of the method in any one of claims 1 to 10.

13. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method in any one of claims 1 to 10.

Citation Information

Patent Citations

  • Systems and Methods for Viewing and Analyzing Anatomical Structures

    US20120172700A1

  • Simultaneously displaying medical images

    US20180064409A1