Training method and device for doctors to remotely control large medical imaging equipment

Abstract

The invention discloses a training method and device for a doctor to remotely control large medical imaging equipment. The method comprises the following steps: receiving takeover request information of a control room end; sending the request information to an expert end, and waiting for taking-over confirmation of the expert end; receiving takeover confirmation information of the expert end, and establishing a connection relationship between the control room end and the expert end; receiving multiple pictures of the control room end and sending the pictures to the expert end; and receiving an operation instruction of the expert end on the multiple pictures, and sending the operation instruction to a control room end. According to the method and the device, different from the previous single video signal, the positioning of the patient, the parameter information of the patient scanned in real time, the picture of the high-pressure injector and the multi-view picture of a subordinate technician can be acquired in real time through multi-picture signal access, so that the guidance information can be acquired in a real-time and visual manner; the remote control software of the CT / MR equipment can be operated by the local keyboard and mouse at the expert end, so that the remote takeover control of the CT / MR equipment is realized.

Description

Technical Field

[0001] The present invention belongs to the technical field of medical remote control, and in particular relates to a training method and device for doctors to remotely control large medical imaging equipment. Background Art

[0002] With the aging of the population and the increase in the number of patients with chronic diseases, the clinical demand for imaging examinations such as CT / MR / DSA is growing. The advantages of large-scale medical imaging equipment such as CT / MR / DSA in disease screening and diagnosis and the necessity of equipment are becoming more prominent. The procurement demand for these equipment by medical institutions at all levels continues to grow, prompting the market size of large-scale medical imaging equipment in my country to show a rapid growth trend. However, data show that the annual growth rate of medical imaging data in China is currently about 30%, while the growth rate of physicians is only 4.1%. In the face of higher requirements for the professional skills and experience of doctors and technicians in medical technology departments (radiology departments), especially the shortage of high-level expert resources, there is an urgent need to speed up the teaching and training of imaging examination technologies such as CT / MR / DSA. The existing method is generally for junior doctors to study under the guidance of senior doctors. This learning method is limited by time and venue, and after the learning period, they cannot be consulted at any time.

[0003] When young doctors encounter problems during independent operation, they often use telephone consultation or video conferencing. However, the existing consultation method requires describing a lot of information and all the time is spent on communication, which does not allow young doctors to get convenient and effective help. Summary of the invention

[0004] The purpose of the present invention is to overcome the above problems and provide a method and device for training doctors to remotely control large medical imaging equipment. The control room end of the present invention can initiate a takeover application for experts with one click, the control room equipment can access multiple signal sources, and the expert end can remotely control multiple data sources, thereby providing teaching and training for young technicians, remote imaging diagnosis guidance, remote imaging consultation, remote imaging case quality control, etc.

[0005] In order to achieve the above purpose, the technical solution adopted by the present invention is:

[0006] A method for training doctors to remotely control large medical imaging equipment includes performing the following steps when an expert terminal takes over a control room terminal:

[0007] Presenting the control source of the controlled device in an interactive window, and controlling the controlled device located at the control room end according to the control instruction; receiving the control source transmitted by the transmission protocol at the control room end, and presenting the control source on the interactive window;

[0008] The video source of the controlled device is presented in a video window located on the same screen as the interactive window, and the video source at least includes the camera collection located at the control room end.

[0009] As a further improvement, presenting the control source of the controlled device in an interactive window includes the following steps:

[0010] The first interactive window presents the main screen;

[0011] The second interactive window presents the real-time scanned patient parameter information in the secondary screen;

[0012] Among them, the interactive window includes the first interactive window and the second interactive window; the control source includes the main screen image and the real-time scanned patient parameter information; the first interactive window and the second interactive window can switch screens and can interact with the control room end.

[0013] As a further improvement, presenting the control source of the controlled device in an interactive window includes the following steps:

[0014] Control the remote controlled device by managing and configuring the main screen.

[0015] As a further improvement, controlling the controlled device located at the control room end according to the control instruction to initiate teaching training includes the following steps:

[0016] Single-select or multi-select users in the training list and / or search users, send the selected user information to the control room, and initiate teaching training for the selected single or multiple people.

[0017] As a further improvement, controlling the controlled device located at the control room end according to the control instruction and initiating a remote takeover instruction includes the following steps:

[0018] Select a control room in the schedule, send the selected control room to the control room end, and initiate a remote takeover task;

[0019] The first interactive window and the second interactive window screen after remote takeover are displayed, wherein:

[0020] The main and sub-screen information includes:

[0021] The second interactive window screen is a multi-source screen, which at least displays a patient positioning screen and real-time scanned patient parameter information.

[0022] On the other hand, a training method for doctors to remotely control large medical imaging equipment is also provided, which is characterized by comprising the following steps when the control room end is taken over by the expert end:

[0023] Presenting the control source of the controlled device in a shared window, receiving the control source shared by the expert terminal, and presenting the control source in the shared window;

[0024] The video source of the controlled device is presented in a video window located on the same screen as the sharing window, and the video source includes local camera acquisition and expert end camera acquisition.

[0025] As a further improvement, by clicking the chat message button of the sharing window, a chat message dialog box pops up, and the dialog box covers part of the video window.

[0026] As a further improvement, when the control room end is taken over by the expert end, the following steps are further performed:

[0027] View available experts;

[0028] Directly call an online expert or select an expert from the form, and send a request to the server to call the expert. If the competent expert is online, only the competent expert will be called; if the supervisor is not online, if there is only one expert available, the competent expert will be automatically called; if there are multiple optional experts, the expert list will be displayed, and after selecting multiple experts, a request to call the expert will be sent to the server, and confirmation from the expert on the server will be received; when the first expert answers the call, the call is successful;

[0029] Wait for the expert to respond, the screen will show the waiting time, and enter the waiting queue;

[0030] Cancel the call request information, hide the call waiting status, and delete it from the waiting queue.

[0031] As a further improvement, when the control room end is taken over by the expert end, the following steps are further performed:

[0032] Receive the quick join takeover invitation code sent by the expert;

[0033] Join the takeover queue.

[0034] On the other hand, the present invention also provides a training device for doctors to remotely control large medical imaging equipment. The expert end and the control room end of the device include at least one processor and a memory storing instructions. When the instructions are executed by at least one processor, the method in the above technical solution is implemented.

[0035] A computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the method described in the steps of the above technical solution.

[0036] A computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the method described in the steps of the above technical solution is implemented.

[0037] The beneficial effects of the present invention are: through this method and device, the following are achieved:

[0038] (1) Different from the previous single video signal, through the access of multi-screen signals, experts can obtain patient positioning, real-time scanning of patient parameter information, high-pressure syringe images, and multi-view images of subordinate technicians in real time, which is convenient for experts to obtain guidance information in real time;

[0039] (2) The expert end can use the local keyboard and mouse to operate the control software of the remote CT / MR / DSA equipment, thereby realizing the remote takeover and control of the CT / MR / DSA equipment;

[0040] (3) Support remote control of different brands, models, and types of CT / MR / DSA equipment;

[0041] (4) If the CT / MR / DSA equipment is in the hospital's local intranet, the internal and external networks can be isolated by hardware, so there is no need to transmit patient imaging data or other data across the internal and external network restrictions, thus ensuring the security and privacy of patient data. There is no need to install any software on the hospital's existing equipment, and remote control can be performed only through the keyboard / mouse. There is no need for data docking or interface development.

[0042] (5) Experts can take over the control of CT / MR / DSA equipment, and young technicians can follow the experts in operating the CT / MR / DSA equipment to better learn the operating techniques of the CT / MR / DSA equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The present invention has the following accompanying drawings:

[0044] Figure 1 The flowchart of a training method for doctors to remotely control large medical imaging equipment in some specific embodiments of the present invention is as follows: Figure 1 ;

[0045] Figure 2 The flowchart of a training method for doctors to remotely control large medical imaging equipment in some specific embodiments of the present invention is as follows: Figure 2 ;

[0046] Figure 3 The flowchart of a training method for doctors to remotely control large medical imaging equipment in some specific embodiments of the present invention is as follows: Figure 3 ;

[0047] Figure 4It is a schematic diagram of the structure of a training device for doctors to remotely control large medical imaging equipment according to some specific embodiments of the present invention;

[0048] Figure 5 A schematic diagram of a training device for doctors to remotely control large medical imaging equipment according to the present invention. DETAILED DESCRIPTION

[0049] The following examples further illustrate the content of the present invention, but should not be construed as limiting the present invention. Without departing from the spirit and substance of the present invention, modifications or substitutions made to the methods, steps or conditions of the present invention all fall within the scope of the present invention.

[0050] A method for training doctors to remotely control large medical imaging equipment includes performing the following steps when an expert terminal takes over a control room terminal:

[0051] Presenting the control source of the controlled device in an interactive window, and controlling the controlled device located at the control room end according to the control instruction; receiving the control source transmitted by the transmission protocol at the control room end, and presenting the control source on the interactive window;

[0052] The video source of the controlled device is presented in a video window located on the same screen as the interactive window, and the video source at least includes the camera acquisition at the control room end. For example, the device video is acquired from the camera at the remote control room end, and the expert image is acquired from the local camera.

[0053] In some embodiments of the present invention, presenting the control source of the controlled device in an interactive window includes the following steps:

[0054] The first interactive window presents the main screen;

[0055] The second interactive window presents the real-time scanned patient parameter information in the secondary screen;

[0056] Among them, the interactive window includes the first interactive window and the second interactive window; the control source includes the main screen image and the real-time scanned patient parameter information; the first interactive window and the second interactive window can switch screens and can interact with the control room end.

[0057] In some embodiments of the present invention, presenting the control source of the controlled device in an interactive window includes the following steps:

[0058] Control the remote controlled device by managing and configuring the main screen.

[0059] In some embodiments of the present invention, controlling the controlled device located at the control room end according to the control instruction to initiate teaching training includes the following steps:

[0060] Single-select or multi-select users in the training list and / or search users, send the selected user information to the control room, and initiate teaching training for the selected single or multiple people.

[0061] In some embodiments of the present invention, controlling the controlled device located at the control room end according to the control instruction and initiating a remote takeover instruction includes the following steps:

[0062] Select a control room in the schedule, send the selected control room to the control room end, and initiate a remote takeover task;

[0063] The first interactive window and the second interactive window screen after remote takeover are displayed, wherein:

[0064] The main and sub-screen information includes:

[0065] The second interactive window screen is a multi-source screen, which at least displays a patient positioning screen and real-time scanned patient parameter information.

[0066] On the other hand, a training method for doctors to remotely control large medical imaging equipment is also provided, which is characterized by comprising the following steps when the control room end is taken over by the expert end:

[0067] Presenting the control source of the controlled device in a shared window, receiving the control source shared by the expert terminal, and presenting the control source in the shared window;

[0068] The video source of the controlled device is presented in a video window located on the same screen as the shared window, and the video source includes the local camera acquisition and the expert end camera acquisition. For example, the device video is acquired from the local camera, and the expert image is acquired from the remote expert end camera.

[0069] In some embodiments of the present invention, a chat message dialog box pops up when a chat message button of the shared window is clicked, and the chat message dialog box covers part of the video window. For example, when a chat message in the lower column of the shared window is clicked, a chat dialog box pops up on the video window, and the chat dialog box covers the video window page, and the content of the covered part of the video window can be seen through the chat dialog box.

[0070] In some embodiments of the present invention, when the control room end is taken over by the expert end, the following steps are further performed:

[0071] View available experts;

[0072] Directly call an online expert or select an expert from the form, and send a request to the server to call the expert. If the competent expert is online, only the competent expert will be called; if the supervisor is not online, if there is only one expert available, the competent expert will be automatically called; if there are multiple optional experts, the expert list will be displayed, and after selecting multiple experts, a request to call the expert will be sent to the server, and confirmation from the expert on the server will be received; when the first expert answers the call, the call is successful;

[0073] Wait for the expert to respond, the screen will show the waiting time, and enter the waiting queue;

[0074] Cancel the call request information, hide the call waiting status, and delete it from the waiting queue.

[0075] In some embodiments of the present invention, when the control room end is taken over by the expert end, the following steps are further performed:

[0076] Receive the quick join takeover invitation code sent by the expert;

[0077] Join the takeover queue.

[0078] Embodiment 1:

[0079] like Figure 1 As shown, the present invention provides a method for training doctors to remotely control large medical imaging equipment, including the server side executing the following steps:

[0080] Step S1101: receiving takeover request information from the control room end; wherein the server end is a virtual cockpit system, including a cloud platform and a privatization platform, and the control room end and the expert end establish a connection relationship through the virtual cockpit system, and then exchange information; when the control room end has a takeover demand, it will send a takeover request to the server end to establish a connection between the server end and the expert end; for example, when the doctor at the control room end wants the expert end to operate and check the instrument, he will check the online expert list, and then initiate a takeover request at the control room end, and the request will be transmitted to the server end;

[0081] Step S1102: Send the request information to the expert end, and wait for the expert end to take over and confirm; for example, the server end processes the received request information, sends it to the expert end, and then enters the waiting queue to wait for the expert to respond and confirm;

[0082] Step S1103: receiving the takeover confirmation information from the expert end, and establishing a connection relationship between the control room end and the expert end;

[0083] Step S1104: Based on the established connection relationship, multiple images received from the control room end are sent to the expert end; the control room end can access multiple signal sources and multiple images, for example, the images may include patient positioning images, CT / MR / DAS control software images, high-pressure injector images, and lower-level technician images, and these images are provided to the expert in real time during remote takeover;

[0084] Step S1105: Receive the operation instructions of the expert end for the multiple screens, and send the operation instructions to the control room end. For example, the functions of the expert end include being able to answer the remote takeover application of the control room end, being able to see multiple screens such as patient positioning, CT / MR / DAS control software screens, etc. at the same time, being able to communicate with the technicians of the control room end by video, voice, and text, and being able to use the local keyboard and mouse to remotely operate the CT / MR / DAS control software of the equipment in the control room end, CT / MR / DAS is medical CT examination, MR is nuclear magnetic resonance examination, and DSA is angiography examination.

[0085] Step S1104 includes the following steps:

[0086] Step S11041: at least receive the patient positioning image, real-time scanned patient parameter information, high-pressure syringe image, and multi-perspective image of the subordinate technician from the control room end; the control room end can access the images collected by multiple source devices, so the collected multiple images can be sent to the expert end after the connection is established.

[0087] Step S11042: Send the patient positioning screen, real-time scanned patient parameter information, high-pressure syringe screen, and multi-view screen of the subordinate technician to the expert end.

[0088] Step S1105 includes the following steps:

[0089] Step S11051: receiving the operation instructions of the patient positioning screen, the real-time scanned patient parameter information, the high-pressure syringe screen, and the multi-view screen of the subordinate technician; the server side can receive the operation instructions sent by the expert side for the multi-source data source;

[0090] Step S11052: Send the operation instruction to the control room end. The server end receives the operation instruction sent by the expert end, and then forwards it to the control room end through the established connection.

[0091] like Figure 2 As shown, the present invention also provides a training method for doctors to remotely control large medical imaging equipment, including the expert end performing the following steps:

[0092] Step S2101: receiving a takeover request message from the server, and confirming the takeover request message;

[0093] Step S2102: Send the takeover confirmation to the server, initiate teaching and training, and initiate remote takeover instructions; for example, the expert can initiate teaching and training, according to the user list, or search, and can select multiple users or single users to initiate training for users. Display all control rooms in the schedule of the radiology center, list the control rooms (the list of control rooms that experts can control in the back-end schedule), and after clicking on the control room, initiate the remote takeover service.

[0094] Step S2103: Send the instruction to the server;

[0095] Step S2104: receiving the patient positioning screen, real-time scanned patient parameter information, high-pressure syringe screen, and multi-view screens of subordinate technicians;

[0096] Step S2105: Based on the patient positioning screen, real-time scanned patient parameter information, high-pressure syringe screen, and multi-view screen of the subordinate technician, a control screen instruction is sent to the server.

[0097] Among them, the expert-side modules include teaching and training sections, management and control groups, and quick joining sections via invitation codes.

[0098] Initiating teaching training in step S2102 includes the following steps:

[0099] Step S21021: Single-select or multiple-select users in the training list and / or search users, send the selected user information to the server, and initiate teaching training for the selected single or multiple people.

[0100] The remote takeover instruction initiated in step S2102 includes the following steps:

[0101] Step S21022: Select a control room in the schedule, send the selected control room to the server, and initiate a remote takeover task;

[0102] Step S21023: Display the main and sub-screen information after remote takeover, where:

[0103] The main and sub-screen information includes:

[0104] The current main screen displays the remote control screen, and the secondary screen displays at least the patient positioning screen, wherein the secondary screen is a four-split screen; in the four-split screen, the upper left corner displays the expert's main source screen, the upper right corner displays the patient positioning screen, the lower left corner displays the real-time scanned patient parameter information, and the lower right corner displays the high-pressure injector control screen. For example, the content in the main screen includes turning on and off the local microphone, turning on and off the camera, remote control, screenshots, sharing sources, participants, chat messages, starting recording, sound brightness control, etc. Among them, the remote control function includes: pop-up confirmation prompt, do you want to start remote takeover? Initiate takeover after confirmation; take over directly without the other party's consent; after taking over, directly share the screen with everyone ((default shared screen); main and sub-screen screen display: the current main screen is displayed as the source of remote control, and the sub-screen is split into 4 screens to display other screens of the controlled device. If there is still empty area, the expert's main source screen will be displayed, and other end users will be prompted to open shared remote control, and the layout will be updated synchronously. Chat message functions include: displaying the number of unread new chats; opening the chat box, and the chat content is read; displaying chat content, including: avatar, text content, time; chat messages support keyboard input, support Chinese and English, but not pictures; the chat box is closed and hidden.

[0105] like Figure 3 As shown, the present invention also provides a training method for doctors to remotely control large medical imaging equipment, including the control room end performing the following steps:

[0106] Step S3101: Send takeover request information to the server; for example, when there is a training demand, initiate a call to an expert. When calling, only the responsible expert will be called if the responsible expert is online; if the supervisor is not online, if there is only one expert who can take over (online), the call can be automatically called; if there are multiple optional experts, the expert list will be displayed, and the first expert who answers the call will indicate that the call is successful. Among them, a quick call button is also provided on the control room side, and the first function module in the control panel is used as a shortcut button function of the toolbar. After initiating a call, three states will be displayed: the call is waiting for answer; in the waiting state, the call is canceled and the call is terminated; no one answers the expert end, the waiting timeout (for example, the waiting timeout of 1 minute) occurs, and the call is terminated.

[0107] For example, the control room can see the number of online experts and their names in the expert box. To make a call, you can select an online expert in the list to call. When calling, you can call one or more experts and then wait for the expert to take over. When calling multiple experts, the first expert to take over is the docking expert for the control room. In the expert list, you can see whether an expert is online, the number of experts, the expert selection button, the call button, and other components or functions.

[0108] Step S3102: receiving teaching training from the server and initiating remote takeover instructions;

[0109] Step S3103: Send the patient positioning screen, real-time scanned patient parameter information, high-pressure syringe screen, and multi-view screens of subordinate technicians to the server. For example, after receiving the takeover confirmation instruction from the expert, start sending multi-source data to the server, and the server sends it to the expert.

[0110] For example, in taking over remote training, the page on the control room side includes a main screen and a sub-screen (the main screen is on the left and the sub-screen is on the right). The current main screen displays the local source of the controller side, and the sub-screen displays at least the patient positioning screen, wherein the sub-screen is a four-split screen; in the four-split screen, the top corner displays the expert's remote source screen, further down is the patient positioning screen, further down is the high-pressure injector control screen, and the bottom is the screen of the doctor being trained.

[0111] For example, the contents on the main screen include turning on / off the local microphone, turning on / off the camera, screen capture, participants, chat messages, sound brightness control, etc. Among them, "turn off microphone" means turning on / off the local microphone.

[0112] Among them, the chat message functions include: displaying the number of new unread chats; opening the chat box, the chat content is read; displaying the chat content, including: avatar, text content, time; chat messages support keyboard input, support Chinese and English, but not pictures; the chat box is closed and hidden. Participants: List the participants and display the number of people who have not joined the meeting.

[0113] In some embodiments of the present invention, there is also a history record module at the control room end, and the history record module includes: reverse chronological listing of the history records initiated or participated in, including those that were not answered after application (displayed according to the background data display parameter settings (such as: within 3 months); display content: name, initiator's avatar, initiator, time, duration, recorded call or answering history records; if there is a recording, it can be reviewed; click to display historical details.

[0114] The control room also performs the following steps:

[0115] Step S3104: Check the experts that can be called;

[0116] Step S3105: directly call an online expert or select an expert from the form, and send a request to call the expert to the server. If the competent expert is online, only the competent expert is called; if the supervisor is not online, if there is only one expert who can take over, the competent expert is automatically called; if there are multiple optional experts, the expert list is displayed, and after multiple experts are selected, a request to call the expert is sent to the server, and confirmation from the expert on the server is received; when the first expert answers the call, the call is successful;

[0117] Step S3106: Wait for the expert to respond, the screen displays the waiting time, and enters the waiting queue;

[0118] Step S3107: Cancel the call request information, hide the call waiting status, and delete it from the waiting queue.

[0119] The control room also performs the following steps:

[0120] Step S3108: receiving a quick join takeover invitation code sent by the server;

[0121] Step S3109: Join the taken-over queue.

[0122] For example, you can join a multi-person takeover initiated by an expert through an invitation code; if there is no ongoing takeover, this item will be empty, if there is an ongoing takeover, it will be displayed, and you can join it by clicking it.

[0123] Embodiment 2:

[0124] like Figure 1 As shown, the present invention provides a method for training doctors to remotely control large medical imaging equipment, comprising the following steps:

[0125] Step S101: receiving takeover request information from the control room;

[0126] Step S102: sending the request information to the expert end, and waiting for the expert end to take over and confirm;

[0127] Step S103: receiving the takeover confirmation information from the expert end, and establishing a connection relationship between the control room end and the expert end;

[0128] Step S104: Based on the established connection relationship, multiple images received from the control room end are sent to the expert end;

[0129] Step S105: Receive the operation instructions of the expert end for the multiple screens, and send the operation instructions to the control room end.

[0130] In some specific embodiments, the multi-screen at least includes:

[0131] Patient positioning screen, real-time scanned patient parameter information, high-pressure syringe screen, and multi-perspective screen of junior technicians.

[0132] In some specific embodiments, the expert terminal may select multiple takeover request information at the same time.

[0133] Step S105 includes the following steps:

[0134] Step S1051: The page displays the control room that initiated the takeover request in the shift schedule of the radiology center. After clicking the control room, the remote takeover service is initiated.

[0135] Initiating the remote takeover service in step S1051 includes the following steps:

[0136] Step S10511: Take over the control of the patient positioning screen, real-time scanned patient parameter information, high-pressure syringe screen and multi-view screen of the subordinate technician.

[0137] In some specific embodiments, the page content of the multiple screens on the screen includes:

[0138] The current main screen displays the source of remote control, and the secondary screen displays other screens of the controlled device, where the secondary screen is divided into four parts; if there is any empty area left, the expert's main source screen is displayed; if other end users request to open a shared remote control screen, the page layout is updated synchronously.

[0139] Step S102 includes the following steps:

[0140] Step S1021: The responsible expert calls any expert in the online expert list online;

[0141] Step S1022: If the supervisor is not online, if there is only one online expert who can take over, the call can be made automatically;

[0142] Step S1023: If there are multiple optional online experts, the online expert list is displayed, and the first expert to answer the call indicates that the call is successful.

[0143] In some specific embodiments, when the control room end calls the expert end, it includes:

[0144] The call waiting icon appears in the waiting state, showing the waiting time and entering the waiting queue;

[0145] If a one-touch call button is pressed multiple times in a short period of time, it will only respond to the first press event.

[0146] In some specific embodiments, the appearance of the call waiting icon in the waiting state includes:

[0147] call reception, call cancellation, and call waiting timeout;

[0148] The call cancellation includes:

[0149] After the application is withdrawn, the call waiting status is hidden, and a message prompts that the application has been withdrawn;

[0150] The pop-up window on the expert side is closed;

[0151] Remove from the waiting queue;

[0152] The call waiting timeout includes:

[0153] No expert answered the call, and the call timed out after one minute.

[0154] Prompt timeout, hide after display timeout;

[0155] The pop-up window on the expert side is closed;

[0156] Remove from the waiting queue.

[0157] Embodiment 3:

[0158] like Figure 4 As shown, the present invention provides a training device for doctors to remotely control large medical imaging equipment, comprising:

[0159] A first receiving module, used for receiving takeover request information from the control room end;

[0160] A first sending module, used for sending the request information to the expert end, and waiting for the expert end to take over and confirm;

[0161] The second receiving module is used to receive the takeover confirmation information from the expert end and establish a connection relationship between the control room end and the expert end;

[0162] A second sending module is used to receive the multi-images at the control room end and send them to the expert end based on the established connection relationship;

[0163] The third sending module is used to receive the operation instructions of the expert end on the multiple screens, and send the operation instructions to the control room end.

[0164] In some specific embodiments, the multi-screen at least includes:

[0165] Patient positioning screen, real-time scanned patient parameter information, high-pressure syringe screen, and multi-perspective screen of junior technicians.

[0166] In some specific embodiments, the expert terminal may select multiple takeover request information at the same time.

[0167] The third sending module includes:

[0168] The takeover module is used to display the control room that initiates the takeover request in the shift schedule of the radiology center on the page. After clicking the control room, the remote takeover service is initiated.

[0169] The remote takeover service initiated in the takeover module includes:

[0170] The first takeover module is used to take over the patient positioning screen, real-time scanned patient parameter information, high-pressure syringe screen and multi-view screen control of subordinate technicians.

[0171] In some specific embodiments, the page content of the multiple screens on the screen includes:

[0172] The current main screen displays the source of remote control, and the secondary screen displays other screens of the controlled device, where the secondary screen is divided into four parts; if there is any empty area left, the expert's main source screen is displayed; if other end users request to open a shared remote control screen, the page layout is updated synchronously.

[0173] The first sending module includes:

[0174] Competent Experts Online Only call competent experts;

[0175] If the supervisor is not online, a call can be made automatically if there is only one online expert who can take over;

[0176] If there are multiple online experts available, the list of online experts will be displayed. The first expert to answer the call means the call is successful.

[0177] In some specific embodiments, when the control room end calls the expert end, it includes:

[0178] The call waiting icon appears in the waiting state, showing the waiting time and entering the waiting queue;

[0179] If a one-touch call button is pressed multiple times in a short period of time, it will only respond to the first press event.

[0180] In some specific embodiments, the appearance of the call waiting icon in the waiting state includes:

[0181] call reception, call cancellation, and call waiting timeout;

[0182] The call cancellation includes:

[0183] After the application is withdrawn, the call waiting status is hidden, and a message indicating that the application has been withdrawn is displayed and then hidden;

[0184] The pop-up window on the expert side is closed;

[0185] Remove from the waiting queue;

[0186] The call waiting timeout includes:

[0187] No expert answered the call, and the call timed out after one minute.

[0188] Prompt timeout, hide after display timeout;

[0189] The pop-up window on the expert side is closed;

[0190] Remove from the waiting queue.

[0191] Embodiment 4:

[0192] The present invention discloses a method for remotely controlling CT / MR / DSA equipment. The system includes a control room end and an expert end. The control room end function includes being able to initiate a takeover application for an expert with one click. The control room equipment can access multiple signal sources, such as a patient positioning screen, a CT / MR / DSA control software and a technician scanning operation screen, a high-pressure injector screen, and a patient inspection monitoring screen. These screens are provided to the expert in real time during remote takeover. The expert end function includes being able to answer the remote takeover application of the control room end, being able to simultaneously see multiple screens such as the patient positioning, the CT / MR / DSA control software and the technician scanning operation screen, being able to communicate with the technician of the control room end via video, voice, and text, and being able to use a local keyboard and mouse to remotely operate the CT / MR / DSA control software and the technician scanning operation interface of the equipment of the control room end, and to demonstrate in person, thereby realizing the guidance of inspection technology to the technician of the control room end without leaving home.

[0193] The present invention discloses a training method for remotely controlling CT / MR / DSA equipment. The system includes a control room end and an expert end. The control room end function includes being able to initiate a takeover application for an expert with one key. The control room equipment can access multiple signal sources, such as a patient positioning screen, a CT / MR / DSA control software screen, a high-pressure injector screen, and a lower-level technician screen. These screens are provided to the expert in real time during remote takeover. The expert end function includes being able to answer the remote takeover application from the control room end, being able to simultaneously see multiple screens such as the patient positioning, the CT / MR / DSA control software screen, and being able to communicate with the technician at the control room end via video, voice, and text, and being able to use a local keyboard and mouse to remotely operate the CT / MR / DSA control software of the equipment at the control room end.

[0194] 1. Expert side, including: home page, initiating teaching and training module, initiating remote takeover module and remote takeover training module (including main screen module and sub-screen module).

[0195] 1.1. Home Page

[0196] After opening, the main interface is displayed, and the business module is entered from the main interface;

[0197] Business modules include: teaching and training, control groups, historical records, and quick join;

[0198] 1.2. Initiate teaching training

[0199] List all users by group, support search, and allow multiple selections. After selection, you can initiate teaching training for the selected multiple people;

[0200] 1.3. Initiate remote takeover

[0201] Display all control rooms in the radiology center's shift schedule, list the control rooms (the list of control rooms that can be controlled by experts in the backend shift schedule), and click on a control room to initiate remote takeover.

[0202] 1.4. Remote takeover and training

[0203] Main screen, functions include: turning on and off the local microphone, turning on and off the camera, remote control, screenshot, sharing source, participants, chatting, starting recording, and sound brightness control.

[0204] Remote control function:

[0205] 1. A confirmation prompt pops up, asking whether to start remote takeover? Confirm and initiate takeover;

[0206] 2. Take over directly without the other party’s consent;

[0207] 3. After taking over, directly share the screen with everyone ((default shared screen);

[0208] 4. Screen display: The current main screen is the source screen for remote control, and the secondary screen is divided into 4 screens to display other screens of the controlled device. If there is no empty area, the expert's main source screen will be displayed. Other end users are prompted to open shared remote control, and the layout is updated synchronously;

[0209] Chat message function:

[0210] 1. If there are new unread chats, the number of chats will be displayed;

[0211] 2. Open the chat box and the chat content is read;

[0212] 3. Display chat content, including: avatar, text content, and time;

[0213] 4. Chat messages support keyboard input, Chinese and English, but not pictures;

[0214] 5. Close and hide the chat box;

[0215] 2. Control room end (such as Figure 5 As shown), including: the default interface module in display mode, the call expert module, the remote expert module, the quick join module, the remote takeover training module and the history module.

[0216] 2.1.Default interface in display mode

[0217] 1. The default setting is display mode, which is usually used for office work;

[0218] 2. When there is no signal in the display mode for 30 seconds, the screen will automatically turn off;

[0219] 3. When there is a signal in the display mode, the screen will turn on automatically;

[0220] 4. When the screen is off, click the mouse or touch the screen to automatically turn on the screen;

[0221] 6. Move the mouse / touch screen to the right side, the shortcut control interface and network status are displayed on the right side, and move the mouse to the right control interface area;

[0222] 7. Move the mouse out of the operation area, click any non-system operation area and return to computer operation;

[0223] 2.2. Call an expert

[0224] 1. Make a call

[0225] (1) When the competent expert is online, only the competent expert can be called;

[0226] (2) If the supervisor is not online, and there is only one expert who can take over (online), the call can be made automatically;

[0227] (3) If there are multiple optional experts, the expert list is displayed, and the first expert to answer the call indicates that the call is successful;

[0228] 2. This call shortcut button is mainly based on the first function module in the control panel below as the shortcut button function of this toolbar

[0229] 2.1. After initiating a call

[0230] (1) The call waiting icon appears and indicates the waiting state, the waiting time is displayed, and the user enters the waiting queue;

[0231] (2) A one-touch call button, if pressed multiple times in a short period of time, only responds to the first press;

[0232] 2.2. Cancel in the waiting state, and the prompt will hide after cancellation

[0233] (1) After the application is cancelled, the call waiting status is hidden and a message prompting that the application has been cancelled is displayed. The status icon is hidden after a few seconds of displaying the prompt message.

[0234] (2) The pop-up window on the expert side is closed;

[0235] (3) Delete from the waiting queue;

[0236] 2.3. No expert answered the call, waiting for 1 minute and timeout

[0237] (1) The prompt timeout is displayed and hidden after the timeout;

[0238] (2) The pop-up window on the expert side is closed;

[0239] (3) Delete from the waiting queue;

[0240] 2.3. Remote Experts

[0241] 1. List the experts in the expert group (in the backend scheduling expert group);

[0242] 2. Expert portrait, name, group, and expert status;

[0243] 3. Do not select an expert, but directly call the online experts in the group call list;

[0244] 4. You can also choose one or several experts to call;

[0245] 2.4. Quick Join

[0246] 1. Join the multi-person takeover initiated by experts through the invitation code;

[0247] 2. If there is no ongoing session, this item will be empty. If there is an ongoing session, it will be displayed and you can join it by clicking it.

[0248] 2.5. Remote takeover and training

[0249] Chat message function:

[0250] 1. If there are new unread chats, the number of chats will be displayed;

[0251] 2. Open the chat box and the chat content is read;

[0252] 3. Display chat content, including: avatar, text content, and time;

[0253] 4. Chat messages support keyboard input, Chinese and English, but not pictures;

[0254] 5. Close and hide the chat box;

[0255] Participants: List the participants and show the number of participants who have not joined the meeting.

[0256] 2.6. History

[0257] 1. List the historical records of initiation or participation in reverse order, including those that were not answered after application (displayed according to the backend data display parameter settings (for example, within 3 months);

[0258] 2. Display content: name, initiator's avatar, initiator, time, duration, recorded call or answering history; if there is a recording, you can watch it back; click to display historical details.

[0259] Through this method and device, the following are achieved:

[0260] (1) Different from the previous single video signal, through the access of multi-screen signals, experts can obtain patient positioning, real-time scanning of patient parameter information, high-pressure syringe images, and multi-view images of subordinate technicians in real time, which is convenient for experts to obtain guidance information in real time;

[0261] (2) The expert end can use the local keyboard and mouse to operate the control software of the remote CT / MR device, thereby realizing the remote takeover and control of the CT / MR device;

[0262] (3) Support remote control of CT / MR / DSA equipment of different brands and models; the implementation process of remote control is as follows: After the remote control function is turned on, the terminal's video decoding mode will switch from playback to preview. The system will begin to capture mouse events and transmit keyboard and mouse data to the remote peer using the UDP protocol. At the same time, the transmission protocol of video decoding is switched from Shinetcp to the UDP-based WebRTC protocol, which effectively reduces data transmission delay. Finally, the relevant events are accurately transmitted to the controlled PC through the built-in chip, thus achieving a complete remote control operation process.

[0263] (4) CT / MR equipment is in the intranet, and the internal and external networks are isolated by hardware. There is no need to install any software on the hospital's existing equipment, and no data docking or interface development is required;

[0264] (5) Experts can take over the control of the CT / MR equipment, and young technicians can follow the experts in operating the CT / MR equipment and better learn the operating techniques of the CT / MR equipment.

[0265] In some specific embodiments, Figure 5 As shown, a training device for doctors to remotely control large medical imaging equipment, the server side, expert side and control room side in the device include at least one processor and a memory storing instructions to implement any one of the training methods for doctors to remotely control large medical imaging equipment in the above technical solutions.

[0266] In some specific embodiments, a computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the steps in the above technical solution.

[0267] In some specific embodiments, a computer program product is provided, the computer program product includes a computer program, and when the computer program is executed by a processor, the method of implementing the steps in the above technical solution is implemented.

[0268] The embodiments and functional operations of the subject matter described in this specification may be implemented in: digital electronic circuitry, tangibly implemented computer software or firmware, computer hardware, including the structures disclosed in this specification and their structural equivalents, or a combination of more than one of the above. The embodiments of the subject matter described in this specification may be implemented as one or more computer programs, i.e., one or more modules of computer program instructions encoded on one or more tangible non-transitory program carriers, for execution by a data processing device or to control the operation of a data processing device.

[0269] Alternatively or additionally, the program instructions may be encoded on an artificially generated propagation signal, such as a machine-generated electrical, optical, or electromagnetic signal, which is generated to encode information for transmission to an appropriate receiver device for execution by a data processing device. The computer storage medium may be a machine-readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of one or more of the above devices.

[0270] A computer program (which may also be referred to or described as a program, software, software application, module, software module, script or code) may be written in any form of programming language, including compiled or interpreted languages ​​or declarative or procedural languages, and the computer program may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment. A computer program may, but need not, correspond to a file in a file system. A program may be stored in a portion of a file that stores other programs or data, for example, one or more scripts stored in the following: in a markup language document; in a single file dedicated to a related program; or in multiple collaborative files, for example, files storing one or more modules, subroutines or code portions. A computer program may be deployed to execute on one or more computers, the computers being located in one place or distributed to multiple locations and interconnected by a communication network.

[0271] The contents not described in detail in this specification belong to the prior art known to professional and technical personnel in this field.

[0272] Although the present invention has been described in detail above by general description, specific implementation methods and experiments, it is obvious to those skilled in the art that some modifications or improvements can be made to the present invention. Therefore, these modifications or improvements made without departing from the spirit of the present invention all belong to the scope of protection claimed by the present invention.

Claims

1. A method for training doctors to remotely control large medical imaging equipment, characterized in that: When the expert end takes over the control room end, perform the following steps: Presenting the control source of the controlled device in an interactive window, and controlling the controlled device located at the control room end according to the control instruction; receiving the transmission protocol and control source at the control room end, and presenting the control screen and control function on the interactive window; The video source of the controlled device is presented in a video window located on the same screen as the interactive window, and the video source at least includes camera acquisition at the control room end, camera acquisition at the expert end, control host screen, and positioning screen.

2. A method for training doctors to remotely control large medical imaging equipment according to claim 1, characterized in that: The method of presenting the control screen of the controlled device in an interactive window includes the following steps: The first interactive window presents the main screen; The second interactive window presents the real-time scanned patient parameter information in the secondary screen; Among them, the interactive window includes the first interactive window and the second interactive window; the control source includes the main screen image and the real-time scanned patient parameter information; the first interactive window and the second interactive window can switch screens and can interact with the control room end.

3. A method for training doctors to remotely control large medical imaging equipment according to claim 2, characterized in that: The method of presenting the control source of the controlled device in an interactive window includes the following steps: Control the remote controlled device by managing and configuring the main screen.

4. A method for training doctors to remotely control large medical imaging equipment according to claim 2, characterized in that: The controlling the controlled device at the control room end according to the control instruction to initiate teaching training comprises the following steps: Single-select or multi-select users in the training list and / or search users, send the selected user information to the control room, and initiate teaching training for the selected single or multiple people.

5. The method for training doctors to remotely control large medical imaging equipment according to claim 2, characterized in that: The step of controlling the controlled device located at the control room end according to the control instruction and initiating a remote takeover instruction comprises the following steps: Select a control room in the schedule, send the selected control room to the control room end, and initiate a remote takeover task; The first interactive window and the second interactive window screen after remote takeover are displayed, wherein: The main and sub-screen information includes: The second interactive window screen is a multi-source screen, which at least displays a patient positioning screen and real-time scanned patient parameter information.

6. A method for training doctors to remotely control large medical imaging equipment, characterized in that: The following steps are performed when the control room end is taken over by the expert end: Presenting the control source of the controlled device in a shared window, receiving the control source shared by the expert terminal, and presenting the control source in the shared window; The video source of the controlled device is presented in a video window located on the same screen as the sharing window, and the video source includes local camera acquisition and expert end camera acquisition.

7. A method for training doctors to remotely control large medical imaging equipment according to claim 6, characterized in that: Clicking the chat message button of the sharing window pops up a chat message dialog box, which covers part of the video window.

8. A method for training doctors to remotely control large medical imaging equipment according to claim 6, characterized in that: When the control room end is taken over by the expert end, the following steps are also performed: View available experts; Directly call an online expert or select an expert from the form, and send a request to the server to call the expert. If the competent expert is online, only the competent expert will be called; if the supervisor is not online, if there is only one expert available, the competent expert will be automatically called; if there are multiple optional experts, the expert list will be displayed, and after selecting multiple experts, a request to call the expert will be sent to the server, and confirmation from the expert on the server will be received; when the first expert answers the call, the call is successful; Wait for the expert to respond, the screen will show the waiting time, and enter the waiting queue; Cancel the call request information, hide the call waiting status, and delete it from the waiting queue.

9. The method for training doctors to remotely control large medical imaging equipment according to claim 6, characterized in that: When the control room end is taken over by the expert end, the following steps are also performed: Receive the quick join takeover invitation code sent by the expert; Join the takeover queue.

10. A training device for doctors to remotely control large medical imaging equipment, characterized in that: The expert end of the device includes at least one processor and a memory storing instructions. When the instructions are executed by at least one processor, a training method for doctors to remotely control large medical imaging equipment as described in any one of claims 1 to 5 is implemented.

Images