Multi-screen medical equipment remote accurate control positioning method and system

Abstract

The invention belongs to the technical field of medical equipment control, and provides a multi-screen medical equipment remote accurate control positioning method and system, and the method comprises the steps: employing a hardware connection mode, enabling an image collection device to be connected with a hardware connection device, guaranteeing the stable input of an image signal, two output ports of the hardware connection device are respectively connected with a real-time screen and a comparison screen through standard data lines, and connection parameters are adjusted, so that stable transmission and synchronous control of display contents of the two screens are realized; according to the method, accurate positioning of the mouse on the two display screens is achieved through a positioning algorithm built in hardware, when the mouse is in the real-time screen, only the mouse is displayed on the real-time screen, and when the mouse moves to the boundary of the comparison screen and continues to move, the mouse can automatically and accurately display on the comparison screen; and the position of the mouse accurately corresponds to an actual operation position, so that a solid guarantee is provided for reliable operation of medical equipment.

Description

Technical Field

[0001] The present invention belongs to the technical field of medical device control, and particularly relates to a method and system for remote precise control and positioning of multi-screen medical devices. Background Art

[0002] In the modern medical field, with the rapid development of medical technology and the continuous increase in the requirements for the refinement of disease diagnosis and treatment, the application of multi-screen medical devices shows an increasingly extensive and in-depth trend. Especially in scenarios such as operating rooms where there are almost demanding requirements for precision, the role of multi-screen devices becomes more prominent. Every operation in the operating room is related to the life and health of patients. Doctors need to obtain comprehensive and accurate information in a very short time to make correct decisions.

[0003] Taking DSA (Digital Subtraction Angiography) devices as an example, the real-time screen and comparison screen equipped with them play an irreplaceable role during the operation. The real-time screen can present the dynamic images of the internal structures such as the patient's blood vessels under the action of contrast agents in real time. Doctors can directly observe the blood flow, blood vessel morphology, and real-time changes in the lesion site. The comparison screen is like a powerful information storage and analysis platform. It can integrate and display the patient's preoperative imaging data, examination results at different stages, and other relevant medical data. By using the real-time screen and the comparison screen in coordination, doctors can, during the operation, while closely observing the real-time progress of the operation, at any time retrieve the historical data and relevant reference information on the comparison screen, and conduct a comprehensive and multi-angle observation and in-depth analysis of the patient's imaging information.

[0004] This multi-dimensional observation and analysis method helps doctors more accurately grasp the subtle changes in the patient's condition, and accurately judge the location, scope, and nature of the lesion. For example, during a cardiovascular intervention operation, doctors can clearly see the real-time progress of the catheter in the blood vessel through the real-time screen, and at the same time, compare it with the preoperative angiography image on the comparison screen to accurately avoid blood vessel stenosis or malformation sites and select the best surgical path. Another example is in tumor resection surgery. The multi-modal image fusion information on the comparison screen can help doctors more accurately distinguish the boundary between tumor tissue and normal tissue, so as to achieve a more complete tumor resection and minimize the damage to surrounding normal tissue. In short, the coordinated work of the real-time screen and the comparison screen provides solid information support for doctors to make more accurate diagnosis and treatment decisions, and is of crucial significance for improving the success rate of the operation, ensuring the treatment effect and life safety of patients.

[0005] However, the traditional hardware connection method can only achieve simple screen display functions and cannot solve the problem of accurate positioning of the mouse between different screens. During remote control, problems such as latency and positioning deviation are more likely to occur, seriously affecting the accuracy and efficiency of medical operations and even potentially having an adverse impact on the treatment effect of patients. Therefore, it is urgent to develop a method that can achieve remote precise control and positioning of multi-screen medical devices without the need for third-party software. Summary of the Invention

[0006] To solve the above technical problems, the present invention provides a method and system for remote precise control and positioning of multi-screen medical devices to solve the problem that the traditional hardware connection method in the prior art can only achieve simple screen display functions and cannot solve the problem of accurate positioning of the mouse between different screens.

[0007] A method and system for remote precise control and positioning of multi-screen medical devices include the following steps:

[0008] S1. Adopt a hardware connection method to connect the image acquisition device to the hardware connection device to ensure stable input of the image signal. Then, connect the two output ports of the hardware connection device to the real-time screen and the comparison screen respectively through standard data cables, and adjust the connection parameters to achieve stable transmission and synchronous control of the display content on the two screens.

[0009] S2. Set positioning calibration parameters in the hardware connection device through a positioning algorithm based on coordinate mapping and boundary detection built into the hardware to calibrate the initial positions of the mouse on the real-time screen and the comparison screen. Continuously monitor the movement trajectory of the mouse, and use the coordinate mapping algorithm to accurately convert the movement of the mouse in the physical space into coordinate changes on the screen. When the mouse approaches the boundary between the real-time screen and the comparison screen, automatically judge through the boundary detection algorithm and prepare to switch the mouse display to the comparison screen to achieve accurate positioning of the mouse on the two display screens.

[0010] S3. Install remote control software matching the hardware connection device on the remote control end and establish a stable connection through the network. The operator operates input devices such as the mouse and keyboard on the remote control end, and the remote control software transmits the operation signals to the hardware connection device. The hardware connection device accurately controls the movement and operation of the mouse on the real-time screen and the comparison screen according to the received signals, and real-time feedbacks the operation state of the mouse and the display content of the screen to the remote control end.

[0011] Preferably, the hardware connection method can achieve stable control of multi-screen medical devices without installing third-party software.

[0012] Preferably, for the positioning algorithm built into the hardware, the algorithm uses the following formula to calculate the coordinates (x 1 , y 1):

[0013]

[0014] Among them, (x 0 , y 0 ) is the starting coordinate of the mouse on the real-time screen, (x m , y m ) is the current coordinate of the mouse on the real-time screen, D 实时 and D 对比 are the resolution or size ratio factors of the real-time screen and the comparison screen respectively.

[0015] Preferably, the remote control software is connected to the hardware connection device.

[0016] Preferably, the hardware connection device adopts a high-speed data transmission interface.

[0017] Preferably, the setting of the positioning and calibration parameters is based on multiple sets of experimental data and optimized through machine learning algorithms to improve the accuracy of mouse positioning. Let the positioning error be E, and by minimizing the objective function

[0018]

[0019] Using the gradient descent algorithm

[0020]

[0021] (where θ j is the model parameter and α is the learning rate) continuously optimize the coordinate mapping and boundary detection.

[0022] Preferably, when the remote control software establishes a connection with the hardware connection device, an encrypted transmission protocol is adopted to ensure the security of the operation signal transmission.

[0023] Preferably, the hardware connection device has an automatic detection function. When an abnormal image signal is detected, it can issue an alarm in time and perform self-repair. Among them, the automatic detection function is based on a signal feature recognition algorithm. Let the image signal be S(t), and by analyzing its frequency (T is the signal period), amplitude A and other features to judge whether the signal is abnormal. When or , it is determined that the signal is abnormal.

[0024] Preferably, the remote control end is equipped with a setting module for adjusting the operation sensitivity, which is convenient for the operator to adjust the operation sensitivity according to his own habits. Let the operation sensitivity parameter be k, and this setting module is associated with an operation signal processing algorithm to amplify or reduce the mouse movement signal according to the set sensitivity parameter. Let the original mouse movement signal be (dx, dy), and the processed signal be (k·dx, k·dy).

[0025] A system for a remote precise control and positioning method of a multi-screen medical device, comprising:

[0026] A hardware connection device, used to connect an image acquisition device to a real-time screen and a comparison screen, realizing stable transmission of image signals and synchronous control of the screen display content;

[0027] A positioning module, integrated in the hardware connection device, with a built-in positioning algorithm, used to achieve precise positioning of the mouse on two display screens;

[0028] A remote control terminal, including remote control software matching the hardware connection device and input devices such as a mouse and a keyboard, used to remotely control a multi-screen medical device.

[0029] Compared with the prior art, the present invention has the following beneficial effects:

[0030] 1. Through the positioning algorithm built into the hardware, the present invention realizes precise positioning of the mouse on two display screens. When the mouse is on the real-time screen, only the real-time screen displays the mouse. When the mouse moves to the boundary of the comparison screen and continues to move, the mouse can automatically and precisely be displayed on the comparison screen, and it is ensured that the position of the mouse exactly corresponds to the actual operation position, without relying on third-party software, effectively solving the problem of difficult software access in the medical environment, ensuring the security and stability of the system, and providing a solid guarantee for the reliable operation of medical devices.

[0031] 2. The present invention utilizes the remote control module, combined with the above-mentioned hardware connection and positioning technologies, to realize remote operation of a multi-screen medical device. An operator can remotely control the movement and operation of the mouse between two screens as precisely as if operating locally through the device, and there will be no delay or positioning deviation.

[0032] 3. In the present invention, the hardware connection device adopts a high-speed data transmission interface, accelerating the transmission rate of image signals, reducing image stuttering and delay phenomena, enabling doctors to view patient images in real time and clearly, and providing support for timely diagnosis and treatment. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the drawings required for description in the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts. Among them:

[0034] Figure 1 It is a block diagram of the method steps of the present invention;

[0035] Figure 2This is the system module block diagram of the present invention. Detailed implementation manners

[0036] The following further describes in detail the implementation manners of the present invention in conjunction with the accompanying drawings and embodiments. The following embodiments are used to illustrate the present invention, but cannot be used to limit the scope of the present invention.

[0037] As shown in the Figure 1 accompanying drawings:

[0038] Embodiment 1: The present invention provides a method for remotely and precisely controlling and positioning a multi-screen medical device, including the following steps:

[0039] S1. Adopt a hardware connection method to connect the image acquisition device to the hardware connection device. The image signals obtained by the image acquisition device are transmitted to the hardware connection device through an adapted interface in a specific electrical protocol to ensure stable and distortion-free input of the signals. The hardware connection device has dual output ports, which are respectively connected to the real-time screen and the comparison screen through standard data lines. During the connection process, the connection parameters are carefully adjusted according to parameters such as the resolution and refresh rate of the screen, for example, setting appropriate video transmission protocols, data transmission rates, etc., so as to achieve stable transmission and synchronous control of the display content on the two screens, and ensure that the real-time screen and the comparison screen can accurately present the image information captured by the image acquisition device;

[0040] S2. Set positioning calibration parameters in the hardware connection device through a positioning algorithm based on coordinate mapping and boundary detection built into the hardware to calibrate the initial positions of the mouse on the real-time screen and the comparison screen; continuously monitor the movement trajectory of the mouse, and use the coordinate mapping algorithm to accurately convert the movement of the mouse in the physical space into coordinate changes on the screen. When the mouse approaches the boundary between the real-time screen and the comparison screen, automatically judge through the boundary detection algorithm and prepare to switch the mouse display to the comparison screen; assume that the coordinates of the mouse in the physical space are (x phy , y phy ), and through the coordinate mapping function f(x phy , y phy ) = (x scr , y scr ), convert it into the coordinates (x scr , y scr ) on the screen, where the coordinate mapping function f is determined by parameters such as the screen resolution and the relative position between the physical device and the screen; when the mouse approaches the boundary between the real-time screen and the comparison screen, automatically judge through the boundary detection algorithm and prepare to switch the mouse display to the comparison screen. Assume that the boundary coordinate range of the real-time screen is [x 1 , x 2 , [y 1 , y 2 , and the boundary coordinate range of the comparison screen is [x 3 , x4 , [y 3 , y 4 , when (x scr , y scr ) satisfies ((x scr ≥x 2 ∧x scr ≤x 3 ) ∨ (y scr ≥y 2 ∧y scr ≤y 3 ), the mouse display switching is triggered to achieve precise positioning of the mouse on two display screens;

[0041] S3. Install remote control software on the remote control terminal that matches the hardware connection device. Through wired or wireless network connection methods, using specific network protocols such as the TCP / IP protocol, establish a stable connection between the remote control software and the hardware connection device. The operator operates input devices such as the mouse and keyboard on the remote control terminal. The remote control software encodes and processes these operation signals, converts them into a format suitable for network transmission, and then transmits them to the hardware connection device through the network. After receiving the signal, the hardware connection device decodes and analyzes it, and precisely controls the movement and operation of the mouse on the real-time screen and the comparison screen according to the parsed instructions. At the same time, the hardware connection device real-time collects the operation status information of the mouse and the key feature data of the screen display content, such as the current coordinates of the mouse, the click status, the image features of a specific area on the screen, etc., encodes these data and feeds them back to the remote control terminal so that the operator can timely understand the operation results.

[0042] Specifically, the hardware connection method can achieve stable control of multi-screen medical devices without installing third-party software;

[0043] As can be seen from the above: By adopting customized circuit design and signal processing chips, it does not rely on third-party software for signal conversion and transmission control. The circuit layout inside the hardware connection device is optimized to reduce signal interference and transmission loss, directly adapt and process the signals output by the image acquisition device, and then transmit them to the screen, so as to achieve stable control of multi-screen medical devices without installing third-party software.

[0044] Specifically, the positioning algorithm built into the hardware uses the following formula to calculate the coordinates (x 1 , y 1 ) of the mouse pointer on the comparison screen:

[0045]

[0046] Among them, (x 0 , y 0) is the starting coordinate of the mouse on the real-time screen, (x m , y m ) is the current coordinate of the mouse on the real-time screen, D 实时 and D 对比 are the resolution or size scale factors of the real-time screen and the comparison screen respectively.

[0047] As can be seen from the above: This calculation process is completed inside the hardware interface device without relying on software-level processing, thus ensuring the real-time and accuracy of the mouse pointer switching between multiple screens.

[0048] Specifically, the connection between the remote control software and the hardware connection device;

[0049] As can be seen from the above: The adaptive network bandwidth adjustment technology is adopted. During the network transmission process, network bandwidth, delay and other parameters are monitored in real time. When the network condition is good, the data transmission rate is increased to ensure the real-time of operations; when network congestion or increased delay occurs, the data transmission volume is automatically reduced, and the transmission of key operation signals is prioritized to ensure that there is no delay or positioning deviation for the operator during remote control.

[0050] Specifically, the hardware connection device adopts a high-speed data transmission interface;

[0051] Among them, the high-speed data transmission interface is a USB3.0 or Thunderbolt interface;

[0052] As can be seen from the above: These interfaces have the characteristics of high bandwidth and low delay. During the image signal transmission process, they can quickly transmit the high-definition image data obtained by the image acquisition device to the screen at a data transmission rate of several GB per second, greatly improving the transmission rate and stability of the image signal, and reducing image stuttering and delay phenomena.

[0053] Specifically, the setting of the positioning calibration parameters is based on multiple groups of experimental data and optimized through machine learning algorithms to improve the accuracy of mouse positioning. Let the positioning error be E, and by minimizing the objective function

[0054]

[0055] Using the gradient descent algorithm

[0056]

[0057] (where θ j is the model parameter and α is the learning rate) continuously optimizes the coordinate mapping and boundary detection.

[0058] Specifically, when the remote control software establishes a connection with the hardware connection device, an encrypted transmission protocol is adopted to ensure the security of the operation signal transmission;

[0059] As can be seen from the above: Before data transmission, the operation signal is encrypted to convert the plaintext data into ciphertext. The data is encrypted and decrypted using a key. During the transmission process, even if the data is intercepted by a third party, without the correct key, the true content of the operation signal cannot be obtained.

[0060] Specifically, the hardware connection device has an automatic detection function. When an abnormal image signal is detected, it can promptly issue an alarm and perform self-repair. The automatic detection function is based on a signal feature recognition algorithm. Let the image signal be S(t). By analyzing its frequency (T is the signal period), amplitude A, and other features to determine whether the signal is abnormal. When or , the signal is determined to be abnormal.

[0061] Specifically, the remote control end is equipped with a setting module for adjusting the operation sensitivity, which facilitates the operator to adjust the operation sensitivity according to their own habits. Let the operation sensitivity parameter be k. This setting module is associated with an operation signal processing algorithm and amplifies or reduces the mouse movement signal according to the set sensitivity parameter. Let the original mouse movement signal be (dx, dy), and the processed signal be (k·dx, k·dy);

[0062] As can be seen from the above: Once an abnormality is detected, the hardware connection device automatically activates the backup signal transmission channel and simultaneously diagnoses and repairs the main signal transmission channel. For example, by detecting short circuits and open circuits in the signal transmission line and automatically adjusting the gain of the signal amplifier, etc., the normal signal transmission is restored.

[0063] As shown in the Figure 2 appendix:

[0064] Embodiment 2:

[0065] A system for a remote precise control and positioning method of a multi-screen medical device, including:

[0066] A hardware connection device that connects the image acquisition device to the real-time screen and the comparison screen through a specific interface and circuit design. During the signal transmission process, according to the signal type and screen requirements, signal conversion, amplification, noise reduction, etc. are performed to achieve stable transmission of the image signal and synchronous control of the screen display content.

[0067] A positioning module integrated in the hardware connection device, with a built-in positioning algorithm. By collecting and analyzing the mouse sensor data in real time and combining the coordinate mapping and boundary detection algorithms, the physical position of the mouse is accurately converted into the coordinate position on the screen, realizing precise positioning of the mouse on the two display screens.

[0068] The remote control terminal includes remote control software that matches the hardware connection device, as well as input devices such as a mouse and a keyboard. The operator operates the input devices to generate operation signals. After encoding and encrypting these signals, the remote control software transmits them to the hardware connection device through the network to achieve remote control of the multi-screen medical device. At the same time, it receives the operation status and screen information feedback from the hardware connection device and presents them to the operator.

[0069] Importantly, it should be noted that the construction and arrangement of the present application shown in multiple different exemplary embodiments are merely illustrative. Although only a few embodiments are described in detail in this disclosure, those who refer to this disclosure should easily understand that many modifications are possible without materially departing from the novel teachings and advantages of the subject matter described in this application (for example, the dimensions, scales, structures, shapes and proportions of various elements, as well as parameter values (such as temperature, pressure, etc.), installation arrangements, use of materials, color, orientation changes, etc.). For example, an element shown as integrally formed may be composed of multiple parts or elements, the position of the element may be inverted or otherwise changed, and the nature or number or position of discrete elements may be changed or altered. Therefore, all such modifications are intended to be included within the scope of the present invention. The order or sequence of any process or method steps may be changed or reordered according to alternative embodiments. In the claims, any "means-plus-function" clause is intended to cover the structures that perform the recited function herein, and not only structural equivalents but also equivalent structures. Other substitutions, modifications, changes and omissions may be made in the design, operating conditions and arrangement of the exemplary embodiments without departing from the scope of the present invention. Therefore, the present invention is not limited to a particular embodiment, but extends to various modifications that still fall within the scope of the appended claims.

[0070] In addition, in order to provide a concise description of the exemplary embodiments, not all features of the actual embodiments may be described (i.e., those features that are not relevant to the currently considered best mode of implementing the present invention or those features that are not relevant to implementing the present invention).

[0071] It should be understood that in the development of any actual implementation, such as in any engineering or design project, a large number of specific implementation decisions may be made. Such development efforts may be complex and time-consuming, but for those of ordinary skill in the art who benefit from this disclosure, without excessive experimentation, such development efforts will be a routine task of design, manufacturing and production.

[0072] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present invention, and they should all be covered within the scope of the claims of the present invention.

Claims

1. A method for remote precise control and positioning of multi-screen medical equipment, characterized in that: The following steps are involved: S1. Use hardware connection to connect the image acquisition device to the hardware connection device to ensure stable input of the image signal. Then connect the two output ports of the hardware connection device to the real-time screen and the comparison screen through standard data cables, and adjust the connection parameters to achieve stable transmission and synchronous control of the display contents of the two screens. S2. By using the hardware-built-in positioning algorithm based on coordinate mapping and boundary detection, the positioning calibration parameters are set in the hardware connection device to calibrate the initial position of the mouse on the real-time screen and the comparison screen; the movement trajectory of the mouse is monitored in real time, and the movement of the mouse in the physical space is accurately converted into the coordinate change on the screen by using the coordinate mapping algorithm. When the mouse approaches the boundary between the real-time screen and the comparison screen, the boundary detection algorithm is used to automatically judge and prepare to switch the mouse display to the comparison screen, so as to realize the accurate positioning of the mouse on the two display screens; S3. Install remote control software that matches the hardware connection device on the remote control end and establish a stable connection through the network; the operator operates input devices such as the mouse and keyboard on the remote control end, and the remote control software transmits the operation signal to the hardware connection device. The hardware connection device accurately controls the movement and operation of the mouse on the real-time screen and the comparison screen based on the received signal, and feeds back the mouse operation status and screen display content to the remote control end in real time.

2. According to claim 1, a multi-screen medical device remote precise control positioning method is characterized by: The hardware connection method can achieve stable control of multi-screen medical equipment without installing third-party software.

3. According to claim 2, a multi-screen medical device remote precise control positioning method is characterized by: The hardware built-in positioning algorithm uses the following formula to calculate the coordinates of the mouse pointer on the comparison screen (x 1 ,y 1 ): Among them, (x0, y0) is the starting coordinate of the mouse on the real-time screen, (x m ,y m ) The current coordinates of the mouse on the real-time screen, D 实时 and D 对比 These are the resolution or size ratio factors of the real-time screen and the comparison screen, respectively.

4. According to claim 1, a multi-screen medical device remote precise control positioning method is characterized by: The remote control software is connected to the hardware connection device.

5. According to claim 1, a multi-screen medical device remote precise control positioning method is characterized by: The hardware connection device adopts a high-speed data transmission interface.

6. According to claim 1, a multi-screen medical device remote precise control positioning method is characterized by: The positioning calibration parameters are set based on multiple sets of experimental data and optimized through machine learning algorithms to improve the accuracy of mouse positioning. The positioning error is set to E, and the objective function is minimized. Using the gradient descent algorithm (where θ j is the model parameter, α is the learning rate) to continuously optimize the coordinate mapping and boundary detection.

7. According to claim 1, a multi-screen medical device remote precise control positioning method is characterized by: When the remote control software establishes a connection with the hardware connection device, an encrypted transmission protocol is used to ensure the security of operation signal transmission.

8. According to claim 1, a multi-screen medical device remote precise control positioning method is characterized by: The hardware connection device has an automatic detection function. When an abnormal image signal is detected, it can issue an alarm in time and perform self-repair. The automatic detection function is based on a signal feature recognition algorithm. Suppose the image signal is S(t). By (T is the signal period), amplitude A and other characteristic analysis to determine whether the signal is abnormal. or When , the signal is judged to be abnormal.

9. According to claim 1, a multi-screen medical device remote precise control positioning method is characterized by: The remote control terminal is equipped with a setting module for adjusting the operation sensitivity, which is convenient for the operator to adjust the operation sensitivity according to his own habits. The operation sensitivity parameter is set to k. The setting module is associated with the operation signal processing algorithm, and the mouse movement signal is amplified or reduced according to the set sensitivity parameter. The original mouse movement signal is set to (dx, dy), and the processed signal is (k·dx, k·dy).

10. A system for implementing the remote precise control and positioning method of a multi-screen medical device according to any one of claims 1 to 9, characterized in that: include: Hardware connection device, used to connect the image acquisition device with the real-time screen and comparison screen to achieve stable transmission of image signals and synchronous control of screen display content; The positioning module is integrated in the hardware connection device and has a built-in positioning algorithm to achieve accurate positioning of the mouse on the two display screens; The remote control terminal includes remote control software that matches the hardware connection device and input devices such as mouse and keyboard, which are used to realize remote control of multi-screen medical equipment.

Images