Multi-screen medical equipment remote control method based on image recognition

Abstract

The invention relates to the technical field of medical equipment remote control, and particularly discloses a multi-screen medical equipment remote control method based on image recognition, which comprises the following steps of: 1, capturing a medical image on multi-screen medical equipment in real time through a high-precision image sensor, and carrying out preprocessing operations such as de-noising and contrast enhancement on the image; step 2, utilizing a deep learning algorithm and a pre-trained image recognition model to perform feature extraction and recognition on the preprocessed medical image; according to the remote medical equipment control method, the completeness of the medical image capturing and processing technology of the remote medical equipment control method is improved through the cooperation of multiple steps, the influence of factors such as ambient light, motion artifacts and optical distortion on the image quality is reduced, and the diagnosis accuracy of the remote medical equipment control method is improved; and meanwhile, the identification precision and the real-time performance of the application in the medical field are improved, and the phenomena of data transmission delay and data leakage in the remote transmission process are avoided.

Description

Technical Field

[0001] The present invention belongs to the technical field of remote control of medical devices, and particularly relates to a method for remotely controlling multi-screen medical devices based on image recognition. Background Art

[0002] Remote control of multi-screen medical devices based on image recognition is an advanced medical technology that combines various technologies such as image recognition, multi-screen display, and remote control, bringing revolutionary changes to the medical field. With the continuous development of medical technology, telemedicine has become an important development direction in the medical field. The traditional way of controlling medical devices relies on on-site operation, which to a certain extent limits the allocation and utilization efficiency of medical resources. To overcome this limitation, realizing the remote control of medical devices has become an urgent problem to be solved.

[0003] However, there are many deficiencies in the existing methods for remotely controlling medical devices. The technologies for capturing and processing medical images are not yet perfect, and the image quality is easily affected by factors such as ambient light, motion artifacts, and optical distortion, resulting in a decrease in diagnostic accuracy. At the same time, although there has been some progress in image recognition technology, its application in the medical field still faces problems such as low recognition accuracy and poor real-time performance. Moreover, the stability and security of data during the remote transmission process are also a major challenge. Transmission delay and data leakage may both have an adverse impact on medical services. Therefore, a method for remotely controlling multi-screen medical devices based on image recognition is proposed. Summary of the Invention

[0004] The purpose of the present invention is to provide a method for remotely controlling multi-screen medical devices based on image recognition to solve the problems that the technologies for capturing and processing medical images are not yet perfect, the image quality is easily affected by factors such as ambient light, motion artifacts, and optical distortion, resulting in a decrease in diagnostic accuracy; at the same time, although there has been some progress in image recognition technology, its application in the medical field still faces problems such as low recognition accuracy and poor real-time performance, and the stability and security of data during the remote transmission process are also a major challenge. Transmission delay and data leakage may both have an adverse impact on medical services.

[0005] To achieve the above purpose, the present invention provides the following technical solutions:

[0006] A method for remotely controlling multi-screen medical devices based on image recognition, comprising:

[0007] Step 1: Real-time capture medical images on a multi-screen medical device through a high-precision image sensor, and perform preprocessing operations such as denoising and enhancing contrast on the images;

[0008] Step 2: Use a deep learning algorithm and a pre-trained image recognition model to extract features and perform recognition on the preprocessed medical images;

[0009] Step 3: Transmit the recognized medical image and its recognition result to the remote control terminal through a high-speed and low-latency network transmission protocol;

[0010] Step 4: On the remote control terminal, the user inputs remote control instructions according to the recognized medical image through input devices such as a touch screen, keyboard, and mouse;

[0011] Step 5: Transmit the remote control instructions back to the multi-screen medical device through an encrypted communication protocol, and the device performs corresponding operations according to the instructions.

[0012] Through the settings of the above step solution, a high-precision image sensor is used to capture medical images in real time, and preprocessing operations such as denoising and enhancing contrast are performed to eliminate noise and distortion in the images, improve the stability and accuracy of the images. At the same time, an adaptive exposure technology is introduced to automatically adjust the exposure parameters of the image sensor according to the ambient light to obtain the best image effect; deep learning algorithms and pre-trained image recognition models are used to extract features and recognize the preprocessed medical images, supporting real-time image annotation and measurement functions. At the same time, an image segmentation technology is introduced to accurately segment different tissues or organs in the medical images for more in-depth analysis and diagnosis; the recognized medical images and their recognition results are transmitted to the remote control terminal through a high-speed and low-latency network transmission protocol. At the same time, an image compression technology is introduced to reduce the amount of transmitted data while ensuring image quality and improve transmission efficiency; multiple input methods are provided on the remote control terminal, including touch screen, keyboard, mouse, and voice control, to facilitate the user to input remote control instructions. At the same time, natural language processing technology is introduced to allow the user to input control instructions through natural language, improving the convenience and flexibility of control; the remote control instructions are transmitted back to the multi-screen medical device through an encrypted communication protocol to ensure the security of data transmission, and the device performs corresponding operations according to the instructions to achieve remote control.

[0013] Preferably, the image capture further includes real-time detection and compensation of motion artifacts and optical distortions in the image, and an adaptive exposure technology is introduced to automatically adjust the exposure parameters of the image sensor according to the ambient light.

[0014] Preferably, the image recognition further includes using the multi-layer structure of a convolutional neural network (CNN) to extract feature information of different scales from the medical image; and combining the local features and global context information of the medical image.

[0015] Preferably, the image recognition and transmission further includes introducing an image compression technology.

[0016] Preferably, the remote control terminal further includes introducing natural language processing technology to allow the user to input control instructions through natural language.

[0017] Preferably, the operation content of the remote control instruction is to adjust the camera angle, focal length, zoom in or out the image, and mark the lesion area.

[0018] Preferably, the input methods of the remote control terminal include touch screen, keyboard, mouse and voice control. The input methods are used for the user to input remote control instructions, and according to the instructions input by the user, perform instruction parsing and conversion to generate executable device control commands.

[0019] Preferably, the image recognition is to accurately segment different tissues or organs in the medical image by introducing image segmentation technology for more in-depth analysis and diagnosis. The recognition content includes lesion areas, organ contours and surgical instruments.

[0020] In summary, the perfection of the medical image capture and processing technology of the remote medical device control method is increased, the influence of factors such as environmental light, motion artifacts and optical distortion on the image quality is reduced, and the accuracy of the diagnosis of the remote medical device control method is improved; at the same time, the recognition accuracy and real-time problems in the application in the medical field are improved, and the phenomenon of data transmission delay and data leakage during the remote transmission process is avoided.

[0021] Compared with the prior art, the beneficial effects of the present invention are:

[0022] Use a high-precision image sensor to capture medical images in real time, and perform preprocessing operations such as denoising and enhancing contrast to eliminate noise and distortion in the images, improve the stability and accuracy of the images. At the same time, introduce an adaptive exposure technology to automatically adjust the exposure parameters of the image sensor according to the environmental light to obtain the best image effect;

[0023] Use deep learning algorithms and pre-trained image recognition models to extract features and recognize the preprocessed medical images, support real-time image annotation and measurement functions. At the same time, introduce image segmentation technology to accurately segment different tissues or organs in the medical image for more in-depth analysis and diagnosis; transmit the recognized medical images and their recognition results to the remote control terminal through a high-speed, low-latency network transmission protocol;

[0024] At the same time, introduce image compression technology to reduce the amount of transmitted data while ensuring image quality and improve transmission efficiency; provide multiple input methods on the remote control terminal, including touch screen, keyboard, mouse and voice control, to facilitate the user to input remote control instructions;

[0025] Introduce natural language processing technology to allow users to manipulate instructions through natural language input, improving the convenience and flexibility of manipulation; transmit the remote control instructions back to the multi-screen medical device through an encrypted communication protocol to ensure the security of data transmission, and the device performs corresponding operations according to the instructions to achieve remote control;

[0026] In summary, it improves the perfection of the medical image capture and processing technology of the remote medical device control method, reduces the influence of factors such as environmental light, motion artifacts, and optical distortion on the image quality, and improves the diagnostic accuracy of the remote medical device control method; at the same time, it improves the recognition accuracy and real-time performance in the medical field application, and avoids the phenomenon of data transmission delay and data leakage during remote transmission. Brief Description of the Drawings

[0027] Figure 1 It is a flowchart of the steps of the present invention. Detailed Embodiments

[0028] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0029] As Figure 1 shown, a remote control method for a multi-screen medical device based on image recognition includes:

[0030] Step 1: Use a high-precision image sensor to capture medical images in real time on the multi-screen medical device, and perform preprocessing operations such as denoising and enhancing contrast on the images, detect and compensate for motion artifacts and optical distortion in the images in real time to ensure the stability and accuracy of the images; introduce an adaptive exposure technology to automatically adjust the exposure parameters of the image sensor according to the ambient light to obtain the best image effect and improve the image quality;

[0031] Step 2: Use deep learning algorithms and pre-trained image recognition models to extract features and recognize the preprocessed medical images, support real-time image annotation and measurement functions, such as annotating lesion areas, measuring blood vessel diameters, calculating tissue areas, etc.; introduce image segmentation technology to accurately segment different tissues or organs in the medical images for more in-depth analysis and diagnosis, and the recognized content includes lesion areas, organ contours, and surgical instruments;

[0032] Step 3: Transmit the recognized medical images and their recognition results to the remote control terminal through a high-speed and low-latency network transmission protocol. Introduce image compression technology to reduce the amount of transmitted data and improve the transmission efficiency while ensuring image quality;

[0033] Step 4: On the remote control terminal, the user inputs remote control instructions according to the recognized medical images through input devices such as touchscreens, keyboards, and mice. Introduce natural language processing technology to allow the user to input control instructions through natural language, improving the convenience and flexibility of operation. On the remote control terminal, provide multiple input methods. The input methods of the remote control terminal include touchscreens, keyboards, mice, and voice control, facilitating the user to input remote control instructions; Parse and convert the instructions according to the user's input to generate executable device control commands;

[0034] Step 5: Transmit the remote control instructions back to the multi-screen medical device through an encrypted communication protocol. The device performs corresponding operations according to the instructions. The operation content of the remote control instructions is to adjust the camera angle, focal length, zoom in or out the image, and mark the lesion area. Transmit the parsed device control commands back to the multi-screen medical device through an encrypted communication protocol; The multi-screen medical device performs corresponding operations according to the received commands, supports the real-time feedback function, and transmits the execution results of the device to the remote control terminal in real time.

[0035] Through the settings of the above step solutions, use a high-precision image sensor to capture medical images in real time and perform preprocessing operations such as denoising and enhancing contrast to eliminate noise and distortion in the images, improving the stability and accuracy of the images. At the same time, introduce adaptive exposure technology to automatically adjust the exposure parameters of the image sensor according to the ambient light to obtain the best image effect; Use deep learning algorithms and pre-trained image recognition models to extract features and recognize the preprocessed medical images, support real-time image annotation and measurement functions. At the same time, introduce image segmentation technology to accurately segment different tissues or organs in the medical images for more in-depth analysis and diagnosis; Transmit the recognized medical images and their recognition results to the remote control terminal through a high-speed and low-latency network transmission protocol. At the same time, introduce image compression technology to reduce the amount of transmitted data and improve the transmission efficiency while ensuring image quality; Provide multiple input methods on the remote control terminal, including touchscreens, keyboards, mice, and voice control, facilitating the user to input remote control instructions. At the same time, introduce natural language processing technology to allow the user to input control instructions through natural language, improving the convenience and flexibility of operation; Transmit the remote control instructions back to the multi-screen medical device through an encrypted communication protocol to ensure the security of data transmission. The device performs corresponding operations according to the instructions to achieve remote control;

[0036] In summary, the perfection of the capture and processing technology of medical images for the remote medical device control method is increased, the influence of factors such as environmental light, motion artifacts, and optical distortion on the image quality is reduced, and the diagnostic accuracy of the remote medical device control method is improved; at the same time, the recognition accuracy and real-time problems in the application in the medical field are improved, and the phenomena of data transmission delay and data leakage during the remote transmission process are avoided.

[0037] Although the embodiments of the present invention have been shown and described, those of ordinary skill in the art can understand that various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A multi-screen medical equipment remote control method based on image recognition, characterized in that: include: Step 1: Use high-precision image sensors to capture medical images in real time on multi-screen medical devices, and perform pre-processing operations such as denoising and contrast enhancement on the images; Step 2: Use deep learning algorithms and pre-trained image recognition models to extract and recognize features of pre-processed medical images; Step 3: Transmit the identified medical image and its identification results to the remote control terminal via a high-speed, low-latency network transmission protocol; Step 4: On the remote control terminal, the user inputs remote control commands based on the identified medical images through input devices such as a touch screen, keyboard, and mouse; Step 5: Transmit the remote control instructions back to the multi-screen medical device through an encrypted communication protocol, and the device performs corresponding operations according to the instructions.

2. According to claim 1, a multi-screen medical equipment remote control method based on image recognition is characterized in that: The image capture also includes real-time detection and compensation of motion artifacts and optical distortion in the image, and the introduction of adaptive exposure technology to automatically adjust the exposure parameters of the image sensor according to the ambient light.

3. The method for remotely controlling a multi-screen medical device based on image recognition according to claim 1, characterized in that: The image recognition also includes using a multi-layer structure of a convolutional neural network (CNN) to extract feature information of different scales from the medical image; and combining local features and global context information of the medical image.

4. The method for remotely controlling a multi-screen medical device based on image recognition according to claim 1, characterized in that: The image recognition transmission also includes introducing image compression technology.

5. The method for remotely controlling a multi-screen medical device based on image recognition according to claim 1, characterized in that: The remote control terminal also includes the introduction of natural language processing technology, allowing the user to input control instructions through natural language.

6. The method for remotely controlling a multi-screen medical device based on image recognition according to claim 1, characterized in that: The operation contents of the remote control instructions are to adjust the camera angle, focal length, zoom in or out the image and mark the lesion area.

7. The method for remotely controlling a multi-screen medical device based on image recognition according to claim 1, characterized in that: The input methods of the remote control terminal include touch screen, keyboard, mouse and voice control. The input methods are used to allow users to input remote control instructions, and according to the instructions input by the user, the instructions are parsed and converted to generate executable device control commands.

8. The method for remotely controlling a multi-screen medical device based on image recognition according to claim 1, characterized in that: The image recognition is to accurately segment different tissues or organs in the medical image by introducing image segmentation technology, and the recognition content includes the lesion area, organ contour and surgical instrument.

Images