Remote maintenance device and remote maintenance system for medical equipment

Abstract

The utility model provides a medical equipment remote maintenance device and a remote maintenance system. The medical equipment remote maintenance device comprises augmented reality equipment and a Bluetooth connection module. The augmented reality device comprises a first camera, a head-mounted virtual display and a Bluetooth antenna, the first camera is aligned with a display screen of the medical device and shoots the display screen, and the augmented reality device is in remote communication connection with a remote terminal device. The Bluetooth connection module is used for receiving a control signal and remote guidance information from the remote terminal equipment, receiving the control signal and the remote guidance information and transmitting the control signal to the medical equipment. A first camera of the augmented reality device collects a screen video stream of the medical device and transmits the screen video stream to the remote terminal device, and a control signal of the remote terminal device is transmitted to the medical device through the augmented reality device.

Description

Technical Field

[0001] The utility model relates to the field of medical equipment, and in particular to a remote maintenance device and a remote maintenance system for medical equipment. Background Art

[0002] As medical equipment becomes more intelligent and complex, maintenance becomes more difficult and requires higher professional capabilities. When medical equipment fails or requires maintenance, it is sometimes difficult for high-level maintenance personnel to arrive at the site in time, which not only wastes time and resources, but also may cause production line downtime, business interruption and other problems. In addition, traditional medical equipment maintenance methods are inefficient and cannot obtain equipment data in advance or in real time, making it difficult to ensure maintenance quality and speed. Therefore, at this stage, there is an increasing demand for remote guidance during medical equipment maintenance.

[0003] In existing technical solutions, remote maintenance experts often guide on-site maintenance personnel through video calls, but this lacks interactivity and leads to low maintenance efficiency. Utility Model Content

[0004] The technical problem to be solved by the utility model is to overcome the above-mentioned defects and provide a remote maintenance device and a remote maintenance system for medical equipment.

[0005] The utility model achieves the above technical effects through the following technical solutions:

[0006] The utility model provides a remote maintenance device for medical equipment, comprising:

[0007] An augmented reality device, the augmented reality device comprising a first camera, a head-mounted virtual display and a Bluetooth antenna, the first camera is aimed at a display screen of the medical device and photographs the display screen, the augmented reality device is remotely connected to a remote terminal device, and transmits the photographed image of the display screen to the remote terminal device, and receives control signals and remote guidance information from the remote terminal device, and the head-mounted virtual display is used to display the remote guidance information;

[0008] A Bluetooth connection module, wherein the Bluetooth connection module is connected to the Bluetooth antenna of the augmented reality device via Bluetooth communication to receive the control signal and the remote guidance information from the remote terminal device, and the Bluetooth connection module is connected to the medical device via Bluetooth communication to transmit the control signal to the medical device.

[0009] In this solution, the screen video stream of the medical device is collected by the first camera of the augmented reality device and transmitted to the remote terminal device, and the control signal of the remote terminal device is transmitted to the medical device through the augmented reality device. Therefore, the expert of the remote terminal device can see the screen video of the medical device and can also remotely control the medical device through the mouse and keyboard of the remote terminal device. The use of machine vision for video signal acquisition is not limited by the video signal format of the controlled device, which fundamentally guarantees the security of data and the controlled system; the augmented reality device is applied to remote maintenance to provide interactive virtual guidance for on-site technicians, realize multi-mode interaction such as voice, video, and image, and improve maintenance efficiency.

[0010] Preferably, the head-mounted virtual display includes a support frame for surrounding the head and a display lens connected to the support frame, and the first camera is connected to the support frame.

[0011] In this solution, the first camera is set on the head-mounted virtual display, which can provide real-time shooting images to remote maintenance experts based on the perspective of on-site technicians, and also realize the unified integration of augmented reality devices.

[0012] Preferably, the augmented reality device further comprises a second camera, the second camera is aimed at the medical device, the second camera is used to record the maintenance screen, and the augmented reality device is further configured to store the maintenance screen.

[0013] In this solution, the second camera is used to record the entire maintenance process to accumulate equipment maintenance data and knowledge and experience, and achieve continuous optimization.

[0014] Preferably, the second camera is arranged on the supporting frame.

[0015] Preferably, the augmented reality device is configured to store maintenance operation guidance information; and / or, the augmented reality device is configured to display a stereoscopic holographic image of the medical device on the head-mounted virtual display.

[0016] In this solution, augmented reality devices are used to provide an immersive augmented reality experience, so that maintenance personnel can see the holographic image of medical equipment, which improves the intuitiveness and efficiency of maintenance. Using the spatial mapping and positioning functions of augmented reality devices, the image of medical equipment or the screen of the remote expert can be accurately anchored in the actual environment to achieve virtual-real integration. This provides a spatial basis for remote experts to operate and guide.

[0017] Preferably, the control signal includes keyboard and mouse events to achieve remote control of the medical device.

[0018] Preferably, the augmented reality device further comprises a microphone, and the microphone is used to collect audio information of the medical device or on-site personnel, and the augmented reality device is configured to transmit the audio information to the remote terminal device.

[0019] Preferably, the Bluetooth connection module includes a Bluetooth data transparent transmission unit and a serial port to USB unit, and the Bluetooth data transparent transmission unit and the serial port to USB unit are connected via serial port communication; wherein the Bluetooth data transparent transmission unit is used to convert the Bluetooth signal into a serial port signal; the serial port to USB unit is used to convert the serial port signal into a signal recognizable by the HID device and connected to the medical device via USB communication;

[0020] Alternatively, the Bluetooth connection module includes a Bluetooth-to-serial port unit, and the Bluetooth-to-serial port unit is connected to the medical device via serial port communication.

[0021] In this solution, the Bluetooth data transmission unit and the serial port to USB unit are suitable for conventional OS systems. By innovatively combining the data transmission unit and the serial port to USB unit, seamless conversion between Bluetooth protocol instructions and HID communication is achieved, and HID communication can control conventional OS systems; the Bluetooth to serial port unit is suitable for conventional non-OS systems. Through the Bluetooth to serial port unit, seamless conversion between Bluetooth protocol instructions and serial port instructions is achieved, and serial port instructions can directly control conventional non-OS systems.

[0022] The utility model also provides a remote maintenance system, comprising the above-mentioned medical equipment remote maintenance device.

[0023] Preferably, the remote maintenance system also includes the medical device and the remote terminal device, the remote terminal device is connected to the augmented reality device through server remote communication, and transmits the control signal to the augmented reality device, the augmented reality device transmits the control signal to the Bluetooth connection module through the Bluetooth antenna, and the Bluetooth connection module transmits the control signal to the medical device.

[0024] In this solution, remote experts can use local serial port commands to control medical devices on remote terminal devices. These serial port commands will be transmitted through the cloud server and finally pushed to the augmented reality device. Finally, by using the Bluetooth connection module, the serial port command events are pushed to the medical device, thereby realizing remote control of the medical device.

[0025] On the basis of conforming to the common sense in the art, the above-mentioned preferred conditions can be arbitrarily combined to obtain the preferred embodiments of the present utility model.

[0026] The positive and progressive effect of the utility model is that: for the remote maintenance device for medical equipment, the screen video stream of the medical equipment is collected by the first camera of the augmented reality device and transmitted to the remote terminal device, and the control signal of the remote terminal device is transmitted to the medical device through the augmented reality device. Therefore, the expert of the remote terminal device can see the screen video of the medical device, and can also remotely control the medical device through the mouse and keyboard of the remote terminal device. The use of machine vision for video signal acquisition is not limited by the video signal format of the controlled device, which fundamentally guarantees the security of the data and the controlled system; the augmented reality device is applied to remote maintenance to provide interactive virtual guidance for on-site technicians and improve maintenance efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The embodiments of the present invention will be described in detail below with reference to the accompanying drawings so that those skilled in the art will be more aware of the above and other features and advantages of the present invention.

[0028] Figure 1 It is a schematic diagram of a remote maintenance system according to a preferred embodiment of the utility model.

[0029] The reference numerals are as follows:

[0030] Remote maintenance system 100

[0031] Medical equipment remote maintenance device 10

[0032] Augmented Reality 101

[0033] Bluetooth connection module 102

[0034] Remote terminal equipment 20

[0035] Medical equipment30

[0036] Server 40 DETAILED DESCRIPTION

[0037] In order to have a clearer understanding of the technical features, purposes and effects of the utility model, the specific implementation methods of the utility model are now described with reference to the accompanying drawings, in which the same reference numerals represent the same parts.

[0038] In this document, “exemplary” means “serving as an example, instance or illustration”, and any diagram or implementation described in this document as “exemplary” should not be interpreted as a more preferred or more advantageous technical solution.

[0039] In order to simplify the drawings, only the parts related to the utility model are schematically shown in each figure, and they do not represent the actual structure of the product. In addition, in order to simplify the drawings and facilitate understanding, in some figures, only one of the parts with the same structure or function is schematically drawn or marked.

[0040] In this article, "one" not only means "only one", but also means "more than one". In this article, "first", "second", etc. are only used to distinguish each other, rather than to indicate their importance and order, or the premise of each other's existence.

[0041] The utility model discloses a remote maintenance device 10 for medical equipment. Figure 1 As shown, the medical equipment remote maintenance device 10 includes an augmented reality device 101 and a Bluetooth connection module 102. The augmented reality device 101 includes a first camera, a head-mounted virtual display and a Bluetooth antenna. The first camera is aimed at the display screen of the medical device 30 and shoots the display screen. The augmented reality device 101 is remotely connected to the remote terminal device 20, and transmits the image of the captured display screen to the remote terminal device 20, and receives control signals and remote guidance information from the remote terminal device 20. The head-mounted virtual display is used to display the remote guidance information; the Bluetooth connection module 102 is connected to the Bluetooth antenna of the augmented reality device 101 by Bluetooth communication to receive control signals and remote guidance information from the remote terminal device 20, and the Bluetooth connection module 102 is communicatively connected to the medical device 30 to transmit the control signal to the medical device 30.

[0042] In this embodiment, the screen video stream of the medical device 30 is collected by the first camera of the augmented reality device 101 and transmitted to the remote terminal device 20, and the control signal of the remote terminal device 20 is transmitted to the medical device 30 through the augmented reality device 101. Therefore, the expert of the remote terminal device 20 can see the screen video of the medical device 30, and can also remotely control the medical device 30 through the mouse and keyboard of the remote terminal device 20. The use of machine vision for video signal acquisition is not limited by the video signal format of the controlled device, which fundamentally guarantees the security of data and the controlled system; the augmented reality device 101 is applied to remote maintenance, providing interactive virtual guidance for on-site technicians, realizing multi-mode interaction such as voice, video, and image, and improving maintenance efficiency.

[0043] In this embodiment, the augmented reality device 101 can specifically adopt an augmented reality product, such as a HoloLens device, which is equipped with a high-definition camera to meet the needs of high-definition video acquisition, and can be used as a first camera to capture the screen video stream of the medical device 30. In addition, the solution is universal and easy to use, and can be plug-and-play. HoloLens supports gesture and voice interaction, and with the head mirror display, it can achieve natural human-computer interaction, and remote experts can easily command and assist on-site maintenance personnel. With the help of the HoloLens insight platform, multi-person collaborative remote maintenance can be achieved, and each party can see the shared equipment images and annotations to improve collaboration efficiency. It should be noted that augmented reality products are not limited to HoloLens, and other augmented reality products that can achieve the purpose of this solution can also be used.

[0044] The head-mounted virtual display includes a support frame for surrounding the head and a display lens connected to the support frame, and the first camera is connected to the support frame. The first camera is set on the head-mounted virtual display, which can provide real-time shooting images to the remote maintenance expert based on the perspective of the on-site technician, and also realize the unified integration of the augmented reality device 101.

[0045] The augmented reality device 101 also includes a second camera, which is aimed at the medical device 30. The second camera is used to record the maintenance screen. The augmented reality device 101 is also configured to store the maintenance screen. The second camera is used to record the entire maintenance process to accumulate equipment maintenance data and knowledge and experience, and to achieve continuous optimization. The second camera is set on the support frame.

[0046] The augmented reality device 101 is configured to store maintenance operation guidance information; and / or, the augmented reality device 101 is configured to display a stereoscopic holographic image of the medical device 30 on a head-mounted virtual display. The augmented reality device 101 provides an immersive augmented reality experience, and maintenance personnel can see the holographic image of the medical device 30, which improves the intuitiveness and efficiency of maintenance. Using the spatial mapping and positioning functions of the augmented reality device 101, the image of the medical device 30 or the screen of the remote expert end can be accurately anchored in the actual environment to achieve virtual-real fusion. This provides a spatial basis for operation and guidance for remote experts.

[0047] The control signal includes keyboard and mouse events to achieve remote control of the medical device 30. The augmented reality device 101 also includes a microphone, which is used to collect audio information of the medical device 30 or on-site personnel. The augmented reality device 101 is configured to transmit the audio information to the remote terminal device 20.

[0048] The Bluetooth connection module 102 includes a Bluetooth data transparent transmission unit and a serial port to USB unit, and the Bluetooth data transparent transmission unit and the serial port to USB unit are connected via serial port communication; wherein the Bluetooth data transparent transmission unit is used to convert the Bluetooth signal into a serial port signal; the serial port to USB unit is used to convert the serial port signal into a signal recognizable by the HID device and connected to the medical device 30 via USB communication. The Bluetooth data transparent transmission unit and the serial port to USB unit are suitable for conventional OS systems. By innovatively combining the data transparent transmission unit and the serial port to USB unit, seamless conversion between Bluetooth protocol instructions and HID communication is achieved, and HID communication can control conventional OS systems;

[0049] The Bluetooth connection module 102 includes a Bluetooth to serial port unit, which is connected to the medical device 30 via serial port communication. The Bluetooth to serial port unit is suitable for conventional non-OS systems. Through the Bluetooth to serial port unit, seamless conversion between Bluetooth protocol instructions and serial port instructions is achieved, and serial port instructions can directly control conventional non-OS systems.

[0050] The utility model also provides a remote maintenance system 100, comprising the above-mentioned medical equipment remote maintenance device 10.

[0051] The remote maintenance system 100 also includes a medical device 30 and a remote terminal device 20. The remote terminal device 20 is remotely connected to the augmented reality device 101 through the server 40 and transmits a control signal to the augmented reality device 101. The augmented reality device 101 transmits the control signal to the Bluetooth connection module 102 via the Bluetooth antenna, and the Bluetooth connection module 102 transmits the control signal to the medical device 30.

[0052] In this embodiment, the remote expert can use local serial port commands to control the medical device 30 on the remote terminal device 20, and these serial port commands will be transmitted through the cloud server 40 and finally pushed to the augmented reality device 101. Finally, by using the Bluetooth connection module 102, the serial port command events are pushed to the medical device 30, thereby realizing remote control of the medical device 30.

[0053] Although the specific implementations of the utility model are described above, those skilled in the art should understand that this is only an example, and the protection scope of the utility model is defined by the attached claims. Those skilled in the art can make various changes or modifications to these implementations without departing from the principle and essence of the utility model, but these changes and modifications fall within the protection scope of the utility model.

Claims

1. A remote maintenance device for medical equipment, characterized in that: include: An augmented reality device, the augmented reality device comprising a first camera, a head-mounted virtual display and a Bluetooth antenna, the first camera is aimed at a display screen of the medical device and photographs the display screen, the augmented reality device is remotely connected to a remote terminal device, and transmits the photographed image of the display screen to the remote terminal device, and receives control signals and remote guidance information from the remote terminal device, and the head-mounted virtual display is used to display the remote guidance information; A Bluetooth connection module, wherein the Bluetooth connection module is connected to the Bluetooth antenna of the augmented reality device via Bluetooth communication to receive the control signal and the remote guidance information from the remote terminal device, and the Bluetooth connection module is connected to the medical device via Bluetooth communication to transmit the control signal to the medical device.

2. The medical equipment remote maintenance device according to claim 1, characterized in that: The head-mounted virtual display includes a support frame for surrounding the head and a display lens connected to the support frame, and the first camera is connected to the support frame.

3. The medical equipment remote maintenance device according to claim 2, characterized in that: The augmented reality device also includes a second camera, which is aimed at the medical device and is used to record a maintenance screen. The augmented reality device is also configured to store the maintenance screen.

4. The medical equipment remote maintenance device according to claim 3, characterized in that: The second camera is arranged on the supporting frame.

5. The medical equipment remote maintenance device according to claim 1, characterized in that: The augmented reality device is configured to store maintenance operation guidance information; and / or, the augmented reality device is configured to display a stereoscopic holographic image of the medical device on the head-mounted virtual display.

6. The medical equipment remote maintenance device according to claim 1, characterized in that: The control signal includes keyboard and mouse events to achieve remote control of the medical device.

7. The medical equipment remote maintenance device according to claim 1, characterized in that: The augmented reality device also includes a microphone, which is used to collect audio information of the medical device or on-site personnel, and the augmented reality device is configured to transmit the audio information to the remote terminal device.

8. The remote maintenance device for medical equipment according to claim 1, characterized in that: The Bluetooth connection module includes a Bluetooth data transparent transmission unit and a serial port to USB unit, and the Bluetooth data transparent transmission unit and the serial port to USB unit are connected via serial port communication; wherein the Bluetooth data transparent transmission unit is used to convert the Bluetooth signal into a serial port signal; the serial port to USB unit is used to convert the serial port signal into a signal recognizable by the HID device and connect to the medical device via USB communication; Alternatively, the Bluetooth connection module includes a Bluetooth-to-serial port unit, and the Bluetooth-to-serial port unit is connected to the medical device via serial port communication.

9. A remote maintenance system, characterized in that: It comprises the medical equipment remote maintenance device as described in any one of claims 1-8.

10. The remote maintenance system according to claim 9, characterized in that: The remote maintenance system also includes the medical device and the remote terminal device. The remote terminal device is connected to the augmented reality device through server remote communication and transmits the control signal to the augmented reality device. The augmented reality device transmits the control signal to the Bluetooth connection module through the Bluetooth antenna, and the Bluetooth connection module transmits the control signal to the medical device.

Images