Ultrasonic inspection scene multi-modal data real-time monitoring system

Abstract

The utility model relates to the field of medical treatment. An ultrasonic examination scene multi-modal data real-time monitoring system comprises an ultrasonic chamber, an examination bed is placed in the ultrasonic chamber, and ultrasonic medical image examination equipment is placed on one side of the examination bed and provided with an ultrasonic probe; a camera system is arranged on the other side of the examination bed and comprises an omnibearing holder and a driving motor for driving a camera on the omnibearing holder to rotate; a Bluetooth positioning system is further arranged in the ultrasonic chamber and comprises a Bluetooth terminal, the Bluetooth terminal is in control connection with the driving motor, the Bluetooth positioning system further comprises a Bluetooth work card, the Bluetooth work card is fixed to the ultrasonic probe, the Bluetooth positioning system further comprises four Bluetooth beacons, and the Bluetooth beacons are connected with the Bluetooth terminal. The four Bluetooth beacons are fixed to the four corners of the ultrasonic chamber respectively. A camera of the camera system can shoot the manipulation of a doctor to operate the ultrasonic probe.

Description

Technical Field

[0001] This application relates to the medical field, especially real-time monitoring of multimodal data. Background Art

[0002] Ultrasonic examination is a medical imaging technique that mainly uses the characteristics of high-frequency sound waves propagating in the body to generate images of tissues and organs. Due to its non-invasive, real-time, cost-effective and other characteristics, ultrasonic examination is widely used in medical diagnosis.

[0003] However, the imaging of ultrasonic examination may be incomplete. This incompleteness may be caused by various factors, such as the operator's technical level, operating gestures, the patient's physical condition, and the performance of the equipment. Therefore, a camera system that can monitor the ultrasonic detection process in real time is needed to check whether it is caused by the operator's technical level or operating gestures through the camera system. Summary of the Utility Model

[0004] The purpose of this utility model is to provide a real-time monitoring system for multimodal data in ultrasonic examination scenarios to solve the above technical problems.

[0005] The technical problems solved by this utility model can be realized by the following technical solutions:

[0006] A real-time monitoring system for multimodal data in ultrasonic examination scenarios, including an ultrasound room, in which an examination bed is placed. On one side of the examination bed, there is an ultrasonic medical imaging examination device, and the ultrasonic medical imaging examination device is provided with an ultrasonic probe;

[0007] On the other side of the examination bed, there is a camera system, which includes an omnidirectional cloud platform and a driving motor for driving the camera on the omnidirectional cloud platform to rotate;

[0008] The ultrasound room is also provided with a Bluetooth positioning system, which includes Bluetooth terminals. The Bluetooth terminals are controlled to connect the driving motor. The Bluetooth positioning system also includes Bluetooth work cards. One of the Bluetooth work cards is fixed on the ultrasonic probe. The Bluetooth positioning system also includes Bluetooth beacons. There are at least three Bluetooth beacons in the same ultrasound room, and the distance between two adjacent Bluetooth beacons is not less than 1m.

[0009] First, the utility model adds a camera system in the ultrasound room. When using ultrasonic medical imaging equipment to perform ultrasonic examinations on patients, the camera of the camera system is allowed to capture the doctor's technique of operating the ultrasonic probe. When the ultrasonic imaging is unclear, the camera system is used to check whether it is caused by the operator's technical level. Secondly, the utility model limits the position of the camera system so that the ultrasonic medical imaging equipment and the camera system are respectively located on both sides of the examination bed, thereby avoiding mutual interference. Then, the utility model adds a Bluetooth positioning system in the ultrasound room, which can locate the position of the ultrasonic probe, thereby determining the approximate position of the ultrasonic probe in the ultrasound room. More importantly, the position information can be used as one of the parameters for adjusting the direction of the camera, allowing the camera to be adjusted to face the ultrasonic probe using the parameter, thereby improving the accuracy and pertinence of the captured technique video and reducing invalid images.

[0010] Preferably, the Bluetooth terminal is connected to the hospital information system via WIFI or 5G, the camera is connected to the hospital information system via WIFI or 5G, and the ultrasonic medical imaging device is connected to the hospital information system via a DICOM interface or a video acquisition card. Doctors can use the hospital information system to view ultrasonic images, patient information (from the hospital information system), examination doctor information (from the hospital information system), and videos of the ultrasonic doctor's examination techniques on the patient during the examination, so as to compare and integrate them and enhance the diagnostic ability of ultrasonic examination.

[0011] Preferably, the camera system also includes a base, on which a fixed rod is fixed, and the fixed rod is provided with a hollow cavity, in which a sliding rod is slidably provided, and the top of the sliding rod is connected to the omnidirectional pan-tilt head, and a Bluetooth work card is fixed on the omnidirectional pan-tilt head; the position of the camera is determined by the Bluetooth work card fixed on the omnidirectional pan-tilt head, including the distance to the examination bed and the height of the camera, so as to record the position parameters of the camera, and later allow the position of the camera to be determined according to the position parameters, or according to the relationship between the position parameters and the situation of the operation technique images, as a reference position for obtaining more accurate operation technique images.

[0012] Preferably, universal wheels are provided under the base, the camera system stands on the floor of the ultrasound room, and a counterweight is fixed under the base, thereby lowering the center of the camera system and reducing shaking of the camera system when it moves.

[0013] Preferably, a crossbar is provided on the upper part of the ultrasound room, the base is slidably connected to the crossbar, and the camera system is suspended on the crossbar through the base, thereby reducing the occupation of the lower space of the ultrasound room and preventing the camera system from being touched or blocked by objects below. Moreover, the camera system is allowed to move along the crossbar.

[0014] Preferably, the cross bar is provided with a slot opening downward, and a rear curtain is suspended in the slot. The camera is located on the side of the curtain close to the examination bed, so that there is no need to separately provide a cross bar to suspend the curtain, thereby reducing costs.

[0015] Preferably, the camera is 50 cm - 100 cm higher than the examination bed, ensuring that the camera can clearly capture the examination techniques of the ultrasound doctor on the patient.

[0016] Preferably, the camera adopts a motion capture camera. The motion capture camera enables the camera to capture more accurate data on the examination techniques of the ultrasound doctor on the patient, improving the diagnostic ability of ultrasound examinations. Description of the Drawings

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings. Among them:

[0018] Figure 1 It is a schematic structural diagram of the overall base with universal wheels of the camera system in the multi-modal data real-time monitoring system for ultrasound examination scenarios provided by an embodiment of the present invention.

[0019] Figure 2 It is a schematic structural diagram of the camera system in the multi-modal data real-time monitoring system for ultrasound examination scenarios provided by an embodiment of the present invention.

[0020] Figure 3 It is a schematic structural diagram of the cross bar for placing the camera system in the multi-modal data real-time monitoring system for ultrasound examination scenarios provided by an embodiment of the present invention. Detailed Embodiments

[0021] To make the above objects, features, and advantages of the present invention more understandable, the following will describe the detailed embodiments of the present invention in conjunction with the drawings of the specification.

[0022] In the following description, many specific details are set forth to fully understand the present invention. However, the present invention can also be implemented in other ways different from those described herein. Those skilled in the art can make similar extensions without departing from the connotation of the present invention. Therefore, the present invention is not limited by the specific embodiments disclosed below.

[0023] Secondly, the present utility model will be described in detail with reference to the schematic diagrams. When describing the embodiments of the present utility model in detail, for the convenience of explanation, the cross-sectional views showing the device structure will be enlarged locally in a non-general proportion, and the schematic diagrams are only examples and should not limit the scope of protection of the present utility model herein. In addition, the three-dimensional spatial dimensions of length, width, and depth should be included in actual production.

[0024] Furthermore, the so-called "one embodiment" or "embodiment" herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation manner of the present utility model. The "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor is it a separate or selectively mutually exclusive embodiment with other embodiments.

[0025] Embodiment 1

[0026] Referring to Figure 1 and Figure 2 , this embodiment provides a real-time monitoring system for multi-modal data in an ultrasound examination scenario, including an ultrasound room, in which an examination bed 2 is placed, and an ultrasound medical imaging examination device 1 is placed on one side of the examination bed 2. The ultrasound medical imaging examination device 1 is provided with an ultrasonic probe 11.

[0027] A camera system is placed on the other side of the examination bed 2, and the camera system includes an omnidirectional pan-tilt head 4 and a driving motor 5 for driving the camera 3 on the omnidirectional pan-tilt head 4 to rotate; a Bluetooth positioning system is also arranged in the ultrasound room, and the Bluetooth positioning system includes a Bluetooth terminal, and the Bluetooth terminal controls the connection to the driving motor 5, and the Bluetooth positioning system also includes a Bluetooth work card, and one of the Bluetooth work cards is fixed on the ultrasonic probe 11, and the Bluetooth positioning system also includes four Bluetooth beacons, which are respectively fixed at the four corners of the ultrasound room. The Bluetooth terminal is connected to the hospital information system via WIFI or 5G, the camera is connected to the hospital information system via WIFI or 5G, and the ultrasonic medical imaging equipment is connected to the hospital information system via a DICOM interface or a video acquisition card. First, by setting up a camera system next to the examination bed 2, while the patient is being examined ultrasonically, the camera 3 of the camera system can record the doctor's operation of the ultrasonic probe 11, and compare and integrate the ultrasonic image, patient information (from the hospital information system), examination doctor information (from the hospital information system), and the video of the ultrasound doctor's examination of the patient during the examination. Multiple groups of data are integrated and compared to enhance the diagnostic capability of the ultrasound examination. Secondly, the camera system is also provided with a pan-tilt support for the camera 3. The pan-tilt can adjust the camera 3 to the position to be detected by driving the motor 5, thereby improving the accuracy of the video of the ultrasound doctor's examination of the patient. Finally, the Bluetooth positioning system is used to determine the position of the ultrasonic probe 11 through the Bluetooth work card and four Bluetooth beacon blocks, and the camera of the camera 3 on the pan-tilt is controlled by the Bluetooth terminal to face the ultrasonic probe 11, so as to realize automatic control of the camera 3 to face the ultrasonic probe 11, making the camera system quick and convenient to use.

[0028] The camera system also includes a base 61, on which a fixing rod 62 is fixed, and the fixing rod 62 is provided with a hollow cavity, in which a sliding rod 63 is slidably provided, and the top of the sliding rod 63 is connected to the omnidirectional pan-tilt head 4, on which a Bluetooth work card is fixed; the position of the camera 3 is determined by the Bluetooth work card fixed on the omnidirectional pan-tilt head 4, including the distance to the examination bed 2 and the height of the camera 3, so as to record the position parameters of the camera 3, and later allow the position of the camera 3 to be determined according to the position parameters, or according to the relationship between the position parameters and the operation technique images, as a reference position for obtaining more accurate operation technique images.

[0029] Universal wheels 611 are provided below the base 61 , and the camera system stands on the floor of the ultrasound room. A counterweight is also fixed below the base 61 , thereby lowering the center of the camera system and reducing shaking when the camera system moves.

[0030] Four Bluetooth beacons are respectively fixed at the four corners of the top of the ultrasound room; thereby reducing the occupation of the lower space of the ultrasound room and avoiding the influence of lower objects on the Bluetooth beacon signals. More importantly, the distance between the Bluetooth beacons is increased to make the detection results more accurate.

[0031] The Bluetooth terminal is fixed at the lower part of the examination bed 2; thereby making full use of the lower space of the examination bed 2 to protect the Bluetooth terminal and reducing the external touch on the Bluetooth terminal. And making the Bluetooth terminal close to the ultrasonic medical imaging examination device 1 for convenient wiring.

[0032] The camera 3 is 50 cm - 100 cm higher than the examination bed 2; ensuring that the camera 3 can clearly capture the examination techniques of the ultrasound doctor on the patient.

[0033] The camera 3 adopts a motion capture camera 3; the motion capture camera 3 makes the data of the examination techniques of the ultrasound doctor captured by the camera 3 more accurate, improving the diagnostic ability of the ultrasound examination

[0034] During use, after obtaining the patient's consent, first open the caster locking mechanism on the caster 611, move the imaging system to a suitable shooting position, then unscrew the screw to adjust the height of the sliding rod 63, thereby adjusting the shooting angle of the camera 3, improving the accuracy of shooting the doctor's operation techniques, preventing detection dead angles from occurring at some special detection positions and affecting the accuracy of shooting. When the doctor starts the ultrasonic medical imaging examination device 1, the Bluetooth terminal is also started. When operating the ultrasonic probe 11 to detect the patient's condition, turn on the switch of the camera 3, and the Bluetooth work card sends signals in real time. After the Bluetooth terminal receives and analyzes the position information of the Bluetooth work card, it analyzes the positions of the camera 3 and the ultrasonic probe 11. The Bluetooth terminal controls the pan-tilt according to the position information, first rotates the camera 3 on the pan-tilt to a suitable position through the driving motor 5, and then adjusts the pan-tilt to align with the position of the Bluetooth work card on the ultrasonic probe 11. The ultrasonic probe 11 is manually controlled by the doctor. Thus, when the doctor performs ultrasonic detection, the detection techniques of the doctor can be photographed in real time, and the ultrasonic images, patient information (from the hospital information system), examination doctor information (from the hospital information system), and the video of the examination techniques of the ultrasound doctor on the patient during the examination process are compared and integrated. Multiple groups of data are integrated and compared to enhance the diagnostic ability of the ultrasound examination.

[0035] Embodiment 2

[0036] Refer to Figure 2 and Figure 3 This is the second embodiment of the present invention, and this embodiment is based on the previous embodiment.

[0037] A cross bar is provided at the upper part of the ultrasound room, and the base 61 is slidably connected to the cross bar. The camera system is suspended on the cross bar through the base 61, thereby reducing the occupation of the lower space of the ultrasound room and avoiding the touch or occlusion of the lower objects to the camera system. Moreover, the camera system is allowed to move along the cross bar.

[0038] The cross bar is provided with a slot opening downward, and a rear curtain is suspended in the slot. The camera 3 is located on the side of the curtain close to the examination bed 2, thereby eliminating the need to provide another cross bar for suspending the curtain and reducing the cost.

[0039] During use, pull up the curtain on the cross bar. After obtaining the patient's consent, slide the base 61 on the cross bar to adjust the camera 3 to a proper position, start the camera 3 for shooting, reduce the occupation of the lower space of the ultrasound room, and avoid the touch or occlusion of the lower objects to the camera system.

[0040] Importantly, it should be noted that the construction and arrangement of the present application shown in multiple different exemplary embodiments are merely illustrative. Although only a few embodiments are described in detail in this disclosure, those who refer to this disclosure should easily understand that many modifications are possible on the premise of substantially not deviating from the novel teachings and advantages of the subject matter described in this application (for example, the dimensions, scales, structures, shapes and proportions of various components, as well as parameter values (such as temperature, pressure, etc.), installation arrangements, use of materials, color, orientation changes, etc.). For example, an element shown as integrally formed can be composed of multiple parts or elements, the position of the element can be inverted or otherwise changed, and the nature, number or position of discrete elements can be changed or altered. Therefore, all such modifications are intended to be included within the scope of the present utility model. The order or sequence of any process or method steps can be changed or reordered according to alternative embodiments. In the claims, any "means plus function" clause is intended to cover the structure that performs the recited function in this disclosure, and not only structural equivalents but also equivalent structures. Other substitutions, modifications, changes and omissions can be made in the design, operating conditions and arrangement of the exemplary embodiments without departing from the scope of the present utility model. Therefore, the present utility model is not limited to specific embodiments, but extends to various modifications that still fall within the scope of the appended claims.

[0041] In addition, in order to provide a concise description of the exemplary embodiments, not all features of the actual embodiments may be described (i.e., those features that are not relevant to the best mode currently considered for implementing the present utility model or those features that are not relevant to the implementation of the present utility model).

[0042] It should be understood that, in the development of any actual implementation, such as in any engineering or design project, a large number of specific implementation decisions can be made. Such development efforts may be complex and time-consuming, but for those of ordinary skill in the art who benefit from this disclosure, without undue experimentation, such development efforts will be routine work of design, fabrication, and production.

[0043] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present invention, and they should all be covered within the scope of the claims of the present invention.

Claims

1. A multimodal data real-time monitoring system for an ultrasound examination scene, comprising an ultrasound room, an examination bed is placed in the ultrasound room, an ultrasound medical imaging device is placed on one side of the examination bed, and the ultrasound medical imaging device is provided with an ultrasound probe, characterized in that: A camera system is placed on the other side of the examination bed, and the camera system includes an omnidirectional pan-tilt head and a driving motor for driving the camera on the omnidirectional pan-tilt head to rotate; A Bluetooth positioning system is also arranged in the ultrasound room, and the Bluetooth positioning system includes a Bluetooth terminal, and the Bluetooth terminal controls and connects to the driving motor. The Bluetooth positioning system also includes a Bluetooth work card, and one of the Bluetooth work cards is fixed on the ultrasonic probe. The Bluetooth positioning system also includes a Bluetooth beacon. There are at least three Bluetooth beacons in the same ultrasound room, and the distance between two adjacent Bluetooth beacons is not less than 1m.

2. The multimodal data real-time monitoring system for ultrasonic inspection scenes according to claim 1, characterized in that: The Bluetooth terminal is connected to the hospital information system via WIFI or 5G, the camera is connected to the hospital information system via WIFI or 5G, and the ultrasonic medical imaging equipment is connected to the hospital information system via a DICOM interface or a video acquisition card.

3. The real-time monitoring system for multimodal data of ultrasonic inspection scenes according to claim 1, characterized in that: The camera system also includes a base, a fixing rod is fixed on the base, the fixing rod is provided with a hollow cavity, a sliding rod is slidably provided in the cavity, the top of the sliding rod is connected to the omnidirectional pan-tilt head, and a Bluetooth work card is fixed on the omnidirectional pan-tilt head.

4. The real-time monitoring system for multimodal data of ultrasonic inspection scenes according to claim 3 is characterized in that: Universal wheels are arranged below the base, the camera system stands on the floor of the ultrasound room, and a counterweight is fixed below the base.

5. The real-time monitoring system for multimodal data of ultrasonic inspection scenes according to claim 3, characterized in that: A crossbar is arranged on the upper part of the ultrasound room, the base is slidably connected to the crossbar, and the camera system is suspended on the crossbar through the base.

6. The real-time monitoring system for multimodal data of ultrasonic inspection scenes according to claim 5, characterized in that: The cross bar is provided with a slot opening downwards, a rear curtain is hung in the slot, and the camera is located on a side of the curtain close to the examination bed.

7. The real-time monitoring system for multimodal data of an ultrasonic inspection scene according to any one of claims 1 to 6, characterized in that: Four Bluetooth beacons are respectively fixed on the four corners of the top of the ultrasound room.

8. The real-time monitoring system for multimodal data of an ultrasonic inspection scene according to any one of claims 1 to 6, characterized in that: The Bluetooth terminal is fixed on the lower part of the examination bed.

9. The real-time monitoring system for multimodal data of an ultrasonic inspection scene according to any one of claims 1 to 6, characterized in that: The camera is 50 cm to 100 cm higher than the examination bed.

10. The real-time monitoring system for multimodal data of an ultrasonic inspection scene according to any one of claims 1 to 6, characterized in that: The camera is a motion capture camera.

Images