A remote medical detection system and method for remote human 3D model restoration

Abstract

The present invention discloses a remote medical detection system and method for remote human body 3D model restoration, which includes a detection position, a detector with a detection head, a local detection unit and a remote detection unit; the local detection unit takes a photo of the detection object to obtain 3D data, sends the 3D data to the remote detection unit, drives the detection head to move and / or retract according to the guidance information of the remote detection unit to complete the detection, and forms a detection image; the remote detection unit receives the 3D data and remotely simulates the detection object model according to the 3D data, operates on the detection object model through a probe positioning device, forms guidance information, and completes the local detection in the local detection unit. A medical detection method is also provided. The medical detection system and method of the present invention do not require a detection technician with detection skills to operate at the local end, and perform corresponding detection operations according to the guidance information of the remote end, thereby solving the problem of detection difficulties in medical institutions that currently do not have detection technicians.

Description

Technical Field

[0001] The present invention relates to the field of medical detection, and in particular to a remote medical detection system and method for remote human body 3D model restoration. Background Art

[0002] In the field of medical imaging, B-ultrasound is the most widely used, but B-ultrasound requires professional testing technicians to operate, and general treating physicians do not have such testing skills. Based on this feature, especially in China where medical development is uneven, it is not guaranteed that every medical institution has professional testing technicians, such as health centers or clinics in remote rural areas. Then, in these medical institutions without professional testing technicians, B-ultrasound testing cannot be completed. When a patient needs to be tested, he can only make a judgment based on his own diagnosis and treatment experience. Often, the diagnosis and treatment experience of the treating physicians in these remote health centers or clinics is relatively limited and cannot meet the needs. At this time, the patient needs to go to a distant or larger medical clinic for diagnosis and treatment, which may delay treatment. Summary of the invention

[0003] The purpose of the present invention is to provide a remote medical detection system and method for remote human body 3D model restoration, aiming to solve the technical problem that medical institutions that currently do not have detection technicians have difficulties in completing projects that require specific detection knowledge, or to solve the technical problem that there is a large shortage of detection technicians and the demand cannot be met.

[0004] The invention provides a remote medical detection system for remote human body 3D model restoration.

[0005] A remote medical detection system for remote human 3D model restoration, comprising a detection position and a detector arranged at one side of the detection position, wherein the detector has a detection head, and the remote medical detection system for remote human 3D model restoration further comprises: a local detection unit and a remote detection unit;

[0006] The local detection unit is used to take a picture of the detection object at the detection position to form 3D data of the detection object, send the 3D data to the remote detection unit, drive the detection head to move and / or extend relative to the detection object according to the guidance information of the remote detection unit to complete the detection, and form a detection image;

[0007] The remote detection unit receives the 3D data and remotely simulates a detection object model according to the 3D data, operates on the detection object model through a probe positioning device with a positioning function to form guidance information, and sends the guidance information to the local detection unit to complete local detection.

[0008] Furthermore, the guidance information includes 3D coordinates relative to the detection position.

[0009] Furthermore, the local detection unit includes:

[0010] A plurality of cameras arranged at an angle to each other, the plurality of cameras being arranged above the detection positions respectively, and taking pictures of the detection object at the detection positions to form a plurality of images;

[0011] An image processing center, connected to the plurality of cameras, for receiving the plurality of images and forming 3D data;

[0012] a communication module, the communication module being connected to the image processing center and configured to send the 3D data to the remote detection unit;

[0013] A detection head driving module, wherein the detection head is arranged on the detection head driving module;

[0014] The detection head control module is connected to the communication module, and the detection head control module receives the guidance information through the communication module, and controls the detection head drive module to move or retract according to the guidance information, thereby driving the detection head to move to a corresponding detection position and detection depth to complete the detection.

[0015] Furthermore, the communication module communicates with the detector and is used to send the detection image to the remote detection unit.

[0016] Furthermore, the remote detection unit comprises:

[0017] A detection object model disposed on a workbench;

[0018] a model control device, the model control device being connected to the detection object model, the model control device being used to shape the detection object model, the model control device being in communication with the communication module, being used to receive the 3D data sent by the communication module, and shaping the detection object model according to the 3D data, the formed detection object model being the same as the detection object;

[0019] A probe positioning device, which communicates with the communication module, comprises a positioning module. When the probe positioning device is operated and moved, the guidance information is generated, and the guidance information is sent to the local detection unit through the communication module.

[0020] Furthermore, the detection object model is made of soft plastic material, and its interior is divided into multiple unit modules, each of which is provided with a connection port; the model control device includes a model control center and at least one blowing device and multiple conduits and control valves connected to the blowing device, and the connection port is connected to one of the conduits respectively; the model control center is connected to the control valve, and the model control center controls the opening and closing of multiple control valves according to the 3D data, thereby controlling the inflation amount in each of the unit modules to achieve the purpose of simulating the body shape of the detection object.

[0021] Furthermore, the remote detection unit also includes a display module, which communicates with the communication module; the at least one camera is used to shoot the operation process of the local detection system to form an operation video; the communication module sends the operation video and the detection image of the detector to the display module for display.

[0022] The invention also provides a remote medical detection method.

[0023] A remote medical detection method for remote human 3D model restoration comprises the following steps:

[0024] Step 1: Generate 3D data of the detected object locally;

[0025] Step 2: remotely simulating a detection object model having the same body shape as the detection object according to the 3D data;

[0026] Step 3: Perform a detection operation on the remote detection object model, and obtain the coordinates of the detection position during the detection operation as guidance information;

[0027] Step 4: Send the guidance information to the local device, and drive the detection head to complete the detection operation on the detection object according to the corresponding coordinates based on the guidance information, so as to form a detection image.

[0028] The method for forming the 3D data in step 1 includes:

[0029] A plurality of cameras with shooting angles are set to capture a plurality of images, and 3D data is calculated based on the plurality of images by a 3D imaging algorithm.

[0030] The method for forming the detection object model in step 2 includes:

[0031] The detection object model is divided into multiple unit modules, each unit module has a catheter and a control valve, and the catheter is connected to the blowing device through the control valve; the model control center controls one or more of the multiple control valves to be turned on or off according to the 3D data, so that different amounts of air are filled into the multiple unit modules, thereby simulating the body shape of the detection object.

[0032] The telemedicine system disclosed in the present invention comprises a local detection unit at a local end and a remote detection unit at a remote end. The local detection unit obtains 3D data consistent with the vital signs of an object to be detected, and sends the 3D data to the remote detection unit. The remote detection unit simulates and forms a detection object model according to the 3D data, and uses a probe positioning device with a positioning function to operate on the detection object model. According to the operation process, guidance information with coordinates as data is formed, and the guidance information is sent to the local detection unit. By driving the mechanism of the local detection unit connected to the detection head, the corresponding detection points are detected according to the coordinates and sequence of the guidance information, thereby forming a detection image on the detector.

[0033] The remote medical detection system for remote human 3D model restoration of the present invention does not require detection technicians with detection skills to operate at the local end, but only needs to obtain 3D data of the detection object; detection technicians with specific skills at the remote end perform remote detection operations, and use the detection coordinates and sequence as guidance information to guide the detection head at the local end to perform corresponding detection operations, thereby solving the technical problem that medical institutions that do not have detection technicians currently have difficulties in completing detection. In addition, the detection technician at the remote end can be linked to multiple local ends through the communication module in succession, guide the detection of the local end, and achieve one-to-many customized services, making the work of the detection technician more targeted. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 It is a working schematic diagram of the detector of the present invention;

[0035] Figure 2 It is a module schematic diagram of a remote medical detection system for remote human 3D model restoration of the present invention;

[0036] Figure 3 It is a schematic diagram of a simulation shaping method of a detection object model of the present invention;

[0037] Figure 4 It is a schematic diagram of the flow of the remote medical detection method of the present invention. DETAILED DESCRIPTION

[0038] The present invention will be further described and illustrated below in conjunction with specific embodiments and accompanying drawings:

[0039] Please refer to Figures 1 to 3 The present invention provides a remote medical detection system for remote human 3D model restoration, which includes a detection position 100 and a detector 200 arranged on one side of the detection position 100, and the detector 200 has a detection head 21, a local detection unit 300 and a remote detection unit 400.

[0040] The local detection unit 300 is used to take a picture of the detection object on the detection position 100 to form 3D data of the detection object, send the 3D data to the remote detection unit 400, and drive the detection head 21 to move and / or retract relative to the detection object according to the guidance information of the remote detection unit 400 to complete the detection and form a detection image;

[0041] Among them, the remote detection unit 400 receives the 3D data and remotely simulates a detection object model based on the 3D data, operates on the detection object model through a probe positioning device 43 with a positioning function, forms guidance information, and sends the guidance information to the local detection unit 300 to complete local detection. The guidance information includes 3D coordinates relative to the detection position 100.

[0042] The telemedicine system disclosed in the present invention includes a local detection unit 300 at the local end and a remote detection unit 400 at the remote end. The local detection unit 300 obtains 3D data consistent with the vital signs of the object to be detected, and sends the 3D data to the remote detection unit 400. The remote detection unit 400 simulates and forms a detection object model according to the 3D data, and uses a probe positioning device 43 with a positioning function to operate on the detection object model. According to the operation process of the probe positioning device 43, guidance information with coordinates as data is formed, and the guidance information is sent to the local detection unit 300. By driving the local detection unit 300 to connect to the detection head 21, the corresponding detection points are detected according to the coordinates and sequence of the guidance information, thereby forming a detection image on the detector 200.

[0043] The remote medical detection system for remote human body 3D model restoration of the present invention does not require a detection technician with detection skills to operate at the local end, but only needs to obtain 3D data of the detection object; a detection technician with specific skills at the remote end performs remote detection operations, and uses the detection coordinates and sequence as guidance information to guide the local detection head 21 to perform corresponding detection operations, thereby solving the technical problem of difficulty in completing detection in medical institutions that do not have detection technicians at the local end.

[0044] In addition, the detection technician at the remote end can successively communicate with the local detection units 300 at multiple local ends to guide the detection at the local end. In particular, the communication can establish a link through a mobile wireless network, a local area network or a wide area network, thereby expanding the connection between the remote end and the local end. One remote end can be connected to multiple local ends, achieving one-to-many customized services, making the work of the detection technician more targeted.

[0045] In the present invention, the local detection unit 300 includes: a plurality of cameras 31 , an image processing center 32 , a communication module 33 , a detection head driving module 34 and a detection head control module 35 .

[0046] Among them, multiple cameras 31 are arranged near the detection position 100, and the shooting angles of each other are set at an angle. The multiple cameras 31 are respectively arranged above the detection position 100, and take pictures of the detection objects on the detection position 100 to form multiple images; the image processing center 32 is connected to the multiple cameras 31, and is used to receive multiple images and form 3D data; the communication module 33 is connected to the image processing center 32 to send 3D data to the remote detection unit 400.

[0047] Furthermore, a detection head 21 is fixed on the detection head driving module 34, which is used to drive the detection head 21 so that the detection head 21 moves and / or retracts to a corresponding detection position and detection depth; the detection head control module 35 is connected to the communication module 33, and the detection head control module 35 receives the guidance information through the communication module 33, and controls the detection head driving module 34 to move or retract according to the guidance information, thereby driving the detection head 21 to move to a corresponding detection position and detection depth to complete the detection.

[0048] The detector 200 is commonly a B-ultrasound detector 200, and its detection head 21 needs to determine the detection position, detection angle and depth of the detection head 21 according to the description of the subject's condition and position during detection. In this embodiment, with the help of the detection head driving module 34, the position and depth data that need to be detected can be quickly determined.

[0049] Of course, in this embodiment, the detector 200 also communicates with the communication module 33, and can send the detection image of the detection head 21 to the remote detection unit 400 through the communication module 33. The remote detection unit 400 is provided with a display module 44, which can display the detection image in time, thereby providing diagnostic guidance for the inspection technician operating on the remote detection unit 400.

[0050] In addition, at least one camera 31 is used to capture the operation process of the local detection unit 300 to form an operation video; the communication module 33 sends the operation video to the display module 44 for display.

[0051] In this embodiment, the remote detection unit 400 further includes: a detection object model 41 , a model control device 42 and a probe positioning device 43 .

[0052] Specifically, the detection object model 41 is set on the workbench, and is connected to the model control device 42. The model control device 42 controls the detection object model 41, so that the detection object model 41 simulates the detection object model 41 that is the same as the detection object. The model control device 42 is connected to the detection object model 41, and the model control device 42 is used to shape the detection object model 41. The model control device 42 communicates with the communication module 33, and is used to receive the 3D data sent by the communication module 33, and shapes the detection object model 41 according to the 3D data. The detection object model 41 formed is the same as the body shape of the detection object; the probe positioning device 43 communicates with the communication module 33, and includes a positioning module 431. When the probe positioning device 43 is operated and moved, the guidance information is generated, and the guidance information is sent to the local detection unit 300 through the communication module 33.

[0053] In this embodiment, the positioning module 431 takes a point on the workbench as the initial coordinate position, and when the detection technician operates the probe positioning device 43, the coordinates of the positioning module 431 are recorded, and the guidance information is formed based on the coordinates.

[0054] Of course, the guidance information also includes the detection order at different detection points, the detection depth and detection angle at each detection point and other information.

[0055] In this embodiment, since the shaped detection object model 41 has the same body shape as the detection object, the operation of the detection object model 41 by the detection technician operating at the remote detection center is equivalent to direct operation on the detection object; and the guidance information formed by the record of the detection technician's operation at the remote end can restore the operation process at the local detection center at the local end, thereby overcoming the problem that the detection cannot be completed without a detection technician at the local end.

[0056] The detection object model 41 is made of soft plastic material, and is internally divided into a plurality of unit modules 41, each of which is provided with a connection port 412. When the number of internally divided unit modules 41 is sufficient, it is completely possible to reconstruct the body shape of the detection object on the detection object model 41 completely according to the 3D data.

[0057] Specifically, the model control device 42 includes a model control center 421 and at least one blowing device 422 and multiple conduits 423 and a control valve 424 connected to the blowing device 422, and the connecting port 412 is respectively connected to one of the conduits 423; the model control center 421 is connected to the control valve 424, and the model control center 421 controls the opening and closing of the multiple control valves 424 according to the 3D data, thereby controlling the inflation amount in each of the unit modules 41 to achieve the purpose of simulating the body shape of the detection object.

[0058] In the present invention, a remote medical detection method for remote human 3D model restoration is also provided, and the remote medical detection method for remote human 3D model restoration comprises the following steps: referring to Figure 2 as well as Figure 4 ,Specifically, step 1: locally generate 3D data of the detection object;

[0059] The method of forming the 3D data includes:

[0060] A plurality of cameras 31 with shooting angles are provided to shoot a plurality of images, and 3D data are calculated according to the plurality of images by a 3D imaging algorithm.

[0061] Step 2: remotely simulating and forming a detection object model 41 having the same body shape as the detection object according to the 3D data;

[0062] The method of forming the detection object model 41 includes:

[0063] The detection object model 41 is divided into multiple unit modules 41, each unit module 41 has a conduit 423 and a control valve 424, and the conduit 423 is connected to the blowing device 422 through the control valve 424; the model control center 421 controls the opening or closing of corresponding one or more of the multiple control valves 424 according to the 3D data, so that different amounts of air are filled into the multiple unit modules 41, thereby simulating the body shape of the detection object.

[0064] Step 3: Perform a detection operation on the remote detection object model 41, and obtain the coordinates of the detection position 100 during the detection operation as guidance information;

[0065] Step 4: Send the guidance information to the local, and drive the detection head 21 to complete the detection operation on the detection object according to the corresponding coordinates according to the guidance information, so as to form a detection image.

[0066] In the remote medical detection method of remote human 3D model restoration of the present invention, firstly, the 3D data formed locally is obtained according to the detection object, and then the 3D data is sent to the remote detection center. At the remote end, a detection object model 41 with the same body shape as the local detection object is first shaped according to the 3D data. At the remote end, a detection technician with specific detection knowledge performs detection operations on the detection object model 41, and forms guidance information according to the process of the detection operation, and sends the guidance information back to the local end. The local end drives the detection head 21 to detect the detection object according to the corresponding coordinates, position, angle, depth, etc. according to the guidance information to form a detection image. In the whole work and operation process, the local end does not need a detection technician, and only needs to use the corresponding equipment to obtain the 3D data of the detection object, and perform specific detection operations according to the guidance information sent back by the remote end, which overcomes the technical problem in the prior art that medical institutions that do not currently have detection technicians have difficulties in detection when completing projects that require specific detection knowledge, or solves the technical problem that the shortage of inspection technicians is large and cannot meet the demand.

[0067] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, rather than to limit the scope of protection of the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the essence and scope of the technical solution of the present invention.

Claims

1. A remote medical detection system for remote human 3D model restoration, comprising a detection position and a detector arranged on one side of the detection position, wherein the detector has a detection head, characterized in that: The remote medical detection system for remote human 3D model restoration also includes: a local detection unit and a remote detection unit; The local detection unit is used to take a picture of the detection object at the detection position to form 3D data of the detection object, send the 3D data to the remote detection unit, drive the detection head to move and / or extend relative to the detection object according to the guidance information of the remote detection unit to complete the detection, and form a detection image; The remote detection unit receives the 3D data and remotely simulates a detection object model according to the 3D data, operates on the detection object model through a probe positioning device with a positioning function to form guidance information, and sends the guidance information to the local detection unit to complete the local detection; The remote detection unit comprises: A detection object model disposed on a workbench; a model control device, the model control device being connected to the detection object model, the model control device being used to shape the detection object model, the model control device being in communication with the communication module, being used to receive the 3D data sent by the communication module, and shaping the detection object model according to the 3D data, the formed detection object model being the same in shape as the detection object; A probe positioning device, the probe positioning device communicates with the communication module, and includes a positioning module. When the probe positioning device is operated and moved, the guidance information is generated, and the guidance information is sent to the local detection unit through the communication module; The detection object model is made of soft plastic material, and its interior is divided into multiple unit modules, each of which is provided with a connection port; the model control device includes a model control center and at least one blowing device and multiple conduits and control valves connected to the blowing device, and the connection port is connected to one of the conduits respectively; the model control center is connected to the control valve, and the model control center controls the opening and closing of multiple control valves according to the 3D data, thereby controlling the inflation amount in each unit module to achieve the purpose of simulating the body shape of the detection object.

2. The remote medical detection system for remote human 3D model restoration as claimed in claim 1, characterized in that: The guidance information includes 3-dimensional coordinates relative to the detection position.

3. The remote medical detection system for remote human 3D model restoration as claimed in claim 1, characterized in that: The local detection unit comprises: A plurality of cameras arranged at an angle to each other, the plurality of cameras being arranged above the detection positions respectively, taking pictures of the detection objects on the detection positions to form a plurality of images; An image processing center, connected to the plurality of cameras, for receiving the plurality of images and forming 3D data; a communication module, the communication module being connected to the image processing center and configured to send the 3D data to the remote detection unit; A detection head driving module, wherein the detection head is arranged on the detection head driving module; The detection head control module is connected to the communication module, and the detection head control module receives the guidance information through the communication module, and controls the movement and / or extension of the detection head drive module according to the guidance information, thereby driving the detection head to move to a corresponding detection position and detection depth to complete the detection.

4. The remote medical detection system for remote human 3D model restoration as claimed in claim 3, characterized in that: The communication module communicates with the detector and is used to send the detection image to the remote detection unit.

5. The remote medical detection system for remote human 3D model restoration as claimed in claim 4, characterized in that: The remote detection unit also includes a display module, which communicates with the communication module; at least one of the cameras is used to capture the operation process of the local detection unit to form an operation video; the communication module sends the operation video and the detection image of the detector to the display module for display.

6. A method implemented by a remote medical detection system based on remote human 3D model restoration as claimed in any one of claims 1 to 5, characterized in that: The following steps are involved: Step 1: Generate 3D data of the detected object locally; Step 2: remotely simulating a detection object model having the same body shape as the detection object according to the 3D data; Step 3: Perform a detection operation on the remote detection object model, and obtain the coordinates of the detection position during the detection operation as guidance information; Step 4: Send the guidance information to the local device, and drive the detection head to complete the detection operation on the detection object according to the corresponding coordinates according to the guidance information, so as to form a detection image; The method for forming the detection object model in step 2 includes: The detection object model is divided into a plurality of unit modules, each unit module has a conduit and a control valve, and the conduit is connected to the blowing device through the control valve; The model control center controls one or more of the multiple control valves to be turned on or off according to the 3D data, so that different amounts of air are filled into the multiple unit modules, thereby simulating the body shape of the detection object.

7. The method implemented by the remote medical detection system for remote human 3D model restoration as claimed in claim 6, characterized in that: The method for forming the 3D data in step 1 includes: A plurality of cameras with shooting angles are set to capture a plurality of images, and 3D data is calculated based on the plurality of images by a 3D imaging algorithm.

Images