Medical live broadcast image capture control system and method

Abstract

The invention provides a medical live broadcast image capture control system and method. The medical live broadcast image capture control system is suitable for executing the medical live broadcast image capture control method. In the medical live broadcast image capture control method, an image capture device is controlled to move between different image capture positions and capture a plurality of medical images.

Description

Technical Field

[0001] The present invention relates to medical imaging, and in particular to a control system and method for capturing medical live images. Background Art

[0002] The operating room is an important place for patients to undergo surgical treatment and rescue, involving the participation of medical personnel from many aspects. It is extremely important for colleagues in the operating room to provide high-quality services to surgeons and provide high-quality care to patients. With the increasing complexity of modern surgery, especially the birth of minimally invasive surgery, the requirements for the medical capabilities of medical personnel and the medical environment of the operating room are extremely high. In order to avoid affecting the surgical process, it is impossible to meet the needs of multiple people to observe and learn on site, resulting in a significant reduction in the opportunities for other medical personnel to learn and observe the surgery, which is not conducive to improving the medical demonstration teaching and communication effects between medical personnel in the same hospital or different hospitals.

[0003] In order to provide medical demonstration teaching and communication effects outside the operating room, a few interactive communication systems have been developed to provide synchronous networking between electronic devices of medical personnel in the same or different hospitals or other places, and to broadcast the surgery or other medical behavior process in real time and dynamically as a remote or ongoing teaching. However, the cameras installed in the existing operating room are all fixed at the same height, and the capture position, direction and range of these cameras are fixed. The remotely networked medical personnel cannot remotely and dynamically control the movement of the camera and shoot the target they want to observe. For example, the camera cannot move with the movement of the medical instrument (such as a scalpel) held by the medical personnel in the operating room who want to observe on the specific patient's body part. Summary of the invention

[0004] In view of the deficiencies in the prior art, the present invention provides a medical live image capture control system and method.

[0005] A medical live broadcast image capture control system of the present invention is suitable for controlling an image capture device, and comprises a main control device. The main control device is configured to output a plurality of main control signals. The image capture device is configured to move between a plurality of image capture positions according to the plurality of main control signals received from the main control device, and to capture a plurality of medical images at the plurality of image capture positions.

[0006] A medical live image capture control method of the present invention comprises the following steps: a plurality of user remote devices respectively output a plurality of remote control signals to a main control device; the main control device respectively outputs a plurality of main control signals to an image capture device based on the plurality of remote control signals to control the image capture device to move between a plurality of image capture positions; and the image capture device is used to respectively capture a plurality of medical images at the plurality of image capture positions.

[0007] As described above, the present invention provides a medical live broadcast image capture control system and method. The medical live broadcast image capture control system and method of the present invention can remotely control the movement of image capture devices (including multiple image capture devices) set in other spaces such as operating rooms based on remote control signals issued by users such as remote medical personnel operating their user remote devices, so as to change the position, direction and range of the image captured by the image capture device, and realize the real-time dynamic tracking of multiple targets by remotely controlling the image capture device. In this way, remote medical personnel can observe different targets or targets in moving positions from different fields of view at any time, for example, they can see the patient's wound more clearly and clearly observe the medical staff in the operating room treating the patient's wound, effectively achieving a good remote live broadcast teaching and observation effect.

[0008] In order to further understand the features and technical contents of the present invention, reference may be made to the following detailed description and drawings of the present invention. However, the drawings provided are only for reference and description and are not intended to limit the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 It is a block diagram of a medical live image capture control system according to the first embodiment of the present invention.

[0010] Figure 2 This is a block diagram of a medical live image capture control system according to a first embodiment of the present invention applied to an operating room.

[0011] Figure 3 4 is a block diagram of a medical live image capture control system according to a second embodiment of the present invention.

[0012] Figure 4 This is a flowchart of the steps of a medical live image capture control method according to the second embodiment of the present invention.

[0013] Figure 5 A schematic diagram of a medical image playback platform established by a medical live image capture control system according to a third embodiment of the present invention playing a plurality of medical images.

[0014] Figure 6 A schematic diagram of a remote control panel of a medical image playback platform established by a medical live image capture control system according to a third embodiment of the present invention.

[0015] Figure 7 This is a schematic diagram of opening a conference participation window on a medical image playback platform established by the medical live image capture control system according to the third embodiment of the present invention.

[0016] Figure 8A schematic diagram of a remote control panel on a medical image playback platform established by a medical live image capture control system according to a fourth embodiment of the present invention.

[0017] Description of Figure Numbers

[0018] 100: Main control device

[0019] 200: Image capture device

[0020] 300: User remote device

[0021] 110: Main control module

[0022] 120: Communication platform establishment module

[0023] 210: Image Capture Lens

[0024] 220: Lens control assembly

[0025] S101~S105: Steps

[0026] RG1: Video playback area

[0027] RG2: Control options area

[0028] RG3: Image recommendation area

[0029] RG4: Image Case Menu Area

[0030] IM1, IM2, IM3: Medical imaging

[0031] BU1: Remote Control Panel Option

[0032] BU2: Online Meeting Options

[0033] WD1, WD3: Remote control panel

[0034] BW1: Move up option

[0035] BW2: Move down options

[0036] BW3: Move options left

[0037] BW4: Move options right

[0038] BW5: Zoom in on the move option

[0039] BW6: Zoom out option

[0040] WD2: Meeting participation window

[0041] BU3: Meeting Attendance Options

[0042] BM1, BM2: Sub-control panel options

[0043] BW7: Centering option

[0044] BP1~BP8: Preset capture position options DETAILED DESCRIPTION

[0045] The following is an explanation of the embodiments of the present invention through specific embodiments, and those skilled in the art can understand the advantages and effects of the present invention from the contents disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and the details in this specification can also be modified and changed in various ways based on different viewpoints and applications without departing from the concept of the present invention. In addition, it is stated in advance that the drawings of the present invention are only simple schematic illustrations and are not depicted according to actual sizes. The following embodiments will further explain the relevant technical contents of the present invention in detail, but the disclosed contents are not intended to limit the scope of protection of the present invention. In addition, the term "or" used herein may include any one or more combinations of the associated listed items depending on the actual situation.

[0046] Reference Figure 1 and Figure 2 ,in Figure 1 is a block diagram of a medical live image capture control system according to a first embodiment of the present invention, Figure 2 This is a block diagram of a medical live image capture control system according to a first embodiment of the present invention applied to an operating room.

[0047] like Figure 1 As shown, the medical live broadcast image capture control system of the present invention includes a main control device 100, which is suitable for directly controlling the movement of the image capture device 200, and is also suitable for controlling the movement of the image capture device 200 according to the remote control of the user remote device 300. The main control device 100 establishes a connection, network or communication with the user remote device 300 and the image capture device 200.

[0048] like Figure 2 As shown, the medical live broadcast image capture control system of the present invention is applicable to the operating room of the hospital, and is also applicable to other operating rooms, consulting rooms and other spaces in the hospital, and can also be applied to clinics or other medical institutions. The image capture device 200 of the medical live broadcast image capture control system of the present invention can be as follows Figure 2 Shown as being set up in an operating room in a hospital or in practice being set up in consulting rooms and other spaces.

[0049] The medical live image capture control system of the present invention is designed to allow the images of surgical procedures in a hospital's operating room to be shared with a large number of medical personnel in the same hospital or different hospitals outside the operating room. At the same time, it can respond to the live image content that the medical personnel need to watch (such as the hands of the surgeon and the medical equipment held, such as a scalpel, and the patient's body parts, etc.), and provide the medical personnel with the ability to remotely control the position, angle, direction, and range of shooting by the image capture device 200 through the user remote device 300.

[0050] In such Figure 2 In the scenario shown, users outside the hospital's operating room, including medical staff from this hospital and other hospitals, especially new medical staff, can use the hospital's or personal user remote device 300 to remotely control the movement and rotation of the operating room's image capture device 200 (such as a camera) to change the content of the medical images captured by the image capture device 200.

[0051] For ease of explanation, a single user remote device 300 is described below. However, in actual application scenarios, multiple users can simultaneously use multiple user remote devices to remotely control the movement or rotation of the image capture device 200 (such as a camera) in the operating room.

[0052] The user remote device 300 (such as a computer, a remote server or other electronic device) outputs multiple remote control signals according to multiple control indication information (including multiple moving direction indication information and multiple target position indication signals) input by the user on the user remote device 300 or according to multiple control operation options triggered by the user. It should be understood that the number of multiple control indication information input, multiple control operation options triggered, and remote control signals output depends on actual needs.

[0053] The main control device 100 is a control machine, a microcontroller or other hardware device. The main control device 100 outputs a main control signal (according to each remote control signal from one or more user remote devices 300). The image capture device 200 moves between multiple image capture positions according to multiple main control signals received from the main control device 100, and captures multiple medical images at multiple image capture positions. The multiple medical images described herein may include multiple medical dynamic images, multiple medical static images or any combination thereof.

[0054] For the convenience of explanation, Figure 2Only a single image capture device 200 is shown in the figure. In practice, the image capture device 200 may include multiple medical capture components (e.g., multiple cameras) distributed in the operating room of the hospital or in practice, multiple different capture positions in the consulting room and other spaces. Each of the multiple medical capture components moves between multiple image capture positions according to one or more master control signals received from the master control device 100 to capture multiple medical images at the multiple image capture positions.

[0055] Reference Figure 3 and Figure 4 ,in Figure 3 is a block diagram of a medical live image capture control system according to a second embodiment of the present invention, Figure 4 This is a flowchart of the steps of a medical live image capture control method according to the second embodiment of the present invention.

[0056] like Figure 3 As shown, the medical live broadcast image capture control system of the present invention includes a main control device 100, which is suitable for directly controlling the movement of the image capture device 200, and is also suitable for controlling the movement of the image capture device 200 according to the remote control of the user remote device 300. In the second embodiment, the image capture device 200 includes an image capture lens 210 and a lens control component 220, and the main control device 100 includes a main control module 110 and a communication platform establishment module 120.

[0057] The medical live broadcast image capture control method of the present invention may include: Figure 4 Steps S101 to S105 shown in FIG. Figure 3 The medical live broadcast image capture control system shown is executed. The execution order and content of these steps S101 to S105 can be appropriately adjusted and omitted according to actual needs, and the present invention is not limited thereto.

[0058] The communication platform establishment module 120 of the main control device 100 is connected to one or more user remote devices 300. In the main control device 100, the communication platform establishment module 120 is wirelessly or wiredly connected to the main control module 110. The main control module 110 of the main control device 100 is wirelessly or wiredly connected to the lens control component 220 of the image capture device 200. In the image capture device 200, the lens control component 220 is electrically or mechanically connected to the image capture lens 210.

[0059] In a space at a medical institution, such as an operating room, the lens control component 220 in the image capture device 200 controls the image capture lens 210 to capture multiple images of multiple target tracking objects (including the environment, medical personnel, medical equipment such as scalpels, etc.) in the space to output multiple medical images, including multiple medical dynamic images, multiple medical static images or any combination thereof, especially for live broadcast of surgical procedures, capturing and outputting multiple medical dynamic images (such as Figure 4 Step S101).

[0060] At the medical institution end, the main control module 110 obtains a plurality of medical images captured by the image capture lens 210 of the image capture device 200 from the lens control component 220 of the image capture device 200 .

[0061] At the medical institution end, the communication platform establishment module 120 of the main control device 100 establishes a medical image playback platform (such as Figure 4 In step S102), the medical image playback platform may include a network platform, an application program, or a combination thereof.

[0062] At the medical institution end, the communication platform establishment module 120 of the main control device 100 obtains the multiple medical images captured by the image capture lens 210 of the image capture device 200 from the main control module 110, and plays these multiple medical images in the image playback area on the medical image playback platform (such as Figure 4 Step S103).

[0063] At the medical institution end, the main control device 100 (based on the contents of multiple medical images played on the medical image playback platform) outputs multiple main control signals (such as Figure 4 Step S104).

[0064] Alternatively, on the client side, each user operates the user remote device 300 to open the medical image playback platform on the browser installed in the user remote device 300 to watch the multiple medical images played on the medical image playback platform. At this time, the user can use the user remote device 300 to perform operations on the medical image playback platform at any time, such as inputting multiple control instruction information on the medical image playback platform, or triggering multiple control operation options on the medical image playback platform to generate multiple remote control signals.

[0065] At the medical institution end, the communication platform establishment module 120 of the main control device 100 outputs a plurality of corresponding remote interactive communication signals according to the operation of the user remote device 300 on the medical image playback platform, for example, when the plurality of remote control options are triggered at different time points, the plurality of remote interactive communication signals are output respectively. The main control module 110 of the main control device 100 outputs a plurality of main control signals (such as Figure 4 Step S104).

[0066] At the medical institution end, the lens control component 220 in the image capture device 200 controls the image capture lens 210 to move or rotate (such as Figure 4 Step S105).

[0067] Reference Figures 5 to 7 ,in Figure 5 A schematic diagram of a medical image playback platform established by a medical live broadcast image capture control system according to a third embodiment of the present invention playing a plurality of medical images, Figure 6 A schematic diagram of a remote control panel of a medical image playback platform established by a medical live image capture control system according to a third embodiment of the present invention, Figure 7 This is a schematic diagram of opening a conference participation window on a medical image playback platform established by the medical live image capture control system according to the fourth embodiment of the present invention.

[0068] like Figure 3 The medical live image capture control system shown can establish Figure 5 and Figure 6 For the convenience of explanation, the following uses the medical image playback platform shown in FIG. Figure 3 The medical live image capture control system shown is executed for explanation.

[0069] like Figure 5 and Figure 6 As shown, a page of the medical image playback platform established by the communication platform establishment module 120 can be divided into multiple areas, including an image playback area RG1, a control option area RG2, an image recommendation area RG3, and an image case menu area RG4. It should be understood that the number, area, range, and position of the areas divided on the page of the medical image playback platform can be adjusted according to actual needs, and the present invention is not limited thereto.

[0070] The communication platform establishment module 120 can trigger the remote control panel option BU1 by the user operating the user remote device 300, and open the medical image playback platform. Figure 6The remote control panel WD1 shown (this is another window opened) provides multiple remote control options on this remote control panel, including multiple moving direction options, such as but not limited to: Figure 6 Shown are an upward move option BW1, a downward move option BW2, a left move option BW3, a right move option BW4, a zoom-in move option BW5, a zoom-out move option BW6, a centering option BW7, and multiple preset capture position options BP1-BP8.

[0071] The communication platform establishment module 120 outputs a remote interactive communication signal with centering movement information according to the triggering of the centering option BW7 in the remote control panel WD3 on the medical image playback platform by the user operating the user remote device 300. The main control module 110 outputs a main control signal with centering movement information according to the remote interactive communication signal with centering movement information. The lens control component 220 controls the image capture lens 210 to move to a preset centering position according to the main control signal with centering movement information.

[0072] The communication platform establishment module 120 outputs a remote interactive communication signal with upward movement information according to the triggering of the upward movement option BW1 on the medical image playback platform by the user operating the user remote device 300. The main control module 110 outputs a main control signal with upward movement information according to the remote interactive communication signal with upward movement information. The lens control component 220 controls the image capture lens 210 to move upward according to the main control signal with upward movement information.

[0073] The communication platform establishment module 120 outputs a remote interactive communication signal with downward movement information according to the triggering of the downward movement option BW2 on the medical image playback platform by the user operating the user remote device 300. The main control module 110 outputs a main control signal with downward movement information according to the remote interactive communication signal with downward movement information. The lens control component 220 controls the image capture lens 210 to move downward according to the main control signal with downward movement information.

[0074] The communication platform establishment module 120 outputs a remote interactive communication signal with left movement information according to the triggering of the left movement option BW3 on the medical image playback platform by the user operating the user remote device 300. The main control module 110 outputs a main control signal with left movement information according to the remote interactive communication signal with left movement information. The lens control component 220 controls the image capture lens 210 to move left according to the main control signal with left movement information.

[0075] The communication platform establishment module 120 outputs a remote interactive communication signal with rightward movement information according to the triggering of the rightward movement option BW4 on the medical image playback platform by the user operating the user remote device 300. The main control module 110 outputs a main control signal with rightward movement information according to the remote interactive communication signal with rightward movement information. The lens control component 220 controls the image capture lens 210 to move right according to the main control signal with rightward movement information.

[0076] The communication platform establishment module 120 outputs a remote interactive communication signal with zoom-in information based on the triggering of the zoom-in option BW5 on the medical image playback platform by the user operating the user remote device 300. The main control module 110 outputs a main control signal with zoom-in information based on the remote interactive communication signal with zoom-in information. The lens control component 220 performs an image recognition program on the captured medical image to identify the target tracking object (including the doctor's entire body, the doctor's hands, a scalpel or a combination thereof) in the medical image based on the main control signal with zoom-in information, and controls the image capture lens 210 to move in a direction close to the target tracking object to shorten the distance to the target tracking object, thereby enlarging the target tracking object to be viewed.

[0077] The communication platform establishment module 120 outputs a remote interactive communication signal with zoom-out movement information based on the triggering of the zoom-out movement option BW6 on the medical image playback platform by the user operating the user remote device 300. The main control module 110 outputs a main control signal with zoom-out movement information based on the remote interactive communication signal with zoom-out movement information. The lens control component 220 performs an image recognition program on the captured medical image to identify the target tracking object (including the doctor's hand, scalpel or a combination thereof) in the medical image based on the main control signal with zoom-out movement information, and controls the image capture lens 210 to move away from the target tracking object to increase the distance from the target tracking object, thereby increasing the viewing range.

[0078] If necessary, the communication platform establishment module 120 can be Figure 6 The multiple control options provided on the medical image playback platform shown in the figure may further include an online conference option BU2. The online conference option BU2 may be as follows: Figure 6 Shown in the video playback area.

[0079] The communication platform establishment module 120 can be based on the user's operation of the user remote device 300 to Figure 6 The triggering of the online conference option BU2 on the medical image playback platform shown in FIG. 1 (eg, by clicking on it) is used to open the medical image playback platform. Figure 7The conference joining window WD2 shown in the figure may provide a conference joining option BU3, which may actually include a plurality of conference setting options and a plurality of conference information options.

[0080] The communication platform establishment module 120 can be based on the user's operation of the user remote device 300 to Figure 7 The conference participation window WD2 on the medical image playback platform shown is triggered to open the online conference interactive area of ​​the online conference on the medical image playback platform, allowing one or more users (e.g., only the host) who join the online conference to have the authority to communicate with each other, trigger multiple remote control options, select multiple medical images, and view multiple medical images. In this way, the user is allowed to allow conference participants to control multiple cameras, such as the person who co-hosts the meeting and the participants who are authorized to participate in the meeting can remotely control the image capture device 200.

[0081] Reference Figure 8 , which is a schematic diagram of a remote control panel on a medical image playback platform established by a medical live image capture control system according to a fourth embodiment of the present invention.

[0082] like Figure 6 The remote control panel WD1 shown can be replaced by Figure 8 The remote control panel WD3 shown. The communication platform establishment module 120 can be Figure 8 The remote control panel WD3 shown provides multiple sub-control panel options BM1 and BM2, which are respectively used to remotely control the image capture device 200. The number of the multiple sub-control panel options BM1 and BM2 may depend on the number of image capture devices 200 included in the image capture device 200.

[0083] The communication platform establishment module 120 triggers the multiple sub-control panel options BM1 and BM2 in the remote control panel WD3 on the medical image playback platform according to the user operating the user remote device 300, so as to open the corresponding multiple sub-control panels on the remote control panel WD3.

[0084] Industrial Applicability

[0085] In summary, the present invention provides a medical live image capture control system and method. The medical live image capture control system and method of the present invention can remotely control the movement of image capture devices set in other spaces such as operating rooms based on remote control signals issued by users such as remote medical personnel operating their user remote devices, so as to change the position, direction and range of images captured by the image capture device, and realize real-time dynamic tracking of multiple targets by remotely controlling the image capture device. In this way, remote medical personnel can observe different targets or targets in moving positions from different fields of view at any time, for example, they can see the patient's wound more clearly and clearly observe the medical staff in the operating room treating the patient's wound, effectively achieving a good remote live teaching and observation effect.

[0086] The contents disclosed above are only preferred feasible embodiments of the present invention, and are not intended to limit the scope of the present invention. Therefore, all equivalent technical changes made using the contents of the present invention description and drawings are included in the scope of the present invention.

Claims

1. A medical live broadcast image capture control system, suitable for controlling an image capture device, characterized in that: Include: A master control device, configured to output a plurality of master control signals, The image capture device is configured to move between a plurality of image capture positions according to a plurality of the master control signals received from the master control device, and to capture a plurality of medical images at the plurality of the image capture positions.

2. The medical live broadcast image capture control system according to claim 1, characterized in that: The main control device is configured to output a plurality of the main control signals according to a plurality of remote control signals from a plurality of user remote devices.

3. The medical live broadcast image capture control system according to claim 1, characterized in that: The image capturing device includes a plurality of image capturing devices.

4. The medical live broadcast image capture control system according to claim 1, characterized in that: The image capture device includes an image capture lens and a lens control component. The lens control component is configured to control the movement of the image capturing lens according to each of the main control signals received from the main control device.

5. The medical live broadcast image capture control system according to claim 1, characterized in that: The main control device is configured to play each of the medical images received from the main control device on a medical image playback platform.

6. The medical live broadcast image capture control system according to claim 5, characterized in that: The main control device is configured to open a remote control panel on the medical image playback platform, and output a plurality of remote interactive communication signals respectively when a plurality of remote control options on the remote control panel are respectively triggered. The main control device is configured to output a plurality of the main control signals according to a plurality of the remote interactive communication signals respectively.

7. The medical live broadcast image capture control system according to claim 6, characterized in that: The plurality of remote control options include a plurality of moving direction options, a plurality of default capture position options or any combination thereof.

8. The medical live broadcast image capture control system according to claim 6, characterized in that: The main control device is configured to provide a plurality of sub-control panel options on the remote control panel, and to respectively open a plurality of sub-control panels when the plurality of sub-control panel options are respectively triggered. The plurality of sub-control panels are respectively configured to control a plurality of the image capturing devices, and a plurality of the remote control options are provided on each of the sub-control panels.

9. The medical live broadcast image capture control system according to claim 6, characterized in that: The main control device is configured to provide an online conference interactive area for an online conference on the medical image playback platform, allowing one or more users who join the online conference to have the authority to trigger multiple remote control options.

10. A method for controlling medical live broadcast image capture, characterized in that: The following steps are involved: The main control device outputs a plurality of main control signals to the image capture device; The image capturing device moves between a plurality of image capturing positions according to a plurality of the main control signals; and The image capturing device is used to capture a plurality of medical images at a plurality of image capturing positions.

11. The medical live broadcast image capture control method according to claim 10, characterized in that: It also includes the following steps: A plurality of user remote devices respectively output a plurality of remote control signals to the main control device; The main control device outputs a plurality of the main control signals to the image capture device respectively according to a plurality of the remote control signals.

12. The medical live broadcast image capture control method according to claim 10, characterized in that: It also includes the following steps: The image capture device is configured to include an image capture lens and a lens control component; and The lens control component controls the movement of the image capturing lens according to each of the main control signals.

13. The medical live broadcast image capture control method according to claim 10, characterized in that: The method also includes the following steps executed by the main control device: The medical images are played on a medical image playback platform.

14. The medical live broadcast image capture control method according to claim 10, characterized in that: The method also includes the following steps executed by the main control device: Opening a remote control panel on the medical image playback platform; and When multiple remote control options on the remote control panel are triggered respectively, multiple main control signals are output respectively.

15. The medical live broadcast image capture control method according to claim 14, characterized in that: The method also includes the following steps executed by the main control device: The plurality of remote control options are configured to include a plurality of moving direction options corresponding to a plurality of moving directions, a plurality of default capture position options, or any combination thereof.

16. The medical live broadcast image capture control method according to claim 14, characterized in that: The method also includes the following steps executed by the main control device: providing a plurality of sub-control panel options on the remote control panel; The main control device displays a plurality of sub-control panels respectively when a plurality of sub-control panel options are respectively triggered; as well as A plurality of remote control options are provided on each of the sub-control panels.

17. The medical live broadcast image capture control method according to claim 12, characterized in that: The method also includes the following steps executed by the main control device: Establishing an online conference interactive area for online conferences on the medical image playback platform; and One or more users who are allowed to join the online conference have the authority to trigger multiple remote control options.

Images