Method and system for realizing telemedicine, medium and electronic equipment

Abstract

The invention discloses a method and system for realizing telemedicine, a medium and electronic equipment, and the method comprises the steps: setting the number of video signal collection equipment according to the number of medical instruments needing to collect video signals in a medical treatment site; connecting the medical instrument with a video signal acquisition interface of a corresponding video signal acquisition device; the medical video proxy device joins in the remote medical conference and sends a conference participation instruction to the video signal acquisition device, and the video signal acquisition device joins in the remote medical conference, encodes the acquired video signals and issues each path of video encoding signals and a medical video proxy device identifier; and the remote medical terminal equipment displays the video coding signals with the same medical video proxy equipment identifier in a medical video proxy equipment release window of the remote medical conference. According to the invention, the implementation modes of remote medical treatment are enriched, the application flexibility and reliability of remote medical treatment are improved, and the implementation complexity and cost of remote medical treatment are reduced.

Description

Technical Field

[0001] The present disclosure relates to the field of medical technology, and in particular to a method for implementing telemedicine, a system for implementing telemedicine, a storage medium, and an electronic device. Background Art

[0002] Telemedicine refers to the technology that enables the long-distance transmission of medical information through remote communication technology, holographic imaging technology, new generation electronic information technology and computer multimedia technology, so as to provide medical services at a distance. In the process of realizing telemedicine (such as telemedicine consultation, telemedicine teaching and teleoperative guidance, etc.), remote medical personnel (such as medical experts or trainees, etc.) usually need to understand the current display of various medical instruments at the medical treatment site and conduct remote audio / video interaction with the medical personnel at the site, for example, the remote medical experts guide the medical personnel at the site to successfully complete the medical treatment process.

[0003] With the development of medical technology, the types and quantities of medical instruments used at the rescue site are often more than one or two. How to simply and conveniently provide the display images of various medical instruments used at the rescue site to remote medical personnel in a timely manner so that remote medical personnel can better participate in the medical treatment process is a technical issue worthy of attention. Summary of the invention

[0004] In order to solve the above technical problems, the present disclosure is proposed. The embodiments of the present disclosure provide a method, a system, a storage medium and an electronic device for implementing telemedicine.

[0005] According to a first aspect of an embodiment of the present disclosure, a method for implementing telemedicine is provided, the method comprising: setting the number of video signal acquisition devices according to the number of medical instruments that need to acquire video signals at a medical treatment site; connecting the medical instruments that need to acquire video signals to the video signal acquisition interfaces of the corresponding video signal acquisition devices respectively; wherein a video signal acquisition device has one or more video signal acquisition interfaces, and a video signal acquisition device is connected to one or more medical instruments through its video signal acquisition interface; a medical video agent device joins a telemedicine conference and sends a conference participation instruction to at least one video signal acquisition device; the video signal acquisition device that receives the conference participation instruction joins the telemedicine conference, acquires video signals from the medical instruments connected thereto, encodes the acquired video signals, obtains at least one video encoding signal, and publishes each video encoding signal and the medical video agent device identifier to the telemedicine conference; the telemedicine terminal device displays each video encoding signal with the same medical video agent device identifier in the medical video agent device publishing window of the telemedicine conference according to a preset window layout.

[0006] According to a second aspect of an embodiment of the present disclosure, a system for implementing telemedicine is provided, the system comprising: at least one video signal acquisition device, a medical video proxy device, and at least one telemedicine terminal device, the video signal acquisition device and the medical video proxy device are arranged at a medical treatment site, and each video signal acquisition device has one or more video signal acquisition interfaces, each video signal acquisition device is connected to one or more medical instruments that need to acquire video signals at the medical treatment site through its own video signal acquisition interface, and the number of the video signal acquisition devices is determined according to the number of medical instruments that need to acquire video signals at the medical treatment site; the medical video proxy device comprises: a conference participation control module, which is used to enable the medical video proxy device to join a telemedicine conference and send a video signal acquisition message to at least one video signal acquisition device. The video signal acquisition device comprises: a conference participation module, which is used to join the remote medical conference according to the conference participation instruction when the video signal acquisition device where the video signal acquisition device is located receives the conference participation instruction from the medical video agent device; a first acquisition and encoding module, which is used to acquire video signals from medical instruments connected to the video signal acquisition device where the video signal acquisition device is located, and encode the acquired video signals to obtain at least one video encoding signal; a first publishing module, which is used to publish the various video encoding signals obtained by the first acquisition and encoding module and the medical video agent device identifier to the remote medical conference; the remote medical terminal device comprises: a first display module, which is used to display the various video encoding signals with the same medical video agent device identifier in the medical video agent device publishing window of the remote medical conference according to a preset window layout.

[0007] According to a third aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, wherein the storage medium stores a computer program, and the computer program is used to implement any of the above methods.

[0008] According to a fourth aspect of an embodiment of the present disclosure, an electronic device is provided, comprising: a processor; a memory for storing instructions executable by the processor; the processor is configured to read the executable instructions from the memory and execute the instructions to implement any of the above methods.

[0009] Based on a method, system, storage medium and electronic device for implementing telemedicine provided by the above-mentioned embodiments of the present disclosure, by setting up a video signal acquisition device at the medical treatment site and connecting the video signal acquisition device to the medical instrument, the phenomenon of hardware modification of the medical video agent device to increase the video signal acquisition interface can be avoided, thereby helping to avoid the high modification cost and long modification cycle caused by hardware modification and the equipment operation stability problems caused by hardware stacking; since the number of video signal acquisition devices can be determined according to the number of medical instruments at the medical treatment site, the technical solution of the present disclosure can conveniently meet the different requirements of different telemedicine scenarios for the number of video signal acquisition interfaces, thereby helping to avoid the phenomenon that the medical video agent device after hardware modification has a fixed number of video signal acquisition interfaces and is difficult to flexibly apply to different telemedicine scenarios; each video signal acquisition The device joins the telemedicine conference according to the instruction of the medical video proxy device, and publishes the video coded signal collected and coded by it together with the medical video proxy device identifier, so that each telemedicine terminal device can group the received video coded signals by the medical video proxy device, and present the video coded signals of the same group in a medical video proxy device publishing window, which not only makes the video images of the medical instruments that the remote medical personnel can reach flexibly controlled, but also makes the medical treatment site free of the bottleneck phenomenon caused by one medical video device processing the video signals of all medical instruments. In addition, while the number of video signal acquisition devices connected to the medical video proxy device is not limited, each telemedicine terminal device can also switch conveniently in different medical treatment sites through the switching window, which is conducive to further enhancing the application flexibility of the technical solution of the present disclosure. It can be seen that the technical solution provided by the present disclosure is conducive to enriching the implementation methods of telemedicine, improving the application flexibility and reliability of telemedicine, and reducing the implementation complexity and cost of telemedicine, and can be better applied to telemedicine application scenarios that are sensitive to delay.

[0010] The technical solution of the present disclosure is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other purposes, features and advantages of the present disclosure will become more apparent by describing the embodiments of the present disclosure in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present disclosure and constitute a part of the specification. Together with the embodiments of the present disclosure, they are used to explain the present disclosure and do not constitute a limitation of the present disclosure. In the drawings, the same reference numerals generally represent the same components or steps.

[0012] Figure 1 A schematic diagram of an application scenario of the technology for implementing telemedicine disclosed in the present invention;

[0013] Figure 2 A flowchart of an embodiment of a method for implementing telemedicine disclosed in the present invention;

[0014] Figure 3 This is a structural diagram of an embodiment of a system for implementing telemedicine disclosed in the present invention;

[0015] Figure 4 is a structural diagram of an electronic device provided by an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0016] The exemplary embodiments according to the present disclosure will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments of the present disclosure, and it should be understood that the present disclosure is not limited to the exemplary embodiments described here.

[0017] It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0018] Those skilled in the art can understand that the terms "first" and "second" in the embodiments of the present disclosure are only used to distinguish different steps, devices or modules, etc., and neither represent any specific technical meaning nor indicate the necessary logical order between them.

[0019] It should also be understood that in the embodiments of the present disclosure, “plurality” may refer to two or more than two, and “at least one” may refer to one, two, or more than two.

[0020] It should also be understood that any component, data or structure mentioned in the embodiments of the present disclosure can generally be understood as one or more, unless explicitly limited or otherwise indicated in the context.

[0021] In addition, the term "and / or" in this disclosure is only a description of the association relationship of associated objects, indicating that there may be three relationships, such as A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this disclosure generally indicates that the associated objects before and after are in an "or" relationship.

[0022] It should also be understood that the description of the various embodiments in the present disclosure focuses on the differences between the various embodiments, and the same or similar aspects thereof can be referenced to each other, and for the sake of brevity, they will not be described one by one.

[0023] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0024] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0025] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0026] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0027] The embodiments of the present disclosure can be applied to electronic devices such as terminal devices, computer systems, servers, etc., which can operate with many other general or special computing system environments or configurations. Examples of well-known terminal devices, computing systems, environments and / or configurations suitable for use with electronic devices such as terminal devices, computer systems or servers include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, small computer systems, large computer systems, and distributed cloud computing technology environments including any of the above systems, etc.

[0028] Electronic devices such as terminal devices, computer systems, servers, etc. can be described in the general context of computer system executable instructions (such as program modules) executed by computer systems. Generally, program modules can include routines, programs, target programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types. Computer systems / servers can be implemented in a distributed cloud computing environment. In a distributed cloud computing environment, tasks can be performed by remote processing devices linked through a communication network. In a distributed cloud computing environment, program modules can be located on local or remote computing system storage media including storage devices.

[0029] SUMMARY OF THE DISCLOSURE

[0030] In the process of realizing the present disclosure, the inventors found that in the process of realizing telemedicine, in order to enable remote medical personnel (such as medical experts, etc.) to fully understand the situation at the medical treatment site in real time, a medical video device is usually set at the medical treatment site (such as an operating room, etc.), and the medical video device has a video signal acquisition interface, and is connected to the medical instrument at the treatment site through its video signal acquisition interface, so as to collect the video signal of the medical instrument. The medical video device can publish a video stream to the remote terminal based on the video signal it has collected, and the medical video device can also provide remote audio / video interactive services for the medical personnel at the site and the remote medical personnel (such as medical experts, etc.). However, the current display screen of the medical instrument that the remote medical personnel can see through the remote terminal usually depends on the number of video signal acquisition interfaces of the medical video device, and the medical video device in reality usually has two video signal acquisition interfaces, so that the medical video device can only collect video signals of two medical instruments at most at the same time. If the remote medical personnel need to see more current display screens of medical instruments, the hardware structure of the medical video device needs to be modified to increase the number of video signal acquisition interfaces. Modification of the hardware structure of medical video equipment often involves processes such as mold opening, revision, and selection, which results in high modification costs and a long modification cycle. Moreover, the modified medical video equipment cannot flexibly meet the requirements for the number of video signal acquisition interfaces of medical video equipment in different telemedicine environments, and lacks flexibility in use. In addition, the modification of the hardware structure of medical video equipment usually adopts the method of setting up expansion boards, which usually cause hardware stacking, thereby increasing the complexity of the connection between hardware in the medical video equipment, and therefore, is not conducive to ensuring the operational stability of the medical video equipment. Furthermore, if a large number of medical instruments are connected to the medical video equipment, the load on the medical video equipment may be heavy, making the medical video equipment a bottleneck in the process of realizing telemedicine, which may affect the real-time nature of telemedicine.

[0031] In the process of implementing telemedicine, remote medical personnel (such as medical experts, etc.) may participate in more than one telemedicine at the same time. In this case, remote medical personnel need to switch between different telemedicines conveniently and quickly, which poses new challenges to the implementation of telemedicine. This requires that the technology for implementing telemedicine should not only avoid the high cost, long cycle and lack of flexibility caused by hardware modification of corresponding equipment as much as possible, but also avoid the impact of hardware stacking on the operating stability of hardware equipment as much as possible. At the same time, the real-time and flexibility of telemedicine should be guaranteed as much as possible.

[0032] Exemplary Overview

[0033] The technical solution for implementing telemedicine disclosed in the present invention can be applied to a variety of application scenarios. For example, it can be applied to application scenarios such as remote surgery guidance, remote medical teaching, and remote consultation. Figure 1 , taking remote surgery guidance as an example, the technical solution for realizing telemedicine disclosed in the present invention is explained.

[0034] Figure 1 In the example, experts A and B use telemedicine terminal devices 100 and 110 in their respective expert offices to remotely guide a surgery in an operating room 120 of a remote hospital. Six medical instruments are set in the operating room 120. It is assumed that experts A and B need to view four of the medical instruments (i.e. Figure 1 If the medical instrument 120-1, medical instrument 120-2, medical instrument 120-3 and medical instrument 120-4) in the operating room 120 currently displays the screen, two video signal acquisition devices (i.e., 120-5 and 120-6) and a medical video agent device 120-7 can be set in the operating room 120, and the video signal acquisition device 120-5 and the video signal acquisition device 120-6 respectively have two video signal acquisition interfaces, and the medical video agent device 120-7 may not have a video signal acquisition interface.

[0035] Assuming that the medical instruments 120-1 and 120-2 are set close to each other, and the medical instruments 120-3 and 120-4 are set close to each other, a video signal acquisition device 120-5 can be set at the position of the medical instrument 120-1 or the medical instrument 120-2, and a video signal acquisition device 120-6 can be set at the position of the medical instrument 120-3 or the medical instrument 120-4. The two video signal acquisition interfaces of the video signal acquisition device 120-5 are respectively connected to the medical instrument 120-1 and the medical instrument 120-2 by wire, and the two video signal acquisition interfaces of the video signal acquisition device 120-6 are respectively connected to the medical instrument 120-3 and the medical instrument 120-4 by wire. In addition, the telemedicine terminal device 100, the telemedicine terminal device 110, the video signal acquisition device 120-5, the video signal acquisition device 120-6 and the medical video agent device 120-7 are all connected to the network (such as the Internet, local area network, etc.), and before the operation officially begins, the telemedicine terminal device 100, the telemedicine terminal device 110 and the medical video agent device 120-7 all join the same telemedicine conference. The medical staff in the operating room 120 can use the setting page provided by the medical video agent device 120-7 (such as the conference setting page) to select medical instruments 120-1, medical instruments 120-2, medical instruments 120-3 and medical instruments 120-4 as medical instruments that need to collect video signals. The medical video proxy device 120-7 sends a conference participation instruction to the video signal acquisition device 120-5 according to the currently selected medical instruments 120-1 and 120-2, so as to notify the video signal acquisition device 120-5 to join the telemedicine conference as a signal source participant (such as the identity of medical instruments 120-1 and the identity of medical instruments 120-), so that the video signal acquisition device 120-5 releases the video encoding signals of medical instruments 120-3 and 120-4 to the telemedicine conference; at the same time The medical video agent device 120-7 sends a conference participation instruction to the video signal acquisition device 120-6 according to the currently selected medical instrument 120-3 and medical instrument 120-4, so as to notify the video signal acquisition device 120-6 to join the telemedicine conference as a signal source participant (such as the identity of medical instrument 120-3 and the identity of medical instrument 120-4), so that the video signal acquisition device 120-6 publishes the video encoding signals of medical instrument 120-3 and medical instrument 120-4 to the telemedicine conference.

[0036] During the operation, the video signal acquisition device 120-5 acquires the video signals of the medical instruments 120-1 and 120-2 in real time, and encodes the two acquired video signals respectively to obtain two video encoding signals (i.e., two video streams). The two video encoding signals are published to the telemedicine conference by the video signal acquisition device 120-5 as signal source participants, and the video signal acquisition device 120-5 logo and the medical video agent device 120-7 logo are also published at the same time; the video signal acquisition device 120-6 also acquires the video signals of the medical instruments 120-3 and 120-4 in real time, and encodes the two acquired video signals respectively to obtain two video encoding signals (i.e., two video streams). The two video encoding signals are also published to the telemedicine conference by the video signal acquisition device 120-6 as signal source participants, and the video signal acquisition device 120-6 logo and the medical video agent device 120-7 logo are also published at the same time. Expert A and expert B can use their respective telemedicine terminal devices to select and view the video stream released by the participant with the medical video agent device 120-7 logo, so that the telemedicine terminal device 100 and the telemedicine terminal device 110 respectively decode and process the four video streams with the medical video agent device 120-7 logo, and display the four decoded video signals as the video signals released by the medical video agent device 120-7 in the same window of the telemedicine conference.

[0037] In addition, during the operation, the medical staff in the operating room 120 can also conduct voice / video interaction with experts A and B through the telemedicine conference jointly joined by the telemedicine terminal device 100, the telemedicine terminal device 110 and the medical video agent device 120-7.

[0038] Exemplary Methods

[0039] Figure 2 FIG. 1 is a flow chart of an embodiment of a method for implementing telemedicine disclosed in the present invention. Figure 2 The method shown includes: steps S200, S201, S202, S203 and S204. Figure 2 Each step in is described separately.

[0040] S200. According to the number of medical instruments that need to collect video signals at the medical treatment site, set the number of video signal acquisition devices.

[0041] The medical treatment site in the present disclosure may be an indoor place such as an operating room, an emergency room, or an ICU (Intensive Care Unit) for providing medical treatment to patients.

[0042] The medical instrument in the present disclosure generally refers to a device that acts directly or indirectly on the human body and can generate a video signal itself (i.e., the medical instrument can display the corresponding image in real time). In one example, the medical instrument can be equipped with a micro camera, such as a laparoscope and a thoracoscope, etc.; the medical instrument can also be without a camera, such as a blood pressure and heart rate monitoring device, etc. The present disclosure does not limit the specific form of the medical instrument.

[0043] The video signal acquisition device in the present disclosure refers to a device capable of compressing and processing a digital video signal. In one example, the video signal acquisition device may be a device capable of compressing and decompressing a digital video signal, that is, the video signal acquisition device may not only perform encoding operations, but also perform decoding operations. In a more specific example, the video signal acquisition device may be a video codec supporting H.264 (i.e. AVC (Advanced Video Coding), H.265 (i.e. HEVC (High Efficiency Video Coding), VP9 (i.e. NGOV (Next Gen Open Video)) or AV1 (Alliance for Open Media Video 1, Open Media Alliance), etc. The present disclosure does not limit the specific form of expression of the video signal acquisition device.

[0044] In one example, the number of video signal acquisition devices in the present disclosure is related to the number of medical instruments that need to acquire video signals, and the number of video signal acquisition devices is generally less than the number of medical instruments that need to acquire video signals. In a special application scenario, the number of video signal acquisition devices may be the same as the number of medical instruments that need to acquire video signals. For example, when a video signal acquisition device is only connected to one medical instrument, the number of video signal acquisition devices is the same as the number of medical instruments that need to acquire video signals.

[0045] In one example, the number of medical instruments that a video signal acquisition device can connect to usually depends on the number of video signal acquisition interfaces of the video signal acquisition device. For example, if a video signal acquisition device has n (n is an integer greater than 1) video signal acquisition interfaces, the video signal acquisition device can be connected to up to n medical instruments at the same time. By using the number of video signal acquisition interfaces of the video signal acquisition device and the number of medical instruments that need to acquire video signals, the number of video signal acquisition devices is set, so that the technical solution of the present disclosure can be flexibly formed according to the actual situation of the medical treatment site to implement a system for telemedicine. By connecting each video signal acquisition device to the medical instrument at the medical treatment site, and connecting the video signal acquisition device to as many medical instruments as possible (such as all video signal acquisition interfaces are connected to medical instruments), it is helpful to reduce the number of video signal acquisition devices used, thereby helping to reduce the implementation cost of telemedicine.

[0046] S201. Connect the medical instruments that need to collect video signals to the video signal collection interfaces of the corresponding video signal collection devices.

[0047] The medical instrument in the present disclosure has a video interface, which is used to output the video signal generated by the medical instrument itself to an external device. The video signal acquisition device in the present disclosure has a video signal acquisition interface, which is mainly used to collect the video signal output by the external device into the video signal acquisition device. The video signal acquisition interface is also a video interface. A video signal acquisition device usually has multiple video signal acquisition interfaces, that is, a video signal acquisition device can be connected to one or more medical instruments at the same time. It should be noted that the video signal generated by the medical instrument in the present disclosure itself can be a video signal containing sound and image, and such a video signal can also be called an audio and video signal. In an example, the video signal generated by the medical instrument in the present disclosure itself can also be a video signal that does not contain sound but only contains an image.

[0048] In one example, the video signal acquisition interface / video interface in the present disclosure may be: HDMI (High Definition Multimedia Interface), DVI (Digital Visual Interface), S-terminal (Separate Video, a five-core interface), SDI (Serial Digital Interface), Type-C (Type-C) interface, VGA (Video Graphics Array) interface, USB (Universal Serial Bus) interface, or RGB (Red Green Blue) interface, etc. The present disclosure does not limit the specific form of the video signal acquisition interface / video interface. In addition, a wired connection is usually used between the medical instrument and the video signal acquisition device, and the video signal acquisition device is usually set close to the medical instrument.

[0049] In one example, different medical instruments may have different types of video interfaces, and a video signal acquisition device may also have different types of video signal acquisition interfaces, and the types of video signal acquisition interfaces possessed by different video signal acquisition devices may be the same or different.

[0050] S202: The medical video agent device joins a remote medical conference and sends a conference participation instruction to at least one video signal acquisition device.

[0051] In one example, the medical video proxy device disclosed herein refers to a video communication device that can be used in the medical field, for example, a video communication device that can be used in scenarios such as remote consultation, remote surgical teaching, and remote surgical guidance. The medical video proxy device here can be implemented using a computer (such as a notebook computer) or other device suitable for a medical environment.

[0052] In one example, the medical video proxy device in the present disclosure is mainly used to manage video signal acquisition devices, and the medical video proxy device can also be used for audio / video interaction between medical personnel at the medical treatment site and remote medical personnel. For example, the management of video signal acquisition devices by the medical video proxy device may include: participating in conference management, exiting conference management, and acquisition signal management. That is, a medical video proxy device can control all video signal acquisition devices at the medical treatment site where it is located to join a telemedicine conference, exit a telemedicine conference, and whether to perform video signal acquisition and encoding for the medical instruments connected to it.

[0053] The telemedicine conference in the present disclosure is usually a video conference, and the medical video proxy device usually joins the telemedicine conference as a video signal publisher. A medical video proxy device in the present disclosure usually corresponds to a medical treatment site, different medical video proxy devices usually correspond to different medical treatment sites, and different medical treatment sites can correspond to the same telemedicine conference, that is, a medical treatment site is usually equipped with a medical video proxy device, and each medical video proxy device set up at different medical treatment sites can join the same telemedicine conference as a video signal publisher, and telemedicine personnel can participate in multiple medical treatment sites at the same time through a telemedicine conference attended by their telemedicine terminal devices.

[0054] In one example, the conference joining instruction in the present disclosure refers to a command for controlling a video signal acquisition device to join a telemedicine conference. The conference joining instruction generally includes the video conference number of the telemedicine conference, and may also include the identity information of the video signal acquisition device joining the telemedicine conference, and the video signal acquisition device identifier, etc. The video signal acquisition device identifier is unique. The identity information for joining the telemedicine conference may indicate the signal source corresponding to the video encoding signal released by the video signal acquisition device to the telemedicine conference. For example, when a video signal acquisition device is respectively connected to the first medical instrument and the second medical instrument, the conference participation instruction sent by the medical video agent device to the video signal acquisition device may include: the video conference number and the information for joining the telemedicine conference as the first signal source device. Since the first signal source device corresponds to the first medical instrument, it can be considered that the medical video agent device commands the video signal acquisition device to join the telemedicine conference corresponding to the video conference number as the first medical instrument. Furthermore, the conference participation instruction sent by the medical video agent device to the video signal acquisition device may also include: the video conference number, the information for joining the telemedicine conference as the first signal source device and the information for joining the telemedicine conference as the second signal source device. Since the first signal source device corresponds to the first medical instrument and the second signal source device corresponds to the second medical instrument, it can be considered that the medical video agent device commands the video signal acquisition device to join the telemedicine conference corresponding to the video conference number as the first medical instrument and the second medical instrument. In addition, the conference participation instruction in the present disclosure is also used to trigger the video signal acquisition device to release the video encoding signal acquired through acquisition and encoding to the telemedicine conference it joins.

[0055] In one example, the medical video agent device may send conference participation instructions to all video signal acquisition devices in the medical treatment site where it is located (for example, sending conference participation instructions to all video signal acquisition devices in the medical treatment site where it is located according to default or user selection), or may send conference participation instructions to only some of the video signal acquisition devices in the medical treatment site where it is located (for example, sending conference participation instructions to some of the video signal acquisition devices in the medical treatment site where it is located according to user selection).

[0056] In one example, the medical video proxy device can generate at least one conference participation instruction based on the medical instrument selected by the user that needs to display the video screen in the telemedicine conference, and send the corresponding conference participation instruction to each video signal acquisition device connected to the selected medical instrument. For example, the medical video proxy device can display a conference participation setting interface to the user, and the user can use the conference participation setting interface displayed by the medical video proxy device to select at least some medical instruments from all medical instruments respectively connected to all video signal acquisition devices according to actual needs (such as the current needs of telemedicine personnel, etc.), and the medical video proxy device uses each medical instrument selected by the user as a medical instrument that needs to display the video screen in the telemedicine conference. Since the medical video proxy device is pre-set with all the video signal acquisition device information, all the medical instrument information, and the connection relationship information between the video signal acquisition device and the medical instrument at the medical treatment site, the medical video proxy device can obtain the video signal acquisition device corresponding to each medical instrument that needs to display the video screen in the telemedicine conference based on the pre-set information, so that the corresponding conference participation instruction can be generated for the corresponding video signal acquisition device, and the corresponding conference participation instruction can be sent to the corresponding video signal acquisition device.

[0057] In one example, a specific process of generating a conference participation instruction in the present disclosure may be: the medical video agent device displays a conference participation setting interface to the user, and the conference participation setting interface provides the user with multiple option information, namely, option information of each video signal acquisition device, and option information of each medical instrument connected to each video signal acquisition device. The user can check the options in the interface. For example, the user can check the option information for a video signal acquisition device, and for another example, the user can check the option information for one or more medical instruments connected to a video signal acquisition device, etc. In the case where the user selects a video signal acquisition device through the option information in the conference participation setting interface, the medical video agent device will treat all medical instruments connected to the selected video signal acquisition device as medical instruments that need to display video images in the telemedicine conference, and generate a conference participation instruction for all medical instruments to participate in the conference for the selected video signal acquisition device. At this time, the conference participation instruction may include: the video conference number, and information for joining the telemedicine conference separately as each signal source device connected to it, etc. When the user selects some medical instruments connected to a video signal acquisition device through the option information in the conference setting interface, the medical video agent device only regards the selected some medical instruments as medical instruments that need to display video images in the telemedicine conference, and generates conference participation instructions for some medical instruments to participate in the conference for the video signal acquisition devices connected to the selected some medical instruments. At this time, the conference participation instructions may include: the video conference number, and information for joining the telemedicine conference separately as each selected signal source device.

[0058] In one example, the medical video agent device disclosed in the present invention may also, without the need for user selection, default to treating all medical instruments as medical instruments that need to display video images in a telemedicine conference and generate a conference participation instruction (such as generating a conference participation instruction for each video signal acquisition device, and the parameters carried by different conference participation instructions may be different), thereby sending corresponding conference participation instructions to all video signal acquisition devices respectively.

[0059] By providing users with a way to select medical instruments that need to display video images in telemedicine conferences, it is possible to avoid unnecessary information processing while fully meeting the actual needs of remote medical personnel. For example, unnecessary signal acquisition processing, encoding processing, decoding processing, signal transmission processing, and rendering processing can be avoided, which is beneficial to improving the user experience of telemedicine and improving the flexibility and real-time performance of telemedicine.

[0060] In one example, the conference setting interface of the present disclosure may also include encoding parameter setting options. The medical video agent device displays the encoding parameter setting options to the user through the conference setting interface. The user can select corresponding encoding parameters (such as bit rate, frame rate, resolution, color space, and encoding protocol, etc.) based on the encoding parameter setting options in the conference setting interface. The medical video agent device can send these encoding parameters to each video signal acquisition device. For example, the medical video agent device generates an encoding parameter setting instruction based on the encoding parameters selected by the user, and sends the encoding parameter setting instruction to at least one video signal acquisition device. For another example, the medical video agent device carries the encoding parameters selected by the user in the conference instruction and sends it to each video signal acquisition device.

[0061] In one example, during the telemedicine preparation stage or the telemedicine implementation stage, the medical video proxy device can display the current video images of multiple medical instruments in the conference setting interface. Specifically, the medical video proxy device and all video signal acquisition devices can realize information interaction between the medical video proxy device and the video signal acquisition device through a network (such as the Internet or a local area network, etc.), so that the medical video proxy device can access each video signal acquisition device through the network. After each video signal acquisition device collects the video signal from each medical instrument connected to it in real time, it will independently encode each video signal to obtain the video encoding signal corresponding to each medical instrument. (i.e., multiple video streams), and the medical video proxy device can obtain multiple video encoding signals obtained after the current encoding processing of each video signal acquisition device by accessing the video signal acquisition device, and the medical video proxy device decodes and processes each obtained video encoding signal respectively, thereby obtaining multiple video signals, and the medical video proxy device displays the option information of each video signal acquisition device and the option information of the medical instrument connected to each video signal acquisition device to the user in the conference setting interface, and can also display the various video signals obtained by decoding to the user, for example, at the option information position of each medical instrument in the conference setting interface, a video screen formed based on the corresponding video signal is displayed. It can be seen from this that the present disclosure can enable users to feel each medical instrument more intuitively, avoiding the phenomenon of users making wrong selections or missing selections, thereby helping to improve the feasibility of telemedicine and improving user experience.

[0062] In one example, the medical video proxy device and all video signal acquisition devices disclosed in the present invention can access the network (such as the Internet or a local area network, etc.) through WIFI or a mobile network, so that the medical video proxy device can access each video signal acquisition device through the network, and the medical video proxy device can obtain each channel of video coded signals obtained after the encoding processing of each video signal acquisition device based on RTSP (Real Time Streaming Protocol), SRT (Secure Reliable Transport) protocol or FLV (Flash Video) protocol. The medical video proxy device can obtain all video coded signals based on the same protocol. For example, the medical video proxy device can obtain all video coded signals from each video signal acquisition device based on RTSP, or obtain all video coded signals from each video signal acquisition device based on the SRT protocol, or obtain all video coded signals from each video signal acquisition device based on the FLV protocol. Of course, the present disclosure does not exclude the situation where the medical video proxy device obtains all video coded signals from each video signal acquisition device based on different protocols. By enabling the medical video proxy device to access each video signal acquisition device through a network (such as the Internet or a local area network), the medical video proxy device will not limit the number of video signal acquisition devices, and thus the technical solution for realizing telemedicine disclosed in the present invention will not limit the number of medical instruments; by adopting RTSP, SRT protocol or FLV protocol to obtain all video encoding signals, it is helpful to reduce the delay of the medical video proxy device in obtaining video encoding information, so as to make the video images of each medical instrument displayed by the medical video proxy device to the user synchronized with the video images actually displayed by each medical instrument as much as possible. In particular, when obtaining video encoding signals based on the FLV protocol, the effect of synchronizing the video images displayed by the two can be better achieved, which is helpful to improve the user experience.

[0063] S203, the video signal acquisition device that receives the conference participation instruction joins the telemedicine conference, acquires video signals from the medical instruments connected to it, encodes the acquired video signals, obtains at least one video encoding signal, and publishes each video encoding signal and the medical video proxy device identifier to the telemedicine conference. The medical video proxy device identifier is unique.

[0064] In one example, after receiving a conference participation instruction, the video signal acquisition device of the present disclosure can join the telemedicine conference as a signal source device. That is, although the video signal acquisition device joins the telemedicine conference and is a participant of the telemedicine conference, the video signal acquisition device is not the actual signal source, and the medical instrument connected to it is the actual signal source. Therefore, although the video signal acquisition device in the present disclosure is a participant, its participant identity can be the identity of the signal source device. That is to say, from the perspective of remote medical personnel, the video encoding signal released to the remote video conference comes from the signal source device, such as from the corresponding medical instrument. In the case where the video encoding signals corresponding to the multiple medical instruments connected to the video signal acquisition device each need to be released to the telemedicine conference, the video signal acquisition device can become multiple independent participants of the telemedicine conference, and the identities of different participants are the identities of different signal source devices. The video signal acquisition device can join the telemedicine conference according to the identity information of the participant in the conference participation instruction. For example, the conference participation instruction includes the identity information of at least one participant. The identity information of the participant in the conference participation instruction can, on the one hand, enable the video signal acquisition device to learn the medical instrument that needs to perform video signal acquisition, and on the other hand, enable the video signal acquisition device to learn the identity information of the participant who joins the telemedicine conference. Of course, the present disclosure does not exclude the possibility that the video signal acquisition device joins the telemedicine conference with its own identity.

[0065] In one example, the encoding process of the video signal by the video signal acquisition device of the present invention may refer to the format conversion / compression process of the acquired original video signal, and the encoding process of the present invention may be an encoding process based on H.264, an encoding process based on H.265, an encoding process based on VP9, ​​or an encoding process based on AV1, etc. The video encoding signal obtained after the encoding process is usually in the form of a video file of a corresponding format. In one example, the protocols adopted by the encoding processes supported by different video signal acquisition devices may be the same or different.

[0066] In one example, if a video signal acquisition device is connected to only one medical instrument, then when the video signal acquisition device acquires the video signal output by the medical instrument in real time, it continuously encodes the video signal to obtain one video encoding signal, which is a video stream. If a video signal acquisition device is connected to multiple medical instruments at the same time, then the video signal acquisition device will acquire the video signals output by multiple medical instruments in real time at the same time, and the video signal acquisition device will perform continuous independent encoding processing on each acquired video signal, thereby obtaining multiple video encoding signals, which is a multiple video stream, that is, in this example, the encoding processing of any video signal by the video signal acquisition device is independent of other video signals, so it can be seen that the video signal acquisition device will not perform mixed encoding processing on multiple video signals. Of course, the present disclosure does not exclude the possibility that the video signal acquisition device performs mixed encoding processing on the multiple video signals it acquires (such as mixed screen encoding processing according to a predetermined window layout, etc.). By using video signal acquisition equipment to independently encode multiple video signals from multiple medical instruments, the loss of image details caused by non-independent encoding of multiple video signals can be avoided, which is beneficial to ensuring the picture quality corresponding to each video encoding signal, thereby facilitating the provision of high-quality video images for remote terminals.

[0067] In one example, the video signal acquisition device can publish its own video signal acquisition device identification while publishing various video encoding signals and medical video proxy device identification to the telemedicine conference. By allowing the video signal acquisition device to join the telemedicine conference as a signal source, remote medical personnel can clearly see the current images displayed by various medical instruments at the medical treatment site; by allowing the video signal acquisition device to publish its identification, remote medical personnel and on-site medical personnel can understand the acquisition device corresponding to the medical instrument, which is conducive to the interaction and problem troubleshooting of both parties, and thus helps to improve the user experience.

[0068] In one example, the medical video proxy device can also control the video signal acquisition device to exit the telemedicine conference. For example, when the medical video proxy device detects that a medical instrument that needs to acquire video signals is changed to a medical instrument that does not need to acquire video signals, the medical video proxy device generates a first exit conference instruction and sends the first exit conference instruction to the video signal acquisition device connected to the medical instrument that is changed to not need to acquire video signals. The video signal acquisition device that receives the first exit conference instruction exits the telemedicine conference with the corresponding signal source identity in the telemedicine conference. Specifically, when the on-site medical personnel change the option information of the selected medical equipment, or the remote medical personnel no longer need to view the display screen of a certain medical equipment, the medical video agent device can obtain the video signal acquisition device identifier corresponding to the medical equipment whose display screen does not need to be viewed, and generate a first exit meeting instruction based on the identifier, and send the first exit meeting instruction to the video signal acquisition device with the identifier. The first exit meeting instruction may include: the video signal acquisition device identifier, and the signal source identity information of the exiting remote medical conference (that is, the identity information of the participant who needs to exit the remote medical conference), etc. The video signal acquisition device that receives the first exit meeting instruction can no longer collect the video signal of the corresponding medical equipment connected to it (that is, the medical equipment corresponding to the signal source identity information of the exiting remote medical conference) while causing the participant with the corresponding identity to exit the remote medical conference according to the instruction. As a more specific example, a user can modify one or some selected medical instruments to be unselected through the conference setting interface displayed by the medical video proxy device. If the modification causes all medical instruments connected to a video signal acquisition device to no longer need to collect video signals, the medical video proxy device sends a first exit meeting instruction to the corresponding video signal acquisition device according to the video signal acquisition device identifier. The video signal acquisition device that receives the first exit meeting instruction will cause all corresponding participants to exit the telemedicine conference. At this time, if the conference setting interface is in an activated state, the video signal acquisition device can continue to collect video signals from each medical instrument connected to it, and transmit the encoded video encoded signal to the medical video proxy device, so that the medical video proxy device displays the corresponding video screen at the corresponding medical instrument position in the conference setting interface; if the conference setting interface is in a closed or minimized state, the video signal acquisition device may no longer continue to collect video signals from each medical instrument connected to it.

[0069] In one example, before the medical video proxy device exits the telemedicine conference, it may send a second exit conference instruction to each video signal acquisition device corresponding to each video encoding signal having the medical video proxy device identifier, thereby causing the video signal acquisition devices that receive the second exit conference instruction to exit the telemedicine conference with all their respective signal source identities in the telemedicine conference.

[0070] During an ongoing telemedicine conference, remote medical personnel (such as remote experts, etc.) may need to view changes in medical equipment due to the progress of treatment. By adding and exiting conference control for the video signal acquisition device, the video image presented by the telemedicine terminal device can always be the video image that the remote medical personnel currently expect to see, thereby improving the flexibility of telemedicine implementation and improving user experience.

[0071] S204. The telemedicine terminal device displays the video encoding signals having the same medical video proxy device identifier in the medical video proxy device publishing window of the telemedicine conference according to the preset window layout.

[0072] In one example, the telemedicine terminal device can decode each received video encoding signal separately to obtain each video signal, and then render each decoded video signal with the same medical video proxy device identifier according to the window equal division layout (i.e., screen equal division layout), and display the rendering processing results in the medical video proxy device publishing window of the telemedicine conference, that is, display the current display screen of each medical instrument in the medical video proxy device publishing window of the telemedicine conference. The screen equal division layout method here means dividing the display area of ​​the screen into multiple blocks according to the total number of video encoding signals, and the area size of each block is usually the same, and one block corresponds to one video encoding signal. During the rendering process, the telemedicine terminal device should align the time of each video signal obtained by decoding, that is, the display screens of each medical instrument displayed in the same window at the telemedicine terminal device should be the display screens at the same time. In the case where the screen is divided into i blocks by an equal layout (such as i is 4, 6, 8 or 9, etc.), if the total number of video coded signals is less than i (such as when i is 6, the total number of video signals is 5), the telemedicine terminal device can render all video signals and one or more preset video signals (such as preset black screen video signals, etc.) together during the rendering process. Of course, the present disclosure does not exclude the possibility that the telemedicine terminal device uses an unequal screen layout for rendering. For example, due to the different importance of medical instruments or the different complexity of displayed content, the telemedicine terminal device can set the block corresponding to a certain medical instrument in the center position, and the area of ​​the block is larger than the area of ​​the blocks corresponding to other medical instruments. As can be seen from the above description, the present disclosure divides the video coded signals with the same medical video agent device identifier into the same group, and a group corresponds to a display window (i.e., a medical video agent device publishing window). The video screen displayed in a display window can be considered as a video screen published by a participant (i.e., a medical video agent device). In addition, the telemedicine terminal device may generate a publishing window of the medical video conference agent device by subscribing to the medical video conference agent device identifier in the telemedicine conference.

[0073] In one example, a medical video proxy device is provided with a camera and a microphone, and the medical video proxy device can collect a video signal of a medical treatment site through the camera and the microphone (the video signal here is a video signal including sound and image), and the medical video proxy device can encode and process the video signal, so that after the medical video proxy device joins the telemedicine conference, the medical video proxy device can publish the video encoding signal obtained by the encoding and processing together with its own identification to the telemedicine conference. By making the medical video proxy device generate a video encoding signal of the medical treatment site, and publishing the video encoding signal and the medical video proxy device identification to the telemedicine conference, it is convenient for remote medical personnel (such as medical experts or trainees of research and study, etc.) to understand the situation of the medical treatment site in real time, and it is convenient for the medical personnel at the medical treatment site to interact with the remote medical personnel by voice / video.

[0074] In one example, the video encoding signals received by the telemedicine terminal device include: the video encoding signals released by the video signal acquisition devices and the video encoding signals released by the medical video proxy device. The telemedicine terminal device decodes all the video encoding signals respectively to obtain the video signals, and renders the decoded video signals with the same medical video proxy device identifier according to the screen-divided layout mode, and displays the rendering results in the medical video proxy device publishing window of the telemedicine conference, that is, the current display screens of the medical instruments and the screens of the medical treatment site are displayed in the medical video proxy device publishing window of the telemedicine conference. For example, assuming that two video signal acquisition devices acquire four video signals and the medical video proxy device acquires one video signal of the medical treatment site, the telemedicine terminal device can render these five video signals plus one preset black screen video signal without image content according to the screen-divided layout mode, and display the rendering results in the medical video proxy device publishing window. By adopting a screen-equally divided layout method to render and process the video signals corresponding to each medical instrument and the video signals of the medical treatment scene, the implementation of the technical solution of the present invention will not be affected by the number of medical instruments, which is conducive to making the technical solution of the present invention flexible in implementation and facilitating the convenient and fast realization of telemedicine.

[0075] In one example, a medical video proxy device collects video signals of a medical treatment site through a camera and a microphone, and encodes and processes the video signals of the medical treatment site to obtain a medical treatment site video encoding signal, and the medical video proxy device publishes the medical treatment site video encoding signal to a telemedicine conference. The telemedicine terminal device decodes and processes the medical treatment site video encoding signal published to the telemedicine conference, and displays the medical treatment site video signal obtained by the decoding process in a medical treatment site window. The medical treatment site window is independent of the medical video proxy device publishing window.

[0076] In one example, the medical video proxy device decodes and processes each channel of video encoding signals with the same medical video proxy device identification published to the remote medical conference, and displays each channel of video signals in the local medical video proxy device publishing window in an equally divided window layout.

[0077] Exemplary Systems

[0078] Figure 3 FIG. 1 is a schematic diagram of a system for implementing telemedicine according to an embodiment of the present disclosure. Figure 3 The system shown mainly includes: at least one video signal acquisition device 300, a medical video agent device 310 and at least one remote medical terminal device 320. The following describes each device included in the system.

[0079] The video signal acquisition device 300 and the medical video agent device 310 in the present disclosure are arranged at the medical treatment site, and each video signal acquisition device 300 has one or more video signal acquisition interfaces. Each video signal acquisition device 300 is connected to one or more medical instruments 330 that need to collect video signals at the medical treatment site through its own video signal acquisition interface. The number of video signal acquisition devices 300 is usually less than the number of medical instruments 330 that need to collect video signals at the medical treatment site, and the number of video signal acquisition devices 300 is determined according to the number of medical instruments 330 that need to collect video signals at the medical treatment site.

[0080] In one example, the video signal acquisition device 300 of the present disclosure includes: a conference participation module 3001, a first acquisition and encoding module 3002, and a first publishing module 3003. The conference participation module 3001 is mainly used to join the telemedicine conference (i.e., the telemedicine conference joined by the medical video agent device 310) according to the conference participation instruction when the video signal acquisition device 300 in which it is located receives the conference participation instruction from the medical video agent device 310. For example, the conference participation module 3001 can join the telemedicine conference (i.e., the telemedicine conference joined by the medical video agent device 310) as a signal source when the video signal acquisition device 300 in which it is located receives the conference participation instruction from the medical video agent device 310. The first acquisition and encoding module 3002 is mainly used to collect video signals from the medical instrument 330 connected to the video signal acquisition device 300 in which it is located, and encode the collected video signals to obtain at least one video encoding signal. The first publishing module 3003 is mainly used to publish the various video encoding signals and medical video proxy device identifiers obtained by the first acquisition and encoding module 3002 to the remote medical conference. For example, the first publishing module 3003 can publish various video encoding signals, video signal acquisition device identifiers, and medical video proxy device identifiers to the remote medical conference joined by the video signal acquisition device 300.

[0081] In one example, the medical video agent device 310 of the present disclosure mainly includes: a conference control module 3101. The conference control module 3101 is mainly used to enable the medical video agent device 310 to join a remote medical conference and send a conference instruction to at least one video signal acquisition device 300 so that the corresponding video signal acquisition device 300 also joins the remote medical conference.

[0082] In one example, the conference control module 3101 in the medical video agent device 310 includes: a first submodule 31011, a second submodule 31012, a third submodule 31013, a fourth submodule and a fifth submodule (not shown in the figure). The first submodule 31011 is mainly used to enable the medical video agent device 310 to join a telemedicine conference. The second submodule 31012 is mainly used to enable the medical video agent device 310 to display a conference setting interface to the user. The third submodule 31013 is mainly used to generate a conference instruction according to the medical instrument that needs to display the video screen in the telemedicine conference selected by the user based on the conference setting interface, and send the conference instruction to each video signal acquisition device connected to the medical instrument selected by the user. The fourth submodule is used to generate a coding parameter setting instruction according to the coding parameters selected by the user based on the coding parameter setting options in the conference setting interface, and send the coding parameter setting instruction to at least one video signal acquisition device; the fifth submodule is used to carry the coding parameters selected by the user based on the coding parameter setting options in the conference setting interface in the conference instruction.

[0083] In one example, the second submodule 31012 may include: an access unit 310121, a decoding unit 310122, and a display unit 310123. The access unit 310121 is mainly used to enable the medical video agent device 310 to access each video signal acquisition device 300 and obtain each video encoding signal obtained after the video signal acquisition device 300 acquires and encodes the signal. For example, the access unit 310121 can enable the medical video agent device 310 to access each video signal acquisition device 300 using a network (such as the Internet or a local area network), and obtain the video encoding signals corresponding to all medical instruments that need to acquire video signals from each video signal acquisition device based on a real-time streaming protocol, a secure and reliable transmission protocol, or a flash video protocol. The decoding unit 310122 is mainly used to decode the video encoding signals obtained by the access unit 310121 to obtain each video signal. The display unit 310123 is mainly used to display to the user through the conference setting interface the option information of each video signal acquisition device, the option information of the medical instrument connected to each video signal acquisition device, and the video images of each medical instrument formed based on the video signals obtained by the decoding unit 310122.

[0084] In one example, the medical video proxy device 310 may also include: an exit control module 3102. And the exit control module 3102 is mainly used to generate a first exit conference instruction when it is detected that a medical instrument that needs to collect video signals is transformed into a medical instrument that does not need to collect video signals, and send the first exit conference instruction to the video signal acquisition device 300 connected to the medical instrument that does not need to collect video signals. And the video signal acquisition device 300 of the present disclosure may also include: an exit module 3004. The exit module 3004 is mainly used to exit the telemedicine conference with the corresponding signal source identity in the telemedicine conference when the video signal acquisition device 300 where it is located receives the first exit conference instruction from the medical video proxy device 310. In addition, the exit control module 3102 can be used to send a second exit conference instruction to the video signal acquisition device corresponding to each video encoding signal with the medical video proxy device identification before the medical video proxy device itself exits the telemedicine conference. The exit module 3004 is used for the video signal acquisition device that receives the second exit conference instruction to exit all signal source identities in the telemedicine conference from the telemedicine conference.

[0085] In one example, when the medical video agent device 310 of the present disclosure is provided with a camera and a microphone, the medical video agent device 310 may further include: a second acquisition and encoding module 3103 and a second publishing module 3104. The second acquisition and encoding module 3103 is mainly used to encode the video signal of the medical treatment scene collected by the camera and the microphone to obtain a medical treatment scene video encoding signal. The second publishing module 3104 is mainly used to publish the medical treatment scene video encoding signal obtained by the second acquisition and encoding module 3103 together with the medical video agent device identifier to the telemedicine conference.

[0086] In one example, the telemedicine terminal device 320 includes: a first display module 3201, and the first display module 3201 is mainly used to display various video encoding signals with the same medical video proxy device identifier in the medical video proxy device publishing window of the telemedicine conference according to the preset window layout. For example, the first display module 3201 may include: a sixth submodule 32011 and a seventh submodule 32012. The sixth submodule 32011 is mainly used to decode the medical treatment scene video encoding signal and various video encoding signals with the same medical video proxy device identifier published in the telemedicine conference, respectively, to obtain various video signals. The seventh submodule 32012 is mainly used to use the various video signals obtained by the sixth submodule 32011 as video signals published by the medical video proxy device, and display the various video signals in the medical video proxy device publishing window according to the window equal layout method.

[0087] In one example, the first display module 3201 may include an eighth submodule (not shown in the figure), which is used to decode the medical treatment scene video encoded signal published to the remote medical conference, and display the medical treatment scene video signal obtained by the decoding process in the medical treatment scene window. The medical treatment scene window is independent of the medical video agent device publishing window.

[0088] In one example, the medical video proxy device 310 may further include a second display module (not shown in the figure). The second display module is used to decode and process the video encoding signals with the same medical video proxy device identifier released to the remote medical conference, and display the video signals in the local medical video proxy device release window according to the window equal layout mode.

[0089] Exemplary Electronic Devices

[0090] Reference below Figure 4 An electronic device according to an embodiment of the present disclosure is described. Figure 4 1 shows a block diagram of an electronic device according to an embodiment of the present disclosure. Figure 4 As shown, the electronic device 41 includes one or more processors 411 and a memory 412 .

[0091] The processor 411 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 41 to perform desired functions.

[0092] The memory 412 may include one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory, for example, may include: random access memory (RAM) and / or cache memory (cache), etc. The non-volatile memory, for example, may include: read-only memory (ROM), hard disk, and flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 411 may execute the program instructions to implement the methods for implementing telemedicine and / or other desired functions of the various embodiments of the present disclosure described above.

[0093] In one example, the electronic device 41 may further include: an input device 413 and an output device 414, etc., which are interconnected through a bus system and / or other forms of connection mechanisms (not shown). In addition, the input device 413 may also include, for example, a keyboard, a mouse, etc. The output device 414 may output various information to the outside. The output device 414 may include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, etc.

[0094] Of course, to simplify, Figure 4 Only some of the components related to the present disclosure in the electronic device 41 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 41 may also include any other appropriate components.

[0095] Exemplary computer program products and computer-readable storage media

[0096] In addition to the above-mentioned methods and devices, an embodiment of the present disclosure may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the method for implementing telemedicine according to various embodiments of the present disclosure described in the above-mentioned "Exemplary Method" section of this specification.

[0097] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0098] In addition, an embodiment of the present disclosure may also be a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, causes the processor to execute the steps of the method for implementing telemedicine according to various embodiments of the present disclosure described in the above “Exemplary Method” section of this specification.

[0099] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive enumeration) of readable storage media can include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0100] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. must be possessed by each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, rather than limitation, and the above details do not limit the present disclosure to the necessity of adopting the above specific details to be implemented.

[0101] Each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the system embodiment, since it basically corresponds to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0102] The block diagrams of the devices, apparatuses, equipment, and systems involved in the present disclosure are intended only as illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems may be connected, arranged, and configured in any manner. Words such as "include," "comprise," "have," and the like are open words, meaning "including but not limited to," and may be used interchangeably therewith. The words "or" and "and" used herein refer to the words "and / or," and may be used interchangeably therewith, unless the context clearly indicates otherwise. The word "such as" used herein refers to the phrase "such as but not limited to," and may be used interchangeably therewith.

[0103] The method and apparatus of the present disclosure may be implemented in many ways. For example, the method and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above order of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above, unless otherwise specifically stated. In addition, in some embodiments, the present disclosure may also be implemented as a program recorded in a recording medium, which includes machine-readable instructions for implementing the method according to the present disclosure. Therefore, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.

[0104] It should also be noted that in the apparatus, device and method of the present disclosure, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present disclosure.

[0105] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects, etc., will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0106] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present disclosure to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A method for implementing telemedicine, characterized in that: The method comprises: Set the number of video signal acquisition devices according to the number of medical instruments that need to collect video signals at the medical treatment site; Connecting the medical instruments that need to collect video signals to the video signal collection interfaces of the corresponding video signal collection devices respectively; wherein one video signal collection device has one or more video signal collection interfaces, and one video signal collection device is connected to one or more medical instruments through its video signal collection interface; The medical video agent device joins a telemedicine conference and sends a conference participation instruction to at least one video signal acquisition device; The video signal acquisition device that receives the conference participation instruction joins the telemedicine conference, acquires video signals from the medical instruments connected thereto, encodes the acquired video signals to obtain at least one video encoding signal, and publishes each video encoding signal and the medical video proxy device identifier to the telemedicine conference; The telemedicine terminal device displays the video encoding signals having the same medical video proxy device identification in the medical video proxy device publishing window of the telemedicine conference according to the preset window layout.

2. The method according to claim 1, characterized in that The sending of a conference participation instruction to at least one video signal acquisition device includes: The medical video agent device displays a conference setting interface to the user, generates a conference joining instruction according to the medical instrument selected by the user based on the conference setting interface and needs to display the video image in the telemedicine conference, and sends the conference joining instruction to each video signal acquisition device connected to the selected medical instrument.

3. The method according to claim 2, characterized in that The conference setting interface also includes: encoding parameter setting options, and the method also includes: The medical videoconferencing agent device generates a coding parameter setting instruction according to the coding parameters selected by the user based on the coding parameter setting options in the conference setting interface, and sends the coding parameter setting instruction to at least one video signal acquisition device; and / or The medical videoconferencing agent device carries the encoding parameters selected by the user based on the encoding parameter setting options in the conference joining setting interface in the conference joining instruction.

4. The method according to claim 2, characterized in that: The medical video conference agent device displays a conference setting interface to the user, including: The medical video proxy device obtains each channel of video coded signals acquired after acquisition and encoding by each video signal acquisition device by accessing each video signal acquisition device, and decodes each channel of video coded signals to obtain each channel of video signals; The medical video agent device displays to the user through the conference setting interface the option information of each video signal acquisition device, the option information of the medical instrument connected to each video signal acquisition device, and the video images of each medical instrument formed based on each video signal.

5. The method according to claim 4, characterized in that The medical video proxy device accesses each video signal acquisition device to obtain each channel of video encoding signals acquired after the video signal acquisition device acquires and encodes the signals, including: The medical video proxy device uses the network to access each video signal acquisition device, and based on the real-time streaming transmission protocol, the secure and reliable transmission protocol or the flash video protocol, obtains the corresponding video encoding signals of all medical instruments that need to collect video signals from each video signal acquisition device.

6. The method according to claim 1, characterized in that The video signal acquisition device that receives the conference participation instruction joins the telemedicine conference, including: The video signal acquisition device that receives the conference participation instruction joins the telemedicine conference as a signal source; And the issuing of each channel of video encoding signal and the medical video agent device identifier to the remote medical conference includes: The video signal acquisition device releases each channel of video encoding signals, the video signal acquisition device identifier and the medical video proxy device identifier to the remote medical conference.

7. The method according to claim 6, characterized in that The method further comprises: When the medical video proxy device detects that a medical device that needs to collect video signals is changed to a medical device that does not need to collect video signals, the medical video proxy device generates a first exit conference instruction and sends the first exit conference instruction to the video signal acquisition device connected to the medical device that does not need to collect video signals; The video signal acquisition device that receives the first exit conference instruction exits the telemedicine conference as a corresponding signal source in the telemedicine conference; And / or, the method further comprises: Before the medical video proxy device exits the remote medical conference, the medical video proxy device sends a second exit conference instruction to the video signal acquisition devices corresponding to the respective video encoding signals with the medical video proxy device identification; The video signal acquisition devices that receive the second exit conference instruction will exit the telemedicine conference with all their respective signal source identities in the telemedicine conference.

8. The method according to any one of claims 1 to 7, characterized in that: The medical video agent device is provided with a camera and a microphone, and the method further comprises: The medical video agent device collects the video signal of the medical treatment scene through a camera and a microphone, and encodes the video signal of the medical treatment scene to obtain a medical treatment scene video encoding signal; The medical video proxy device publishes the medical treatment scene video encoding signal together with the medical video proxy device identifier to the remote medical conference; The telemedicine terminal device displays the video encoding signals with the same medical video proxy device identifier in the medical video proxy device publishing window of the telemedicine conference according to the preset window layout, including: The telemedicine terminal device decodes the medical treatment scene video coded signals and various video coded signals published to the telemedicine conference with the same medical video proxy device identification, and uses the various video signals obtained by the decoding process as video signals published by the medical video proxy device, and displays the various video signals in the medical video proxy device publishing window in an equally divided window layout manner; Alternatively, the method further comprises: The medical video agent device collects the video signal of the medical treatment scene through a camera and a microphone, and encodes the video signal of the medical treatment scene to obtain a medical treatment scene video encoding signal; The medical video agent device publishes the medical treatment scene video encoding signal to the remote medical conference; The telemedicine terminal device decodes the medical treatment scene video encoding signal published to the telemedicine conference, and displays the medical treatment scene video signal obtained by decoding in the medical treatment scene window; wherein, the medical treatment scene window is independent of the medical video agent device publishing window.

9. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: The medical video proxy device decodes and processes the various video encoding signals with the same medical video proxy device identification published to the remote medical conference, and displays the various video signals in the local medical video proxy device publishing window in a window equally divided layout.

10. A system for implementing telemedicine, characterized in that: The system includes: at least one video signal acquisition device, a medical video proxy device, and at least one remote medical terminal device, wherein the video signal acquisition device and the medical video proxy device are arranged at a medical treatment site, and each video signal acquisition device has one or more video signal acquisition interfaces, and each video signal acquisition device is connected to one or more medical instruments that need to acquire video signals at the medical treatment site through its own video signal acquisition interface, and the number of the video signal acquisition devices is determined according to the number of medical instruments that need to acquire video signals at the medical treatment site; The medical video agent device comprises: A conference control module, used to enable the medical video agent device to join a remote medical conference and send a conference instruction to at least one video signal acquisition device; The video signal acquisition device comprises: A conference joining module, configured to join the telemedicine conference according to the conference joining instruction when the video signal acquisition device where the module is located receives the conference joining instruction from the medical videoconferencing agent device; A first acquisition and encoding module is used to acquire video signals from a medical instrument connected to the video signal acquisition device where the medical instrument is located, and encode the acquired video signals to obtain at least one video encoding signal; A first publishing module, used for publishing the video encoding signals of each channel obtained by the first acquisition and encoding module and the medical video proxy device identifier to the remote medical conference; The telemedicine terminal device comprises: The first display module is used to display various video encoding signals with the same medical video agent device identifier in the medical video agent device publishing window of the remote medical conference according to a preset window layout.

11. The system according to claim 10, characterized in that The conference control module includes: The first submodule is used to enable the medical video agent device to join a remote medical conference; The second submodule is used to enable the medical videoconferencing agent device to display a conference setting interface to the user; The third submodule is used to generate a conference participation instruction according to the medical instrument that needs to display the video image in the telemedicine conference selected by the user based on the conference participation setting interface, and send the conference participation instruction to each video signal acquisition device connected to the selected medical instrument.

12. The system according to claim 11, characterized in that The conference setting interface also includes: encoding parameter setting options, and the conference control module also includes: A fourth submodule is used to generate a coding parameter setting instruction according to the coding parameters selected by the user based on the coding parameter setting options in the conference setting interface, and send the coding parameter setting instruction to at least one video signal acquisition device; and / or The fifth submodule is used to carry the encoding parameters selected by the user based on the encoding parameter setting options in the conference joining setting interface in the conference joining instruction.

13. The system according to claim 11, characterized in that The second submodule includes: An access unit, used to enable the medical video proxy device to access each video signal acquisition device to obtain each channel of video encoding signals acquired after the video signal acquisition device has acquired and encoded the signals; A decoding unit, used for respectively decoding the video coded signals obtained by the access unit to obtain video signals of each channel; The display unit is used to display to the user through the conference setting interface the option information of each video signal acquisition device, the option information of the medical instrument connected to each video signal acquisition device, and the video images of each medical instrument formed based on the various video signals obtained by the decoding unit.

14. The system according to claim 10, characterized in that: The conference participation module is specifically used to: join the remote medical conference as a signal source when the video signal acquisition device where the module is located receives a conference participation instruction from the medical video agent device; And the first publishing module is specifically used to: publish each channel of video encoding signal, the video signal acquisition device identifier and the medical video proxy device identifier to the remote medical conference.

15. The system according to claim 14, characterized in that The medical video agent device also includes: An exit control module is used to generate a first exit conference instruction when detecting that a medical device that needs to collect video signals is changed to a medical device that does not need to collect video signals, and send the first exit conference instruction to a video signal acquisition device connected to the medical device that is changed to not need to collect video signals; And the video signal acquisition device also includes: An exit module is used to exit the telemedicine conference with the corresponding signal source identity when the video signal acquisition device where the video signal acquisition device is located receives a first exit conference instruction from the medical video agent device; and / or, The exit control module is used to send a second exit conference instruction to the video signal acquisition devices corresponding to each of the video encoding signals with the medical video proxy device identification before the medical video proxy device exits the remote medical conference; The exit module is configured to cause all the signal source identities in the telemedicine conference to exit from the telemedicine conference for the video signal acquisition devices that have received the second exit conference instruction.

16. The system according to any one of claims 10 to 15, characterized in that The medical video agent device is provided with a camera and a microphone, and the medical video agent device also includes: A second acquisition and encoding module is used to encode the video signal of the medical treatment scene collected by the camera and the microphone to obtain a medical treatment scene video encoding signal; A second publishing module, configured to publish the medical treatment scene video encoding signal obtained by the second acquisition and encoding module together with the medical video proxy device identifier to the remote medical conference; And the first display module includes: The sixth submodule is used to decode the medical treatment scene video encoding signal and each channel of video encoding signal respectively, which have the same medical video proxy device identifier and are published to the remote medical conference, to obtain each channel of video signals; A seventh submodule is used to use each channel of video signals obtained by the sixth submodule as a video signal published by the medical video proxy device, and display each channel of video signals in a publishing window of the medical video proxy device in a window-equally-divided layout manner; Alternatively, the first presentation module includes: The eighth submodule is used to decode the encoded medical treatment scene video signal published to the remote medical conference, and display the medical treatment scene video signal obtained by decoding in the medical treatment scene window; wherein the medical treatment scene window is independent of the medical video agent device publishing window.

17. The system according to any one of claims 10 to 15, characterized in that: The medical video agent device also includes: The second display module is used to decode and process the various video encoding signals with the same medical video proxy device identification published to the remote medical conference, and display the various video signals in the local medical video proxy device publishing window according to the window equal layout.

18. A computer-readable storage medium storing a computer program, wherein the computer program is used to execute the method according to any one of claims 1 to 10.

19. An electronic device, comprising: processor; a memory for storing instructions executable by the processor; The processor is used to read the executable instructions from the memory and execute the instructions to implement the method according to any one of claims 1 to 10.

Images