Methods, systems, media, and electronic devices for enabling telemedicine

Abstract

Disclosed are a method, system, medium and electronic device for implementing telemedicine, the method comprising: setting the number of video signal collection devices according to the number of medical instruments requiring video signal collection in a medical treatment site; connecting the medical instruments with the video signal collection interfaces of the corresponding video signal collection devices; joining a telemedicine conference by a medical video agent device and sending a conference participation instruction to the video signal collection devices, the video signal collection devices joining the telemedicine conference, encoding the collected video signals, and publishing each video encoded signal and the medical video agent device identifier; and displaying each video encoded signal with the same medical video agent device identifier in a medical video agent device publishing window of the telemedicine conference by a telemedicine terminal device. The present disclosure is conducive to enriching the implementation mode of telemedicine, improving the application flexibility and reliability of telemedicine, and reducing the implementation complexity and cost of telemedicine.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of medical treatment, and in particular, to a method for implementing remote medical treatment, a system for implementing remote medical treatment, a storage medium, and an electronic device. BACKGROUND

[0002] Remote medical treatment refers to a technology for providing medical services remotely by means of remote communication technology, holographic image technology, new-generation electronic information technology, and computer multimedia technology, etc., to realize the long-distance transmission of medical information. In the process of implementing remote medical treatment (such as remote medical consultation, remote medical teaching, and remote surgery guidance, etc.), the medical personnel at the remote end (such as medical experts or trainees, etc.) usually need to understand the current display screen of various medical instruments in the medical treatment site, and interact with the medical personnel on site remotely in terms of audio / video, for example, the medical experts at the remote end guiding the medical personnel on site to successfully complete the medical treatment process, etc.

[0003] With the development of medical technology, the types and quantities of medical instruments used in the treatment site are often more than one or two. How to simply and conveniently provide the display screen of various medical instruments used in the treatment site to the medical personnel at the remote end in a timely manner, so that the medical personnel at the remote end can better participate in the medical treatment process, is a technical problem worthy of attention. SUMMARY

[0004] In order to solve the above technical problem, the present disclosure is proposed. Embodiments of the present disclosure provide a method, a system, a storage medium, and an electronic device for implementing remote medical treatment.

[0005] According to a first aspect of the embodiments of the present disclosure, a method for implementing remote medical treatment is provided, which comprises: setting the number of video signal collection devices according to the number of medical instruments in a medical treatment site that need to collect video signals; connecting the medical instruments that need to collect video signals with the video signal collection interfaces of the corresponding video signal collection devices respectively; wherein one video signal collection device has one or more video signal collection interfaces, and one video signal collection device is connected with one or more medical instruments through the video signal collection interfaces thereof; a medical video agent device joins a remote medical meeting and sends a participation instruction to at least one video signal collection device; the video signal collection device receiving the participation instruction joins the remote medical meeting, collects video signals from the medical instruments connected therewith, encodes the collected video signals, obtains at least one video encoded signal, and publishes each video encoded signal and the medical video agent device identifier to the remote medical meeting; and a remote medical terminal device displays each video encoded signal with the same medical video agent device identifier in the medical video agent device publishing window of the remote medical meeting according to a preset window layout. According to the method for implementing remote medical treatment provided by the embodiments of the present disclosure, the number of video signal collection devices is set according to the number of medical instruments in the medical treatment site that need to collect video signals, and the medical instruments that need to collect video signals are connected with the video signal collection interfaces of the corresponding video signal collection devices respectively. In this way, the video signal collection devices can be connected with the medical instruments in the medical treatment site in a one-to-one manner, and the video signals of the medical instruments in the medical treatment site can be collected in a one-to-one manner. Furthermore, the medical video agent device joins the remote medical meeting and sends a participation instruction to at least one video signal collection device, and the video signal collection device receiving the participation instruction joins the remote medical meeting, collects video signals from the medical instruments connected therewith, encodes the collected video signals, obtains at least one video encoded signal, and publishes each video encoded signal and the medical video agent device identifier to the remote medical meeting. In this way, the medical personnel at the remote end can understand the current display screen of various medical instruments in the medical treatment site, and can interact with the medical personnel on site remotely in terms of audio / video, so that the medical personnel at the remote end can better participate in the medical treatment process.

[0006] According to a second aspect of the embodiments of the present disclosure, a system for implementing telemedicine is provided, which comprises at least one video signal acquisition device, a medical video agent device, and at least one telemedicine terminal device, the video signal acquisition device and the medical video agent device are arranged at a medical treatment site, and each video signal acquisition device has one or more video signal acquisition interfaces, each video signal acquisition device is connected with one or more medical instruments in the medical treatment site which need to acquire video signals through the video signal acquisition interface of the video signal acquisition device, and the number of the video signal acquisition devices is determined according to the number of the medical instruments in the medical treatment site which need to acquire video signals; the medical video agent device comprises a conference control module, which is configured to make the medical video agent device join a telemedicine conference and send a joining instruction to the at least one video signal acquisition device; the video signal acquisition device comprises a joining module, which is configured to join the telemedicine conference according to the joining instruction when the video signal acquisition device receives the joining instruction from the medical video agent device; a first acquisition and coding module, which is configured to acquire video signals from the medical instruments connected with the video signal acquisition device and code the acquired video signals to obtain at least one video coded signal; and a first publishing module, which is configured to publish each video coded signal obtained by the first acquisition and coding module and the medical video agent device identifier to the telemedicine conference; and the telemedicine terminal device comprises a first display module, which is configured to display each video coded signal with the same medical video agent device identifier in a medical video agent device publishing window of the telemedicine conference according to a preset window layout.

[0007] According to a third aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, which stores a computer program for implementing any of the above methods.

[0008] According to a fourth aspect of the embodiments of the present disclosure, an electronic device is provided, which comprises a processor, a memory for storing executable instructions of the processor, and the processor is configured to read the executable instructions from the memory and execute the instructions to implement any of the above methods.

[0009] The method, system, storage medium and electronic device for implementing remote medical treatment provided by the embodiments of the present disclosure can avoid the phenomenon of hardware modification of the medical video agent device for increasing the video signal acquisition interface, thereby being conducive to avoiding the problems of high modification cost, long modification period and device operation stability caused by hardware stacking; since the number of video signal acquisition devices can be determined according to the number of medical instruments in the medical treatment site, the technical solution of the present disclosure can conveniently meet the different needs of different remote medical scenarios for the number of video signal acquisition interfaces, thereby being conducive to avoiding the phenomenon that the medical video agent device after hardware modification has a fixed number of video signal acquisition interfaces and is difficult to be flexibly applicable to different remote medical scenarios; each video signal acquisition device joins the remote medical conference according to the instruction of the medical video agent device, and publishes the video coding signal acquired and coded by the video signal acquisition device together with the medical video agent device identifier, so that each remote medical terminal device can group the received video coding signals according to the medical video agent device, and make the video coding signals of the same group appear in a medical video agent device publishing window, not only the video screen of the medical instrument available to the remote medical personnel can be flexibly controlled, but also the bottleneck phenomenon caused by the medical video device processing all the video signals of the medical instruments in the medical treatment site can be avoided. In addition, while the number of video signal acquisition devices connected to the medical video agent device is not limited, each remote medical terminal device can also conveniently switch between different medical treatment sites by switching the window, which is conducive to further improving the application flexibility of the technical solution of the present disclosure. Therefore, the technical solution provided by the present disclosure is conducive to enriching the implementation mode of remote medical treatment, improving the application flexibility and reliability of remote medical treatment, and reducing the implementation complexity and cost of remote medical treatment, and can be better applied to remote medical application scenarios sensitive to delay.

[0010] The technical solution of the present disclosure will be described in further detail below by means of the accompanying drawings and embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0011] The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. The drawings provided in the present disclosure are used to provide further understanding of the embodiments of the present disclosure, and constitute a part of the specification. The drawings provided in the present disclosure together with the embodiments of the present disclosure serve to explain the present disclosure and do not constitute a limitation on the present disclosure. In the drawings, the same reference numerals generally represent the same components or steps.

[0012] Figure 1 An application scenario diagram of the technical solution of the present disclosure for implementing remote medical treatment;

[0013] Figure 2 Flow chart of an embodiment of a method for implementing telemedicine of the present disclosure;

[0014] Figure 3 Structural schematic diagram of an embodiment of a system for implementing telemedicine of the present disclosure;

[0015] Figure 4 Structural diagram of an electronic device provided by an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0016] The exemplary embodiments according to the present disclosure will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, and not all of the embodiments of the present disclosure. It should be understood that the present disclosure is not limited to the exemplary embodiments described herein.

[0017] It should be noted that: unless otherwise specified, the relative arrangement, numerical expression and numerical value of the components and steps set forth in these embodiments do not limit the scope of the present disclosure.

[0018] Those skilled in the art can understand that the terms "first", "second" and the like in the embodiments of the present disclosure are only used to distinguish different steps, devices or modules, and do not represent any specific technical meaning, nor indicate their logical order.

[0019] It should also be understood that in the embodiments of the present disclosure, "multiple" can mean two or more, and "at least one" can mean one, two or more.

[0020] It should also be understood that for any component, data or structure mentioned in the embodiments of the present disclosure, unless specifically limited or given the opposite implication by the context, it can be understood as one or more in general.

[0021] In addition, the term "and / or" in the present disclosure is only a description of the association relationship between the associated objects, which means that there can be three relationships, such as A and / or B, which can represent the three cases of A alone, A and B together, and B alone. In addition, the character " / " in the present disclosure generally represents an "or" relationship between the front and rear associated objects.

[0022] It should also be understood that the description of various embodiments of the present disclosure focuses on the differences between various embodiments, and the same or similar parts can be referred to each other, and for the sake of brevity, will not be repeated.

[0023] At the same time, it should be understood that, for the convenience of description, the size of each part shown in the drawings is not drawn in accordance with the actual proportional relationship.

[0024] The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the disclosure or its application or uses.

[0025] Techniques, methods, and devices known to those of ordinary skill in the relevant art can not be discussed in detail herein. However, where appropriate, such techniques, methods, and devices can be considered part of the specification.

[0026] It is to be noted that like reference numerals and letters throughout the several views in the drawings represent similar objects, and thus, further discussion will not be repeated herein.

[0027] Embodiments of the disclosure can be applied to electronic devices such as terminal devices, computer systems, servers, etc., which can operate with numerous other general purpose or special purpose computing system environments or configurations. Examples of well-known computing systems, environments, and / or configurations that can be suitable for use with electronic devices such as terminal devices, computer systems, or servers, include, but are not limited to, personal computers, server computers, thin clients, thick clients, hand-held or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, minicomputers, mainframe computers, and distributed cloud computing environments that include any of the above systems or the like.

[0028] Electronic devices such as terminal devices, computer systems, servers, etc., can be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules can include routines, programs, objects, components, logic, data structures, and the like, that perform particular tasks or implement particular abstract data types. Computer systems / servers can be practiced in distributed cloud-computing environments. In a distributed cloud-computing environment, tasks can be performed by remote processing devices that are linked through a communications network. In a distributed cloud-computing environment, program modules can be located in local or remote computer system storage media including storage devices.

[0029] Summary of the disclosure

[0030] In the process of implementing the present disclosure, the inventors found that in the process of implementing remote medical treatment, in order to enable remote medical personnel (such as medical experts, etc.) to have a real-time and sufficient understanding of the situation at the medical treatment site, a medical video device is usually arranged at the medical treatment site (such as an operating room, etc.), the medical video device has a video signal acquisition interface, and is connected with medical instruments in the treatment site through the video signal acquisition interface, so as to acquire video signals of the medical instruments. The medical video device can publish a video stream based on the acquired video signals to a remote terminal, and the medical video device can also provide remote audio / video interaction services for on-site treatment medical personnel and remote medical personnel (such as medical experts, etc.). However, the current display screen of the medical instruments that can be seen by the remote medical personnel through the remote terminal usually depends on the number of video signal acquisition interfaces of the medical video device, and the medical video device in reality usually has two video signal acquisition interfaces, so that the medical video device can at most simultaneously acquire video signals of two medical instruments. If the remote medical personnel need to see more current display screens of the medical instruments, the hardware structure of the medical video device needs to be modified in order to increase the number of video signal acquisition interfaces. Modification of the hardware structure of the medical video device often involves processes such as mold opening, version modification, and selection, so that the modification cost is high, the modification period is long, and the modified medical video device cannot flexibly meet the demand for the number of video signal acquisition interfaces of the medical video device in different remote medical environments, and there is a lack of flexibility in use. In addition, the modification of the hardware structure of the medical video device usually adopts the method of setting an expansion board, and the expansion board usually causes hardware stacking, thereby increasing the complexity of the connection between the hardware in the medical video device, and thus is not conducive to ensuring the running stability of the medical video device. In addition, the connection of a large number of medical instruments to the medical video device may cause the medical video device to have a heavy load, so that the medical video device becomes a bottleneck in the implementation of remote medical treatment, thereby possibly affecting the real-time performance of remote medical treatment.

[0031] In the process of implementing remote medical treatment, the remote medical personnel (such as medical experts, etc.) may participate in more than one remote medical treatment at the same time, in which case the remote medical personnel need to conveniently and quickly switch between different remote medical treatments, which poses a new challenge to the implementation scheme of remote medical treatment, which makes the implementation of remote medical treatment not only avoid the problems of high cost, long period and lack of flexibility caused by hardware modification of the corresponding device, but also avoid the influence of hardware stacking on the running stability of the hardware device, while also ensuring the real-time performance and use flexibility of remote medical treatment.

[0032] Example overview

[0033] The technical solutions for implementing remote medical treatment of the present disclosure can be applied in various application scenarios. For example, the technical solutions can be applied in remote surgery guidance, remote medical treatment teaching, remote consultation and the like. The technical solutions for implementing remote medical treatment of the present disclosure will be described below in combination with the accompanying drawings. Figure 1 Taking remote surgery guidance as an example, the technical solutions for implementing remote medical treatment of the present disclosure will be described.

[0034] Figure 1 In the example, the expert A and the expert B use the remote medical treatment terminal device 100 and the remote medical treatment terminal device 110 respectively in the expert offices to remotely guide a surgery in the operating room 120 of a remote hospital. The operating room 120 is provided with six medical instruments. It is assumed that the expert A and the expert B need to view the current display screens of four medical instruments (i.e. the medical instrument 120-1, the medical instrument 120-2, the medical instrument 120-3 and the medical instrument 120-4 in the medical instruments 120-1, 120-2, 120-3 and 120-4 in the medical instruments in the example) in real time. Two video signal acquisition devices (i.e. 120-5 and 120-6) and one medical video proxy device 120-7 can be provided in the operating room 120. The video signal acquisition device 120-5 and the video signal acquisition device 120-6 have two video signal acquisition interfaces respectively. The medical video proxy device 120-7 can not have a video signal acquisition interface. Figure 1

[0035] ​Assuming that medical instrument 120-1 and medical instrument 120-2 are located close to each other, and medical instrument 120-3 and medical instrument 120-4 are located close to each other, video signal acquisition device 120-5 can be arranged at the location of medical instrument 120-1 or medical instrument 120-2, and video signal acquisition device 120-6 can be arranged at the location of medical instrument 120-3 or medical instrument 120-4, two video signal acquisition interfaces of video signal acquisition device 120-5 are connected to medical instrument 120-1 and medical instrument 120-2 respectively, and two video signal acquisition interfaces of video signal acquisition device 120-6 are connected to medical instrument 120-3 and medical instrument 120-4 respectively. In addition, remote medical terminal device 100, remote medical terminal device 110, video signal acquisition device 120-5, video signal acquisition device 120-6 and medical video proxy device 120-7 are connected to a network (such as the Internet, a local area network, etc.) respectively, and before the operation formally starts, remote medical terminal device 100, remote medical terminal device 110 and medical video proxy device 120-7 join the same remote medical conference, and the medical staff in operating room 120 can use the setting page (such as a participation setting page) provided by medical video proxy device 120-7 to select medical instrument 120-1, medical instrument 120-2, medical instrument 120-3 and medical instrument 120-4 as the medical instruments that need to acquire video signals. Medical video proxy device 120-7 sends participation instructions to video signal acquisition device 120-5 according to the currently selected medical instrument 120-1 and medical instrument 120-2, so as to notify video signal acquisition device 120-5 to join the remote medical conference as a signal source participant (such as the identity of medical instrument 120-1 and the identity of medical instrument 120-2), so that video signal acquisition device 120-5 publishes the video coding signals of medical instrument 120-3 and medical instrument 120-4 to the remote medical conference; at the same time, medical video proxy device 120-7 sends participation instructions to video signal acquisition device 120-6 according to the currently selected medical instrument 120-3 and medical instrument 120-4, so as to notify video signal acquisition device 120-6 to join the remote medical conference as a signal source participant (such as the identity of medical instrument 120-3 and the identity of medical instrument 120-4), so that video signal acquisition device 120-6 publishes the video coding signals of medical instrument 120-3 and medical instrument 120-4 to the remote medical conference.

[0036] During the surgery, the video signal acquisition device 120-5 acquires the video signals of the medical instrument 120-1 and the medical instrument 120-2 in real time, and encodes the two acquired video signals respectively to obtain two video encoded signals (i.e., two video streams). The two video encoded signals are published to the remote medical conference as signal source participants by the video signal acquisition device 120-5, and the video signal acquisition device 120-5 identifier and the medical video proxy device 120-7 identifier are also published at the same time. The video signal acquisition device 120-6 also acquires the video signals of the medical instrument 120-3 and the medical instrument 120-4 in real time, and encodes the two acquired video signals respectively to obtain two video encoded signals (i.e., two video streams). The two video encoded signals are also published to the remote medical conference as signal source participants by the video signal acquisition device 120-6, and the video signal acquisition device 120-6 identifier and the medical video proxy device 120-7 identifier are also published at the same time. The expert A and the expert B can use their respective remote medical terminal devices to select the video stream published by the participant with the medical video proxy device 120-7 identifier, so that the remote medical terminal device 100 and the remote medical terminal device 110 decode the four video streams with the medical video proxy device 120-7 identifier respectively, and display the four decoded video signals as the video signals published by the medical video proxy device 120-7 in the same window of the remote medical conference.

[0037] In addition, during the surgery, the medical personnel in the operating room 120 can also perform voice / video interaction with the expert A and the expert B through the remote medical terminal device 100, the remote medical terminal device 110, and the remote medical conference in which the medical video proxy device 120-7 is jointly joined.

[0038] Example method

[0039] Figure 2 A flowchart of an embodiment of the method for implementing remote medical treatment of the present disclosure. As shown in the method includes steps S200, S201, S202, S203, and S204, which are described below. Figure 2 Figure 2 The steps in the method are described below.

[0040] S200, according to the number of medical instruments in the medical treatment site that need to collect video signals, set the number of video signal acquisition devices.

[0041] The medical treatment site in the present disclosure can be an operating room, an emergency rescue room, or an ICU (Intensive Care Unit, intensive care unit) or other indoor places for medical treatment of patients. ​

[0042] The medical instrument in the present disclosure generally refers to a device that directly or indirectly acts on the human body and can form a video signal by itself (i.e., the medical instrument can display the corresponding picture in real time). In one example, the medical instrument can be equipped with a miniature camera, such as a laparoscope, a thoracoscope, etc.; the medical instrument can also not be equipped with a camera, such as a blood pressure and heartbeat monitoring device, etc. The present disclosure does not limit the specific forms of the medical instrument.

[0043] The video signal acquisition device in the present disclosure refers to a device that can compress a digital video signal. In one example, the video signal acquisition device can be a device that can compress and decompress a digital video signal, i.e., the video signal acquisition device can not only perform an encoding operation, but also perform a decoding operation. In a more specific example, the video signal acquisition device can be a video codec that supports H.264 (i.e., AVC (Advanced Video Coding), H.265 (i.e., HEVC (High Efficiency Video Coding)), VP9 (i.e., NGOV (Next Gen Open Video)), or AV1 (Alliance for Open Media Video 1), etc. The present disclosure does not limit the specific forms of the video signal acquisition device.

[0044] In one example, the number of video signal acquisition devices in the present disclosure is related to the number of medical instruments that need to acquire video signals, and the number of video signal acquisition devices is generally less than the number of medical instruments that need to acquire video signals. In a special application scenario, the number of video signal acquisition devices can be the same as the number of medical instruments that need to acquire video signals, for example, in the case where one video signal acquisition device is connected to only one medical instrument, the number of video signal acquisition devices is the same as the number of medical instruments that need to acquire video signals.

[0045] In one example, the number of medical instruments that can be connected by a video signal acquisition device usually depends on the number of video signal acquisition interfaces of the video signal acquisition device, for example, if a video signal acquisition device has n (n is an integer greater than 1) video signal acquisition interfaces, the video signal acquisition device can be connected with at most n medical instruments at the same time. By setting the number of video signal acquisition devices according to the number of video signal acquisition interfaces of the video signal acquisition device and the number of medical instruments that need to acquire video signals, the technical solution of the present disclosure can flexibly set up a system for implementing remote medical treatment according to the actual situation of the medical treatment site. By connecting each video signal acquisition device with a medical instrument in the medical treatment site respectively and connecting the video signal acquisition device with as many medical instruments as possible (such as connecting all video signal acquisition interfaces with medical instruments respectively), it is beneficial to reduce the number of video signal acquisition devices used, thereby reducing the implementation cost of remote medical treatment.

[0046] S201, connect the medical instruments that need to acquire video signals with the video signal acquisition interfaces of the corresponding video signal acquisition devices respectively.

[0047] The medical instrument in the present disclosure has a video interface for outputting the video signal generated by the medical instrument itself to an external device. The video signal acquisition device in the present disclosure has a video signal acquisition interface, which is mainly used to collect the video signal output by the external device into the video signal acquisition device. The video signal acquisition interface is also a kind of video interface. A video signal acquisition device usually has multiple video signal acquisition interfaces, that is, a video signal acquisition device can be connected with one or more medical instruments at the same time. It should be noted that the video signal generated by the medical instrument in the present disclosure can be a video signal containing sound and image, which can also be called an audio-video signal. In one example, the video signal generated by the medical instrument in the present disclosure can also be a video signal that does not contain sound but only contains image.

[0048] In one example, the video signal acquisition interface / video interface in the present disclosure can be: HDMI (High Definition Multimedia Interface), DVI (Digital Visual Interface), S terminal (Separate Video, a five-core interface), SDI (Serial Digital Interface), Type-C interface, VGA (Video Graphics Array) interface, USB (Universal Serial Bus) interface, or RGB (Red Green Blue) interface, etc. The present disclosure does not limit the specific form of the video signal acquisition interface / video interface. In addition, a wired connection is usually used between the medical instrument and the video signal acquisition device, and the video signal acquisition device is usually arranged close to the medical instrument.

[0049] In one example, different medical instruments can have different types of video interfaces, and a video signal acquisition device can also have different types of video signal acquisition interfaces, and the types of video signal acquisition interfaces of different video signal acquisition devices can be the same or different.

[0050] S202, the medical video proxy device joins a remote medical meeting and sends a participation instruction to at least one video signal acquisition device.

[0051] In one example, the medical video proxy device of the present disclosure refers to a video communication device that can be used in the medical field, for example, a video communication device that can be applied to remote consultation, remote surgery demonstration, and remote surgery guidance, etc. The medical video proxy device here can be implemented by a computer (such as a notebook computer) suitable for a medical environment.

[0052] In one example, the medical video proxy device in the present disclosure is mainly used for managing the video signal acquisition device, and the medical video proxy device can also be used for audio / video interaction between the medical personnel at the medical treatment site and the remote medical personnel. For example, the management of the medical video proxy device to the video signal acquisition device can include: participation management, exit management, and acquisition signal management, etc. That is, a medical video proxy device can control all video signal acquisition devices in the medical treatment site where it is located to join a remote medical meeting, exit a remote medical meeting, and whether to perform video signal acquisition and encoding on the medical instrument connected thereto, etc.

[0053] The remote medical conference in the present disclosure is usually a video conference, and the medical video proxy device usually joins the remote medical conference as a video signal publisher. One medical video proxy device in the present disclosure usually corresponds to one medical treatment site, different medical video proxy devices usually correspond to different medical treatment sites, and different medical treatment sites can correspond to the same remote medical conference, that is, one medical treatment site usually sets up one medical video proxy device, and each medical video proxy device set up in different medical treatment sites can join the same remote medical conference as a video signal publisher, and the remote medical personnel can participate in multiple medical treatment sites at the same time by participating in one remote medical conference through the remote medical terminal device.

[0054] In one example, the participation instruction in the present disclosure refers to a command for controlling the video signal acquisition device to join a remote medical conference. The participation instruction usually includes the video conference number of the remote medical conference, and can also include the identity information of the video signal acquisition device joining the remote medical conference, and the video signal acquisition device identifier, etc. The video signal acquisition device identifier is unique. The identity information of joining the remote medical conference can indicate the signal source corresponding to the video encoded signal published by the video signal acquisition device to the remote medical conference. For example, in the case that a video signal acquisition device is connected with a first medical instrument and a second medical instrument respectively, the participation instruction sent by the medical video proxy device to the video signal acquisition device can include the video conference number and the information of joining the remote medical conference as the first signal source device. Since the first signal source device corresponds to the first medical instrument, it can be considered that the medical video proxy device commands the video signal acquisition device to join the remote medical conference corresponding to the video conference number as the first medical instrument. In addition, the participation instruction sent by the medical video proxy device to the video signal acquisition device can also include the video conference number, the information of joining the remote medical conference as the first signal source device, and the information of joining the remote medical conference as the second signal source device. Since the first signal source device corresponds to the first medical instrument and the second signal source device corresponds to the second medical instrument, it can be considered that the medical video proxy device commands the video signal acquisition device to join the remote medical conference corresponding to the video conference number as the first medical instrument and the second medical instrument. In addition, the participation instruction in the present disclosure is also used to trigger the video signal acquisition device to publish the video encoded signal acquired and encoded by it to the remote medical conference it joins.

[0055] In one example, the medical videoconferencing agent device can send a participation instruction to each video signal acquisition device in the medical treatment site where the medical videoconferencing agent device is located (e.g., send a participation instruction to each video signal acquisition device in the medical treatment site where the medical videoconferencing agent device is located according to a default or a user selection), or send a participation instruction to only some of the video signal acquisition devices in the medical treatment site where the medical videoconferencing agent device is located (e.g., send a participation instruction to only some of the video signal acquisition devices in the medical treatment site where the medical videoconferencing agent device is located according to a user selection).

[0056] In one example, the medical videoconferencing agent device can display medical instruments with video pictures in the remote medical conference according to a user selection, generate at least one participation instruction, and send the corresponding participation instruction to each video signal acquisition device connected to the selected medical instrument. For example, the medical videoconferencing agent device can display a participation setting interface to the user, and the user can use the participation setting interface displayed by the medical videoconferencing agent device to select at least some medical instruments from all medical instruments connected to each video signal acquisition device according to actual needs (e.g., current needs of the remote medical personnel). The medical videoconferencing agent device regards each medical instrument selected by the user as a medical instrument with a video picture to be displayed in the remote medical conference. Since the medical videoconferencing agent device has pre-set information of all video signal acquisition devices in the medical treatment site, information of all medical instruments, and connection relationship information between the video signal acquisition devices and the medical instruments, the medical videoconferencing agent device can know the video signal acquisition devices corresponding to each medical instrument with a video picture to be displayed in the remote medical conference based on the pre-set information, and thus can generate a corresponding participation instruction for each video signal acquisition device and send the corresponding participation instruction to the corresponding video signal acquisition device.

[0057] In one example, a specific process of generating the participation instruction by the present disclosure can be: the medical video conference agent device displays a participation setting interface to the user, the participation setting interface provides the user with a plurality of option information, i.e., option information of each video signal acquisition device and option information of medical instruments connected to each video signal acquisition device, the user can select options in the interface, for example, the user can select options for the option information of a video signal acquisition device, for another example, the user can select options for the option information of one or more medical instruments connected to a video signal acquisition device, etc. In the case that the user selects a video signal acquisition device through the option information in the participation setting interface, the medical video conference agent device regards all medical instruments connected to the selected video signal acquisition device as medical instruments that need to display video pictures in the remote medical conference, and generates a participation instruction for all medical instruments connected to the selected video signal acquisition device to participate in the remote medical conference, at this time, the participation instruction can include: a video conference number, and information for joining the remote medical conference as an identity of each signal source device connected thereto, etc. In the case that the user selects part of medical instruments connected to a video signal acquisition device through the option information in the participation setting interface, the medical video conference agent device only regards the selected part of medical instruments as medical instruments that need to display video pictures in the remote medical conference, and generates a participation instruction for the video signal acquisition device connected to the selected part of medical instruments to participate in the remote medical conference, at this time, the participation instruction can include: a video conference number, and information for joining the remote medical conference as an identity of each signal source device connected thereto, etc.

[0058] In one example, the medical video conference agent device of the present disclosure can also default to regarding all medical instruments as medical instruments that need to display video pictures in the remote medical conference without the need for the user to select, and generate a participation instruction (such as generating a participation instruction for each video signal acquisition device respectively, different participation instructions can carry different parameters), so as to send the corresponding participation instruction to all video signal acquisition devices respectively.

[0059] By providing the user with the option of selecting medical instruments that need to display video pictures in the remote medical conference, the actual needs of the remote medical personnel can be fully met while unnecessary information processing is avoided, for example, unnecessary signal acquisition processing, encoding processing, decoding processing, signal transmission processing and rendering processing, etc. can be avoided, thereby facilitating the improvement of the user experience of remote medical treatment, and facilitating the improvement of the flexibility and real-time performance of remote medical treatment.

[0060] In one example, the participating setting interface of the present disclosure can further include an encoding parameter setting option, the medical video proxy device can display the encoding parameter setting option to the user through the participating setting interface, the user can select corresponding encoding parameters (such as code rate, frame rate, resolution, color space, and encoding protocol, etc.) based on the encoding parameter setting option in the participating setting interface, and the medical video proxy device can send these encoding parameters to each video signal acquisition device. For example, the medical video proxy device generates an encoding parameter setting instruction according to the encoding parameters selected by the user, and sends the encoding parameter setting instruction to at least one video signal acquisition device. For another example, the medical video proxy device carries the encoding parameters selected by the user in the participating instruction, and sends it to each video signal acquisition device.

[0061] In one example, during the remote medical preparation stage or the remote medical implementation stage, the medical video proxy device can display the current video pictures of multiple medical instruments in the participating setting interface. Specifically, the medical video proxy device and all video signal acquisition devices can realize information interaction between the medical video proxy device and the video signal acquisition devices through a network (such as the Internet or a local area network, etc.), so that the medical video proxy device can access each video signal acquisition device through the network. After each video signal acquisition device respectively collects video signals from each medical instrument connected thereto in real time, it independently encodes each video signal, thereby obtaining video encoding signals (i.e. multiple video streams) corresponding to each medical instrument. The medical video proxy device can obtain multiple video encoding signals obtained by each video signal acquisition device after encoding by accessing the video signal acquisition device. The medical video proxy device decodes each video encoding signal to obtain multiple video signals. The medical video proxy device displays the option information of each video signal acquisition device and the option information of each medical instrument connected to each video signal acquisition device to the user in the participating setting interface, and also displays each video signal obtained by decoding to the user, for example, displays a video picture formed based on the corresponding video signal at the position of the option information of each medical instrument in the participating setting interface. Therefore, the present disclosure can enable the user to more intuitively perceive each medical instrument, avoid the phenomenon of user misselection or omission, thereby facilitating the implementation of remote medical treatment and improving user experience.

[0062] In one example, the medical video proxy device and all the video signal collection devices of the present disclosure can access a network (such as the Internet or a local area network) through WIFI or a mobile network, so that the medical video proxy device can access each video signal collection device through the network, and the medical video proxy device can obtain each video coding signal obtained after coding processing of each video signal collection device based on the RTSP (Real Time Streaming Protocol, Real-time Streaming Protocol), SRT (Secure Reliable Transport, Secure Reliable Transport) protocol or FLV (Flash Video, Flash Video) protocol, etc. The medical video proxy device can obtain all video coding signals based on the same protocol, for example, the medical video proxy device can obtain all video coding signals from each video signal collection device based on RTSP, or obtain all video coding signals from each video signal collection device based on the SRT protocol, or obtain all video coding signals from each video signal collection device based on the FLV protocol. Of course, the present disclosure does not exclude the case that the medical video proxy device obtains all video coding signals from each video signal collection device based on different protocols. By making the medical video proxy device access each video signal collection device through the network (such as the Internet or a local area network), the medical video proxy device will not limit the number of video signal collection devices, and thus the technical solution of the present disclosure for realizing remote medical treatment will not limit the number of medical instruments; by using RTSP, SRT protocol or FLV protocol to obtain all video coding signals, it is beneficial to reduce the delay of the medical video proxy device obtaining video coding information, thereby facilitating the medical video proxy device to display the video of each medical instrument to the user as much as possible. Synchronization of the video displayed by each medical instrument, thereby facilitating the improvement of user experience. Especially when obtaining video coding signals based on the FLV protocol, it can better achieve the effect of synchronization of the video displayed by the two, thereby facilitating the improvement of user experience.

[0063] S203, the video signal collection device receiving the participation instruction joins the remote medical meeting, collects video signals from the medical instruments connected thereto, encodes the collected video signals, obtains at least one video coding signal, and publishes each video coding signal and a medical video proxy device identifier to the remote medical meeting. The medical video proxy device identifier has uniqueness.

[0064] In one example, after receiving the participation instruction, the video signal acquisition device of the present disclosure can join the telemedicine conference as the identity of the signal source device, that is, although the video signal acquisition device joins the telemedicine conference as a participant, the video signal acquisition device is not the actual signal source, and the medical instrument connected thereto is the actual signal source. Therefore, the video signal acquisition device of the present disclosure, although as a participant, can have the identity of the signal source device, that is, from the perspective of the remote medical personnel, the video encoded signal published to the remote video conference comes from the signal source device, such as from the corresponding medical instrument. In the case where the video encoded signals of the plurality of medical instruments connected to the video signal acquisition device each corresponding to the video signal acquisition device need to be published to the remote medical conference, the video signal acquisition device can become a plurality of independent participants of the remote medical conference, and the identities of different participants are the identities of different signal source devices. The video signal acquisition device can join the remote medical conference according to the participant identity information in the participation instruction. For example, the participation instruction contains the identity information of at least one participant, which can enable the video signal acquisition device to know the medical instrument that needs to be video signal acquired, and also enable the video signal acquisition device to know the participant identity information when it joins the remote medical conference. Of course, the present disclosure does not exclude the possibility that the video signal acquisition device joins the remote medical conference as its own identity.

[0065] In one example, the encoding process of the video signal acquisition device of the present disclosure can be a format conversion / compression process of the acquired original video signal, and the encoding process of the present disclosure can be an encoding process based on H.264, an encoding process based on H.265, an encoding process based on VP9, or an encoding process based on AV1, etc. The video encoded signal obtained after the encoding process is usually in the form of a video file of the corresponding format. In one example, the protocols adopted by the encoding processes supported by different video signal acquisition devices can be the same or different.

[0066] In one example, if a video signal acquisition device is connected with only one medical instrument, the video signal acquisition device continuously encodes the video signal output by the medical instrument in real time to obtain one video encoded signal, i.e., one video stream. If a video signal acquisition device is connected with multiple medical instruments, the video signal acquisition device simultaneously acquires the video signals output by the multiple medical instruments in real time, and continuously encodes each of the acquired video signals independently to obtain multiple video encoded signals, i.e., multiple video streams. In this example, the video signal acquisition device encodes each video signal independently of the other video signals, and thus does not mix the multiple video signals. Of course, the present disclosure does not exclude the possibility that the video signal acquisition device mixes the multiple video signals (e.g., mixes the screens according to a predetermined window layout). By independently encoding each video signal from the multiple medical instruments, the video signal acquisition device can avoid losing image details that would otherwise occur if the multiple video signals were mixed and encoded together. This advantageously ensures that each video encoded signal has a high quality picture, thereby providing a high quality video picture to the remote terminal.

[0067] In one example, the video signal acquisition device publishes the video signal acquisition device identifier together with the video encoded signals and the medical video agent identifier. By joining the video signal acquisition device as a signal source in the remote medical conference, the remote medical personnel can easily see the pictures currently displayed by the medical instruments in the medical treatment site. By publishing the video signal acquisition device identifier, the remote medical personnel and the on-site medical personnel can know the acquisition device corresponding to the medical instrument, which advantageously facilitates interaction and problem troubleshooting, thereby improving the user experience.

[0068] In one example, the medical video proxy device can also control the video signal acquisition device to exit the remote medical conference. For example, when the medical video proxy device detects that a medical instrument requiring video signal acquisition is changed to a medical instrument not requiring video signal acquisition, the medical video proxy device generates a first exit conference instruction and sends the first exit conference instruction to the video signal acquisition device connected to the medical instrument changed to not requiring video signal acquisition. The video signal acquisition device receiving the first exit conference instruction exits the corresponding signal source identity in the remote medical conference. Specifically, when the on-site medical personnel changes the selected medical instrument option information or the remote medical personnel no longer needs to view the display screen of a certain medical instrument, the medical video proxy device can obtain the video signal acquisition device identifier corresponding to the medical instrument not requiring video signal acquisition, and generate a first exit conference instruction according to the identifier and send the first exit conference instruction to the video signal acquisition device with the identifier. The first exit conference instruction can include the video signal acquisition device identifier and the signal source identity information (i.e., the identity information of the participant requiring to exit the remote medical conference) requiring to exit the remote medical conference. The video signal acquisition device receiving the first exit conference instruction can no longer acquire the video signal of the corresponding medical instrument (i.e., the medical instrument corresponding to the signal source identity information requiring to exit the remote medical conference) connected thereto while exiting the corresponding participant with the identity from the remote medical conference according to the instruction. In a more specific example, the user can modify a certain or certain selected medical instrument to be unselected through the participant setting interface displayed by the medical video proxy device. If the modification results in that all medical instruments connected to a video signal acquisition device no longer require video signal acquisition, the medical video proxy device sends a first exit conference instruction to the corresponding video signal acquisition device according to the video signal acquisition device identifier. The video signal acquisition device receiving the first exit conference instruction exits all participants corresponding thereto from the remote medical conference. At this time, if the participant setting interface is in an activated state, the video signal acquisition device can continue to acquire the video signals of the medical instruments connected thereto and transmit the encoded video signals to the medical video proxy device, so that the medical video proxy device displays the corresponding video screen at the position of the corresponding medical instrument in the participant setting interface. If the participant setting interface is in a closed or minimized state, the video signal acquisition device can no longer continue to acquire the video signals of the medical instruments connected thereto.

[0069] In one example, before the medical video conferencing proxy device exits the telemedicine conference, it can send a second exit command to the video signal acquisition device corresponding to each video encoded signal with the identifier of the medical video conferencing proxy device. This will cause the video signal acquisition device that receives the second exit command to exit the telemedicine conference with all its signal source identities in the telemedicine conference.

[0070] During a telemedicine conference, remote medical personnel (such as remote experts) may encounter situations where the medical instruments they need to view on the video feed change as the treatment progresses. By controlling the video signal acquisition equipment to join and leave the conference, the video feed displayed on the telemedicine terminal device can always be the one that the remote medical personnel expect to see. This improves the flexibility of telemedicine and enhances the user experience.

[0071] S204. The remote medical terminal equipment displays the video encoded signals with the same medical video proxy device identifier in the medical video proxy device publishing window of the remote medical conference according to the preset window layout.

[0072] In one example, the remote medical terminal device can decode each of the received video coding signals respectively, obtain each of the video signals, and then render each of the decoded video signals having the same medical video agent identifier according to a window distribution manner (i.e., a screen distribution manner), and display the rendering result in the medical video agent publishing window of the remote medical conference, i.e., display the current display screen of each medical instrument in the medical video agent publishing window of the remote medical conference. The screen distribution manner refers to dividing the display area of the screen into a plurality of blocks according to the total number of the video coding signals, and the area size of each block is usually the same, and one block corresponds to one video coding signal. During the rendering process, the remote medical terminal device should align the time of each of the decoded video signals, i.e., the display screens of each medical instrument displayed in the same window of the remote medical terminal device should be the display screens of the same time. In the case of dividing the screen into i blocks (e.g., i is 4, 6, 8, or 9, etc.) by the screen distribution manner, if the total number of the video coding signals is less than i (e.g., the total number of the video signals is 5 when i is 6), the remote medical terminal device can render all the video signals and one or more preset video signals (e.g., a preset black screen video signal, etc.) together during the rendering process. Of course, the disclosure does not exclude the possibility that the remote medical terminal device uses a screen distribution manner for rendering. For example, considering the different importance of medical instruments or the complexity of display content, the remote medical terminal device can set the block corresponding to a certain medical instrument at the center position, and the area of the block is larger than the area of the blocks corresponding to other medical instruments. From the above description, it can be seen that the disclosure divides the video coding signals having the same medical video agent identifier into the same group, and one group corresponds to one display window (i.e., a medical video agent publishing window), and the video screen displayed in one display window can be considered as the video screen published by one participant (i.e., one medical video agent). In addition, the remote medical terminal device can generate the publishing window of the medical video agent by subscribing to the medical video agent identifier in the remote medical conference.

[0073] In one example, the medical video agent device is provided with a camera and a microphone, and the medical video agent device can collect a video signal (here, the video signal is a video signal including sound and image) of the medical treatment site through the camera and the microphone. The medical video agent device can perform encoding processing on the video signal, so that after the medical video agent device joins the remote medical conference, the medical video agent device can publish the video encoding signal obtained by encoding processing and the identifier of the medical video agent device to the remote medical conference. By making the medical video agent device generate a video encoding signal of the medical treatment site and publishing the video encoding signal and the identifier of the medical video agent device to the remote medical conference, the remote medical personnel (such as medical experts or students for research and learning) can conveniently and timely understand the situation of the medical treatment site, and the medical personnel at the medical treatment site and the remote medical personnel can conveniently and timely perform voice / video interaction.

[0074] In one example, the remote medical terminal device receives each video encoding signal including the video encoding signal published by each video signal collection device and the video encoding signal published by the medical video agent device. The remote medical terminal device decodes all video encoding signals respectively to obtain each video signal, and performs rendering processing on each video signal with the same medical video agent device identifier according to a screen layout mode, and displays the rendering processing result in the medical video agent device publishing window of the remote medical conference, that is, displays the current display screen of each medical instrument and the screen of the medical treatment site in the medical video agent device publishing window of the remote medical conference. For example, assuming that two video signal collection devices collect four video signals and the medical video agent device collects one video signal of the medical treatment site, the remote medical terminal device can perform rendering processing on the five video signals and a preset black screen video signal without image content according to a screen layout mode, and display the rendering processing result in the medical video agent device publishing window. By performing rendering processing on the video signal corresponding to each medical instrument and the video signal of the medical treatment site according to the screen layout mode, the implementation of the technical solution of the present disclosure is not affected by the number of medical instruments, so as to facilitate the implementation flexibility of the technical solution of the present disclosure, and facilitate the convenient and efficient implementation of remote medical treatment.

[0075] In one example, the medical video proxy device collects the video signals of the medical treatment site through the camera and the microphone, and encodes the video signals of the medical treatment site to obtain one medical treatment site video encoding signal. The medical video proxy device publishes the medical treatment site video encoding signal to the telemedicine conference. The telemedicine terminal device decodes the medical treatment site video encoding signal published to the telemedicine conference, and displays the medical treatment site video signal obtained by decoding in the medical treatment site window. The medical treatment site window is independent of the medical video proxy device publishing window.

[0076] In one example, the medical video proxy device decodes each medical treatment site video encoding signal published to the telemedicine conference, and displays each medical treatment site video signal in the local medical video proxy device publishing window according to the window distribution mode.

[0077] Example system

[0078] Figure 3 A structural schematic diagram of an embodiment of the system for implementing telemedicine of the present disclosure is shown in FIG. 1. As shown in the figure, the system mainly includes at least one video signal collection device 300, a medical video proxy device 310, and at least one telemedicine terminal device 320. The devices included in the system are described below respectively. Figure 3

[0079] The video signal collection device 300 and the medical video proxy device 310 in the present disclosure are arranged in the medical treatment site, and each video signal collection device 300 has one or more video signal collection interfaces. Each video signal collection device 300 is connected with one or more medical instruments 330 in the medical treatment site through the video signal collection interface of the video signal collection device 300, wherein the number of the video signal collection devices 300 is usually less than the number of the medical instruments 330 in the medical treatment site, and the number of the video signal collection devices 300 is determined according to the number of the medical instruments 330 in the medical treatment site.

[0080] ​In one example, the video signal collection device 300 of the present disclosure comprises a participating module 3001, a first collection and encoding module 3002, and a first publishing module 3003. The participating module 3001 is mainly used to join a telemedicine conference (i.e., a telemedicine conference joined by the medical video agent device 310) according to a participating instruction received by the video signal collection device 300 where the participating module 3001 is located from the medical video agent device 310 in the case that the participating instruction is received by the video signal collection device 300 where the participating module 3001 is located. For example, the participating module 3001 can join the telemedicine conference (i.e., a telemedicine conference joined by the medical video agent device 310) as a signal source in the case that the participating instruction is received by the video signal collection device 300 where the participating module 3001 is located from the medical video agent device 310. The first collection and encoding module 3002 is mainly used to collect video signals from the medical instrument 330 connected to the video signal collection device 300 where the first collection and encoding module 3002 is located, and to encode the collected video signals to obtain at least one video encoded signal. The first publishing module 3003 is mainly used to publish the video encoded signals obtained by the first collection and encoding module 3002 and the medical video agent device identifier to the telemedicine conference. For example, the first publishing module 3003 can publish the video encoded signals, the video signal collection device identifier, and the medical video agent device identifier to the telemedicine conference joined by the video signal collection device 300.

[0081] In one example, the medical video agent device 310 of the present disclosure mainly comprises a participating control module 3101. The participating control module 3101 is mainly used to make the medical video agent device 310 join a telemedicine conference, and to send a participating instruction to at least one video signal collection device 300 so as to make the corresponding video signal collection device 300 also join the telemedicine conference.

[0082] In one example, the participating control module 3101 in the medical videoconferencing agent device 310 comprises a first sub-module 31011, a second sub-module 31012, a third sub-module 31013, a fourth sub-module and a fifth sub-module (not shown in the figure). The first sub-module 31011 is mainly configured to make the medical videoconferencing agent device 310 join a remote medical conference. The second sub-module 31012 is mainly configured to make the medical videoconferencing agent device 310 show a participating setting interface to a user. The third sub-module 31013 is mainly configured to generate a participating instruction according to a medical instrument selected by the user based on the participating setting interface and make the video signal acquisition device connected to the medical instrument selected by the user send the participating instruction. The fourth sub-module is configured to generate an encoding parameter setting instruction according to an encoding parameter selected by the user based on an encoding parameter setting option in the participating setting interface and send the encoding parameter setting instruction to at least one video signal acquisition device. The fifth sub-module is configured to carry the encoding parameter selected by the user based on the encoding parameter setting option in the participating setting interface in the participating instruction.

[0083] In one example, the second sub-module 31012 can comprise an accessing unit 310121, a decoding unit 310122 and a showing unit 310123. The accessing unit 310121 is mainly configured to make the medical videoconferencing agent device 310 access the video signal acquisition device 300 and obtain each video encoding signal obtained by the video signal acquisition device 300 after collecting and encoding processing. For example, the accessing unit 310121 can make the medical videoconferencing agent device 310 access the video signal acquisition device 300 through a network (such as the Internet or a local area network) and obtain the video encoding signal corresponding to each medical instrument from which the video signal needs to be collected from the video signal acquisition device based on a real-time streaming protocol, a secure reliable transmission protocol or a flash video protocol. The decoding unit 310122 is mainly configured to decode each video encoding signal obtained by the accessing unit 310121 to obtain each video signal. The showing unit 310123 is mainly configured to show the option information of the video signal acquisition device, the option information of the medical instrument connected to each video signal acquisition device and the video picture of each medical instrument formed based on each video signal obtained by the decoding unit 310122 to the user through the participating setting interface.

[0084] In one example, the medical video agent device 310 can further comprise an exit control module 3102. The exit control module 3102 is mainly configured to generate a first exit instruction when a medical instrument requiring video signal collection is converted into a medical instrument not requiring video signal collection, and send the first exit instruction to the video signal collection device 300 connected to the medical instrument converted into a medical instrument not requiring video signal collection. The video signal collection device 300 of the present disclosure can further comprise an exit module 3004. The exit module 3004 is mainly configured to exit the corresponding signal source identity in the remote medical conference when the video signal collection device 300 where the exit module 3004 is located receives the first exit instruction from the medical video agent device 310. In addition, the exit control module 3102 can be configured to send a second exit instruction to each video signal collection device corresponding to each video coding signal with the medical video agent device identity before the medical video agent device itself exits the remote medical conference. The video signal collection device receiving the second exit instruction exits all signal source identities in the remote medical conference.

[0085] In one example, when the medical video agent device 310 of the present disclosure is provided with a camera and a microphone, the medical video agent device 310 can further comprise a second collection and coding module 3103 and a second publishing module 3104. The second collection and coding module 3103 is mainly configured to code and process the video signal of the medical treatment scene collected by the camera and the microphone to obtain a medical treatment scene video coding signal. The second publishing module 3104 is mainly configured to publish the medical treatment scene video coding signal obtained by the second collection and coding module 3103 to the remote medical conference together with the medical video agent device identity.

[0086] In one example, the remote medical terminal device 320 comprises a first display module 3201. The first display module 3201 is mainly configured to display each video coding signal with the same medical video agent device identity in the medical video agent device publishing window of the remote medical conference according to a preset window layout. For example, the first display module 3201 can comprise a sixth sub-module 32011 and a seventh sub-module 32012. The sixth sub-module 32011 is mainly configured to decode and process the medical treatment scene video coding signal and each video coding signal with the same medical video agent device identity published to the remote medical conference to obtain each video signal. The seventh sub-module 32012 is mainly configured to display each video signal obtained by the sixth sub-module 32011 as the video signal published by the medical video agent device in the medical video agent device publishing window according to the window layout.

[0087] In one example, the first display module 3201 may include an eighth submodule (not shown in the figure). This eighth submodule is used to decode the encoded video signal of the medical treatment site published to the telemedicine conference and display the decoded video signal in the medical treatment site window. The medical treatment site window is independent of the medical video conferencing agent device's publishing window.

[0088] In one example, the medical video conferencing proxy device 310 may also include a second display module (not shown in the figure). The second display module is used to decode each video encoded signal with the same medical video conferencing proxy device identifier published to the telemedicine conference, and display each video signal in the local medical video conferencing proxy device publishing window according to the window division layout.

[0089] Example electronic device

[0090] The following is for reference. Figure 4 To describe an electronic device according to embodiments of the present disclosure. Figure 4 A block diagram of an electronic device according to an embodiment of the present disclosure is shown. (As follows) Figure 4 As shown, the electronic device 41 includes one or more processors 411 and memory 412.

[0091] The processor 411 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 41 to perform desired functions.

[0092] The memory 412 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may, for example, include random access memory (RAM) and / or cache memory. The non-volatile memory may, for example, include read-only memory (ROM), hard disk, and flash memory. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 411 may execute the program instructions to implement the methods for implementing telemedicine and / or other desired functions described in the various embodiments of this disclosure above.

[0093] In one example, the electronic device 41 can further include an input device 413 and an output device 414, etc., which are interconnected through a bus system and / or other forms of connection mechanisms (not shown). In addition, the input device 413 can include, for example, a keyboard, a mouse, etc. The output device 414 can output various information to the outside. The output device 414 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, etc.

[0094] Of course, in order to simplify, Figure 4 Only some of the components in the electronic device 41 related to the present disclosure are shown in the middle, and components such as buses, input / output interfaces, etc. are omitted. In addition, the electronic device 41 can include any other appropriate components according to specific application cases.

[0095] Example computer program product and computer readable storage medium

[0096] In addition to the above-mentioned methods and devices, embodiments of the present disclosure can also be a computer program product, which includes computer program instructions that, when executed by a processor, cause the processor to perform the steps of the method for implementing remote medical treatment according to various embodiments of the present disclosure described in the above "Exemplary Methods" section of the present specification.

[0097] The computer program product can be written in any combination of one or more programming languages, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on a user computing device, partially on a user device, as an independent software package, partially on a user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0098] In addition, embodiments of the present disclosure can also be a computer readable storage medium having stored thereon computer program instructions, which, when executed by a processor, cause the processor to perform the steps of the method for implementing remote medical treatment according to various embodiments of the present disclosure described in the above "Exemplary Methods" section of the present specification.

[0099] The computer readable storage medium can be any combination of one or more computer readable medium(s). The computer readable medium can be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium include an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0100] The above generally describes the basic principles of the disclosure in conjunction with specific embodiments, but it should be noted that the advantages, benefits, effects and the like mentioned in the disclosure are only examples and are not limiting, and these advantages, benefits and effects and the like cannot be considered as necessary for each embodiment of the disclosure. In addition, the above specific details of the disclosure are only for the purpose of example and for the purpose of understanding, and the above details do not limit the disclosure to be necessarily implemented with the above specific details.

[0101] Each embodiment in the specification is described in a progressive manner, and each embodiment focuses on the difference from other embodiments. The same or similar parts between each embodiment can be referred to each other. For system embodiments, since they basically correspond to method embodiments, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0102] The block diagrams of the devices, apparatuses, equipment, systems involved in the disclosure are only illustrative examples and are not intended to require or imply the connection, arrangement, configuration shown in the block diagram. As those skilled in the art will recognize, these devices, apparatuses, equipment and systems can be connected, arranged and configured in any manner. Words such as "include", "contain", "have" and the like are open-ended words, which mean "including but not limited to", and can be used interchangeably. The words "or" and "and" used herein mean the word "and / or", and can be used interchangeably unless the context clearly indicates otherwise. The word "such as" used herein means the phrase "such as but not limited to", and can be used interchangeably.

[0103] The methods and apparatus of the present disclosure can be implemented in a number of ways. For example, the methods and apparatus of the present disclosure can be implemented using software, hardware, firmware, or any combination of software, hardware, and firmware. The order of any steps described above is merely exemplary and the steps of the methods of the present disclosure need not be performed in the order described unless otherwise specified. Furthermore, any steps described above can be combined, reordered, or otherwise altered unless otherwise specified. Moreover, in some embodiments, the present disclosure can also be implemented as a program for running on a computer or other programmable apparatus to implement the methods as described above. Thus, the present disclosure also covers record mediums storing programs for implementing the methods of the present disclosure.

[0104] It is also important to note that the present disclosure can be implemented in methods and apparatuses containing, solely or in combination with other forms, software, firmware, hardware, or any combination thereof. The methods of the present disclosure can be implemented by one or more computer program products comprising computer readable medium having computer readable program code embodied therin, which when executed by a processor, carries out the methods of the present disclosure.

[0105] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein can be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0106] The above description has been presented for the purpose of illustration and description. Furthermore, this description is not intended to limit the embodiments of the present disclosure to forms disclosed herein. Although various example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, changes, additions, and sub-combinations thereof.

Claims

1. A method for implementing telemedicine, characterized in that, The method includes: The number of video signal acquisition devices shall be determined based on the number of medical instruments that require video signal acquisition at the medical treatment site. The medical instruments that require video signal acquisition are respectively connected to the video signal acquisition interface of the corresponding video signal acquisition device; wherein, a video signal acquisition device has one or more video signal acquisition interfaces, and a video signal acquisition device is connected to one or more medical instruments through its video signal acquisition interface, and the video signal acquisition device and the medical instruments are set up together in the medical treatment site; A medical video conferencing proxy device set up at the medical treatment site joins a telemedicine conference and sends a participation instruction to at least one video signal acquisition device; wherein, the medical video conferencing proxy device joins the telemedicine conference as a video signal publisher, one medical video conferencing proxy device corresponds to one medical treatment site, and different medical treatment sites correspond to the same telemedicine conference; Upon receiving the participation instruction, the video signal acquisition device joins the telemedicine conference, acquires video signals from the medical instruments connected to it, encodes the acquired video signals to obtain at least one encoded video signal, and publishes each encoded video signal and the medical video conferencing agent device identifier to the telemedicine conference; wherein, the video signal acquisition device joins the telemedicine conference as a signal source. According to the preset window layout, the remote medical terminal device displays the video encoded signals of each channel with the same medical video proxy device identifier in the medical video proxy device publishing window of the remote medical conference; Before exiting the telemedicine conference, the medical video conferencing proxy device sends a second exit command to the video signal acquisition device corresponding to each video encoded signal with the identifier of the medical video conferencing proxy device. Upon receiving the second exit conference instruction, the video signal acquisition device will exit the telemedicine conference for all its respective signal source identities.

2. The method according to claim 1, characterized in that, Sending a meeting participation instruction to at least one video signal acquisition device includes: The medical video conferencing proxy device displays a meeting setup interface to the user, generates a meeting instruction based on the medical instrument selected by the user based on the meeting setup interface, and sends the meeting instruction to each video signal acquisition device connected to the selected medical instrument.

3. The method according to claim 2, characterized in that, The meeting setup interface also includes: encoding parameter setting options, and the method also includes: The medical video conferencing proxy device generates an encoding parameter setting instruction based on the encoding parameters selected by the user according to the encoding parameter setting options in the meeting settings interface, and sends the encoding parameter setting instruction to at least one video signal acquisition device; and / or The medical video conferencing proxy device carries the encoding parameters selected by the user based on the encoding parameter setting options in the meeting settings interface in the meeting command.

4. The method according to claim 2, characterized in that, The medical video conferencing proxy device displays a meeting setup interface to the user, including: The medical video conferencing proxy device accesses each video signal acquisition device to obtain each video signal after it has been acquired and encoded by each video signal acquisition device, and then decodes each video signal to obtain each video signal. The medical video conferencing proxy device displays to the user, through the meeting settings interface, the option information of each video signal acquisition device, the option information of the medical instruments connected to each video signal acquisition device, and the video images of each medical instrument formed based on each video signal.

5. The method according to claim 4, characterized in that, The medical video conferencing proxy device accesses each video signal acquisition device to obtain the various video encoded signals acquired and encoded by each video signal acquisition device, including: The medical video conferencing proxy device accesses various video signal acquisition devices via the network and obtains the corresponding video encoded signals of all medical instruments that need to acquire video signals from each video signal acquisition device based on real-time streaming protocols, secure and reliable transmission protocols, or flash video protocols.

6. The method according to claim 1, characterized in that, The video signal acquisition device that receives the meeting participation instruction joins the remote medical conference, including: Upon receiving the meeting participation instruction, the video signal acquisition device joins the remote medical conference as a signal source. Furthermore, the step of transmitting various video encoded signals and the medical video conferencing agent identifier to the telemedicine conference includes: The video signal acquisition device transmits various encoded video signals, the identification of the video signal acquisition device, and the identification of the medical video conferencing proxy device to the telemedicine conference.

7. The method according to claim 6, characterized in that, The method further includes: When the medical video conferencing proxy device detects that a medical instrument that needs to acquire video signals has changed to a medical instrument that does not need to acquire video signals, the medical video conferencing proxy device generates a first exit conference command and sends the first exit conference command to the video signal acquisition device connected to the medical instrument that has changed to not need to acquire video signals. Upon receiving the first exit command, the video signal acquisition device will exit the telemedicine conference as the corresponding signal source.

8. The method according to any one of claims 1 to 7, characterized in that, The medical video conferencing device is equipped with a camera and a microphone, and the method further includes: The medical video conferencing device acquires video signals from the medical treatment site through a camera and microphone, and encodes the video signals to obtain a single encoded video signal from the medical treatment site. The medical video conferencing proxy device transmits the encoded video signal of the medical treatment site, along with the medical video conferencing proxy device identifier, to the telemedicine conference. Furthermore, the remote medical terminal device, according to a preset window layout, displays various video encoded signals with the same medical video proxy device identifier in the medical video proxy device publishing window of the remote medical conference, including: The remote medical terminal device decodes the medical treatment site video encoding signals and other video encoding signals that have the same medical video proxy device identifier and are published to the remote medical conference. The decoded video signals are used as video signals published by the medical video proxy device and displayed in the publishing window of the medical video proxy device in an equally divided window layout. Alternatively, the method may further include: The medical video conferencing device acquires video signals from the medical treatment site through a camera and microphone, and encodes the video signals to obtain a single encoded video signal from the medical treatment site. The medical video conferencing proxy device transmits the encoded video signal of the medical treatment site to the telemedicine conference. The remote medical terminal device decodes the medical treatment scene video signal published to the remote medical conference and displays the decoded medical treatment scene video signal in the medical treatment scene window; wherein, the medical treatment scene window is independent of the publishing window of the medical video proxy device.

9. The method according to any one of claims 1 to 7, characterized in that, The method further includes: The medical video conferencing proxy device decodes each video encoded signal with the same medical video conferencing proxy device identifier that is published to the telemedicine conference, and displays each video signal in the local medical video conferencing proxy device publishing window according to the window division layout.

10. A system for realizing telemedicine, characterized in that, The system includes: at least one video signal acquisition device, one medical video conferencing proxy device, and at least one remote medical terminal device. The video signal acquisition device and the medical video conferencing proxy device are located at the medical treatment site. Each video signal acquisition device has one or more video signal acquisition interfaces. Each video signal acquisition device is connected to one or more medical instruments at the medical treatment site that need to acquire video signals through its own video signal acquisition interface. The number of video signal acquisition devices is determined according to the number of medical instruments at the medical treatment site that need to acquire video signals. The medical video conferencing device includes: The meeting control module is used to enable medical video conferencing proxy devices to join a telemedicine conference and send a meeting instruction to at least one video signal acquisition device; wherein, the medical video conferencing proxy device joins the telemedicine conference as a video signal publisher, one medical video conferencing proxy device corresponds to one medical treatment site, and different medical treatment sites correspond to the same telemedicine conference; The exit control module is used to send a second exit command to the video signal acquisition device corresponding to each video encoded signal with the identifier of the medical video agent device before the medical video agent device exits the telemedicine conference. The video signal acquisition device includes: The participation module is used to join the telemedicine conference according to the participation instruction received by its video signal acquisition device from the medical video conferencing agent device; wherein, the video signal acquisition device joins the telemedicine conference as a signal source; The first acquisition and encoding module is used to acquire video signals from the medical instrument connected to the video signal acquisition device it is located in, and to encode the acquired video signals to obtain at least one video encoded signal. The first publishing module is used to publish the video encoded signals obtained by the first acquisition and encoding module and the identifier of the medical video agent device to the remote medical conference. The exit module is used to exit the telemedicine conference for all signal source identities of its video signal acquisition device in the telemedicine conference when the video signal acquisition device receives the second exit conference instruction. The remote medical terminal device includes: The first display module is used to display the video encoded signals of each channel with the same medical video proxy device identifier in the medical video proxy device publishing window of the telemedicine conference, according to a preset window layout.

11. The system according to claim 10, characterized in that, The meeting control module includes: The first submodule is used to enable the medical video conferencing agent device to join a telemedicine conference; The second submodule is used to enable the medical video conferencing agent device to display the meeting settings interface to the user. The third submodule is used to generate a participation instruction based on the medical instruments selected by the user based on the participation settings interface, which need to display video images in the telemedicine conference, and to send the participation instruction to each video signal acquisition device connected to the selected medical instrument.

12. The system according to claim 11, characterized in that, The meeting setup interface also includes: encoding parameter setting options; the meeting control module also includes: The fourth submodule is used to generate an encoding parameter setting instruction based on the encoding parameters selected by the user according to the encoding parameter setting options in the meeting settings interface, and to send the encoding parameter setting instruction to at least one video signal acquisition device; and / or The fifth submodule is used to carry the encoding parameters selected by the user based on the encoding parameter setting options in the meeting settings interface in the meeting command.

13. The system according to claim 11, characterized in that, The second submodule includes: The access unit is used to enable the medical video agent device to access each video signal acquisition device and obtain each video signal acquisition device after it has acquired and encoded the video signals. The decoding unit is used to decode the video encoded signals obtained by the access unit to obtain the video signals. The display unit is used to display to the user, through the meeting settings interface, the option information of each video signal acquisition device, the option information of the medical instruments connected to each video signal acquisition device, and the video images of each medical instrument formed based on the video signals obtained by the decoding unit.

14. The system according to claim 10, characterized in that: The participation module is specifically used to: join the remote medical conference as a signal source when its video signal acquisition device receives a participation instruction from the medical video conferencing agent device; Furthermore, the first publishing module is specifically used to: publish various video encoded signals, the identifier of the video signal acquisition device, and the identifier of the medical video conferencing proxy device to the remote medical conference.

15. The system according to claim 14, characterized in that: The exit control module is also used to generate a first exit conference instruction when it detects that a medical instrument that needs to acquire video signals has changed to a medical instrument that does not need to acquire video signals, and to send the first exit conference instruction to the video signal acquisition device connected to the medical instrument that has changed to not need to acquire video signals. The exit module is also used to exit the telemedicine conference for the corresponding signal source identity when the video signal acquisition device receives a first exit conference instruction from the medical video conferencing agent device.

16. The system according to any one of claims 10 to 15, characterized in that, The medical video conferencing proxy device is equipped with a camera and a microphone, and the medical video conferencing proxy device also includes: The second acquisition and encoding module is used to encode the video signal of the medical treatment site acquired by the camera and microphone to obtain a medical treatment site video encoding signal. The second publishing module is used to publish the medical treatment site video encoding signal obtained by the second acquisition and encoding module together with the medical video agent device identifier to the remote medical conference; And the first display module includes: The sixth submodule is used to decode the medical treatment site video encoding signals with the same medical video agent device identifier and each video encoding signal published to the telemedicine conference to obtain each video signal; The seventh submodule is used to display the video signals obtained by the sixth submodule as video signals published by the medical video proxy device in the publishing window of the medical video proxy device in an equally divided window layout. Alternatively, the first display module includes: The eighth submodule is used to decode the medical treatment scene video signal published to the telemedicine conference and display the decoded medical treatment scene video signal in the medical treatment scene window; wherein, the medical treatment scene window is independent of the medical video conferencing agent device publishing window.

17. The system according to any one of claims 10 to 15, characterized in that, The medical video conferencing device also includes: The second display module is used to decode each video encoded signal with the same medical video proxy device identifier published to the telemedicine conference, and display each video signal in the local medical video proxy device publishing window according to the window division layout.

18. A computer-readable storage medium storing a computer program for performing the method of any one of claims 1-10.

19. An electronic device, the electronic device comprising: processor; Memory used to store the processor's executable instructions; The processor is configured to read the executable instructions from the memory and execute the instructions to implement the method of any one of claims 1-10.

Images