Video acquisition fusion video phone method, device and electronic equipment based on IMS

Abstract

The present application provides a video acquisition fusion video phone method, device and electronic device based on IMS, the method is executed by a proxy device, including: in response to the proxy device receiving the first video data uploaded by the first electronic device, a video phone request is initiated to the first mobile device through the operator network; in response to the first mobile device responding to the video phone request, a communication path is established between the second mobile device and the first mobile device based on the operator network; the first video data is converted into the first virtual video data output by the virtual camera, and the first virtual video data is transmitted to the first mobile device through the communication path, so that the first virtual video data is displayed on the display screen of the first mobile device; wherein the first electronic device is set locally; the first mobile device uses a 4G and above smartphone, and no third-party application is installed. In this way, the efficiency and effect of remote video calls can be improved.

Description

Technical Field

[0001] The present application relates to the field of video telephony technology, and in particular to an IMS-based video acquisition and fusion video telephony method, device, and electronic equipment. Background Art

[0002] With the continuous development of medical technology and the increasing popularity of communication technology, medical remote consultation, as a convenient and efficient medical service model, is being adopted by more and more doctors and patients. In the process of remote consultation, in order to enable remote experts to obtain key information such as medical images or videos collected locally for accurate diagnosis and treatment recommendations, the method usually adopted is that the local doctor establishes a connection with the mobile device of the remote expert, and the local doctor uses the rear camera of the mobile phone to shoot the computer monitor.

[0003] However, this method has many obvious flaws. First, the clarity of the outpatient computer screen that the expert sees on the mobile phone is often very poor, which seriously affects the expert's accurate judgment of the details of the condition. Secondly, since the local doctor uses a handheld phone to shoot, the picture will inevitably shake, further reducing the quality and readability of the image or video. In addition, in order to receive and view the content shot locally, the remote expert also needs to download and install a third-party application on the mobile phone. This process is not only cumbersome and complicated, but may also involve issues such as application compatibility and security, which brings great inconvenience to the remote expert and affects the efficiency and effectiveness of remote consultation to a certain extent. Summary of the invention

[0004] The present application provides a video acquisition fusion video phone method, device and electronic device based on IMS to at least solve the above technical problems existing in the prior art.

[0005] According to a first aspect of the present application, a video acquisition and fusion video phone method based on IMS is provided, which is executed by an agent device, and the method includes:

[0006] In response to receiving the first video data uploaded by the first electronic device, initiating a video call request to the first mobile device through the operator network;

[0007] In response to the first mobile device responding to the video phone request, establishing a communication path between the second mobile device and the first mobile device based on the operator network;

[0008] Converting the first video data into first virtual video data output by a virtual camera, and transmitting the first virtual video data to the first mobile device through the communication path, so that the first virtual video data is displayed on a display screen of the first mobile device;

[0009] The first electronic device is locally installed and has no third-party application installed; the proxy device is installed on the second mobile device.

[0010] In the above solution, the first video data is acquired or collected by the first electronic device and displayed on a display screen of the first electronic device;

[0011] The first video data is transmitted from the first electronic device to the proxy device via a video capture card;

[0012] The first electronic device is connected to the video capture card via a first interface; the video capture card is connected to the second mobile device via a second interface.

[0013] In the above solution, the first interface includes one of the following:

[0014] High Definition Multimedia Interface (HDMI), DisplayPort (DP), Digital Visual Interface (DVI), Video Graphics Array (VGA) interface, Serial Digital Interface (SDI), AV Composite Video Interface (AV), Separate Video (S-Video) or color difference component interface.

[0015] In the above solution, after transmitting the first virtual video data to the first mobile device through the communication path, the method further includes:

[0016] In response to the content displayed on the display screen of the first electronic device switching from the first video data to the third video data, receiving the third video data uploaded by the first electronic device;

[0017] The third video data is converted into second virtual video data output by the virtual camera, and the second virtual video data is transmitted to the first mobile device through the communication path, so that the display screen of the first mobile device switches from displaying the first virtual video data to displaying the second virtual video data.

[0018] In the above solution, the communication path between the first mobile device and the operator network is established, and the method further includes:

[0019] confirming whether the video phone capability indication information sent by the first mobile device is received;

[0020] In response to receiving the video phone capability indication information sent by the first mobile device, a communication path is established with the first mobile device based on the operator network; the communication path includes a video communication path.

[0021] In the above scheme, the method further includes:

[0022] In response to receiving the indication information of not having video phone capability sent by the first mobile device, establishing a first communication path with the first mobile device based on the operator network; the first communication path includes an audio communication path;

[0023] and sending a video call text message invitation to the first mobile device; the video call text message invitation carries a link for establishing a video communication path;

[0024] In response to the first mobile device responding to the link of the video communication path, a second communication path is established between the second mobile device and the first mobile device; the second communication path includes the video communication path.

[0025] In the above solution, the step of converting the first video data into first virtual video data output by a virtual camera, and transmitting the virtual video data to the first mobile device through the communication path, further includes:

[0026] The audio collecting device of the second mobile device collects the first audio data, and transmits the first audio data to the first mobile device through the communication path, so that the speaker of the first mobile device outputs the first audio data.

[0027] In the above solution, the step of converting the first video data into first virtual video data output by a virtual camera, and transmitting the virtual video data to the first mobile device through the communication path, further includes:

[0028] receiving second audio data transmitted by the first mobile device based on the communication path, and outputting the second audio data through a speaker of the second mobile device; the second audio data is collected by an audio collection device of the first mobile device;

[0029] The second video data transmitted by the first mobile device is received based on the communication path, and the second video data is output through the display device of the second mobile device; the second video data is collected by the image collection device of the first mobile device.

[0030] According to a second aspect of the present application, there is provided an agent device, the device comprising:

[0031] A call initiating unit, configured to initiate a video call request to the first mobile device through an operator network in response to receiving the first video data uploaded by the first electronic device;

[0032] The call initiating unit is further configured to establish a communication path between the second mobile device and the first mobile device based on the operator network in response to the first mobile device responding to the video call request;

[0033] a video phone unit, configured to convert the first video data into first virtual video data output by a virtual camera, and transmit the first virtual video data to the first mobile device through the communication path, so that the first virtual video data is displayed on a display screen of the first mobile device;

[0034] The first electronic device is locally installed and has no third-party application installed; the proxy device is installed on the second mobile device.

[0035] According to a third aspect of the present application, an electronic device is provided, including:

[0036] at least one processor; and

[0037] a memory communicatively connected to the at least one processor; wherein,

[0038] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the present application.

[0039] The IMS-based video acquisition and fusion video telephone method of the present application, in response to receiving the first video data uploaded by the first electronic device, initiates a video telephone request to the first mobile device through the operator network; in response to the first mobile device responding to the video telephone request, establishes a communication path between the second mobile device and the first mobile device based on the operator network; converts the first video data into first virtual video data output by the virtual camera, and transmits the first virtual video data to the first mobile device through the communication path, so that the first virtual video data is displayed on the display screen of the first mobile device; wherein, the first electronic device is set locally; the first mobile device has no third-party application installed; the proxy device is set on the second mobile device; the first mobile device can establish a communication path with the second mobile device without installing a third-party application, and directly and clearly displays the first video data in the first electronic device on the display screen, which simplifies the process of communication between local and remote experts and improves the efficiency and effect of remote consultation.

[0040] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] By reading the detailed description below with reference to the accompanying drawings, the above and other purposes, features and advantages of the exemplary embodiments of the present application will become readily understood. In the accompanying drawings, several embodiments of the present application are shown in an exemplary and non-limiting manner, wherein:

[0042] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts.

[0043] Figure 1 A first optional flow chart of the IMS-based video acquisition and fusion video phone method provided in an embodiment of the present application is shown;

[0044] Figure 2 A second optional flow chart of the IMS-based video acquisition and fusion video phone method provided in an embodiment of the present application is shown;

[0045] Figure 3 A third optional flow chart of the IMS-based video acquisition and fusion video phone method provided in an embodiment of the present application is shown;

[0046] Figure 4 A schematic diagram showing the structure of the IMS-based video acquisition and fusion video phone method provided in an embodiment of the present application is shown;

[0047] Figure 5 A fourth optional flow chart of the IMS-based video acquisition and fusion video telephony method provided in an embodiment of the present application is shown;

[0048] Figure 6 A fifth optional flow chart of the IMS-based video acquisition and fusion video telephony method provided in an embodiment of the present application is shown;

[0049] Figure 7 An optional structural diagram of an agent device provided in an embodiment of the present application is shown;

[0050] Figure 8 A schematic diagram of the structure of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0051] In order to make the purpose, features, and advantages of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0052] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it can be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0053] In the following description, the terms "first\second" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0054] Unless otherwise defined, all technical and scientific terms used in this application have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used in this application are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0055] It should be understood that in the various embodiments of the present application, the size of the serial number of each implementation process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0056] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0057] 1) Local end of remote consultation (clinical end): refers to the clinical doctor end where the patient is being consulted during the remote consultation.

[0058] 2) Remote consultation expert end (expert end): refers to the doctor expert connected by video call during the remote consultation, who provides auxiliary diagnosis on the clinical side and has rich experience in medical clinical theory and practice.

[0059] The current remote consultation solutions mainly include the following two forms:

[0060] Solution 1: Build a department-specific remote consultation room, dedicated to the clinical and expert ends.

[0061] Clinicians in the outpatient department can connect to the Internet or the hospital intranet through the clinical PC to initiate remote audio and video communication and connect to the expert consultation PC at the remote end. Clinicians need to initiate the communication under the configuration of remote consultation equipment, and the expert needs to provide guidance in a professional remote consultation room.

[0062] Solution 2: The clinician uses third-party applications such as WeChat and DingTalk to directly initiate remote consultations with experts.

[0063] In work practice, cost and convenience are often limiting factors. Frontline hospitals do not have enough money to build telemedicine rooms, but there are many frontline clinicians at the grassroots level who need guidance from experts in their actual work, and experts may not always be in the teleconsultation room. Therefore, the current transition method is for clinicians to initiate video calls through communication tools such as WeChat and DingTalk, establish consultation contacts with experts, and shoot computer monitors through the rear camera to achieve the effect of guidance.

[0064] In the above solution 1, the patient information on the outpatient computer is transmitted in real time through the dedicated network in the hospital, which is clear and stable, and has audio and video recordings for easy retrospection; the clinical end and the expert end communicate in two directions through the headset connected to the PC computer, with clear sound and high consultation efficiency. However, the cost is high, and both the grassroots hospital and the superior hospital need to build an exclusive remote consultation room, which is dedicated to the specific purpose; and the convenience is poor, requiring experts to go to the designated remote consultation room for remote guidance, but in daily work, experts may not always be on duty.

[0065] In the above-mentioned solution 2, the cost is low, and there is no need to set up a professional remote consultation room. Both parties only need to add third-party application friends to initiate a consultation. It is highly convenient, and neither the clinical side nor the expert side needs to be at a designated location. Once the clinical side needs guidance, it only needs to contact the expert side to initiate a WeChat call to achieve a remote consultation. However, through WeChat video calls, the outpatient computer display is photographed with the rear camera. The outpatient computer screen viewed by the expert side on the mobile phone WeChat has poor clarity, and the handheld phone is used to shoot, so there are problems such as picture jitter. When the clinical side communicates with the expert side, voice calls are prone to jamming when the signal is poor. The entire remote consultation process lacks audio and video recording, and once a dispute occurs, it cannot be traced.

[0066] Therefore, in response to the defects in the above-mentioned solutions, the present application provides a video acquisition and fusion video calling method based on IMS, in which the expert side uses a first mobile device of a 4G network or above smartphone, and there is no need to install any third-party application in the first mobile device to make a video call with the clinical side, and the first mobile device of the expert side can directly display the contents of the clinical side computer screen.

[0067] Figure 1A first optional flow chart of the IMS-based video acquisition and fusion video telephony method provided in an embodiment of the present application is shown, and will be explained according to each step.

[0068] Step S101: in response to the proxy device receiving first video data uploaded by the first electronic device, a video call request is initiated to the first mobile device through the operator network.

[0069] In some embodiments, the IMS-based video acquisition fusion video phone method is executed by a proxy device set on a second mobile device; the first electronic device and the second mobile device are connected by wire, the distance between the first electronic device and the second mobile device is less than a certain threshold, or the first electronic device and the second mobile device are in the same space (such as the same room, the same floor or the same building). The first mobile device is a remote device, that is, the distance between it and the first electronic device or the second mobile device exceeds a certain distance. The second mobile device includes but is not limited to laptops, mobile phones, tablets, personal digital assistants (PDAs), and other devices with mobile storage device connection technology (On-The-Go, OTG) technology.

[0070] In some embodiments, the first video data is acquired or collected by the first electronic device, and may be video data corresponding to a medical image, or may be image data displayed on a display screen of the first electronic device, and may be video data obtained by sampling at a certain sampling time. The first electronic device includes but is not limited to personal computers (PC), ultrasound equipment, magnetic resonance imaging (MRI), computed tomography (CT), digital radiography (DR) and other medical devices, and all devices with video image output.

[0071] In some embodiments, the operator network may be an operator IP Multimedia Subsystem (IMS) network; accordingly, the video call may include a VoIMS call such as VoLTE, VoNR, VoWiFi, etc.

[0072] Step S102: in response to the first mobile device responding to the video call request, establishing a communication path between the second mobile device and the first mobile device based on the operator network.

[0073] In some embodiments, the first mobile device responds to the video call request, which may include the first mobile device agreeing to make a video call with the second mobile device; in response to the first mobile device responding to the video call request, a communication path is established between the second mobile device and the first mobile device based on the operator's IMS network.

[0074] In specific implementation, if the first mobile device is a non-IOS system, the first mobile device supports video calls based on the video communication path established by the operator's IMS network, and therefore can directly respond to the video call request; or, if the first mobile device is an IOS system, the first mobile device does not support video calls based on the video communication path established by the operator's IMS network, and therefore can respond to audio call requests and establish video communication with the second mobile device based on a SMS link.

[0075] Step S103: convert the first video data into first virtual video data output by a virtual camera, and transmit the first virtual video data to the first mobile device through the communication path, so that the first virtual video data is displayed on a display screen of the first mobile device.

[0076] In some embodiments, the proxy device converts the first video data into a virtual camera, and transmits the data to the first mobile device through a communication path, so that the first mobile device displays the first video data of the first electronic device.

[0077] In this way, through the IMS-based video capture and fusion video telephone method provided in the embodiment of the present application, the first mobile device does not need to install third-party software, and can make a video call with the second mobile device through the operator network; the first electronic device transmits the first video data to the second mobile device, and converts the first video data into first virtual video data output by the virtual camera, and transmits it to the first mobile device through the communication path supported by the operator network, so that the first mobile device can display the content displayed by the first electronic device, so that the expert can see the video data or image data with a fixed angle and clearness, thereby improving the efficiency and effectiveness of remote consultation or remote conferencing.

[0078] Figure 2 A second optional flow chart of the IMS-based video acquisition and fusion video telephony method provided in an embodiment of the present application is shown, and will be explained according to each step.

[0079] Step S201: a first electronic device acquires or collects first video data.

[0080] In some embodiments, the first electronic device includes but is not limited to: a laptop computer, a desktop computer, a tablet computer, a PC computer, an ultrasound instrument, MR, CT, DR and other medical devices with video image output. The first electronic device can obtain the first video data or image data collected by the second electronic device by downloading or transmitting. The second electronic device can be a laptop computer, a desktop computer or a tablet computer, and can also be a medical imaging device, that is, the second electronic device can be a medical imaging device, and after the medical imaging device obtains the first video data, the first video data is transmitted to the first electronic device; or, the second electronic device can also be a computer, a server, etc., after obtaining the first video data from the medical imaging device, the first video data is transmitted to the first electronic device. When the second electronic device is a computer or a server, it can be set in a separate computer room or cloud, connected to the medical imaging device by wire or wireless means, obtain the first video data directly collected by the medical imaging device, and then transmit the first video data to the first electronic device by wire or wireless means; for example, the doctor's computer in the hospital can directly download the medical image uploaded by the medical imaging device from the cloud server, at this time the cloud server is the second electronic device, and the doctor's computer is the first electronic device. When the second electronic device is a medical imaging device, it can be set in an imaging room or acquisition room of a hospital to acquire medical-related images, such as X-rays, magnetic resonance imaging (MRI), computed tomography (CT) and ultrasound imaging. The second electronic device can be connected to the first electronic device via wired or wireless means to transmit the acquired medical images (first video data) to the first electronic device.

[0081] In other embodiments, the first electronic device may also be a medical imaging device, and the first video data or image data is directly acquired.

[0082] In some optional embodiments, the first electronic device may also be a laptop computer, a desktop computer or a tablet computer, and the first electronic device may obtain the first video data from its own memory or cache.

[0083] In some optional embodiments, after the first electronic device acquires or collects the first video data, the first video data is displayed on a display screen of the first electronic device.

[0084] In some optional embodiments, the second electronic device transmits image data (such as medical imaging data) to the first electronic device in real time, and the first electronic device can also collect or obtain image data in real time and display the image data on the display screen of the first electronic device. The first electronic device samples the content displayed on the display screen of the first electronic device at a certain sampling interval, and converts the sampled image data into video frames in chronological order, and the video data composed of all video frames is the first video data.

[0085] Step S202: the first electronic device transmits the first video data to the second mobile device.

[0086] In some embodiments, the first electronic device is connected to the video capture card through a first interface, and the video capture card is connected to the second mobile device through a second interface; the first interface includes a high-definition multimedia interface, a display port, a digital video interface, a video graphics array interface, a digital component serial interface, a composite video interface, a two-component video interface or a color difference component interface; the second interface includes a Type-C interface.

[0087] The first electronic device first transmits the first video data to the video capture card through the first interface, and the video capture card transmits the first video data to the second mobile device through the second interface.

[0088] In some embodiments, the video capture card is a hardware device independent of the first electronic device and the second mobile device; the proxy device in the second mobile device connects the first video data to the second mobile device through electronic device data exchange technology (OTG), and converts the first video data into a recognizable virtual camera.

[0089] In some embodiments, the first electronic device transmits the first video data in real time. After the second mobile device establishes a communication path with the first mobile device, the second mobile device converts the first video data into a virtual camera and transmits it to the first mobile device through the communication path.

[0090] Step S203: The second mobile device completes the operator network registration process and initiates a video call request to the first mobile device.

[0091] In some embodiments, the second mobile device initiates a registration process with the operator network, completes the registration, and then initiates a video call request to the first mobile device. In the embodiment of the present application, the first mobile device is a non-IOS system terminal and has no third-party applications installed; the third-party applications include but are not limited to WeChat, DingTalk, Tencent Conference, Feishu, Zoom, Skype and other applications that are not installed in the factory settings of the mobile phone.

[0092] Step S204: the first mobile device uploads the video phone capability to the operator network.

[0093] In some embodiments, the first mobile device uploads video calling capability indication information to the operator network, i.e., indication information of whether the first mobile device is capable of making video calls based on the operator network; the operator network sends the video calling capability indication information to the second mobile network. In this scenario, the system of the first mobile device is a non-IOS system, i.e., a system that can support IMS video calls established by the operator network.

[0094] In response to the first mobile device being able to make a video call based on the operator network, the second mobile device waits for the first mobile device to respond to the video call request; or, in response to the first mobile device being unable to make a video call based on the operator network, the operator network sends an alarm message to the second mobile device, indicating that the first mobile device cannot respond to the video call request.

[0095] Step S205: in response to the first mobile device responding to the video call request, establishing a communication path between the second mobile device and the first mobile device based on the operator network.

[0096] In some embodiments, the communication path is a video communication path, that is, the second mobile device and the first mobile device can conduct a video call based on the video communication path.

[0097] In some embodiments, the first mobile device has the capability of making a video call and accepts the video call request, and then responds to the video call request.

[0098] In some embodiments, the communication path is used to transmit data, such as video data and audio data, between the first mobile device and the second mobile device.

[0099] Step S206: The first mobile device makes a video call with the second mobile device.

[0100] In some embodiments, the second mobile device converts the first video data into first virtual video data output by a virtual camera, transmits the first virtual video data to the first mobile device through the communication path, and the first mobile device displays the first virtual video data on a display screen; the second mobile device collects first audio data based on an audio collection device of the second mobile device, and transmits the first audio data to the first mobile device through the communication path; and the speaker of the first mobile device outputs the first audio data.

[0101] In some embodiments, the first mobile device collects second video data based on an image acquisition device, the second mobile device receives the second video data based on the communication path, and outputs the second video data through a display device of the second mobile device; the first mobile device collects second audio data based on an audio acquisition device, the second mobile device receives the second audio data based on the communication path, and outputs the second audio data through a speaker of the second mobile device.

[0102] In some optional embodiments, the second mobile device stores the first virtual video data, the first audio data, the second video data and the second audio data.

[0103] Step S207, updating the first video data.

[0104] In some embodiments, the content displayed on the display screen of the first electronic device is not fixed, and the content displayed on the display screen may be updated according to the needs of the expert; in response to the content displayed on the display screen of the first electronic device switching from the first video data to the third video data, the third video data uploaded by the first electronic device is received; the third video data is converted into the second virtual video data output by the virtual camera, and the second virtual video data is transmitted to the first mobile device through the communication path, so that the display screen of the first mobile device switches from displaying the first virtual video data to displaying the second virtual video data. The third video data is video data with the same or different content as the first video data, and its playback time is after the playback time of the first video data; for example, the third video data may be video data played after the first video data; since the content displayed on the first electronic device may be updated, after the content is updated (from the first video data to the third video data), the first electronic device uploads the third video data to the second mobile device.

[0105] In this way, through the IMS-based video capture and video telephone method provided in the embodiment of the present application, there is no need to set up a professional remote consultation room. Only a video capture card and a second mobile device equipped with a proxy device need to be prepared to enable all hospital departments to achieve the ability of remote consultation; it is highly convenient. The clinical end only needs to make a video call to the non-IOS expert end through the second mobile device. The expert end does not need to install WeChat or other third-party applications. The IMS-based video phone can be used to achieve real-time transmission of outpatient computers, voice communication between the two parties, and real-time remote consultation without application installation; it is highly reliable. The real-time transmission of images from outpatient computers is clear and stable, and there is audio and video recording for easy retrospection; the expert end can answer the video call with one click, the quality is stable and reliable, and compared with third-party applications, it will not be interrupted by calls or other interference.

[0106] Figure 3A third optional flow chart of the IMS-based video acquisition and fusion video telephony method provided in an embodiment of the present application is shown, and will be explained according to each step.

[0107] Step S301: a first electronic device acquires or collects first video data.

[0108] The specific steps of step S301 are the same as those of step S201 and will not be repeated here.

[0109] Step S302: the first electronic device transmits the first video data to the second mobile device.

[0110] The specific step flow of step S302 is the same as that of step S202 and will not be repeated here.

[0111] Step S303: The second mobile device completes the operator network registration process and initiates a video call request to the first mobile device.

[0112] In some embodiments, the second mobile device initiates a registration process with the operator network, completes the registration, and then initiates a video call request to the first mobile device. In the embodiment of the present application, the first mobile device is an IOS system terminal, and no third-party applications are installed; the third-party applications include but are not limited to WeChat, DingTalk, Tencent Conference, Feishu, Zoom, Skype and other applications that are not installed in the factory settings of the mobile phone.

[0113] Step S304: the first mobile device uploads the video phone capability to the operator network.

[0114] In some embodiments, the first mobile device uploads information indicating that it has video calling capability to the operator network, i.e., information indicating whether the first mobile device has the ability to make video calls based on the operator network; the operator network sends the information indicating that it has video calling capability to the second mobile network. In this scenario, the system of the first mobile device is an IOS system, i.e., a system that cannot support IMS video calls established by the operator network, then the first mobile device uploads information indicating that it does not have video calling capability to the operator network.

[0115] Step S305: in response to the audio call request of the first mobile device, a first communication path is established between the second mobile device and the first mobile device based on the operator network.

[0116] In some embodiments, since mobile devices of the IOS system cannot support IMS video calls and only support IMS audio calls, in response to receiving an indication message sent by the first mobile device that it does not have video calling capabilities, a first communication path is established between the first mobile device and the second mobile device, and the first communication path refers to an audio communication path.

[0117] In some embodiments, the first electronic device sends a video call text message invitation to a first mobile device; the video call text message invitation carries a link for establishing a video communication path; in response to the first mobile device responding to the link of the video communication path (i.e., an expert of the first mobile device clicks on the link), a second communication path is established between the second mobile device and the first mobile device; the second communication path includes a video communication path.

[0118] Step S306: The first mobile device makes a video call with the second mobile device.

[0119] In some embodiments, the second mobile device converts the first video data into first virtual video data output by a virtual camera, transmits the first virtual video data to the first mobile device through the second communication path, and the first mobile device displays the first virtual video data on a display screen; the second mobile device collects first audio data based on an audio collection device of the second mobile device, and transmits the first audio data to the first mobile device through the first communication path; and the speaker of the first mobile device outputs the first audio data.

[0120] In some embodiments, the first mobile device collects second video data based on an image acquisition device, the second mobile device receives the second video data based on the second communication path, and outputs the second video data through a display device of the second mobile device; the first mobile device collects second audio data based on an audio acquisition device, the second mobile device receives the second audio data based on the first communication path, and outputs the second audio data through a speaker of the second mobile device.

[0121] In some optional embodiments, the second mobile device stores the first virtual video data, the first audio data, the second video data and the second audio data.

[0122] Step S307, updating the first video data.

[0123] In some embodiments, the content displayed on the display screen of the first electronic device is not fixed and may be updated according to the needs of experts; in response to the content displayed on the display screen of the first electronic device switching from the first video data to the third video data, the third video data uploaded by the first electronic device is received; the third video data is converted into second virtual video data output by the virtual camera, and the second virtual video data is transmitted to the first mobile device through the second communication path, so that the display screen of the first mobile device switches from displaying the first virtual video data to displaying the second virtual video data.

[0124] In this way, through the IMS-based video capture and video telephone method provided in the embodiment of the present application, there is no need to set up a professional remote consultation room. Only a video capture card and a second mobile device equipped with a proxy device need to be prepared to enable all hospital departments to achieve the ability of remote consultation; it is highly convenient. The clinical end only needs to make a video call to the IOS expert end through the second mobile device. The expert end does not need to install WeChat or other third-party applications. The application can be installed without the need to install an IMS-based audio phone and establish a video call between the clinical end and the expert end through a text message link, thereby realizing real-time transmission of outpatient computers, voice communication between the two parties, and real-time remote consultation; it is highly reliable. The real-time transmission of images from outpatient computers is clear and stable, and there is audio and video recording for easy retrospection; the expert end can answer the video call with one click, and the quality is stable and reliable. Compared with third-party applications, it will not be interrupted by calls or other interferences.

[0125] Figure 4 A structural schematic diagram of the IMS-based video acquisition and fusion video telephony method provided in an embodiment of the present application is shown.

[0126] Outpatient computers or other video image output devices at the clinical end (i.e., clinical end): refers to all devices (which can be computers, CT instruments, monitors, televisions, etc.) that support interfaces including: High Definition Multimedia Interface, DisplayPort digital video interface, DVI digital video interface, video graphics array interface, digital component serial interface, composite video interface, two-component video interface, color difference component interface, etc.

[0127] Video capture card: refers to a video capture card that supports converting various video image output interfaces into video capture cards that can be accessed through the Type C interface and OTG technology; the video capture card is compatible with the second mobile device.

[0128] The second mobile device can be a customized work mobile phone, including a proxy device, which realizes the real-time acquisition of video acquisition data by the video capture card through OTG technology, synchronizes it to the proxy device, and then converts it into a virtual camera recognizable by the program. When a video call is initiated in the video call program corresponding to the customized work mobile phone, the camera screen of the original mobile phone can be changed to a universal video dynamic image.

[0129] The customized work phone also includes a video phone program, which is used to support VoLTE, VoNR, VoWiFi and other user mobile phone video calls based on the IMS network and the use of VoIMS technology, with high-quality transmission of audio and video, and a good user experience.

[0130] Operator IMS network: refers to the IMS network established by the three major domestic operators that supports 4G and 5G, and supports high-definition video phone capabilities such as VoLTE, VoNR, and VoWiFi.

[0131] Expert mobile phone (i.e. expert terminal): refers to a smartphone that supports 4G network and above and is used by the expert terminal without the need to install other third-party applications.

[0132] Figure 5 A fourth optional flow chart of the IMS-based video acquisition and fusion video telephony method provided in an embodiment of the present application is shown.

[0133] The embodiment of the present application utilizes the IMS network established by domestic communication operators to support the capabilities of video calls such as VoLTE high-definition calls and VoNR ultra-high-definition calls. The video capture card obtains the first video data output by the first interface (video image output interface) of the first electronic device, realizes real-time video capture and data synchronization through OTG technology, converts the first video data into OTG video data, and sends it to the second mobile device. The agent device in the second mobile device converts the first video data into a virtual camera that can be recognized by the program. Then, the basic IMS registration process is completed by customizing the video phone program installed in the work mobile phone, and an IMS video phone call is initiated to establish an IMS call (including VoLTE, VoNR, VoWiFi and other VoIMS calls). The virtual camera screen sent by the video phone program installed in the custom work mobile phone can transmit the real-time image to the expert's personal mobile phone, making remote consultation convenient, efficient and lower cost. The video capture card is matched with the second mobile device. The video image output interfaces include: HDMI high-definition multimedia interface, DisplayPort digital video interface, DVI digital video interface, VGA video graphics array interface, SDI digital component serial interface, AV composite video interface, S-Video two-component video interface, color difference component interface and other interfaces with video image output.

[0134] The specific process includes:

[0135] The outpatient computer or other image output device transmits the first video data to the video capture card through the first interface. The outpatient computer or other image output device refers to all devices (which may be computers, CT instruments, monitors, televisions, etc.) that support interfaces including: high-definition multimedia interface, DisplayPort digital video interface, DVI digital video interface, video graphics array interface, digital component serial interface, composite video interface, two-component video interface, color difference component interface, etc.

[0136] By customizing the matching video capture card of the working mobile phone (i.e. video capture card), the customized working mobile phone or tablet (second mobile device) is connected with the Type C interface, supporting OTG technology (electronic device data exchange technology) to realize video data communication.

[0137] The proxy device in the customized work mobile phone and the video capture card realize real-time video capture data synchronization through OTG technology.

[0138] The proxy device in the customized work mobile phone and the video phone program corresponding to the customized work mobile phone realize the conversion of OTG video data in the system to the virtual camera.

[0139] The video phone program corresponding to the customized work mobile phone completes the operator's IMS network registration process and initiates a video call request to the first mobile device.

[0140] The expert end (the first mobile device) determines through negotiation whether it supports video calls, and reports the video call capabilities of the expert end to the operator's IMS network;

[0141] The customized work mobile phone receives the video phone capability of the expert end sent by the operator's IMS network. After the proxy device confirms the video phone capability of the expert end, the video phone between the proxy device and the expert end is realized under the IMS network.

[0142] Finally, the remote consultation video call between the clinical end and the expert end is completed; the speaker of the customized work mobile phone receives and plays the audio collected by the expert end microphone; the display screen of the customized work mobile phone receives and displays the video collected by the expert end camera; the expert end speaker receives and plays the audio data collected by the customized work mobile phone microphone; the expert end display screen receives and displays the video data of the virtual camera of the customized work mobile phone.

[0143] In this way, through the IMS-based video capture and video telephone method provided in the embodiment of the present application, there is no need to set up a professional remote consultation room. Only a video capture card and a second mobile device equipped with a proxy device need to be prepared to enable all hospital departments to achieve the ability of remote consultation; it is highly convenient. The clinical end only needs to make a video call to the expert end through the second mobile device. The expert end does not need to install WeChat or other third-party applications. The IMS-based video phone can be used to achieve real-time transmission of outpatient computers, voice communication between the two parties, and real-time remote consultation without application installation; it is highly reliable. The real-time transmission of images from outpatient computers is clear and stable, and there is audio and video recording for easy retrospection; the expert end can answer the video call with one click, the quality is stable and reliable, and compared with third-party applications, it will not be interrupted by calls or other interferences.

[0144] Figure 6 A fifth optional flow chart of the IMS-based video acquisition and fusion video telephony method provided in an embodiment of the present application is shown.

[0145] The embodiment of the present application utilizes the IMS network established by domestic communication operators to support the capabilities of video calls such as VoLTE high-definition calls and VoNR ultra-high-definition calls. The video capture card obtains the first video data output by the first interface (video image output interface) of the first electronic device, realizes real-time video capture and data synchronization through OTG technology, converts the first video data into OTG video data, and sends it to the second mobile device. The agent device in the second mobile device converts the first video data into a virtual camera that can be recognized by the program. Then, the basic IMS registration process is completed by customizing the video phone program installed in the work mobile phone, and an IMS phone call is initiated to establish an IMS call. A video call invitation is initiated through the video phone platform. After the expert responds, the virtual camera screen sent by the video phone platform can transmit the real-time image to the expert's personal mobile phone, making remote consultation convenient and efficient, lower cost and supporting the expert's iPhone. The video capture card is matched with the second mobile device. The video image output interfaces include: HDMI high-definition multimedia interface, DisplayPort digital video interface, DVI digital video interface, VGA video graphics array interface, SDI digital component serial interface, AV composite video interface, S-Video two-component video interface, color difference component interface and other interfaces with video image output.

[0146] The specific process includes:

[0147] The outpatient computer or other image output device transmits the first video data to the video capture card through the first interface. The outpatient computer or other image output device refers to all devices (which may be computers, CT instruments, monitors, televisions, etc.) that support interfaces including: high-definition multimedia interface, DisplayPort digital video interface, DVI digital video interface, video graphics array interface, digital component serial interface, composite video interface, two-component video interface, color difference component interface, etc.

[0148] Through the matching video capture card (i.e. video capture card), the customized work mobile phone (second mobile device) is connected to the Type C interface, supporting OTG technology (electronic device data exchange technology) to realize video data communication.

[0149] The proxy device in the customized work mobile phone and the video capture card realize real-time video capture data synchronization through OTG technology.

[0150] The proxy device in the customized work mobile phone and the video phone program corresponding to the customized work mobile phone realize the conversion of OTG video data in the system to the virtual camera.

[0151] The video phone program corresponding to the customized work mobile phone completes the operator's IMS network registration process and initiates a video call request to the first mobile device.

[0152] The expert end (the first mobile device) determines through negotiation whether it supports video calls, and reports the video call capabilities of the expert end to the operator's IMS network;

[0153] The customized work mobile phone receives the video call capability of the expert end sent by the operator's IMS network. After the agent device confirms that the expert end does not have the video call capability, the agent device and the expert end can make an audio call under the IMS network.

[0154] Then, the video call program corresponding to the customized work phone initiates a video call SMS invitation, and the expert's mobile phone receives the SMS. The expert clicks the SMS link to complete the video call process and transmit the video screen of the virtual camera to the expert's iPhone.

[0155] Finally, the remote consultation video call between the clinical end and the expert end is completed; the speaker of the customized work mobile phone receives and plays the audio collected by the expert end microphone; the display screen of the customized work mobile phone receives and displays the video collected by the expert end camera; the expert end speaker receives and plays the audio data collected by the customized work mobile phone microphone; the expert end display screen receives and displays the video data of the virtual camera of the customized work mobile phone.

[0156] In this way, through the IMS-based video capture and video telephone method provided in the embodiment of the present application, there is no need to set up a professional remote consultation room. Only a video capture card and a second mobile device equipped with a proxy device need to be prepared to enable all hospital departments to achieve the ability of remote consultation; it is highly convenient. The clinical end only needs to make a video call to the expert end through the second mobile device. The expert end iPhone does not need to install WeChat or other third-party applications. The IMS-based video phone can be used to achieve real-time transmission of the outpatient computer, voice communication between the two parties, and real-time remote consultation without application installation; it is highly reliable. The real-time transmission of the images of the outpatient computer is clear and stable, and there is audio and video recording for easy backtracking; the expert end can answer the video call with one click, the quality is stable and reliable, and compared with third-party applications, it will not be interrupted by the phone and will not be affected by other interferences.

[0157] Figure 7 An optional structural diagram of an agent device provided in an embodiment of the present application is shown, and will be described according to each part.

[0158] In some embodiments, the proxy device 700 includes a call initiating unit 701 and a video phone unit 702 .

[0159] A call initiating unit 701 is configured to initiate a video call request to the first mobile device through an operator network in response to receiving first video data uploaded by the first electronic device;

[0160] The call initiating unit 701 is further configured to establish a communication path between the second mobile device and the first mobile device based on the operator network in response to the first mobile device responding to the video call request;

[0161] The video phone unit 702 is used to convert the first video data into first virtual video data output by the virtual camera, and transmit the first virtual video data to the first mobile device through the communication path, so that the first virtual video data is displayed on the display screen of the first mobile device;

[0162] Among them, the first electronic device is set locally; the first mobile device uses a smart phone that supports 4G network and above, and no third-party applications are installed. Third-party applications include but are not limited to WeChat, DingTalk, Tencent Conference, Feishu, Zoom, Skype and other applications that are not installed in the factory settings of the mobile phone; the proxy device is set on the second mobile device.

[0163] In some embodiments, the first video data is acquired or collected by the first electronic device and displayed on a display screen of the first electronic device;

[0164] The first video data is transmitted from the first electronic device to the proxy device via a video capture card;

[0165] The first electronic device is connected to the video capture card via a first interface; the video card is connected to the second mobile device via a second interface.

[0166] In some embodiments, the first interface includes one of the following:

[0167] High-Definition Multimedia Interface, DisplayPort, Digital Video Interface, Video Graphics Array Interface, Digital Component Serial Interface, Composite Video Interface, Two-Component Video Interface, or Color Difference Component Interface.

[0168] The call initiating unit 701, after transmitting the first virtual video data to the first mobile device through the communication path, is further configured to receive the third video data uploaded by the first electronic device in response to the content displayed on the display screen of the first electronic device switching from the first video data to the third video data;

[0169] The third video data is converted into second virtual video data output by the virtual camera, and the second virtual video data is transmitted to the first mobile device through the communication path, so that the display screen of the first mobile device switches from displaying the first virtual video data to displaying the second virtual video data.

[0170] The call initiating unit 701 is specifically used to confirm whether to receive the video phone capability indication information sent by the first mobile device;

[0171] In response to receiving the video phone capability indication information sent by the first mobile device, a communication path is established with the first mobile device based on the operator network.

[0172] The video phone unit 702 is specifically used to collect first audio data based on the audio collection device of the second mobile device, and transmit the first audio data to the first mobile device through the communication path; so that the speaker of the first mobile device outputs the first audio data.

[0173] The video phone unit 702 is specifically configured to receive second audio data transmitted by the first mobile device based on the communication path, and output the second audio data through a speaker of the second mobile device; the second audio data is collected by an audio collection device of the first mobile device;

[0174] The second video data transmitted by the first mobile device is received based on the communication path, and the second video data is output through the display device of the second mobile device; the second video data is collected by the image collection device of the first mobile device.

[0175] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.

[0176] Figure 8 A schematic block diagram of an example electronic device 800 that can be used to implement an embodiment of the present application is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0177] like Figure 8 As shown, the electronic device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 to a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the electronic device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0178] Multiple components in the electronic device 800 are connected to the I / O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the electronic device 800 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0179] The computing unit 801 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above, such as the video acquisition fusion video phone method based on IMS. For example, in some embodiments, the video acquisition fusion video phone method based on IMS may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the video acquisition fusion video phone method based on IMS described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to execute the IMS-based video acquisition fusion video phone method in any other appropriate manner (for example, by means of firmware).

[0180] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0181] The program code for implementing the method of the present application can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, implements the functions / operations specified in the flow chart and / or block diagram. The program code can be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0182] In the context of the present application, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0183] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0184] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0185] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0186] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution disclosed in this application can be achieved, and this document is not limited here.

[0187] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0188] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A video acquisition and fusion video phone method based on IMS, characterized in that: The method is performed by an agent device, and the method includes: In response to the proxy device receiving the first video data uploaded by the first electronic device, a video call request is initiated to the first mobile device through the operator network; wherein the first video data is content displayed on the display screen of the first electronic device, the first video data is obtained or collected by the first electronic device, and the first electronic device is a medical device with video image output; In response to the first mobile device responding to the video phone request, establishing a communication path between the second mobile device and the first mobile device based on the operator network; Converting the first video data into first virtual video data output by a virtual camera, and transmitting the first virtual video data to the first mobile device through the communication path, so that the first virtual video data is displayed on a display screen of the first mobile device; In response to the content displayed on the display screen of the first electronic device switching from the first video data to the third video data, receiving the third video data uploaded by the first electronic device; Converting the third video data into second virtual video data output by the virtual camera, and transmitting the second virtual video data to the first mobile device through the communication path, so that the display screen of the first mobile device switches from displaying the first virtual video data to displaying the second virtual video data; The establishing of a communication path between the second mobile device and the first mobile device based on the operator network includes: confirming whether the video phone capability indication information sent by the first mobile device is received; In response to receiving the video phone capability indication information sent by the first mobile device, establishing a communication path with the first mobile device based on the operator network; the communication path includes a video communication path; In response to receiving the indication information of not having video phone capability sent by the first mobile device, establishing a first communication path with the first mobile device based on the operator network; the first communication path includes an audio communication path; and sending a video call text message invitation to the first mobile device; the video call text message invitation carries a link for establishing a video communication path; In response to the first mobile device responding to the link of the video communication path, a second communication path between the second mobile device and the first mobile device is established; the second communication path includes a video communication path; The first electronic device is locally set and has no third-party application installed; the proxy device is set on the second mobile device; and the first mobile device has no third-party application installed.

2. The method according to claim 1, characterized in that The first video data is transmitted from the first electronic device to the proxy device via a video capture card; The first electronic device is connected to the video capture card via a first interface; the video capture card is connected to the second mobile device via a second interface.

3. The method according to claim 2, characterized in that The first interface includes one of the following: High-definition multimedia interface HDMI, display port DP, digital video interface DVI, video graphics array interface VGA, digital component serial interface SDI, composite video interface AV, two-component video interface S-Video or color difference component interface.

4. The method according to claim 1, characterized in that: The converting the first video data into first virtual video data output by a virtual camera, and transmitting the virtual video data to the first mobile device through the communication path, further includes: The audio collecting device of the second mobile device collects the first audio data, and transmits the first audio data to the first mobile device through the communication path, so that the speaker of the first mobile device outputs the first audio data.

5. The method according to claim 1, characterized in that The converting the first video data into first virtual video data output by a virtual camera, and transmitting the virtual video data to the first mobile device through the communication path, further includes: receiving second audio data transmitted by the first mobile device based on the communication path, and outputting the second audio data through a speaker of the second mobile device; the second audio data is collected by an audio collection device of the first mobile device; The second video data transmitted by the first mobile device is received based on the communication path, and the second video data is output through the display device of the second mobile device; the second video data is collected by the image collection device of the first mobile device.

6. A proxy device, characterized in that: The device comprises: a call initiating unit, configured to initiate a video call request to the first mobile device through the operator network in response to receiving first video data uploaded by the first electronic device; wherein the first video data is content displayed on a display screen of the first electronic device, the first video data is acquired or collected by the first electronic device, and the first electronic device is a medical device with video image output; The call initiating unit is further configured to establish a communication path between the second mobile device and the first mobile device based on the operator network in response to the first mobile device responding to the video call request; The video phone unit is used to convert the first video data into first virtual video data output by the virtual camera, and transmit the first virtual video data to the first mobile device through the communication path, so that the first virtual video data is displayed on the display screen of the first mobile device; and is also used to receive the third video data uploaded by the first electronic device in response to the content displayed on the display screen of the first electronic device switching from the first video data to the third video data; convert the third video data into second virtual video data output by the virtual camera, and transmit the second virtual video data to the first mobile device through the communication path, so that the display screen of the first mobile device switches from displaying the first virtual video data to displaying the second virtual video data; The establishing of a communication path between the second mobile device and the first mobile device based on the operator network includes: confirming whether the video phone capability indication information sent by the first mobile device is received; In response to receiving the video phone capability indication information sent by the first mobile device, establishing a communication path with the first mobile device based on the operator network; the communication path includes a video communication path; In response to receiving the indication information of not having video phone capability sent by the first mobile device, establishing a first communication path with the first mobile device based on the operator network; the first communication path includes an audio communication path; and sending a video call text message invitation to the first mobile device; the video call text message invitation carries a link for establishing a video communication path; In response to the first mobile device responding to the link of the video communication path, a second communication path between the second mobile device and the first mobile device is established; the second communication path includes a video communication path; The first electronic device is locally set and has no third-party application installed; the proxy device is set on the second mobile device; and the first mobile device has no third-party application installed.

7. An electronic device, characterized in that: include: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method according to any one of claims 1 to 5.

Images