Video consultation method and device with multiple data streams isolated, and electronic equipment

Abstract

The invention provides a multi-data-stream isolated video consultation method and device, electronic equipment, client handheld equipment, health consultation equipment, a cloud server and a consultation workbench. Wherein the cloud server comprises a long connection link, a real-time communication link and a short connection link which are mutually independent; the client handheld device establishes connection with the health consultation device through the health consultation device identification information, and the client handheld device establishes connection with the cloud server based on a short connection link; the consultation workbench establishes connection with the cloud server based on the long connection link and the real-time communication link; and the health consultation equipment establishes connection with the cloud server based on the long connection link, the real-time communication link and the short connection link. According to the invention, a three-link cooperation mechanism is fused, and stability and high flexibility of playing local media content and video consultation are realized.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a video consultation method, device and electronic equipment for isolating multiple data streams. Background Art

[0002] In public health service places such as health huts or health stations, in order to improve the public's health consultation experience and efficiency, a video consultation system based on independent Android devices is currently widely used. These devices are usually equipped with large screens (24 inches and above) and high-definition cameras, aiming to provide users with intuitive and convenient remote consultation services. However, in actual application, the existing system has exposed a series of problems that need to be solved, which are specifically reflected in the following aspects:

[0003] (1) When the device is idle, that is, when no video consultation is being conducted, its large screen resources are often idle and not effectively utilized. For example, it is not possible to automatically play health education videos or promotional materials, thus missing out on the opportunity to convey health knowledge to the public.

[0004] (2) When playing online videos, existing consulting equipment has high requirements for network bandwidth, which limits the length and clarity of video content and affects the user's viewing experience. This problem is particularly prominent in areas with poor network conditions.

[0005] (3) The current consulting system lacks an effective real-time monitoring mechanism for network status. Once a problem occurs in the network connection of the device during the consultation process, it will directly affect the continuity and quality of the consulting service, causing inconvenience to users and seriously damaging the service experience.

[0006] (4) During the consultation process, users often need to show the doctor the test reports or examination documents saved in their mobile phones. However, existing consultation devices often do not support the function of directly transferring files from the user's mobile phone, which limits the integrity of the consultation information and affects the accuracy of the diagnosis and the effectiveness of the consultation.

[0007] Therefore, a video consultation method, device and electronic device for isolating multiple data streams are proposed. Summary of the invention

[0008] The present specification provides a video consultation method, device and electronic device with multiple data stream isolation, which integrates a three-link collaboration mechanism to achieve stability and high flexibility in playing local media content and video consultation.

[0009] This specification provides a video consultation method with multiple data stream isolation, including: a client handheld device, a health consultation device, a cloud server, and a consultation workbench; wherein the cloud server includes independent long connection links, real-time communication links, and short connection links;

[0010] The client handheld device establishes a connection with the health consulting device through the health consulting device identification information, and the client handheld device establishes a connection with the cloud server based on the short connection link;

[0011] The consulting workstation establishes a connection with the cloud server based on the long connection link and the real-time communication link;

[0012] The health consultation device establishes a connection with the cloud server based on the long connection link, the real-time communication link, and the short connection link.

[0013] Optional, including:

[0014] The client starts the client handheld device, and the client handheld device establishes the short connection link connection with the cloud server through the health consultation device identification information;

[0015] The cloud server controls the health consultation device to display a health consultation page through the long connection link;

[0016] The client establishes the real-time communication link connection with the consultation workstation through the health consultation page to realize video call consultation, and sends health consultation related materials to the consultation workstation through the client's handheld device based on the short connection link.

[0017] Optionally, the client handheld device establishes the short connection link connection with the cloud server through the health consultation device identification information, including:

[0018] The client handheld device scans the health consultation device identification information set on the health consultation device to establish the short connection link connection with the cloud server;

[0019] or,

[0020] The health consultation device identification information is manually inputted through the client handheld device to establish the short connection link connection with the cloud server.

[0021] Optionally, the cloud server controls the health consultation device to display a health consultation page through the long connection link, including:

[0022] The cloud server controls the health consultation device through the long connection link to interrupt the playing of local media information and display the health consultation page.

[0023] Optionally, also include:

[0024] The health consultation device periodically sends a status report to the cloud server based on the long connection link.

[0025] Optionally, after the health consultation device sends a status report to the cloud server based on the long connection link at a set time, it includes:

[0026] When the health consultation device fails to send the status report to the cloud server according to the set time, the cloud server closes the current long connection link and re-establishes the long connection link with the health consultation device.

[0027] Optionally, before the cloud server controls the health consultation device to interrupt playing the local media information through the long connection link, the process includes:

[0028] Starting the health consultation device, wherein the health consultation device sends an https request to the cloud server based on the short connection link;

[0029] The cloud server returns the application version number and the file URL to the health consultation device based on the https request;

[0030] The health consultation device determines whether the current application version number is consistent with the returned application version number;

[0031] When the health consulting device determines that the current application version number is inconsistent with the returned application version number, the health consulting device downloads the application update file based on the file URL to complete the version upgrade.

[0032] This specification provides a video consultation device for isolating multiple data streams, including:

[0033] Customer handheld device, health consultation device, cloud server, consultation workbench; wherein the cloud server includes independent long connection links, real-time communication links and short connection links;

[0034] A first data flow isolation module is used for the client handheld device to establish a connection with the health consulting device through the health consulting device identification information, and the client handheld device to establish a connection with the cloud server based on the short connection link;

[0035] A second data flow isolation module is used for establishing a second connection between the consulting workstation and the cloud server based on the long connection link and the real-time communication link;

[0036] The third data flow isolation module is used for the health consultation device to establish a connection with the cloud server based on the long connection link, the real-time communication link, and the short connection link.

[0037] Optional, including:

[0038] The client starts the client handheld device, and the client handheld device establishes the short connection link connection with the cloud server through the health consultation device identification information;

[0039] The cloud server controls the health consultation device to display a health consultation page through the long connection link;

[0040] The client establishes the real-time communication link connection with the consultation workstation through the health consultation page to realize video call consultation, and sends health consultation related materials to the consultation workstation through the client's handheld device based on the short connection link.

[0041] Optionally, the first data flow isolation module includes:

[0042] The client handheld device scans the health consultation device identification information set on the health consultation device to establish the short connection link connection with the cloud server;

[0043] or,

[0044] The health consultation device identification information is manually inputted through the client handheld device to establish the short connection link connection with the cloud server.

[0045] Optionally, the cloud server controls the health consultation device to display a health consultation page through the long connection link, including:

[0046] The cloud server controls the health consultation device through the long connection link to interrupt the playing of local media information and display the health consultation page.

[0047] Optionally, also include:

[0048] The health consultation device periodically sends a status report to the cloud server based on the long connection link.

[0049] Optionally, after the health consultation device sends a status report to the cloud server based on the long connection link at a set time, it includes:

[0050] When the health consultation device fails to send the status report to the cloud server according to the set time, the cloud server closes the current long connection link and re-establishes the long connection link with the health consultation device.

[0051] Optionally, before the cloud server controls the health consultation device to interrupt playing the local media information through the long connection link, the process includes:

[0052] Starting the health consultation device, wherein the health consultation device sends an https request to the cloud server based on the short connection link;

[0053] The cloud server returns the application version number and the file URL to the health consultation device based on the https request;

[0054] The health consultation device determines whether the current application version number is consistent with the returned application version number;

[0055] When the health consulting device determines that the current application version number is inconsistent with the returned application version number, the health consulting device downloads the application update file based on the file URL to complete the version upgrade.

[0056] This specification also provides an electronic device, wherein the electronic device includes:

[0057] processor; and,

[0058] A memory storing computer executable instructions, which when executed cause the processor to perform any of the above methods.

[0059] The present specification also provides a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, any of the above methods is implemented.

[0060] In the present invention, the long connection link, real-time communication link and short connection link of the cloud server are utilized, which can not only display high-quality local media content in full screen when the device is idle, making full use of the advantages of large-screen devices, but also switch to the video consultation call mode immediately through independent control signals and heartbeat links when needed, ensuring seamless conversion. In addition, independent content and user interaction links allow customers to seamlessly send inspection / test reports saved in their mobile phones to the consultation workbench through mobile phone applets, improving the user experience. At the same time, the device side regularly sends status reports through independent control signals and heartbeat links to ensure timely updates of the device's networking status, and avoids misoperation and malicious harassment through independent background control links and independent user interaction links, thereby protecting user privacy and device security to the greatest extent possible. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0062] Figure 1A schematic diagram of the principle of a video consultation system with multiple data streams isolated provided in an embodiment of this specification;

[0063] Figure 2 A schematic diagram of the principle of a video consultation method for isolating multiple data streams provided in an embodiment of this specification;

[0064] Figure 3 A schematic diagram of the structure of a video consultation device with multiple data stream isolation provided in an embodiment of this specification;

[0065] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of this specification;

[0066] Figure 5 A schematic diagram of a computer-readable medium provided for an embodiment of this specification. DETAILED DESCRIPTION

[0067] The following description is used to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments described below are only examples, and those skilled in the art can think of other obvious variations. The basic principles of the present invention defined in the following description can be applied to other embodiments, variations, improvements, equivalents, and other technical solutions that do not deviate from the spirit and scope of the present invention.

[0068] The following is combined with Figure 1-5 The exemplary embodiments of the present invention are described more fully. However, the exemplary embodiments can be implemented in various forms, and it should not be understood that the present invention is limited to the embodiments set forth herein. On the contrary, providing these exemplary embodiments can make the present invention more comprehensive and complete, and it is more convenient to fully convey the inventive concept to those skilled in the art. The same reference numerals in the figures represent the same or similar elements, components or parts, and thus their repeated description will be omitted.

[0069] Under the premise of being consistent with the technical concept of the present invention, the features, structures, characteristics or other details described in a specific embodiment do not exclude that they can be combined in one or more other embodiments in a suitable manner.

[0070] In the description of specific embodiments, the features, structures, characteristics or other details described in the present invention are intended to enable those skilled in the art to fully understand the embodiments. However, it does not exclude that those skilled in the art can practice the technical solutions of the present invention without one or more of the specific features, structures, characteristics or other details.

[0071] The flowcharts described in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0072] The block diagrams described in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0073] The term "and / or" or "and / or" includes all combinations of any one or more of the associated listed items.

[0074] Figure 1 A schematic diagram of a multi-data stream isolation video consultation system provided in an embodiment of this specification, the system may include:

[0075] Customer handheld device, health consultation device, cloud server, consultation workbench; wherein the cloud server includes independent long connection links, real-time communication links and short connection links;

[0076] The client handheld device establishes a connection with the health consulting device through the health consulting device identification information, and the client handheld device establishes a connection with the cloud server based on the short connection link;

[0077] The consulting workstation establishes a connection with the cloud server based on the long connection link and the real-time communication link;

[0078] The health consultation device establishes a connection with the cloud server based on the long connection link, the real-time communication link, and the short connection link.

[0079] In a specific embodiment of the present specification, the client handheld device is a portable device held by a user, such as a smart phone or a tablet computer.

[0080] The health consultation device uses the Android operating system and integrates a large-screen display (usually 24 inches or larger to provide a clear visual experience), a high-definition camera (for face-to-face video communication), a high-sensitivity microphone (to ensure the clarity and accuracy of voice communication), and a high-power external speaker (to provide loud and clear audio output). The integrated design of these components enables the device to not only have powerful multimedia interaction capabilities, but also meet the various technical requirements required for remote health consultation.

[0081] The cloud server is the core of the system, responsible for processing data from various devices, storing information, and coordinating communications between devices. The cloud server contains three independent connection links:

[0082] Long connection link: used to maintain a continuous connection between the health consultation device and the cloud server to support real-time status updates and data synchronization.

[0083] Real-time communication link: ensures real-time transmission of audio, video and text information during the consultation process, providing high-quality remote communication experience.

[0084] Short connection link: used for fast data transmission between customer handheld devices and cloud servers, such as sending files, receiving notifications, etc. This connection is established when needed and disconnected when completed to save resources and bandwidth.

[0085] Specifically, the persistent connection link includes the Web Socket bidirectional persistent connection link. Web Socket is a protocol for full-duplex communication on a single TCP connection. It supports the server to actively push information to the client, and also allows the client to actively send information to the server, thus realizing true two-way equal dialogue.

[0086] Real-time communication links include Web RTC (Web Real-Time Communication) real-time communication links. Real-time communication links are a technology that enables real-time communication between Web browsers and mobile applications. They allow network applications or sites to establish peer-to-peer connections between browsers without the aid of an intermediary, thereby enabling the transmission of video streams, audio streams, or any other data.

[0087] Short connection links include Web Service short connection https links. Web Service is a network-based application that uses standardized XML messaging to access services provided by other applications on the network. It does not depend on a specific programming language or platform, so it can achieve interoperability between different languages ​​​​and systems.

[0088] Figure 2 A schematic diagram of the principle of a video consultation method for isolating multiple data streams provided in an embodiment of this specification, the method may include:

[0089] S110: The client starts the client handheld device, and the client handheld device establishes the short connection link connection with the cloud server through the health consultation device identification information;

[0090] Optionally, the S110 includes:

[0091] The client handheld device scans the health consultation device identification information set on the health consultation device to establish the short connection link connection with the cloud server;

[0092] or,

[0093] The health consultation device identification information is manually inputted through the client handheld device to establish the short connection link connection with the cloud server.

[0094] In a specific implementation of this specification, the health consultation device identification information includes a QR code, a bar code, or a device code pasted / displayed on the health consultation device.

[0095] The customer uses the scanning function (such as a camera or dedicated QR code scanning software) on a handheld device (such as a smartphone) to scan the identification information on the health consultation device. After the scan is successful, the handheld device will automatically parse the connection parameters in the identification information. Based on the parsed connection parameters, the handheld device establishes a short connection link with the cloud server through security protocols such as HTTPS.

[0096] S120: The cloud server controls the health consultation device to display a health consultation page through the long connection link;

[0097] Optionally, the S120 includes:

[0098] The cloud server controls the health consultation device through the long connection link to interrupt the playing of local media information and display the health consultation page.

[0099] In a specific implementation of this specification, the cloud server maintains real-time communication with the health consultation device through a long connection link. When health consultation information needs to be displayed to the user, the server will send a command to the device. After receiving the command, the device immediately interrupts the currently playing local media information, and loads and displays the health consultation page according to the server's command. This mechanism ensures that users can receive important health consultation information in a timely manner, while also providing a flexible and real-time communication method.

[0100] Optionally, before the cloud server controls the health consultation device to interrupt playing the local media information through the long connection link, the process includes:

[0101] Starting the health consultation device, wherein the health consultation device sends an https request to the cloud server based on the short connection link;

[0102] The cloud server returns the application version number and the file URL to the health consultation device based on the https request;

[0103] The health consultation device determines whether the current application version number is consistent with the returned application version number;

[0104] When the health consulting device determines that the current application version number is inconsistent with the returned application version number, the health consulting device downloads the application update file based on the file URL to complete the version upgrade.

[0105] In a specific implementation of this specification, the health consultation device sends an HTTPS request to the cloud server through a short connection link (compared with a long connection, a short connection will close the connection after each communication). After receiving the HTTPS request, the cloud server will check the content of the request (which may include the device identifier, the current application version number and other information), and return the latest application version number and the URL (Uniform Resource Locator) of the application update file based on this information. After the health consultation device receives the application version number and file URL returned by the cloud server, it will compare it with the application version number currently installed on the device. If the health consultation device determines that the current application version number is inconsistent with the returned application version number (i.e., there is an update), the device will download the application update file according to the file URL. After the download is complete, the device will perform installation and configuration operations to complete the version upgrade. This process ensures that the health consultation device can obtain the latest application version in a timely manner and keep it synchronized with the cloud server. Sending an HTTPS request through a short connection link not only ensures the security of communication, but also avoids the resource consumption caused by maintaining a connection for a long time. At the same time, by comparing the application version number, the device can intelligently determine whether it is necessary to download and install the update file, thereby improving the stability and availability of the system.

[0106] S130: The client establishes the real-time communication link connection with the consultation workstation through the health consultation page to realize video call consultation, and sends health consultation related materials to the consultation workstation through the client's handheld device based on the short connection link.

[0107] In a specific implementation of this specification, the client browses to a health consultation page on a health consultation device, which provides an option to establish a real-time communication link connection with a consultation workstation. After the client chooses to establish a connection, the health consultation page will send a request to the consultation workstation to request the establishment of a real-time communication link (such as a WebSocket connection or a real-time communication technology based on HTTP). After receiving the request, the consultation workstation will verify the identity and authority of the client, and then agree to establish a real-time communication link connection. Once the connection is established, a real-time video call consultation can be conducted between the client and the consultation workstation.

[0108] During the video call consultation, the client may need to send some health consultation-related materials to the consultation workstation, such as medical reports, physical examination results, photos, etc. The client can use the application or browser on a handheld device (such as a smartphone or tablet) to send these materials to the cloud server through a short connection link (such as HTTPS). After receiving the materials, the cloud server will perform necessary processing (such as storage, encryption, forwarding, etc.) and send the materials to the consultation workstation. After receiving the materials, the consultation workstation can view, analyze or discuss these materials with the client during the video call.

[0109] The real-time communication link is used for real-time video calls and voice communications between the client and the consultation workstation. The short-term connection link is used for data transmission between the client and the cloud server, such as sending health consultation related materials. These two links are independent, but in this scenario they work together to support comprehensive and efficient health consultation services between the client and the consultation workstation.

[0110] Optionally, also include:

[0111] The health consultation device periodically sends a status report to the cloud server based on the long connection link.

[0112] In the specific implementation of this specification, the purpose of the status report is to enable the cloud server to understand the status and performance of the device in real time, so as to perform remote monitoring, data analysis, fault warning and other operations. The time interval can be set according to the type of device, application scenario and the requirements of the cloud server, which may be a few seconds, minutes, hours or longer. Regularly sending status reports can ensure that the cloud server can regularly receive the status information of the device, so as to maintain continuous monitoring and management of the device.

[0113] Optionally, after the health consultation device sends a status report to the cloud server based on the long connection link at a set time, it includes:

[0114] When the health consultation device fails to send the status report to the cloud server according to the set time, the cloud server closes the current long connection link and re-establishes the long connection link with the health consultation device.

[0115] In a specific embodiment of the present specification, if the health consultation device does not send a status report to the cloud server within a set time interval, this may be due to reasons such as device failure, network problems, or power problems. Once the cloud server detects that the health consultation device does not send a status report on time, and this situation lasts for a period of time (this period of time can be configured according to actual needs), the server will decide to close the current long connection link. Closing the connection is to ensure that no data or instructions are sent to a device that may have lost response or failed. After closing the current long connection link, the cloud server will try to re-establish a long connection link with the health consultation device. If the device is still able to work normally and receives a request to reconnect, it will try to establish a new long connection link with the cloud server. If the cloud server fails when trying to re-establish the connection, or the device cannot respond to the request to reconnect, this may mean that the device has a serious failure or is offline. In this case, the cloud server can trigger a fault handling process, such as sending an alarm notification to an administrator or maintenance personnel so that they can take appropriate measures to solve the problem. The cloud server will record all log information related to device connection and status reporting. These log information can be used for subsequent analysis and troubleshooting to help determine the reason why the device did not send a status report on time.

[0116] In the present invention, the long connection link, real-time communication link and short connection link of the cloud server are utilized, which can not only display high-quality local media content in full screen when the device is idle, making full use of the advantages of large-screen devices, but also switch to the video consultation call mode immediately through independent control signals and heartbeat links when needed, ensuring seamless conversion. In addition, independent content and user interaction links allow customers to seamlessly send inspection / test reports saved in their mobile phones to the consultation workbench through mobile phone applets, improving the user experience. At the same time, the device side regularly sends status reports through independent control signals and heartbeat links to ensure timely updates of the device's networking status, and avoids misoperation and malicious harassment through independent background control links and independent user interaction links, thereby protecting user privacy and device security to the greatest extent possible.

[0117] Figure 3 A schematic diagram of a video consultation device for isolating multiple data streams provided in an embodiment of this specification, the device may include:

[0118] Customer handheld device, health consultation device, cloud server, consultation workbench; wherein the cloud server includes independent long connection links, real-time communication links and short connection links;

[0119] A first data flow isolation module 10, used for the client handheld device to establish a connection with the health consulting device through the health consulting device identification information, and the client handheld device to establish a connection with the cloud server based on the short connection link;

[0120] A second data flow isolation module 20, for secondly connecting the consulting workstation to establish a connection with the cloud server based on the long connection link and the real-time communication link;

[0121] The third data flow isolation module 30 is used for the health consultation device to establish a connection with the cloud server based on the long connection link, the real-time communication link, and the short connection link.

[0122] Optional, including:

[0123] The client starts the client handheld device, and the client handheld device establishes the short connection link connection with the cloud server through the health consultation device identification information;

[0124] The cloud server controls the health consultation device to display a health consultation page through the long connection link;

[0125] The client establishes the real-time communication link connection with the consultation workstation through the health consultation page to realize video call consultation, and sends health consultation related materials to the consultation workstation through the client's handheld device based on the short connection link.

[0126] Optionally, the first data flow isolation module 10 includes:

[0127] The client handheld device scans the health consultation device identification information set on the health consultation device to establish the short connection link connection with the cloud server;

[0128] or,

[0129] The health consultation device identification information is manually inputted through the client handheld device to establish the short connection link connection with the cloud server.

[0130] Optionally, the cloud server controls the health consultation device to display a health consultation page through the long connection link, including:

[0131] The cloud server controls the health consultation device through the long connection link to interrupt the playing of local media information and display the health consultation page.

[0132] Optionally, also include:

[0133] The health consultation device periodically sends a status report to the cloud server based on the long connection link.

[0134] Optionally, after the health consultation device sends a status report to the cloud server based on the long connection link at a set time, it includes:

[0135] When the health consultation device fails to send the status report to the cloud server according to the set time, the cloud server closes the current long connection link and re-establishes the long connection link with the health consultation device.

[0136] Optionally, before the cloud server controls the health consultation device to interrupt playing the local media information through the long connection link, the process includes:

[0137] Starting the health consultation device, wherein the health consultation device sends an https request to the cloud server based on the short connection link;

[0138] The cloud server returns the application version number and the file URL to the health consultation device based on the https request;

[0139] The health consultation device determines whether the current application version number is consistent with the returned application version number;

[0140] When the health consulting device determines that the current application version number is inconsistent with the returned application version number, the health consulting device downloads the application update file based on the file URL to complete the version upgrade.

[0141] The functions of the device in the embodiment of the present invention have been described in the above method embodiment, so for details not provided in the description of this embodiment, please refer to the relevant description in the above embodiment, and no further description will be given here.

[0142] Based on the same inventive concept, an embodiment of this specification also provides an electronic device.

[0143] The following describes an electronic device embodiment of the present invention, which can be regarded as a specific physical implementation of the method and device embodiments of the present invention. The details described in the electronic device embodiment of the present invention should be regarded as a supplement to the above method or device embodiments; details not disclosed in the electronic device embodiment of the present invention can be implemented with reference to the above method or device embodiments.

[0144] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this specification. Figure 4 The electronic device 300 according to the embodiment of the present invention is described. Figure 4 The electronic device 300 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0145] like Figure 4 As described above, the electronic device 300 is in the form of a general-purpose computing device. The components of the electronic device 300 may include, but are not limited to: at least one processing unit 310, at least one storage unit 320, a bus 330 connecting different system components (including the storage unit 320 and the processing unit 310), a display unit 340, etc.

[0146] The storage unit stores program codes, which can be executed by the processing unit 310, so that the processing unit 310 performs the steps according to various exemplary embodiments of the present invention described in the above processing method section of this specification. For example, the processing unit 310 can perform the following steps: Figure 2 The steps described.

[0147] The storage unit 320 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 3201 and / or a cache memory unit 3202 , and may further include a read-only memory unit (ROM) 3203 .

[0148] The storage unit 320 may also include a program / utility 3204 having a set (at least one) of program modules 3205, such program modules 3205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each of which or some combination may include the implementation of a network environment.

[0149] Bus 330 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0150] The electronic device 300 may also communicate with one or more external devices 400 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), one or more devices that enable viewers to interact with the electronic device 300, and / or any device that enables the electronic device 300 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed through an input / output (I / O) interface 350. Furthermore, the electronic device 300 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 360. The network adapter 360 may communicate with other modules of the electronic device 300 through the bus 330. It should be understood that although Figure 4Not shown, other hardware and / or software modules may be used in conjunction with the electronic device 300, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0151] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the exemplary embodiments described in the present invention can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation method of the present invention can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.) or on a network, including a number of instructions to enable a computing device (which can be a personal computer, server, or network device, etc.) to execute the above method according to the present invention. When the computer program is executed by a data processing device, the computer-readable medium can implement the above method of the present invention, that is: Figure 2 The method described.

[0152] Figure 5 A schematic diagram of a computer-readable medium provided for an embodiment of this specification.

[0153] accomplish Figure 2 The computer program of the method can be stored on one or more computer readable media. The computer readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0154] The computer readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by an instruction execution system, an apparatus, or a device or used in combination with it. The program code contained on the readable storage medium may be transmitted with any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.

[0155] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the viewer computing device, partially on the viewer device, as a stand-alone software package, partially on the viewer computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the viewer computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0156] In summary, the present invention can be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that general data processing devices such as microprocessors or digital signal processors (DSPs) can be used in practice to implement some or all of the functions of some or all of the components in the embodiments of the present invention. The present invention can also be implemented as a device or apparatus program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program implementing the present invention can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0157] The specific embodiments described above further describe the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the present invention is not inherently related to any specific computer, virtual device or electronic device, and various general devices can also implement the present invention. The above description is only a specific embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

[0158] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.

[0159] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A video consultation method for isolating multiple data streams, characterized in that: include: Customer handheld device, health consultation device, cloud server, consultation workbench; wherein the cloud server includes independent long connection links, real-time communication links and short connection links; The client handheld device establishes a connection with the health consulting device through the health consulting device identification information, and the client handheld device establishes a connection with the cloud server based on the short connection link; The consulting workstation establishes a connection with the cloud server based on the long connection link and the real-time communication link; The health consultation device establishes a connection with the cloud server based on the long connection link, the real-time communication link, and the short connection link.

2. The video consultation method for multiple data stream isolation as claimed in claim 1, characterized in that: include: The client starts the client handheld device, and the client handheld device establishes the short connection link connection with the cloud server through the health consultation device identification information; The cloud server controls the health consultation device to display a health consultation page through the long connection link; The client establishes the real-time communication link connection with the consultation workstation through the health consultation page to realize video call consultation, and sends health consultation related materials to the consultation workstation through the client's handheld device based on the short connection link.

3. The video consultation method for multiple data stream isolation as claimed in claim 2, characterized in that: The client handheld device establishes the short connection link connection with the cloud server through the health consultation device identification information, including: The client handheld device scans the health consultation device identification information set on the health consultation device to establish the short connection link connection with the cloud server; or, The health consultation device identification information is manually inputted through the client handheld device to establish the short connection link connection with the cloud server.

4. The video consultation method for multiple data stream isolation as claimed in claim 3, characterized in that: The cloud server controls the health consultation device to display a health consultation page through the long connection link, including: The cloud server controls the health consultation device through the long connection link to interrupt the playing of local media information and display the health consultation page.

5. The video consultation method for multiple data stream isolation as claimed in claim 4, characterized in that: Also includes: The health consultation device periodically sends a status report to the cloud server based on the long connection link.

6. The video consultation method for multiple data stream isolation as claimed in claim 5, characterized in that: After the health consultation device sends a status report to the cloud server based on the long connection link at a set time, it includes When the health consultation device fails to send the status report to the cloud server according to the set time, the cloud server closes the current long connection link and re-establishes the long connection link with the health consultation device.

7. The video consultation method for multiple data stream isolation as claimed in claim 6, characterized in that: Before the cloud server controls the health consultation device to interrupt playing the local media information through the long connection link, the method includes: Starting the health consultation device, wherein the health consultation device sends an https request to the cloud server based on the short connection link; The cloud server returns the application version number and the file URL to the health consultation device based on the https request; The health consultation device determines whether the current application version number is consistent with the returned application version number; When the health consulting device determines that the current application version number is inconsistent with the returned application version number, the health consulting device downloads the application update file based on the file URL to complete the version upgrade.

8. A video consultation device with multiple data stream isolation, characterized in that: include: Customer handheld device, health consultation device, cloud server, consultation workbench; wherein the cloud server includes independent long connection links, real-time communication links and short connection links; A first data flow isolation module is used for the client handheld device to establish a connection with the health consulting device through the health consulting device identification information, and the client handheld device to establish a connection with the cloud server based on the short connection link; A second data flow isolation module is used for establishing a second connection between the consulting workstation and the cloud server based on the long connection link and the real-time communication link; The third data flow isolation module is used for the health consultation device to establish a connection with the cloud server based on the long connection link, the real-time communication link, and the short connection link.

9. An electronic device, wherein: The electronic device includes: processor; and, A memory storing computer executable instructions which, when executed, cause the processor to perform a method according to any one of claims 1-7.

10. A computer-readable storage medium, wherein: The computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the method of any one of claims 1 to 7 is implemented.

Images