A remote consultation control method and control system, computer equipment and media

Abstract

The present invention discloses a remote consultation control method, a remote consultation control system, a computer device and a medium. The remote consultation control method comprises: a server receives a consultation reservation and establishes a virtual clinic, wherein the virtual clinic comprises one or more consultation terminals, wherein the consultation terminal comprises a consultation control terminal and a consultation device; the consultation control terminal sends a startup message including a first identifier of a consultation device to be controlled and a startup instruction to an MQTT message queue of the server, and the server pushes the startup message to a topic subscribed by the consultation device having the first identifier according to the MQTT protocol; the consultation device receives the startup message and executes the startup instruction, and sends a startup confirmation message including a second identifier of the corresponding consultation control terminal to the MQTT message queue of the server, and the startup confirmation message is pushed to the topic subscribed by the consultation control terminal having the second identifier via the server; the consultation control terminal receives the startup confirmation message and enters the virtual clinic.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a remote consultation control method, a remote consultation control system, a computer device and a medium. Background Art

[0002] The rapid development of the Internet has brought people closer together. With the development of communication technology and the improvement of telecommunications bandwidth, the technology in the field of Internet video has made great progress, which has provided convenient conditions for live video streaming.

[0003] In the medical field, due to the uneven distribution of medical resources, the convenience of seeing a doctor needs to be improved. By connecting experts and patients through the Internet, experts can help more patients and patients can solve their problems conveniently. However, there are still many problems in the existing remote consultation control system, specifically involving communication between multiple devices, device control, system integration, network delay, and docking of different protocols, which seriously affect the user's experience of remote medical consultation. Therefore, how to manage and coordinate multiple devices has become a problem that technicians in this field need to solve urgently. Summary of the invention

[0004] In order to solve at least one of the above problems, the first embodiment of the present invention provides a remote consultation control method, which is applied to a server and includes:

[0005] Receive consultation appointments;

[0006] Establishing a virtual consulting room according to the consultation appointment, wherein the virtual consulting room includes one or more consultation terminals, and the consultation terminals include a consultation control terminal and a consultation device;

[0007] Receiving, through the MQTT message queue, a start message sent by each consultation control terminal participating in the consultation appointment, wherein the start message includes a first identifier of the consultation device to be controlled and a start instruction;

[0008] Pushing each of the startup messages to a topic subscribed by a consultation device having the first identifier according to the MQTT protocol, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue;

[0009] Receiving, through the MQTT message queue, a startup confirmation message fed back by each of the consultation devices after completing the startup instruction, wherein the startup confirmation message includes a first identifier of the consultation device and a second identifier of the corresponding consultation control terminal;

[0010] According to the MQTT protocol, each of the start confirmation messages is pushed to the topic subscribed by the consultation control terminal having the second identifier, so that the consultation control terminal receives the start confirmation message and enters the virtual consulting room.

[0011] Further, after establishing the virtual consulting room according to the consultation appointment, and before receiving the start message sent by each consultation control terminal participating in the consultation appointment through the MQTT message queue, the remote consultation control method further includes:

[0012] Receiving access messages of each of the consultation control terminals and each of the consultation devices through an MQTT message queue, wherein the access message includes the second identifier of the consultation control terminal or the first identifier of the consultation device;

[0013] According to each of the access messages, a query is made in the database to complete the registration or update of each of the consultation control terminals or each of the consultation devices, and the access confirmation messages of the registration or update are pushed to the corresponding topics respectively according to the MQTT protocol, wherein the access confirmation message includes the second identifier of the consultation control terminal or the first identifier of the consultation device, so that the consultation device with the first identifier or the consultation control terminal with the second identifier that subscribes to the topic receives the access confirmation message.

[0014] Furthermore, the remote consultation control method further includes:

[0015] The messages of each consultation control terminal and each consultation device are obtained through the MQTT message queue and their status is updated in real time. A health check message is sent to each consultation control terminal or each consultation device that has no message within a preset time period. If no feedback message is received from the consultation control terminal or consultation device, an offline message is sent according to the MQTT protocol and its status is modified.

[0016] Furthermore, the remote consultation control method further includes:

[0017] The status change messages of the consultation control terminals and the consultation devices are received through the MQTT message queue and their status is modified, and the status change messages are sent to all the consultation devices and the consultation control terminals in the virtual clinic according to the TCP protocol.

[0018] Further, after pushing each of the start confirmation messages to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol, the remote consultation control method further includes:

[0019] Receiving a control message sent by the consultation control terminal through an MQTT message queue, wherein the control message includes a first identifier of a consultation device to be controlled and a control instruction;

[0020] Pushing the control message to the corresponding topic according to the MQTT protocol, so that the consultation device with the first identifier subscribed to the topic receives the control message and executes the control instruction;

[0021] Receiving, through the MQTT message queue, a control confirmation message fed back by the consultation device after completing the control instruction, wherein the control confirmation message includes a first identifier of the consultation device and a second identifier of the corresponding consultation control terminal;

[0022] The control confirmation message is pushed to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol, so that the consultation control terminal receives the control confirmation message.

[0023] Further, after pushing each of the start confirmation messages to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol, the remote consultation control method further includes:

[0024] A remote setting message is received through an MQTT message queue, wherein the remote setting message includes a second identifier of a consultation control terminal to be controlled or a first identifier of a consultation device and a setting instruction, and the remote setting message is pushed to a topic subscribed to by the consultation control terminal with the second identifier or the consultation device with the first identifier according to the MQTT protocol, so that the consultation control terminal or the consultation device receives the setting message and executes the setting instruction.

[0025] A second embodiment of the present invention provides a remote consultation control method, which is applied to a consultation control terminal, comprising:

[0026] In response to a first operation of the user, a startup message is sent to an MQTT message queue of the server, wherein the startup message includes a first identifier of the consultation device to be controlled and a startup instruction, so that the server pushes the startup message to a topic subscribed by the consultation device having the first identifier according to the MQTT protocol, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue;

[0027] Receive a start confirmation message according to the subscribed topic and enter the virtual clinic. The start confirmation message is sent by the consultation device to the MQTT message queue of the server after completing the start instruction, and includes the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal. The server pushes the start confirmation message to the topic subscribed by the consultation control terminal with the second identifier in accordance with the MQTT protocol. The virtual clinic is established by the server according to the received consultation appointment. The virtual clinic includes one or more consultation terminals, and the consultation terminals include a consultation control terminal and a consultation device.

[0028] Further, before sending a start message to the MQTT message queue of the server in response to the first operation of the user, it also includes:

[0029] In response to a second operation of the user, an access message is sent to an MQTT message queue of the server, wherein the access message includes a second identifier of the consultation control terminal, so that the server queries a database according to the access message;

[0030] An access confirmation message is received according to the subscribed topic, wherein the access confirmation message includes the second identifier of the consultation control terminal and is pushed to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol after the server completes the registration or update of the consultation control terminal.

[0031] Further, after receiving the start confirmation message according to the subscribed topic and entering the virtual clinic, the method further includes:

[0032] In response to a third operation of the user, a control message is sent to the MQTT message queue of the server, wherein the control message includes a first identifier of the consultation device to be controlled and a control instruction, so that the server pushes the control message to a topic subscribed by the consultation device having the first identifier according to the MQTT protocol, so that the consultation device receives the control message and executes the control instruction;

[0033] A control confirmation message is received according to the subscribed topic, wherein the control confirmation message includes the first identifier of the consultation device and the second identifier of its corresponding consultation control terminal, and is sent to the MQTT message queue of the server after the consultation device completes the control instruction. The server pushes the control confirmation message to the topic subscribed by the consultation control terminal with the second identifier in accordance with the MQTT protocol.

[0034] A third embodiment of the present invention provides a remote consultation control method, which is applied to a consultation device, comprising:

[0035] Receive a startup message according to the subscribed topic, the startup message including the first identifier of the consultation device and a startup instruction, the startup message is sent by the consultation control terminal to the MQTT message queue of the server, and the server pushes the startup message to the topic subscribed by the consultation control terminal having the first identifier according to the MQTT protocol;

[0036] Execute the start instruction and send a start confirmation message to the MQTT message queue of the server, the start confirmation message including the first identifier of the consultation device and the second identifier of its corresponding consultation control terminal, so that the server pushes the start confirmation message to the topic subscribed by the consultation control terminal with the second identifier in accordance with the MQTT protocol, so that the consultation control terminal receives the start confirmation message and enters the virtual clinic, the virtual clinic is established by the server according to the received consultation appointment, the virtual clinic includes one or more consultation terminals, and the consultation terminals include a consultation control terminal and a consultation device.

[0037] Furthermore, before receiving the start message according to the subscribed topic, the method further includes:

[0038] Sending an access message to an MQTT message queue of a server, wherein the access message includes a first identifier of the consultation device, so that the server queries a database according to the access message;

[0039] An access confirmation message is received according to the subscribed topic, and a long connection is maintained with the MQTT message queue. The access confirmation message includes the first identifier of the consultation device, and is pushed to the topic subscribed by the consultation device with the first identifier according to the MQTT protocol after the server completes the registration or update of the consultation device.

[0040] Further, after executing the start instruction and sending a start confirmation message to the MQTT message queue of the server, it also includes:

[0041] Receive a control message according to the subscribed topic, the control message including the first identifier of the consultation device to be controlled and a control instruction, which is sent by the consultation control terminal to the MQTT message queue of the server and pushed by the server to the topic subscribed by the consultation device having the first identifier according to the MQTT protocol;

[0042] Execute the control instruction and send a control confirmation message to the MQTT message queue of the server, wherein the control confirmation message includes the first identifier of the consultation device and the second identifier of its corresponding consultation control terminal, and the server pushes the control confirmation message to the topic subscribed by the consultation control terminal with the second identifier in accordance with the MQTT protocol.

[0043] A fourth embodiment of the present invention provides a remote consultation control system, comprising a server and at least two consultation terminals, wherein the consultation terminals include a consultation control terminal and a consultation device, wherein

[0044] The server includes an MQTT message queue and a management center, and is configured to:

[0045] Receiving a consultation appointment through a management center and establishing a virtual consulting room according to the consultation appointment, wherein the virtual consulting room includes one or more consultation terminals, and the consultation terminal includes a consultation control terminal and a consultation device;

[0046] Receiving, through the MQTT message queue, a start message sent by each consultation control terminal participating in the consultation appointment, wherein the start message includes a first identifier of the consultation device to be controlled and a start instruction;

[0047] Pushing each of the startup messages to the topic subscribed by the consultation device corresponding to the first identifier according to the MQTT protocol, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue;

[0048] Receiving, through the MQTT message queue, a startup confirmation message fed back by each of the consultation devices after completing the startup instruction, wherein the startup confirmation message includes a first identifier of the consultation device and a second identifier of the corresponding consultation control terminal;

[0049] Each of the start confirmation messages is pushed to the corresponding topic according to the MQTT protocol, so that the consultation control terminal corresponding to the second identifier subscribed to the topic receives the start confirmation message and enters the virtual consulting room.

[0050] Furthermore, it also includes a remote control terminal, which is configured to send a remote setting message to the MQTT message queue of the server, wherein the remote setting message includes the second identifier of the consultation control terminal to be controlled or the first identifier of the consultation device and a setting instruction, so that the server pushes the remote setting message to the topic subscribed by the consultation control terminal with the second identifier or the consultation device with the first identifier according to the MQTT protocol, so that the consultation control terminal or the consultation device receives the setting message and executes the setting instruction.

[0051] A fifth embodiment of the present invention provides a non-transitory computer-readable storage medium having a computer program stored thereon.

[0052] When the program is executed by a processor, the method described in the first embodiment is implemented;

[0053] or

[0054] When the program is executed by a processor, the method described in the second embodiment is implemented;

[0055] or

[0056] When the program is executed by a processor, the method described in the third embodiment is implemented.

[0057] A sixth embodiment of the present invention provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor.

[0058] When the processor executes the program, the method described in the first embodiment is implemented;

[0059] or

[0060] When the processor executes the program, the method described in the second embodiment is implemented;

[0061] or

[0062] When the processor executes the program, the method described in the third embodiment is implemented.

[0063] The present invention discloses a remote consultation control method, a remote consultation control system, a computer device and a medium. By setting an MQTT message queue on the server side and using the MQTT protocol to realize the forwarding control of messages between devices, simplified control and convenient communication between the consultation control terminal and the consultation device, between the consultation control terminal and the server, and between the consultation device and the server are realized, thereby compensating for the problems existing in the prior art, improving the real-time performance and reliability of the remote consultation control system, effectively improving the user experience, and having broad application prospects. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0065] Figure 1 A flowchart showing a remote consultation control method according to an embodiment of the present invention;

[0066] Figure 2 A structural block diagram of a remote consultation control system according to an embodiment of the present invention is shown;

[0067] Figure 3 A swim lane diagram showing a startup process according to an embodiment of the present invention;

[0068] Figure 4 A swim lane diagram showing an access process according to an embodiment of the present invention;

[0069] Figure 5 A swim lane diagram showing a remote control process according to an embodiment of the present invention;

[0070] Figure 6 A flowchart showing a remote consultation control method according to another embodiment of the present invention;

[0071] Figure 7 A flowchart showing a remote consultation control method according to another embodiment of the present invention;

[0072] Figure 8 A schematic structural diagram of a computer device according to another embodiment of the present invention is shown. DETAILED DESCRIPTION

[0073] In order to more clearly illustrate the present invention, the present invention is further described below in conjunction with preferred embodiments and accompanying drawings. Similar components in the accompanying drawings are represented by the same reference numerals. It should be understood by those skilled in the art that the content specifically described below is illustrative rather than restrictive, and should not be used to limit the scope of protection of the present invention.

[0074] like Figure 1 As shown, an embodiment of the present invention provides a remote consultation control method, which is applied to a server, including: receiving a consultation appointment; establishing a virtual clinic according to the consultation appointment, the virtual clinic including one or more consultation terminals, the consultation terminals including a consultation control terminal and a consultation device; receiving a startup message sent by each consultation control terminal participating in the consultation appointment through an MQTT message queue, the startup message including a first identifier and a startup instruction of the consultation device to be controlled; pushing each of the startup messages to a topic subscribed by a consultation device having the first identifier according to the MQTT protocol, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue; receiving a startup confirmation message fed back by each of the consultation devices after completing the startup instruction through the MQTT message queue, the startup confirmation message including the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal; pushing each of the startup confirmation messages to a topic subscribed by a consultation control terminal having the second identifier according to the MQTT protocol, so that the consultation control terminal receives the startup confirmation message and enters the virtual clinic.

[0075] MQTT (Message Queuing Telemetry Transport) is a lightweight communication protocol based on the publish / subscribe model built on the TCP protocol. In this embodiment, the MQTT protocol is used to implement the publishing and subscription of messages between the consultation control terminal and the consultation equipment of the consultation terminal, and the MQTT message queue set on the server side is used to proxy and forward the messages between the consultation control terminal and the consultation equipment, so as to provide instant and reliable message services for the connected remote devices using limited bandwidth, thereby effectively simplifying the management process of the remote consultation control system and improving the real-time performance and reliability of the remote consultation control system.

[0076] like Figure 2 The remote consultation control system shown in the figure includes a server and at least two consultation terminals. The server establishes a virtual clinic to accommodate at least two consultation terminals according to the received consultation appointment. Each of the consultation terminals includes a consultation control terminal and a consultation device. The consultation control terminal and the consultation device communicate through the server to achieve device management and control. Among them, the server includes a management center and an MQTT message queue. The management center is used to receive consultation appointments and establish a virtual clinic according to the consultation appointments, manage the access, registration or update of each device, and the status of each device by querying the database. The MQTT message queue is responsible for forwarding the communication between each device as a message agent; the consultation control terminal can be a tablet computer or a smart phone, and the consultation device is a large-screen display device, including a camera, an acquisition card and other devices.

[0077] It is worth noting that in certain specific scenarios, the consultation control terminal and the consultation device can be integrated into the same device. The present application does not make any specific limitation on this. Those skilled in the art should make settings according to actual needs, which is not limited here.

[0078] In a specific embodiment, a consultation control terminal and a consultation device of a consultation terminal are used as an example to implement device management and control through a server, wherein the consultation control terminal is a tablet computer and the consultation device is a large-size display screen including a camera and an acquisition card. Specifically, the following steps are included:

[0079] like Figure 3 As shown, the consultation control terminal 200 and the consultation device 300 are managed and controlled through the server 100 .

[0080] S10. The server 100 establishes a virtual consulting room according to the received consultation appointment.

[0081] In this embodiment, the server 100 receives a consultation appointment, which is set by a user using the consultation control terminal 200 and is not limited by time and place. After receiving the consultation appointment, the server 100 establishes a virtual clinic according to the specific time of the consultation appointment. The virtual clinic is used to accommodate at least two consultation terminals participating in the consultation. The virtual clinic includes the consultation time and each consultation terminal participating in the consultation.

[0082] S11 . The consultation control terminal 200 of each consultation terminal sends a start message to the MQTT message queue of the server 100 in response to the first operation of the user to start the corresponding consultation device 300 .

[0083] In this embodiment, the user operates the tablet computer to control the display screen. For example, the user starts the display screen by clicking a start button of an application on the tablet computer. That is, the user clicks the start button through the first operation, which is manifested as the tablet computer sending a start message to the MQTT message queue of the server. The start message includes a first identifier of the consultation device to be controlled and a start instruction.

[0084] The MQTT message queue receives and parses the start message, and obtains that the recipient of the start message is a consultation device with a first identifier.

[0085] S12. The server 100 pushes the start message to the topic subscribed by the consultation device 300 having the first identifier according to the MQTT protocol.

[0086] In this embodiment, the server pushes the startup message to the corresponding topic according to the MQTT protocol, and the topic is subscribed by the consultation device with the first identifier. That is, the server publishes the startup message to the topic subscribed by the consultation device through the MQTT message queue according to the MQTT protocol, thereby forwarding the instruction sent by the consultation control terminal to the consultation device.

[0087] S13 . The consultation device 300 receives the startup message and executes the startup instruction, and sends a startup confirmation message to the MQTT message queue of the server 100 .

[0088] In this embodiment, the consultation device turns on the display screen, camera and audio according to the startup instruction, enters the consultation state, and at the same time feeds back a startup confirmation message to the MQTT message queue of the server 100. The startup confirmation message includes the first identifier of the consultation device and the second identifier of its corresponding consultation control terminal. The consultation device maintains a long connection with the MQTT message queue.

[0089] S14. The server pushes the start confirmation message to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol.

[0090] In this embodiment, similar to the above-mentioned embodiment, the server publishes the start confirmation message to the topic subscribed by the consultation control terminal through the MQTT message queue according to the MQTT protocol, thereby forwarding the start confirmation message fed back by the consultation device to the consultation control terminal.

[0091] The consultation control terminal receives the start confirmation message to determine that the consultation device has entered the consultation state, and the consultation control terminal displays that the virtual consultation room has been entered and the remote consultation can be started.

[0092] In an optional embodiment, after the server establishes the virtual clinic and before the consultation control terminal starts the consultation device, the remote consultation control method also includes: receiving access messages of each consultation control terminal and each consultation device through an MQTT message queue, the access message including the second identifier of the consultation control terminal or the first identifier of the consultation device; querying in the database according to each access message to complete the registration or update of each consultation control terminal or each consultation device, and pushing the registered or updated access confirmation message to the corresponding topic according to the MQTT protocol, the access confirmation message including the second identifier of the consultation control terminal or the first identifier of the consultation device, so that the consultation device with the first identifier or the consultation control terminal with the second identifier that subscribes to the topic receives the access confirmation message.

[0093] In this embodiment, the consultation control terminal and the consultation device respectively access the server by sending access messages to the MQTT message queue of the server and complete registration or update on the server side.

[0094] Specifically, Figure 4 As shown,

[0095] S21. In response to the second operation of the user, the consultation control terminal 200 sends an access message to the MQTT message queue of the server, and the consultation device 300 sends an access message to the MQTT message queue of the server.

[0096] In this embodiment, the consultation control terminal responds to the user's second operation, for example, the user clicks an access button of an application on a tablet computer, that is, the user clicks the access button through the second operation, which is manifested as the tablet computer sending an access message to the MQTT message queue of the server. The access message includes the second identifier of the consultation control terminal, which is used to register or update information on the server side.

[0097] Similarly, the consultation device sends an access message to the MQTT message queue of the server when powered on, and the access message includes the first identifier of the consultation device, which is used to register or update information on the server side.

[0098] S22. The server queries the database and completes the access of the consultation control terminal or the consultation device.

[0099] In this embodiment, the management center of the server performs a query based on the second identifier that can uniquely identify the consultation control terminal, or the first identifier that can uniquely identify the consultation equipment, for example, queries whether there is registration information of the consultation control terminal or the consultation equipment in the database. If not, the consultation equipment is registered on the server side according to the first identifier and saved in the database, or the consultation control terminal is registered on the server side according to the second identifier and saved in the database. If it already exists, the relevant information of the consultation control terminal or the consultation equipment, such as the IP address, display name, etc., used for remote consultation is updated in the database.

[0100] S23. After completing the registration or update operation, the server publishes the access confirmation message to the corresponding topic through the MQTT message queue according to the MQTT protocol.

[0101] In this embodiment, the server publishes the access confirmation message to the topic subscribed by the consultation control terminal through the MQTT message queue according to the MQTT protocol to send the access confirmation message to it, indicating that the consultation control terminal has established a connection with the server. Similarly, the server publishes the access confirmation message to the topic subscribed by the consultation device through the MQTT message queue according to the MQTT protocol to send the access confirmation message to it, indicating that the consultation device has established a connection with the consultation control terminal, and the consultation device maintains a long connection with the MQTT message queue, for example, the consultation device maintains a long connection with the MQTT message queue through the Web Socket protocol.

[0102] To ensure the connection status between the consultation control terminal, the consultation equipment and the server, in an optional embodiment, the remote consultation control method also includes: obtaining messages from each consultation control terminal and each consultation equipment through the MQTT message queue and updating their status in real time, sending health check messages to each consultation control terminal or each consultation equipment that has no messages within a preset time period, and if no feedback message is received from the consultation control terminal or the consultation equipment, sending an offline message according to the MQTT protocol and modifying its status.

[0103] In this embodiment, after accessing the consultation control terminal and the consultation device, the server monitors all messages of the consultation control terminal and the consultation device through the MQTT message queue, and determines the connection status of the consultation control terminal and the consultation device according to the monitored messages. When no message from the consultation control terminal or the consultation device is received within a predetermined time, the server actively sends a health detection message to the consultation control terminal or the consultation device to monitor the access status of the consultation control terminal and the consultation device.

[0104] Specifically, Figure 4 As shown,

[0105] S24. The server sends a health detection message to the consultation control terminal or the consultation device through the MQTT message queue according to the MQTT protocol.

[0106] In this embodiment, the health detection message includes the second identifier of the consultation control terminal, or includes the first identifier of the consultation device, and the server uses the MQTT protocol to publish the health detection message to the designated consultation control terminal or the topic subscribed by the consultation device according to the second identifier or the first identifier through the MQTT message queue.

[0107] S25. The consultation control terminal feeds back a health confirmation message to the MQTT message queue of the server.

[0108] In this embodiment, when the consultation control terminal maintains connection with the server, it receives the health detection message and feeds back a health confirmation message, so that the server determines the status of the consultation control terminal based on the received health confirmation message, for example, displays the status of the consultation control terminal as online in the virtual clinic.

[0109] S26. The server sends an offline message to other devices participating in the consultation through the MQTT message queue according to the MQTT protocol.

[0110] In this embodiment, when the consultation device is disconnected from the server, it cannot receive the health detection message issued by the server and cannot feedback the health confirmation message. On the server side, it is manifested as not receiving any message from the consultation device. When the pre-set time threshold is exceeded, the server determines that the consultation device has been disconnected, and sends an offline message of the disconnected consultation device to the consultation control terminal, consultation equipment, etc. of other consultation terminals participating in the consultation, and at the same time changes the status of the consultation device to offline in the virtual clinic.

[0111] To further confirm the status of each device in the virtual clinic, in an optional embodiment, the remote consultation control method also includes: receiving status change messages of each consultation control terminal and each consultation device through the MQTT message queue and modifying their status, and sending the status change messages to all the consultation devices and the consultation control terminals in the virtual clinic according to the TCP protocol.

[0112] In this embodiment, the server monitors all messages of the consultation control terminal and the consultation equipment through the MQTT message queue, and when it monitors that the status of the consultation control terminal or the consultation equipment has changed, such as connecting to or disconnecting from the server, entering or leaving the virtual clinic, or being offline. To ensure the normal operation of each consultation terminal in the virtual clinic, the server modifies the status of the consultation control terminal or the consultation equipment in the virtual clinic, and at the same time sends the status change message to all the consultation equipment and the consultation control terminal in the virtual clinic through the TCP protocol. For example, when the server monitors that the consultation equipment has disconnected from the MQTT message queue of the server, the status of the consultation equipment is marked as offline in the virtual clinic, and the status of the consultation equipment is sent to all remote terminals in the virtual clinic using the TCP protocol, that is, the consultation equipment is broadcast offline in the virtual clinic to ensure that the consultation control terminals and consultation equipment of each remote terminal receive the message.

[0113] In an optional embodiment, the user can also control the consultation device through the consultation control terminal. After pushing each of the start confirmation messages to the topic subscribed by the consultation control terminal with the second identifier according to the MQTT protocol, the remote consultation control method also includes: receiving the control message sent by the consultation control terminal through the MQTT message queue, the control message including the first identifier and control instructions of the consultation device to be controlled; pushing the control message to the corresponding topic according to the MQTT protocol, so that the consultation device with the first identifier subscribed to the topic receives the control message and executes the control instructions; receiving the control confirmation message fed back by the consultation device after completing the control instruction through the MQTT message queue, the control confirmation message including the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal; pushing the control confirmation message to the topic subscribed by the consultation control terminal with the second identifier according to the MQTT protocol, so that the consultation control terminal receives the control confirmation message.

[0114] In this embodiment, the consultation control terminal controls the consultation equipment through the MQTT protocol and the MQTT message queue set on the server side. Specifically, the consultation control terminal sends a control message to the server in response to the user's third operation by clicking the command button of the application on the tablet computer, and forwards the control message for the consultation equipment through the MQTT message queue of the server. The control message includes a first identifier of the consultation equipment to be controlled. The server pushes the control message to the topic subscribed by the consultation equipment with the first identifier. The consultation equipment receives the control instruction and controls the consultation equipment to adjust the camera angle, adjust the volume, switch the video source or adjust the video zoom ratio according to the control instruction. The specific implementation process is similar to the aforementioned embodiment and will not be repeated here.

[0115] In an optional embodiment, after pushing each of the start confirmation messages to the topic subscribed by the consultation control terminal with the second identifier according to the MQTT protocol, the remote consultation control method further includes: receiving a remote setting message through an MQTT message queue, the remote setting message including the second identifier of the consultation control terminal to be controlled or the first identifier of the consultation device and a setting instruction, and pushing the remote setting message to the topic subscribed by the consultation control terminal with the second identifier or the consultation device with the first identifier according to the MQTT protocol, so that the consultation control terminal or the consultation device receives the setting message and executes the setting instruction.

[0116] In this embodiment, if Figure 2 As shown, the remote consultation control system also includes a remote control terminal, which can access the server through a browser and set each consultation control terminal and the consultation equipment in the virtual clinic through the management center of the server and the MQTT message queue, that is, by sending a remote setting message to the MQTT message queue of the server, the remote setting message includes the second identifier of the consultation control terminal to be controlled or the first identifier of the consultation equipment and a setting instruction, so that the server pushes the remote setting message to the topic subscribed by the consultation control terminal with the second identifier or the consultation equipment with the first identifier according to the MQTT protocol, so that the consultation control terminal or the consultation equipment receives the setting message and executes the setting instruction, thereby realizing the control of each consultation terminal in the virtual clinic by the remote control terminal.

[0117] Specifically, Figure 5 As shown, including:

[0118] S31 . The remote control terminal 400 sends a remote setting message to the server 100 .

[0119] In this embodiment, the remote control terminal can access the server through a browser and send a remote setting message to the MQTT message queue of the server, wherein the remote setting message includes the second identifier of the consultation control terminal to be controlled or the first identifier of the consultation device and a setting instruction.

[0120] S32. The server 100 receives the remote setting message and pushes the remote setting message to a corresponding topic according to the MQTT protocol.

[0121] In this embodiment, the server 100 parses the remote setting message. For example, if the remote setting message includes the first identifier of the consultation device and the setting instruction, the server 100 pushes the remote message to the topic subscribed by the consultation device with the first identifier to ensure that the consultation device can receive the remote message.

[0122] S33. The consultation device 300 receives the remote message and executes the setting instruction.

[0123] In this embodiment, the consultation device parses the setting instructions based on the received remote setting message and executes the setting instructions, such as controlling the consultation device to adjust the angle of the camera, adjust the volume, switch the video source or adjust the video zoom ratio, etc. The specific implementation process is similar to the above-mentioned embodiment and will not be repeated here.

[0124] Similarly, if the remote message includes the second identifier of the consultation control terminal and the setting instruction, the server pushes the remote message to the topic subscribed by the consultation control terminal with the second identifier to ensure that the consultation control terminal can receive the remote message and execute the setting instruction.

[0125] This embodiment uses the MQTT protocol and the MQTT message queue set on the server side to realize the synchronous management and device management of the consultation control terminal and the consultation equipment, avoiding the problems of complex processing flow, call failure, and inability to manage too many devices at the same time caused by realizing synchronous management and device management through RPC calls or http remote calls in the prior art; at the same time, the use of the publishing and subscription topic functions of the MQTT protocol can effectively solve the bandwidth occupation problem caused by the strong coupling between the consultation equipment and the server side in the remote consultation system in the prior art, thereby saving bandwidth to transmit the video interaction between the consultation terminals, thereby improving the quality of video transmission.

[0126] like Figure 6As shown, an embodiment of the present invention provides a remote consultation control method, which is applied to a consultation control terminal, including: in response to a first operation of a user, sending a startup message to an MQTT message queue of a server, the startup message including a first identifier of a consultation device to be controlled and a startup instruction, so that the server pushes the startup message to a topic subscribed by a consultation device having the first identifier according to the MQTT protocol, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue; receiving a startup confirmation message according to the subscribed topic and entering a virtual clinic, the startup confirmation message is sent by the consultation device to the MQTT message queue of the server after completing the startup instruction, and includes the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal, and the server pushes the startup confirmation message to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol, and the virtual clinic is established by the server according to the received consultation appointment, and the virtual clinic includes one or more consultation terminals, and the consultation terminal includes a consultation control terminal and a consultation device.

[0127] In this embodiment, the consultation control terminal sends a start message to the server in response to the user's first operation of clicking the start button of the application on the tablet computer, and starts the corresponding consultation equipment through the MQTT message queue of the server according to the MQTT protocol, thereby entering the virtual clinic and starting a remote consultation. For the specific implementation method, please refer to the previous embodiment and will not be repeated here.

[0128] In an optional embodiment, before sending a startup message to the MQTT message queue of the server in response to the user's first operation, it also includes: sending an access message to the MQTT message queue of the server in response to the user's second operation, the access message including the second identifier of the consultation control terminal, so that the server queries in the database according to the access message; receiving an access confirmation message according to the subscribed topic, the access confirmation message including the second identifier of the consultation control terminal, and pushing it to the topic subscribed by the consultation control terminal with the second identifier according to the MQTT protocol after the server completes the registration or update of the consultation control terminal.

[0129] In this embodiment, before starting the corresponding consultation device, the consultation control terminal first responds to the user's second operation by clicking the access button of the application on the tablet computer to send an access message to the server, accesses the server and maintains a connection with the server to facilitate control of the consultation device. For the specific implementation method, please refer to the previous embodiment and will not be repeated here.

[0130] In an optional embodiment, after the start confirmation message is received according to the subscribed topic and the virtual clinic is entered, it also includes: sending a control message to the MQTT message queue of the server in response to the user's third operation, the control message including the first identifier of the consultation device to be controlled and the control instruction, so that the server pushes the control message to the topic subscribed by the consultation device with the first identifier according to the MQTT protocol, so that the consultation device receives the control message and executes the control instruction; receiving a control confirmation message according to the subscribed topic, the control confirmation message including the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal, and is sent to the MQTT message queue of the server after the consultation device completes the control instruction, and the server pushes the control confirmation message to the topic subscribed by the consultation control terminal with the second identifier according to the MQTT protocol.

[0131] In this embodiment, the consultation control terminal sends a control message to the server in response to the user's third operation of clicking the control button of the application on the tablet computer, that is, sends a control message to the MQTT message queue of the server, and the server pushes the control message to the topic subscribed by the consultation device to be controlled in accordance with the MQTT protocol, thereby realizing the control of the consultation device. The specific implementation method refers to the aforementioned embodiment and will not be repeated here.

[0132] like Figure 7 As shown, an embodiment of the present invention also provides a remote consultation control method, which is applied to a consultation device, including: receiving a startup message according to a subscribed topic, the startup message including a first identifier of the consultation device and a startup instruction, the startup message is sent by the consultation control terminal to the MQTT message queue of the server, and the server pushes the startup message to the topic subscribed by the consultation control terminal with the first identifier according to the MQTT protocol; executing the startup instruction and sending a startup confirmation message to the MQTT message queue of the server, the startup confirmation message including the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal, so that the server pushes the startup confirmation message to the topic subscribed by the consultation control terminal with the second identifier according to the MQTT protocol, so that the consultation control terminal receives the startup confirmation message and enters a virtual clinic, the virtual clinic is established by the server according to the received consultation appointment, and the virtual clinic includes one or more consultation terminals, and the consultation terminals include a consultation control terminal and a consultation device.

[0133] In this embodiment, the consultation device is started in response to the start instruction of the consultation control terminal by receiving the subscribed topic through the MQTT message queue of the server according to the MQTT protocol, thereby entering the consultation state and feeding back a start confirmation message, so that the consultation control terminal enters the virtual consulting room and starts the remote consultation. For the specific implementation method, please refer to the aforementioned embodiment and will not be repeated here.

[0134] In an optional embodiment, before receiving the start message according to the subscribed topic, it also includes: sending an access message to the MQTT message queue of the server, the access message including the first identifier of the consultation device, so that the server queries in the database according to the access message; receiving an access confirmation message according to the subscribed topic, and maintaining a long connection with the MQTT message queue, the access confirmation message including the first identifier of the consultation device, and pushing it to the topic subscribed by the consultation device with the first identifier according to the MQTT protocol after the server completes the registration or update of the consultation device.

[0135] In this embodiment, before starting, the consultation device first connects to the server and maintains a long connection state with the server. The specific implementation method is shown in the above embodiment and will not be described again.

[0136] In an optional embodiment, after executing the start instruction and sending a start confirmation message to the MQTT message queue of the server, it also includes: receiving a control message according to a subscribed topic, the control message including a first identifier of the consultation device to be controlled and a control instruction, sending the control message to the MQTT message queue of the server by the consultation control terminal, and pushing the control message to the topic subscribed by the consultation device with the first identifier through the server in accordance with the MQTT protocol; executing the control instruction and sending a control confirmation message to the MQTT message queue of the server, the control confirmation message including the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal, and pushing the control confirmation message to the topic subscribed by the consultation control terminal with the second identifier through the server in accordance with the MQTT protocol.

[0137] In this embodiment, the consultation device receives the control message sent by the consultation control terminal through the MQTT message queue of the server to adjust the various components of the consultation device, thereby realizing the control of the consultation device by the consultation control terminal. The specific implementation method is shown in the above embodiment and will not be repeated here.

[0138] Corresponding to the remote consultation control method provided in the above-mentioned embodiment, an embodiment of the present application also provides a remote consultation control system that executes the above-mentioned remote consultation control method. Since the remote consultation control system provided in the embodiment of the present application corresponds to the remote consultation control methods provided in the above-mentioned embodiments, the previous implementation method is also applicable to the remote consultation control system provided in this embodiment and will not be described in detail in this embodiment.

[0139] like Figure 2 As shown, an embodiment of the present application further provides a remote consultation control system for executing the above-mentioned remote consultation control method, comprising a server, at least two consultation terminals, each consultation terminal comprising a consultation control terminal and a consultation device, wherein the server comprises an MQTT message queue and a management center, and is configured to: receive a consultation appointment through the management center and establish a virtual clinic according to the consultation appointment, wherein the virtual clinic comprises one or more consultation terminals, wherein the consultation terminal comprises a consultation control terminal and a consultation device; receive a start message sent by each consultation control terminal participating in the consultation appointment through the MQTT message queue, wherein the start message comprises a first identifier of the consultation device to be controlled and a start instruction; according to M The QTT protocol pushes each of the startup messages to the topic subscribed by the consultation device corresponding to the first identifier, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue; receives the startup confirmation message fed back by each of the consultation devices after completing the startup instruction through the MQTT message queue, and the startup confirmation message includes the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal; according to the MQTT protocol, pushes each of the startup confirmation messages to the corresponding topic, so that the consultation control terminal corresponding to the second identifier subscribed to the topic receives the startup confirmation message and enters the virtual clinic.

[0140] In this embodiment, the MQTT protocol is used to implement the publication and subscription of messages by the consultation control terminal and the consultation equipment. The MQTT message queue arranged on the server side is used to proxy and forward the messages between the consultation control terminal and the consultation equipment, so as to provide instant and reliable message services for the connected remote devices by utilizing the limited bandwidth, thereby effectively simplifying the management process of the remote consultation control system and improving the real-time and reliability of the remote consultation control system.

[0141] In an optional embodiment, the remote consultation control system also includes a remote control terminal, which is configured to send a remote setting message to the MQTT message queue of the server, wherein the remote setting message includes a second identifier of the consultation control terminal to be controlled or a first identifier of the consultation device and a setting instruction, so that the server pushes the remote setting message to the topic subscribed by the consultation control terminal with the second identifier or the consultation device with the first identifier according to the MQTT protocol, so that the consultation control terminal or the consultation device receives the setting message and executes the setting instruction.

[0142] In this embodiment, the remote control terminal accesses the server through a browser and sets each consultation control terminal and the consultation equipment in the virtual clinic through the management center and the MQTT message queue of the server, that is, by sending a remote setting message to the MQTT message queue of the server to control each consultation control terminal and the consultation equipment. The specific implementation method is the same as the previous embodiment and will not be repeated here.

[0143] Another embodiment of the present invention provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements: a server receiving a consultation appointment; establishing a virtual clinic according to the consultation appointment, the virtual clinic including one or more consultation terminals, the consultation terminals including a consultation control terminal and a consultation device; receiving a startup message sent by each consultation control terminal participating in the consultation appointment through an MQTT message queue, the startup message including a first identifier of the consultation device to be controlled and a startup instruction; pushing each of the startup messages to a topic subscribed to by a consultation device having the first identifier according to the MQTT protocol, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue; receiving a startup confirmation message fed back by each of the consultation devices after completing the startup instruction through the MQTT message queue, the startup confirmation message including the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal; pushing each of the startup confirmation messages to a topic subscribed to by a consultation control terminal having the second identifier according to the MQTT protocol, so that the consultation control terminal receives the startup confirmation message and enters the virtual clinic.

[0144] Another embodiment of the present invention provides a non-transitory computer-readable storage medium having a computer program stored thereon, which is implemented when executed by a processor: the consultation control terminal sends a startup message to the MQTT message queue of the server in response to a first operation of the user, the startup message including a first identifier of the consultation device to be controlled and a startup instruction, so that the server pushes the startup message to the topic subscribed by the consultation device having the first identifier according to the MQTT protocol, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue; receives a startup confirmation message according to the subscribed topic and enters a virtual clinic, the startup confirmation message is sent by the consultation device to the MQTT message queue of the server after completing the startup instruction, and includes the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal, and the server pushes the startup confirmation message to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol, the virtual clinic is established by the server according to the received consultation appointment, and the virtual clinic includes one or more consultation terminals, and the consultation terminals include a consultation control terminal and a consultation device.

[0145] Another embodiment of the present invention provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements: the consultation device receives a startup message according to a subscribed topic, the startup message including a first identifier of the consultation device and a startup instruction, the startup message is sent by the consultation control terminal to the MQTT message queue of the server, and the server pushes the startup message to the topic subscribed by the consultation control terminal having the first identifier in accordance with the MQTT protocol; executes the startup instruction and sends a startup confirmation message to the MQTT message queue of the server, the startup confirmation message including the first identifier of the consultation device and the second identifier of the consultation control terminal corresponding to it, so that the server pushes the startup confirmation message to the topic subscribed by the consultation control terminal having the second identifier in accordance with the MQTT protocol, so that the consultation control terminal receives the startup confirmation message and enters a virtual clinic, the virtual clinic is established by the server according to the received consultation appointment, the virtual clinic includes one or more consultation terminals, and the consultation terminals include a consultation control terminal and a consultation device.

[0146] In practical applications, the computer-readable storage medium can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0147] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0148] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0149] Computer program code for performing the operations of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0150] like Figure 8As shown, a structural schematic diagram of a computer device provided by another embodiment of the present invention. Figure 8 The computer device 12 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0151] like Figure 8 As shown, the computer device 12 is in the form of a general-purpose computing device. The components of the computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that connects various system components (including the system memory 28 and the processing unit 16).

[0152] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. By way of example, these architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MAC) bus, an Enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.

[0153] The computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0154] The system memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 34 may be used to read and write non-removable, non-volatile magnetic media ( Figure 8 not shown, usually called a "hard drive"). Although Figure 8 Not shown in the figure, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 18 via one or more data medium interfaces. The memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present invention.

[0155] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in the memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 42 generally perform the functions and / or methods of the embodiments described herein.

[0156] The computer device 12 may also communicate with one or more external devices 14 (e.g., keyboards, pointing devices, displays 24, etc.), one or more devices that enable a user to interact with the computer device 12, and / or any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., network cards, modems, etc.). Such communication may be performed through an input / output (I / O) interface 22. Furthermore, the computer device 12 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) through a network adapter 20. Figure 8 As shown, the network adapter 20 communicates with other modules of the computer device 12 via the bus 18. It should be understood that although Figure 8 Not shown, other hardware and / or software modules may be used in conjunction with computer device 12, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0157] The processor unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing a remote consultation control method provided by an embodiment of the present invention.

[0158] In view of the current existing problems, the present invention develops a remote consultation control method, a remote consultation control system, a computer device and a medium, which realizes the forwarding control of messages between devices by setting up an MQTT message queue on the server side and using the MQTT protocol, thereby realizing simplified control and convenient communication between the consultation control terminal and the consultation device, between the consultation control terminal and the server, and between the consultation device and the server, thereby making up for the problems existing in the prior art, being able to improve the real-time and reliability of the remote consultation control system, effectively improving the user experience, and having broad application prospects.

[0159] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not limitations on the implementation methods of the present invention. For ordinary technicians in the relevant field, other different forms of changes or modifications can be made based on the above description. It is impossible to list all the implementation methods here. All obvious changes or modifications derived from the technical solution of the present invention are still within the protection scope of the present invention.

Claims

1. A remote consultation control method based on a remote consultation control system, applied to a server, characterized in that: The remote consultation control system includes a server and at least two consultation terminals, each of which includes a consultation control terminal and a consultation device. The remote consultation control method includes: Receive consultation appointments; Establishing a virtual consulting room according to the consultation appointment, wherein the virtual consulting room includes one or more consultation terminals, and the consultation terminals include a consultation control terminal and a consultation device; Receiving, through the MQTT message queue, a start message sent by each consultation control terminal participating in the consultation appointment, wherein the start message includes a first identifier of the consultation device to be controlled and a start instruction; Pushing each of the startup messages to a topic subscribed by a consultation device having the first identifier according to the MQTT protocol, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue; Receiving, through the MQTT message queue, a startup confirmation message fed back by each of the consultation devices after completing the startup instruction, wherein the startup confirmation message includes a first identifier of the consultation device and a second identifier of the corresponding consultation control terminal; Pushing each of the start confirmation messages to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol, so that the consultation control terminal receives the start confirmation message and enters the virtual consulting room; Also includes: Obtain messages from each consultation control terminal and each consultation device through the MQTT message queue and update their status in real time, send health detection messages to each consultation control terminal or each consultation device that has no messages within a preset time period, and if no feedback message is received from the consultation control terminal or consultation device, send an offline message according to the MQTT protocol and modify its status; The status change message of each consultation control terminal and each consultation device is received through the MQTT message queue and its status is modified, and the status change message is sent to all the consultation devices and the consultation control terminals in the virtual clinic according to the TCP protocol to broadcast the status change message.

2. The remote consultation control method according to claim 1, characterized in that: After establishing the virtual consulting room according to the consultation appointment, and before receiving the start message sent by each consultation control terminal participating in the consultation appointment through the MQTT message queue, the remote consultation control method further includes: Receiving access messages of each of the consultation control terminals and each of the consultation devices through an MQTT message queue, wherein the access message includes the second identifier of the consultation control terminal or the first identifier of the consultation device; According to each of the access messages, a query is made in the database to complete the registration or update of each of the consultation control terminals or each of the consultation devices, and the access confirmation messages of the registration or update are pushed to the corresponding topics respectively according to the MQTT protocol, wherein the access confirmation message includes the second identifier of the consultation control terminal or the first identifier of the consultation device, so that the consultation device with the first identifier or the consultation control terminal with the second identifier that subscribes to the topic receives the access confirmation message.

3. The remote consultation control method according to any one of claims 1-2, characterized in that: After pushing each of the start confirmation messages to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol, the remote consultation control method further includes: Receiving a control message sent by the consultation control terminal through an MQTT message queue, wherein the control message includes a first identifier of a consultation device to be controlled and a control instruction; Pushing the control message to the corresponding topic according to the MQTT protocol, so that the consultation device with the first identifier subscribed to the topic receives the control message and executes the control instruction; Receiving, through the MQTT message queue, a control confirmation message fed back by the consultation device after completing the control instruction, wherein the control confirmation message includes a first identifier of the consultation device and a second identifier of the corresponding consultation control terminal; The control confirmation message is pushed to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol, so that the consultation control terminal receives the control confirmation message.

4. The remote consultation control method according to claim 1, characterized in that: After pushing each of the start confirmation messages to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol, the remote consultation control method further includes: A remote setting message is received through an MQTT message queue, wherein the remote setting message includes a second identifier of a consultation control terminal to be controlled or a first identifier of a consultation device and a setting instruction, and the remote setting message is pushed to a topic subscribed to by the consultation control terminal with the second identifier or the consultation device with the first identifier according to the MQTT protocol, so that the consultation control terminal or the consultation device receives the setting message and executes the setting instruction.

5. A remote consultation control method based on a remote consultation control system, applied to a consultation control terminal, characterized in that: The remote consultation control system includes a server and at least two consultation terminals, each of which includes a consultation control terminal and a consultation device. The remote consultation control method includes: In response to a first operation of the user, a startup message is sent to an MQTT message queue of the server, wherein the startup message includes a first identifier of the consultation device to be controlled and a startup instruction, so that the server pushes the startup message to a topic subscribed by the consultation device having the first identifier according to the MQTT protocol, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue; Receive a start confirmation message according to the subscribed topic and enter the virtual clinic. The start confirmation message is sent by the consultation device to the MQTT message queue of the server after completing the start instruction, and includes the first identifier of the consultation device and the second identifier of the corresponding consultation control terminal. The server pushes the start confirmation message to the topic subscribed by the consultation control terminal with the second identifier in accordance with the MQTT protocol. The virtual clinic is established by the server according to the received consultation appointment. The virtual clinic includes one or more consultation terminals, and the consultation terminals include a consultation control terminal and a consultation device.

6. The remote consultation control method according to claim 5, characterized in that: Before sending a start message to the MQTT message queue of the server in response to the first operation of the user, the method further includes: In response to a second operation of the user, an access message is sent to an MQTT message queue of the server, wherein the access message includes a second identifier of the consultation control terminal, so that the server queries a database according to the access message; An access confirmation message is received according to the subscribed topic, wherein the access confirmation message includes the second identifier of the consultation control terminal and is pushed to the topic subscribed by the consultation control terminal having the second identifier according to the MQTT protocol after the server completes the registration or update of the consultation control terminal.

7. The remote consultation control method according to claim 5 or 6, characterized in that: After receiving the start confirmation message according to the subscribed topic and entering the virtual clinic, the method further includes: In response to a third operation of the user, a control message is sent to the MQTT message queue of the server, wherein the control message includes a first identifier of the consultation device to be controlled and a control instruction, so that the server pushes the control message to a topic subscribed by the consultation device having the first identifier according to the MQTT protocol, so that the consultation device receives the control message and executes the control instruction; A control confirmation message is received according to the subscribed topic, wherein the control confirmation message includes the first identifier of the consultation device and the second identifier of its corresponding consultation control terminal, and is sent to the MQTT message queue of the server after the consultation device completes the control instruction. The server pushes the control confirmation message to the topic subscribed by the consultation control terminal with the second identifier in accordance with the MQTT protocol.

8. A remote consultation control method based on a remote consultation control system, applied to a consultation device, characterized in that: The remote consultation control system includes a server and at least two consultation terminals, each of which includes a consultation control terminal and a consultation device. The remote consultation control method includes: Receive a startup message according to the subscribed topic, the startup message including the first identifier of the consultation device and a startup instruction, the startup message is sent by the consultation control terminal to the MQTT message queue of the server, and the server pushes the startup message to the topic subscribed by the consultation control terminal having the first identifier according to the MQTT protocol; Execute the start instruction and send a start confirmation message to the MQTT message queue of the server, the start confirmation message including the first identifier of the consultation device and the second identifier of its corresponding consultation control terminal, so that the server pushes the start confirmation message to the topic subscribed by the consultation control terminal with the second identifier in accordance with the MQTT protocol, so that the consultation control terminal receives the start confirmation message and enters the virtual clinic, the virtual clinic is established by the server according to the received consultation appointment, the virtual clinic includes one or more consultation terminals, and the consultation terminals include a consultation control terminal and a consultation device.

9. The remote consultation control method according to claim 8, characterized in that: Before receiving the start message according to the subscribed topic, the method further includes: Sending an access message to an MQTT message queue of a server, wherein the access message includes a first identifier of the consultation device, so that the server queries a database according to the access message; An access confirmation message is received according to the subscribed topic, and a long connection is maintained with the MQTT message queue. The access confirmation message includes the first identifier of the consultation device, and is pushed to the topic subscribed by the consultation device with the first identifier according to the MQTT protocol after the server completes the registration or update of the consultation device.

10. The remote consultation control method according to claim 8 or 9, characterized in that: After executing the start instruction and sending a start confirmation message to the MQTT message queue of the server, the method further includes: Receive a control message according to the subscribed topic, the control message including the first identifier of the consultation device to be controlled and a control instruction, which is sent by the consultation control terminal to the MQTT message queue of the server and pushed by the server to the topic subscribed by the consultation device having the first identifier according to the MQTT protocol; Execute the control instruction and send a control confirmation message to the MQTT message queue of the server, wherein the control confirmation message includes the first identifier of the consultation device and the second identifier of its corresponding consultation control terminal, and the server pushes the control confirmation message to the topic subscribed by the consultation control terminal with the second identifier in accordance with the MQTT protocol.

11. A remote consultation control system, characterized in that: It includes a server, at least two consultation terminals, each of which includes a consultation control terminal and a consultation device, wherein The server includes an MQTT message queue and a management center, and is configured to: Receiving a consultation appointment through a management center and establishing a virtual consulting room according to the consultation appointment, wherein the virtual consulting room includes one or more consultation terminals, and the consultation terminal includes a consultation control terminal and a consultation device; Receiving, through the MQTT message queue, a start message sent by each consultation control terminal participating in the consultation appointment, wherein the start message includes a first identifier of the consultation device to be controlled and a start instruction; Pushing each of the startup messages to the topic subscribed by the consultation device corresponding to the first identifier according to the MQTT protocol, so that the consultation device receives the startup message and executes the startup instruction, and the consultation device maintains a long connection with the MQTT message queue; Receiving, through the MQTT message queue, a startup confirmation message fed back by each of the consultation devices after completing the startup instruction, wherein the startup confirmation message includes a first identifier of the consultation device and a second identifier of the corresponding consultation control terminal; Pushing each of the start confirmation messages to the corresponding topics according to the MQTT protocol, so that the consultation control terminal corresponding to the second identifier subscribed to the topic receives the start confirmation message and enters the virtual consulting room; Also includes: Obtain messages from each consultation control terminal and each consultation device through the MQTT message queue and update their status in real time, send health detection messages to each consultation control terminal or each consultation device that has no messages within a preset time period, and if no feedback message is received from the consultation control terminal or consultation device, send an offline message according to the MQTT protocol and modify its status; The status change message of each consultation control terminal and each consultation device is received through the MQTT message queue and its status is modified, and the status change message is sent to all the consultation devices and the consultation control terminals in the virtual clinic according to the TCP protocol to broadcast the status change message.

12. The remote consultation control system according to claim 11, characterized in that: It also includes a remote control terminal, which is configured to send a remote setting message to the MQTT message queue of the server, wherein the remote setting message includes the second identifier of the consultation control terminal to be controlled or the first identifier of the consultation device and a setting instruction, so that the server pushes the remote setting message to the topic subscribed by the consultation control terminal with the second identifier or the consultation device with the first identifier according to the MQTT protocol, so that the consultation control terminal or the consultation device receives the setting message and executes the setting instruction.

13. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 4 is implemented; or When the program is executed by a processor, the method according to any one of claims 5 to 7 is implemented; or When the program is executed by a processor, the method according to any one of claims 8 to 10 is implemented.

14. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 4 is implemented; or When the processor executes the program, the method according to any one of claims 5 to 7 is implemented; or When the processor executes the program, the method according to any one of claims 8 to 10 is implemented.

Images