Remote ultrasonic diagnosis method, device and system, electronic equipment and storage medium

Abstract

The invention provides a remote ultrasonic diagnosis method, device and system, electronic equipment and a storage medium. The method comprises the following steps: acquiring first audio and video information and an ultrasonic image in a consultation server; sending a first control instruction and / or second audio and video information to a consultation server; authority application information sent by the auxiliary diagnosis end equipment is received, whether the communication control authority is allocated to the auxiliary diagnosis end equipment or not is determined, and the authority application information comprises communication authority request information and control authority request information; and after it is determined that the communication control permission is allocated to the auxiliary diagnosis end equipment, permission permission information is sent to the auxiliary diagnosis end equipment. Compared with the prior art, the information is acquired by the patient terminal equipment and uploaded to the consultation server, and the communication connection is established between the consultation server and the main diagnosis terminal equipment, the patient terminal equipment and the auxiliary diagnosis terminal equipment, so that the main diagnosis terminal equipment and the auxiliary diagnosis terminal equipment can simultaneously control the patient terminal equipment to perform consultation on the patient; and meanwhile, the auxiliary diagnosis terminal equipment can be managed and controlled.

Description

Technical Field

[0001] The present disclosure relates to the technical field of ultrasonic robots, and in particular to a method and device, system, electronic equipment and storage medium for remote ultrasonic diagnosis. Background Art

[0002] The remote ultrasound diagnosis system can be operated remotely through peer-to-peer (P2P) audio and video communication technology, which has the advantages of high diagnostic efficiency and reduced workload for doctors. The doctor's device can receive and display the patient's ultrasound image in real time, and obtain the patient's voice and video information through the microphone and camera, so that the doctor can perform remote diagnosis.

[0003] When the condition is complicated, the attending doctor may need assistance from an off-site assistant doctor. However, since the current system model only supports one doctor-side device to operate one ultrasonic robot diagnostic device, the attending doctor and the off-site assistant doctor cannot use the ultrasonic robot to provide remote consultation for the patient at the same time. Summary of the invention

[0004] The present invention provides a remote ultrasound diagnosis method and device, system, electronic device and storage medium, the main purpose of which is to enable the primary doctor and the remote assistant doctor to use the ultrasound robot to provide remote consultation for the patient at the same time.

[0005] According to a first aspect of the present disclosure, a remote ultrasound diagnosis method is provided, which is applied to a primary diagnosis terminal device, comprising:

[0006] Acquire first audio and video information and ultrasound images in the consultation server, wherein the first audio and video information and the ultrasound images are uploaded to the consultation server by at least one patient-side device;

[0007] Sending a first control instruction and / or a second audio and video information to the consultation server;

[0008] Receive permission application information sent by the auxiliary diagnosis terminal device, and determine whether to allocate communication control permission to the auxiliary diagnosis terminal device, wherein the permission application information includes communication permission request information and control permission request information;

[0009] After determining to allocate the communication control authority to the auxiliary diagnosis terminal device, authority permission information is sent to the auxiliary diagnosis terminal device.

[0010] Optionally, before acquiring the first audio and video information and the ultrasound image in the consultation server, the method further includes:

[0011] Obtain the diagnosis and treatment plan from the consultation management server;

[0012] According to the diagnosis and treatment plan and the preset communication library, establishing a first encrypted data channel with the consultation server;

[0013] Based on the first encrypted data channel and the consultation server, communication connections are established with the auxiliary diagnosis terminal device and the patient terminal device respectively.

[0014] Optionally, the obtaining of the first audio and video information and the ultrasound image in the consultation server includes:

[0015] Pulling the first audio and video information and the ultrasound image based on the first encrypted data channel and the real-time communication protocol;

[0016] The first audio and video information and the ultrasonic image are decrypted according to a preset encryption protocol.

[0017] Optionally, the method further includes:

[0018] In response to the second control instruction, authority release information is sent to the auxiliary diagnosis terminal device.

[0019] Optionally, the method further includes:

[0020] The device status information is uploaded to a device management server, wherein the device management server is used to monitor and manage the operating status of the device.

[0021] According to a second aspect of the present disclosure, a remote ultrasound diagnosis method is provided, which is applied to an auxiliary diagnosis terminal device, comprising:

[0022] Acquire first audio and video information and ultrasound images in the consultation server, wherein the first audio and video information and the ultrasound images are uploaded to the consultation server by at least one patient-side device;

[0023] Sending permission application information to the main diagnosis end, wherein the permission application information includes communication permission request information and control permission request information;

[0024] Receiving permission information sent by the primary diagnosis terminal device;

[0025] Send a third control instruction and / or third audio and video information to the consultation server.

[0026] Optionally, before acquiring the first audio and video information and the ultrasound image in the consultation server, the method further includes:

[0027] Obtain the diagnosis and treatment plan from the consultation management server;

[0028] According to the diagnosis and treatment plan and the preset communication library, establishing a second encrypted data channel with the consultation server;

[0029] Based on the second encrypted data channel and the consultation server, communication connections are established with the primary diagnosis end device and the patient end device respectively.

[0030] Optionally, the obtaining of the first audio and video information and the ultrasound image in the consultation server includes:

[0031] Pulling the first audio and video information and the ultrasound image based on the second encrypted data channel and the real-time communication protocol;

[0032] The first audio and video information and the ultrasonic image are decrypted according to a preset encryption protocol.

[0033] Optionally, the method further includes:

[0034] The device status information is uploaded to a device management server, wherein the device management server is used to monitor and manage the operating status of the device.

[0035] According to a third aspect of the present disclosure, a remote diagnosis method is provided, which is applied to a patient-side device, comprising:

[0036] Collecting first audio and video information and ultrasound images, and uploading the first audio and video information and the ultrasound images to a consultation server;

[0037] Receiving a first control instruction and / or a second audio and video information sent by a primary diagnosis terminal device; receiving a third control instruction and / or a third audio and video information sent by an auxiliary diagnosis terminal device;

[0038] According to the first control instruction and / or the third control instruction, the ultrasound probe of the patient-side device is controlled to examine the patient.

[0039] According to a fourth aspect of the present disclosure, a remote ultrasonic diagnosis device is provided, which is applied to a primary diagnosis terminal device, comprising:

[0040] A first acquisition unit is used to acquire first audio and video information and an ultrasound image in a consultation server, wherein the first audio and video information and the ultrasound image are uploaded to the consultation server by at least one patient-side device;

[0041] A first sending unit, used to send a first control instruction and / or a second audio and video information to the consultation server;

[0042] A first receiving unit is used to receive permission application information sent by the auxiliary diagnosis terminal device, and determine whether to allocate communication control authority to the auxiliary diagnosis terminal device, wherein the permission application information includes communication authority request information and control authority request information;

[0043] The second sending unit is used to send permission permission information to the auxiliary diagnosis terminal device after determining to allocate the communication control authority to the auxiliary diagnosis terminal device.

[0044] Optionally, the device further comprises:

[0045] A third acquisition unit is used to acquire a diagnosis and treatment plan from the consultation management server before the first acquisition unit acquires the first audio and video information and the ultrasound image in the consultation server;

[0046] A first establishing unit, used to establish a first encrypted data channel with the consultation server according to the diagnosis and treatment plan and a preset communication library;

[0047] The second establishing unit is used to establish communication connections with the auxiliary diagnosis terminal device and the patient terminal device respectively based on the first encrypted data channel and the consultation server.

[0048] Optionally, the first acquiring unit includes:

[0049] A first pulling module, used for pulling the first audio and video information and the ultrasonic image based on the first encrypted data channel and the real-time communication protocol;

[0050] The first decryption module is used to decrypt the first audio and video information and the ultrasonic image according to a preset encryption protocol.

[0051] Optionally, the device further comprises:

[0052] The fifth sending unit is used to send permission release information to the auxiliary diagnosis terminal device in response to the second control instruction.

[0053] Optionally, the device further comprises:

[0054] The first uploading unit is used to upload the device status information to the device management server, wherein the device management server is used to monitor and manage the running status of the device.

[0055] According to a fifth aspect of the present disclosure, there is provided a remote ultrasonic diagnosis device, which is applied to an auxiliary diagnosis terminal device, comprising:

[0056] A second acquisition unit is used to acquire first audio and video information and an ultrasound image in the consultation server, wherein the first audio and video information and the ultrasound image are uploaded to the consultation server by at least one patient-side device;

[0057] A third sending unit is used to send permission application information to the main diagnosis end, wherein the permission application information includes communication permission request information and control permission request information;

[0058] A second receiving unit, used to receive the permission information sent by the primary diagnosis terminal device;

[0059] The fourth sending unit is used to send a third control instruction and / or third audio and video information to the consultation server.

[0060] Optionally, the device further comprises:

[0061] A fourth acquisition unit is used to acquire a diagnosis and treatment plan from the consultation management server before the second acquisition unit acquires the first audio and video information and the ultrasound image in the consultation server;

[0062] A third establishing unit, used to establish a second encrypted data channel with the consultation server according to the diagnosis and treatment plan and a preset communication library;

[0063] The fourth establishing unit is used to establish communication connections with the main diagnosis end device and the patient end device respectively based on the second encrypted data channel and the consultation server.

[0064] Optionally, the second acquiring unit includes:

[0065] A second pulling module, used for pulling the first audio and video information and the ultrasonic image based on the second encrypted data channel and the real-time communication protocol;

[0066] The second decryption module is used to decrypt the first audio and video information and the ultrasonic image according to a preset encryption protocol.

[0067] Optionally, the device further comprises:

[0068] The second uploading unit is used to upload the device status information to the device management server, wherein the device management server is used to monitor and manage the running status of the device.

[0069] According to a sixth aspect of the present disclosure, there is provided a remote diagnosis apparatus, which is applied to a patient-side device, comprising:

[0070] A collection unit, used for collecting first audio and video information and ultrasonic images, and uploading the first audio and video information and the ultrasonic images to a consultation server;

[0071] A third receiving unit is used to receive the first control instruction and / or the second audio and video information sent by the primary diagnosis terminal device; receive the third control instruction and / or the third audio and video information sent by the auxiliary diagnosis terminal device;

[0072] A control unit is used to control the ultrasound probe of the patient-side device to examine the patient according to the first control instruction and / or the third control instruction.

[0073] According to a seventh aspect of the present disclosure, there is provided a remote diagnosis system, the system comprising: a patient-side device, a primary diagnosis-side device, an auxiliary diagnosis-side device, and a consultation server;

[0074] The consultation server is connected to the patient terminal device, the main diagnosis terminal device, and the auxiliary diagnosis terminal device respectively; the consultation server is used to establish a mutual communication connection between the patient terminal device, the main diagnosis terminal device, and the auxiliary diagnosis terminal device based on a preset communication library and a real-time communication protocol;

[0075] The patient-side device is used to collect first audio and video information and ultrasound images from the patient, and upload the first audio and video information and the ultrasound images to the consultation server;

[0076] The primary diagnosis end device is used to obtain the first audio and video information and the ultrasound image from the consultation server, send a second control instruction and permission information to the patient end device and the auxiliary diagnosis end device respectively, collect the second audio and video information of the primary diagnosis end, and send the second audio and video information to the consultation server;

[0077] The auxiliary diagnosis terminal device is used to obtain the first audio and video information and the ultrasound image from the consultation server, send a third control instruction and permission application information to the patient terminal device and the main diagnosis terminal device respectively, collect the third audio and video information of the auxiliary diagnosis terminal and send the third audio and video information to the consultation server;

[0078] Optionally, the system further includes: a consultation management server and a device management server:

[0079] The consultation management server is connected to the patient-side device, the main diagnosis-side device, and the auxiliary diagnosis-side device respectively; the device management server is connected to the patient-side device, the main diagnosis-side device, and the auxiliary diagnosis-side device respectively;

[0080] The consultation management server is used to manage doctor information, patient information, consultation information, and consultation service information, and to generate a diagnosis and treatment plan based on at least one of the doctor information, the patient information, the consultation information, and the consultation service information;

[0081] The device management server is used to manage the device status information sent by the patient-side device, the primary diagnosis-side device, and the auxiliary diagnosis-side device, and monitor and manage the patient-side device, the primary diagnosis-side device, and the auxiliary diagnosis-side device.

[0082] According to an eighth aspect of the present disclosure, there is provided an electronic device, including:

[0083] at least one processor; and

[0084] a memory communicatively connected to the at least one processor; wherein,

[0085] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the first aspect and / or the second aspect.

[0086] According to a ninth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method described in the first aspect and / or the second aspect.

[0087] According to a tenth aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements the method described in the first aspect and / or the second aspect.

[0088] The present disclosure provides a method and device, system, electronic device and storage medium for remote ultrasonic diagnosis, which obtains first audio and video information and ultrasonic images in a consultation server, wherein the first audio and video information and the ultrasonic images are uploaded to the consultation server by at least one patient-side device; sends a first control instruction and / or second audio and video information to the consultation server; receives permission application information sent by an auxiliary diagnosis-side device, and determines whether to allocate communication control authority to the auxiliary diagnosis-side device, wherein the permission application information includes communication authority request information and control authority request information; after determining to allocate communication control authority to the auxiliary diagnosis-side device, sends permission permission information to the auxiliary diagnosis-side device. Compared with the related art, the present disclosure uploads the information collected by the patient-side device to the consultation server, and establishes a communication connection between the consultation server and the main diagnosis-side device, the patient-side device and the auxiliary diagnosis-side device, so that the main diagnosis-side device and the auxiliary diagnosis-side device can simultaneously consult with the patient, and can also realize the management and control of the auxiliary diagnosis-side device.

[0089] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0091] Figure 1 A schematic diagram of the structure of a remote ultrasonic diagnosis system provided by an embodiment of the present disclosure;

[0092] Figure 2 A schematic diagram of the structure of another remote ultrasonic diagnosis system provided by an embodiment of the present disclosure;

[0093] Figure 3 A flowchart of a remote ultrasonic diagnosis method provided by an embodiment of the present disclosure;

[0094] Figure 4 A flowchart of another remote ultrasonic diagnosis method provided by an embodiment of the present disclosure;

[0095] Figure 5 A flowchart of another remote ultrasonic diagnosis method provided by an embodiment of the present disclosure;

[0096] Figure 6 A flowchart of another remote ultrasonic diagnosis method provided by an embodiment of the present disclosure;

[0097] Figure 7 A flowchart of another remote ultrasonic diagnosis method provided by an embodiment of the present disclosure;

[0098] Figure 8 A schematic diagram of the structure of a remote ultrasonic diagnosis device provided by an embodiment of the present disclosure;

[0099] Fig. 9 A schematic diagram of the structure of another remote ultrasonic diagnosis device provided by an embodiment of the present disclosure;

[0100] Fig.10 A schematic diagram of the structure of another remote ultrasonic diagnosis device provided by an embodiment of the present disclosure;

[0101] Fig.11 A schematic diagram of the structure of another remote ultrasonic diagnosis device provided by an embodiment of the present disclosure;

[0102] Fig.12 A schematic diagram of the structure of another remote ultrasonic diagnosis device provided by an embodiment of the present disclosure;

[0103] Fig.13 A schematic block diagram of an exemplary electronic device provided for an embodiment of the present disclosure. DETAILED DESCRIPTION

[0104] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0105] The following describes the remote ultrasound diagnosis method and apparatus, system, electronic device, and storage medium according to embodiments of the present disclosure with reference to the accompanying drawings.

[0106] Figure 1 A schematic diagram of the structure of a remote ultrasound diagnosis system provided by an embodiment of the present disclosure includes: a patient-side device 11, a primary diagnosis-side device 12, an auxiliary diagnosis-side device 13, and a consultation server 14;

[0107] The consultation server 14 is connected to the patient terminal device 11, the primary diagnosis terminal device 12, and the auxiliary diagnosis terminal device 13 respectively; the consultation server 14 is used to establish a mutual communication connection between the patient terminal device 11, the primary diagnosis terminal device 12, and the auxiliary diagnosis terminal device 13 based on a preset communication library and a real-time communication protocol;

[0108] The patient-side device 11 is used to collect first audio and video information and ultrasound images from the patient, and upload the first audio and video information and the ultrasound images to the consultation server 14;

[0109] The primary diagnosis end device 12 is used to obtain the first audio and video information and the ultrasound image from the consultation server 14, send the second control instruction and permission information to the patient end device 11 and the auxiliary diagnosis end device 13 respectively, collect the second audio and video information of the primary diagnosis end and send the second audio and video information to the consultation server 14;

[0110] The auxiliary diagnosis terminal device 13 is used to obtain the first audio and video information and the ultrasound image from the consultation server 14, send a third control instruction and permission application information to the patient terminal device 11 and the main diagnosis terminal device 12 respectively, collect the third audio and video information of the auxiliary diagnosis terminal and send the third audio and video information to the consultation server 14;

[0111] In the embodiment of the present disclosure, the patient-side device 11 of the remote ultrasound robot system (remote ultrasound diagnosis system) receives the control command of the doctor-side device (main diagnosis device 12, auxiliary diagnosis device 13), and operates the ultrasound probe through the mechanical arm to obtain the ultrasound image. The display of the patient-side device 11 displays the doctor-side image, the camera of the patient-side device 11 collects the local patient image, and the microphone of the patient-side device 11 collects the patient's voice and transmits it to the doctor to assist the doctor in diagnosis.

[0112] The doctor-assisted diagnosis system (the main diagnosis terminal device 12 or the auxiliary diagnosis terminal device 13 of the remote ultrasound diagnosis system) uses a somatosensory handle to control the remote ultrasound robot. The display of the doctor-side device (main diagnosis terminal device 12, auxiliary diagnosis terminal device 13) displays the ultrasound image and the images of the patient side and other doctor sides. The camera of the doctor-side device 11 collects the image of the local doctor, and the microphone collects the patient's voice and transmits it to the patient side or other doctor sides.

[0113] The preset communication library is used to establish encrypted data channels between the patient terminal device 11, the primary diagnosis terminal device 12, and the auxiliary diagnosis terminal device 13 and the consultation server 14, for example, it can be a real-time two-way communication library socket.io; it should be noted that the present disclosure does not limit the type of communication library used to establish the encrypted data channel. Figure 1 As shown, the patient-side device 11, the primary diagnosis-side device 12, and the auxiliary diagnosis-side device 13 are respectively connected to the consultation server 14 through a preset communication library. By using a real-time communication protocol, the remote ultrasound diagnosis system can push ultrasound images, camera images, and audio data from the microphone to the consultation server 14 in real time. The doctor can receive and display the ultrasound image on the patient side in real time, and obtain the patient's video and audio information through the camera and microphone for remote diagnosis. In this way, a communication connection can be established between the patient-side device 11, the primary diagnosis-side device 12, and the auxiliary diagnosis-side device 13 to realize online consultation of the patient, and facilitate communication between the primary doctor and the auxiliary doctor.

[0114] Further, as a possible implementation method of the present disclosure, Figure 2 As shown, the system further includes: a consultation management server 15 and a device management server 16:

[0115] The consultation management server 15 is connected to the patient terminal device 11, the main diagnosis terminal device 12, and the auxiliary diagnosis terminal device 13 respectively; the device management server 16 is connected to the patient terminal device 11, the main diagnosis terminal device 12, and the auxiliary diagnosis terminal device 13 respectively;

[0116] The consultation management server 15 is used to manage doctor information, patient information, consultation information, and consultation service information, and to generate a diagnosis and treatment plan based on at least one of the doctor information, the patient information, the consultation information, and the consultation service information;

[0117] The device management server 16 is used to manage the device status information sent by the patient-side device 11, the primary diagnosis-side device 12, and the auxiliary diagnosis-side device 13, and monitor and manage the patient-side device 11, the primary diagnosis-side device 12, and the auxiliary diagnosis-side device 13.

[0118] In the embodiment of the present disclosure, the patient-side device 11, the main diagnosis-side device 12, and the auxiliary diagnosis-side device 13 are connected to the consultation management server 15 respectively. After the patient-side device 11 is started, it automatically uses the preset connection protocol to establish a connection with the consultation management server 15, and obtains the diagnosis and treatment plan from the consultation management server 15. According to the diagnosis and treatment plan, it automatically logs in to the online consultation room of the designated consultation server 14, uses the real-time communication protocol to push the ultrasound image, camera image, and audio data from the microphone (first audio and video information and ultrasound image) to the online consultation room of the consultation server 14, and uses the preset communication library to establish an encrypted data channel with the consultation room.

[0119] After the main diagnosis terminal device 12 is started, it automatically uses the preset connection protocol to establish a connection with the consultation management server 15, and obtains the diagnosis and treatment plan from the consultation management server 15. According to the diagnosis and treatment plan, it automatically logs in to the online consultation room of the designated consultation server 14, uses the real-time communication protocol to push the ultrasound image, camera image, and microphone audio data (second control instructions, permission information, second audio and video information) to the online consultation room of the consultation server 14, and uses the preset communication library to establish an encrypted data channel with the consultation room.

[0120] After the auxiliary diagnosis terminal device 13 is started, it automatically uses the preset connection protocol to establish a connection with the consultation management server 15, and obtains the diagnosis and treatment plan from the consultation management server 15. According to the diagnosis and treatment plan, it automatically logs in to the online consultation room of the designated consultation server 14, uses the real-time communication protocol to push the ultrasound image, camera image, and audio data from the microphone (third control instruction, permission application information, third audio and video information) to the online consultation room of the consultation server 14, and uses the preset communication library to establish an encrypted data channel with the consultation room.

[0121] like Figure 1 and Figure 2 As shown, the auxiliary diagnosis terminal device 13 may include multiple devices. By using the consultation server to establish an online consultation room, the number of auxiliary diagnosis terminal devices 13 can be increased at will, so that more auxiliary doctors can provide online consultations for patients. This disclosure takes the process of establishing a diagnosis and treatment connection with a single auxiliary diagnosis terminal device 13 as an example, but this does not constitute a limitation on the number of auxiliary diagnosis terminal devices 13.

[0122] It should be noted that the consultation server 14, the consultation management server 15, and the device management server 16 may be three different physical servers, or may refer to different virtual servers on the same physical server, which is not limited in the embodiments of the present disclosure. Assigning the corresponding functions of the consultation server 14, the consultation management server 15, and the device management server 16 to different physical servers can achieve data isolation, protect the data security of the remote ultrasound diagnosis system, and enhance the security of the remote ultrasound diagnosis system.

[0123] In other embodiments of the present disclosure, the remote ultrasound diagnosis system can also be used for training new doctors. New doctors can participate in training through the auxiliary diagnosis terminal device 13, and the training instructor teaches through the main diagnosis terminal device 12; by connecting the patient terminal device 11, the main diagnosis terminal device 12, and the auxiliary diagnosis terminal device 13 to the consultation server 14 through a preset communication library. By using a real-time communication protocol, the remote ultrasound diagnosis system can push ultrasound images, camera images, and audio data from the microphone to the consultation server 14 in real time. New doctors, training instructors, and patients can achieve voice communication through the remote ultrasound diagnosis system, and new doctors and training instructors can also make diagnoses for patients; by increasing the number of auxiliary diagnosis terminal devices 13, new doctors in multiple locations can be trained at the same time. It should be noted that how many auxiliary diagnosis terminal devices 13 the remote ultrasound diagnosis system can be connected to depends on the processing capacity of the consultation server 14, and the present disclosure does not limit the number of auxiliary diagnosis terminal devices 13 in the remote ultrasound diagnosis system.

[0124] Due to factors such as uneven economic development, uneven medical levels, and uneven distribution of medical resources among regions, most experienced ultrasound doctors are concentrated in large hospitals. Many remote areas and primary medical institutions lack professional ultrasound doctors, making it impossible to conduct effective ultrasound diagnosis and receive ultrasound treatment in a timely manner, or due to limited local diagnostic capabilities, misdiagnosis or missed diagnosis occurs.

[0125] In an achievable application scenario of the present disclosure, the remote ultrasound diagnosis system can enable the doctors of the superior department to remotely observe and guide the business operations of the doctors of the subordinate departments at the same time. The subordinate doctors at the subordinate departments examine the patients by operating the auxiliary diagnosis terminal device 13, and the doctors of the superior department observe and guide the business operations of the subordinate doctors at the subordinate departments by operating the main diagnosis terminal device 12.

[0126] Figure 3 A flowchart of a remote ultrasonic diagnosis method provided in an embodiment of the present disclosure.

[0127] like Figure 3 As shown, the method comprises the following steps:

[0128] Step 201, obtaining first audio and video information and ultrasound images in a consultation server, wherein the first audio and video information and the ultrasound images are uploaded to the consultation server by at least one patient-side device.

[0129] In the embodiments of the present disclosure, the first audio and video information is the camera image and audio data from the microphone collected by the patient-side device; the ultrasonic image is the ultrasonic image information collected by the ultrasonic robot in the patient-side device. After the patient-side device is started, the ultrasonic image, camera image, and audio data from the microphone (the first audio and video information and ultrasonic image) are pushed to the online consultation room of the consultation server using a real-time communication protocol. It should be noted that the present disclosure is not limited to sending audio and video data to the online consultation room of the consultation server, and a point-to-point data connection can also be established through the consultation server.

[0130] Step 202: Send a first control instruction and / or second audio and video information to the consultation server.

[0131] In an embodiment of the present disclosure, the first control instruction is a control instruction sent by the main diagnosis-end device to the patient-end device; the main diagnosis-end device sends the first control instruction and / or the second audio and video information to the online consultation room in the consultation server; the patient-end device then pulls the first control instruction and / or the second audio and video information from the consultation server.

[0132] Step 203, receiving the permission application information sent by the auxiliary diagnosis terminal device, and determining whether to allocate communication control authority to the auxiliary diagnosis terminal device, wherein the permission application information includes communication authority request information and control authority request information.

[0133] In an embodiment of the present disclosure, when a doctor at the auxiliary diagnosis end wants to establish communication or control with a patient-side device, he needs to request corresponding authority from the main diagnosis end device. The communication control authority corresponds to the authority request information. The auxiliary diagnosis end device sends communication request information to the main diagnosis end device, and the main diagnosis end device allocates communication authority to the auxiliary diagnosis end device; the auxiliary diagnosis end device sends control request information to the main diagnosis end device, and the main diagnosis end device allocates control authority to the auxiliary diagnosis end device. Exemplarily, when establishing communication with a patient-side device, communication authority request information is sent to the main diagnosis end device; when controlling the patient-side device to establish communication, communication authority request information and control authority request information are sent to the main diagnosis end device.

[0134] If the auxiliary diagnosis device wants to establish a communication connection with the patient device, it needs to send permission application information to the main diagnosis device; this can ensure that only authorized auxiliary diagnosis devices can establish a connection with the patient device; the permissions of the slave device can be controlled and managed; the permission application process can also be used to authenticate and identify the slave device. In summary, by sending permission application information to the main diagnosis device, security, control, resource management, and authentication can be provided to ensure the safety and effective management of online conference rooms.

[0135] Step 204: after determining to allocate the communication control authority to the auxiliary diagnosis terminal device, send authority permission information to the auxiliary diagnosis terminal device.

[0136] In an embodiment of the present disclosure, after determining that the communication control authority can be assigned to the auxiliary diagnosis terminal device, the main diagnosis terminal device sends the authority permission information to the online consultation room in the consultation server. It should be noted that the present disclosure does not limit the main diagnosis terminal device to sending the authority permission information to the online consultation room in the consultation server, and the main diagnosis terminal device and the auxiliary diagnosis terminal device can also establish a point-to-point data connection through the consultation server.

[0137] The present disclosure provides a method for remote ultrasonic diagnosis, which obtains first audio and video information and ultrasonic images in a consultation server, wherein the first audio and video information and the ultrasonic images are uploaded to the consultation server by at least one patient-side device; sends a first control instruction and / or a second audio and video information to the consultation server; receives permission application information sent by an auxiliary diagnosis-side device, and determines whether to allocate communication control authority to the auxiliary diagnosis-side device, wherein the permission application information includes communication authority request information and control authority request information; after determining to allocate communication control authority to the auxiliary diagnosis-side device, sends permission permission information to the auxiliary diagnosis-side device. Compared with the related art, the present disclosure uploads the information collected by the patient-side device to the consultation server, and establishes a communication connection between the consultation server and the main diagnosis-side device, the patient-side device, and the auxiliary diagnosis-side device, so that the main diagnosis-side device and the auxiliary diagnosis-side device can simultaneously consult with the patient, and can also realize the management and control of the auxiliary diagnosis-side device.

[0138] In order to clearly illustrate the embodiments of the present disclosure, this embodiment provides Figure 4 A flowchart of another method of remote ultrasonic diagnosis is shown.

[0139] like Figure 4 As shown, the method comprises the following steps:

[0140] Step 301, obtaining a diagnosis and treatment plan from a consultation management server.

[0141] Step 302: establishing a first encrypted data channel with the consultation server according to the diagnosis and treatment plan and a preset communication library.

[0142] Step 303: Based on the first encrypted data channel and the consultation server, establish communication connections with the auxiliary diagnosis terminal device and the patient terminal device respectively.

[0143] Specifically, in the embodiments of the present disclosure, the diagnosis and treatment plan may include but is not limited to doctor information, patient information, consultation information, consultation service information, etc. The preset communication library is the real-time two-way communication library socket.io; it should be noted that the present disclosure uses the socket.io communication library as an example for explanation, which does not constitute a limitation on the preset communication library. The first encrypted data channel is an encrypted data channel established between the main diagnosis terminal device and the consultation server.

[0144] Use the HTTPS protocol to obtain the treatment plan from the consultation management server, operate the doctor's device to enter the online consultation room of the designated consultation server according to the treatment plan, use WebRTC real-time communication technology to push the camera data and microphone data to the online consultation room, and use the real-time two-way communication library socket.io to establish an encrypted data channel with the consultation room.

[0145] After establishing the first encrypted data channel with the consultation server, communication connection with the auxiliary diagnosis terminal device and the patient terminal device can be achieved.

[0146] Step 304: Pull the first audio and video information and the ultrasound image based on the first encrypted data channel and the real-time communication protocol.

[0147] Step 305: Decrypt the first audio and video information and the ultrasonic image according to a preset encryption protocol.

[0148] Specifically in the embodiments of the present disclosure, the real-time communication protocol may be but is not limited to WebRTC real-time communication technology; the preset encryption protocol may be but is not limited to common encryption strategies such as Transport Layer Security (TLS), Datagram Transport Layer Security (DTLS), and SRTP.

[0149] Step 306: Send the first control instruction and / or the second audio and video information to the consultation server.

[0150] Step 307, receiving the permission application information sent by the auxiliary diagnosis terminal device, and determining whether to allocate communication control authority to the auxiliary diagnosis terminal device, wherein the permission application information includes communication authority request information and control authority request information.

[0151] Step 308: after determining to allocate the communication control authority to the auxiliary diagnosis terminal device, send authority permission information to the auxiliary diagnosis terminal device.

[0152] For detailed descriptions of steps 306 to 308 , please refer to the above embodiment, which will not be described in detail in this embodiment.

[0153] Step 309: In response to the second control instruction, send permission release information to the auxiliary diagnosis terminal device.

[0154] Specifically, in the embodiment of the present disclosure, in order to avoid control conflicts of the remote robot during the online diagnosis process. The primary diagnosis device controlled by the attending physician is the responsible party for the consultation, and has the power to control the auxiliary diagnosis device to communicate with the patient device by voice, and has the power to control the auxiliary diagnosis device to operate the remote robot of the patient device. If the above actions need to be performed, it is necessary to send a permission application to the primary diagnosis device. At the same time, the primary diagnosis device can cancel the permissions granted to the auxiliary diagnosis device at any time.

[0155] After the online diagnosis is completed, the attending doctor will be responsible for giving a diagnosis report. If the condition is complicated, the attending doctor can interact with the assistant doctor in real time via audio or video to discuss the condition and give a diagnosis.

[0156] Furthermore, as an achievable method of the embodiment of the present disclosure, in order to monitor the device status of the main diagnosis end device, the device status information can be uploaded to the device management server, which is used to monitor and manage the operating status of the device.

[0157] Specifically, in the embodiments of the present disclosure, in order to monitor the device status of the main diagnosis end device, the device status information is uploaded to the device management server; the status of the main diagnosis end device can be monitored in real time. The device management server can receive and record various status information of the device, such as the operating status, connection status, fault alarm, etc. of the device. In this way, abnormal conditions of the device can be discovered in time, and corresponding measures can be taken to deal with them to ensure the normal operation of the device. The device management server can implement the fault early warning function by analyzing the device status information. The device management server can collect and analyze the device status information and provide reports and charts on the device usage. Through the device management server, remote management of the main diagnosis end device can be achieved.

[0158] Figure 5 A flowchart of a remote ultrasonic diagnosis method provided in an embodiment of the present disclosure.

[0159] like Figure 5 As shown, the method comprises the following steps:

[0160] Step 401, obtaining first audio and video information and ultrasound images in a consultation server, wherein the first audio and video information and the ultrasound images are uploaded to the consultation server by at least one patient-side device.

[0161] In the embodiments of the present disclosure, the first audio and video information is the camera image and audio data from the microphone collected by the patient-side device; the ultrasonic image is the ultrasonic image information collected by the ultrasonic robot in the patient-side device. After the patient-side device is started, the ultrasonic image, camera image, and audio data from the microphone (the first audio and video information and ultrasonic image) are pushed to the online consultation room of the consultation server using a real-time communication protocol. It should be noted that the present disclosure is not limited to sending audio and video data to the online consultation room of the consultation server, and a point-to-point data connection can also be established through the consultation server.

[0162] Step 402: Send permission application information to the main diagnosis end, wherein the permission application information includes communication permission request information and control permission request information.

[0163] In the embodiments of the present disclosure, when the doctor at the auxiliary diagnosis end wants to establish communication or control with the patient-side device, he needs to request the corresponding authority from the main diagnosis end device. Exemplarily, when establishing communication with the patient-side device, the communication authority request information is sent to the main diagnosis end device; when controlling the patient-side device to establish communication, the communication authority request information and the control authority request information are sent to the main diagnosis end device.

[0164] If the auxiliary diagnosis device wants to establish a communication connection with the patient device, it needs to send permission application information to the main diagnosis device; this can ensure that only authorized auxiliary diagnosis devices can establish a connection with the patient device; the permissions of the slave device can be controlled and managed; the permission application process can also be used to authenticate and identify the slave device. In summary, by sending permission application information to the main diagnosis device, security, control, resource management, and authentication can be provided to ensure the safety and effective management of online conference rooms.

[0165] Step 403: receiving permission information sent by the primary diagnosis terminal device.

[0166] In an embodiment of the present disclosure, after determining that the communication control authority can be assigned to the auxiliary diagnosis terminal device, the main diagnosis terminal device sends the authority permission information to the online consultation room in the consultation server. It should be noted that the present disclosure does not limit the main diagnosis terminal device to sending the authority permission information to the online consultation room in the consultation server, and the main diagnosis terminal device and the auxiliary diagnosis terminal device can also establish a point-to-point data connection through the consultation server.

[0167] Step 404: Send a third control instruction and / or third audio and video information to the consultation server.

[0168] In the embodiment of the present disclosure, after determining that the primary diagnosis end device has granted the corresponding authority, the camera image, audio data from the microphone, and control instructions (third control instructions and / or third audio and video information) collected by the auxiliary diagnosis end device are sent to the consultation server. The patient end device or the primary diagnosis end device directly pulls the third audio and video information from the consultation server, and the patient end device responds to the third control instruction to control the ultrasound robot to examine the patient.

[0169] The present disclosure provides a method for remote ultrasonic diagnosis, which obtains first audio and video information and ultrasonic images in a consultation server, wherein the first audio and video information and the ultrasonic images are uploaded to the consultation server by at least one patient-side device; sends permission application information to the main diagnosis end, wherein the permission application information includes communication permission request information and control permission request information; receives permission permission information sent by the main diagnosis end device; and sends a third control instruction and / or third audio and video information to the consultation server. Compared with the related art, the present disclosure uploads the information collected by the patient-side device to the consultation server, and establishes a communication connection between the consultation server and the main diagnosis end device, the patient-side device, and the auxiliary diagnosis end device, so that the main diagnosis end device and the auxiliary diagnosis end device can simultaneously consult with the patient, and can also realize the management and control of the auxiliary diagnosis end device.

[0170] In order to clearly illustrate the embodiments of the present disclosure, this embodiment provides Figure 6 A flowchart of another method of remote ultrasonic diagnosis is shown.

[0171] like Figure 6 As shown, the method comprises the following steps:

[0172] Step 501, obtaining a diagnosis and treatment plan from a consultation management server.

[0173] Step 502: Establish a second encrypted data channel with the consultation server according to the diagnosis and treatment plan and the preset communication library.

[0174] Step 503: Based on the second encrypted data channel and the consultation server, communication connections are established with the primary diagnosis device and the patient device respectively.

[0175] Specifically, in the embodiments of the present disclosure, the diagnosis and treatment plan may include but is not limited to doctor information, patient information, consultation information, consultation service information, etc. The preset communication library is the real-time two-way communication library socket.io; it should be noted that the present disclosure uses the socket.io communication library as an example for explanation, which does not constitute a limitation on the preset communication library. The second encrypted data channel is an encrypted data channel established between the auxiliary diagnosis terminal device and the consultation server.

[0176] Use the HTTPS protocol to obtain the treatment plan from the consultation management server, operate the doctor's device to enter the online consultation room of the designated consultation server according to the treatment plan, use WebRTC real-time communication technology to push the camera data and microphone data to the online consultation room, and use the real-time two-way communication library socket.io to establish an encrypted data channel with the consultation room.

[0177] After establishing the second encrypted data channel with the consultation server, the communication connection with the main diagnosis end device and the patient end device can be achieved.

[0178] Step 504: Pull the first audio and video information and the ultrasound image based on the second encrypted data channel and the real-time communication protocol.

[0179] Step 505: Decrypt the first audio and video information and the ultrasonic image according to a preset encryption protocol.

[0180] Specifically in the embodiments of the present disclosure, the real-time communication protocol may be but is not limited to WebRTC real-time communication technology; the preset encryption protocol may be but is not limited to common encryption strategies such as Transport Layer Security (TLS), Datagram Transport Layer Security (DTLS), and SRTP.

[0181] Step 506: Send permission application information to the main diagnosis end, wherein the permission application information includes communication permission request information and control permission request information.

[0182] Step 507: receiving the permission information sent by the primary diagnosis terminal device.

[0183] Step 508: Send a third control instruction and / or third audio and video information to the consultation server.

[0184] For detailed descriptions of steps 506 to 508, please refer to the above embodiment, which will not be described in detail in this embodiment.

[0185] Furthermore, as an achievable method of the embodiment of the present disclosure, in order to monitor the device status of the auxiliary diagnosis terminal device, the device status information can be uploaded to the device management server, wherein the device management server is used to monitor and manage the operating status of the device.

[0186] Specifically, in the embodiments of the present disclosure, in order to monitor the device status of the auxiliary diagnosis end device, the device status information is uploaded to the device management server; the status of the main diagnosis end device can be monitored in real time. The device management server can receive and record various status information of the device, such as the operating status, connection status, fault alarm, etc. of the device. In this way, abnormal conditions of the device can be discovered in time, and corresponding measures can be taken to deal with them to ensure the normal operation of the device. The device management server can implement the fault early warning function by analyzing the device status information. The device management server can collect and analyze the device status information and provide reports and charts on the device usage. Through the device management server, remote management of the main diagnosis end device can be achieved.

[0187] Figure 7 A flowchart of a remote ultrasonic diagnosis method provided in an embodiment of the present disclosure.

[0188] like Figure 7 As shown, the method comprises the following steps:

[0189] Step 601: collect first audio and video information and ultrasound images, and upload the first audio and video information and the ultrasound images to a consultation server.

[0190] In the embodiment of the present disclosure, the patient-side device collects the first audio and video information of the patient-side through audio and video collection devices such as cameras and microphones, collects the ultrasound image of the patient through an ultrasound probe, and uploads the first audio and video information and the ultrasound image to the consultation server.

[0191] In other embodiments of the present disclosure, multiple patient-side devices simultaneously upload the first audio and video information and ultrasound images to the consultation server. The patient-side device automatically uses the HTTPS protocol to obtain the diagnosis and treatment plan from the consultation management server, automatically logs in to the online consultation room of the designated consultation server according to the diagnosis and treatment plan, and uses WebRTC real-time communication technology to push the first audio and video information and ultrasound images to the online consultation room, and uses the real-time two-way communication library socket.io to establish an encrypted data channel with the consultation room. The technologies used for data encryption include, but are not limited to, common encryption strategies such as the Secure Transport Layer Protocol (TLS), the Datagram Security Protocol (DTLS), and the Encrypted RTP Protocol (SRTP).

[0192] Step 602, receiving a first control instruction and / or second audio and video information sent by a primary diagnosis terminal device; receiving a third control instruction and / or third audio and video information sent by an auxiliary diagnosis terminal device.

[0193] In the embodiments of the present disclosure, after the consultation is conducted based on the first audio and video information and the ultrasound image, the primary diagnosis end device generates a first control instruction and / or a second audio and video information; the auxiliary diagnosis end device generates a third control instruction and / or a third audio and video information. It should be noted that in the present disclosure, communication is established by establishing an online consultation room, and the number of auxiliary diagnosis end devices and patient end devices connected is not limited; the use scenarios triggered by this will not be described in detail in the present disclosure.

[0194] Step 603: According to the first control instruction and / or the third control instruction, control the ultrasound probe of the patient-side device to examine the patient.

[0195] In the embodiment of the present disclosure, after receiving the control instruction, the patient-side device will perform an ultrasound examination on the patient according to the control instruction. It should be noted that since the primary diagnosis device has the highest control authority, the patient-side device has a higher execution priority for the first control instruction of the primary diagnosis device.

[0196] It should be noted that the embodiments of the present disclosure may include multiple steps. For the convenience of description, these steps are numbered, but these numbers do not limit the execution time slots or execution order between the steps; these steps can be implemented in any order, and the embodiments of the present disclosure do not limit this.

[0197] Corresponding to the above-mentioned remote ultrasonic diagnosis method, the present invention also provides a remote ultrasonic diagnosis device. Since the device embodiment of the present invention corresponds to the above-mentioned method embodiment, details not disclosed in the device embodiment can be referred to the above-mentioned method embodiment, and will not be repeated in the present invention.

[0198] Figure 8 A schematic diagram of the structure of a remote ultrasonic diagnosis device provided by an embodiment of the present disclosure is shown in FIG. Figure 8 As shown, including:

[0199] A first acquisition unit 71 is used to acquire first audio and video information and an ultrasound image in a consultation server, wherein the first audio and video information and the ultrasound image are uploaded to the consultation server by a patient-side device;

[0200] A first sending unit 72, configured to send a first control instruction and / or second audio and video information to the consultation server;

[0201] The first receiving unit 73 is used to receive the permission application information sent by the auxiliary diagnosis terminal device, and determine whether to allocate communication control authority to the auxiliary diagnosis terminal device, wherein the permission application information includes communication authority request information and control authority request information;

[0202] The second sending unit 74 is used to send permission permission information to the auxiliary diagnosis terminal device after determining to allocate the communication control authority to the auxiliary diagnosis terminal device.

[0203] The present disclosure provides a device for remote ultrasonic diagnosis, which obtains first audio and video information and ultrasonic images in a consultation server, wherein the first audio and video information and the ultrasonic images are uploaded to the consultation server by at least one patient-side device; sends a first control instruction and / or a second audio and video information to the consultation server; receives permission application information sent by an auxiliary diagnosis-side device, and determines whether to allocate communication control authority to the auxiliary diagnosis-side device, wherein the permission application information includes communication authority request information and control authority request information; after determining to allocate communication control authority to the auxiliary diagnosis-side device, sends permission permission information to the auxiliary diagnosis-side device. Compared with the related art, the present disclosure uploads the information collected by the patient-side device to the consultation server, and establishes a communication connection between the consultation server and the main diagnosis-side device, the patient-side device, and the auxiliary diagnosis-side device, so that the main diagnosis-side device and the auxiliary diagnosis-side device can simultaneously consult with the patient, and can also realize the management and control of the auxiliary diagnosis-side device.

[0204] Furthermore, in a possible implementation of this embodiment, as Fig. 9 As shown, the device also includes:

[0205] The third acquisition unit 75 is used to acquire the diagnosis and treatment plan from the consultation management server before the first acquisition unit acquires the first audio and video information and the ultrasound image in the consultation server;

[0206] A first establishing unit 76, configured to establish a first encrypted data channel with the consultation server according to the diagnosis and treatment plan and a preset communication library;

[0207] The second establishing unit 77 is used to establish communication connections with the auxiliary diagnosis terminal device and the patient terminal device respectively based on the first encrypted data channel and the consultation server.

[0208] Furthermore, in a possible implementation of this embodiment, as Fig. 9 As shown, the first acquisition unit 61 includes:

[0209] A first pulling module 711 is used to pull the first audio and video information and the ultrasonic image based on the first encrypted data channel and the real-time communication protocol;

[0210] The first decryption module 712 is used to decrypt the first audio and video information and the ultrasonic image according to a preset encryption protocol.

[0211] Furthermore, in a possible implementation of this embodiment, as Fig. 9As shown, the device also includes:

[0212] The fifth sending unit 78 is used to send permission release information to the auxiliary diagnosis terminal device in response to the second control instruction.

[0213] Furthermore, in a possible implementation of this embodiment, as Fig. 9 As shown, the device also includes:

[0214] The first uploading unit 79 is used to upload the device status information to the device management server, wherein the device management server is used to monitor and manage the running status of the device.

[0215] Fig.10 A schematic diagram of the structure of a remote ultrasonic diagnosis device provided by an embodiment of the present disclosure is shown in FIG. Fig.10 As shown, including:

[0216] A second acquisition unit 81 is used to acquire first audio and video information and an ultrasound image in the consultation server, wherein the first audio and video information and the ultrasound image are uploaded to the consultation server by a patient-side device;

[0217] The third sending unit 82 is used to send permission application information to the main diagnosis end, wherein the permission application information includes communication permission request information and control permission request information;

[0218] The second receiving unit 83 is used to receive the permission information sent by the main diagnosis terminal device;

[0219] The fourth sending unit 84 is used to send a third control instruction and / or third audio and video information to the consultation server.

[0220] The present disclosure provides a device for remote ultrasonic diagnosis, which obtains first audio and video information and ultrasonic images in a consultation server, wherein the first audio and video information and the ultrasonic images are uploaded to the consultation server by at least one patient-side device; sends permission application information to the main diagnosis end, wherein the permission application information includes communication permission request information and control permission request information; receives permission permission information sent by the main diagnosis end device; and sends a third control instruction and / or third audio and video information to the consultation server. Compared with the related art, the present disclosure uploads the information collected by the patient-side device to the consultation server, and establishes a communication connection between the consultation server and the main diagnosis end device, the patient-side device, and the auxiliary diagnosis end device, so that the main diagnosis end device and the auxiliary diagnosis end device can simultaneously consult with the patient, and can also realize the management and control of the auxiliary diagnosis end device.

[0221] Furthermore, in a possible implementation of this embodiment, as Fig.11 As shown, the device also includes:

[0222] The fourth acquisition unit 85 is used to acquire the diagnosis and treatment plan from the consultation management server before the second acquisition unit acquires the first audio and video information and the ultrasound image in the consultation server;

[0223] A third establishing unit 86 is used to establish a second encrypted data channel with the consultation server according to the diagnosis and treatment plan and the preset communication library;

[0224] The fourth establishing unit 87 is used to establish communication connections with the primary diagnosis end device and the patient end device respectively based on the second encrypted data channel and the consultation server.

[0225] Furthermore, in a possible implementation of this embodiment, as Fig.11 As shown, the second acquisition unit 71 includes:

[0226] A second pulling module 811 is used to pull the first audio and video information and the ultrasonic image based on the second encrypted data channel and the real-time communication protocol;

[0227] The second decryption module 812 is used to decrypt the first audio and video information and the ultrasonic image according to a preset encryption protocol.

[0228] Furthermore, in a possible implementation of this embodiment, as Fig.11 As shown, the device also includes:

[0229] The second uploading unit 88 is used to upload the device status information to the device management server, wherein the device management server is used to monitor and manage the running status of the device.

[0230] Fig.12 A schematic diagram of the structure of a remote ultrasonic diagnosis device provided by an embodiment of the present disclosure is shown in FIG. Fig.12 As shown, including:

[0231] A collection unit 91 is used to collect first audio and video information and ultrasound images, and upload the first audio and video information and the ultrasound images to a consultation server;

[0232] The third receiving unit 92 is used to receive the first control instruction and / or the second audio and video information sent by the primary diagnosis terminal device; receive the third control instruction and / or the third audio and video information sent by the auxiliary diagnosis terminal device;

[0233] The control unit 93 is used to control the ultrasound probe of the patient-side device to examine the patient according to the first control instruction and / or the third control instruction.

[0234] It should be noted that the above explanation of the method embodiment is also applicable to the device of this embodiment, and the principle is the same, which is not limited in this embodiment.

[0235] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0236] Fig.13 A schematic block diagram of an example electronic device 1000 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0237] like Fig.13 As shown, the device 1000 includes a computing unit 1001, which can perform various appropriate actions and processes according to a computer program stored in a ROM (Read-Only Memory) 1002 or a computer program loaded from a storage unit 1008 to a RAM (Random Access Memory) 1003. In the RAM 1003, various programs and data required for the operation of the device 1000 can also be stored. The computing unit 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An I / O (Input / Output) interface 1005 is also connected to the bus 1004.

[0238] A number of components in the device 1000 are connected to the I / O interface 1005, including: an input unit 1006, such as a keyboard, a mouse, etc.; an output unit 1007, such as various types of displays, speakers, etc.; a storage unit 1008, such as a disk, an optical disk, etc.; and a communication unit 1009, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1009 allows the device 1000 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0239] The computing unit 1001 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1001 include, but are not limited to, a CPU (Central Processing Unit), a GPU (Graphic Processing Units), various dedicated AI (Artificial Intelligence) computing chips, various computing units running machine learning model algorithms, a DSP (Digital Signal Processor), and any appropriate processor, controller, microcontroller, etc. The computing unit 1001 performs the various methods and processes described above, such as a method for remote ultrasound diagnosis. For example, in some embodiments, the method for remote ultrasound diagnosis may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 1008. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 1000 via the ROM 1002 and / or the communication unit 1009. When the computer program is loaded into the RAM 1003 and executed by the computing unit 1001, one or more steps of the method described above may be performed. Alternatively, in other embodiments, the computing unit 1001 may be configured to perform the aforementioned remote ultrasound diagnosis method in any other appropriate manner (eg, by means of firmware).

[0240] Various embodiments of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, FPGAs (Field Programmable Gate Arrays), ASICs (Application-Specific Integrated Circuits), ASSPs (Application Specific Standard Products), SOCs (System On Chips), CPLDs (Complex Programmable Logic Devices), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that may be executed and / or interpreted on a programmable system including at least one programmable processor that may be a special purpose or general purpose programmable processor that may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0241] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0242] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a RAM, a ROM, an EPROM (Electrically Programmable Read-Only-Memory) or a flash memory, an optical fiber, a CD-ROM (Compact Dis sc Read-Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0243] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball), through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0244] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: LAN (Local Area Network), WAN (Wide Area Network), the Internet, and blockchain networks.

[0245] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server combined with a blockchain.

[0246] It should be noted that artificial intelligence is a discipline that studies how computers can simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), and includes both hardware-level and software-level technologies. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, as well as machine learning / deep learning, big data processing technology, knowledge graph technology, and other major directions.

[0247] The various numerical numbers such as first and second involved in the present disclosure are only for the convenience of description and are not used to limit the scope of the embodiments of the present disclosure, but also indicate the order of precedence.

[0248] At least one in the present disclosure may also be described as one or more, and a plurality may be two, three, four or more, which is not limited in the present disclosure. In the embodiments of the present disclosure, for a technical feature, the technical features in the technical feature are distinguished by "first", "second", "third", "A", "B", "C" and "D", etc., and there is no order of precedence or size between the technical features described by the "first", "second", "third", "A", "B", "C" and "D".

[0249] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0250] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A remote diagnosis method, characterized in that: Applied to the main diagnosis equipment, including: Acquire first audio and video information and ultrasound images in the consultation server, wherein the first audio and video information and the ultrasound images are uploaded to the consultation server by at least one patient-side device; Sending a first control instruction and / or a second audio and video information to the consultation server; Receive permission application information sent by the auxiliary diagnosis terminal device, and determine whether to allocate communication control permission to the auxiliary diagnosis terminal device, wherein the permission application information includes communication permission request information and control permission request information; After determining to allocate the communication control authority to the auxiliary diagnosis terminal device, authority permission information is sent to the auxiliary diagnosis terminal device.

2. The method according to claim 1, characterized in that Before acquiring the first audio and video information and the ultrasound image in the consultation server, the method further includes: Obtain the diagnosis and treatment plan from the consultation management server; According to the diagnosis and treatment plan and the preset communication library, establishing a first encrypted data channel with the consultation server; Based on the first encrypted data channel and the consultation server, communication connections are established with the auxiliary diagnosis terminal device and the patient terminal device respectively.

3. The method according to claim 2, characterized in that The step of obtaining the first audio and video information and the ultrasound image from the consultation server includes: Pulling the first audio and video information and the ultrasound image based on the first encrypted data channel and the real-time communication protocol; The first audio and video information and the ultrasonic image are decrypted according to a preset encryption protocol.

4. The method according to claim 1, characterized in that: The method further comprises: In response to the second control instruction, authority release information is sent to the auxiliary diagnosis terminal device.

5. The method according to claim 1, characterized in that The method further comprises: The device status information is uploaded to a device management server, wherein the device management server is used to monitor and manage the operating status of the device.

6. A remote diagnosis method, characterized in that: Applied to auxiliary diagnosis equipment, including: Acquire first audio and video information and ultrasound images in the consultation server, wherein the first audio and video information and the ultrasound images are uploaded to the consultation server by at least one patient-side device; Sending permission application information to the main diagnosis end, wherein the permission application information includes communication permission request information and control permission request information; Receiving permission information sent by the primary diagnosis terminal device; Send a third control instruction and / or third audio and video information to the consultation server.

7. The method according to claim 6, characterized in that Before acquiring the first audio and video information and the ultrasound image in the consultation server, the method further includes: Obtain the diagnosis and treatment plan from the consultation management server; Establishing a second encrypted data channel with the consultation server according to the diagnosis and treatment plan and the preset communication library; Based on the second encrypted data channel and the consultation server, communication connections are established with the primary diagnosis end device and the patient end device respectively.

8. The method according to claim 6, characterized in that The step of obtaining the first audio and video information and the ultrasound image from the consultation server includes: Pulling the first audio and video information and the ultrasound image based on the second encrypted data channel and the real-time communication protocol; The first audio and video information and the ultrasonic image are decrypted according to a preset encryption protocol.

9. The method according to claim 6, characterized in that The method further comprises: The device status information is uploaded to a device management server, wherein the device management server is used to monitor and manage the operating status of the device.

10. A remote diagnosis method, characterized in that: Applied to patient-side devices, including: Collecting first audio and video information and ultrasound images, and uploading the first audio and video information and the ultrasound images to a consultation server; Receiving a first control instruction and / or a second audio and video information sent by a primary diagnosis terminal device; receiving a third control instruction and / or a third audio and video information sent by an auxiliary diagnosis terminal device; According to the first control instruction and / or the third control instruction, the ultrasound probe of the patient-side device is controlled to examine the patient.

11. A remote diagnosis device, characterized in that: Applied to the main diagnosis equipment, including: A first acquisition unit is used to acquire first audio and video information and an ultrasound image in a consultation server, wherein the first audio and video information and the ultrasound image are uploaded to the consultation server by at least one patient-side device; A first sending unit, used to send a first control instruction and / or a second audio and video information to the consultation server; A first receiving unit is used to receive permission application information sent by the auxiliary diagnosis terminal device, and determine whether to allocate communication control authority to the auxiliary diagnosis terminal device, wherein the permission application information includes communication authority request information and control authority request information; The second sending unit is used to send permission permission information to the auxiliary diagnosis terminal device after determining to allocate the communication control authority to the auxiliary diagnosis terminal device.

12. A remote diagnosis device, characterized in that: Applied to auxiliary diagnosis equipment, including: A second acquisition unit is used to acquire first audio and video information and an ultrasound image in the consultation server, wherein the first audio and video information and the ultrasound image are uploaded to the consultation server by at least one patient-side device; A third sending unit is used to send permission application information to the main diagnosis end, wherein the permission application information includes communication permission request information and control permission request information; A second receiving unit, used to receive the permission information sent by the primary diagnosis terminal device; The fourth sending unit is used to send a third control instruction and / or third audio and video information to the consultation server.

13. A remote diagnosis device, characterized in that: Applied to patient-side devices, including: A collection unit, used for collecting first audio and video information and ultrasonic images, and uploading the first audio and video information and the ultrasonic images to a consultation server; A third receiving unit is used to receive the first control instruction and / or the second audio and video information sent by the primary diagnosis terminal device; receive the third control instruction and / or the third audio and video information sent by the auxiliary diagnosis terminal device; A control unit is used to control the ultrasound probe of the patient-side device to examine the patient according to the first control instruction and / or the third control instruction.

14. A remote diagnosis system, characterized in that: The system includes: patient-side equipment, primary diagnosis-side equipment, auxiliary diagnosis-side equipment, and consultation server; The consultation server is connected to the patient terminal device, the main diagnosis terminal device, and the auxiliary diagnosis terminal device respectively; the consultation server is used to establish a mutual communication connection between the patient terminal device, the main diagnosis terminal device, and the auxiliary diagnosis terminal device based on a preset communication library and a real-time communication protocol; The patient-side device is used to collect first audio and video information and ultrasound images from the patient, and upload the first audio and video information and the ultrasound images to the consultation server; The primary diagnosis end device is used to obtain the first audio and video information and the ultrasound image from the consultation server, send a second control instruction and permission information to the patient end device and the auxiliary diagnosis end device respectively, collect the second audio and video information of the primary diagnosis end, and send the second audio and video information to the consultation server; The auxiliary diagnosis end device is used to obtain the first audio and video information and the ultrasound image from the consultation server, send third control instructions and permission application information to the patient end device and the main diagnosis end device respectively, collect the third audio and video information of the auxiliary diagnosis end and send the third audio and video information to the consultation server.

15. The system according to claim 14, characterized in that The system also includes: a consultation management server and a device management server: The consultation management server is connected to the patient-side device, the main diagnosis-side device, and the auxiliary diagnosis-side device respectively; the device management server is connected to the patient-side device, the main diagnosis-side device, and the auxiliary diagnosis-side device respectively; The consultation management server is used to manage doctor information, patient information, consultation information, and consultation service information, and to generate a diagnosis and treatment plan based on at least one of the doctor information, the patient information, the consultation information, and the consultation service information; The device management server is used to manage the device status information sent by the patient-side device, the primary diagnosis-side device, and the auxiliary diagnosis-side device, and monitor and manage the patient-side device, the primary diagnosis-side device, and the auxiliary diagnosis-side device.

16. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 10.

Images