A medical message processing system and method, storage medium and electronic device

Abstract

The present application discloses an instant messaging system, including a medical terminal carried by medical personnel and a server; the medical terminal is used to obtain medical messages sent by the server that need to be processed by the medical personnel, play the medical messages to the medical personnel by voice, send a voice query request message to the server for obtaining the associated information of the medical messages, obtain the associated information of the medical messages returned by the server, play the associated information of the medical messages to the medical personnel by voice, and send the voice reply information to the server; the server is used to obtain the medical messages, send the medical messages, obtain the voice query request for the associated information of the medical messages, send the associated information of the medical messages, and send the voice reply information of the medical messages. The present application solves the problem of hospital medical personnel timely receiving or processing the business system information within the hospital and communicating instantly.

Description

Technical Field

[0001] The present application relates to the field of instant messaging, and more particularly to a medical message processing system. The present application also relates to a medical message processing method, a storage medium and an electronic device. Background Art

[0002] With the continuous development of computer application technology and Internet technology, various application communication services, especially information communication service systems, have become an indispensable part of life. In patient-centered modern medical services, the interaction and sharing of information between business systems and clinical work are very important. The timeliness of medical communication and collaboration is directly related to the safety of patients.

[0003] However, in the existing technology, the internal communication service of the hospital only provides the access and exchange functions of voice calls, and the commonly used communication means include wired communication within the hospital (internal program-controlled exchange), cluster intercom system, etc. The traditional communication service system supports a single communication function, weak information exchange capability, poor intelligent communication interaction experience, and is prone to problems such as untimely call response between medical staff and between doctors and patients, and excessive ineffective communication, which affects patient safety, reduces the processing efficiency of clinicians, increases patients' hospitalization time, and poses the risk of medical disputes.

[0004] Therefore, how to provide a convenient, efficient, intelligent and secure instant information communication system for client personnel between medical staff and nurses, and between doctors and patients in the medical system is an urgent problem to be solved. Summary of the invention

[0005] The present application provides a medical message processing system and method, storage medium and electronic device to enable medical staff in a hospital to timely receive or process business system information within the hospital, instant voice communication or voice messages, solve the problem of untimely communication in clinical medical activities, and improve the work efficiency of medical staff.

[0006] The present application provides a medical message processing system, including a medical terminal carried by medical personnel and a server;

[0007] The medical terminal is used to obtain the medical message sent by the server that needs to be processed by the medical staff, determine the emergency level of the medical message and the current behavior mode of the medical staff, and if the emergency level of the medical message reaches or exceeds the preset emergency level, and the current behavior mode of the medical staff is the medical treatment behavior mode, then the emergency level of the medical message and the medical message are played to the medical staff in voice, in response to detecting the voice query request of the medical staff for the associated information of the medical message, send a query request message for obtaining the associated information of the medical message to the server, obtain the associated information of the medical message returned by the server, play the associated information of the medical message to the medical staff in voice, and in response to detecting the voice reply information input by the medical staff in voice mode for the medical message, send the voice reply information to the server;

[0008] The service end is used to obtain the medical message, send the medical message to the medical terminal, obtain the query request message sent by the medical terminal, obtain the associated information of the medical message, send the associated information of the medical message to the medical terminal, and obtain the voice reply information sent by the medical terminal.

[0009] Optionally, the medical terminal is specifically used to extract medical keywords from the medical message, obtain the emergency level corresponding to the medical keyword according to the medical keyword and the correspondence between the preset emergency level and the medical keyword, and determine the emergency level of the medical message according to the emergency level corresponding to the medical keyword;

[0010] Alternatively, the medical terminal is specifically used to obtain emergency level information for the medical message sent by the service end, and determine the emergency level of the medical message according to the emergency level information for the medical message.

[0011] Optionally, the medical terminal is specifically used to play behavior pattern inquiry information for inquiring the medical staff about the current behavior pattern of the medical staff by voice, obtain the current behavior pattern information of the medical staff in response to the behavior pattern inquiry information input by the medical staff by voice, and judge the current behavior pattern of the medical staff according to the current behavior pattern information of the medical staff replied by the medical staff;

[0012] Alternatively, the medical terminal is specifically used to determine whether the medical staff is currently in a medical treatment environment according to the current geographical location information of the medical terminal, and determine the current behavior mode of the medical staff by determining whether the medical staff is currently in a medical treatment environment;

[0013] Alternatively, the medical terminal is specifically used to determine whether the medical staff is currently in a medical treatment environment based on medical environment parameters collected by the medical environment sensor in the medical terminal, and to determine the current behavior pattern of the medical staff by determining whether the medical staff is currently in a medical treatment environment.

[0014] Optionally, the medical terminal is specifically used to determine whether the medical staff is currently in a medical treatment environment based on the medical odor parameters and / or medical sound parameters collected by the medical environment sensor.

[0015] Optionally, the associated information of the medical message includes:

[0016] Medical memo data corresponding to the patient information in the medical message.

[0017] Optionally, the associated information of the medical message includes the following two types of information:

[0018] Medical memo data corresponding to the patient information in the medical message;

[0019] The contact information of the medical staff corresponding to the patient information in the medical message.

[0020] Optionally, the associated information of the medical message includes the following three types of information:

[0021] Medical memo data corresponding to the patient information in the medical message;

[0022] The contact information of the medical staff corresponding to the patient information in the medical message;

[0023] The contact information of the medical personnel who can handle the disease or symptom corresponding to the medical keyword in the medical message.

[0024] Optionally, the voice reply information includes medical treatment suggestion information for the disease or symptom corresponding to the medical keyword in the medical message.

[0025] Optionally, the medical terminal is further used to send the medical memorandum data to the server when detecting the medical memorandum data corresponding to the patient information in the medical message input by the medical staff by voice before obtaining the medical message;

[0026] The server is also used to store the medical memorandum data.

[0027] Optionally, the medical terminal is also used to enter a voice interaction mode for performing voice interaction operations when it is in a dormant state and detects a voice wake-up phrase preset for the medical terminal input by the medical staff through voice.

[0028] Optionally, the medical terminal is further used to query contact information corresponding to the personnel name if the medical staff detects the personnel name input by voice, and send a first voice request message to the server for requesting the terminal corresponding to the personnel name to perform voice interaction according to the contact information corresponding to the personnel name;

[0029] The server is also used to obtain the first voice request message, obtain the contact information corresponding to the personnel name according to the first voice request message, and send a second voice request message to the terminal corresponding to the personnel name according to the contact information corresponding to the personnel name, which is used to indicate that the medical terminal requests voice interaction with the terminal corresponding to the personnel name.

[0030] Optionally, the medical terminal is further used for displaying a voice call interface for making a voice call to the target person if it is detected that the medical staff has input a voice call request to the target person by voice, and for displaying a message interface for the medical staff to leave a message to the target person if it is detected that the terminal corresponding to the target person has not answered the voice call request within a preset time period, and in response to detecting the voice message information for the target person input by the medical staff by voice, sending the voice message information to the server;

[0031] The service end is used to obtain the voice message information sent by the medical terminal and send the voice message information to the terminal corresponding to the target person.

[0032] The present application also provides a medical message processing method, which is applied to a medical terminal carried by medical personnel, and the method includes:

[0033] Obtaining a medical message sent by the server that needs to be processed by the medical staff;

[0034] Determining the urgency level of the medical message and the current behavior pattern of the medical staff;

[0035] If the emergency level of the medical message reaches or exceeds the preset emergency level, and the current behavior mode of the medical staff is the medical treatment behavior mode, the emergency level of the medical message and the medical message are played to the medical staff in voice;

[0036] In response to detecting a voice query request by the medical staff for the associated information of the medical message, sending a query request message for obtaining the associated information of the medical message to the server;

[0037] Obtaining the associated information of the medical message returned by the server;

[0038] Playing the associated information of the medical message to the medical staff in voice;

[0039] In response to detecting the voice reply information input by the medical staff in voice mode for the medical message, the voice reply information is sent to the server.

[0040] The present application also provides a medical message processing method, which is applied to a server, and the method comprises:

[0041] Obtain medical information that requires medical personnel to handle;

[0042] Sending the medical message to the medical terminal carried by the medical staff;

[0043] Obtaining a query request message for the medical staff regarding the associated information of the medical message, sent by the medical terminal;

[0044] Obtaining related information of the medical message;

[0045] Sending the associated information of the medical message to the medical terminal;

[0046] Obtaining voice reply information for the medical message sent by the medical terminal.

[0047] The present application also provides an electronic device, the electronic device comprising: a processor;

[0048] The memory is used to store a computer program, and when the computer program is read and executed by the processor, it runs the medical message processing method described above.

[0049] The present application also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the medical message processing method described above is executed.

[0050] Compared with the prior art, this application has the following advantages:

[0051] The present application provides a medical message processing system, including a medical terminal carried by medical personnel and a server; the medical terminal is used to obtain the medical message sent by the server that needs to be processed by the medical personnel, and judge the emergency level of the medical message and the current behavior mode of the medical personnel. If the emergency level of the medical message reaches or exceeds the preset emergency level, and the current behavior mode of the medical personnel is the medical treatment behavior mode, the emergency level of the medical message and the medical message are played to the medical personnel in voice. In response to detecting the voice query request of the medical personnel for the associated information of the medical message, a query request message for obtaining the associated information of the medical message is sent to the server, the associated information of the medical message returned by the server is obtained, and the associated information of the medical message is played to the medical personnel in voice. In response to detecting the voice reply information input by the medical personnel in voice mode for the medical message, the voice reply information is sent to the server. The server is used to obtain the medical message, send the medical message to the medical terminal, obtain the query request message sent by the medical terminal, obtain the associated information of the medical message, send the associated information of the medical message to the medical terminal, and obtain the voice reply message sent by the medical terminal. Therefore, the medical terminal carried by medical staff in the hospital and the medical message processing system of the server can be used to obtain the medical message sent by the server that needs to be processed by the medical staff, determine the emergency level of the medical message and the current behavior pattern of the medical staff, and play the emergency level of the medical message and the medical message to the medical staff in voice, thereby solving the problem that medical staff in the hospital cannot communicate in voice in time. In response to detecting the voice query request of the medical staff for the associated information of the medical message, the medical terminal sends a query request message for obtaining the associated information of the medical message to the server, obtains the associated information of the medical message returned by the server, plays the associated information of the medical message to the medical staff by voice, and promptly receives and / or processes the business message in the Hospital Information System (HIS system) of the server in response to detecting the voice reply information input by the medical staff for the medical message by voice through the medical terminal.The medical terminal responds to detecting the voice reply information input by the medical staff in voice mode for the medical message and sends the voice reply information to the server. The medical staff can make voice memos of medical messages such as medical record handover for the patient, and can transcribe the medical messages of the voice memos into text and send the medical messages to the server. The server applies the medical messages to the Hospital Management Information System (HIS), thereby solving the problem of untimely communication in clinical medical activities and improving the work efficiency of medical staff. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 It is a structural diagram of a medical message processing system provided in an embodiment of the present application.

[0053] Figure 2 It is a schematic diagram of the internal structure of a medical terminal provided in an embodiment of the present application.

[0054] Figure 3 It is a schematic diagram of an external front view (left) and a rear view (right) of a medical terminal provided in an embodiment of the present application.

[0055] Figure 4 It is a schematic diagram of the left view (left) and right view (right) of the external structure of a medical terminal provided in an embodiment of the present application.

[0056] Figure 5 It is a bottom-up schematic diagram of the external structure of a medical terminal provided in an embodiment of the present application.

[0057] Figure 6 It is a structural diagram of a medical terminal provided in an embodiment of the present application.

[0058] Figure 7 It is a network structure diagram of a medical message processing system provided in an embodiment of the present application.

[0059] Figure 8 It is a structural diagram of a medical message processing system in a network architecture according to an embodiment of the present application.

[0060] Fig. 9 It is a schematic diagram of a voice memo of an electronic device provided in an embodiment of the present application.

[0061] Fig.10 This is a schematic diagram of a voice call of an electronic device provided in an embodiment of the present application.

[0062] Fig.11 This is a schematic diagram of a voice message for an electronic device provided in an embodiment of the present application.

[0063] Fig.12It is a schematic diagram of a voice memo of an electronic device provided in an embodiment of the present application.

[0064] Fig.13 It is a medical terminal step flow chart of a medical message processing method in an embodiment of the present application.

[0065] Fig.14 It is a server-side step flow chart of a medical message processing method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0066] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application. Therefore, the present application is not limited to the specific implementation disclosed below.

[0067] The terms used in this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The descriptions used in this application and the appended claims, such as "a", "first", and "second", are not limitations on quantity or sequence, but are used to distinguish the same type of information from each other.

[0068] Combined with the description of the above background technology, it can be seen that inefficient communication between medical staff wastes a lot of time every year, wasting the working time of medical staff and increasing the length of hospital stay for patients. Due to the low efficiency of communication, hospitals with more beds will suffer greater losses every year. In particular, the communication systems assigned to the medical workflow often adopt a fixed deployment method, patients cannot communicate with mobile medical staff by voice, and medical staff cannot achieve multi-party instant communication, etc., and the adaptability and flexibility of communication are poor.

[0069] In terms of application scenarios, the existing technology only provides voice telephone access and exchange functions for internal hospital communication services. Common communication methods include in-hospital wired communication (internal program-controlled exchange), cluster intercom systems, etc. The traditional communication service system supports a single communication function, weak information exchange capabilities, and poor intelligent communication interaction experience. It is easy to have problems such as untimely call responses between doctors and nurses, and between doctors and patients, and too much ineffective communication, which affects the safety of patients' medical treatment and increases the length of their hospital stay. At the same time, it reduces the business processing efficiency of medical staff and poses a risk of medical disputes. At the same time, the fixed communication system in the hospital is often independent of the hospital management information system (Hospital Information System, also known as the HIS system) of the hospital. At present, in the process of daily treatment of patients by medical staff, medical staff cannot obtain the patient's condition information in a mobile state or through mobile devices. On the one hand, some patients' vital signs or treatment information need to be recorded in time. On the other hand, there will be many urgent problems that require contacting relevant business personnel for help or medical advice, and some medical staff also need to review or process urgent business messages when they are not at the computer. The patient's key emergency or critical information cannot be pushed to the relevant medical staff who are not in front of the computer in time, which can easily form a "gap" in information flow and pose a risk of medical accidents. In particular, the outbreak of emergency medical events has a great impact on the medical and health industry and the emergency response mechanism's inability to communicate information in a timely and effective manner. Therefore, in modern medical care centered on patients, it is very important to give full play to the emergency efficiency of the communication system, and to interact and share information between the hospital's internal medical business system and during work. The timeliness of medical staff's communication and collaboration is directly related to the safety of patients. Based on the above problems, this application designs and launches an intelligent communication terminal for use in the medical field, that is, a medical message processing system, which improves the communication efficiency between medical staff, while reducing information redundancy and noise, and improving the immediacy and accuracy of information push.

[0070] The present application provides a medical message processing system, which adopts non-contact instant communication technology based on intelligent voice control, uses the medical terminal 101 and the medical message processing system of the server 102 carried by medical staff in the hospital through the Internet information communication management service, obtains the medical message sent by the server 102 that needs to be processed by the medical staff, determines the emergency level of the medical message and the current behavior pattern of the medical staff, and plays the emergency level of the medical message and the medical message to the medical staff in voice, thereby solving the problem that medical staff in the hospital cannot communicate in time by voice. The medical terminal 101 responds to the voice query request of the medical staff for the associated information of the medical message by sending a query request message for the associated information of the medical message to the server 102, obtains the associated information of the medical message returned by the server 102, plays the associated information of the medical message to the medical staff by voice, and receives and / or processes the HIS (Hospital) of the server 102 in a timely manner through the medical terminal 101 in response to the voice reply information input by the medical staff for the medical message by voice. The medical terminal 101 detects the voice reply information input by the medical staff in voice mode for the medical message, and sends the voice reply information to the server 102. The medical staff can make voice memos of medical messages such as medical record handover for the patient, and can transcribe the medical messages of the voice memos into text and send the medical messages to the server 102, which are applied by the server 102 to the HIS (Hospital Information System) hospital management information system, and realize voice wake-up, contactless voice communication, one-key do not disturb, message push processing, etc., which solves the problem of untimely communication in clinical medical activities and improves the work efficiency of medical staff.

[0071] A medical message processing system of the present application, combined with the attached Figure 1 The medical terminal 101 and the server 102 are provided for illustration, and include a medical terminal 101 carried by medical personnel and a server 102; the medical terminal 101 may be a mobile terminal carried by medical personnel customized by the hospital. The mobile terminal is preferably an electronic device, such as the attached Figure 2As shown, a portable medical terminal 101 provided by the present application also includes: a system and hardware, wherein the hardware includes: a processor, a radio frequency transceiver module, a signal processing module, a wireless fidelity module (Wireless Fidelity, also known as a WIFI module), a mobile communication module, a Bluetooth module, a battery and management module, a near field communication module (Near Field Communication, also known as NFC), a device hardware interface and an external plug-in. Among them, the external plug-in includes a display, a memory, a subscriber identity module (Subscriber Identity Module, also known as SIM), a speaker and a microphone. The system of the electronic device includes: a system interface, a voice transmission based on the Internet interconnection protocol (Voice over Internet Protocol, also known as VoIP) communication module, an information transceiver module, a voice control module, a communication management module, a near field communication (Near Field Communication, also known as NFC) module, an address book module, a log recording module, an identity authentication module, an alarm management module, an application processing module and a location calculation module. Among them, the natural language processing (NLP) module is built into the above-mentioned processor, and the system part of the electronic device is interconnected and communicated with the voice server 802, the electronic certification (Certificate Authority, CA) server 803 and the location positioning server respectively.

[0072] In the present application, the voice control module is the voice control command of the medical staff received by the medical terminal 101. The voice control command converts the received voice into text through the text-to-speech conversion module set by the application processing module, and matches it with the corresponding text information in the pre-set control instruction through the natural language processing module. The medical terminal 101 then executes the pre-set control instruction. For example, the medical staff says "voice conference, Dr. Zhang from the Department of Gastroenterology, Dr. Wang from the Department of Gastroenterology, Nurse Liu from the Nursing Department, etc.", and the above voice information is converted into corresponding text information. By matching the text information with the server 102, the voice call with the above corresponding medical terminal is controlled. For example, the corresponding medical terminal 101 is activated through the voice message of the medical staff of "voice conference", the corresponding interface navigation is opened, and the corresponding voice conference is started. Through the voice information of the medical staff of "Dr. Zhang from the Department of Gastroenterology, Dr. Wang from the Department of Gastroenterology, Nurse Liu from the Nursing Department, etc.", the information of the people in the stored address book and the corresponding medical terminal information of the medical staff are obtained, and a request for "voice conference" is sent through the hospital wireless network or mobile communication network. The request for "voice conference" is controlled by voice through the medical terminal 101 throughout the process, and the contactless voice control operation frees the hands of the medical staff. The called medical terminal 101 accepts the "voice conference", or when receiving the message processing request and directly voice replies the processing result, or is busy at this time, replies with a busy reminder, and then makes a voice call to discuss the message after the matter is completed, so as to ensure the timeliness of medical message processing, wherein the medical message can be a voice or text message.

[0073] In the present application, the near field communication module (NFC) uses wireless near field communication technology, and the identification information, identity information and / or voice information of the medical terminal personnel are read by the near field communication module in the communication processing end, and simulated as a contactless card or tag to be read and used by the service end 102. The medical terminal 101 can exchange data information when close to each other, and mobile payment, electronic ticketing, access control, identity authentication and anti-counterfeiting are carried out between the medical terminal 101 and the service end 102. In particular, after the identity information of the medical staff is read, it is convenient for medical staff to enter and exit the hospital's access control system for multiple uses.

[0074] In the present application, the electronic authentication is that the medical personnel carrying the medical terminal installs an electronic visa certificate, binds the electronic certificate with the identity information of the applicant of the medical terminal 101 through the electronic authentication certificate of the communication processing end, and generates a signature certificate of the medical terminal personnel, which is used to authenticate the authenticity of the identity information of the medical terminal personnel.

[0075] In one embodiment of the present application, the electronic authentication (CA authentication) is a unique electronic tag application assigned to an individual by a hospital or a third party installed by the medical terminal 101, and the medical terminal 101 is authenticated by installing the electronic tag application. Each time information is exchanged between the medical terminal 101 and an external system, the electronic tag application is started, the identity is verified, and when the identity of the medical terminal 101 matches the electronic signature outside the medical terminal 101, the information interaction is executed; otherwise, it is not executed. The electronic signature of the electronic authentication (CA authentication) is used to verify the authenticity of the medical terminal 101 and its medical terminal personnel information, so as to protect the security of the medical terminal 101 and the network system to which the medical terminal 101 is connected, and realize secure data transmission.

[0076] The electronic device has the business functions of Internet phone, voice message, message processing, voice wake-up, voice recognition, and voice memo. Specifically, when medical staff encounter problems that need to be communicated with other medical staff in their daily work, they can directly conduct point-to-point and point-to-multipoint network calls through the medical terminal 101 carried by the medical staff. The medical terminal 101 sends the network call request to the medical terminal 101 of the called medical staff through the service end 102, and the called medical staff accepts the network call request and conducts the network call in time, and handles the problem of the medical message in time and efficiently. In the process of the point-to-point call, if the other party does not answer, the medical terminal 101 can be used to leave a voice message. The medical message of the voice message is sent to the service end 102 for storage through the medical terminal 101. When the medical terminal 101 of the called medical staff responds to the detection, it is sent to the medical terminal 101 of the called medical staff, and it is decided whether to play the medical message of the voice message according to the status of the called person, so as to conveniently and quickly inform the called person of the relevant medical message.

[0077] In one embodiment of the present application, the electronic device, as shown in the attached Figure 3-5As shown, an electronic device provided by the present application includes an electronic device housing and a display screen 1005, wherein the display screen 1005 is embedded in the inner side of the electronic device housing, and a first earphone 1001 and a second earphone 1002, a status light 1003, a hanging ring 1004, a speaker mesh cover 1006 and a nano-spray coating 1007 on the outer surface thereof are arranged on the front. A back clip 1008 is arranged on the back of the electronic device housing, and a buckle structure is arranged on the back clip 1008; the hanging ring 1004 is provided with a hanging strap; an interface 1013 is arranged at the bottom of the electronic device housing, and the interface can be a universal serial bus type interface, preferably a universal serial bus type interface C (Universal Serial BUS TYPE C). A power button 1011 and a volume button 1012, a voice wake-up button 1009 and a card slot 1010 and a slot sealing sheet are arranged on the side of the electronic device, and the voice wake-up button is a push-to-talk button structure. The electronic device can be a lightweight, portable, wearable, contactless intelligent voice communication terminal.

[0078] In one embodiment of the present application, as shown in the attached Figure 6 As shown, the present application provides an application processor and the structure of the application processor. The application processor provided by the electronic device of the present application is connected to a memory unit, a WIFI processor unit, an audio noise processing unit, a communication processor unit, a power management unit and an audio processing unit. Specifically, the application processor is installed with an Android operating system, and the memory unit includes a running memory and a storage memory. Among them, the running memory is a RAM memory, and the memory capacity is set according to demand, the memory (LPDDR3), and the memory capacity of the storage memory is preset according to actual needs, and the memory is preferably (Embedded Multi Media Card, abbreviated as emmc).

[0079] In this embodiment, the WIFI processor unit body can be a WIFI four-in-one processor, which is connected to the application processor, wherein the WIFI processor unit also includes a 5G wireless module (5G WIFI, also known as 802.11ac) antenna, a 2.4G wireless module antenna (2.4G WIFI, also known as 802.11b) antenna, a Bluetooth module, a global positioning system (Global Positioning System, also known as GPS) antenna and a crystal clock, and the WIFI processor unit adopts an 802.11ac dual-band WIFI mode, and the dual-band WIFI mode is a 5G WIFI and 2.4G WIFI mode. The 5G WIFI antenna and the 2.4G WIFI antenna are connected to the WIFI four-in-one processor respectively, and are used for the 802.11ac dual-band WIFI mode to receive and send the medical message transmitted by the wireless network; the Bluetooth module is a Bluetooth 5.0 (BLE 5.0) model, and the Bluetooth 5.0 (BLE 5.0) The speed of low-power devices has been improved and optimized accordingly. The Bluetooth 5.0 model combines WIFI to assist in indoor positioning, improves the transmission speed, and increases the effective working distance; the GPS antenna receives and / or sends GPS data signals; the crystal clock is used to generate a control signal for the frequency of processor data processing. The WIFI processor unit receives wireless WIFI signals and / or GPS signals and performs calculation and processing of signal data under the control signal generated by the crystal clock. Among them, the GPS signal can be the medical terminal 101 obtaining the wireless network communication data or the digital cellular mobile communication data through the location calculation module set in the positioning server to calculate the positioning data of the medical terminal 101, or the GPS location signal information received by the GPS antenna is calculated by the location calculation module to obtain the location information of the medical terminal 101.

[0080] In this embodiment, the audio noise processing unit includes a voice wake-up noise reduction chip, which is connected to the application processor as a main body, and can preferably provide a working clock source frequency for a 32.768KHZ crystal clock. The audio noise processing unit also includes the anti-noise microphone array, which is a first microphone or a second microphone, and the above two microphones are respectively connected to the voice wake-up noise reduction chip.

[0081] In this embodiment, the communication processor unit is composed of a main communication processor, a main set module and a diversity module, and the communication processor is connected to the application processor, the main set module and the diversity module. The main set module also includes a main set antenna, which is connected to the main set module and is used to receive external 4G signals and transmit them to the main set module and / or send out the 4G signals output by the main set module; one end of the diversity module is also connected to the application processor, and the other end is connected to the main set module, which is used to independently receive 4G signals and transmit them to the application processor for analysis and processing; the diversity module also includes a diversity antenna, which is connected to the diversity module and is used to receive external 4G signals and transmit them to the diversity module. The model of the communication processor unit is digital cellular mobile communication 4G full network access.

[0082] In this embodiment, the power management unit is composed of a main power management and audio processing module and a secondary power management module, which are respectively connected to the application processor for providing power to the application processor. The charging interface can be a Universal Serial BUS TYPE C interface, which is respectively connected to the application processor, the main power management and audio processing module and the secondary power management module for transmitting data to the application processor and charging the main power management and audio processing module and the secondary power management module.

[0083] In this embodiment, the main power management and audio processing module also includes a speaker, which is connected to the main power management and audio processing module, and is used when the Universal Serial Bus Type C interface is used as a headphone interface. When the main power management and audio processing module works as an audio processing module, the audio processing module is connected to the application processor to output the voice audio, and the voice audio output interface is an external headset jack; the speaker outputs information of the external power amplifier audio processing module, for example, when the external environment is large, it is difficult to hear the sound when the headphones connected to the Universal Serial Bus Type C interface are connected. At this time, the audio processing module can use the speaker to output the voice information. The speaker is external, for example, the external power can be preferably 1.5 watts. The main power management and audio processing module is also connected to the communication processor to power the communication processor. The secondary power management module also includes a battery, which is used to provide power to the application processor when there is no external power supply.

[0084] In this embodiment, the SIM card is connected to the application processor and is a 4G GSM IC card. It is a user identification card for a digital cellular mobile phone, called a user identification card. It constitutes a communication terminal device together with the electronic device. It is an identification information card equipped for each mobile electronic device user. The SIM card is the key for the electronic device to connect to the information communication network. Once the SIM card is pulled out of the mobile phone, the electronic device will not be able to enjoy the various services provided by the information communication network operator except for emergency calls. In addition to being used as a key, the SIM card also provides a lot of convenience for medical terminal users. For example, the user only needs to insert or embed the SIM card into any medical terminal to achieve interconnection and interoperability of the information communication network.

[0085] In this embodiment, the SIM card has a microprocessor chip of an operating system. The eight contacts of the chip are interconnected with the electronic device after the device is inserted into the card slot and powered on. The above-mentioned system and module function instructions are combined with the SIM card chip to provide the SIM card with storage data (for example, control access to various transmitted voice or text information) and the intelligent characteristics of completing customer identity authentication and customer information encryption algorithm under the condition that the security verification has been passed, for example, the personal identification number or personal identification password (Personal Identification Number, also known as PIN) and the authentication key are correct. Therefore, the instant intelligent communication system identifies the medical staff holding the medical terminal 101 through the SIM card. In addition to storing normal data fields, the SIM card also stores non-file fields such as the authentication key with voice information, the personal identification number, the personal unlocking code and other related information of the medical message.

[0086] In this embodiment, the external plug-in of the medical terminal 101 also includes the display screen and the sensor, which are respectively connected to the application processor. The display screen is a capacitive touch screen; the sensor can be an odor sensor, a sound volume sensor, a voice sensor, a medical environment vibration sensor, etc. for detecting the medical environment, wherein the medical environment vibration sensor is a three-axis gravity sensor.

[0087] like Figure 7As shown, in one embodiment of the present application, the server 102 of the present application includes a communication management server 801, a voice server 802 and an electronic authentication server 803; the communication management server 801 and the server 102 are used to manage the medical messages of the server 102, maintain the address book, and send the medical messages managed above to the voice server 802 and the electronic authentication server 803 via the wireless communication network 701 and the cellular mobile communication network 702 in real time. For ease of understanding, the above technical terms are explained. The communication management server 801 includes the communication management service system and the communication management server 801. The communication management server 801 includes the communication management service system, the communication database service system and the background system. The communication management server 801 manages the unique identification information, identity information, system login information, medical messages, etc. of the user established by the medical terminal 101, generates an address book, and also includes establishing, calling and maintaining the address book, and managing the corresponding relationship between the above information of the medical terminal 101 and other users in the medical terminal 101, as well as the sending and / or receiving of the above information of the medical terminal 101, and communicating the unique identification information, identity information, system login information, medical messages, etc. of the user with the voice server 802 and the electronic authentication server 803. The information communication network can be connected to multiple medical message processing systems, and can also be connected to the communication management server 801. The communication management server 801 manages the sending and / or receiving of the unique identification information, identity information, system login information, medical messages, etc. of the user by the medical terminal 101. The medical terminal 101 can be a lightweight, portable, wearable, contactless intelligent voice communication terminal, which has the characteristics of strong noise reduction voice processing dual microphone array, touch screen, standby time, support for BLE5.0 connection, etc. At the same time, it also integrates voice capabilities such as voice wake-up, voiceprint recognition, voice command control, voice recognition conversion, TTS voice broadcast and voice event memo.

[0088] As attached Figure 8As shown, the present application provides a network architecture, including a medical terminal 201 connected by wireless WIFI, a medical terminal 202 connected by wireless Bluetooth, and a medical terminal 203 connected by a cellular mobile communication network 702 (4G or 5G). The WIFI wireless router 301 is respectively connected to the Bluetooth wireless router 302 and the signal base station 303 or is respectively connected to the network firewall 401. At the same time, the medical terminal 201 connected by wireless WIFI, the medical terminal 202 connected by wireless Bluetooth, and the medical terminal 203 connected by the cellular mobile communication network 702 (4G or 5G) can also be connected through the built-in wireless Bluetooth communication of the medical terminal. The network firewall 401 is then connected to an external network system, and the external network system includes a backend management system 501, an internal hospital (HospitalInformation The system is composed of a hospital management information system 502, an electronic authentication system 503, other extended service systems, a voice service system 601, a text-to-speech system 602, a voice transmission system 603, a security service system 604 and a data service system 605. The above systems are connected through an Internet topology and can also be a local area network. Through the above network architecture, they communicate with the medical terminal 101 which is securely protected by a network firewall 401.

[0089] The voiceprint recognition is that when the medical terminal 101 logs in by receiving the voice information, the voice information is identified and / or confirmed to be consistent with the identification information of the medical staff holding the medical terminal, and the login recognition is passed; otherwise, the login recognition fails. The voiceprint recognition is that the medical terminal 101 receives the voice information (i.e., voice timbre information) of the medical staff holding the medical terminal, and the communication processing end analyzes the timbre data of the voice information of the medical terminal user, and stores the timbre data as identification information in the medical terminal and / or the service end 102. When the medical terminal 101 receives the same voice information, the communication processing end analyzes the timbre data of the voice information of the medical staff and compares it with the timbre data stored in the medical terminal 101 and / or the service end 102. When the timbre data of the compared voice information does not match, the medical terminal 101 authentication is not passed; when the above two timbre data match, the medical terminal 101 passes the verification. For example, when the medical staff enters the hospital gate and is next to the access control, the medical staff passes the identity authentication of the access control system equipped with voiceprint recognition through voice. The voiceprint recognition can be used to verify whether the match between the medical terminals 101 used by the medical staff is correct, and the identity of the medical staff carrying the medical terminal can also be authenticated through voiceprint recognition. For example, when a respiratory doctor enters the duty room access control at night, he conducts a voice conversation with the medical terminal 101, and sends a voiceprint recognition instruction to the duty room access control system connected to the server 102 through the medical terminal 101. The duty room access control system determines whether the voiceprint recognition information of the medical terminal 101, the medical staff and the duty room access control are all matched. If they are all matched, the verification is passed, and the duty room access control is opened; if the information of the above three is not completely matched, the verification is not passed to prevent other personnel from breaking into the duty room at night, ensuring the safety of the personnel in the duty room at night, and realizing reliable multiple authentication.

[0090] In one embodiment of the present application, a medical message processing system is provided. When the medical staff is in emergency surgery or expert consultation for a long time, they can also turn off the voice wake-up button of the medical terminal 101 that they carry with them at all times. At this time, the medical terminal turns off the response detection system program to achieve a one-key do not disturb setting function. When the voice wake-up button of the medical terminal 101 is turned on, the medical terminal 101 is also used when it is in a dormant state. If the medical staff detects the preset voice wake-up phrase for the medical terminal 101 input by voice, it enters a voice interaction mode for voice interaction operations.

[0091] The medical terminal 101 is also used for, when in a dormant state, if the medical staff detects the preset voice wake-up phrase for the medical terminal 101 input by voice, for example, when the medical staff "Hua Kangjian" speaks the voice wake-up phrases such as "Xi Bo" or "Little Elf" to the medical terminal 101, the voice wake-up phrase of the medical staff is collected by the voice sensor of the medical terminal 101, and the voice wake-up phrase is converted into corresponding text information through the voice recognition algorithm set by the application processing module, and the text information is matched with the preset voice wake-up phrases such as "Xi Bo" or "Little Elf" of the medical terminal 101, the medical terminal 101 enters the voice interaction mode for voice interaction operation from the dormant state. When the medical terminal 101 enters the voice interaction mode, the medical terminal 101 immediately accepts the voice control of the medical staff through the above-mentioned voice sensor, and the voice control includes voice dialing, voice call, voice message and voice memo. The medical terminal 101 is used to obtain the medical message sent by the service end 102 that needs to be processed by the medical staff, and to determine the emergency level of the medical message and the current behavior mode of the medical staff.

[0092] In one embodiment of the present application, a medical message processing system is provided, wherein the medical terminal 101 is specifically used to extract medical keywords from the medical message, obtain the emergency level corresponding to the medical keyword according to the medical keyword and the correspondence between the preset emergency level and the medical keyword, and judge the emergency level of the medical message according to the emergency level corresponding to the medical keyword. For example, a patient of the medical staff "Xi Bo" suddenly suffers from cerebral infarction, and the medical staff "Xi Bo" speaks the medical message "Yan Er suddenly suffers from cerebral infarction" to the medical terminal 101 through voice, and the medical terminal 101 of the medical staff "Xi Bo" recognizes and obtains the medical message "Yan Er suddenly suffers from cerebral infarction" through the voice recognition module set in the application processing module, and converts the above-mentioned voice medical message of "Yan Er suddenly suffers from cerebral infarction" into a text medical message of "Yan Er suddenly suffers from cerebral infarction" through the text-to-speech conversion module set in the application processing module, and extracts the medical keywords in the text medical message through the natural language processing module, and the above-mentioned medical keyword of "Yan Er suddenly suffers from cerebral infarction" is "cerebral infarction". For example, the keywords corresponding to the first level (most urgent level) are the most serious and urgent keywords that need help, such as bleeding, vomiting blood, myocardial infarction, cerebral infarction, respiratory failure, etc. Another example is the keywords of the second level (not particularly urgent) fever, cough, etc. Another example is the keywords of the third level (general situation) prescription, meeting, etc. The keywords in the medical message correspond to the keywords of which level, and the emergency level of the medical message is the corresponding level. At this time, the medical terminal 101 corresponds the medical message of "Yan Er suddenly suffered cerebral infarction" to the first level (most urgent level), and the medical message of the first level (most urgent level) is used to warn the medical terminal 101 and the server 102 associated with it through the alarm management module, and at the same time, the medical message of "Yan Er suddenly suffered cerebral infarction" of the first level (most urgent level) is sent to the server 102. The alarm management module is used to warn and manage its emergency disposal matters, and realizes the timely and accurate interaction and push of emergency medical messages with the instant messaging system. For another example, the medical terminal 101 of the medical staff member "Hua Kangjian" obtains a medical message of "patient Zhao Wu suffered myocardial infarction" of undetermined emergency level sent by the server 102. The medical terminal 101 of the medical staff member "Hua Kangjian" matches the keyword "myocardial infarction" preset in the medical message with the keyword of the first level (the most urgent level). The medical terminal 101 of the medical staff member "Hua Kangjian" determines the emergency level of the medical message of "patient Zhao Wu suffered myocardial infarction" of undetermined emergency level as the corresponding first level (the most urgent level).

[0093] In one embodiment of the present application, a medical terminal 101 is provided, which is specifically used to obtain the emergency level information for the medical message sent by the service end 102, and determine the emergency level of the medical message according to the emergency level information for the medical message. For example, if the medical terminal 101 obtains the medical message voice with a weak and hoarse voice, a low voice volume, or an uneven voice volume and a large amplitude, the medical terminal 101 receives the medical message voice through a voice sensor provided with the anti-noise microphone array, and transmits the medical message voice with a weak and hoarse voice, a low voice volume, or an uneven voice volume and a large amplitude to the audio noise processing unit, and the audio noise processing unit eliminates the noise in the environment through a voice wake-up noise reduction chip according to the environmental noise in which the medical message is located, and amplifies the processed medical message voice after equalization processing. At this time, the medical terminal 101 obtains the medical message voice that is easy to identify after processing, and the voice is weak and hoarse, the voice volume is low, or the voice volume is uneven and the amplitude is large, then the medical message is determined to be the first level (the most urgent level). For another example, the emergency level information of the medical message corresponding to the second level (not particularly urgent) is a high excitement state of fast speech, rapid voice, or unstable emotions. For example, the emergency level information of the medical message corresponding to the third level (general situation) is a normal speaking speed, a stable voice volume, and other normal and stable emotions. The emergency level of the medical message corresponds to the voice state characteristics of which level. In the embodiment of the present application, the first emergency level of the medical message obtained by the medical terminal 101 can be determined by the medical keywords, and the second emergency level can be determined by the voice state characteristics of the emergency level information of the medical message obtained by the medical terminal 101. The first emergency level and the second emergency level are compared, and the higher emergency level is determined as the level to which the medical message finally corresponds.

[0094] In one embodiment of the present application, a medical message processing system is provided, characterized in that the medical terminal 101 is specifically used to play the behavior pattern inquiry information for inquiring the medical staff about the current behavior pattern of the medical staff by voice, obtain the current behavior pattern information of the medical staff in response to the behavior pattern inquiry information input by the medical staff by voice, and judge the current behavior pattern of the medical staff according to the current behavior pattern information of the medical staff replied by the medical staff. For example, the medical terminal 101 carried by the medical staff Zhang San receives a medical message, and the medical terminal 101 plays "You have an urgent message, please deal with it in time" by voice, and the medical terminal 101 flashes a green breathing light slowly at the same time. Or the medical terminal 101 plays the third level (general message) of "You have a general message, please deal with it in time" by voice, and the medical terminal 101 rings and flashes a green breathing light slowly at the same time. Thus, Zhang San can obtain the emergency level of the medical message according to the voice message heard from the medical terminal 101 or the above-mentioned color and frequency state of the flashing light of the breathing lamp of the medical terminal 101. The medical terminal 101 carried by the medical staff Zhang San controls the external speaker voice in the audio processing module through the natural language processing module to play the voice information of the pre-set medical message "Please report the current behavior mode". The medical terminal 101 is pre-set with two behavior modes of medical staff: "medical treatment" and "no medical treatment". The medical staff Zhang San replies to the voice of "no medical treatment" by voice according to his current behavior mode. The medical terminal 101 carried by the medical staff Zhang San obtains the information of Zhang San's current behavior mode through the voice sensor of the anti-noise microphone array, and determines that the current behavior mode of the medical staff Zhang San is "no medical treatment". Further, the medical terminal 101 carried by the medical staff Zhang San plays the received medical message by voice.

[0095] In one embodiment of the present application, a medical terminal 101 is provided to determine whether the medical staff is currently in a medical treatment environment according to the current geographical location information of the medical terminal 101, and to determine the current behavior mode of the medical staff by determining whether the medical staff is currently in a medical treatment environment. For example, the medical terminal 101 carried by the medical staff Zhang San receives GPS communication information through the Global Positioning System (Global Positioning System, also known as GPS) antenna set on the medical terminal 101 or the communication information of the cellular mobile communication network 702 set on the medical terminal 101 is calculated and positioned by the service end 102, or the wireless fidelity module (Wireless Fidelity, also known as WIFI module) set on the medical terminal 101 determines the geographical location information of the medical staff Zhang San in the hospital cafeteria or the hospital lounge. The medical terminal 101 carried by the medical staff Zhang San determines that the current behavior mode of the medical staff Zhang San is "not medically treated" according to the geographical location information of the medical staff Zhang San. For another example, if the current geographic location information of the medical terminal 101 carried by the medical staff member Zhang San is located in the hospital operating room or emergency room, the medical terminal 101 determines that the current behavior mode of the medical staff member Zhang San is "medical treatment" based on the current geographic location information of the hospital operating room or emergency room.

[0096] In one embodiment of the present application, a medical terminal 101 is provided, which is specifically used to judge whether the medical staff is currently in a medical treatment environment according to the medical environment parameters collected by the medical environment sensor in the medical terminal 101, and judge the current behavior mode of the medical staff by judging whether the medical staff is currently in a medical treatment environment. For example, the medical terminal 101 is provided with a medical environment state sensor for real-time monitoring of the current environment, and the medical environment state sensor is provided with at least one medical environment state sensor of different categories, and multiple medical environment state sensors of the same category can also be provided, and it can also be multiple groups of medical environment state sensors of different categories. The above-mentioned medical environment state sensor mainly collects medical environment parameters, such as medical odor parameters. For example, the medical terminal 101 is provided with a medical odor sensor that can collect the environment where iodine tincture and / or alcohol exist. When iodine tincture and / or alcohol exist in the medical environment, the medical odor sensor collects the odor of iodine tincture and / or alcohol, and transmits it to the natural language processing module, and further judges that the current behavior mode of the medical staff is "medical treatment" through the natural language processing module. Another example is the use of medical sound parameters, such as the medical staff member Zhang San speaking to the medical terminal 101 carried by the medical terminal 101, or the sound of the medical forceps hitting the tray, or the sound of the emergency call warning of the ambulance, or the sound of the emergency stretcher rubbing against the hospital floor when being pushed, and the sound of the medical staff member Zhang San giving voice guidance to the emergency patient, etc. The sound parameters of the medical environment are collected by the medical sound sensor, and the medical terminal 101 determines that the medical staff member Zhang San is currently in a medical emergency treatment environment under the sound parameters of the current state, and the natural language processing module determines that the current behavior mode of the medical staff member Zhang San is "medical treatment".

[0097] In one embodiment of the present application, a medical message processing system is provided, wherein the medical terminal 101 is specifically used to determine whether the medical staff is currently in a medical treatment environment according to the medical odor parameters and / or medical sound parameters collected by the medical environment sensor. For example, the medical odor sensor of the medical terminal 101 carried by the medical staff "Xi Bo" collects the odor of blood, and the medical environment odor sensor also collects the odor of alcohol or iodine, then the medical terminal 101 carried by the medical staff "Xi Bo" determines that the medical staff "Xi Bo" is currently in a "medical treatment" environment. For example, the medical environment odor sensor of the medical terminal 101 carried by the medical staff "Xi Bo" collects the odor of blood, and the medical environment sound sensor collects the emergency call warning sound of the ambulance and / or the patient's pain groaning sound, or there is also the movement of the medical staff's body collected by the medical environment vibration sensor, etc., then the medical terminal 101 of the medical staff "Xi Bo" determines that the medical staff "Xi Bo" is currently in a "medical treatment" environment. For another example, the medical environment odor sensor of the medical terminal 101 carried by the medical staff "Hua Kangjian" does not collect the odor of the medical environment, and the medical environment sound sensor does not collect the sound of the medical environment, or the medical environment vibration sensor does not collect the vibration or movement in the medical environment, then the medical terminal 101 of the medical staff "Hua Kangjian" determines that the medical staff "Hua Kangjian" is currently in an "unmedically treated" environment.

[0098] In one embodiment of the present application, if the emergency level of the medical message reaches or exceeds the preset emergency level, and the current behavior mode of the medical staff is the medical treatment behavior mode, the emergency level of the medical message and the medical message are played to the medical staff by voice. In the above embodiment, the medical environment sensor of the medical terminal 101 carried by the medical staff "Xi Bo" collects the environmental status information of "medical treatment", then the medical terminal 101 of the medical staff "Xi Bo" determines that the medical staff "Xi Bo" is currently in the "medical treatment" environment. If the medical terminal 101 carried by the medical staff "Xi Bo" obtains the medical message of "Yan Er suddenly suffers from respiratory failure" sent by the service end 102, the medical terminal 101 determines through the natural language processing module that the medical message of "Yan Er suddenly suffers from respiratory failure" obtained above is the first level (the most urgent level), and the emergency level of the medical message reaches or exceeds the preset emergency level, and the medical terminal 101 further determines that the current behavior mode of the medical staff "Xi Bo" is the behavior mode of "medical treatment"; at this time, the medical message obtained by the medical terminal 101 carried by the medical staff "Xi Bo" is played to the medical staff "Xi Bo" through the external speaker. The medical message "First level (most urgent level), Yan Er suddenly suffers from respiratory failure"

[0099] In one embodiment of the present application, a medical terminal 101 is provided, in response to detecting a voice query request for the associated information of the medical message from the medical staff, to send a query request message for obtaining the associated information of the medical message to the server 102. For example, the medical terminal 101 carried by the medical staff "Hua Kangjian" obtains the medical message and plays the medical message "First level (most urgent level), Yan Er suddenly suffered a cerebral infarction" to the medical staff "Hua Kangjian" through an external speaker. If the medical staff "Hua Kangjian" is the attending physician of the patient "Yan Er", at this time, it is necessary to immediately provide guidance on first aid work for the patient "Yan Er" on the medical terminal 101 line regarding the medical event of "Yan Er suddenly suffered a cerebral infarction". At this time, the medical staff "Hua Kangjian" can speak a voice query request of "query Yan Er's daily medical records" to the portable medical terminal 101. The medical terminal 101 carried by the medical staff "Hua Kangjian" collects the voice query request of the medical staff "Hua Kangjian" about the patient "Yan Er" to "query Yan Er's daily medical records" through the voice sensor of the anti-noise microphone array, and saves the above voice information in the memory of the medical terminal 101 through the portable medical terminal 101, and executes the voice query request of the patient "Yan Er" to "query Yan Er's daily medical records" through the processor. The voice query request can be transmitted to the server 102 through the Internet protocol through the wireless fidelity module in the WIFI processor unit, or the main set antenna based on the main set module in the cellular mobile communication network, or the Bluetooth wireless transmission module based on the Bluetooth protocol. The server 102 is based on the associated information of the medical messages of the patient "Yan Er", such as "first level (most urgent level), Yan Er suddenly suffered cerebral infarction" and "query Yan Er's daily medical records", for example, the associated information of the medical messages may be "Yan Er's daily medical records", "Yan Er's injected drugs, dosage, time" and "Yan Er's detailed records of surgical conditions", etc. The associated information of the medical messages is sent to the display screen of the medical terminal 101 carried by the medical staff "Hua Kangjian" through the server 102. The medical staff "Hua Kangjian" checks the associated information of the medical messages of the patient "Yan Er", and can provide timely and accurate guidance on first aid work online on the medical terminal 101 for the medical message of "first level (most urgent level), Yan Er suddenly suffered cerebral infarction", thereby ensuring an accurate understanding of the patient's condition and accurate guidance of first aid work during the first aid process, and avoiding mistakes in first aid work.

[0100] In one embodiment of the present application, a medical message processing system is provided, wherein the medical terminal 101 obtains the associated information of the medical message returned by the service end 102, and plays the associated information of the medical message to the medical staff in voice. Fig. 9As shown, the associated information of the medical message includes: medical memorandum data corresponding to the patient information in the medical message. For example, the medical terminal 101 of the medical staff "Xi Bo" receives a voice message "Now the high blood pressure has risen to 210" sent by the patient "Yan Er". The medical terminal 101 determines that the medical message is the first level (the most urgent level) through the natural language processing module, and the medical terminal 101 carried by the medical staff responds to the medical memorandum data corresponding to the information of the patient "Yan Er" in the medical message "Now the high blood pressure has risen to 210". The medical memorandum data can be a voice memorandum message, or it can be a text record of the patient's daily case by other medical staff. When the medical memo data corresponding to the information of the patient "Yan Er" in the medical message is a voice memo, the voice memo also displays the date, time, recorded doctor and recorded type of the voice memo, and the voice control module receives the voice command of the medical staff for the medical terminal 101. The voice command is converted into text by the text-to-speech conversion module, and matched with the corresponding text information in the preset control instruction by the natural language processing module, and then the medical terminal 101 executes the preset control instruction. The content of the voice memo can be played by voice according to the voice command of the medical staff to "play the voice memo" in the form of voice through the natural language processing module.

[0101] In one embodiment of the present application, as shown in the attached Fig. 9 As shown, the associated information of the medical message includes the following two types of information: medical memorandum data corresponding to the patient information in the medical message; and contact information of the medical staff corresponding to the patient information in the medical message. For example, the medical terminal 101 of the medical staff received a medical message from the patient "Yan Er" that "his heart rate is now 120". The natural language processing module of the medical terminal 101 determines that the medical message is the second level (not particularly urgent). The associated information of the medical message can be other medical staff's daily case records of the patient "Yan Er".

[0102] The log recording module is a daily case record service, and the medical terminal 101 receives and / or sends the medical message, which can be a voice or text message, and stores the information in other application systems of the server 102 and / or in the storage medium of the medical terminal 101. The content of its daily case record is "2020-07-14 daily case record: the patient's current spirit, diet and sleep are OK, blood sugar occasionally fluctuates, basic control is OK, blood pressure is stable, physical examination is stable" or "imaging right lobe position...", and also includes the signature of the doctor "Xi Bo" who records the daily course of illness, and the names of medical staff such as the doctor "Hua Kangjian" recorded in the voice memo. The name of the medical staff corresponds to the name of the medical staff corresponding to the information list of the patient "Yan Er" in the above medical message and the corresponding contact information in the address book.

[0103] In one embodiment of the present application, as shown in the attached Fig. 9 As shown, the associated information of the medical message includes the following three types of information: medical memo data corresponding to the patient information in the medical message; contact information of medical personnel corresponding to the patient information in the medical message; contact information of medical personnel who can handle the disease or symptoms corresponding to the medical keywords in the medical message.

[0104] For example, the doctor's medical terminal 101 of the medical staff "Hua Kangjian" received a medical message from the patient "Yan Er" that he had "severe chest pain". The medical terminal 101 judged that the medical message was at the first level (the most urgent level) through the natural language processing module. The associated information of the medical message could be other medical staff's daily case records of the patient, and the content of the daily case record was "2020-07-13 Daily case record: There is a possibility of an extracoronary event, and no surgery will be performed today. The patient "Yan Er" had no special complaints of respiratory system symptoms, and the physical examination was basically the same as before. The current insulin is 13-10-14U. After the patient's neoadjuvant chemotherapy, the indications for surgical treatment are clear..., please Internal medicine and critical care medicine consultation to assess perioperative risks and assist in diagnosis and treatment", also includes the signature of the physician with daily medical records "Bian Tuo", and the names of medical staff such as the physician "Hua Kangjian" in the voice memo record. The above names of medical staff correspond to the names of the medical staff "Hua Kangjian", "Bian Tuo", etc. corresponding to the information list of the patient "Yan Er" in the above medical message, and their corresponding contact information (it can also be the contact number of the medical terminal 101) or information (it can also be a personal phone number, or WeChat, or the treatment number corresponding to the hospital management information system, etc.) of the respiratory doctor, surgical medical staff and the corresponding medical terminal 101 in the address book.

[0105] In one embodiment of the present application, a medical message processing system is provided, wherein the medical terminal 101 is further configured to, before obtaining the medical message, send the medical memorandum data corresponding to the patient information in the medical message input by the medical staff in voice mode to the server 102 when detecting the medical memorandum data. The server 102 is further configured to store the medical memorandum data. For example, before the medical staff "Xi Bo" obtains the medical message of the patient "Yan Er" through the medical terminal 101, when the medical terminal 101 detects that the medical staff "Bian Tuo" inputs the daily case record of the patient "Yan Er" by voice, "Combined with the patient's current symptoms and the opinions of the anesthesiology department, it is recommended that the patient further improve the medical record information of the patient "Yan Er" in the hospital management information system and the possibility of coronary events excluding coronary CTA, so no surgery will be performed today. The patient has no special complaints of respiratory symptoms, and the physical examination is basically the same as before. The fasting blood sugar is basically up to standard, and the current insulin is adjusted to 13-10-14U,..., please consult the internal medicine and critical care medicine departments to assess the patient's perioperative risks and assist in diagnosis and treatment" or "The patient reported that he had no dizziness, headache, normal nocturia, and normal physical examination" corresponding to the daily case record or medical memorandum data of the patient "Yan Er" in the medical message, the medical terminal 101 of the medical staff "Bian Tuo" sends the above-mentioned medical memorandum data or daily case record to the service end 102. The server 102 is also used to store the medical memorandum data. The server 102 obtains the medical memorandum data or daily case records sent by the medical terminal 101 to the server 102 and stores the data records in the storage medium of the server 102.

[0106] In one embodiment of the present application, a medical message processing system is provided, such as Fig.10As shown, the medical terminal 101 is also used to query the contact information corresponding to the personnel name if it detects the personnel name input by the medical staff by voice, and send a first voice request message to the server 102 to request voice interaction with the terminal corresponding to the personnel name according to the contact information corresponding to the personnel name. For example, if the medical terminal 101 of the medical staff detects that the medical staff inputs the personal name "Zhang San" by voice, the medical terminal 101 obtains the voice information of "Zhang San" spoken by the medical staff, and the medical terminal 101 obtains the voice information of "Zhang San" and queries the contact information corresponding to the name "Zhang San" stored in the medical terminal 101 and / or the server, such as "General Surgery Zhang San" in the address book of the medical terminal 101 or the server 102. According to the contact information "General Surgery Zhang San" corresponding to the name "Zhang San", a first voice request information is sent to the server 102 to request the medical terminal 101 corresponding to the name "Zhang San" to perform voice interaction, and the first voice request information includes the contact information "General Surgery Zhang San" corresponding to the name "Zhang San" in the address book.

[0107] The server 102 is used to obtain the medical message, send the medical message to the medical terminal 101, obtain the query request message sent by the medical terminal 101, obtain the associated information of the medical message, and send the associated information of the medical message to the medical terminal 101. The server 102 is also used to obtain the first voice request message, obtain the contact information corresponding to the personnel name according to the first voice request message, and send a second voice request message to the terminal corresponding to the personnel name according to the contact information corresponding to the personnel name, indicating that the medical terminal 101 requests the terminal corresponding to the personnel name to perform voice interaction. The server 102 obtains the first voice request message, obtains the contact information "General Surgery Zhang San" corresponding to the name "Zhang San" according to the first voice request message, and sends a second voice request message to the medical terminal 101 corresponding to the name "Zhang San" according to the contact information "General Surgery Zhang San" corresponding to the name "Zhang San" to indicate that the medical terminal 101 requests the medical terminal 101 to perform voice interaction with the medical terminal 101 corresponding to the name "Zhang San". The second voice request information includes the contact information of the medical staff who issued the first voice request information (medical staff Qian San), and the medical staff "Zhang San" confirms the above second voice request message, answers the first voice request information for voice interaction, and conducts a voice call.

[0108] In one embodiment of the present application, a medical terminal 101 sends a voice reply message to a server 102 in response to detecting a voice reply message input by the medical staff in response to the medical message. The voice reply message includes medical treatment suggestion information for the disease or symptom corresponding to the medical keyword in the medical message. For example, as shown in the attached Fig. 9 As shown, the medical terminal 101 of the doctor "Hua Kangjian" responds to the medical message obtained on the service end 102 about the medical staff "Bian Tuo" for the patient "Yan Er is now dizzy", the medical keyword in the medical message is "dizziness", combined with the corresponding disease message of the patient "Yan Er" "malignant tumor in the right lung, lung in situ", and the symptoms in the daily medical record "the patient's current spirit, diet and sleep are good, blood sugar occasionally fluctuates, blood pressure is stable, physical examination is stable, and basically controllable". The medical staff doctor "Hua Kangjian" combines the above medical message of the patient "Yan Er" displayed on the medical terminal 101 carried by him, and sends a voice reply message "measure the patient's blood pressure and blood sugar, inject 12-11-14U of insulin, and rest for examination" through the medical terminal 101.

[0109] In one embodiment of the present application, a medical message processing system is provided, such as Fig.11As shown, it is characterized in that the medical terminal 101 is also used to display a voice call interface for making a voice call to the target person if it is detected that the medical staff inputs a voice call request to the target person by voice, and display a message interface for the medical staff to leave a message to the target person if it is detected that the terminal corresponding to the target person does not connect the voice call request within a preset time period, and in response to detecting the voice message information for the target person input by the medical staff by voice, send the voice message information to the service end 102. For example, if the medical terminal 101 detects that the medical staff "Qian Wu" inputs a voice call request to the target person "Zhang San of General Surgery" by voice, the screen of the medical terminal 101 called by "Qian Wu" displays a voice call interface for making a voice call to the target person "Zhang San", as well as a slogan and a message option button waiting for the other party to answer, and the voice call sound can also be played out loud through the loudspeaker option button. If it is detected that the medical terminal 101 corresponding to the target person "Zhang San" does not answer the voice call request of "Qian Wu" within a preset time (for example, 60 seconds), the screen of the medical terminal 101 called by "Qian Wu" displays a voice message interface for the medical staff "Qian Wu" to leave a message for the target person "Zhang San". After the medical terminal 101 of "Qian Wu" responds to the detection of the voice message information for the target person "Zhang San" input by the medical staff "Qian Wu" in voice mode, the medical terminal 101 of "Qian Wu" sends the voice message information to the service end 102, and then the medical terminal 101 enters the message list. The above-mentioned voice message information that has been responded to and detected is recorded in the message list, including the medical terminal 101. The service end 102 is used to obtain the voice message information sent by the medical terminal and send the voice message information to the terminal corresponding to the target person. For example, the service end 102, which is communicatively connected to the medical terminal 101, obtains the voice message information sent by the medical terminal 101 of "Qian Wu", sends the voice message information to the medical terminal 101 corresponding to the target person "Zhang San", and stores the voice message information.

[0110] In one embodiment of the present application, Fig.12As shown, the medical terminal 101 can create a voice memo through the medical terminal 101 or the server 102. The medical terminal 101 can transcribe the collected sound into text content and store it, which is convenient for medical staff to quote when writing medical records or nursing shifts on the PC side. In one embodiment of the present application, the steps for creating a memo for medical staff are as follows. Medical staff can use the medical terminal 101 that they carry with them at any time to control it by voice, or they can directly click the memo button to display the client user's patient list by default. The patient list is divided into three tabs: myself, this group, and undergraduate. After clicking, select the memo type course of admission to create a voice memo associated with the patient "Yan Er". After selecting the course of the patient "Yan Er" on the PC side, you can view or enter the memo content of the patient. The generated voice memo is stored and displayed in the voice memo by time and the unique identification information of the memorandum of the medical terminal 101. After the memo is successfully created, click the [Patient List] button to switch to the memo recording interface. Medical terminal 101 medical staff can click the record in this interface to view the text content of the memo transcription, or directly click the button on the right to play the audio file of the original memo.

[0111] Based on the construction of smart hospitals under the conditions of new infrastructure, relying on the advantages of 5G mobile Internet technology, it has the characteristics of regional integration, community coverage, and remote extension. The mobility of medical staff in collaborative work, as well as the demand for multidisciplinary joint diagnosis and treatment across regions and hospitals have increased significantly, which has brought tremendous pressure to the traditional medical communication system. Multi-source information flow, heterogeneous communication flow, and ubiquitous business flow require patients' diagnosis and treatment information to flow quickly and interact in a timely manner under multi-channel, multi-mode, and multi-type conditions. The hospital's demand for information communication is no longer limited to traditional phone calls, text messages, and Internet access. Instead, it is urgently necessary to apply advanced communication technology to clinical practice, diagnosis, treatment, and rescue business processes, to achieve 4A (Anytime, Anywhere, Anyone, Anything) medical information intelligent interactive experience, and provide convenient, efficient, and secure instant information communication services for medical staff and patients.

[0112] Corresponding to a medical message processing system provided in the embodiment of the present application, the embodiment of the present application also provides a medical message processing method applied to a medical terminal embodiment carried by medical personnel. Fig.13 Provide explanation.

[0113] The present application provides a medical terminal step flow chart of a medical message processing method. Since the system embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the system embodiment. The medical terminal embodiment of a medical message processing method described below is only illustrative.

[0114] The present application provides a medical message processing method, characterized in that it is applied to a medical terminal 101 carried by medical personnel, and the method includes: obtaining a medical message sent by a service end 102 that needs to be processed by the medical personnel. Determining the emergency level of the medical message If the emergency level of the medical message reaches or exceeds the preset emergency level, and the current behavior mode of the medical personnel is a medical treatment behavior mode, the emergency level of the medical message and the medical message are played to the medical personnel by voice. In response to detecting a voice query request for the associated information of the medical message by the medical personnel, a query request message for obtaining the associated information of the medical message is sent to the service end 102. Obtaining the associated information of the medical message returned by the service end 102; and playing the associated information of the medical message to the medical personnel by voice. In response to detecting a voice reply message input by the medical personnel in voice mode for the medical message, the voice reply message is sent to the service end 102.

[0115] Corresponding to a medical message processing system provided in the embodiment of the present application, the embodiment of the present application also provides a medical message processing method applied to the server embodiment. Fig.14 Provide explanation.

[0116] The server-side step flow chart of a medical message processing method provided in an embodiment of the present application. Since the system embodiment is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the system embodiment. The server-side embodiment of a medical message processing method described below is only illustrative.

[0117] The present application provides a medical message processing method, characterized in that it is applied to a server 102, and the method includes: obtaining medical messages that need to be processed by medical personnel; sending the medical messages to a medical terminal 101 carried by the medical personnel. Obtaining a query request message for the medical personnel's associated information of the medical messages sent by the medical terminal 101. Obtaining the associated information of the medical messages; sending the associated information of the medical messages to the medical terminal 101. Obtaining a voice reply message for the medical messages sent by the medical terminal 101.

[0118] The present application also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the medical message processing method as described above is executed.

[0119] Based on the above content, the present application also provides an electronic device, such as the attached Figure 5As shown, the electronic device includes: a processor, which is the computing and control core of the electronic device, responsible for reading the instructions of the medical message received by the electronic device, decoding the instructions of the medical message and executing the instructions of the medical message; a memory, which is used to store a program for processing the medical message generated by the medical terminal 101. When the program is read and executed by the processor, the medical message processing method as described above is executed.

[0120] In a typical configuration, a mobile electronic device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0121] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0122] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory media such as modulated data signals and carrier waves.

[0123] In one embodiment of the present application, the above information is installed on a movable electronic device, and the information may be a computer-readable instruction, a data structure, a program module or other data. The medical terminal 101 of the movable electronic device may also be a mobile terminal such as a mobile phone and a PAD installed with the above information, and the server 102 may be a network service system set up by a hospital. When the medical terminal 101 is running, it runs a medical message processing method applied to the medical terminal 101 carried by medical personnel or a medical message processing method applied to the medical message processing method of the server 102.

Claims

1. A medical message processing system, characterized in that: Including medical terminals and service terminals carried by medical staff; The medical terminal is used to obtain the medical message sent by the server that needs to be processed by the medical staff, determine the emergency level of the medical message and the current behavior mode of the medical staff, and if the emergency level of the medical message reaches or exceeds the preset emergency level, and the current behavior mode of the medical staff is the medical treatment behavior mode, then the emergency level of the medical message and the medical message are played to the medical staff in voice, in response to detecting the voice query request of the medical staff for the associated information of the medical message, send a query request message for obtaining the associated information of the medical message to the server, obtain the associated information of the medical message returned by the server, play the associated information of the medical message to the medical staff in voice, and in response to detecting the voice reply information input by the medical staff in voice mode for the medical message, send the voice reply information to the server; The server is used to obtain the medical message, send the medical message to the medical terminal, obtain the query request message sent by the medical terminal, obtain the associated information of the medical message, send the associated information of the medical message to the medical terminal, and obtain the voice reply information sent by the medical terminal; The medical terminal is specifically used to extract medical keywords from the medical message, obtain the emergency level corresponding to the medical keyword according to the medical keyword and the correspondence between the preset emergency level and the medical keyword, and judge the emergency level of the medical message according to the emergency level corresponding to the medical keyword; or, the medical terminal is specifically used to obtain the emergency level information for the medical message sent by the service end, and judge the emergency level of the medical message according to the emergency level information for the medical message; The associated information of the medical message includes at least one of the following information: medical memo data corresponding to the patient information in the medical message; contact information of medical personnel corresponding to the patient information in the medical message; contact information of medical personnel who can handle the disease or symptoms corresponding to the medical keywords in the medical message.

2. The medical message processing system according to claim 1, characterized in that: The medical terminal is specifically used to play behavior pattern inquiry information for inquiring the medical staff about the current behavior pattern of the medical staff by voice, obtain the current behavior pattern information of the medical staff in response to the behavior pattern inquiry information input by the medical staff by voice, and determine the current behavior pattern of the medical staff according to the current behavior pattern information of the medical staff replied by the medical staff; Alternatively, the medical terminal is specifically used to determine whether the medical staff is currently in a medical treatment environment according to the current geographical location information of the medical terminal, and determine the current behavior mode of the medical staff by determining whether the medical staff is currently in a medical treatment environment; Alternatively, the medical terminal is specifically used to determine whether the medical staff is currently in a medical treatment environment based on medical environment parameters collected by the medical environment sensor in the medical terminal, and to determine the current behavior pattern of the medical staff by determining whether the medical staff is currently in a medical treatment environment.

3. The medical message processing system according to claim 2, characterized in that: The medical terminal is specifically used to determine whether the medical staff is currently in a medical treatment environment based on the medical odor parameters and / or medical sound parameters collected by the medical environment sensor.

4. The medical message processing system according to claim 1, characterized in that: The voice reply information includes medical treatment suggestion information for a disease or symptom corresponding to a medical keyword in the medical message.

5. A medical message processing method, characterized in that: Applied to a medical terminal carried by medical personnel, the method comprises: Obtaining a medical message sent by the server that needs to be processed by the medical staff; Determining the emergency level of the medical message and the current behavior pattern of the medical staff, wherein the determining the emergency level of the medical message comprises: extracting medical keywords from the medical message, obtaining the emergency level corresponding to the medical keyword according to the medical keyword and the correspondence between the preset emergency level and the medical keyword, and determining the emergency level of the medical message according to the emergency level corresponding to the medical keyword; or, obtaining the emergency level information for the medical message sent by the server, and determining the emergency level of the medical message according to the emergency level information for the medical message; If the emergency level of the medical message reaches or exceeds the preset emergency level, and the current behavior mode of the medical staff is the medical treatment behavior mode, the emergency level of the medical message and the medical message are played to the medical staff in voice; In response to detecting a voice query request for the associated information of the medical message by the medical staff, sending a query request message for obtaining the associated information of the medical message to the server, so that the server obtains the associated information of the medical message according to the query request message, and sends the associated information of the medical message to the medical terminal; Obtaining the associated information of the medical message returned by the server; Playing the associated information of the medical message to the medical staff in voice, the associated information of the medical message including at least one of the following information: medical memo data corresponding to the patient information in the medical message; contact information of the medical staff corresponding to the patient information in the medical message; contact information of the medical staff who can handle the disease or symptom corresponding to the medical keyword in the medical message; In response to detecting the voice reply information input by the medical staff in voice mode for the medical message, the voice reply information is sent to the server.

6. A medical message processing method, characterized in that: Applied to the server, the method includes: Obtain medical information that requires medical personnel to handle; sending the medical message to a medical terminal carried by the medical staff; the medical terminal is specifically used to extract medical keywords from the medical message, obtain the emergency level corresponding to the medical keyword according to the medical keyword and the correspondence between the preset emergency level and the medical keyword, and judge the emergency level of the medical message according to the emergency level corresponding to the medical keyword; or, the medical terminal is specifically used to obtain the emergency level information for the medical message sent by the service end, and judge the emergency level of the medical message according to the emergency level information for the medical message; Obtaining a query request message for the medical staff regarding the associated information of the medical message, sent by the medical terminal; Obtaining related information of the medical message; Sending the associated information of the medical message to the medical terminal so that the medical terminal plays the associated information of the medical message to the medical staff in voice, wherein the associated information of the medical message includes at least one of the following information: medical memo data corresponding to the patient information in the medical message; contact information of the medical staff corresponding to the patient information in the medical message; contact information of the medical staff who can handle the disease or symptom corresponding to the medical keyword in the medical message; Obtaining voice reply information for the medical message sent by the medical terminal.

7. An electronic device, characterized in that: The electronic device comprises: processor; A memory for storing a computer program, wherein when the computer program is read and executed by the processor, the computer program runs the medical message processing method according to claim 5 or 6.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the medical message processing method according to claim 5 or 6 is executed.

Images