First-aid system

Abstract

The invention relates to the technical field of first aid, particularly provides a first aid system, and aims to solve the problem that in the prior art, physiological indexes acquired only by a smart bracelet may be inaccurate. In order to achieve the purpose, the system comprises an AR device, an intelligent terminal and a bracelet which are in communication connection with one another; the AR device can acquire a first physiological index of a patient and transmit the acquired first physiological index to the intelligent terminal, the bracelet can acquire a second physiological index of the patient, and at least part of the first physiological index can be calibrated according to at least part of the second physiological index; the intelligent terminal can perform diagnosis according to the calibrated first physiological index and part of the second physiological index to obtain a preliminary illness state; and the diagnosis result is transmitted to an on-site doctor to assist the on-site doctor in rescuing the patient. Therefore, the final physiological index structure can be more accurate, and a doctor can more accurately determine the illness state of a patient.

Description

Technical Field

[0001] The invention relates to the technical field of first aid, and in particular provides a first aid system. Background Art

[0002] When a patient has a disease or other pathological phenomenon, the family will generally call the emergency number and ask the hospital doctor for help. However, since the ambulance needs to be on duty 24 hours a day, and after arriving at the scene, it is not only necessary to provide on-site first aid to the patient, but also to transfer the patient to the ambulance and then send him to the hospital for treatment. The labor intensity is high and the physical fitness requirements are high.

[0003] Ambulances are usually staffed by young doctors or emergency doctors. Young doctors lack experience, which sometimes makes it difficult to accurately judge the condition of the patient. Young doctors and emergency doctors may be more familiar with the conditions of some areas due to professional limitations, but not familiar with the conditions of areas other than their major. However, the conditions of the patients on site are diverse, and the doctors on site may not be able to accurately determine the conditions, so they need the assistance of hospital doctors. However, hospital doctors currently only assist through voice calls on mobile terminals such as mobile phones, which cannot provide good guidance for on-site doctors.

[0004] In addition, some of the patient's physiological indicators are obtained through traditional contact instruments, which is inefficient and requires moving the patient, which is very inconvenient. In order to solve this problem, some hospitals have equipped ambulances with smart bracelets to test the patient's physiological indicators. However, the physiological indicators obtained solely by smart bracelets may be inaccurate.

[0005] Therefore, the relevant field is in urgent need of a first aid system to solve the above technical problems. Summary of the invention

[0006] The present invention aims to solve the above technical problem, that is, to solve the problem that the physiological indicators obtained by relying solely on smart bracelets in the prior art may be inaccurate.

[0007] In a first aspect, the present invention provides an emergency rescue system, which includes an AR device, a smart terminal and a wristband, which are interconnected for communication;

[0008] The AR device can obtain a first physiological indicator of the patient and transmit the obtained first physiological indicator to the smart terminal, and the wristband can obtain a second physiological indicator of the patient, and can calibrate at least part of the first physiological indicator according to at least part of the second physiological indicator;

[0009] The intelligent terminal can perform diagnosis based on the calibrated first physiological index and part of the second physiological index to obtain a preliminary condition; and transmit the diagnosis result to the on-site doctor to assist the on-site doctor in rescuing the patient.

[0010] In a specific implementation of the above-mentioned first aid system, the smart terminal, the AR glasses or the bracelet can contact a hospital doctor, and the hospital doctor can assist the on-site doctor in rescuing the patient based on the calibrated first physiological indicator and part of the second physiological indicator.

[0011] In a specific implementation of the above-mentioned emergency system, the AR device can also obtain on-site video and transmit the obtained on-site video to doctors in the hospital. The doctors in the hospital can assist on-site doctors in rescuing patients based on the on-site video.

[0012] In a specific embodiment of the emergency system, the first physiological index includes a first blood oxygen saturation, a first heart rate, a first respiratory rate, and a first heart rate variability; the second physiological index includes blood pressure, a second heart rate, a second heart rate variability, a second respiratory rate, and a second blood oxygen saturation;

[0013] The first heart rate is calibrated according to the second heart rate, the first heart rate variability is calibrated according to the second heart rate variability, the first respiratory rate is calibrated according to the second respiratory rate, and the first blood oxygen saturation is calibrated according to the second blood oxygen saturation.

[0014] In a specific implementation of the emergency rescue system, the first physiological indicator is obtained based on the patient's facial video.

[0015] In a specific implementation of the first aid system, the facial video is input into the MTTS-CAN multi-task network model to calculate the heart rate and respiratory rate.

[0016] In a specific implementation of the emergency system, the frames of the facial video and the differential normalization results between the frames are input into the MTTS-CAN multi-task network model, and the signal curves of the heart rate and the respiratory rate are output;

[0017] Detrending, filtering and spectrum calculation of the signal;

[0018] The heart rate and respiratory rate are calculated based on the frequency corresponding to the maximum value of the spectrum.

[0019] In a specific implementation of the emergency system, the peak value of the heart rate signal curve is detected using scipy;

[0020] According to the position corresponding to the peak, a sequence consisting of the time differences of all adjacent peak points is obtained;

[0021] The standard deviation of the series was calculated to obtain the heart rate variability.

[0022] In the specific implementation of the above emergency system, the calculation formula of blood oxygen saturation SPO2 is as follows:

[0023]

[0024] Among them, A and B are empirical constants, and the R value is calculated from the red and blue channel values ​​of the ROI. The calculation formula is:

[0025]

[0026] Among them, I AC λ1 and I AC λ2 They refer to the standard deviation of the red and blue channel signals, respectively. DC λ1 and I DC λ2 are the average values ​​of the red and blue channel signals respectively;

[0027] All key points of the human face are detected in the facial video, and a region of interest ROI is obtained according to the key points.

[0028] In the case of adopting the above technical solution, the AR device of the present invention can obtain the first physiological index of the patient and transmit the obtained first physiological index to the server, the bracelet can obtain the second physiological index of the patient, and can calibrate at least part of the first physiological index according to at least part of the second physiological index; the smart terminal can diagnose according to the calibrated first physiological index and part of the second physiological index to obtain a preliminary condition; and transmit the diagnosis result to the on-site doctor to assist the on-site doctor in rescuing the patient. The on-site doctor can rescue the patient according to the calibrated first physiological index and part of the second physiological index, so that the patient can receive scientific and effective rescue.

[0029] By calibrating at least part of the first physiological indicator obtained through the facial video according to at least part of the second physiological indicator obtained through the bracelet, the final physiological indicator structure can be more accurate. When an error occurs in one of them, the error can be reduced through calibration, so that the doctor can more accurately determine the patient's condition. Acquiring physiological indicators in two ways and calibrating them can reduce the error of physiological indicators obtained by a single way and ensure the accuracy of physiological indicators.

[0030] Hospital doctors can assist on-site doctors in rescuing patients based on the calibrated first physiological index and part of the second physiological index. Hospital doctors participate remotely and guide on-site doctors in rescuing patients, so that patients can receive scientific and effective rescue.

[0031] By obtaining the first physiological index based on the facial video, the measurement can be performed without contact, which can reduce the tactile pressure when the measuring device contacts the test person or the psychological pressure and discomfort caused by the environment, and will not cause harm to the test person, thereby reducing its impact on the measurement, and obtaining physiological parameter results that are more in line with the current state of the test person. In addition, the method of obtaining facial video is relatively fast and convenient, and the calculation and acquisition of the first physiological index is also relatively rapid. The first physiological index can be obtained quickly and a rapid diagnosis can be achieved; patients can receive targeted and effective rescue in a shorter time.

[0032] The AR device can also obtain on-site video and transmit the obtained on-site video to the server. The server can contact the hospital doctor, and the hospital doctor can assist the on-site doctor in rescuing the patient based on the on-site video. The hospital doctor can judge whether the treatment site has sufficient space, whether the patient's home has equipment that can assist in treatment, what operations can be performed at the patient's home, and how to smoothly transport the patient to the ambulance. The on-site video can be used to guide the on-site doctor to provide targeted rescue in a more targeted manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings, in which:

[0034] Figure 1 This is a schematic diagram of the structure of the AR glasses provided by the present invention. Figure 1 ;

[0035] Figure 2 This is a schematic diagram of the structure of the AR glasses provided by the present invention. Figure 2 ;

[0036] Figure 3 is a detailed flow chart of steps for obtaining heart rate and respiratory rate provided by the present invention;

[0037] Figure 4 It is a flow chart of detailed steps for obtaining heart rate specificity provided by the present invention.

[0038] List of reference numerals:

[0039] 01. Main body; 02. Glasses leg; 1. Nose pad; 2. Optical module; 3. Myopia lens; 4. Switch; 5. Wearing detector; 6. Speaker; 7. Screen switch; 8. Charging port; 9. Sound pickup hole; 10. Sunshade lens; 11. Increase key; 12. Decrease key; 13. Camera. DETAILED DESCRIPTION

[0040] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0041] It should be noted that in the description of the present invention, the terms "upper", "lower", "left", "right", "inner", "outer" and the like indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings, which are only for the convenience of description, and do not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0042] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installation", "setting", and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a direct connection, an indirect connection through an intermediate medium, or the internal connection of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0043] In order to solve the problem that the physiological indicators obtained by relying solely on smart bracelets in the prior art may be inaccurate.

[0044] This embodiment discloses an emergency rescue system, which is mainly used in ambulances to serve emergency rescue personnel in ambulances and mainly assist on-site doctors in treating patients.

[0045] The emergency system includes an AR device, a smart terminal and a wristband that are in communication connection, wherein the wristband is a smart wristband. The three are in communication connection with each other, specifically, each of them is in communication connection with each other.

[0046] The emergency system also includes a server, specifically a backend server, which is generally arranged in a hospital and can contact the doctor on duty at the hospital at any time and can also transmit the instructions of the doctor on duty.

[0047] The AR device is AR glasses, such as Figure 1 and 2 As shown, the AR glasses include a glasses frame, a camera 13, two optical modules 2, two myopia lenses 3, a microphone, a speaker 6 and a shading lens 10, etc.

[0048] The eyeglass frame includes a body 01 and two eyeglass legs 02 rotatably arranged on the body 01. Two mounting holes are arranged on the body 01, and two optical modules 2 are respectively installed in the two mounting holes. A nose pad 1 is arranged in the middle of the body 01 for users to wear.

[0049] The camera 13 is set on the glasses frame, specifically on the body 01. The camera 13 is located at the front end of the glasses frame and between the two optical modules 2, that is, located in the middle of the body 01. The front end of the camera 13 is tilted downward to ensure that the image recorded by the camera 13 is synchronized with the image seen by the human eye; so that the subsequent data processing results are more accurate, so that the on-site doctor can provide better rescue for the patient. The camera 13 is specifically used to record the patient's facial video and on-site video, and can also record the patient's full body video and the video of the affected part.

[0050] Two myopia lenses 3 are respectively arranged corresponding to the two optical modules 2, and the myopia lenses 3 are arranged behind the optical module 2. The myopia lenses 3 are detachably mounted on the body 01. The myopia lenses 3 of corresponding degrees can be replaced according to different wearers; so that the wearer can wear the AR glasses without wearing contact lenses and can use them normally. Alternatively, the wearer does not need to wear myopia glasses, which can avoid interference between myopia glasses and AR glasses, causing discomfort when wearing AR glasses.

[0051] The microphone is arranged on the glasses frame, specifically arranged inside the glasses frame, specifically located inside the body 01 above the left or right optical module 2. A sound pickup hole 9 corresponding to the microphone is arranged on the glasses frame, and when the wearer speaks, the microphone can pick up the sound through the sound pickup hole 9 to make a call. Since the distance between the sound pickup hole 9 and the mouth is relatively close, the sound can be picked up better.

[0052] The speaker 6 is arranged on the glasses leg 02, and the two glasses legs 02 are both provided with a speaker 6. The speaker 6 is located above the ear, so that the sound of the speaker 6 can be better transmitted to the wearer's ear; so that the wearer can better obtain the transmitted sound.

[0053] In addition, the AR glasses also include a shading lens 10, which is arranged on the glasses frame and is located in front of the optical module 2. The shading lens 10 has a relatively large area and can completely cover the entire front surface of the body 01. The shading lens 10 can prevent strong external light from entering the optical module 2, thereby preventing external light from affecting the display of the optical module 2. A avoidance hole is provided on the shading lens 10, and the front end of the camera 13 is arranged in the avoidance hole, so that the shading lens 10 will not affect the recording of the image, so as to ensure the clarity of the recorded image.

[0054] The AR glasses also include a control module, in which the speaker 6, microphone, camera 13 and optical module 2 are all electrically connected to the control module, and the sound collected by the microphone can be transmitted to the control module, which processes and transmits it. The control module can transmit the sound signal to be emitted to the speaker 6 and control the speaker 6 to emit sound. The image collected by the camera 13 can be transmitted to the control module, and the control module can process the image, mainly to obtain the patient's information based on the image. The control module can transmit the image and text information to the optical module 2 for display.

[0055] The AR glasses also include a switch 4, which is arranged on the glasses frame and is used to switch the AR glasses between 2D mode and 3D mode. The switch 4 is connected to the control module, and the control module switches the display mode of the AR glasses according to the instruction of the switch 4. Specifically, when the current display mode of the AR glasses is 2D mode, pressing the switch 4 once can switch the display mode to 3D mode; when the current display mode of the AR glasses is 3D mode, pressing the switch 4 once can switch the display mode to 2D mode.

[0056] Preferably, the AR glasses further include a screen switch 7, which is arranged on the glasses frame and is used to control whether the optical module 2 displays an image. Specifically, the screen switch 7 is electrically connected to the control module, and when the control module receives an on command, it can control the optical module 2 to display an image; when the control module receives a off command, it can control the optical module 2 to turn off the displayed image, so that the optical module 2 no longer displays an image.

[0057] A lithium battery is also provided in the glasses leg 02 or the body 01 for powering each module. A charging interface 8 is provided at the end of one of the glasses legs 02, which is electrically connected to the lithium battery and can charge the lithium battery. The inflatable shaft charging interface 8 is specifically a Type-C interface, which can be a Type-B interface. Of course, in other embodiments, a battery slot can also be provided on the glasses leg 02 or the body 01 for accommodating dry batteries or rechargeable batteries, and the charging interface 8 may not be provided in this case.

[0058] Volume and brightness adjustment keys are also provided on the glasses leg 02, specifically including an increase key 11 and a decrease key 12, and the two keys are integrally formed; the end close to the body 01 is the increase key 11, and the end away from the body 01 is the decrease key 12. In this embodiment, the volume can be adjusted by tapping; the brightness can be adjusted by long pressing. In other embodiments, the brightness can also be adjusted by tapping, and the volume can be adjusted by long pressing. Although in this embodiment, the volume and brightness share a button, this is not a limitation of the present invention. Without departing from the principles of the present invention, in other embodiments, those skilled in the art may also choose to set buttons for adjusting the volume and brightness separately, which can be adjusted in steps by tapping, and can be adjusted continuously by long pressing. These do not deviate from the basic principles of the present invention and will fall within the scope of protection of the present invention.

[0059] The body 01 is also provided with a wearing detector 5, which is specifically arranged in the middle position of the body 01 and arranged toward the rear. The wearing detector 5 is specifically an infrared detector, which is used to detect whether a person is wearing the AR glasses; the wearing detector 5 is electrically connected to the control module and can transmit the detected information to the control module. If the medical staff wears the AR glasses, the control module can respond to the instructions of each button. If the medical staff does not wear the AR glasses, the control module does not respond to the instructions of each button; that is, the AR glasses cannot be used when they are not worn.

[0060] The images recorded by the AR camera 13 can be displayed on the optical module 2 for the wearer to watch. The information processed by the control module (including images and text) can also be displayed on the optical module 2 for the wearer to watch.

[0061] The mobile terminal is generally placed on the ambulance, which is specifically a small computer that can perform various data calculations and can also communicate. The AR glasses are provided with a mobile communication card (SIM card) to achieve wireless communication with the mobile terminal. The AR glasses can also be connected to the mobile terminal wirelessly via Bluetooth, WiFi, etc. The AR glasses or the mobile terminal are connected to the server in communication, specifically through a communication card set on the AR glasses or a communication card on the mobile terminal. The control module of the AR glasses can also transmit the recorded images and processed information to the smart terminal and the server.

[0062] The AR device can obtain the facial features of the patient and transmit the obtained facial features to the server. The server can obtain the patient's historical medical records based on the facial features. The server can transmit the historical medical records to the AR device so that the on-site doctor can obtain the patient's basic symptoms and assist the on-site doctor in rescuing the patient. Specifically, the camera 13 of the AR device can record the patient's video and obtain facial features based on the recorded video. The specific acquisition method is the same as the existing method of obtaining facial features based on the video, which will not be repeated here. The server can obtain the patient's identity information based on the patient's facial features. Specifically, it can be connected to the household registration system and obtained based on the data of the household registration system; it can also be connected to the social security system and obtained based on the data of the social security system. The patient's historical medical records can be obtained from the medical system based on the patient's identity information. Both on-site doctors and hospital doctors can obtain the patient's basic symptoms based on historical cases, and then rescue the patient based on the basic symptoms and the on-site condition.

[0063] The server can contact the hospital doctor, who can assist the on-site doctor in rescuing the patient based on the patient's underlying condition. The on-site doctor can contact the hospital doctor through the AR device and the server to seek help from the hospital doctor. That is, the hospital doctor can determine the patient's condition and precautions based on the patient's underlying condition and the condition obtained by the on-site doctor, and then guide the on-site doctor to rescue the patient.

[0064] The patient's current condition can be obtained through on-site diagnosis by an on-site doctor, or the patient's physiological indicators can be obtained through instruments, and the patient's condition can be determined based on the patient's physiological indicators. Specifically, it can be obtained through traditional contact instruments. It can also be obtained through non-contact methods. This embodiment will describe the non-contact acquisition method in detail.

[0065] The AR device can obtain the patient's first physiological indicator and transmit the obtained first physiological indicator to the smart terminal.

[0066] The AR device can obtain the patient's first physiological index and transmit the obtained first physiological index to the smart terminal. The first physiological index specifically includes a first blood oxygen saturation, a first heart rate, a first respiratory rate, and a first heart rate variability. The AR device specifically obtains each first physiological index based on the patient's facial video.

[0067] In this embodiment, preferably, the control module of the AR device can perform calculations based on the facial video to obtain a first physiological indicator. Although in this embodiment, the control module of the AR device calculates and obtains the first physiological indicator based on the facial video, this is not a limitation of the present invention. Without departing from the principles of the present invention, in other embodiments, those skilled in the art may also choose to send the facial video to a smart terminal, and have the smart terminal perform calculations to obtain the first physiological indicator. Alternatively, the facial video may be sent to a server, and the server performs calculations based on the facial video to obtain the first physiological indicator. These do not deviate from the basic principles of the present invention and will fall within the scope of protection of the present invention.

[0068] By obtaining the first physiological index based on the facial video, the measurement can be performed without contact, which can reduce the tactile pressure when the measuring device contacts the test person or the psychological pressure and discomfort caused by the environment, and will not cause harm to the test person, thereby reducing its impact on the measurement, and obtaining physiological parameter results that are more in line with the current state of the test person. In addition, the method of obtaining facial video is relatively fast and convenient, and the calculation and acquisition of the first physiological index is also relatively rapid. The first physiological index can be obtained quickly and a rapid diagnosis can be achieved; patients can receive targeted and effective rescue in a shorter time.

[0069] A variety of physiological parameters can be measured through facial videos taken by an ordinary camera 13. The method is simple and convenient to use and is more suitable for use in daily life.

[0070] The AR device can also obtain on-site videos and transmit them to smart terminals. Smart terminals can contact hospital doctors through servers, and hospital doctors can assist on-site doctors in rescuing patients based on on-site videos. Hospital doctors can use on-site videos to determine whether there is enough space at the treatment site, whether the patient's home has equipment that can assist in treatment, what operations can be performed at the patient's home, and how to successfully transport the patient to the ambulance. On-site videos can provide more targeted guidance to on-site doctors for targeted rescue.

[0071] “Acquiring a first physiological index based on the patient's facial video” specifically includes: inputting the facial video into a multi-task network model to calculate and obtain a first heart rate and a first respiratory rate. The multi-task network model is specifically a MTTS-CAN multi-task network model. Figure 3 As shown, it specifically includes the following steps:

[0072] S11, inputting the frames of the facial video and the differential normalization results between the frames into the MTTS-CAN multi-task network model, and outputting the signal curves of the first heart rate and the first respiratory rate.

[0073] S12, cancel the signal to perform detrending, filtering and spectrum calculation.

[0074] S13. Calculate a first heart rate and a first respiratory rate according to the frequency corresponding to the maximum value of the spectrum.

[0075] The obtained first heart rate and first respiratory rate can be transmitted by the control module to the smart terminal so that the smart terminal can be calibrated, and subsequently analyze the condition, contact hospital doctors, and transmit them to the AR glasses for display.

[0076] “Acquiring a first physiological indicator based on the patient's facial video” also includes: obtaining a first heart rate variability, such as Figure 4 As shown, it specifically includes the following steps:

[0077] S21, performing peak detection on the signal curve of the first heart rate using scipy;

[0078] S22, obtaining a sequence consisting of time differences of all adjacent peak points according to the positions corresponding to the peaks;

[0079] S23. Calculate the standard deviation of the sequence to obtain the first heart rate variability.

[0080] The obtained first heart rate variability can be transmitted by the control module to the smart terminal so that the smart terminal can be calibrated, and subsequently analyze the condition, contact hospital doctors, and transmit it to the AR glasses for display.

[0081] “Acquiring a first physiological indicator based on the patient's facial video” also includes acquiring a first blood oxygen saturation. The calculation formula for the first blood oxygen saturation SPO2 is as follows:

[0082]

[0083] Among them, A and B are empirical constants, and the R value is calculated from the red and blue channel values ​​of the ROI. The calculation formula is:

[0084]

[0085] Among them, ROI is obtained according to the facial video, I AC λ1 and I AC λ2 They refer to the standard deviation of the red and blue channel signals, respectively. DC λ1 and I DC λ2 are the average values ​​of the red and blue channel signals respectively.

[0086] The region of interest ROI is obtained in the following manner: all key points of the face are detected in the facial video, and the region of interest ROI is obtained according to the key points. The specific method of obtaining the ROI is prior art and will not be described in detail in this embodiment.

[0087] The first blood oxygen saturation obtained can be transmitted by the control module to the server for calibration, subsequent analysis of the condition, contact with hospital doctors, and transmission to the AR glasses for display.

[0088] The bracelet can be worn on the patient's wrist and can obtain the patient's second physiological index. Among them, the second physiological index includes blood pressure, second heart rate, second heart rate variability, second respiratory rate and second blood oxygen saturation. The specific acquisition method is basically the same as that of the existing bracelet, which will not be repeated here.

[0089] At least part of the first physiological index can be calibrated according to at least the second physiological index; specifically, the calibration is performed by multimodal data fusion, and more specifically, by data proportion.

[0090] The first heart rate can be calibrated according to the second heart rate to obtain the calibrated first heart rate, wherein the data of the second heart rate accounts for a large proportion, specifically 55%, 60% or 65%, etc. The first heart rate variability can be calibrated according to the second heart rate variability to obtain the calibrated first heart rate variability, wherein the data of the second heart rate variability accounts for a large proportion, specifically 55%, 60% or 65%, etc. The first respiratory rate can be calibrated according to the second respiratory rate to obtain the calibrated first respiratory rate, wherein the data of the second respiratory rate accounts for a large proportion, specifically 55%, 60% or 65%, etc. The first blood oxygen saturation can be calibrated according to the second blood oxygen saturation to obtain the calibrated first blood oxygen saturation, wherein the data of the second blood oxygen saturation accounts for a large proportion, specifically 55%, 60% or 65%, etc.

[0091] The process of calibrating the data is handled by the smart terminal, and the calibrated data can be displayed on the optical module of the AR glasses. Moreover, the blood pressure of the second physiological indicator can also be displayed on the optical module, so that the on-site doctor can observe and obtain it, and use it to judge the condition. Specifically, the smart terminal transmits the calibrated first physiological indicator and blood pressure to the AR glasses, and the display is controlled by the control module. Although the data is calibrated by the smart terminal in this embodiment, this is not a limitation of the present invention. Without departing from the principles of the present invention, in other embodiments, those skilled in the art may also choose to calibrate the data by AR glasses, bracelets or servers.

[0092] The intelligent terminal can diagnose the patient based on the calibrated first physiological index and blood pressure to obtain a preliminary condition, and transmit the diagnosis result to the on-site doctor to assist the on-site doctor in rescuing the patient.

[0093] The smart terminal can also contact hospital doctors through the server, and contact hospital doctors in relevant departments based on the initial condition. Hospital doctors can assist on-site doctors in rescuing patients based on the calibrated first physiological indicators and blood pressure. Hospital doctors can determine the patient's condition based on the calibrated first physiological indicators and blood pressure, and further determine the patient's condition, and can better guide on-site doctors to treat the patient based on the condition.

[0094] The blood pressure and the first physiological index after calibration can be transmitted to the smart terminal, which processes it to preliminarily determine the patient's condition and contact the hospital doctor in the corresponding department according to the condition. The smart terminal can also transmit the blood pressure and the first physiological index after calibration to the hospital doctor, who determines the patient's condition based on the above physiological indexes and then guides the on-site doctor based on this.

[0095] Specific usage of this emergency system:

[0096] After the on-site doctor arrives at the rescue site, he wears AR glasses and does not wear a bracelet on the patient; the camera of the AR glasses records the patient's facial video and on-site video, and the AR device calculates and obtains the patient's first physiological index based on the facial video and transmits the first physiological index and the on-site video to the smart terminal and the server. The server obtains the patient's identity based on the facial video and obtains the patient's historical case based on the patient's identity. The bracelet can obtain the patient's second physiological index and transmit it to the smart terminal. The smart terminal calibrates the first physiological index based on part of the second physiological index to obtain the calibrated first physiological index. The smart terminal can preliminarily determine the patient's condition based on blood pressure, the calibrated first physiological index and historical cases to obtain the preliminary condition. The smart terminal can request the server to contact the hospital doctor of the corresponding department based on the condition. The hospital doctor further determines the patient's condition based on blood pressure, the calibrated first physiological index, historical cases and facial video, and then guides the on-site doctor based on the on-site video and condition, so that the on-site doctor can rescue the patient scientifically and effectively.

[0097] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

Claims

1. An emergency system, characterized in that: It includes AR device, smart terminal and wristband, which are connected to each other; The AR device can obtain a first physiological indicator of the patient and transmit the obtained first physiological indicator to the smart terminal, and the wristband can obtain a second physiological indicator of the patient, and can calibrate at least part of the first physiological indicator according to at least part of the second physiological indicator; The intelligent terminal can perform diagnosis based on the calibrated first physiological index and part of the second physiological index to obtain a preliminary condition; The diagnosis results will be transmitted to the on-site doctors to assist them in rescuing the patients.

2. The emergency rescue system according to claim 1, characterized in that: The smart terminal, the AR glasses or the bracelet can contact a hospital doctor, and the hospital doctor can assist the on-site doctor in rescuing the patient based on the calibrated first physiological indicator and part of the second physiological indicator.

3. The emergency rescue system according to claim 1, characterized in that: The AR device can also acquire on-site video and transmit the acquired on-site video to doctors in the hospital. The doctors in the hospital can assist on-site doctors in rescuing patients based on the on-site video.

4. The emergency rescue system according to claim 2, characterized in that: The first physiological index includes a first blood oxygen saturation, a first heart rate, a first respiratory rate and a first heart rate variability; the second physiological index includes blood pressure, a second heart rate, a second heart rate variability, a second respiratory rate and a second blood oxygen saturation; The first heart rate is calibrated according to the second heart rate, the first heart rate variability is calibrated according to the second heart rate variability, the first respiratory rate is calibrated according to the second respiratory rate, and the first blood oxygen saturation is calibrated according to the second blood oxygen saturation.

5. The emergency rescue system according to claim 4, characterized in that: The first physiological indicator is obtained based on the patient's facial video.

6. The emergency rescue system according to claim 5, characterized in that: The facial video is input into the multi-task network model to calculate the heart rate and breathing rate.

7. The emergency rescue system according to claim 6, characterized in that: Inputting frames of the facial video and differential normalization results between frames into the multi-task network model, and outputting signal curves of heart rate and respiratory rate; Detrending, filtering and spectrum calculation of the signal; The heart rate and respiratory rate are calculated based on the frequency corresponding to the maximum value of the spectrum.

8. The emergency rescue system according to claim 7, characterized in that: Performing peak detection on the heart rate signal curve; According to the position corresponding to the peak, a sequence consisting of the time differences of all adjacent peak points is obtained; The standard deviation of the series was calculated to obtain the heart rate variability.

9. The emergency rescue system according to claim 5, characterized in that: The calculation formula for blood oxygen saturation SPO2 is as follows: Among them, A and B are empirical constants, and the R value is calculated from the red and blue channel values ​​of the ROI. The calculation formula is: Wherein, ROI is obtained according to the facial video, I AC λ1 and I AC λ2 They refer to the standard deviation of the red and blue channel signals, respectively. DC λ1 and I DC λ2 are the average values ​​of the red and blue channel signals respectively.

10. The emergency rescue system according to claim 9, characterized in that: All key points of the human face are detected in the facial video, and a region of interest ROI is obtained according to the key points.

Images