First-aid system

Abstract

The invention relates to the technical field of first aid, particularly provides a first aid system, and aims to solve the problem that in the prior art, physiological indexes acquired only by a smart bracelet may be inaccurate. In order to achieve the purpose, the first-aid system comprises an AR device, a server and a bracelet which are in communication connection with one another; the AR device can acquire a first physiological index of a patient and transmit the acquired first physiological index to the server, and the bracelet can acquire a second physiological index of the patient and calibrate at least part of the first physiological index according to at least part of the second physiological index; the on-site doctor can rescue the patient according to the calibrated first physiological index and the part of the second physiological index. Therefore, the final physiological index structure can be more accurate, and a doctor can more accurately determine the illness state of a patient. The physiological indexes are obtained in two modes and are calibrated, so that the error of the physiological indexes obtained in a single mode can be reduced, and the accuracy of the physiological indexes is ensured.

Description

Technical Field

[0001] The invention relates to the technical field of first aid, and in particular provides a first aid system. Background Art

[0002] When a patient has a disease or other pathological phenomenon, the family will generally call the emergency number and ask the hospital doctor for help. However, since the ambulance needs to be on duty 24 hours a day, and after arriving at the scene, it is not only necessary to provide on-site first aid to the patient, but also to transfer the patient to the ambulance and then send him to the hospital for treatment. The labor intensity is high and the physical fitness requirements are high.

[0003] Ambulances are usually staffed by young doctors or emergency doctors. Young doctors lack experience, which sometimes makes it difficult to accurately judge the condition of the patient. Young doctors and emergency doctors may be more familiar with the conditions of some areas due to professional limitations, but not familiar with the conditions of areas other than their major. However, the conditions of the patients on site are diverse, and the doctors on site may not be able to accurately determine the conditions, so they need the assistance of hospital doctors. However, hospital doctors currently only assist through voice calls on mobile terminals such as mobile phones, which cannot provide good guidance for on-site doctors.

[0004] In addition, some of the patient's physiological indicators are obtained through traditional contact instruments, which is inefficient and requires moving the patient, which is very inconvenient. In order to solve this problem, some hospitals have equipped ambulances with smart bracelets to test the patient's physiological indicators. However, the physiological indicators obtained solely by smart bracelets may be inaccurate.

[0005] Therefore, the relevant field is in urgent need of a first aid system to solve the above technical problems. Summary of the invention

[0006] The present invention aims to solve the above technical problem, that is, to solve the problem that the physiological indicators obtained by relying solely on smart bracelets in the prior art may be inaccurate.

[0007] In a first aspect, the present invention provides an emergency rescue system, which includes an AR device, a server, and a wristband, which are communicatively connected with each other;

[0008] The AR device can obtain a first physiological indicator of the patient and transmit the obtained first physiological indicator to the server, the wristband can obtain a second physiological indicator of the patient, and can calibrate at least part of the first physiological indicator according to at least part of the second physiological indicator;

[0009] The on-site doctor can provide assistance to the patient based on the calibrated first physiological indicator and part of the second physiological indicator.

[0010] In a specific implementation of the above-mentioned emergency system, the server can contact a hospital doctor, and the hospital doctor can assist an on-site doctor in rescuing the patient based on the calibrated first physiological indicator and part of the second physiological indicator.

[0011] In a specific implementation of the above-mentioned first aid system, the AR device can also obtain on-site video and transmit the obtained on-site video to the server. The server can contact hospital doctors, and the hospital doctors can assist on-site doctors in rescuing patients based on the on-site video.

[0012] In a specific implementation of the above-mentioned emergency system, the first physiological indicator includes a first blood oxygen saturation, a first heart rate, a first respiratory rate and a first heart rate variability; the second physiological indicator includes blood pressure and pulse; and the first heart rate and the first heart rate variability are calibrated according to the pulse.

[0013] In a specific implementation of the above emergency system, the first physiological indicator is obtained based on the patient's facial video.

[0014] In a specific implementation of the first aid system, the frames of the facial video and the differential normalization results between the frames are input into the MTTS-CAN multi-task network model, and the signal curves of the first heart rate and the first respiratory rate are output;

[0015] Detrending, filtering and spectrum calculation of the signal;

[0016] The first heart rate and the first respiratory rate are calculated according to the frequency corresponding to the maximum value of the spectrum.

[0017] In a specific implementation of the emergency system, peak detection is performed on the signal curve of the first heart rate using scipy;

[0018] According to the position corresponding to the peak, a sequence consisting of the time differences of all adjacent peak points is obtained;

[0019] The standard deviation of the sequence is calculated to obtain the first heart rate variability.

[0020] In a specific implementation of the above emergency system, the calculation formula of the first blood oxygen saturation SPO2 is as follows:

[0021]

[0022] Among them, A and B are empirical constants, and the R value is calculated from the red and blue channel values ​​of the ROI. The calculation formula is:

[0023]

[0024] Wherein, ROI is obtained according to the facial video, I AC λ1 and I AC λ2 They refer to the standard deviation of the red and blue channel signals, respectively. DC λ1 and I DC λ2 are the average values ​​of the red and blue channel signals respectively.

[0025] In a specific implementation of the emergency rescue system, all key points of the human face are detected in the facial video, and a region of interest ROI is obtained according to the key points.

[0026] In a specific implementation of the above-mentioned emergency rescue system, the AR device is AR glasses, and the AR glasses are provided with a camera, and the camera can obtain the patient's facial video and on-site video.

[0027] When the above technical solution is adopted, the AR device of the present invention can obtain the patient's first physiological indicator and transmit the obtained first physiological indicator to the server, the bracelet can obtain the patient's second physiological indicator, and can calibrate at least part of the first physiological indicator according to at least part of the second physiological indicator; the on-site doctor can rescue the patient according to the calibrated first physiological indicator and part of the second physiological indicator.

[0028] By calibrating at least part of the first physiological indicator obtained through the facial video according to at least part of the second physiological indicator obtained through the bracelet, the final physiological indicator structure can be more accurate. When an error occurs in one of them, the error can be reduced through calibration, so that the doctor can more accurately determine the patient's condition. Acquiring physiological indicators in two ways and calibrating them can reduce the error of physiological indicators obtained by a single way and ensure the accuracy of physiological indicators.

[0029] Hospital doctors can assist on-site doctors in rescuing patients based on the calibrated first physiological index and part of the second physiological index. Hospital doctors participate remotely and guide on-site doctors in rescuing patients, so that patients can receive scientific and effective rescue.

[0030] By obtaining the first physiological index based on the facial video, the measurement can be performed without contact, which can reduce the tactile pressure when the measuring device contacts the test person or the psychological pressure and discomfort caused by the environment, and will not cause harm to the test person, thereby reducing its impact on the measurement, and obtaining physiological parameter results that are more in line with the current state of the test person. In addition, the method of obtaining facial video is relatively fast and convenient, and the calculation and acquisition of the first physiological index is also relatively rapid. The first physiological index can be obtained quickly and a rapid diagnosis can be achieved; patients can receive targeted and effective rescue in a shorter time.

[0031] The AR device can also obtain on-site video and transmit the obtained on-site video to the server. The server can contact the hospital doctor, and the hospital doctor can assist the on-site doctor in rescuing the patient based on the on-site video. The hospital doctor can judge whether the treatment site has sufficient space, whether the patient's home has equipment that can assist in treatment, what operations can be performed at the patient's home, and how to smoothly transport the patient to the ambulance. The on-site video can be used to guide the on-site doctor to provide targeted rescue in a more targeted manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings, in which:

[0033] Figure 1 This is a schematic diagram of the structure of the AR glasses provided by the present invention. Figure 1 ;

[0034] Figure 2 This is a schematic diagram of the structure of the AR glasses provided by the present invention. Figure 2 ;

[0035] Figure 3 is a detailed flow chart of steps for obtaining heart rate and respiratory rate provided by the present invention;

[0036] Figure 4 It is a flow chart of detailed steps for obtaining heart rate specificity provided by the present invention.

[0037] List of reference numerals:

[0038] 01. Main body; 02. Glasses leg; 1. Nose pad; 2. Optical module; 3. Myopia lens; 4. Switch; 5. Wearing detector; 6. Speaker; 7. Screen switch; 8. Charging port; 9. Sound pickup hole; 10. Sunshade lens; 11. Increase key; 12. Decrease key; 13. Camera. DETAILED DESCRIPTION

[0039] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0040] It should be noted that in the description of the present invention, the terms "upper", "lower", "left", "right", "inner", "outer" and the like indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings, which are only for the convenience of description, and do not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0041] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installation", "setting", and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a direct connection, an indirect connection through an intermediate medium, or the internal connection of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0042] In the traditional way, some physiological indicators of patients are obtained through traditional contact instruments. This method is inefficient and requires moving the patient, which is very inconvenient. In order to solve this problem, although some hospitals have equipped ambulances with smart bracelets to test the physiological indicators of patients, the physiological indicators obtained solely by smart bracelets may be inaccurate.

[0043] In order to solve the above technical problems, this embodiment discloses an emergency rescue system, which is mainly used in ambulances, serves the emergency rescue personnel of the ambulances, and mainly assists on-site doctors in treating patients.

[0044] The emergency system includes an AR device, a server and a wristband which are in communication connection, wherein the wristband is a smart wristband. The three are in communication connection with each other, specifically, each of them is in communication connection with each other.

[0045] The server is specifically a backend server, which is generally set up in a hospital and can contact the doctor on duty in the hospital at any time and can also transmit the instructions of the doctor on duty.

[0046] The AR device is AR glasses, such as Figure 1 and 2 As shown, the AR glasses include a glasses frame, a camera 13, two optical modules 2, two myopia lenses 3, a microphone, a speaker 6 and a microphone shading lens 10, etc.

[0047] The eyeglass frame includes a body 01 and two eyeglass legs 02 rotatably arranged on the body 01. Two mounting holes are arranged on the body 01, and two optical modules 2 are respectively installed in the two mounting holes. A nose pad 1 is arranged in the middle of the body 01 for users to wear.

[0048] The camera 13 is set on the glasses frame, specifically on the body 01. The camera 13 is located at the front end of the glasses frame and between the two optical modules 2, that is, located in the middle of the body 01. The front end of the camera 13 is tilted downward to ensure that the image recorded by the camera 13 is synchronized with the image seen by the human eye; so that the subsequent data processing results are more accurate, so that the on-site doctor can provide better rescue for the patient. The camera 13 is specifically used to record the patient's facial video and on-site video, and can also record the patient's full body video and the video of the affected part.

[0049] Two myopia lenses 3 are respectively arranged corresponding to the two optical modules 2, and the myopia lenses 3 are arranged behind the optical module 2. The myopia lenses 3 are detachably mounted on the body 01. The myopia lenses 3 of corresponding degrees can be replaced according to different wearers; so that the wearer can wear the AR glasses without wearing contact lenses and can use them normally. Alternatively, the wearer does not need to wear myopia glasses, which can avoid interference between myopia glasses and AR glasses, causing discomfort when wearing AR glasses.

[0050] The microphone is arranged on the glasses frame, specifically arranged inside the glasses frame, specifically located inside the body 01 above the left or right optical module 2. A sound pickup hole 9 corresponding to the microphone is arranged on the glasses frame, and when the wearer speaks, the microphone can pick up the sound through the sound pickup hole 9 to make a call. Since the distance between the sound pickup hole 9 and the mouth is relatively close, the sound can be picked up better.

[0051] The speaker 6 is arranged on the glasses leg 02, and the two glasses legs 02 are both provided with a speaker 6. The speaker 6 is located above the ear, so that the sound of the speaker 6 can be better transmitted to the wearer's ear; so that the wearer can better obtain the transmitted sound.

[0052] In addition, the AR glasses also include a shading lens 10, which is arranged on the glasses frame and is located in front of the optical module 2. The shading lens 10 has a relatively large area and can completely cover the entire front surface of the body 01. The shading lens 10 can prevent strong external light from entering the optical module 2, thereby preventing external light from affecting the display of the optical module 2. A avoidance hole is provided on the shading lens 10, and the front end of the camera 13 is arranged in the avoidance hole, so that the shading lens 10 will not affect the recording of the image, so as to ensure the clarity of the recorded image.

[0053] The AR glasses also include a control module, in which the speaker 6, microphone, camera 13 and optical module 2 are all electrically connected to the control module, and the sound collected by the microphone can be transmitted to the control module, which processes and transmits it. The control module can transmit the sound signal to be emitted to the speaker 6 and control the speaker 6 to emit sound. The image collected by the camera 13 can be transmitted to the control module, and the control module can process the image, mainly to obtain the patient's information based on the image. The control module can transmit the image and text information to the optical module 2 for display.

[0054] The AR glasses also include a switch 4, which is arranged on the glasses frame and is used to switch the AR glasses between 2D mode and 3D mode. The switch 4 is connected to the control module, and the control module switches the display mode of the AR glasses according to the instruction of the switch 4. Specifically, when the current display mode of the AR glasses is 2D mode, pressing the switch 4 once can switch the display mode to 3D mode; when the current display mode of the AR glasses is 3D mode, pressing the switch 4 once can switch the display mode to 2D mode.

[0055] Preferably, the AR glasses further include a screen switch 7, which is arranged on the glasses frame and is used to control whether the optical module 2 displays an image. Specifically, the screen switch 7 is electrically connected to the control module, and when the control module receives an on command, it can control the optical module 2 to display an image; when the control module receives a off command, it can control the optical module 2 to turn off the displayed image, so that the optical module 2 no longer displays an image.

[0056] A lithium battery is also provided in the glasses leg 02 or the body 01 for powering each module. A charging interface 8 is provided at the end of one of the glasses legs 02, which is electrically connected to the lithium battery and can charge the lithium battery. The inflatable shaft charging interface 8 is specifically a Type-C interface, which can be a Type-B interface. Of course, in other embodiments, a battery slot can also be provided on the glasses leg 02 or the body 01 for accommodating dry batteries or rechargeable batteries, and the charging interface 8 may not be provided in this case.

[0057] Volume and brightness adjustment keys are also provided on the glasses leg 02, specifically including an increase key 11 and a decrease key 12, and the two keys are integrally formed; the end close to the body 01 is the increase key 11, and the end away from the body 01 is the decrease key 12. In this embodiment, the volume can be adjusted by tapping; the brightness can be adjusted by long pressing. In other embodiments, the brightness can also be adjusted by tapping, and the volume can be adjusted by long pressing. Although in this embodiment, the volume and brightness share a button, this is not a limitation of the present invention. Without departing from the principles of the present invention, in other embodiments, those skilled in the art may also choose to set buttons for adjusting the volume and brightness separately, which can be adjusted in steps by tapping, and can be adjusted continuously by long pressing. These do not deviate from the basic principles of the present invention and will fall within the scope of protection of the present invention.

[0058] The body 01 is also provided with a wearing detector 5, which is specifically arranged in the middle position of the body 01 and arranged toward the rear. The wearing detector 5 is specifically an infrared detector, which is used to detect whether a person is wearing the AR glasses; the wearing detector 5 is electrically connected to the control module and can transmit the detected information to the control module. If the medical staff wears the AR glasses, the control module can respond to the instructions of each button. If the medical staff does not wear the AR glasses, the control module does not respond to the instructions of each button; that is, the AR glasses cannot be used when they are not worn.

[0059] The images recorded by the AR camera 13 can be displayed on the optical module 2 for the wearer to watch. The information processed by the control module (including images and text) can also be displayed on the optical module 2 for the wearer to watch.

[0060] AR glasses are equipped with a mobile communication card (SIM card) to achieve wireless communication with the server. AR glasses can also be connected to vehicle-mounted devices or other mobile terminals via Bluetooth, WiFi, etc., and vehicle-mounted devices and other mobile terminals are connected to the server wirelessly to achieve communication. The control module can also transmit the recorded images and processed information to the server via wireless communication.

[0061] The AR device can obtain the facial features of the patient and transmit the obtained facial features to the server. The server can obtain the patient's historical medical records based on the facial features. The server can transmit the historical medical records to the AR device so that the on-site doctor can obtain the patient's basic symptoms and assist the on-site doctor in rescuing the patient. Specifically, the camera 13 of the AR device can record the patient's video and obtain facial features based on the recorded video. The specific acquisition method is the same as the existing method of obtaining facial features based on the video, which will not be repeated here. The server can obtain the patient's identity information based on the patient's facial features. Specifically, it can be connected to the household registration system and obtained based on the data of the household registration system; it can also be connected to the social security system and obtained based on the data of the social security system. The patient's historical medical records can be obtained from the medical system based on the patient's identity information. Both on-site doctors and hospital doctors can obtain the patient's basic symptoms based on historical cases, and then rescue the patient based on the basic symptoms and the on-site condition.

[0062] The server can contact the hospital doctor, who can assist the on-site doctor in rescuing the patient based on the patient's underlying condition. The on-site doctor can contact the hospital doctor through the AR device and the server to seek help from the hospital doctor. That is, the hospital doctor can determine the patient's condition and some precautions based on the patient's underlying condition and the condition obtained by the on-site doctor, and then guide the on-site doctor to rescue the patient.

[0063] The patient's current condition can be obtained through on-site diagnosis by an on-site doctor, or the patient's physiological indicators can be obtained through instruments, and the patient's condition can be determined based on the patient's physiological indicators. Specifically, it can be obtained through traditional contact instruments. It can also be obtained through non-contact methods. This embodiment will describe the non-contact acquisition method in detail.

[0064] The AR device can obtain the patient's first physiological indicator and transmit the obtained first physiological indicator to the server.

[0065] The AR device can obtain the patient's first physiological index and transmit the obtained first physiological index to the server. The first physiological index specifically includes a first blood oxygen saturation, a first heart rate, a first respiratory rate, and a first heart rate variability. The AR device specifically obtains each first physiological index based on the patient's facial video.

[0066] Specifically, the control module of the AR device can perform calculations based on the facial video to obtain a first physiological indicator. Although in the present embodiment, the control module of the AR device calculates and obtains the first physiological indicator based on the facial video, this is not a limitation of the present invention. Without departing from the principles of the present invention, in other embodiments, those skilled in the art may also choose to send the facial video to a server, and have the server perform calculations to obtain the first physiological indicator. Alternatively, the facial video may be sent to a vehicle-mounted device or a mobile terminal, and the vehicle-mounted device or the mobile terminal performs calculations and processing based on the facial video to obtain the first physiological indicator. These do not deviate from the basic principles of the present invention and will fall within the scope of protection of the present invention.

[0067] By obtaining the first physiological index based on the facial video, the measurement can be performed without contact, which can reduce the tactile pressure when the measuring device contacts the test person or the psychological pressure and discomfort caused by the environment, and will not cause harm to the test person, thereby reducing its impact on the measurement, and obtaining physiological parameter results that are more in line with the current state of the test person. In addition, the method of obtaining facial video is relatively fast and convenient, and the calculation and acquisition of the first physiological index is also relatively rapid. The first physiological index can be obtained quickly and a rapid diagnosis can be achieved; patients can receive targeted and effective rescue in a shorter time.

[0068] A variety of physiological parameters can be measured through facial videos taken by an ordinary camera 13. The method is simple and convenient to use and is more suitable for use in daily life.

[0069] The AR device can also obtain on-site video and transmit the obtained on-site video to the server. The server can contact the hospital doctor, and the hospital doctor can assist the on-site doctor in rescuing the patient based on the on-site video. The hospital doctor can judge whether the treatment site has sufficient space, whether the patient's home has equipment that can assist in treatment, what operations can be performed at the patient's home, and how to smoothly transport the patient to the ambulance. The on-site video can be used to guide the on-site doctor to provide targeted rescue in a more targeted manner.

[0070] “Acquiring a first physiological index based on the patient's facial video” specifically includes: inputting the facial video into a multi-task network model to calculate and obtain a first heart rate and a first respiratory rate. The multi-task network model is specifically a MTTS-CAN multi-task network model. Figure 3 As shown, it specifically includes the following steps:

[0071] S11, inputting the frames of the facial video and the differential normalization results between the frames into the MTTS-CAN multi-task network model, and outputting the signal curves of the first heart rate and the first respiratory rate.

[0072] S12, cancel the signal to perform detrending, filtering and spectrum calculation.

[0073] S13. Calculate a first heart rate and a first respiratory rate according to the frequency corresponding to the maximum value of the spectrum.

[0074] The obtained first heart rate and first respiratory rate can be transmitted by the control module to the server for calibration, subsequent analysis of the condition, contact with hospital doctors, and transmission to the AR glasses for display.

[0075] “Acquiring a first physiological indicator based on the patient's facial video” also includes: obtaining a first heart rate variability, such as Figure 4 As shown, it specifically includes the following steps:

[0076] S21, performing peak detection on the signal curve of the first heart rate using scipy;

[0077] S22, obtaining a sequence consisting of time differences of all adjacent peak points according to the positions corresponding to the peaks;

[0078] S23. Calculate the standard deviation of the sequence to obtain the first heart rate variability.

[0079] The first heart rate variability obtained can be transmitted by the control module to the server for calibration, subsequent analysis of the condition, contact with hospital doctors, and transmission to the AR glasses for display.

[0080] “Acquiring a first physiological indicator based on the patient's facial video” also includes acquiring a first blood oxygen saturation. The calculation formula for the first blood oxygen saturation SPO2 is as follows:

[0081]

[0082] Among them, A and B are empirical constants, and the R value is calculated from the red and blue channel values ​​of the ROI. The calculation formula is:

[0083]

[0084] Among them, ROI is obtained according to the facial video, I AC λ1 and I AC λ2 They refer to the standard deviation of the red and blue channel signals, respectively. DC λ1 and I DC λ2 are the average values ​​of the red and blue channel signals respectively.

[0085] The region of interest ROI is obtained in the following manner: all key points of the face are detected in the facial video, and the region of interest ROI is obtained according to the key points. The specific method of obtaining the ROI is prior art and will not be described in detail in this embodiment.

[0086] The first blood oxygen saturation obtained can be transmitted by the control module to the server for calibration, subsequent analysis of the condition, contact with hospital doctors, and transmission to the AR glasses for display.

[0087] The bracelet can be worn on the patient's wrist and can obtain the patient's second physiological index. Among them, the second physiological index includes blood pressure, second heart rate, second heart rate variability, second respiratory rate and second blood oxygen saturation. The specific acquisition method is basically the same as that of the existing bracelet, which will not be repeated here.

[0088] At least part of the first physiological index can be calibrated according to at least the second physiological index; specifically, the calibration is performed by multimodal data fusion, and more specifically, by data proportion.

[0089] The first heart rate can be calibrated according to the second heart rate to obtain the calibrated first heart rate, wherein the data of the second heart rate accounts for a large proportion, specifically 55%, 60% or 65%, etc. The first heart rate variability can be calibrated according to the second heart rate variability to obtain the calibrated first heart rate variability, wherein the data of the second heart rate variability accounts for a large proportion, specifically 55%, 60% or 65%, etc. The first respiratory rate can be calibrated according to the second respiratory rate to obtain the calibrated first respiratory rate, wherein the data of the second respiratory rate accounts for a large proportion, specifically 55%, 60% or 65%, etc. The first blood oxygen saturation can be calibrated according to the second blood oxygen saturation to obtain the calibrated first blood oxygen saturation, wherein the data of the second blood oxygen saturation accounts for a large proportion, specifically 55%, 60% or 65%, etc.

[0090] The process of calibrating the data is handled by the server, and the calibrated data can be transmitted to the AR glasses and displayed on the optical module of the AR glasses. Moreover, the blood pressure of the second physiological indicator can also be displayed on the optical module, so that the on-site doctor can observe and obtain it, and use it to judge the condition. Although the data is calibrated by the server in this embodiment, this is not a limitation of the present invention. Without departing from the principles of the present invention, in other embodiments, those skilled in the art may also choose to calibrate the data by AR glasses or bracelets.

[0091] The server can preliminarily determine the patient's condition based on the patient's calibrated first physiological index and blood pressure. The server can contact the hospital doctor, and can contact the hospital doctor of the relevant department based on the preliminarily determined condition. The hospital doctor can assist the on-site doctor in rescuing the patient based on the calibrated first physiological index and blood pressure. The hospital doctor can determine the patient's condition based on the calibrated first physiological index and blood pressure, and further determine the patient's condition, and can better guide the on-site doctor to treat the patient based on the condition.

[0092] The blood pressure and the first physiological index after calibration can be transmitted to the server, which processes the patient's condition and contacts the hospital doctor of the corresponding department according to the condition. The server can also transmit the blood pressure and the first physiological index after calibration to the hospital doctor, who determines the patient's condition based on the above physiological index and then guides the on-site doctor based on it.

[0093] Specific usage of this emergency system:

[0094] After the on-site doctor arrives at the rescue site, he wears AR glasses and does not wear a bracelet on the patient; the camera of the AR glasses records the patient's facial video and on-site video, and the AR device calculates and obtains the patient's first physiological index based on the facial video and transmits the first physiological index and the on-site video to the server. The server obtains the patient's identity based on the facial video and obtains the patient's historical case based on the patient's identity. The bracelet can obtain the patient's second physiological index, calibrate the first physiological index based on part of the second physiological index, and obtain the calibrated first physiological index. The server can preliminarily determine the patient's condition based on blood pressure, the calibrated first physiological index and historical cases, and contact the hospital doctor of the corresponding department based on the condition. The hospital doctor further determines the patient's condition based on blood pressure, the calibrated first physiological index, historical cases and facial video, and then guides the on-site doctor based on the on-site video and condition, so that the on-site doctor can rescue the patient scientifically and effectively.

[0095] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

Claims

1. An emergency system, characterized in that: It includes AR device, server and wristband, which are connected to each other; The AR device can obtain a first physiological indicator of the patient and transmit the obtained first physiological indicator to the server, the wristband can obtain a second physiological indicator of the patient, and can calibrate at least part of the first physiological indicator according to at least part of the second physiological indicator; The on-site doctor can provide assistance to the patient based on the calibrated first physiological indicator and part of the second physiological indicator.

2. The emergency rescue system according to claim 1, characterized in that: The server can contact a doctor in the hospital, and the doctor in the hospital can assist an on-site doctor in rescuing the patient based on the calibrated first physiological indicator and part of the second physiological indicator.

3. The emergency rescue system according to claim 1, characterized in that: The AR device can also acquire on-site video and transmit the acquired on-site video to the server. The server can contact hospital doctors, and the hospital doctors can assist on-site doctors in rescuing patients based on the on-site video.

4. The emergency rescue system according to claim 1, characterized in that: The first physiological index includes a first blood oxygen saturation, a first heart rate, a first respiratory rate and a first heart rate variability; the second physiological index includes blood pressure, a second heart rate, a second heart rate variability, a second respiratory rate and a second blood oxygen saturation; The first heart rate is calibrated according to the second heart rate, the first heart rate variability is calibrated according to the second heart rate variability, the first respiratory rate is calibrated according to the second respiratory rate, and the first blood oxygen saturation is calibrated according to the second blood oxygen saturation.

5. The emergency rescue system according to claim 4, characterized in that: The first physiological indicator is obtained based on the patient's facial video.

6. The emergency rescue system according to claim 5, characterized in that: The facial video is input into a multi-task network model to calculate and obtain a first heart rate and a first respiratory rate.

7. The emergency rescue system according to claim 6, characterized in that: Inputting frames of the facial video and differential normalization results between frames into the multi-task network model, and outputting signal curves of a first heart rate and a first respiratory rate; Detrending, filtering and spectrum calculation of the signal; The first heart rate and the first respiratory rate are calculated according to the frequency corresponding to the maximum value of the spectrum.

8. The emergency rescue system according to claim 7, characterized in that: Performing peak detection on the calibrated curve of the first heart rate; According to the position corresponding to the peak, a sequence consisting of the time differences of all adjacent peak points is obtained; The standard deviation of the sequence is calculated to obtain the first heart rate variability.

9. The emergency rescue system according to claim 5, characterized in that: The calculation formula of the first blood oxygen saturation SPO2 is as follows: Among them, A and B are empirical constants, and the R value is calculated from the red and blue channel values ​​of the ROI. The calculation formula is: Wherein, ROI is obtained according to the facial video, I AC λ1 and I AC λ2 They refer to the standard deviation of the red and blue channel signals, respectively. DC λ1 and I DC λ2 are the average values ​​of the red and blue channel signals respectively.

10. The emergency rescue system according to claim 9, characterized in that: All key points of the human face are detected in the facial video, and a region of interest ROI is obtained according to the key points.

Images