First-aid system

Abstract

The invention relates to the technical field of first aid, in particular to a first aid system, and aims to solve the problem that existing voice communication cannot well guide doctors on site to rescue. In order to achieve the purpose, the first-aid system comprises an AR device and a server which are in communication connection, the AR device can obtain physiological indexes of a patient and transmit the obtained physiological indexes to the server, the server can make contact with hospital doctors, and the hospital doctors can assist field doctors in rescuing the patient according to the physiological indexes. Physiological indexes are measured under the non-contact condition, the psychological stress and discomfort of a detected person caused by touch oppression or the environment when the measuring device is in contact are reduced, the detected person cannot be hurt, and therefore the influence of the detected person on measurement is reduced. The detection mode is rapid and convenient, the physiological indexes can be rapidly calculated and obtained, the physiological indexes can be rapidly obtained, and rapid diagnosis is achieved; and the patient can be effectively rescued in a targeted manner in a shorter time.

Description

Technical Field

[0001] The invention relates to the technical field of first aid, and in particular provides a first aid system. Background Art

[0002] When a patient has a disease or other pathological phenomenon, the family will generally call the emergency number and ask the hospital doctor for help. However, since the ambulance needs to be on duty 24 hours a day, and after arriving at the scene, it is not only necessary to provide on-site first aid to the patient, but also to transfer the patient to the ambulance and then send him to the hospital for treatment. The labor intensity is high and the physical fitness requirements are high.

[0003] Ambulances are usually staffed by young doctors or emergency doctors. Young doctors lack experience, which sometimes makes it difficult to accurately judge the condition of the patient. Young doctors and emergency doctors may be more familiar with the conditions of some areas due to professional limitations, but not familiar with the conditions of areas other than their major. However, the conditions of the patients on site are diverse, and the doctors on site may not be able to accurately determine the conditions, so they need the assistance of hospital doctors. However, hospital doctors currently only assist through voice calls on mobile terminals such as mobile phones, which cannot provide good guidance for on-site doctors.

[0004] Therefore, the relevant field is in urgent need of a first aid system to solve the above technical problems. Summary of the invention

[0005] The present invention aims to solve the above technical problem, that is, to solve the problem that existing voice calls cannot well guide on-site doctors to perform first aid.

[0006] In a first aspect, the present invention provides an emergency rescue system, which includes an AR device and a server that are communicatively connected, wherein the AR device can obtain physiological indicators of a patient and transmit the obtained physiological indicators to the server, and the server can contact a hospital doctor, and the hospital doctor can assist on-site doctors in rescuing the patient based on the physiological indicators.

[0007] In a specific implementation of the above-mentioned first aid system, the AR device can also obtain on-site video and transmit the obtained on-site video to the server. The server can contact hospital doctors, and the hospital doctors can assist on-site doctors in rescuing patients based on the on-site video.

[0008] In a specific implementation of the above emergency system, the physiological indicators include blood oxygen saturation, heart rate, respiratory rate and heart rate variability.

[0009] In a specific implementation of the emergency rescue system, the physiological index is obtained based on the patient's facial video.

[0010] In a specific implementation of the first aid system, the facial video is input into a multi-task network model to calculate the heart rate and respiratory rate.

[0011] In a specific implementation of the first aid system, the frames of the facial video and the differential normalization results between the frames are input into the multi-task network model, and the signal curves of the heart rate and the respiratory rate are output;

[0012] Detrending, filtering and spectrum calculation of the signal;

[0013] The heart rate and respiratory rate are calculated based on the frequency corresponding to the maximum value of the spectrum.

[0014] In a specific implementation of the emergency system, peak detection is performed on the heart rate signal curve;

[0015] According to the position corresponding to the peak, a sequence consisting of the time differences of all adjacent peak points is obtained;

[0016] The standard deviation of the series was calculated to obtain the heart rate variability.

[0017] In the specific implementation of the above emergency system, the calculation formula of blood oxygen saturation SPO2 is as follows:

[0018]

[0019] Among them, A and B are empirical constants, and the R value is calculated from the red and blue channel values ​​of the ROI. The calculation formula is:

[0020]

[0021] Wherein, ROI is obtained according to the facial video, I AC λ1 and I AC λ2 They refer to the standard deviation of the red and blue channel signals, respectively. DC λ1 and I DC λ2 are the average values ​​of the red and blue channel signals respectively.

[0022] In a specific implementation of the emergency rescue system, all key points of the human face are detected in the facial video, and a region of interest ROI is obtained according to the key points.

[0023] In a specific implementation of the above-mentioned emergency rescue system, the AR device is AR glasses, and the AR glasses are provided with a camera, and the camera can obtain the facial video and the on-site video of the patient.

[0024] In the case of adopting the above technical solution, the AR device of the present invention can obtain the physiological indicators of the patient and transmit the obtained physiological indicators to the server. The server can contact the hospital doctor, and the hospital doctor can assist the on-site doctor to rescue the patient according to the physiological indicators. The hospital doctor can determine the patient's condition based on the physiological indicators, preliminarily determine the patient's condition, and can better guide the on-site doctor to treat the patient according to the condition.

[0025] The AR device can obtain the patient's physiological indicators and transmit the obtained physiological indicators to the server. The AR device specifically obtains physiological indicators based on the patient's facial video. By obtaining physiological indicators based on facial videos, measurements can be performed without contact, which can reduce the tactile pressure of the measuring equipment when in contact or the psychological pressure and discomfort caused by the environment to the person being tested, and will not cause harm to the person being tested, thereby reducing its impact on the measurement and obtaining physiological parameter results that are more in line with the current state of the person being tested. In addition, the method of obtaining facial videos is relatively quick and convenient, and the calculation and acquisition of physiological indicators is also relatively rapid. Physiological indicators can be obtained quickly and a rapid diagnosis can be achieved; patients can receive targeted and effective rescue in a shorter time.

[0026] A variety of physiological parameters can be measured through facial videos taken by ordinary cameras. It is simple and convenient to use and more suitable for use in daily life.

[0027] The AR device can also obtain on-site video and transmit the obtained on-site video to the server. The server can contact the hospital doctor, and the hospital doctor can assist the on-site doctor in rescuing the patient based on the on-site video. The hospital doctor can judge whether the treatment site has sufficient space, whether the patient's home has equipment that can assist in treatment, what operations can be performed at the patient's home, and how to smoothly transport the patient to the ambulance. The on-site video can be used to guide the on-site doctor to provide targeted rescue in a more targeted manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings, in which:

[0029] Figure 1 This is a schematic diagram of the structure of the AR glasses provided by the present invention. Figure 1 ;

[0030] Figure 2 This is a schematic diagram of the structure of the AR glasses provided by the present invention. Figure 2 ;

[0031] Figure 3 is a detailed flow chart of steps for obtaining heart rate and respiratory rate provided by the present invention;

[0032] Figure 4It is a flow chart of detailed steps for obtaining heart rate specificity provided by the present invention.

[0033] List of reference numerals:

[0034] 01. Main body; 02. Glasses leg; 1. Nose pad; 2. Optical module; 3. Myopia lens; 4. Switch; 5. Wearing detector; 6. Speaker; 7. Screen switch; 8. Charging port; 9. Sound pickup hole; 10. Sunshade lens; 11. Increase key; 12. Decrease key; 13. Camera. DETAILED DESCRIPTION

[0035] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0036] It should be noted that in the description of the present invention, the terms "upper", "lower", "left", "right", "inner", "outer" and the like indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings, which are only for the convenience of description, and do not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0037] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installation", "setting", and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a direct connection, an indirect connection through an intermediate medium, or the internal connection of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0038] In order to solve the problem that existing voice calls cannot effectively guide on-site doctors to provide first aid.

[0039] This embodiment discloses an emergency rescue system, which is mainly used in ambulances to serve emergency rescue personnel in ambulances and mainly assist on-site doctors in treating patients.

[0040] The emergency system includes an AR device and a server that are communicatively connected, wherein the server is specifically a background server, which is generally set up in a hospital, specifically in a main computer room of the hospital, and can contact the doctor on duty at the hospital at any time and can also transmit the instructions of the doctor on duty.

[0041] The AR device is AR glasses, such as Figure 1 and 2As shown, the AR glasses include a glasses frame, a camera 13, two optical modules 2, two myopia lenses 3, a microphone, a speaker 6 and a microphone, etc.

[0042] The eyeglass frame includes a body 01 and two eyeglass legs 02 rotatably arranged on the body 01. Two mounting holes are arranged on the body 01, and two optical modules 2 are respectively installed in the two mounting holes. A nose pad 1 is arranged in the middle of the body 01 for users to wear.

[0043] The camera 13 is set on the glasses frame, specifically on the body 01. The camera 13 is located at the front end of the glasses frame and between the two optical modules 2, that is, located in the middle of the body 01. The front end of the camera 13 is tilted downward to ensure that the image recorded by the camera 13 is synchronized with the image seen by the human eye; so that the subsequent data processing results are more accurate, so that the on-site doctor can provide better rescue for the patient. The camera 13 is specifically used to record the patient's facial video and on-site video, and can also record the patient's full body video and the video of the affected part.

[0044] Two myopia lenses 3 are respectively arranged corresponding to the two optical modules 2, and the myopia lenses 3 are arranged behind the optical module 2. The myopia lenses 3 are detachably mounted on the body 01. The myopia lenses 3 of corresponding degrees can be replaced according to different wearers; so that the wearer can wear the AR glasses without wearing contact lenses and can use them normally. Alternatively, the wearer does not need to wear myopia glasses, which can avoid interference between myopia glasses and AR glasses, causing discomfort when wearing AR glasses.

[0045] The microphone is arranged on the glasses frame, specifically arranged inside the glasses frame, specifically located inside the body 01 above the left or right optical module 2. A sound pickup hole 9 corresponding to the microphone is arranged on the glasses frame, and when the wearer speaks, the microphone can pick up the sound through the sound pickup hole 9 to make a call. Since the distance between the sound pickup hole 9 and the mouth is relatively close, the sound can be picked up better.

[0046] The speaker 6 is arranged on the glasses leg 02, and the two glasses legs 02 are both provided with a speaker 6. The speaker 6 is located above the ear, so that the sound of the speaker 6 can be better transmitted to the wearer's ear; so that the wearer can better obtain the transmitted sound.

[0047] In addition, the AR glasses also include a shading lens 10, which is arranged on the glasses frame and is located in front of the optical module 2. The shading lens 10 has a relatively large area and can completely cover the front surface of the entire body. The shading lens 10 can prevent strong external light from entering the optical module 2, thereby preventing external light from affecting the display of the optical module 2. A avoidance hole is provided on the shading lens 10, and the front end of the camera 13 is arranged in the avoidance hole, so that the shading lens 10 will not affect the recording of the image, so as to ensure the clarity of the recorded image.

[0048] The AR glasses also include a control module, in which the speaker 6, microphone, camera 13 and optical module 2 are all electrically connected to the control module, and the sound collected by the microphone can be transmitted to the control module, which processes and transmits it. The control module can transmit the sound signal to be emitted to the speaker 6 and control the speaker 6 to emit sound. The image collected by the camera 13 can be transmitted to the control module, and the control module can process the image, mainly to obtain the patient's information based on the image. The control module can transmit the image and text information to the optical module 2 for display.

[0049] The AR glasses also include a switch 4, which is arranged on the glasses frame and is used to switch the AR glasses between 2D mode and 3D mode. The switch 4 is connected to the control module, and the control module switches the display mode of the AR glasses according to the instruction of the switch 4. Specifically, when the current display mode of the AR glasses is 2D mode, pressing the switch once can switch the display mode to 3D mode; when the current display mode of the AR glasses is 3D mode, pressing the switch once can switch the display mode to 2D mode.

[0050] Preferably, the AR glasses further include a screen switch 7, which is arranged on the glasses frame and is used to control whether the optical module 2 displays an image. Specifically, the screen switch 7 is electrically connected to the control module, and when the control module receives an on command, it can control the optical module 2 to display an image; when the control module receives a off command, it can control the optical module 2 to turn off the displayed image, so that the optical module 2 no longer displays an image.

[0051] A lithium battery is also provided in the temple or the body of the glasses to power each module. A charging interface 8 is provided at the end of one of the temples, which is electrically connected to the lithium battery and can charge the lithium battery. The inflatable shaft charging interface 8 is specifically a Type-C interface, which can be a Type-B interface. Of course, in other embodiments, a battery slot can also be provided on the temple 02 or the body 01 to accommodate dry batteries or rechargeable batteries, and the charging interface 8 may not be provided in this case.

[0052] Volume and brightness adjustment keys are also provided on the legs of the glasses, specifically including an increase key 11 and a decrease key 12, and the two keys are integrally formed; the end close to the body is the increase key 11, and the end away from the body is the decrease key 12. In this embodiment, the volume can be adjusted by tapping; the brightness can be adjusted by long pressing. In other embodiments, the brightness can also be adjusted by tapping, and the volume can be adjusted by long pressing. Although in this embodiment, the volume and brightness share a button, this is not a limitation of the present invention. Without departing from the principles of the present invention, in other embodiments, those skilled in the art may also choose to set buttons for adjusting the volume and brightness separately, which can be adjusted in steps by tapping, and can be adjusted continuously by long pressing. These do not deviate from the basic principles of the present invention and will fall within the scope of protection of the present invention.

[0053] The body is also provided with a wearing detector 5, which is specifically arranged in the middle of the body and facing the rear. The wearing detector 5 is specifically an infrared detector, which is used to detect whether a person is wearing the AR glasses; the wearing detector 5 is electrically connected to the control module and can transmit the detected information to the control module. If the medical staff wears the AR glasses, the control module can respond to the instructions of each button. If the medical staff does not wear the AR glasses, the control module does not respond to the instructions of each button; that is, the AR glasses cannot be used when they are not worn.

[0054] The images recorded by the AR camera 13 can be displayed on the optical module 2 for the wearer to watch. The information processed by the control module (including images and text) can also be displayed on the optical module 2 for the wearer to watch.

[0055] AR glasses are equipped with a mobile communication card (SIM card) to achieve wireless communication with the server. AR glasses can also be connected to vehicle-mounted devices or other mobile terminals via Bluetooth, WiFi, etc., and vehicle-mounted devices and other mobile terminals are connected to the background server wirelessly to achieve communication. The control module can also transmit the recorded images and processed information to the server via wireless communication.

[0056] The AR device can obtain the patient's physiological indicators and transmit the obtained physiological indicators to the server. Among them, the physiological indicators specifically include blood oxygen saturation, heart rate, respiratory rate and heart rate variability. The server can preliminarily determine the patient's condition based on the patient's physiological indicators. The server can contact the hospital doctor, and specifically contact the hospital doctor of the relevant department based on the preliminarily determined condition. Hospital doctors can assist on-site doctors in rescuing patients based on physiological indicators. Specifically, hospital doctors can determine the patient's condition based on physiological indicators, further determine the patient's condition, and better guide on-site doctors to treat the patient based on the condition.

[0057] The AR device can obtain the patient's physiological indicators and transmit the obtained physiological indicators to the server. The AR device specifically obtains various physiological indicators based on the patient's facial video.

[0058] Specifically, the control module of the AR device can perform calculations based on the facial video to obtain physiological indicators. Although in the present embodiment, the control module of the AR device calculates and obtains physiological indicators based on the facial video, this is not a limitation of the present invention. Without departing from the principles of the present invention, in other embodiments, those skilled in the art may also choose to send the facial video to a server, and have the server perform calculations to obtain physiological indicators. Alternatively, the facial video may be sent to a vehicle-mounted device or a mobile terminal, and the vehicle-mounted device or the mobile terminal performs calculations and processing based on the facial video to obtain physiological indicators. These do not deviate from the basic principles of the present invention and will fall within the scope of protection of the present invention.

[0059] By obtaining physiological indicators based on facial videos, measurements can be made without contact, which can reduce the tactile pressure of the measuring device or the psychological pressure and discomfort caused by the environment to the person being tested, and will not cause harm to the person being tested, thereby reducing the impact on the measurement and obtaining physiological parameter results that are more in line with the current state of the person being tested. In addition, the method of obtaining facial videos is relatively quick and convenient, and the calculation and acquisition of physiological indicators is also relatively rapid. Physiological indicators can be obtained quickly and a rapid diagnosis can be achieved; patients can receive targeted and effective rescue in a shorter time.

[0060] A variety of physiological parameters can be measured through facial videos taken by an ordinary camera 13. The method is simple and convenient to use and is more suitable for use in daily life.

[0061] The AR device can also obtain on-site video and transmit the obtained on-site video to the server. The server can contact the hospital doctor, and the hospital doctor can assist the on-site doctor in rescuing the patient based on the on-site video. The hospital doctor can judge whether the treatment site has sufficient space, whether the patient's home has equipment that can assist in treatment, what operations can be performed at the patient's home, and how to smoothly transport the patient to the ambulance. The on-site video can be used to guide the on-site doctor to provide targeted rescue in a more targeted manner.

[0062] “Acquiring physiological indicators based on the patient’s facial video” specifically includes: inputting the facial video into a multi-task network model to calculate and obtain the heart rate and respiratory rate. The multi-task network model is specifically the MTTS-CAN multi-task network model. Figure 3 As shown, it specifically includes the following steps:

[0063] S11, input the frames of the facial video and the differential normalization results between frames into the MTTS-CAN multi-task network model, and output the signal curves of the heart rate and respiratory rate.

[0064] S12, cancel the signal to perform detrending, filtering and spectrum calculation.

[0065] S13. Calculate the heart rate and respiratory rate according to the frequency corresponding to the maximum value of the spectrum.

[0066] The obtained heart rate and respiratory rate can be transmitted by the control module to the optical module 2 for display, so that the on-site doctor can obtain the patient's heart rate and respiratory rate, so that the on-site doctor can judge the patient's condition. At the same time, the heart rate and respiratory rate will also be transmitted by the control module to the server, so that the server can analyze the condition and the hospital doctor can analyze the condition to guide the on-site doctor.

[0067] “Obtaining physiological indicators based on the patient’s facial video” also includes: obtaining heart rate variability, such as Figure 4 As shown, it specifically includes the following steps:

[0068] S21, performing peak detection on the heart rate signal curve using scipy;

[0069] S22, obtaining a sequence consisting of time differences of all adjacent peak points according to the positions corresponding to the peaks;

[0070] S23. Calculate the standard deviation of the sequence to obtain the heart rate variability.

[0071] The obtained heart rate variability can be transmitted by the control module to the optical module 2 for display, so that the on-site doctor can obtain the patient's heart rate variability, so that the on-site doctor can judge the patient's condition. At the same time, the heart rate variability will also be transmitted by the control module to the server, so that the server can analyze the condition and the hospital doctor can analyze the condition to guide the on-site doctor.

[0072] “Acquiring physiological indicators based on the patient’s facial video” also includes obtaining blood oxygen saturation. The calculation formula for blood oxygen saturation SPO2 is as follows:

[0073]

[0074] Among them, A and B are empirical constants, and the R value is calculated from the red and blue channel values ​​of the ROI. The calculation formula is:

[0075]

[0076] Among them, ROI is obtained according to the facial video, I AC λ1 and I AC λ2They refer to the standard deviation of the red and blue channel signals, respectively. DC λ1 and I DC λ2 are the average values ​​of the red and blue channel signals respectively.

[0077] The region of interest ROI is obtained in the following manner: all key points of the face are detected in the facial video, and the region of interest ROI is obtained according to the key points. The specific method of obtaining the ROI is prior art and will not be described in detail in this embodiment.

[0078] The obtained blood oxygen saturation can be transmitted by the control module to the optical module 2 for display, so that the on-site doctor can obtain the patient's blood oxygen saturation so that the on-site doctor can judge the patient's condition. At the same time, the blood oxygen saturation will also be transmitted by the control module to the server so that the server can analyze the condition and the hospital doctor can analyze the condition to guide the on-site doctor.

[0079] Specific usage of this emergency system:

[0080] After the on-site doctor arrives at the rescue site, he wears AR glasses; the camera 13 of the AR glasses records the patient's facial video and on-site video, and the AR device calculates the patient's physiological indicators based on the facial video, specifically calculating the heart rate and respiratory rate through a multi-task network model; obtains the heart rate variability by processing the heart rate signal curve; and obtains the blood oxygen saturation through the above formula. The AR glasses also transmit the physiological indicators and on-site video to the background server, which can preliminarily determine the patient's condition based on the physiological indicators and contact the hospital doctor in the corresponding department based on the condition. The hospital doctor further determines the patient's condition based on the physiological indicators and facial video, and then guides the on-site doctor based on the on-site video and the condition, so that the on-site doctor can rescue the patient scientifically and effectively.

[0081] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

Claims

1. An emergency system, characterized in that: It includes an AR device and a server that are communicatively connected. The AR device can obtain the patient's physiological indicators and transmit the obtained physiological indicators to the server. The server can contact hospital doctors, and the hospital doctors can assist on-site doctors in rescuing the patient based on the physiological indicators.

2. The emergency rescue system according to claim 1, characterized in that: The AR device can also acquire on-site video and transmit the acquired on-site video to the server. The server can contact hospital doctors, and the hospital doctors can assist on-site doctors in rescuing patients based on the on-site video.

3. The emergency rescue system according to claim 2, characterized in that: The physiological indicators include blood oxygen saturation, heart rate, respiratory rate and heart rate variability.

4. The emergency rescue system according to claim 3, characterized in that: The physiological index is obtained based on the patient's facial video.

5. The emergency rescue system according to claim 4, characterized in that: The facial video is input into the multi-task network model to calculate the heart rate and breathing rate.

6. The emergency rescue system according to claim 5, characterized in that: Inputting frames of the facial video and differential normalization results between frames into the multi-task network model, and outputting signal curves of heart rate and respiratory rate; Detrending, filtering and spectrum calculation of the signal; The heart rate and respiratory rate are calculated based on the frequency corresponding to the maximum value of the spectrum.

7. The emergency rescue system according to claim 6, characterized in that: Performing peak detection on the heart rate signal curve; According to the position corresponding to the peak, a sequence consisting of the time differences of all adjacent peak points is obtained; The standard deviation of the series was calculated to obtain the heart rate variability.

8. The emergency rescue system according to claim 4, characterized in that: The calculation formula for blood oxygen saturation SPO2 is as follows: Among them, A and B are empirical constants, and the R value is calculated from the red and blue channel values ​​of the ROI. The calculation formula is: Wherein, ROI is obtained according to the facial video, I AC λ1 and I AC λ2 They refer to the standard deviation of the red and blue channel signals, respectively. DC λ1 and I DC λ2 are the average values ​​of the red and blue channel signals respectively.

9. The emergency rescue system according to claim 8, characterized in that: All key points of the human face are detected in the facial video, and a region of interest ROI is obtained according to the key points.

10. The emergency rescue system according to claim 4, characterized in that: The AR device is an AR glasses, and the AR glasses are provided with a camera (13), and the camera (13) can obtain the facial video and the on-site video of the patient.

Images