Physiological parameter acquisition method and device, electronic equipment and storage medium

Abstract

The invention relates to a physiological parameter obtaining method and device, electronic equipment and a storage medium, the physiological parameter obtaining method comprises the steps that in response to a detection instruction, face information of a user is obtained, and the face information comprises a face image; acquiring physiological parameters of the user based on the detection instruction and the face image; the current detection state information is fed back to the user based on the acquisition result of the physiological parameters, the physiological parameters of the user are acquired based on the detection instruction and the face image, and the current detection state information is fed back to the user according to the acquisition result of the physiological parameters of the user, so that feedback of the current detection state information is realized; and a feedback mechanism of the current detection state information is realized, so that the interaction effect between the vehicle-mounted tool and the user is improved.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method, device, electronic device and storage medium for acquiring physiological parameters. Background Art

[0002] As an on-board tool, a car is used for users to ride in. Users need to look forward when driving a car. As the application of cars becomes more and more widespread, various physiological parameters of users can be tested in the car. Users can be drivers or passengers. In the prior art, users are in the car and are tested for various physiological parameters by the built-in electronic module of the car. For the detection of various physiological parameters, the detection status information of various physiological parameters is not informed to the user. The user does not know the detection status information during the detection process of various physiological parameters, resulting in the lack of feedback mechanism for the existing detection of physiological parameters, which affects the interaction effect between the on-board tool and the user. Summary of the invention

[0003] The purpose of the present application is to provide a physiological parameter acquisition method, device, electronic device and storage medium, which can acquire the physiological parameters of a user based on detection instructions and facial images; based on the acquisition results of the physiological parameters, the current detection status information is fed back to the user, thereby realizing the feedback of the current detection status information, and realizing the feedback mechanism of the current detection status information, so as to improve the interaction effect between the vehicle-mounted tool and the user.

[0004] According to a first aspect of an embodiment of the present application, a method for acquiring physiological parameters is provided, comprising:

[0005] In response to the detection instruction, acquiring the user's facial information, the facial information including the facial image;

[0006] Based on the detection instruction and the facial image, obtaining physiological parameters of the user;

[0007] Based on the acquisition result of the physiological parameters, the current detection status information is fed back to the user.

[0008] In one embodiment, the acquiring of the user's facial information in response to the detection instruction includes:

[0009] Matching the detection environment requirements based on the detection instructions;

[0010] Adjust the vehicle environment according to the detection environment requirements;

[0011] In response to the vehicle environment meeting the detection environment requirement, acquiring user facial information.

[0012] In one embodiment, obtaining the physiological parameters of the user based on the detection instruction and the facial image includes:

[0013] Matching preset image requirements based on the detection instructions;

[0014] Determining whether the facial image meets preset image requirements;

[0015] If it is determined that the facial image does not meet the preset image requirements, obtaining a first adjustment instruction;

[0016] The position of the camera is adjusted based on the first adjustment instruction; or, the first adjustment instruction is issued to the user, wherein the first adjustment instruction includes prompt information for reminding the user to adjust the direction.

[0017] In one embodiment, obtaining the physiological parameters of the user based on the detection instruction and the facial image includes:

[0018] Determining a detection area in the facial image required for detecting physiological parameters based on the detection instruction;

[0019] Determine whether the current state of the detection area meets the preset area requirements;

[0020] If the current state of the detection area meets the preset area requirements, the physiological parameters of the user are obtained according to the detection area.

[0021] In one embodiment, the step of determining whether the current state of the detection area meets the preset area requirements further includes:

[0022] Acquiring clarity information of the detection area;

[0023] Determining whether the clarity information exceeds a preset clarity threshold range;

[0024] If it is determined that the clarity information exceeds a preset clarity threshold range, obtaining corresponding test data;

[0025] Passing the acquired test data through a machine learning model to obtain validity parameters of the test data;

[0026] Determining whether the validity parameter is greater than a preset validity parameter;

[0027] If it is determined that the validity parameter is greater than the preset validity parameter, it is determined that the current state of the detection area meets the preset area requirements.

[0028] In one embodiment, after determining whether the current state of the detection area meets the preset area requirement, the method includes:

[0029] If it is determined that the validity parameter is less than the preset validity parameter, it is determined that the current state of the detection area does not meet the preset area requirement; obtaining a second adjustment instruction;

[0030] The angle of the camera is adjusted based on the second adjustment instruction; or, the second adjustment instruction is issued to the user, wherein the second adjustment instruction includes prompt information for reminding the user to adjust the angle.

[0031] In one embodiment, the feeding back current detection status information to the user based on the acquisition result of the physiological parameter includes:

[0032] Determining the acquisition result of the physiological parameter;

[0033] If the physiological parameter is acquired effectively, the user is fed back with successful detection status information or the detection status information of detection completion is fed back to the user;

[0034] If the physiological parameter is invalid, the user is fed back a failed detection status information;

[0035] Monitoring the user's health status according to the effective physiological parameters;

[0036] Wherein, each time after the result of obtaining the physiological parameter is determined, the current detection status information is fed back to the user, and the detection status information is at least one of sound information, text information and light information;

[0037] The acquisition result includes one or more of detection completion, detection validity, and detection failure.

[0038] According to a second aspect of an embodiment of the present application, a physiological parameter acquisition device is provided, which is applied to a sun visor in a car, and a plurality of electronic modules are integrated on the sun visor in the car; the physiological parameter acquisition device comprises:

[0039] A first acquisition module is configured to acquire the user's facial information in response to the detection instruction, wherein the facial information includes a facial image;

[0040] a second acquisition module, configured to acquire physiological parameters of the user based on the detection instruction and the facial image;

[0041] The feedback module is configured to feed back current detection status information to the user based on the acquisition result of the physiological parameters.

[0042] According to a third aspect of an embodiment of the present application, there is provided an electronic device, including:

[0043] one or more processors;

[0044] The storage device is used to store one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the above-mentioned physiological parameter acquisition method.

[0045] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned physiological parameter acquisition method is implemented.

[0046] Compared with the prior art, the present application can realize the detection of the user's physiological characteristics and feedback of the current detection status information, thereby improving the interaction effect between the vehicle-mounted tool and the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A schematic diagram showing a process of a method for acquiring physiological parameters according to an embodiment of the present application is shown;

[0048] Figure 2 Shows Figure 1 Schematic diagram of the process of S110;

[0049] Figure 3 Shows Figure 1 Schematic diagram of the process of S120;

[0050] Figure 4 Shows Figure 1 Schematic diagram of the process flow of S130;

[0051] Figure 5 A schematic diagram of a sun visor according to a physiological parameter acquisition method according to an embodiment of the present application is shown;

[0052] Figure 6 A block diagram of a vehicle-mounted physiological parameter acquisition device according to an embodiment of the present application is shown;

[0053] Figure 7 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION

[0054] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concept of the example embodiments to those skilled in the art.

[0055] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the present application.

[0056] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0057] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0058] As an on-board tool, a car is used for users to ride in. Users need to look forward when driving a car. As the application of cars becomes more and more widespread, various physiological parameters of users can be tested in the car. Users can be drivers or passengers. In the prior art, users are in the car and are tested for various physiological parameters by the built-in electronic module of the car. For the detection of various physiological parameters, the detection status information of various physiological parameters is not informed to the user. The user does not know the detection status information during the detection process of various physiological parameters, resulting in the lack of feedback mechanism for the existing detection of physiological parameters, which affects the interaction effect between the on-board tool and the user.

[0059] In order to solve the above-mentioned technical problems, the purpose of the present application is to provide a physiological parameter acquisition method, device, electronic device and storage medium, which can feedback the current detection status information to the user based on the acquisition results of the physiological parameters, thereby realizing the feedback of the current detection status information, and realizing the feedback mechanism of the current detection status information, so as to improve the interaction effect between the vehicle-mounted tool and the user.

[0060] Figure 1 A physiological parameter acquisition method is shown according to an exemplary embodiment. The physiological parameter acquisition method can be applied to cars, bicycles or smart cockpits to acquire user physiological characteristic data. Please refer to Figures 1 to 4The physiological parameter acquisition method at least includes steps S110 to S140, which are described in detail as follows (the following description is made by taking the application of the method to a car as an example):

[0061] In step S110 , in response to the detection instruction, the user's facial information is acquired, where the facial information includes a facial image.

[0062] In an embodiment of the present application, a user can enter the vehicle-mounted tool and drive the vehicle-mounted tool. At this time, the vehicle-mounted tool can be at least one of a car, a bicycle or a smart cockpit. When the user enters the vehicle-mounted tool, a user's location signal is obtained to facilitate determining that the user is in the vehicle-mounted tool. After the user enters the vehicle-mounted tool, the user's detection instruction is obtained. At this time, the detection instruction can be the user's input instruction, or a detection instruction triggered by the sensor sensing the user, which is not limited here.

[0063] In the embodiment of the present application, various electronic modules can be integrated on the sun visor 20 in the car, and online detection can be performed for the user. The sun visor 20 can be manufactured using a variety of technologies, for example, a camera 10 and a display screen can be provided, the camera 10 is used to capture the image of the user, the display screen is used to display the interface, the interface can be a detection interface, or other interfaces, the signal transmission path is connected to the camera 10 and the display screen, and the camera 10 is located between two fixed positions of the sun visor 20, and the display screen is located on the lower side of the camera 10. Of course, the position arrangement of the camera 10 and the display screen can be changed as needed. Among them, the physiological parameter acquisition device is applied to the sun visor 20 in the car.

[0064] The specific steps can be as follows:

[0065] Step S111, matching the detection environment requirements based on the detection instruction;

[0066] In an embodiment of the present application, after the user enters the vehicle-mounted tool, the user's detection instruction is obtained. At this time, the detection instruction can be an input instruction of the user, or a detection instruction triggered by the sensor sensing the user. It is not limited here, and the input method is not limited either. For example, it can be voice input. The detection instruction can be transmitted in the form of a signal. For example, a sun visor 20 can be provided in the vehicle-mounted tool, and the user's face can be photographed by the camera 10 of the sun visor 20 to obtain the user's facial image, so as to further perform regional processing based on the user's facial image. Of course, in some embodiments, the facial image can also be obtained.

[0067] In an embodiment of the present application, the detection instruction can be parsed to determine the image detection signal within the detection instruction, so as to trigger image detection based on the detection instruction. After receiving the instruction, the camera 10 of the sun visor 20 takes an online photo of the user. The photo may be a real-time image or a real-time video stream. At the same time, the detection environment requirements are matched based on the detection instruction to determine the detection environment requirements according to the detection type, thereby further adjusting the vehicle environment and adapting the detection type. For example, when measuring electrocardiogram, the light brightness reaches a certain threshold; when measuring blood pressure, another threshold must be reached, or humidity, temperature and other conditions must be met.

[0068] Step S112, adjusting the vehicle environment according to the detection environment requirements;

[0069] In an embodiment of the present application, the vehicle environment can be adjusted based on the detection environment requirements, and the vehicle environment can be adaptively adjusted so that the vehicle environment meets the detection environment requirements, thereby ensuring the subsequent shooting of the user's facial image. By comparing the detection environment with the vehicle environment, adaptive adjustments are made to various environmental parameters in the vehicle environment so as to change the user's imaging effect, and effective detection is performed on the detection type corresponding to the detection instruction. Optionally, the vehicle environment can be adjusted for brightness, humidity, temperature, etc., which are not limited here. For example, brightness adjustment can turn on fill lights or ambient lights arranged in the car.

[0070] Step S113: In response to the vehicle environment meeting the detection environment requirement, acquiring the user's facial information.

[0071] In an embodiment of the present application, when the in-vehicle environment meets the detection environment requirements, the current in-vehicle environment in the in-vehicle tool can be an environmental requirement that meets the detection type corresponding to the detection requirements, so as to facilitate further corresponding type detection of the user. At this time, in response to the in-vehicle environment meeting the detection environment requirements, the user's facial information is obtained. Before obtaining the user's facial information, the in-vehicle environment is adjusted to ensure that the in-vehicle environment meets the detection environment requirements. The detection environment requirements can be environmental requirements mapped to the detection instructions.

[0072] In an embodiment of the present application, obtaining the physiological parameters of the user based on the detection instruction and the facial image also includes: determining the detection area required for detecting the physiological parameters in the facial image based on the detection instruction; judging whether the current state of the detection area meets the preset area requirements; if the current state of the detection area meets the preset area requirements, obtaining the physiological parameters of the user according to the detection area.

[0073] Among them, the detection instruction is parsed, and the detection area required for detecting physiological parameters in the facial image is determined based on the detection instruction, so as to determine the corresponding detection area. For example, the required detection area is obtained according to the detection instruction. The detection instruction requires electrocardiogram detection, then the detection area is preferably the forehead and cheek. Of course, in some embodiments, the present application may not distinguish between detection areas.

[0074] In order to further ensure the accuracy of the user's physiological parameters, it is necessary to make a qualification judgment on the detection area required for detecting the physiological parameters in the facial image. At this time, it is determined whether the current state of the detection area meets the preset area requirements, and the current state of the detection area is compared with the preset area requirements. If the current state of the detection area meets the preset area requirements, the user's physiological parameters are obtained according to the detection area. The user's physiological parameters are obtained only after verifying that the detection area is a qualified area, thereby ensuring the accuracy of the user's physiological parameters. Therefore, before obtaining the user's physiological parameters, it is necessary to verify the vehicle environment, the facial image, and the detection area, so as to ensure the collectability of the facial image through the verification of the vehicle environment, the verification of the facial image, and the verification of the detection area, and to ensure the accuracy of obtaining the user's physiological parameters.

[0075] In addition, in the step of determining whether the current state of the detection area meets the preset area requirements, it also includes: obtaining clarity information of the detection area; determining whether the clarity information exceeds a preset clarity threshold range; if it is determined that the clarity information exceeds the preset clarity threshold range, obtaining corresponding test data; and obtaining validity parameters of the test data by passing the obtained test data through a machine learning model;

[0076] In an embodiment of the present application, clarity detection may be performed on the detection area, and clarity information of the detection area may be obtained, so as to compare the clarity information with a preset clarity threshold range, thereby determining whether the clarity information exceeds the preset clarity threshold range.

[0077] If it is determined that the clarity information exceeds the preset clarity threshold range, the clarity of the detection area meets the corresponding requirements, and further corresponding test data is acquired for the detection area, so as to pass the acquired test data through the machine learning model to obtain the validity parameters of the test data, so as to perform subsequent operations on the validity parameters of the test data, and optionally, the machine learning model is trained by previous test data and validity parameters.

[0078] Determine whether the validity parameter is greater than a preset validity parameter; if it is determined that the validity parameter is greater than the preset validity parameter, determine that the current state of the detection area meets the preset area requirements.

[0079] In an embodiment of the present application, a determination is made with respect to the current state of the detection area. At this time, the validity parameter is compared with a preset validity parameter, and a determination is made as to whether the validity parameter is greater than the preset validity parameter. If it is determined that the validity parameter is greater than the preset validity parameter, then it is determined that the current state of the detection area meets the preset area requirements, so that the detection area satisfies the subsequent acquisition of the user's physiological parameters, thereby ensuring the accuracy of the acquisition of the user's physiological parameters.

[0080] In addition, if it is determined that the validity parameter is less than the preset validity parameter, then it is determined that the current state of the detection area does not meet the preset area requirements; a second adjustment instruction is obtained; the angle of the camera 10 is adjusted based on the second adjustment instruction; or, the second adjustment instruction is issued to the user, and the second adjustment instruction includes prompt information for reminding the user to adjust the angle, so that the current state of the detection area is adjusted through the second adjustment instruction, thereby ensuring that the current state of the detection area after the adjustment meets the preset area requirements, and then the user's physiological parameters are acquired based on the adjusted detection area, thereby ensuring the accuracy of the acquisition of the user's physiological parameters.

[0081] Of course, in the above embodiment, all steps that require conditional judgment can proceed directly to the next step without conditional judgment. For example, the judgment of the detection area can directly obtain the image of the detection area through the camera 10 without distinguishing whether it is a detection area.

[0082] refer to Figure 3 In step S120, the physiological parameters of the user are obtained based on the detection instruction and the facial image.

[0083] In an embodiment of the present application, the physiological parameters of the user can be obtained through the detection instruction and the facial image, and the detection area of ​​the facial image can be determined based on the detection instruction to facilitate further detection of the detection area, thereby obtaining the physiological parameters of the user, thereby ensuring the accuracy of the user's physiological parameters.

[0084] The specific steps are as follows:

[0085] Step S121, matching preset image requirements based on the detection instruction;

[0086] In one embodiment of the present application, the detection instruction can be parsed, and the image requirement parsed by the detection instruction is used as the preset image requirement to facilitate monitoring of the image requirement, thereby ensuring image acquisition under the preset image requirement and ensuring the facial image. For example: for an electrocardiogram detection instruction, the corresponding preset image requirement is that the forehead and / or cheek are clearly exposed in the facial image.

[0087] Step S122, determining whether the facial image meets preset image requirements;

[0088] In one embodiment of the present application, the facial image can be compared with preset image requirements, and the preset image requirements are used as standard requirements. By comparing the facial image with the preset image requirements, it is determined whether the facial image is qualified, which further ensures the accuracy of the facial image, thereby improving the collection of the user's physiological parameters based on the facial image.

[0089] Step S123: If it is determined that the facial image does not meet the preset image requirements, a first adjustment instruction is obtained.

[0090] In one embodiment of the present application, if it is determined that the facial image does not meet the preset image requirements, a first adjustment instruction is obtained to adjust the position of the camera 10 or the position of the user based on the first adjustment instruction, thereby ensuring that the adjusted facial image meets the preset image requirements, thereby triggering the subsequent acquisition of the user's physiological parameters, so as to further acquire the user's physiological parameters when the facial image is a qualified image, thereby ensuring the accuracy of the user's physiological parameters and reducing the impact of environmental factors.

[0091] Step S124: adjusting the position of the camera 10 based on the first adjustment instruction; or, issuing the first adjustment instruction to the user, wherein the first adjustment instruction includes prompt information for reminding the user to adjust the direction.

[0092] In an embodiment of the present application, the first adjustment instruction may be parsed and adjustment information may be determined so as to trigger adjustment of the position of the camera 10 or the position of the user through the adjustment information.

[0093] The position of the camera 10 is adjusted based on the first adjustment instruction. At this time, the adjustment information serves as a position signal of the camera 10, so as to trigger the position adjustment of the camera 10 according to the position signal of the camera 10, thereby ensuring that the camera 10 is adjusted in place, and then ensuring that the adjusted facial image meets the preset image requirements.

[0094] The first adjustment instruction is sent to the user, and the first adjustment instruction includes prompt information for reminding the user to adjust the direction. At this time, the adjustment information is used as prompt information for reminding the user to adjust the direction, so as to trigger the user's position adjustment according to the prompt information for reminding the user to adjust the direction, thereby realizing the adjustment of the user's position, thereby ensuring that the user's position is adjusted in place, and then ensuring that the adjusted facial image meets the preset image requirements. Optionally, the prompt information for the user to adjust the direction is played in the form of sound to realize the active adjustment of the user's position.

[0095] In another embodiment of the present application, the user's test item information in the test instruction can be obtained to determine the required test site based on the user's test item information, so as to facilitate targeted testing, thereby improving the accuracy of the test items through targeted testing.

[0096] refer to Figure 4 In step S130, based on the acquisition result of the physiological parameters, the current detection status information is fed back to the user.

[0097] In an embodiment of the present application, the acquisition result of the physiological parameters is determined, and based on the acquisition result of the physiological parameters, the current detection status information is fed back to the user, thereby realizing the feedback of the current detection status information and realizing the feedback mechanism of the current detection status information, so as to improve the interaction effect between the vehicle-mounted tool and the user.

[0098] The acquisition result includes one or more of detection completion, detection validity, and detection failure.

[0099] The specific steps include:

[0100] Step S131, determining the acquisition result of the physiological parameters.

[0101] In one embodiment of the present application, the validity of the obtained result of the physiological parameter can be judged, so as to further screen the obtained result of the physiological parameter, thereby ensuring the validity of the obtained result of the physiological parameter. At this time, the obtained result of the physiological parameter generally refers to the electrocardiogram signal, blood pressure signal, etc. that can be obtained according to the detection area in the face image.

[0102] Step S132: If the physiological parameter is obtained effectively, the successful detection status information is fed back to the user, or the detection status information of the detection completion is fed back to the user.

[0103] In one embodiment of the present application, the validity of the acquired physiological parameters is judged, and if the acquired physiological parameters are valid, the successful detection status information is fed back to the user, and only the physiological parameters in a valid state can trigger the user's feedback, thereby feeding back the successful detection status information to the user. In another embodiment, after the data acquisition is completed, the status information of the detection completion can be fed back to the user.

[0104] Step S133: If the physiological parameters obtained are invalid, the detection status information of failure is fed back to the user.

[0105] In one embodiment of the present application, a validity judgment is performed on the acquired physiological parameters. If the acquired physiological parameters are invalid, failed detection status information is fed back to the user, and the physiological parameters in an invalid state are abandoned, thereby ensuring that valid physiological parameters are used to monitor the user's health status.

[0106] Step S134: monitor the user's health status according to the effective physiological parameters.

[0107] Among them, the physiological parameters collected in real time are sent to the server or the user's health status is judged based on the collected facial information, so as to monitor the user's health status according to the effective physiological parameters, avoid the influence of the invalid physiological parameters, and thus ensure the accuracy of the user's health status.

[0108] In one embodiment, the acquired valid detection results are stored, and the physiological characteristic change information can be dynamically understood. Of course, when an abnormal health status is acquired, an alarm can be promptly issued using the backend or server or vehicle-mounted system.

[0109] Among them, after each time the result of obtaining the physiological parameters is judged, the current detection status information is fed back to the user, and the detection status information is at least one of sound information, text information and light information. At this time, the detection status information includes successful detection status information and / or failed detection status information. For successful detection status information, the corresponding sound information is "detection successful and completed" and the green light is on for 3 seconds; for failed detection status information, the corresponding sound information is "detection failed and re-rotation" and the red light is on for 3 seconds, which is not limited here. Specific embodiment one:

[0111] Step 1: Install a vehicle-mounted sun visor 20 based on image processing. Step 2: The user enters the vehicle-mounted tool and manually enters the identity information to enter the background algorithm processing center. Step 3: The user opens the sun visor 20, and the camera 10 captures the user's facial information. Step 4: The screen text prompts to start / re-collect data. Step 5: The background judgment algorithm processing center determines whether the collected data is available. If the judgment result is no, repeat the previous step. If the judgment result is yes, proceed to the next step. Step 6: The ambient light flashes 3 times to indicate that the collection has been completed. Step 7: The background algorithm processing center uses facial recognition technology to identify and analyze the user. Step 8: The background algorithm processing center analyzes the collected data. Step 9: The real-time results are actually displayed to the user on the display screen. Specific embodiment 2:

[0113] Step 1: Install a vehicle-mounted sun visor 20 based on image processing. Step 2: After the user enters the car, manually enter the identity information into the background algorithm processing center. Step 3: The user opens the sun visor 20, and the camera 10 captures the user's facial information. Step 4: The screen text prompts to start / re-collect data. Step 5: The background judgment algorithm processing center determines whether the collected data is available. If the judgment result is no, repeat the previous step. If the judgment result is yes, proceed to the next step. Step 6: The car voice assistant reminds the customer that data collection has been completed. Step 7: The background algorithm processing center uses facial recognition technology to identify and analyze the user. Step 8: The background algorithm processing center analyzes the collected data. Step 9: The real-time results are actually displayed to the user on the display screen. Specific embodiment three:

[0115] Step 1: Install a vehicle-mounted sun visor 20 based on image processing. Step 2: After the user enters the car, manually input the identity information (or automatically identify the identity) to enter the background algorithm processing center. Step 3: The user opens the sun visor 20, and the camera 10 captures the user's facial information. Step 4: The user selects the physiological parameters that need to be detected. Step 5: Match the corresponding detection environment requirements according to the physiological parameters that the user selects to be detected. Step 6: Adjust the in-car environment so that the in-car environment can meet the detection requirements. Step 7: After the in-car environment is adjusted, the in-car environment is detected. If it meets the requirements, start collecting user facial information data. Data collection can be started through screen text prompts. Step 8: The collected data is transmitted to the background judgment algorithm processing center to judge whether the collected data is useful. If the judgment result is no, the screen prompts the user to continue collecting. If the judgment result is yes, proceed to the next step. Step 9: Prompt the user through some prompting method (voice, ambient light, etc.) that the collection has ended. Step 10: The background algorithm processing center uses face recognition technology to identify and analyze the user. Step 11: The backend algorithm processing center analyzes the collected data. Step 12: The real-time results are actually displayed to the user on the display screen.

[0116] Furthermore, the detection environment requirements include temperature range, light intensity range, light color, light wavelength, etc. For example, if a user needs to perform heart rate data detection, the user's face is generally photographed using the principle of transdermal optical imaging. However, because the optical imaging principle is used, there are certain requirements for the surrounding lighting environment, light color, and light wavelength. In order to achieve better shooting effects and more accurate analysis of hemoglobin concentration, it is best to adjust the light in the car to a suitable range, such as: a light can be set in a certain position in the car or on the sun visor 20, the light can adjust the light brightness, can emit light of different colors and wavelengths, and the light is controlled by a processor in the vehicle to control the light to change according to environmental requirements. Specific embodiment three:

[0118] Install a vehicle-mounted sun visor 20 based on image processing. Step 2: After the user enters the vehicle, he manually inputs his identity information (or automatically identifies his identity) and enters the background algorithm processing center. Step 3: The user opens the sun visor 20, and the camera 10 captures the user's facial information. Step 4: The user selects the physiological parameters to be tested. Step 5: Take a picture of the user's face. Step 6: According to the position of the user's face in the picture, calculate whether the user's face position is not in the center of the picture and needs to be adjusted, or whether the position of the user's face in the picture is inconvenient for data collection and needs to be adjusted. Step 7: If adjustment is required, output instructions to control the drive device in the camera 10 to control the camera 10 to rotate and adjust the shooting angle. If not, proceed directly to step 8. Step 8: After adjusting the shooting angle, start collecting user facial information data. Data collection can be started through a screen text prompt. Step 9: The collected data is transmitted to the background judgment algorithm processing center to judge whether the collected data is useful. If the judgment result is no, the screen prompts the user to continue collecting. If the judgment result is yes, proceed to the next step. Step 10: Notify the user through some prompting method (voice, ambient light, etc.) that the collection has been completed. Step 11: The background algorithm processing center uses face recognition technology to identify and analyze the user. Step 12: The background algorithm processing center analyzes the collected data. Step 13: The real-time results are actually displayed to the user on the display screen.

[0119] Compared with the prior art, the beneficial effects of the present application are: in response to a detection instruction, a facial image of a user is acquired; in the facial image, a detection area required for detecting the physiological parameters of the user is determined; it is judged whether the current state of the detection area meets the requirements of a preset area; if it is determined to be compliant, the physiological parameters of the user are acquired from the detection area. At this time, the facial image of the user is acquired, and the detection area required for detecting the physiological parameters of the user is determined for the facial image of the user. Only when the current state of the detection area meets the requirements of the preset area, the physiological parameters of the user are acquired according to the detection area required for the physiological parameters of the user, thereby ensuring the acquisition of the physiological parameters of the user for a specific detection area, thereby ensuring the accuracy of the physiological parameters of the user.

[0120] The following describes an embodiment of the device of the present application, which can be used to execute the physiological parameter acquisition method in the above embodiment of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the physiological parameter acquisition method in the above embodiment of the present application.

[0121] It should be noted that in the above embodiments, the various steps of implementing the physiological parameter acquisition method are only exemplary, and do not represent or imply that all steps must be performed in this order. A person skilled in the art can transform or change the execution order of the above steps based on the present invention. For example, the determination of conditions such as detection environment and area detection can be performed in step S110 or in step S120.

[0122] Figure 6 A block diagram of a physiological parameter acquisition device according to an embodiment of the present application is shown.

[0123] Reference Figure 6 As shown, according to a sun visor 20 used in a car in the present application, a plurality of electronic modules are integrated on the sun visor 20 in the car; the physiological parameter acquisition device includes:

[0124] A first acquisition module 210 is configured to acquire the user's facial information in response to a detection instruction, wherein the facial information includes a facial image;

[0125] A second acquisition module 220 is configured to acquire physiological parameters of the user based on the detection instruction and the facial image;

[0126] The feedback module 230 is configured to feed back current detection status information to the user based on the acquisition result of the physiological parameters.

[0127] During implementation, the physiological parameter acquisition device may adopt any of the physiological parameter acquisition methods in the above embodiments to acquire the physiological parameters of the user, or provide an assessment of the health status based on the physiological parameters.

[0128] In one embodiment of the present application, an electronic device is further provided, the electronic device comprising:

[0129] one or more processors;

[0130] A storage device is used to store one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the physiological parameter acquisition method as described in the above embodiments.

[0131] In one example, Figure 7 The schematic diagram of the structure of the computer system of the electronic device suitable for implementing the embodiment of the present application is shown. The electronic device can be integrated into the sun visor 20.

[0132] It should be noted that Figure 7 The computer system of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0133] like Figure 7 As shown, the computer system includes a central processing unit (CPU) 301 (i.e., the processor as described above), which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 302 or the program loaded from the storage part 308 to the random access memory (RAM) 303, such as executing the method described in the above embodiment. It should be understood that RAM 303 and ROM 302 are the storage devices as described above. In RAM 303, various programs and data required for system operation are also stored. CPU 301, ROM 302 and RAM 303 are connected to each other through bus 304. Input / output (I / O) interface 305 is also connected to bus 304.

[0134] The following components are connected to the I / O interface 305: an input section 306 including a keyboard, a mouse, etc.; an output section 307 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 308 including a hard disk, etc.; and a communication section 309 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as needed. A removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 310 as needed so that a computer program read therefrom is installed into the storage section 308 as needed.

[0135] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 309, and / or installed from a removable medium 311. When the computer program is executed by a central processing unit (CPU) 301, various functions defined in the system of the present application are executed.

[0136] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. Computer-readable storage medium can be, for example, - but not limited to - a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples of computer-readable storage mediums may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, a device or a device or used in combination with it.

[0137] In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable computer program. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0138] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0139] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not constitute limitations on the units themselves in some cases.

[0140] As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the above embodiment.

[0141] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0142] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation methods of the present application.

[0143] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.

[0144] It should be understood that the present application is not limited to the precise structure described above and shown in the drawings, and various modifications and changes can be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims. In the present invention, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance. The term "plurality" refers to two or more, unless otherwise expressly limited.

[0145] The above description of the embodiments is to facilitate those of ordinary skill in the art to understand and apply the present application. It is obvious that those familiar with the art can easily make various modifications to these embodiments and apply the general principles described herein to other embodiments without having to pay creative labor. Therefore, the present application is not limited to the embodiments herein, and improvements and modifications made by those skilled in the art based on the contents disclosed in the present application without departing from the scope and spirit of the present application are within the scope of the present application.

Claims

1. A method for obtaining physiological parameters, characterized in that: include: In response to the detection instruction, acquiring facial information of the user, the facial information including a facial image; Based on the detection instruction and the facial image, obtaining physiological parameters of the user; Based on the acquisition result of the physiological parameters, the current detection status information is fed back to the user.

2. The physiological parameter acquisition method according to claim 1, characterized in that: The step of obtaining the user's facial information in response to the detection instruction includes: Matching the detection environment requirements based on the detection instructions; Adjust the vehicle environment according to the detection environment requirements; In response to the vehicle environment meeting the detection environment requirement, acquiring user facial information.

3. The physiological parameter acquisition method according to claim 1, characterized in that: Based on the detection instruction and the facial image, obtaining physiological parameters of the user includes: Matching preset image requirements based on the detection instructions; Determining whether the facial image meets preset image requirements; If it is determined that the facial image does not meet the preset image requirements, obtaining a first adjustment instruction; The position of the camera is adjusted based on the first adjustment instruction; or, the first adjustment instruction is issued to the user, wherein the first adjustment instruction includes prompt information for reminding the user to adjust the direction.

4. The physiological parameter acquisition method according to claim 1, characterized in that: The acquiring the physiological parameters of the user based on the detection instruction and the facial image includes: Determining a detection area in the facial image required for detecting physiological parameters based on the detection instruction; Determine whether the current state of the detection area meets the preset area requirements; If the current state of the detection area meets the preset area requirements, the physiological parameters of the user are obtained according to the detection area.

5. The physiological parameter acquisition method according to claim 4, characterized in that: In the step of determining whether the current state of the detection area meets the preset area requirements, it also includes: Acquiring clarity information of the detection area; Determining whether the clarity information exceeds a preset clarity threshold range; If it is determined that the clarity information exceeds a preset clarity threshold range, obtaining corresponding test data; Passing the acquired test data through a machine learning model to obtain validity parameters of the test data; Determining whether the validity parameter is greater than a preset validity parameter; If it is determined that the validity parameter is greater than the preset validity parameter, it is determined that the current state of the detection area meets the preset area requirements.

6. The physiological parameter acquisition method according to claim 5, characterized in that: After determining whether the current state of the detection area meets the preset area requirements, the method further includes: If it is determined that the validity parameter is less than the preset validity parameter, it is determined that the current state of the detection area does not meet the preset area requirement; obtaining a second adjustment instruction; The angle of the camera is adjusted based on the second adjustment instruction; or, the second adjustment instruction is issued to the user, wherein the second adjustment instruction includes prompt information for reminding the user to adjust the angle.

7. The physiological parameter acquisition method according to any one of claims 1 to 6, characterized in that: The obtaining result of the physiological parameters is based on which the current detection status information is fed back to the user, including: Determining the acquisition result of the physiological parameter; If the physiological parameter is acquired effectively, the user is fed back with successful detection status information or the detection status information of detection completion is fed back to the user; If the physiological parameter is invalid, the user is fed back a failed detection status information; Monitoring the user's health status according to the effective physiological parameters; Among them, each time the acquisition result of the physiological parameter is judged, the current detection status information is fed back to the user, and the detection status information is at least one of sound information, text information and light information; the acquisition result includes one or more of detection completion, detection validity and detection failure.

8. A physiological parameter acquisition device, characterized in that: Applied to the sun visor in the car, where multiple electronic modules are integrated; The physiological parameter acquisition device comprises: A first acquisition module is configured to acquire the user's facial information in response to the detection instruction, wherein the facial information includes a facial image; a second acquisition module, configured to acquire physiological parameters of the user based on the detection instruction and the facial image; The feedback module is configured to feed back current detection status information to the user based on the acquisition result of the physiological parameters.

9. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, enables the one or more processors to implement the physiological parameter acquisition method as described in any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the physiological parameter acquisition method according to any one of claims 1 to 7 is implemented.

Images