Archives management method, device, equipment, storage medium and program product

Abstract

An embodiment of the present application discloses a file management method, apparatus, device and storage medium, wherein the method includes: performing physiological status detection on an occupant in a vehicle based on multiple frames of real-time images corresponding to the occupant; displaying real-time detection data obtained from the physiological status detection through a first interface of a connected display device; displaying the detection result of the occupant through a second interface of the display device when the physiological status detection meets a detection stop condition; the detection result is determined based on the real-time detection data; and in response to receiving a trigger operation for a file management control in the first interface or the second interface, managing the file data corresponding to the detection result through a third interface of the display device.

Description

Technical Field

[0001] The present application relates to, but is not limited to, the field of detection technology, and in particular to an archive management method, apparatus, device, and storage medium. Background Art

[0002] The physical health of passengers is a key consideration in vehicle safety. When an occupant becomes unwell or experiences sudden danger, timely vehicle safety control is required. Currently, if the driver or passenger in the vehicle cabin wants to understand their real-time health status, they need to use wearable devices for testing. If the driver or passenger does not purchase and wear such devices, it is difficult to understand their real-time health status. The lack of test data on the driver or passenger's physiological status is not conducive to comprehensive and effective safety protection for vehicle occupants. Summary of the Invention

[0003] In view of this, embodiments of the present application provide at least one file management method, apparatus, device, and storage medium.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] In one aspect, an embodiment of the present application provides a file management method, the method comprising:

[0006] A physiological state detection is performed on an occupant in a vehicle based on multiple frames of real-time images corresponding to the occupant; real-time detection data obtained from the physiological state detection is displayed through a first interface of a connected display device; when the physiological state detection meets a detection stop condition, the detection result of the occupant is displayed through a second interface of the display device; the detection result is determined based on the real-time detection data; and in response to receiving a trigger operation for a file management control in the first interface or the second interface, the file data corresponding to the detection result is managed through a third interface of the display device.

[0007] In the above embodiment, physiological status detection is performed based on multiple frames of real-time images corresponding to the occupants and the real-time detection data is displayed through the first interface of the display device, so that the occupants in the vehicle-mounted device can be quickly detected and displayed in real time without the help of wearable devices, thereby expanding the health detection function in the vehicle-mounted device; at the same time, the detection results are determined based on the real-time detection data and displayed on the second interface of the display device, so that the user can understand his or her own health status in a timely manner, which increases practicality; archival data can also be formed based on the detection results, and the archival data can be managed through the third interface of the display device, so that the detection results of each test of the user can be recorded, making it convenient for the user to view the detection results at any time.

[0008] In some embodiments, the method further includes: upon receiving a request for physiological status detection in the vehicle triggered by a user through an in-vehicle central control screen or a mobile device, obtaining multiple frames of real-time images corresponding to the occupants in the vehicle.

[0009] In the above embodiment, when the user triggers a request to perform physiological status detection on the occupants in the vehicle, multiple frames of real-time images of the corresponding occupants are obtained to respond to the actual needs of the user and obtain real-time detection data of the occupants through visual detection without the need for additional wearable devices for detection.

[0010] In some embodiments, before performing physiological status detection on the occupant in the vehicle based on multiple frames of real-time images corresponding to the occupant, the method further includes: performing face recognition based on at least one frame of the real-time image to obtain the identity information of the occupant; performing physiological status detection on the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle includes: when it is determined that the occupant is a registered user according to the identity information of the occupant, performing physiological status detection on the occupant based on the multiple frames of real-time images corresponding to the occupant.

[0011] In the above embodiment, facial recognition is performed on at least one frame of real-time image to obtain the identity information of the occupant, and the physiological status of the occupant is detected if the occupant is determined to be a user with a profile based on the identity information, thereby ensuring that the physiological status test is performed only when the occupant has a personal profile to save the test results; at the same time, a personal profile is formed in combination with the user's identity information to facilitate subsequent profile management.

[0012] In some embodiments, the method further includes: when it is determined that the occupant is an unfiled user based on the occupant's identity information, prompting the occupant to create a profile and displaying a profile creation interface through the display device; the new profile interface includes at least a user personal information entry item and a facial image entry item; after the occupant's profile is created, the occupant's physiological state is detected based on multiple frames of real-time images corresponding to the occupant.

[0013] In the above embodiment, if the passenger is determined to be unprofiled based on their identity information, a new profile interface is displayed to obtain the user's personal information and facial image to complete the profile creation. This ensures that the passenger's physiological status is tested only when a personal profile exists, preserving the test results. Simultaneously, the personal profile is created in conjunction with the passenger's identity information, facilitating subsequent profile management.

[0014] In some embodiments, the physiological status detection of the occupant in the vehicle based on multiple frames of real-time images corresponding to the occupant includes: when the duration of the physiological status detection of the occupant does not reach a first preset duration, and the number of frames of the collected real-time images reaches a first number of frames or the acquisition duration of the real-time images reaches a second preset duration, the physiological status detection of the occupant is performed based on the collected multiple frames of real-time images to obtain the real-time detection data.

[0015] In the above embodiment, when the duration of physiological status detection, the number of frames of real-time image acquisition, and the acquisition duration meet the corresponding conditions, the physiological status of the occupant is continuously detected, thereby obtaining real-time detection data of multiple tests during the detection process, which facilitates the subsequent determination of more accurate detection results.

[0016] In some embodiments, the physiological state detection of the occupant based on the collected multiple frames of real-time images to obtain the real-time detection data includes: within the first preset time period, using a sliding window method to sequentially determine multiple groups of real-time detection data of the occupant corresponding to multiple sliding windows; wherein each of the sliding windows includes multiple frames of real-time images, and the moving step of the sliding window is not greater than the number of image frames in the sliding window; and displaying the real-time detection data obtained from the physiological state detection through the first interface of the connected display device includes: displaying each group of real-time detection data in sequence through the first interface of the connected display device according to the acquisition timing of the multiple frames of images in each sliding window.

[0017] In the above embodiment, the real-time detection data displayed on the first interface of the display device is updated by sliding a window, so that the measurement data of multiple tests are dynamically displayed during the detection process, which makes it easier for users to understand the detection process data and discover abnormalities in a timely manner.

[0018] In some embodiments, the method further includes: drawing a dynamic change graph of the detection data based on multiple sets of the real-time detection data, and synchronously displaying the dynamic change graph and the real-time detection data through the first interface.

[0019] In the above embodiment, a dynamic change graph of the detection data is obtained by simulating multiple frames of real-time images through multiple sets of real-time detection data, and is synchronously displayed on the first interface of the display device, so as to facilitate users to understand the real-time changes of corresponding physiological indicators and increase practicality.

[0020] In some embodiments, the method further includes: when the occupant's portrait information or identity information is read by performing facial recognition on the occupant's real-time image, synchronously displaying the occupant's portrait or identity information and the real-time detection data through the first interface.

[0021] In the above embodiment, when the occupant's portrait or identity information is obtained through facial recognition, the occupant's portrait or identity information is displayed synchronously with the display of real-time detection data on the first interface to inform the user who the currently detected object is, thereby reducing false detections caused by the presence of multiple objects in the real-time image.

[0022] In some embodiments, the synchronous display of the occupant's portrait or identity information and the real-time detection data through the first interface includes: displaying an icon of the occupant's portrait or an icon of the occupant's identity information through a first window drawn in the first interface; and displaying the real-time detection data through a second window drawn in the first interface; in response to the icon of the occupant's portrait or the icon of the occupant's identity information displayed in the first window being clicked, determining that a trigger operation for the file management control in the first interface is received.

[0023] In the above embodiment, the icon of the occupant's avatar or the icon of the occupant's identity information is displayed through the first window in the first interface, and the real-time detection data is displayed through the second window in the first interface, thereby achieving synchronous display. At the same time, the file management control can be triggered by clicking the avatar icon or the identity information icon, providing a jump link from the first interface to the third interface, thereby increasing convenience.

[0024] In some embodiments, when a dynamic change graph of the detection data is drawn based on multiple groups of the real-time detection data, the synchronous display of the occupant's portrait or identity information and the real-time detection data through the first interface also includes: displaying the real-time dynamic change graph through a third window drawn in the first interface.

[0025] In the above embodiment, the real-time dynamic change graph is displayed through the third window in the third interface, so that the user can understand the dynamic change of the detection data in real time, thereby increasing the visual effect of the first interface.

[0026] In some embodiments, the test results of the occupant include a detection sub-result of at least one indicator item, and when the physiological state detection meets the detection stop condition, the test results of the occupant are displayed through the second interface of the display device, including: when the physiological state detection meets the detection stop condition, the detection sub-result and detail viewing control of each indicator item are displayed through the second interface according to a preset control arrangement; when the detail viewing control is triggered, the historical detection data of the corresponding indicator item is displayed according to a preset time unit; the preset time unit includes one of the following: year, month, week, day.

[0027] In the above embodiment, after the physiological status test meets the test stop conditions, i.e., after the test is completed, the test sub-results for multiple indicator items and detailed viewing controls are displayed simultaneously according to the preset control arrangement. This enables the display of the occupant's overall test report after the test is completed, facilitating subsequent archiving and review. Historical test data for each indicator item can also be viewed by year, month, week, or day.

[0028] In some embodiments, the second interface further includes a remeasurement control, and the method further includes: in response to receiving a trigger operation for the remeasurement control, executing the step of performing physiological status detection on multiple frames of real-time images corresponding to the occupant, and displaying at least one set of obtained detection data through the first interface.

[0029] In the above embodiment, the detection process can be restarted through the re-measurement control on the second interface, which can improve the detection accuracy of the physiological indicators and provide convenience for the user.

[0030] In some embodiments, the archival data includes at least a user avatar icon, personal information, and historical physiological status detection results. The third interface includes at least one of a new control, a user avatar icon, and an edit control. The management of the archival data corresponding to the detection results through the third interface includes: in response to the edit control in the third interface and being triggered, controlling the display device to display the editing interface; the editing interface includes the user's personal information items, avatar, and a delete control for deleting the archival data; in response to the user avatar icon in the third interface being triggered, controlling the display device to jump to the second interface to display the most recent historical physiological status detection result; in response to the new control in the third interface being triggered, controlling the display device to display the archive creation interface.

[0031] In the above embodiment, triggering the create control on the third interface controls the display device to display the profile creation interface, enabling the function of acquiring information through the profile creation interface to create a profile; triggering the user avatar icon on the third interface controls the display device to jump to the second interface to display the corresponding user's test results, enabling the function of viewing test results; and triggering the edit control on the third interface enables the user to independently edit personal information or delete profile data. This enriches the management functions of the third interface and can effectively cover health testing and profile management scenarios in vehicle-mounted devices.

[0032] In some embodiments, in response to the new control in the third interface being triggered, controlling the display device to display the archive creation interface includes: in response to the new control being triggered, determining whether the total number of stored archives exceeds the storage threshold; in response to the new control being triggered, determining whether the total number of stored archives exceeds the storage threshold; if the total number of archives does not exceed the storage threshold, controlling the display device to display the archive creation interface; if the total number of archives exceeds the storage threshold, a pop-up window prompts a first message; the first information is used to instruct the occupant to delete the stored historical archives and create a new archive.

[0033] In the above embodiment, after the create control is triggered, if the total number of stored archives exceeds the storage threshold, a pop-up window will appear to remind the user to delete historical archives before displaying the archive creation interface. This prevents archive creation failures or data loss due to insufficient system storage capacity by pre-determining whether the creation conditions are met before displaying the new page.

[0034] In some embodiments, when the edit control is triggered, the method further includes: in response to the delete control being triggered, a pop-up window prompting a second message; the second information is used by the occupant to confirm whether to delete the file data; in response to receiving a delete operation for the file data, deleting the file data and returning to the editing interface; in response to receiving a cancel delete operation for the file data, returning to the third interface.

[0035] In the above embodiment, when the delete control on the edit page is triggered, a pop-up window prompts the user to confirm the deletion and returns to the corresponding interface based on the user's delete or cancel operation. This reduces the possibility of accidental deletion by prompting a confirmation pop-up window and returns to the previous interface, providing convenience for the user while ensuring normal operation of the program.

[0036] In another aspect, an embodiment of the present application provides a file management device, comprising:

[0037] A state detection module, configured to detect a physiological state of an occupant in the vehicle based on a plurality of frames of real-time images corresponding to the occupant;

[0038] A data display module, configured to display real-time detection data obtained from the physiological state detection via a first interface of a connected display device;

[0039] A result display module, configured to display the test result of the occupant through the second interface of the display device when the physiological state test meets the test stop condition; the test result is determined based on the real-time test data;

[0040] The file management module is configured to manage the file data corresponding to the detection result through a third interface of the display device in response to receiving a trigger operation for the file management control in the first interface or the second interface.

[0041] On the other hand, an embodiment of the present application provides a vehicle-mounted device, including a display device, a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, it combines with the display device to implement some or all of the steps in the above method.

[0042] On the other hand, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which implements some or all of the steps in the above method when executed by a processor.

[0043] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and, together with the specification, are used to illustrate the technical solutions of the present application.

[0045] Figure 1 Schematic diagram of an optional flow chart of the archive management method provided in the embodiment of the present application;

[0046] Figure 2 Schematic diagram of an optional flow chart of the archive management method provided in the embodiment of the present application;

[0047] Figure 3 Schematic diagram of an optional flow chart of the archive management method provided in the embodiment of the present application;

[0048] Figure 4 Schematic diagram of an optional flow chart of the archive management method provided in the embodiment of the present application;

[0049] Figure 5 A schematic diagram of the implementation process of a file management method provided in an embodiment of the present application;

[0050] Figure 6 A schematic diagram of the structure of a file management device provided in an embodiment of the present application;

[0051] Figure 7 A schematic diagram of the hardware entity of a vehicle-mounted device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions of this application are further elaborated in detail below with reference to the accompanying drawings and embodiments. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0053] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0054] The terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first / second / third" can be interchanged with a specific order or sequence where permitted so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0055] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing this application only and are not intended to limit this application.

[0056] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are first described. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0057] The present invention provides a file management method that can be executed by a processor of an in-vehicle device or a mobile terminal device. The in-vehicle device can be a vehicle computer, domain controller, or processor in the vehicle cabin, or a device host for performing image and other data processing operations in a driver monitoring system or an occupant monitoring system, and the present invention does not limit this.

[0058] Figure 1 A schematic diagram of the implementation process of a file management method provided in an embodiment of the present application is shown as follows: Figure 1 As shown, the method includes the following steps S101 to S104:

[0059] Step S101, detecting the physiological state of the occupant in the vehicle based on multiple frames of real-time images corresponding to the occupant;

[0060] Here, the multi-frame real-time images corresponding to the occupant can be multi-frame real-time images collected by the vehicle-mounted camera in real time, or can be multi-frame real-time images collected by other devices or servers in real time and transmitted to the vehicle-mounted device via instant messaging. The embodiment of the present application does not limit this.

[0061] The physiological status detection of the occupants is intended to detect one or more of the occupants' physiological indicators such as heart rate, respiratory status, blood oxygen saturation, blood pressure, heart rate variability, etc. Each indicator item corresponds to a detection data, so that by performing physiological status detection on each real-time image of the occupants, a set of detection data for each indicator item can be obtained.

[0062] Taking heart rate detection as an example, physiological status detection based on real-time images of passengers can be implemented by extracting smooth facial regions from the image and constructing a raw sequence signal based on the average brightness of the pixels in these smooth facial regions extracted from multiple frames of real-time images. This raw sequence signal is then processed using algorithms such as CHROM to obtain rPPG (remote photoplethysmograph) signals. This is then Fourier transformed to extract the power spectrum in the frequency domain to derive the heart rate signal. Physiological status indicators such as blood pressure and blood oxygen saturation can then be derived by combining information such as the passenger's height, weight, age, and gender.

[0063] Compared with the related art method of having users wear wearable devices to detect human physiological indicators, the embodiment of the present application applies visual physiological state detection technology to vehicle-mounted equipment, and detects the physiological state of occupants based on multiple frames of real-time images. During implementation, image processing algorithms and signal analysis algorithms are used to extract indicators such as body temperature and real-time heart rate from multiple frames of real-time images, thereby achieving the purpose of measuring physiological indicators of the driver or passengers in the cabin.

[0064] Step S102, displaying real-time detection data obtained from the physiological status detection via a first interface of a connected display device;

[0065] Here, the vehicle controller or remote controller connected to the display device controls the display device to display the first interface when executing step S102. The display device may be a central control screen of the vehicle device, which is not limited in this embodiment of the present application.

[0066] The first interface is the interface displayed by the connected display device during the physiological status detection process. The display device can be, for example, a vehicle-mounted central control display screen, or it can be a mobile smart terminal connected via the network. The entire detection process will last for a period of time, such as tens of seconds. For each real-time image in the multiple frames of real-time images, a corresponding set of real-time detection data will be detected, and the set of real-time detection data corresponding to each real-time image will be displayed on the first interface in sequence. This makes it easier for users to understand their own health status in a timely manner, expanding the health detection function and practicality of the vehicle-mounted equipment.

[0067] Step S103, when the physiological state detection satisfies the detection stop condition, displaying the detection result of the occupant through the second interface of the display device;

[0068] Here, the detection stop condition can be any of the following conditions: the detection duration reaches a preset detection duration, the posture of the person in the real-time image changes or disappears, or a detection stop request is received. The detection stop condition can be determined based on the actual scenario and is not limited in this embodiment of the present application.

[0069] The second interface can be understood as the test report interface displayed after the test is completed. The second interface can display the test results of various physiological indicators obtained during the test. These test results are determined based on the at least one set of real-time test data. For example, based on the real-time test data detected by each real-time image, such as blood pressure measurement values, the final test result, such as whether the blood pressure indicator is normal, is determined. This allows users to timely understand their health status and increases practicality.

[0070] Step S104 : In response to receiving a trigger operation for the file management control in the first interface or the second interface, managing the file data corresponding to the detection result through the third interface of the display device.

[0071] Here, by setting the file management control in the first interface and the second interface, it is possible to jump to the third interface to manage the file data corresponding to the test results during or after the test based on user needs.

[0072] The archival data is generated based at least on the passenger's test results. In some embodiments, the archival data may also include other identity information such as the passenger's face image and user ID. Thus, the archival data can record the test results of each test performed by the user and provide a third interface for managing the archival data, allowing the user to easily access it at any time.

[0073] In an embodiment of the present application, physiological status detection is performed based on multiple frames of real-time images corresponding to the occupants and the real-time detection data is displayed through the first interface of the display device, so that the occupants in the vehicle-mounted device can be quickly detected and displayed in real time without the help of wearable devices, thereby expanding the health detection function in the vehicle-mounted device; at the same time, the detection results are determined based on at least one set of detection data and displayed on the second interface of the display device, so that the user can understand his or her own health status in a timely manner, which increases practicality; archival data can also be formed based on the detection results, and the archival data can be managed through the third interface of the display device, so that the detection results of each test of the user can be recorded, making it convenient for the user to view the detection results at any time.

[0074] In some embodiments, the method further includes: upon receiving a request for physiological status detection in the vehicle triggered by a user through an in-vehicle central control screen or a mobile device, obtaining multiple frames of real-time images corresponding to the occupants in the vehicle.

[0075] Here, the user can trigger a request for physiological status detection through voice commands or by triggering the icon of the physiological status detection program on the central control screen.

[0076] In implementation, in response to the user's request for physiological status detection, multiple frames of real-time images of the occupants can be collected in real time through a camera in a vehicle-mounted device, such as a vehicle-mounted camera, or multiple frames of real-time images collected and transmitted in real time can be loaded into a mobile device via instant messaging. The embodiment of the present application does not limit the method of obtaining multiple frames of real-time images.

[0077] The on-board camera is a camera inside the cabin of a smart car. The on-board camera can be a Driver Monitor System (DMS) camera or an Occupant Monitoring System (OMS) camera, which can capture images of the driver or passengers in the car cabin in real time for subsequent detection and analysis to ensure occupant safety.

[0078] In the above embodiment, when the user triggers a request to perform physiological status detection on the occupants in the vehicle, multiple frames of real-time images of the corresponding occupants are obtained to respond to the actual needs of the user and obtain real-time detection data of the occupants through visual detection without the need for additional wearable devices for detection.

[0079] In some embodiments, before step S101, the method further includes: performing face recognition based on at least one frame of the real-time image to obtain the identity information of the occupant; thus, the above step S101 of "detecting the physiological status of the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle" can be further implemented as the following steps 111 to 113:

[0080] Step 111 : When it is determined that the occupant is a user with a profile according to the identity information of the occupant, a physiological state detection is performed on the occupant based on multiple frames of real-time images corresponding to the occupant.

[0081] Here, the identity information may include the passenger's user ID, facial feature vector, facial key points, etc., so that the passenger's identity can be further determined based on the identity information to determine whether the passenger is a registered user. Registered users are users who have already established a personal profile, and are therefore considered old users.

[0082] In the case where the identity information is a facial feature vector, whether the occupant is a registered user can be determined through the following process: performing facial recognition on the real-time image corresponding to the occupant to obtain the facial feature vector of the occupant; and determining whether the occupant is the registered user based on the facial feature vector of the occupant and the stored preset facial feature vector.

[0083] In this way, the physiological status of the occupant is detected when the occupant is determined to be a user with a profile based on the identity information, thereby ensuring that the physiological status is detected only when the occupant has a personal profile, so as to save the test results.

[0084] Step 112: If it is determined based on the passenger's identity information that the passenger is a user without a profile, prompt the passenger to create a profile and display a profile creation interface through the display device;

[0085] Here, if the user is determined to be unprofiled based on the identity information, the passenger's personal information, facial image, etc. are obtained through the profile creation interface displayed on the display device to complete the passenger's profile creation. Among them, unprofiled users are understood to be new users.

[0086] The new profile interface includes at least a user personal information entry field and a facial image entry field. The user personal information entry field may include fields for user input of personal information such as name, gender, age, height, and weight, and the facial image entry field may include an avatar entry control to guide the user in entering their facial image. This embodiment of the application does not limit the layout of the new profile interface.

[0087] In some other embodiments, when the passenger is a user without a profile, a pop-up window may be displayed in advance to prompt the user whether to create a profile at that time. If the passenger clicks to confirm the profile creation, the profile creation interface will be displayed. Otherwise, the passenger will be instructed to scan and take a photo again to verify his identity again.

[0088] Step 113 : After the occupant's profile is created, the occupant's physiological status is detected based on multiple frames of real-time images corresponding to the occupant.

[0089] Here, after the occupant has entered personal information and facial images in the file creation interface, he or she can click the file save control to complete the file creation process, so that the occupant's physiological status detection can begin.

[0090] In the above embodiment, before performing a physiological status test on a vehicle occupant, a determination is first made based on the occupant's identity information to determine whether the occupant has a profile. If the occupant's profile is established, the physiological status test is performed directly. If the occupant does not have a profile, a profile creation interface is displayed to obtain the user's personal information and complete the profile creation process. The physiological status test is then performed based on multiple frames of real-time images corresponding to the occupant. This ensures that the occupant's profile exists before performing the physiological status test, preserving the test results. Simultaneously, the profile is created by combining the occupant's identity information to facilitate subsequent profile management.

[0091] In some embodiments, the above-mentioned step S01 can be further implemented as follows: when the duration of the physiological state detection of the occupant has not reached the first preset duration, and the number of frames of the collected real-time image has reached the first number of frames or the acquisition duration of the real-time image has reached the second preset duration, the physiological state of the occupant is detected based on the collected multiple frames of real-time images to obtain real-time detection data.

[0092] Here, the first preset duration is the upper limit of the duration of the entire physiological status detection process, which is generally 20 to 30 seconds; the first number of frames and the second preset duration are empirical values. For a certain physiological indicator item, such as heart rate value, the image acquisition needs to reach a certain number of frames, such as 100 frames, or the real-time image acquisition time reaches a certain time, such as 3 seconds, before the first detection data of the indicator item can be output.

[0093] When the corresponding conditions such as the duration of physiological status detection, the number of frames of real-time image acquisition and the acquisition time are met, the physiological status of the occupant is continuously detected, so as to obtain real-time detection data of multiple tests during the detection process, which is convenient for determining more accurate detection results later.

[0094] The embodiment of the present application provides a file management method, which can be executed by a processor of an onboard device. Figure 2 As shown, the method includes the following steps S201 to S204:

[0095] Step S201, within a first preset time period, using a sliding window method, sequentially determining multiple sets of the real-time detection data of the occupant corresponding to multiple sliding windows;

[0096] Here, each sliding window includes multiple frames of the real-time image, and the moving step length of the sliding window is not greater than the number of image frames in the sliding window. For example, if the sliding window includes 8 frames of real-time image, the moving step length of the sliding window cannot exceed 8.

[0097] Step S202, displaying the groups of real-time detection data in sequence through the first interface of the connected display device according to the acquisition timing of the multiple frames of images in each sliding window;

[0098] Here, the acquisition sequence is understood to be the timestamp sequence of acquiring each frame of image, that is, a set of detection data obtained by detection is displayed frame by frame through the first interface according to the timestamp sequence of multiple frames of real-time images.

[0099] Among them, the method of displaying each group of real-time detection data in sequence can be exemplarily understood as displaying a group of detection data D1 = {d11, d12, d13} of the first frame image at the first moment, and displaying a group of detection data D2 = {d21, d22, d23} of the second frame image at the next moment.

[0100] In this way, the real-time detection data displayed on the first interface of the display device is updated by sliding the window, so that the measurement data of multiple tests can be dynamically displayed during the detection process, which makes it easier for users to understand the detection process data and discover abnormalities in time.

[0101] Step S203: drawing a dynamic change graph of the detection data based on the multiple sets of real-time detection data, and synchronously displaying the dynamic change graph and the real-time detection data through the first interface;

[0102] Here, the dynamic change graph is a curve showing the change of detection data of the same indicator item in multiple frames of real-time images over time.

[0103] In this way, the dynamic change graph of the detection data obtained by simulating multiple frames of real-time images through multiple sets of real-time detection data is synchronously displayed on the first interface of the display device, which makes it easier for users to understand the real-time changes of corresponding physiological indicators and increases practicality.

[0104] Step S204: if the physiological status detection satisfies the detection stop condition, displaying the detection result of the occupant through the second interface of the display device;

[0105] Here, the detection result is determined based on the real-time detection data.

[0106] Step S205 : In response to receiving a trigger operation for the file management control in the first interface or the second interface, managing the file data corresponding to the detection result through the third interface of the display device.

[0107] Here, the above steps S204 to S205 correspond to the above steps S103 to S104 respectively, and when implementing, reference may be made to the specific implementation of the above steps S103 to S104.

[0108] In the embodiment of the present application, the real-time detection data displayed on the first interface of the display device is updated by sliding a window, so that the measurement data of multiple tests can be dynamically displayed during the detection process, which helps the user understand the detection process data and promptly detect abnormalities. At the same time, the dynamic change graph of the detection data obtained by simulating multiple frames of real-time images in real time through multiple sets of real-time detection data is synchronously displayed on the first interface of the display device, which helps the user understand the real-time changes of the corresponding physiological indicators and increases practicality.

[0109] In some embodiments, when the occupant's portrait information or identity information is read by performing facial recognition on the occupant's real-time image, the occupant's portrait or identity information and the real-time detection data are synchronously displayed through the first interface.

[0110] Here, the passenger's identity information can be obtained by performing face recognition on the passenger's real-time image, or by information input by the passenger in a new profile page.

[0111] In this way, when the occupant's portrait or identity information is obtained through facial recognition, the occupant's portrait or identity information is displayed synchronously during the display of real-time detection data on the first interface to inform the user who the currently detected object is, thereby reducing false detections due to the presence of multiple objects in the real-time image.

[0112] In some embodiments, the synchronous display of the occupant's portrait or identity information and the real-time detection data through the first interface includes: displaying an icon of the occupant's portrait or an icon of the occupant's identity information through a first window drawn in the first interface; and displaying the real-time detection data through a second window drawn in the first interface; in response to the icon of the occupant's portrait or the icon of the occupant's identity information displayed in the first window being clicked, determining that a trigger operation for the file management control in the first interface is received.

[0113] In this way, the icon of the occupant's avatar or the icon of the occupant's identity information is displayed through the first window in the first interface, and the real-time detection data is displayed through the second window in the first interface, thereby achieving synchronous display. At the same time, the file management control can be triggered by clicking the avatar icon or the identity information icon, providing a jump link from the first interface to the third interface, thereby increasing convenience.

[0114] In some embodiments, when a dynamic change graph of the detection data is drawn based on multiple groups of the real-time detection data, the synchronous display of the occupant's portrait or identity information and the real-time detection data through the first interface also includes: displaying the real-time dynamic change graph through a third window drawn in the first interface.

[0115] In this way, the real-time dynamic change graph is displayed through the third window in the third interface, which makes it easier for users to understand the dynamic changes of the detection data in real time, thereby increasing the visual effect of the first interface.

[0116] In some embodiments, the passenger's test result includes a test sub-result of at least one indicator item. The present application embodiment provides a file management method, which can be executed by a processor of an onboard device. Figure 3 As shown, the method includes the following steps S301 to S304:

[0117] Step S301, detecting the physiological status of the occupant in the vehicle based on multiple frames of real-time images corresponding to the occupant;

[0118] Step S302, displaying real-time detection data obtained from the physiological status detection via a first interface of a connected display device;

[0119] Here, the above steps S301 to S302 correspond to the above steps S101 to S102 respectively, and the specific implementation methods of the above steps S101 to S302 may be referred to during implementation.

[0120] Step S303: When the physiological state detection satisfies the detection stop condition, the detection sub-result and detail viewing control of each indicator item are displayed through the second interface according to the preset control arrangement mode;

[0121] In practice, at least one set of detection data for the same indicator item can be analyzed and processed to obtain a detection sub-result for the indicator item. For example, the final detection sub-result, i.e., whether the blood pressure indicator is normal, can be determined based on the detection data, such as the blood pressure measurement value, detected from each real-time image.

[0122] Here, the preset control arrangement method can be to distribute the control positions of each indicator item according to the category of the indicator item, wherein the category of at least one indicator item can be the department category to which each indicator item belongs, for example, respiratory status, respiratory rate, etc. belong to the indicator items of respiratory medicine, and heart rate, heart rate variability, etc. belong to the indicator items of neurology, so as to display the detection sub-results of each indicator item on the second interface according to the department category distribution.

[0123] The second interface is used to display the indicator detection report obtained after the detection is completed. The second interface can display the detection sub-results of each physiological indicator item obtained in this detection, the detection time, the occupant's identity and other information.

[0124] On the second interface, users can further click on the detail view control for each indicator item. Each detail view control is used to display the historical detection data of the corresponding indicator item according to a preset time unit; the preset time unit can be one of the following: year, month, week, or day. This allows users to conveniently select and view the historical detection data of a specific indicator item within a specific time period as needed.

[0125] In some embodiments, the second interface further includes a remeasurement control, and the method further includes: in response to receiving a trigger operation for the remeasurement control, executing the step of detecting the physiological status of the multiple frames of real-time images corresponding to the occupant, and displaying at least one set of obtained detection data via the first interface. The remeasurement control on the second interface can thus restart the detection process, thereby improving the detection accuracy of physiological indicators and providing convenience for the user.

[0126] Step S304: In response to receiving a trigger operation for the file management control in the first interface or the second interface, managing the file data corresponding to the detection result through a third interface.

[0127] Here, the above step S304 corresponds to the above step S104 respectively, and the specific implementation of the above step S104 can be referred to during implementation.

[0128] In this embodiment, after the physiological status test meets the test stop conditions, i.e., after the test is completed, the test sub-results for multiple indicator items and detailed viewing controls are displayed simultaneously according to a preset control arrangement. This enables the display of the occupant's overall test report after the test is completed, facilitating subsequent archiving and viewing. Historical test data for each indicator item can also be viewed by year, month, week, day, and other periods.

[0129] In some embodiments, the archive data includes at least a user avatar icon, personal information, and historical physiological status detection results, and the third interface includes at least one of a new control, a user avatar icon, and an edit control. The present application embodiment provides a file management method that can be executed by a processor of an in-vehicle device. Figure 4 As shown, the method includes the following steps S401 to S404:

[0130] Step S401, detecting the physiological state of the occupant in the vehicle based on multiple frames of real-time images corresponding to the occupant;

[0131] Step S402, displaying real-time detection data obtained from the physiological status detection via a first interface of a connected display device;

[0132] Step S403: Displaying the test result of the occupant through the second interface of the display device when the physiological status test meets the test stop condition;

[0133] Here, the detection result is determined based on the real-time detection data.

[0134] The above steps S401 to S403 correspond to the above steps S101 to S103 respectively, and when implementing, reference may be made to the specific implementation of the above steps S101 to S103.

[0135] Step S404, in response to the editing control in the third interface being triggered, controlling the display device to display the editing interface;

[0136] Here, the editing interface includes the user's personal information items, profile picture, and a delete control for deleting the profile data. In some embodiments, the editing interface can be used to re-enter the passenger's face and profile picture or change personal information such as height and weight. In other embodiments, the entire profile data, including the user's profile picture icon, personal information, and previous test data and results, can be directly deleted by clicking the delete control on the editing interface.

[0137] Step S405: in response to the user avatar icon in the third interface being triggered, controlling the display device to jump to the second interface to display the most recent historical physiological status detection result of the occupant;

[0138] Here, the user avatar icon is associated with the historical physiological status detection results corresponding to the occupant in the program, so that when the user clicks the user avatar icon, the historical physiological status detection results corresponding to the occupant can be directly linked to and displayed on the second interface.

[0139] On the second interface, you can intuitively see the latest test results and further view the historical test data of the corresponding indicator items through the details view control.

[0140] Step S406 : In response to the new creation control in the third interface being triggered, controlling the display device to display a file creation interface.

[0141] Here, the profile creation interface is used to prompt the user to fill in personal information and enter a facial image.

[0142] In this embodiment of the application, by triggering the new control set in the third interface to display the profile creation interface, the function of obtaining information on the profile creation interface to create a profile is realized; by triggering the user avatar icon set in the third interface to jump to the second interface to display the corresponding user's test results, the function of viewing test results is realized; by triggering the edit control set in the third interface, the user can independently edit personal information or delete profile data. This enriches the management functions of the third interface and can effectively cover health testing and profile management scenarios in vehicle-mounted devices.

[0143] In some embodiments, the above step S406 includes the following steps 461 to 463:

[0144] Step 461, in response to the new control being triggered, determining whether the total number of stored files exceeds a storage threshold;

[0145] Here, the total number of stored files is the cumulative number of files stored in the system, and the storage threshold is the maximum number of files set in advance based on the system storage capacity or computing power.

[0146] Step 462: If the total number of archives does not exceed the storage threshold, control the display device to display the archive creation interface;

[0147] Here, when it is determined that there is enough storage space to create a file, the display device is controlled to display the file creation interface to complete the task of creating a new file.

[0148] Step 463: When the total number of files exceeds the storage threshold, a pop-up window prompts a first message; the first message is used to instruct the occupant to delete the stored historical files and create a new file.

[0149] Here, assuming that the storage threshold, i.e., the maximum number of stored files, is 10, and the current file to be created is the 11th, it is necessary to delete the stored historical files and then display the file creation interface to create a new file.

[0150] This way, when the create control is triggered, if the total number of stored files exceeds the storage threshold, a pop-up window will appear to remind the user to delete the previous files before displaying the file creation interface. This helps reduce the problem of file creation failure or data loss due to insufficient system storage capacity by pre-determining whether the creation conditions are met before displaying the new page.

[0151] In some embodiments, when the editing control is triggered, after step S404, the method further includes the following steps:

[0152] Step 441: In response to the deletion control being triggered, a pop-up window is displayed to prompt second information;

[0153] Here, the second information is used by the occupant to confirm whether to delete the file data. For example, the second information "Confirm to delete the file data" is displayed in a pop-up window, and "Yes" and "No" controls are provided for the user to select.

[0154] Step 442: In response to receiving a delete operation for the archive data, delete the archive data and return to the editing interface;

[0155] Here, if the crew member confirms the deletion, the corresponding file data of the crew member will be deleted, and the interface will return to the previous level of editing, where other editing operations can continue to be received.

[0156] Step 443: In response to receiving the cancel deletion operation for the archive data, return to the third interface.

[0157] Here, when the passenger cancels the deletion, he / she exits the current editing interface and returns to the third interface to perform other management operations on the archive data through the third interface.

[0158] In this way, when the delete control on the edit page is triggered, a pop-up window will confirm the user's deletion and return to the corresponding interface based on the user's deletion or cancellation operation. This reduces the possibility of accidental deletion by re-confirming the pop-up window and returning to the previous interface, providing convenience for users while ensuring normal operation of the program.

[0159] The following describes the application of the archive management method provided in the embodiment of the present application in actual scenarios.

[0160] In related technologies, if a driver or passenger wants to understand their real-time health status, they need to use wearable devices for testing. If the driver or passenger does not purchase and wear such devices, they will not be able to understand their real-time health status. Current smart car cabins do not include physiological status detection functions. Indeed, this function makes it difficult for the vehicle to make an accurate judgment on the physiological condition of the driver or passenger. If the driver or passenger suddenly develops a health problem, the vehicle will not be able to sense it, and the user will not be able to self-test, which can easily lead to accidents.

[0161] The embodiment of the present application relies on a camera inside the vehicle cabin and uses visual health detection technology to detect the physiological status of the driver or passengers in the vehicle, and combines the face recognition results to form a personal file to facilitate the recording of previous detection records.

[0162] The present application embodiment provides a file management method, such as Figure 5 As shown, the method includes the following steps S501 to S505:

[0163] Step S501, starting a detection application;

[0164] Here, the user clicks the icon of the detection application on the central control screen or wakes it up through voice commands to start the detection application.

[0165] Step S502: performing facial recognition on the passenger;

[0166] Here, if the identification result indicates that the occupant is a new user, step S503 is executed; if the identification result indicates that the occupant is an old user, step S505 is directly executed.

[0167] Step S503, enter the new file interface;

[0168] Here, if it is identified that the occupant is a new user, that is, no health record has been established, the new file interface (equivalent to the file creation interface) will be entered.

[0169] The new profile interface provides fields such as "User ID," "Age," "Height," "Gender," and "Weight" for users to enter their basic personal information. Users can also enter a facial image to complete their profile. Finally, when the user clicks "Confirm," the passenger's health profile is created and the interface is redirected to the health check interface to begin the passenger's health check.

[0170] Step S505, enter the health detection interface;

[0171] Here, the physiological status of the occupants is monitored using images captured by the cabin camera, and the entire process lasts 20 to 30 seconds. During the monitoring period, the central control screen enters the health monitoring interface (equivalent to the first interface), which simulates and displays the heart rate curve in real time based on the test data of a certain indicator, such as the heart rate value. The health monitoring interface also displays the user's identity information (such as user avatar icon, user account, etc.).

[0172] During the detection process, the embodiment of the present application simultaneously displays the heart rate curve and heart rate value, as well as user avatar icon and identity identification and other information based on the obtained detection data, thereby improving the practicality of the detection application.

[0173] Step S506: After the test is completed, enter the test report interface;

[0174] Here, after the health check is completed, the test report interface (equivalent to the second interface) is entered, and the indicator test report is displayed in this interface, including the test results of the occupant's heart rate, respiratory status, respiratory rate, blood oxygen saturation, blood pressure, heart rate variability and other indicators obtained from this health check.

[0175] It should be noted that, in the test report interface, you can also click the "Remeasure" button to jump to step S502 and re-identify.

[0176] Step S507: In response to the detail view control on the test report interface being triggered, a history record interface pops up;

[0177] Here, on the test report screen, passengers can further click the "View Details" control corresponding to each indicator item to pop up the historical record screen. On this historical record screen, they can view the historical test data of the corresponding indicator item and choose to view the historical test data by year, month, week, or day.

[0178] Step S508: In response to the file management control on the health check interface or the test report interface being triggered, the file management interface is displayed.

[0179] Here, during the above steps S505 and S506, the user can directly click the "File Management" button on the health check interface or the test report interface to enter the file management interface (equivalent to the third interface). In the file management interface, the user's health file can be viewed, edited, or deleted, and the historical test data of each indicator item can also be viewed.

[0180] Step S509: In response to the new file control on the file management interface being triggered, determine whether the total number of files is greater than 10;

[0181] In the file management interface, the user clicks the "New File" control and first determines whether the total number of files exceeds 10 (equivalent to the storage threshold). If it exceeds 10, execute step S510; if it does not exceed 10, enter the new file interface and execute step S503.

[0182] Step S510: A pop-up window will prompt you to "delete unnecessary files first".

[0183] Here, a pop-up window is used to remind users to delete unnecessary files, namely historical files.

[0184] Step S511, in response to the editing control of the archive management interface being triggered, jump to the editing interface;

[0185] In the profile management interface, the user clicks the "Edit" control for the current personal profile to enter the profile editing interface and edit the personal profile.

[0186] Step S512: In response to the deletion control on the editing interface being triggered, a pop-up window prompts "Do you want to delete?";

[0187] Here, in the editing interface, further click the "Delete" control, and a pop-up window will remind the user whether to delete. If the user confirms the deletion, the current health record will be deleted and the interface will be returned to the record management interface; if the user denies the deletion, the interface will be returned to the editing interface.

[0188] Step S513: In response to the avatar on the file management interface being clicked, jump to the test report interface;

[0189] Here, in the file management interface, the user clicks on the avatar and the most recent indicator test report is displayed through the test report interface.

[0190] Step S514: In response to the detail view control on the detection report interface being triggered, a history record interface pops up.

[0191] Here, continue to click the details view control on the test report interface to pop up the history interface; on the history interface, click a blank space to return to the most recent indicator test report.

[0192] The embodiment of the present application combines the user's index detection results and face recognition results to generate a personal profile, and records the results of each detection in the user's own personal profile. The user can also select a time period to view historical detection data.

[0193] This embodiment of the application applies the visual health monitoring solution to in-vehicle devices in the form of an application, effectively covering in-vehicle health monitoring scenarios. It allows users to view various physiological indicators and understand their real-time health status in the car without purchasing or wearing additional equipment. During the monitoring process, the real-time heart rate curve and heart rate value can be displayed, increasing practicality.

[0194] Since the user's health record is established in combination with facial recognition, and the test results of each indicator test are recorded at the same time, when the user wants to view the long-term changes in his or her various indicators, he or she can independently start the detection application, enter the file management interface, click on the avatar to view historical test data, and understand the long-term changes in various indicators.

[0195] In other embodiments, when a user is driving a vehicle on the road, he or she can use voice control to open the detection application and start a physiological status detection; or when the user is in a stationary situation such as waiting for a traffic light, stopping or parking, he or she can manually start the detection application to start a physiological status detection. After 20 to 30 seconds, the detection results of various indicators can be viewed. If there is a problem with any indicator, the detection application will also provide corresponding health advice and reminders.

[0196] Based on the foregoing embodiments, an embodiment of the present application provides a file management device, which includes the various units included and the various modules included in each unit, and can be implemented by a processor in an on-board device; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0197] Figure 6 A schematic diagram of the structure of a file management device provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, the apparatus 600 includes: a status detection module 610, a data display module 620, a result display module 630 and a file management module 640, wherein:

[0198] A state detection module 610 is configured to detect a physiological state of an occupant in a vehicle based on a plurality of frames of real-time images corresponding to the occupant;

[0199] A data display module 620 displays real-time detection data obtained from the physiological state detection through a first interface of a connected display device;

[0200] A result display module 630 is configured to display the occupant's test result through the second interface of the display device when the physiological state test satisfies the test stop condition; the test result is determined based on the real-time test data;

[0201] The file management module 640 is configured to manage the file data corresponding to the detection result through the third interface of the display device in response to receiving a trigger operation for the file management control in the first interface or the second interface.

[0202] In some possible embodiments, the device 600 also includes an acquisition module for acquiring multiple frames of real-time images corresponding to the occupants in the vehicle when a request for physiological status detection in the vehicle is received, which is triggered by a user through an in-vehicle central control screen or a mobile device.

[0203] In some possible embodiments, before the physiological status of the occupant in the vehicle is detected based on the multiple frames of real-time images corresponding to the occupant, the device also includes a face recognition module for performing face recognition based on at least one frame of the real-time image to obtain the identity information of the occupant; the status detection module 610 is also used to perform physiological status detection on the occupant based on the multiple frames of real-time images corresponding to the occupant when it is determined that the occupant is a registered user based on the identity information of the occupant.

[0204] In some possible embodiments, the status detection module 610 is further used to prompt the occupant to create a profile and display a profile creation interface through the display device when the occupant is determined to be an unfiled user based on the occupant's identity information; the new profile interface includes at least a user personal information entry item and a facial image entry item; after the occupant's profile is created, the occupant's physiological status is detected based on the multiple frames of real-time images corresponding to the occupant.

[0205] In some possible embodiments, the status detection module 610 is also used to perform physiological status detection on the occupant based on the collected multiple frames of real-time images to obtain the real-time detection data when the duration of the physiological status detection of the occupant has not reached a first preset duration and the number of frames of the collected real-time images has reached a first number of frames or the acquisition duration of the real-time images has reached a second preset duration.

[0206] In some possible embodiments, the status detection module 610 is further used to determine, within the first preset time period, in a sliding window manner, multiple groups of the real-time detection data of the occupant corresponding to multiple sliding windows in sequence, wherein each sliding window includes multiple frames of the real-time image, and the moving step of the sliding window is not greater than the number of image frames in the sliding window; the data display module 620 is further used to display the groups of real-time detection data in sequence through the first interface of the connected display device according to the acquisition timing of the multiple frames of images in each sliding window.

[0207] In some possible embodiments, the device further includes an image drawing module for drawing a dynamic change graph of the detection data based on multiple sets of the real-time detection data, and synchronously displaying the dynamic change graph and the real-time detection data through the first interface.

[0208] In some possible embodiments, the device also includes an information display module for synchronously displaying the occupant's portrait or identity information and the real-time detection data through the first interface when the occupant's portrait information or identity identification is read by performing facial recognition on the occupant's real-time image.

[0209] In some possible embodiments, the information display module includes a first display submodule, a second display submodule and a determination submodule, wherein: the first display submodule is used to display the icon of the occupant's portrait or the icon of the occupant's identity information through a first window drawn in the first interface; the second display submodule is used to display the real-time detection data through a second window drawn in the first interface; the determination submodule is used to determine that a trigger operation for the file management control in the first interface is received in response to the icon of the occupant's portrait or the icon of the occupant's identity information displayed in the first window being clicked.

[0210] In some possible embodiments, the information display module further includes a third display submodule for displaying the real-time dynamic change graph through a third window drawn in the first interface when a dynamic change graph of the detection data is drawn based on multiple sets of real-time detection data.

[0211] In some possible embodiments, the occupant's test results include at least one detection sub-result of an indicator item, and the result display module 630 is further used to display the detection sub-result and detail viewing control of each indicator item through the second interface according to a preset control arrangement when the physiological state detection meets the detection stop condition; the detail viewing control is triggered to display the historical test data of the corresponding indicator item according to a preset time unit; the preset time unit includes one of the following: year, month, week, day.

[0212] In some possible embodiments, the archive data includes at least a user avatar icon, personal information and historical physiological status detection results, the third interface includes at least one of a new control, a user avatar icon and an edit control, and the archive management module 640 includes a third display submodule, a jump module or a fourth display submodule, wherein: the third display submodule is used to control the display device to display the editing interface in response to the edit control in the third interface being triggered; the editing interface includes the user's personal information items, avatar, and a delete control for deleting the archive data; the jump module is used to control the display device to jump to the second interface in response to the user avatar icon in the third interface being triggered to display the occupant's most recent historical physiological status detection result; the fourth display submodule is used to control the display device to display the archive creation interface in response to the new control in the third interface being triggered.

[0213] In some possible embodiments, the fourth display submodule includes a determination unit, a first display unit and a first pop-up unit, wherein: the determination unit is used to determine whether the total number of stored files exceeds a storage threshold in response to the new creation control being triggered; the first display unit is used to control the display device to display the file creation interface when the total number of files does not exceed the storage threshold; the first pop-up unit is used to pop up a first message when the total number of files exceeds the storage threshold; the first information is used to instruct the occupant to delete the stored historical files and create a new file.

[0214] In some possible embodiments, when the editing control is triggered, the third display submodule further includes a second pop-up window unit, a first return unit, and a second return unit, wherein: the second pop-up window unit is used to prompt a second information in response to the deletion control being triggered; the second information is used for the occupant to confirm whether to delete the file data; the first return unit is used to delete the file data and return to the editing interface in response to receiving a deletion operation for the file data; the second return unit is used to return to the third interface in response to receiving a cancel deletion operation for the file data.

[0215] The description of the above device embodiment is similar to the description of the above method embodiment and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to perform the methods described in the above method embodiments. For technical details not disclosed in the device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0216] If the technical solution of this application involves personal information, the product that applies the technical solution of this application has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing personal information. If the technical solution of this application involves sensitive personal information, the product that applies the technical solution of this application has obtained the individual's separate consent before processing sensitive personal information, and at the same time meets the "explicit consent" requirement. For example, on personal information collection devices such as cameras, a clear and prominent sign is set to inform that the personal information collection scope has been entered and personal information will be collected. If the individual voluntarily enters the collection scope, it is deemed that they agree to the collection of their personal information; or on the personal information processing device, when the personal information processing rules are notified by obvious signs / information, the individual's authorization is obtained through pop-up information or by asking the individual to upload their personal information; among which, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.

[0217] It should be noted that, in the embodiment of the present application, if the above-mentioned archive management method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a vehicle-mounted device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software and firmware.

[0218] An embodiment of the present application provides a vehicle-mounted device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0219] The present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements some or all of the steps in the above method. The computer-readable storage medium may be transient or non-transient.

[0220] An embodiment of the present application provides a computer program, including a computer-readable code. When the computer-readable code runs in an in-vehicle device, a processor in the in-vehicle device executes some or all of the steps for implementing the above method.

[0221] An embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, implements some or all of the steps in the above method. The computer program product can be implemented specifically by hardware, software, or a combination thereof. In some embodiments, the computer program product is embodied as a computer storage medium. In other embodiments, the computer program product is embodied as a software product, such as a software development kit (SDK), etc.

[0222] It should be noted that the descriptions of the various embodiments above tend to emphasize the differences between the various embodiments, and their similarities or similarities can be referenced to each other. The descriptions of the above device, storage medium, computer program, and computer program product embodiments are similar to the descriptions of the above method embodiments and have similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the device, storage medium, computer program, and computer program product of this application, please refer to the description of the method embodiments of this application for understanding.

[0223] It should be noted that Figure 7 A schematic diagram of a hardware entity of the vehicle-mounted device in the embodiment of the present application is shown in FIG. Figure 7 As shown, the hardware entity of the vehicle-mounted device 700 includes: a processor 701, a display device 702 and a memory 703, wherein:

[0224] Display device 702, memory 703, and processor 701 are connected via bus 704. Memory 703 is used to store executable computer programs. Processor 701, when executing the executable computer programs stored in memory 703, combines with display device 702 to implement the file management method provided in any of the above-mentioned embodiments of the present application. The display device may be a vehicle-mounted central control screen.

[0225] The memory 703 is configured to store instructions and applications executable by the processor 701. It can also cache data to be processed or processed by the processor 701 and various modules in the vehicle-mounted device 700 (for example, image data, audio data, voice communication data, and video communication data). This can be implemented using flash memory (FLASH) or random access memory (RAM). Data can be transmitted between the processor 701, the display device 702, and the memory 703 via a bus 704.

[0226] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned steps / processes does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0227] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0228] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0229] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed across multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0230] In addition, all functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the above-mentioned integrated units can be implemented in the form of hardware or in the form of hardware plus software functional units.

[0231] Those skilled in the art will understand that all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, and other media that can store program codes.

[0232] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for enabling an on-board device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks or optical disks.

[0233] The above is only an implementation method of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope disclosed in this application, which should be covered by the scope of protection of the present application.

Claims

1. A file management method, characterized in that: Applied to an in-vehicle device, the method includes: Upon receiving a request for physiological status detection in a vehicle triggered by a user via an in-vehicle central control screen or a mobile device, obtaining multiple frames of real-time images corresponding to an occupant in the vehicle; detecting a physiological state of an occupant in the vehicle based on a plurality of frames of real-time images corresponding to the occupant; When the real-time detection data obtained based on the physiological detection includes the occupant's heart rate, blood oxygen saturation, and blood pressure, extracting a smooth facial area from the occupant's real-time image, constructing an original sequence signal based on the average brightness of pixels in the extracted smooth facial area from multiple frames of real-time images, processing the original sequence signal using a CHROM algorithm, obtaining a remote photoplethysmography signal, performing a Fourier transform, and extracting a power spectrum in the frequency domain to derive the occupant's heart rate; and determining the occupant's blood pressure and blood oxygen saturation based on the occupant's heart rate in combination with the occupant's height, weight, age, and gender information; Within a first preset time period, a sliding window method is used to sequentially determine multiple sets of real-time detection data of the occupant corresponding to multiple sliding windows; each sliding window includes multiple frames of real-time images, and the moving step length of the sliding window is no greater than the number of image frames within the sliding window; and each set of real-time detection data is sequentially displayed on a first interface of a connected display device according to the acquisition time sequence of the multiple frames of images within each sliding window; When the physiological state detection satisfies a detection stop condition, displaying the detection result of the occupant through the second interface of the display device; the detection result is determined based on the real-time detection data; In response to receiving a trigger operation for the file management control in the first interface or the second interface, managing the file data corresponding to the detection result through the third interface of the display device.

2. The method according to claim 1, characterized in that Before detecting the physiological state of the occupant based on the multiple frames of real-time images corresponding to the occupant in the vehicle, the method further includes: Performing face recognition based on at least one frame of the real-time image to obtain identity information of the occupant; The detecting of the physiological state of the occupant in the vehicle based on multiple frames of real-time images corresponding to the occupant includes: When it is determined that the occupant is a user with a profile according to the identity information of the occupant, the physiological state of the occupant is detected based on multiple frames of real-time images corresponding to the occupant.

3. The method according to claim 1, characterized in that The detecting of the physiological state of the occupant in the vehicle based on the multiple frames of real-time images corresponding to the occupant further includes: If it is determined based on the passenger's identity information that the passenger is an unprofiled user, prompting the passenger to create a profile and displaying a profile creation interface through the display device; the new profile creation interface includes at least a user personal information entry item and a facial image entry item; After the occupant's profile is created, the occupant's physiological state is detected based on multiple frames of real-time images corresponding to the occupant.

4. The method according to any one of claims 1 to 3, further comprising: When the duration of the physiological status detection of the occupant does not reach the first preset duration, and the number of frames of the collected real-time image reaches the first number of frames or the acquisition duration of the real-time image reaches the second preset duration, the physiological status of the occupant is detected based on the collected multiple frames of real-time images to obtain the real-time detection data.

5. The method according to claim 1, wherein The method further comprises: A dynamic change graph of the detection data is drawn based on multiple groups of the real-time detection data, and the dynamic change graph and the real-time detection data are synchronously displayed through the first interface.

6. The method according to claim 5, characterized in that The method further comprises: When the occupant's portrait information or identity identification is read by performing face recognition on the occupant's real-time image, the occupant's portrait or identity identification information and the real-time detection data are synchronously displayed through the first interface.

7. The method according to claim 6, characterized in that The synchronously displaying the occupant's portrait or identity information and the real-time detection data through the first interface includes: Displaying an icon of the passenger's portrait or an icon of the passenger's identity information through a first window drawn in the first interface; and Displaying the real-time detection data through a second window drawn in the first interface; In response to the icon of the passenger's avatar or the icon of the passenger's identity information displayed in the first window being clicked, it is determined that a trigger operation for the file management control in the first interface is received.

8. The method according to claim 6, characterized in that In the case where a dynamic change graph of the detection data is drawn based on multiple sets of the real-time detection data, the synchronous display of the occupant's portrait or identity information and the real-time detection data through the first interface further includes: The real-time dynamically changing graph is displayed through a third window drawn in the first interface.

9. The method according to any one of claims 1 to 3, characterized in that The test result of the occupant includes a test sub-result of at least one indicator item, and when the physiological state test satisfies a test stop condition, displaying the test result of the occupant through the second interface of the display device includes: When the physiological status detection meets the detection stop condition, the detection sub-results and details viewing controls of each indicator item are displayed through the second interface according to the preset control arrangement; when the details viewing control is triggered, the historical detection data of the corresponding indicator item is displayed according to the preset time unit; the preset time unit includes one of the following: year, month, week, day.

10. The method according to any one of claims 1 to 3, characterized in that The archival data includes at least a user avatar icon, personal information, and historical physiological status test results. The third interface includes at least one of a new control, a user avatar icon, and an edit control. Managing the archival data corresponding to the test results through the third interface includes: In response to the editing control in the third interface being triggered, controlling the display device to display an editing interface; the editing interface includes the user's personal information items, avatar, and a delete control for deleting the archive data; In response to the user avatar icon in the third interface being triggered, controlling the display device to jump to the second interface to display the occupant's most recent historical physiological status detection result; In response to the new creation control in the third interface being triggered, the display device is controlled to display a file creation interface.

11. The method according to claim 10, characterized in that In response to the new creation control in the third interface being triggered, controlling the display device to display the archive creation interface includes: In response to the new creation control being triggered, determining whether the total number of stored archives exceeds a storage threshold; When the total number of archives does not exceed the storage threshold, controlling the display device to display the archive creation interface; When the total number of files exceeds the storage threshold, a pop-up window prompts a first message; the first message is used to instruct the occupant to delete the stored historical files and create a new file.

12. The method according to claim 11, characterized in that When the edit control is triggered, the method further includes: In response to the deletion control being triggered, a pop-up window prompts a second message; the second message is used by the occupant to confirm whether to delete the file data; In response to receiving a delete operation for the archive data, deleting the archive data and returning to the editing interface; In response to receiving a cancel deletion operation on the archive data, returning to the third interface.

13. A file management device, characterized in that: Applied to vehicle-mounted equipment, the device includes: an acquisition module, configured to acquire multiple frames of real-time images corresponding to occupants in the vehicle upon receiving a request for physiological status detection in the vehicle triggered by a user via the vehicle's central control screen or a mobile device; a state detection module for detecting the physiological state of an occupant in the vehicle based on multiple frames of real-time images corresponding to the occupant; extracting a smooth facial area from the real-time image of the occupant, if the real-time detection data obtained based on the physiological detection includes the occupant's heart rate, blood oxygen saturation, and blood pressure; constructing a raw sequence signal based on the average brightness of pixels in the extracted smooth facial area from the multiple frames of real-time images; processing the raw sequence signal using a CHROM algorithm to obtain a remote photoplethysmography signal, performing a Fourier transform, and extracting a power spectrum in the frequency domain to derive the occupant's heart rate; and determining the occupant's blood pressure and blood oxygen saturation based on the occupant's heart rate in combination with the occupant's height, weight, age, and gender information; a data display module configured to sequentially determine, within a first preset time period, a plurality of sets of real-time detection data of the occupant corresponding to a plurality of sliding windows using a sliding window method; each sliding window including a plurality of frames of real-time image, and a moving step length of the sliding window being no greater than the number of image frames within the sliding window; and sequentially displaying the sets of real-time detection data via a first interface of a connected display device according to a timing sequence of acquisition of the plurality of frames of image within each sliding window; A result display module, configured to display the test result of the occupant through the second interface of the display device when the physiological state test meets the test stop condition; the test result is determined based on the real-time test data; The file management module is configured to manage the file data corresponding to the detection result through a third interface of the display device in response to receiving a trigger operation for the file management control in the first interface or the second interface.

14. A vehicle-mounted device comprising: Display devices; a memory for storing executable computer programs; A processor, configured to implement the method according to any one of claims 1 to 12 in combination with the display device when executing the executable computer program stored in the memory.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 12 are implemented.

Images