Login verification system and method based on digital emergency vehicle

Abstract

The present invention provides a login verification system and method based on a digital ambulance, wherein the system includes: an information acquisition module for acquiring information to be verified of a person to be verified who is about to enter the digital ambulance; a verification module for verifying the information to be verified; a first determination module for allowing the person to be verified to enter the digital ambulance if the verification is successful; a second determination module for obtaining a reminder plan based on the type of reason for the failure if the verification fails; and a multiple verification reminder module for reminding the person to be verified according to the reminder plan when the person to be verified enters the information to be verified multiple times. The login verification system and method based on a digital ambulance of the present invention performs login verification on a person to be verified who is about to enter the digital ambulance, performs text content reminders and subsequent input behavior verification when the person to be verified enters the information to be verified multiple times, thereby improving the login verification efficiency of the person to be verified and making the login management of the ambulance more intelligent.

Description

Technical Field

[0001] The present invention relates to the field of face recognition technology, and in particular to a login verification system and method based on a digital emergency vehicle. Background Art

[0002] The digital smart ambulance is a new type of emergency vehicle that integrates advanced technologies such as 5G, Internet of Things, and artificial intelligence. It has modules such as drug query, drug warehousing, drug inventory, data maintenance, and video of first aid equipment use. It is equipped with computers, barcode scanners, and printers. After the ambulance arrives at the scene, medical staff can immediately examine and treat the patient, and transmit relevant information to the hospital in real time, so that the hospital can make preparations for receiving the patient in advance.

[0003] However, the scene where the ambulance arrives is usually crowded with people. Therefore, it is necessary to verify the people entering the car. Setting up fixed management personnel to patrol and check the people entering the car is inefficient and not smart enough.

[0004] In view of this, there is an urgent need for a login verification system and method based on a digital emergency vehicle to at least solve the above-mentioned shortcomings. Summary of the Invention

[0005] One of the purposes of the present invention is to provide a login verification system and method based on a digital ambulance, which performs login verification on personnel to be verified who are about to enter the digital ambulance, obtains a reminder plan for the personnel to be verified based on different verification results, and performs text content reminders and subsequent input behavior verification when the personnel to be verified enters the information to be verified multiple times, thereby improving the login verification efficiency of the personnel to be verified and making the login management of the ambulance more intelligent.

[0006] The embodiment of the present invention provides a digital emergency vehicle-based login verification system, including:

[0007] An information acquisition module is used to acquire the verification information of the person to be verified who is about to enter the digital emergency vehicle;

[0008] A verification module, used to verify the information to be verified;

[0009] A first determination module is configured to allow the person to be verified to enter the digital ambulance if the verification is successful;

[0010] The second determination module is used to obtain a reminder plan for the person to be verified based on the type of failure reason if the verification fails. The reminder plan includes: text content reminder and subsequent input behavior verification strategy;

[0011] The multiple verification reminder module is used to remind the person to be verified accordingly when the person to be verified enters the information to be verified multiple times according to the reminder plan.

[0012] Preferably, the information acquisition module acquires the verification information of the person to be verified who is about to enter the digital emergency vehicle, including:

[0013] Obtaining fingerprint identification data of the person to be verified;

[0014] Obtain facial recognition data of the person to be verified;

[0015] Obtain the login key data of the person to be verified;

[0016] The fingerprint recognition data, facial recognition data and login key data are collectively used as the information to be verified.

[0017] Preferably, the information acquisition module acquires facial recognition data of the person to be verified, including:

[0018] Determine the characteristics of the collected information within the collection range based on the historical recognition records of the facial collection device, the collected information characteristics including: identification and determination of the collected information points and identification and determination of the collected data feature values;

[0019] Divide the effective identification and judgment range of the collection range according to the characteristics of the collected information;

[0020] The range outside the effective identification and judgment range within the collection range is regarded as the source range of related information;

[0021] Real-time acquisition of the first movement trajectory of the person to be verified within the scope of the associated information source;

[0022] Predicting a sequence of facial points of the person to be verified within an effective recognition range based on the first action trajectory;

[0023] Traverse the facial points of the people in the facial point sequence from the beginning to the end, and use the facial point of the person being traversed as the target facial point of the person;

[0024] Match the target person's facial points with the recognition and determination information collection points. If the points match successfully, obtain the historical person's orientation at the corresponding recognition and determination information collection points.

[0025] Obtaining the target person's facial orientation at the target person's facial point;

[0026] If the target person's face direction falls within the historical person direction range, the corresponding target person's face point is used as the target point, the predicted time when the person to be verified arrives at the target point is used as the predicted time, and the traversal is stopped;

[0027] If the current time reaches the predicted time, based on the face recognition technology and the recognition image of the target person's facial points, the facial recognition data of the corresponding person to be verified is obtained.

[0028] Preferably, the information acquisition module uses the predicted time when the person to be verified arrives at the target point as the predicted moment and stops traversing, including:

[0029] Before stopping the traversal, based on the second movement trajectories of the identified persons excluding the person to be verified within the scope of the associated information source, predict the second predicted movement trajectory of the identified target within the time period including the prediction moment within the effective identification determination range;

[0030] Obtain the target point corresponding to the predicted moment and the target line of the facial acquisition device, and determine whether there is an intersection between the target line and the second predicted action trajectory;

[0031] If there is an intersection, the corresponding target person's facial point is removed and the traversal continues.

[0032] The digital emergency vehicle-based login verification system provided in an embodiment of the present invention further includes:

[0033] The emergency scene scanning module is used to scan the emergency scene and generate guide information based on the on-site scanning results.

[0034] Preferably, the emergency scene scanning module performs an on-site scan of the emergency scene and generates navigation information based on the on-site scanning results, including:

[0035] According to the on-site scanning results, the semantics of the scanning results are obtained, and the standard scenarios are matched according to the semantics of the scanning results;

[0036] Obtain the standard operating procedures corresponding to standard situations and present them in multimedia;

[0037] Acquire multiple in-vehicle targets during multimedia presentation;

[0038] Based on the in-vehicle target storage warehouse and the in-vehicle targets, output a storage list of the in-vehicle targets; the storage list includes: one-to-one correspondence between the in-vehicle targets and the storage location numbers;

[0039] Get the sight anchor point when the person in the car views the storage list;

[0040] Get the list items where the gaze anchor point repeatedly passes through, and determine the interval length between repeated passes of the gaze anchor point.

[0041] If the interval time is greater than or equal to the preset interval time threshold, the corresponding storage list item is used as the target storage list item, and the reminder light of the corresponding in-vehicle target is triggered based on the reminder light triggering rule of the target storage list item corresponding to the in-vehicle target;

[0042] Obtain the target distribution map inside the vehicle;

[0043] The target distribution of the in-vehicle target corresponding to the determined target storage list item in the in-vehicle target distribution map;

[0044] Based on the preset distribution logic feature extraction template, the distribution logic features are extracted according to the target distribution;

[0045] According to the distribution logic characteristics, a distribution logic explanation template is obtained;

[0046] Use the distribution logic explanation template to compare the target distribution, obtain the distribution logic explanation, and display the distribution logic explanation to the people in the car.

[0047] Preferably, the emergency scene scanning module performs an on-site scan of the emergency scene and generates navigation information based on the on-site scanning results, further comprising:

[0048] After triggering the warning light of the corresponding in-car target, a light range vector set is constructed based on the light characteristics of the warning light;

[0049] According to the visual range characteristics of the people in the car, a visual range vector set is constructed;

[0050] Determine a vector pair of intersecting light range vectors and sight range vectors according to the light range vector set and the sight range vector set;

[0051] Characterize the vector pair to obtain visible light features, which include: visible light range and visible light intensity;

[0052] Based on the visual light feature-light source position determination experience database, determine whether the light source position can be located based on the visual light feature;

[0053] If not, obtain the matching item that is most similar to the visual light feature in the experience database based on the visual light feature-light source position determination;

[0054] Based on the matching items and visible light characteristics, the warning light viewing strategy is obtained and displayed to the occupants of the vehicle.

[0055] The embodiment of the present invention provides a digital emergency vehicle-based login verification method, including:

[0056] Step 1: Obtain verification information of the person who is about to enter the digital emergency vehicle;

[0057] Step 2: Verify the information to be verified;

[0058] Step 3: If the verification is successful, the person to be verified is allowed to enter the digital emergency vehicle;

[0059] Step 4: If the verification fails, obtain a reminder plan for the person to be verified based on the reason for the failure. The reminder plan includes: text content reminder and subsequent input behavior verification strategy;

[0060] Step 5: According to the reminder plan, when the person to be verified enters the information to be verified multiple times, the person to be verified is reminded accordingly.

[0061] Preferably, step 1: obtaining the verification information of the person to be verified who is about to enter the digital emergency vehicle, includes:

[0062] Obtaining fingerprint identification data of the person to be verified;

[0063] Obtain facial recognition data of the person to be verified;

[0064] Obtain the login key data of the person to be verified;

[0065] The fingerprint recognition data, facial recognition data and login key data are collectively used as the information to be verified.

[0066] Preferably, obtaining facial recognition data of the person to be verified includes:

[0067] Determine the characteristics of the collected information within the collection range based on the historical recognition records of the facial collection device, the collected information characteristics including: identification and determination of the collected information points and identification and determination of the collected data feature values;

[0068] Divide the effective identification and judgment range of the collection range according to the characteristics of the collected information;

[0069] The range outside the effective identification and judgment range within the collection range is regarded as the source range of related information;

[0070] Real-time acquisition of the first movement trajectory of the person to be verified within the scope of the associated information source;

[0071] Predicting a sequence of facial points of the person to be verified within an effective recognition range based on the first action trajectory;

[0072] Traverse the facial points of the people in the facial point sequence from the beginning to the end, and use the facial point of the person being traversed as the target facial point of the person;

[0073] Match the target person's facial points with the recognition and determination information collection points. If the points match successfully, obtain the historical person's orientation at the corresponding recognition and determination information collection points.

[0074] Obtaining the target person's facial orientation at the target person's facial point;

[0075] If the target person's face direction falls within the historical person direction range, the corresponding target person's face point is used as the target point, the predicted time when the person to be verified arrives at the target point is used as the predicted time, and the traversal is stopped;

[0076] If the current time reaches the predicted time, based on the face recognition technology and the recognition image of the target person's facial points, the facial recognition data of the corresponding person to be verified is obtained.

[0077] Preferably, the predicted time when the person to be verified arrives at the target point is used as the predicted moment, and the traversal is stopped, including:

[0078] Before stopping the traversal, based on the second movement trajectories of the identified persons excluding the person to be verified within the scope of the associated information source, predict the second predicted movement trajectory of the identified target within the time period including the prediction moment within the effective identification determination range;

[0079] Obtain the target point corresponding to the predicted moment and the target line of the facial acquisition device, and determine whether there is an intersection between the target line and the second predicted action trajectory;

[0080] If there is an intersection, the corresponding target person's facial point is removed and the traversal continues.

[0081] The beneficial effects of the present invention are:

[0082] The present invention performs login verification on persons to be verified who are about to enter a digital ambulance, obtains a reminder plan for the persons to be verified according to different verification results, and performs text content reminders and subsequent input behavior verification when the persons to be verified enter information to be verified multiple times, thereby improving the login verification efficiency of the persons to be verified and making the login management of the ambulance more intelligent.

[0083] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purpose and other advantages of the present invention can be achieved and obtained through the structures specifically pointed out in this application document.

[0084] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0085] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0086] Figure 1 Schematic diagram of a login verification system based on a digital emergency vehicle in an embodiment of the present invention;

[0087] Figure 2 Schematic diagram of a login verification method based on a digital emergency vehicle in an embodiment of the present invention. DETAILED DESCRIPTION

[0088] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0089] The embodiment of the present invention provides a login verification system based on a digital emergency vehicle, such as Figure 1 As shown, including:

[0090] Information acquisition module 1 is used to obtain the verification information of the person to be verified who is about to enter the digital emergency vehicle; the verification information includes: fingerprint recognition data, facial recognition data and login key data;

[0091] Verification module 2, used to verify the information to be verified;

[0092] The first determination module 3 is configured to allow the person to be verified to enter the digital ambulance if the verification is successful;

[0093] The second determination module 4 is used to obtain a reminder plan for the person to be verified based on the type of failure reason if the verification fails. The reminder plan includes: text content reminder and subsequent input behavior verification strategy;

[0094] The multiple verification reminder module 5 is used to remind the person to be verified according to the reminder plan when the person to be verified inputs the information to be verified multiple times.

[0095] The working principle and beneficial effects of the above technical solution are:

[0096] The person to be verified who is preparing to enter the digital ambulance is: a person who wants to enter the digital ambulance, such as: medical personnel who want to use the digital ambulance at the emergency scene; the information to be verified includes: fingerprint recognition data, facial recognition data and login key data. When verifying the information to be verified, corresponding verification is performed based on the verification method of different verification information types; if the verification is successful, the person to be verified is allowed to enter, otherwise a reminder plan for the person to be verified is obtained based on the type of failure reason (such as: verification failure caused by irregular recognition action, verification failure caused by information mismatch), and the reminder plan includes: text content reminder and subsequent input behavior verification strategy. The text content reminder is: relevant text information of the verification failure reason displayed to the person to be verified based on a preset display device. The subsequent input behavior verification strategy is: detection and reminder strategy for the behavior that causes the failure reason. For example, if the failure reason is: the face of the person to be verified is too close to the facial acquisition device, resulting in the inability to expose the entire face, then the subsequent input behavior verification strategy is: verify whether the face of the person to be verified is too close to the image detection device when the person to be verified subsequently enters the information to be verified, and if so, a reminder is given.

[0097] The present invention performs login verification on persons to be verified who are about to enter a digital ambulance, obtains a reminder plan for the persons to be verified according to different verification results, and performs text content reminders and subsequent input behavior verification when the persons to be verified enter information to be verified multiple times, thereby improving the login verification efficiency of the persons to be verified and making the login management of the ambulance more intelligent.

[0098] In one embodiment, the information acquisition module acquires facial recognition data of the person to be verified, including:

[0099] Determine the characteristics of the collected information within the collection range based on the historical recognition records of the facial collection device, the collected information characteristics including: identification and determination of the collected information points and identification and determination of the collected data feature values;

[0100] Divide the effective identification and judgment range of the collection range according to the characteristics of the collected information;

[0101] The range outside the effective identification and judgment range within the collection range is regarded as the source range of related information;

[0102] Real-time acquisition of the first movement trajectory of the person to be verified within the scope of the associated information source;

[0103] Predicting a sequence of facial points of the person to be verified within an effective recognition range based on the first action trajectory;

[0104] Traverse the facial points of the people in the facial point sequence from the beginning to the end, and use the facial point of the person being traversed as the target facial point of the person;

[0105] Match the target person's facial points with the recognition and determination information collection points. If the points match successfully, obtain the historical person's orientation at the corresponding recognition and determination information collection points.

[0106] Obtaining the target person's facial orientation at the target person's facial point;

[0107] If the target person's face direction falls within the historical person direction range, the corresponding target person's face point is used as the target point, the predicted time when the person to be verified arrives at the target point is used as the predicted time, and the traversal is stopped;

[0108] If the current time reaches the predicted time, based on the face recognition technology and the recognition image of the target person's facial points, the facial recognition data of the corresponding person to be verified is obtained.

[0109] The working principle and beneficial effects of the above technical solution are:

[0110] The facial acquisition device is a device for image acquisition, such as a high-definition camera. The historical recognition record is a record of the facial acquisition device successfully recognizing a face, and the collection information features within the collection range are determined. The collection information features include the recognition and determination collection information point (the location of the collected face data that successfully completed the face recognition judgment) and the recognition and determination collection data feature value (the specific face data collected at the recognition and determination collection information location); the effective recognition judgment range is: the minimum range within the collection range that contains all the recognition and determination collection information points. The effective recognition judgment range is the range that can trigger the face recognition judgment of the face image collected by the facial acquisition device; the person's facial point sequence includes multiple one-to-one corresponding predicted moments and the person's facial points within the effective recognition judgment range predicted at the predicted moment. First, the first predicted action trajectory within the effective recognition judgment range is predicted based on the first action trajectory, and the person's facial point is determined based on the predicted action point and the height of the person to be verified; when the target person's facial point and the recognition and determination collection information point are matched, if the point match is successful, it means that the image at the corresponding position meets the distance requirement for face detection. However, the conditions for effective recognition at different positions within the effective recognition judgment range are different. For example, the boundary of the effective recognition and determination range is prone to distortion. Only when the person to be verified is close to the facial acquisition device (for example, within 3 meters), and the face of the person to be verified is facing the facial acquisition device, and the angle between the straight line where the face is facing and the straight line where the range boundary is located is less than or equal to the preset angle threshold (for example, 5°), can the face of the person to be verified be effectively recognized. In the range corresponding to the top height of the cone formed by the effective recognition and determination range, when the person to be verified is 5 meters away from the facial acquisition device, the vector of the facial orientation vector of the person to be verified and the shooting vector of the facial acquisition device When the angle is within the range of 150° to 180°, the face of the person to be verified can be effectively identified; therefore, if the point matching is successful, the historical person orientation range is obtained according to the recognition and determination data feature value of the corresponding recognition and determination information collection point. If the target person's facial orientation is within the historical person orientation range corresponding to the corresponding successful matching recognition and determination information collection point, it means that the captured image of the target person's facial point meets the face recognition conditions. When the current moment reaches the predicted moment, face detection is performed on the recognition image of the target person's facial point, which improves the efficiency of face detection and reduces the system computing power.

[0111] In one embodiment, the information acquisition module uses the predicted time when the person to be verified arrives at the target location as the predicted time and stops traversal, including:

[0112] Before stopping the traversal, based on the second movement trajectories of the identified persons excluding the person to be verified within the scope of the associated information source, predict the second predicted movement trajectory of the identified target within the time period including the prediction moment within the effective identification determination range;

[0113] Obtain the target point corresponding to the predicted moment and the target line of the facial acquisition device, and determine whether there is an intersection between the target line and the second predicted action trajectory;

[0114] If there is an intersection, the corresponding target person's facial point is removed and the traversal continues.

[0115] The working principle and beneficial effects of the above technical solution are:

[0116] Taking into account the occlusion situation within the effective recognition judgment range, the second action trajectory of the identified person except the person to be verified within the range of the associated information source obtained by the facial acquisition device is used to predict the second predicted action trajectory of the identified target within the time period including the predicted moment within the effective recognition judgment range. For example, if the predicted moment is moment A, the time period including the predicted moment is from 5 seconds before to 5 seconds after moment A. When there is an intersection between the target point corresponding to the predicted moment and the target line of the facial acquisition device and the second predicted action trajectory, it means that although the target point meets the distance and direction conditions for face detection, it may be blocked. Therefore, the corresponding target person's facial point is eliminated, and the traversal continues, further improving the accuracy of the process of triggering face detection position determination.

[0117] An embodiment of the present invention provides a login verification system based on a digital emergency vehicle, further comprising:

[0118] The emergency scene scanning module is used to scan the emergency scene and generate guide information based on the results of the on-site scanning;

[0119] The emergency scene scanning module scans the emergency scene and generates navigation information based on the results of the on-site scanning, including:

[0120] According to the on-site scanning results, the semantics of the scanning results are obtained, and the standard scenarios are matched according to the semantics of the scanning results;

[0121] Obtain the standard operating procedures corresponding to standard situations and present them in multimedia;

[0122] Acquire multiple in-vehicle targets during multimedia presentation;

[0123] Based on the in-vehicle target storage warehouse and the in-vehicle targets, output a storage list of the in-vehicle targets; the storage list includes: one-to-one correspondence between the in-vehicle targets and the storage location numbers;

[0124] Get the sight anchor point when the person in the car views the storage list;

[0125] Get the list items where the gaze anchor point repeatedly passes through, and determine the interval length between repeated passes of the gaze anchor point.

[0126] If the interval time is greater than or equal to the preset interval time threshold, the corresponding storage list item is used as the target storage list item, and the reminder light of the corresponding in-vehicle target is triggered based on the reminder light triggering rule of the target storage list item corresponding to the in-vehicle target;

[0127] Obtain the target distribution map inside the vehicle;

[0128] The target distribution of the in-vehicle target corresponding to the determined target storage list item in the in-vehicle target distribution map;

[0129] Based on the preset distribution logic feature extraction template, the distribution logic features are extracted according to the target distribution;

[0130] According to the distribution logic characteristics, a distribution logic explanation template is obtained;

[0131] Use the distribution logic explanation template to compare the target distribution, obtain the distribution logic explanation, and display the distribution logic explanation to the people in the car.

[0132] The working principle and beneficial effects of the above technical solution are:

[0133] The on-site scanning results are: the scanning data of the surrounding environment by the millimeter-wave radar, ultrasonic radar and lidar carried by the ambulance; the semantics of the scanning results are the semantic description of the scanning data, such as: car accident scene, fire scene, etc.; the standard situation to be matched is: multiple accident scene situations that the ambulance may arrive at, and the standard situation for successful matching is the accident scene situation corresponding to the first aid scene; the standard operating procedure is: the standard response process for standard situations using the items in the ambulance, such as: what kind of protective equipment, medicines and medical facilities to take from the ambulance; multimedia display of the standard operating procedure means displaying the standard operating procedure to the people in the car in a multimedia form (for example: projection of the ambulance's large-screen); multiple in-car targets in the multimedia display process are obtained through multimedia voice recognition; the in-car target warehouse includes: all in-car targets in the ambulance and their storage location codes Number, match the in-car target with all in-car targets in the ambulance, and output the storage list of the in-car target; the sight anchor point is the sight point when the in-car person views the storage list, and the storage list item is the content item of the storage list that the sight anchor point repeatedly passes by, and the content item includes the description text corresponding to a certain in-car target and its corresponding storage location number; when the interval length of repeated passing is greater than the preset interval length threshold (for example: 30 seconds), it reflects a situation: the in-car person views the storage list item and then views it again after a long time, indicating that the in-car user cannot find the corresponding in-car target after searching by himself, and uses the corresponding storage list item as the target storage list item; based on the reminder light triggering rule of the in-car target corresponding to the target storage list item, the reminder light of the corresponding in-car target is triggered, for example: the LED light on the medicine box with trigger number F0113 is turned on, so as to help the in-car person quickly find the required in-car items.

[0134] In addition, the in-vehicle targets corresponding to the determined target storage list items are marked in the in-vehicle target distribution map to obtain the target distribution. The in-vehicle target distribution map is a distribution diagram of all in-vehicle items in the emergency vehicle; the preset distribution logic feature extraction template is used for extracting the distribution rules between different in-vehicle targets from the local or overall in-vehicle target distribution in the in-vehicle target distribution map, for example: the in-vehicle targets are clustered in position, and for example: the storage location numbers of the in-vehicle targets are mostly F-type; the distribution logic explanation template is used to explain the extracted distribution rules based on the distribution logic features, for example: the distribution logic feature is the in-vehicle targets in position. If the objects are in a clustered state, the distribution logic is interpreted as the emission logic of the in-vehicle targets stored at the clustered positions. For example, if the distribution logic feature is that the storage position numbers of the in-vehicle targets are mostly F, the distribution logic is interpreted as the emission logic of the in-vehicle targets with F numbering. The distribution logic interpretation is displayed to the people in the vehicle. The embodiment of the present invention can automatically obtain the knowledge of the in-vehicle distribution content that the people in the vehicle are not familiar with based on the target storage list items. After the people in the vehicle view the explanation, the appearance of target storage list items related to such unfamiliar in-vehicle distribution content will be reduced, which greatly improves the speed of retrieving the in-vehicle targets and further improves the efficiency of first aid.

[0135] In one embodiment, the emergency scene scanning module performs an on-site scan of the emergency scene and generates navigation information based on the on-site scanning results, further comprising:

[0136] After triggering the warning light of the corresponding in-car target, a light range vector set is constructed based on the light characteristics of the warning light;

[0137] According to the visual range characteristics of the people in the car, a visual range vector set is constructed;

[0138] Determine a vector pair of intersecting light range vectors and sight range vectors according to the light range vector set and the sight range vector set;

[0139] Characterize the vector pair to obtain visible light features, which include: visible light range and visible light intensity;

[0140] Based on the visual light feature-light source position determination experience database, determine whether the light source position can be located based on the visual light feature;

[0141] If not, obtain the matching item that is most similar to the visual light feature in the experience database based on the visual light feature-light source position determination;

[0142] Based on the matching items and visible light characteristics, the warning light viewing strategy is obtained and displayed to the occupants of the vehicle.

[0143] The working principle and beneficial effects of the above technical solution are:

[0144] Light features include the direction and intensity of the warning light; the light range vector is a description vector of the intensity and direction of the warning light; the eye sight range feature includes the direction and distance of the sight of the occupants in the car, and the sight range vector is a description vector of the direction and distance of the sight of the occupants in the car; the intersecting light range vector and sight range vector represent the viewing relationship between the sight and the warning light. The visible light feature is a characterization of the viewing relationship between the sight and the warning light, such as: where and what intensity of the warning light; the visible light feature - the light source position determination experience library stores multiple one-to-one matching items (historically, the sight and the warning light can be used to determine the light source position). The characterization of the viewing relationship of light and its corresponding determined light source position are set manually, and the visual situations corresponding to the matching items include: the light is completely unobstructed, the light source is completely obstructed by other objects in the ambulance but the surrounding light can be seen, etc.; if the matching item corresponding to the visible light feature cannot be matched, it means that according to the current viewing relationship, the occupants in the vehicle cannot locate the position of the light source (for example, the light is completely obstructed by other objects in the ambulance), and the matching item with the most similar visual light feature is obtained; the purpose of obtaining the warning light viewing strategy based on the matching item and the visual light feature is to minimize the cost of adjusting the line of sight and to view the warning light at a visual angle as soon as possible, thereby improving the reminder efficiency.

[0145] The embodiment of the present invention provides a login verification method based on a digital emergency vehicle, such as Figure 2 As shown, including:

[0146] Step 1: Obtain verification information of the person who is about to enter the digital emergency vehicle;

[0147] Step 2: Verify the information to be verified;

[0148] Step 3: If the verification is successful, the person to be verified is allowed to enter the digital emergency vehicle;

[0149] Step 4: If the verification fails, obtain a reminder plan for the person to be verified based on the reason for the failure. The reminder plan includes: text content reminder and subsequent input behavior verification strategy;

[0150] Step 5: According to the reminder plan, when the person to be verified enters the information to be verified multiple times, the person to be verified is reminded accordingly.

[0151] In one embodiment, step 1: obtaining verification information of a person who is about to enter a digital emergency vehicle, includes:

[0152] Obtaining fingerprint identification data of the person to be verified;

[0153] Obtain facial recognition data of the person to be verified;

[0154] Obtain the login key data of the person to be verified;

[0155] The fingerprint recognition data, facial recognition data and login key data are collectively used as the information to be verified.

[0156] In one embodiment, obtaining facial recognition data of a person to be verified includes:

[0157] Determine the characteristics of the collected information within the collection range based on the historical recognition records of the facial collection device, the collected information characteristics including: identification and determination of the collected information points and identification and determination of the collected data feature values;

[0158] Divide the effective identification and judgment range of the collection range according to the characteristics of the collected information;

[0159] The range outside the effective identification and judgment range within the collection range is regarded as the source range of related information;

[0160] Real-time acquisition of the first movement trajectory of the person to be verified within the scope of the associated information source;

[0161] Predicting a sequence of facial points of the person to be verified within an effective recognition range based on the first action trajectory;

[0162] Traverse the facial points of the people in the facial point sequence from the beginning to the end, and use the facial point of the person being traversed as the target facial point of the person;

[0163] Match the target person's facial points with the recognition and determination information collection points. If the points match successfully, obtain the historical person's orientation at the corresponding recognition and determination information collection points.

[0164] Obtaining the target person's facial orientation at the target person's facial point;

[0165] If the target person's face direction falls within the historical person direction range, the corresponding target person's face point is used as the target point, the predicted time when the person to be verified arrives at the target point is used as the predicted time, and the traversal is stopped;

[0166] If the current time reaches the predicted time, based on the face recognition technology and the recognition image of the target person's facial points, the facial recognition data of the corresponding person to be verified is obtained.

[0167] In one embodiment, the predicted time when the person to be verified arrives at the target location is used as the predicted time, and the traversal is stopped, including:

[0168] Before stopping the traversal, based on the second movement trajectories of the identified persons excluding the person to be verified within the scope of the associated information source, predict the second predicted movement trajectory of the identified target within the time period including the prediction moment within the effective identification determination range;

[0169] Obtain the target point corresponding to the predicted moment and the target line of the facial acquisition device, and determine whether there is an intersection between the target line and the second predicted action trajectory;

[0170] If there is an intersection, the corresponding target person's facial point is removed and the traversal continues.

[0171] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.

Claims

1. A login verification system based on a digital emergency vehicle, characterized in that: include: An information acquisition module is used to acquire the verification information of the person to be verified who is about to enter the digital emergency vehicle; A verification module, used to verify the information to be verified; A first determination module is configured to allow the person to be verified to enter the digital ambulance if the verification is successful; The second determination module is used to obtain a reminder plan for the person to be verified based on the type of failure reason if the verification fails. The reminder plan includes: text content reminder and subsequent input behavior verification strategy; Multiple verification reminder module, used to remind the person to be verified when the person to be verified enters the information to be verified multiple times according to the reminder plan; The information acquisition module acquires the verification information of the person to be verified who is about to enter the digital ambulance, including: Obtaining fingerprint identification data of the person to be verified; Obtain facial recognition data of the person to be verified; Obtain the login key data of the person to be verified; Fingerprint recognition data, facial recognition data, and login key data are used together as information to be verified; The information acquisition module obtains the facial recognition data of the person to be verified, including: Determine the characteristics of the collected information within the collection range based on the historical recognition records of the facial collection device, the collected information characteristics including: identification and determination of the collected information points and identification and determination of the collected data feature values; Divide the effective identification and judgment range of the collection range according to the characteristics of the collected information; The range outside the effective identification and judgment range within the collection range is regarded as the source range of related information; Real-time acquisition of the first movement trajectory of the person to be verified within the scope of the associated information source; Predicting a sequence of facial points of the person to be verified within an effective recognition range based on the first action trajectory; Traverse the facial points of the people in the facial point sequence from the beginning to the end, and use the facial point of the person being traversed as the target facial point of the person; Match the target person's facial points with the recognition and determination information collection points. If the points match successfully, obtain the historical person's orientation at the corresponding recognition and determination information collection points. Obtaining the target person's facial orientation at the target person's facial point; If the target person's face direction falls within the historical person direction range, the corresponding target person's face point is used as the target point, the predicted time when the person to be verified arrives at the target point is used as the predicted time, and the traversal is stopped; If the current time reaches the predicted time, based on the face recognition technology and the recognition image of the target person's facial points, the facial recognition data of the corresponding person to be verified is obtained.

2. The digital emergency vehicle-based login verification system according to claim 1, characterized in that: The information acquisition module uses the predicted time when the person to be verified arrives at the target location as the predicted moment and stops traversal, including: Before stopping the traversal, based on the second movement trajectories of the identified persons excluding the person to be verified within the scope of the associated information source, predict the second predicted movement trajectory of the identified target within the time period including the prediction moment within the effective identification determination range; Obtain the target point corresponding to the predicted moment and the target line of the facial acquisition device, and determine whether there is an intersection between the target line and the second predicted action trajectory; If there is an intersection, the corresponding target person's facial point is removed and the traversal continues.

3. The digital emergency vehicle-based login verification system according to claim 1, characterized in that: Also includes: The emergency scene scanning module is used to scan the emergency scene and generate guide information based on the on-site scanning results.

4. The digital emergency vehicle-based login verification system according to claim 3, characterized in that: The emergency scene scanning module scans the emergency scene and generates navigation information based on the results of the on-site scanning, including: According to the on-site scanning results, the semantics of the scanning results are obtained, and the standard scenarios are matched according to the semantics of the scanning results; Obtain the standard operating procedures corresponding to standard situations and present them in multimedia; Acquire multiple in-vehicle targets during multimedia presentation; Based on the in-vehicle target storage warehouse and the in-vehicle targets, output a storage list of the in-vehicle targets; the storage list includes: one-to-one correspondence between the in-vehicle targets and the storage location numbers; Get the sight anchor point when the person in the car views the storage list; Get the list items where the gaze anchor point repeatedly passes through, and determine the interval length between repeated passes of the gaze anchor point. If the interval duration is greater than or equal to the preset interval duration threshold, the corresponding storage list item will be used as the target storage list item, and the reminder light of the corresponding in-vehicle target will be triggered based on the reminder light triggering rule of the target storage list item corresponding to the in-vehicle target.

5. A login verification method based on a digital emergency vehicle, characterized in that: include: Step 1: Obtain verification information of the person who is about to enter the digital emergency vehicle; Step 2: Verify the information to be verified; Step 3: If the verification is successful, the person to be verified is allowed to enter the digital emergency vehicle; Step 4: If the verification fails, obtain a reminder plan for the person to be verified based on the reason for the failure. The reminder plan includes: text content reminder and subsequent input behavior verification strategy; Step 5: According to the reminder plan, when the person to be verified enters the information to be verified multiple times, the person to be verified is reminded accordingly; Step 1: Obtaining the verification information of the person to be verified who is about to enter the digital ambulance, including: Obtaining fingerprint identification data of the person to be verified; Obtain facial recognition data of the person to be verified; Obtain the login key data of the person to be verified; Fingerprint recognition data, facial recognition data, and login key data are used together as information to be verified; Obtaining facial recognition data of the person to be verified includes: Determine the characteristics of the collected information within the collection range based on the historical recognition records of the facial collection device, the collected information characteristics including: identification and determination of the collected information points and identification and determination of the collected data feature values; Divide the effective identification and judgment range of the collection range according to the characteristics of the collected information; The range outside the effective identification and judgment range within the collection range is regarded as the source range of related information; Real-time acquisition of the first movement trajectory of the person to be verified within the scope of the associated information source; Predicting a sequence of facial points of the person to be verified within an effective recognition range based on the first action trajectory; Traverse the facial points of the people in the facial point sequence from the beginning to the end, and use the facial point of the person being traversed as the target facial point of the person; Match the target person's facial points with the recognition and determination information collection points. If the points match successfully, obtain the historical person's orientation at the corresponding recognition and determination information collection points. Obtaining the target person's facial orientation at the target person's facial point; If the target person's face direction falls within the historical person direction range, the corresponding target person's face point is used as the target point, the predicted time when the person to be verified arrives at the target point is used as the predicted time, and the traversal is stopped; If the current time reaches the predicted time, based on the face recognition technology and the recognition image of the target person's facial points, the facial recognition data of the corresponding person to be verified is obtained.

6. The login verification method based on a digital emergency vehicle according to claim 5, characterized in that: The predicted time when the person to be verified arrives at the target point is used as the predicted time, and the traversal is stopped, including: Before stopping the traversal, based on the second movement trajectories of the identified persons excluding the person to be verified within the scope of the associated information source, predict the second predicted movement trajectory of the identified target within the time period including the prediction moment within the effective identification determination range; Obtain the target point corresponding to the predicted moment and the target line of the facial acquisition device, and determine whether there is an intersection between the target line and the second predicted action trajectory; If there is an intersection, the corresponding target person's facial point is removed and the traversal continues.

Images