Driver video interview method, system, computer equipment and medium

Abstract

The present application discloses a method, system, computer equipment and medium for driver video face-to-face interview, which relates to the technical field of computer information processing. The method comprises: obtaining a video face-to-face interview request, determining the face-to-face interview object and generating face-to-face interview object information according to the video face-to-face interview request; the face-to-face interview object includes the driver and the collaborator; collecting the first face-to-face interview video in real time, and determining whether only the driver and the collaborator exist in the first face-to-face interview video at the same time according to the face-to-face interview object information, and if so, generating a face-to-face interview instruction; collecting the second face-to-face interview video in real time, and determining whether the driver and the collaborator both make the face-to-face interview operation corresponding to the face-to-face interview instruction according to the second face-to-face interview video and the face-to-face interview instruction; if so, sending the driver video face-to-face interview success information to the terminal. The present application has the effect of improving the flexibility of video face-to-face interview.

Description

Technical Field

[0001] The present application relates to the technical field of computer information processing, and in particular to a driver video face-to-face signing method, system, computer equipment and medium. Background Art

[0002] Video face-to-face interview refers to a mode of face-to-face interview that relies on Internet technology to conduct online customer identity verification, business matters review, document signing, scene witnessing, etc. in the form of audio and video calls. It is usually used in scenarios such as identity authentication, financial purchases, customer service consultation, and insurance claims.

[0003] During the driver's video interview, the person concerned (i.e. the driver) needs to use a camera to shoot a facial video, and the identity of the person concerned is verified and confirmed through the facial video to achieve the purpose of real-name verification. However, for various types of video interviews currently, the interview mode is relatively fixed, and the review operation during the interview process is completed by the back-end seat staff. The person concerned can usually only conduct the interview alone. The form of video interview is relatively simple, and the relevant personnel who help the person concerned conduct the video interview usually need to avoid appearing in the camera, resulting in the lack of flexibility of video interviews and difficulty in meeting the needs of specific users. Summary of the invention

[0004] In order to improve the flexibility of video interview, the present application provides a driver video interview method, system, computer device and medium.

[0005] In the first aspect, the present application provides a driver video interview method, which adopts the following technical solution:

[0006] A driver video interview method, comprising:

[0007] Obtain a video interview request, determine an interview object according to the video interview request, and generate interview object information; the interview object includes the driver and the collaborator;

[0008] Collect the first face-to-face video in real time, and determine whether only the driver and the collaborator exist in the first face-to-face video according to the face-to-face object information, and if so, generate a face-to-face instruction;

[0009] Collecting a second face-to-face interview video in real time, and determining whether the driver and the collaborator have both performed face-to-face interview operations corresponding to the face-to-face interview instruction according to the second face-to-face interview video and the face-to-face interview instruction;

[0010] If so, the driver's video interview success information is sent to the terminal.

[0011] By adopting the above technical solution, when conducting a video face-to-face interview, first obtain a video face-to-face interview request, then determine the face-to-face interview object according to the video face-to-face interview request and generate face-to-face interview object information, then collect the first face-to-face interview video in real time, and determine whether only the driver and the collaborator exist in the first face-to-face interview video at the same time according to the face-to-face interview object information, if the driver and the collaborator exist in the first face-to-face interview video at the same time, then generate a face-to-face interview instruction; then collect the second face-to-face interview video in real time, and determine whether the driver and the collaborator have both made the face-to-face interview operation corresponding to the face-to-face interview instruction according to the second face-to-face interview video and the face-to-face interview instruction, if the driver and the collaborator have both made the face-to-face interview operation corresponding to the face-to-face interview instruction, then send the driver's video face-to-face interview success information to the terminal. In the above method, the collaborator will guide the driver to conduct a video face-to-face interview, and the driver and the collaborator need to appear in the camera at the same time. The driver only needs to follow the collaborator under the guidance of the collaborator to perform the same face-to-face interview operation, and the face-to-face interview can be successful. Compared with the single face-to-face interview method in the background technology, the flexibility of the video face-to-face interview is improved, the form of the video face-to-face interview is enriched, and it is convenient for others to help the driver to perform the face-to-face interview operation, thereby improving the driver's experience in the video face-to-face interview.

[0012] Optionally, determining whether only the driver and the collaborator exist in the first face-to-face video according to the face-to-face interview object information specifically includes:

[0013] Extracting a first image frame from the first face-to-face video according to a preset time interval;

[0014] Detecting whether there is a human face in the first image frame, and taking the image frame in which the human face exists as a first face frame;

[0015] Determine whether there are two faces in the first face frame, and if so, perform similarity matching on the faces in the first face frame in a preset face database to obtain corresponding face identity information;

[0016] The face-to-face signing object information and the face identity information are compared to determine whether only the driver and the collaborator exist at the same time.

[0017] By adopting the above technical solution, in order to determine whether only the driver and the collaborator exist in the first face-to-face video at the same time, the first image frame is first extracted from the first face-to-face video according to a preset time interval, and then it is detected whether there is a face in the first image frame, and the image frame with the face is used as the first face frame, and then it is determined whether there are two faces in the first face frame. If there are two faces in the first face frame, the faces in the first face frame are similarly matched in a preset face database to obtain corresponding face identity information, and finally the face-to-face object information and the face identity information are compared to determine whether only the driver and the collaborator exist at the same time.

[0018] Optionally, after detecting whether there is a face in the first image frame and taking the image frame with the face as the first face frame, the method further includes:

[0019] Determining a first current state of the driver according to the first face frame;

[0020] Extracting audio information from the first interview video, and determining the current second state of the driver according to the audio information;

[0021] Determine whether the first state and the second state are consistent. If not, perform a security assessment on the video interview based on the first interview video to obtain an assessment result.

[0022] Determine whether manual verification is required based on the evaluation results.

[0023] By adopting the above technical solution, the driver's current first state is first determined based on the first face frame, and then audio information is extracted from the first face-to-face video, and the driver's current second state is determined based on the audio information, and then it is determined whether the first state and the second state are consistent. If the first state and the second state are inconsistent, a security assessment is performed on the video face-to-face based on the first face-to-face video to obtain an assessment result, and finally it is determined whether manual verification is required based on the assessment result. In the above manner, it is confirmed whether the driver conducts the face-to-face interview out of personal willingness, thereby improving the reliability and authenticity of the face-to-face interview result.

[0024] Optionally, performing a security assessment on the video interview according to the first interview video to obtain an assessment result specifically includes:

[0025] Determine evaluation parameters based on the first interview video; the evaluation parameters include the quantity of dangerous goods, the type of dangerous goods, the type of interview location, and the interview time;

[0026] The evaluation parameters are input into a preset evaluation model to obtain an evaluation result of the video interview.

[0027] By adopting the above technical solution, in order to obtain more accurate and reliable evaluation results, the evaluation parameters are first determined based on the first face-to-face video, and then the evaluation parameters are input into a preset evaluation model to obtain the evaluation results of the video face-to-face.

[0028] Optionally, determining whether both the driver and the collaborator have performed an interview operation corresponding to the interview instruction according to the second interview video and the interview instruction specifically includes:

[0029] Extracting a second image frame from the second face-to-face video at the preset time interval;

[0030] Detecting whether there is a human face in the second image frame, and using the second image frame in which the human face exists as a second face frame;

[0031] Matching the face signature object information with the face identity information to determine the face image of the driver and the face image of the collaborator in the second face frame;

[0032] Based on the driver's facial image and the face-to-face signing instruction, determine whether the driver has performed the face-to-face signing operation corresponding to the face-to-face signing instruction; and based on the collaborator's facial image and the face-to-face signing instruction, determine whether the collaborator has performed the face-to-face signing operation corresponding to the face-to-face signing instruction.

[0033] By adopting the above technical solution, in order to determine whether the driver and the collaborator have both made the face-to-face signing operation corresponding to the face-to-face signing instruction, the second image frame is first extracted from the second face-to-face signing video at a preset time interval, and then it is detected whether there is a face in the second image frame, and the second image frame with the face is used as the second face frame, and then the face-to-face signing object information and the face identity information are matched to determine the driver's face image and the collaborator's face image in the second face frame, and then based on the driver's face image and the face-to-face signing instruction, it is judged whether the driver has made the face-to-face signing operation corresponding to the face-to-face signing instruction, and based on the collaborator's face image and the face-to-face signing instruction, it is judged whether the collaborator has made the face-to-face signing operation corresponding to the face-to-face signing instruction.

[0034] Optionally, after sending the driver's video face-to-face signing success information to the terminal, the method further includes:

[0035] Binding the first interview video, the second interview video and the interview object information, and generating interview review information;

[0036] The face-to-face verification information is saved.

[0037] By adopting the above technical solution, in order to facilitate the subsequent review of the relevant information of the face-to-face interview, the first face-to-face interview video, the second face-to-face interview video and the face-to-face interview object information are bound, and the face-to-face interview review information is generated, and then the face-to-face interview review information is saved; when the relevant information of the face-to-face interview needs to be sorted and reviewed, the relevant information can be viewed quickly and accurately, thereby facilitating related processing.

[0038] Optionally, obtaining the video interview request, determining the interview object according to the video interview request and generating the interview object information specifically includes:

[0039] Obtaining a video face-to-face interview request, and generating face-to-face interview form information in a user interface according to the video face-to-face interview request; the driver and / or the collaborator fills in the face-to-face interview form information, and generates face-to-face interview information through a face-to-face interview input control;

[0040] Determine whether there is a collaborator in the video face-to-face interview according to the face-to-face interview information. If so, determine the face-to-face interview object according to the face-to-face interview information, and extract the face-to-face interview object information from the face-to-face interview information.

[0041] By adopting the above technical solution, a video interview request is first obtained, and the interview form information is generated in the user interface according to the video interview request. Then the driver and / or collaborator will fill in the interview form information on the terminal, and generate the interview information through the interview input control. Then, it is determined whether there is a collaborator in the video interview based on the interview information. If there is a collaborator in the video interview, the interview object is determined based on the interview information, and the interview object information is extracted from the interview information.

[0042] In the second aspect, the present application also provides a driver video face-to-face signing system, which adopts the following technical solution:

[0043] A driver video face-to-face signing system, comprising:

[0044] An interview object information generation module is used to obtain a video interview request, determine an interview object according to the video interview request, and generate interview object information; the interview object includes the driver and the collaborator;

[0045] An interview instruction generation module is used to collect the first interview video in real time, and determine whether only the driver and the collaborator exist in the first interview video according to the interview object information, and if so, generate an interview instruction;

[0046] An interview operation judgment module is used to collect the second interview video in real time, and determine whether the driver and the collaborator have both performed the interview operation corresponding to the interview instruction according to the second interview video and the interview instruction;

[0047] The face-to-face signing success information generation module is used to send the driver's video face-to-face signing success information to the terminal when the driver and the collaborator both perform the face-to-face signing operation corresponding to the face-to-face signing instruction.

[0048] In a third aspect, the present application also provides a computer device, which adopts the following technical solution:

[0049] A computer device comprises a memory and a processor, wherein the memory stores a computer program executable on the processor, and the processor executes any one of the above methods when executing the computer program.

[0050] In a fourth aspect, the present application further provides a computer-readable storage medium, which adopts the following technical solution:

[0051] A computer-readable storage medium stores a computer program that can be loaded by a processor and execute any of the above methods.

[0052] In summary, the present application includes at least the following beneficial technical effects: when conducting a video face-to-face interview, first obtain a video face-to-face interview request, then determine the face-to-face interview object and generate face-to-face interview object information according to the video face-to-face interview request, then collect the first face-to-face interview video in real time, and determine whether only the driver and the collaborator exist in the first face-to-face interview video at the same time according to the face-to-face interview object information, if the driver and the collaborator exist in the first face-to-face interview video at the same time, then generate a face-to-face interview instruction; then collect the second face-to-face interview video in real time, and determine whether the driver and the collaborator both make the face-to-face interview operation corresponding to the face-to-face interview instruction according to the second face-to-face interview video and the face-to-face interview instruction, if the driver and the collaborator both make the face-to-face interview operation corresponding to the face-to-face interview instruction, then send the driver's video face-to-face interview success information to the terminal. In the above method, the collaborator will guide the driver to conduct a video face-to-face interview, and the driver and the collaborator need to appear in the camera at the same time. The driver only needs to follow the collaborator under the guidance of the collaborator to perform the same face-to-face interview operation, and the face-to-face interview can be successful. Compared with the single face-to-face interview method in the background technology, the flexibility of the video face-to-face interview is improved, the form of the video face-to-face interview is enriched, and it is convenient for others to help the driver to perform the face-to-face interview operation, thereby improving the driver's experience in the video face-to-face interview. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the specific embodiments of the present application or the technical solutions in the prior art, the following is a brief introduction to the drawings required for the specific embodiments or the prior art description. In all drawings, similar elements or parts are generally identified by similar reference numerals. In the drawings, the elements or parts are not necessarily drawn according to the actual scale.

[0054] Figure 1 It is a schematic diagram of the overall process of an embodiment of the present application.

[0055] Figure 2 It is a schematic diagram of the structure of the system of the embodiment of the present application.

[0056] Figure 3 It is a structural block diagram of a computer device according to an embodiment of the present application.

[0057] Description of the drawings: 21. Interview object information generation module; 22. Interview instruction generation module; 23. Interview video storage module; 24. Video interview success information generation module; 31. Memory; 32. Processor.

[0058] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0059] In order to enable those skilled in the art to better understand the scheme of the present disclosure, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without creative work should fall within the scope of protection of the present disclosure.

[0060] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0061] Example 1

[0062] The embodiment of the present application discloses a method for driver video interview.

[0063] Reference Figure 1 , a driver video interview method, comprising the following steps:

[0064] Step S11, obtaining a video interview request, determining an interview object according to the video interview request and generating interview object information.

[0065] Among them, the objects of face-to-face interview include drivers and collaborators, and the information of the objects of face-to-face interview includes driver information and collaborator information.

[0066] It can be understood that in the present application, the driver is the interviewer; the driver can have a video interview at a formal interview location such as the vehicle management office, or at an informal interview location such as indoors or in a car; the collaborator is a person who guides and helps the driver to conduct the video interview, and the collaborator can be the driver's friend or relative, or a staff member at the formal interview location; during the video interview, the driver and the collaborator are both in front of the terminal's camera.

[0067] It should be noted that the driver information includes the driver's basic information, such as the driver's name, ID number, gender and other information; the collaborator information includes the collaborator's name, ID number, specific relationship with the driver and other information; if the collaborator is an on-site staff member, the collaborator information includes the staff member's name, ID number, work number, job position, work department and other information.

[0068] Step S12, collect the first face-to-face video in real time, and determine whether only the driver and the collaborator exist in the first face-to-face video according to the face-to-face object information. If so, generate a face-to-face instruction.

[0069] Specifically, the first interview video is collected in real time, and it is determined based on the interview object information whether only the driver and the collaborator exist in the first interview video at the same time. If only the driver and the collaborator exist in the first interview video at the same time, an interview instruction is generated. If there is a third person other than the driver and the collaborator in the first interview video, a number reminder information is generated.

[0070] It should be noted that, in the present application, the face-to-face signing instructions include one or more of the following related instructions: opening mouth instructions, shaking head instructions, blinking instructions, questioning instructions, etc.

[0071] It is understandable that when there is a third person other than the driver and the collaborator in the face-to-face video, it will affect the safety of subsequent face-to-face operations. At this time, a reminder of the number of people will be generated, for example, "There is a third person within the camera range" will be displayed on the terminal display page.

[0072] Step S13, collect the second face-to-face interview video in real time, and determine whether the driver and the collaborator have both performed the face-to-face interview operation corresponding to the face-to-face interview instruction based on the second face-to-face interview video and the face-to-face interview instruction.

[0073] Specifically, it is determined based on the second interview video whether the driver and the collaborator have both performed the interview operation corresponding to the interview instruction. If the driver and the collaborator have both performed the interview operation corresponding to the interview instruction, step S14 is executed. If at least one of the driver and the collaborator has not performed the interview operation corresponding to the interview instruction, an interview operation reminder message is generated.

[0074] It is understandable that the face-to-face signing operation reminder information is used to remind the driver and the collaborator to perform the face-to-face signing operation corresponding to the face-to-face signing instruction.

[0075] It should be noted that, in the present application, the face-to-face interview operation generally includes one or more operations such as opening the mouth, shaking the head, blinking, and answering questions.

[0076] Step S14: If yes, send the driver's video interview success information to the terminal.

[0077] In the above implementation, when performing a video face-to-face interview, first obtain a video face-to-face interview request, then determine the face-to-face interview object according to the video face-to-face interview request and generate face-to-face interview object information, then collect the first face-to-face interview video in real time, and determine whether only the driver and the collaborator exist in the first face-to-face interview video at the same time according to the face-to-face interview object information, if the driver and the collaborator exist in the first face-to-face interview video at the same time, then generate a face-to-face interview instruction; then collect the second face-to-face interview video in real time, and determine whether the driver and the collaborator have both made the face-to-face interview operation corresponding to the face-to-face interview instruction according to the second face-to-face interview video and the face-to-face interview instruction, if the driver and the collaborator have both made the face-to-face interview operation corresponding to the face-to-face interview instruction, then send the driver's video face-to-face interview success information to the terminal. In the above method, the collaborator will guide the driver to perform a video face-to-face interview, and the driver and the collaborator need to appear in the camera at the same time. The driver only needs to follow the collaborator under the guidance of the collaborator to perform the same face-to-face interview operation, and the face-to-face interview can be successful. Compared with the single face-to-face interview method in the background technology, the flexibility of the video face-to-face interview is improved, the form of the video face-to-face interview is enriched, and it is convenient for others to help the driver perform the face-to-face interview operation, thereby improving the driver's experience in the video face-to-face interview.

[0078] As a further implementation of the driver video interview method, determining whether only the driver and the collaborator exist in the first interview video at the same time according to the interview object information specifically includes the following steps:

[0079] Step S21: extracting a first image frame from a first face-to-face signing video according to a preset time interval.

[0080] It can be understood that there are usually multiple first image frames.

[0081] Step S22, detecting whether there is a human face in the first image frame, and taking the image frame with the human face as the first face frame.

[0082] It is understandable that the first face frame may be one or more frames.

[0083] Step S23, determining whether there are two faces in the first face frame, and if so, performing similarity matching on the faces in the first face frame in a preset face database to obtain corresponding face identity information.

[0084] Specifically, it is determined whether there are two faces in the first face frame. When there are two faces in the first face frame, similarity matching is performed on the faces in the first face frame in a preset face database to obtain corresponding face identity information.

[0085] It should be noted that the preset face database includes face images and face identity information corresponding to the face images.

[0086] Step S24, comparing the face-to-face interview object information and the face identity information to determine whether only the driver and the collaborator exist at the same time.

[0087] In the above embodiment, in order to determine whether only the driver and the collaborator exist in the first face-to-face video at the same time, the first image frame is first extracted from the first face-to-face video according to a preset time interval, and then it is detected whether there is a face in the first image frame, and the image frame with the face is used as the first face frame. Then, it is determined whether there are two faces in the first face frame. If there are two faces in the first face frame, the faces in the first face frame are similarly matched in a preset face database to obtain corresponding face identity information. Finally, the face-to-face object information and the face identity information are compared to determine whether only the driver and the collaborator exist at the same time.

[0088] As a further implementation of the driver video face-to-face signing method, after extracting the face frame from the face-to-face signing video, the following steps are also included:

[0089] Step S31, determining the current first state of the driver according to the first face frame.

[0090] It should be noted that the driver's current first state includes the driver's facial emotional state and the driver's first mental state. The driver's facial emotions include nervousness, happiness, sadness, fear, etc., and the driver's first mental state includes tiredness, vitality, anxiety, etc.

[0091] Step S32: extracting audio information from the first interview video, and determining the driver's current second state based on the audio information.

[0092] It should be noted that the driver's current second state includes the driver's audio emotional state and the driver's second mental state. The driver's facial emotions include nervousness, happiness, sadness, fear, etc., and the driver's second mental state includes tiredness, vitality, anxiety, etc.

[0093] Step S33, determining whether the first state and the second state are consistent, if not, performing a security assessment on the video interview based on the first interview video to obtain an assessment result.

[0094] Specifically, determine whether the driver's facial emotional state and the driver's audio emotional state are consistent, and determine whether the driver's first mental state and the driver's second mental state are consistent; if they are consistent, generate a safety reminder message; otherwise, perform a safety assessment of the video interview based on the first interview video to obtain an assessment result.

[0095] It is understandable that the security reminder information is used to indicate that the video interview is in normal status, which means that the risk of this video interview is low.

[0096] Step S34, determining whether manual verification is required based on the evaluation result.

[0097] It should be noted that the driver may be forced to conduct the video interview according to the wishes of the collaborator. Therefore, it is necessary to determine whether the driver is conducting the video interview out of personal will by judging whether the driver's first state and second state are consistent, thereby improving the reliability and security of the video interview.

[0098] In the above implementation, the driver's current first state is first determined based on the first face frame, and then audio information is extracted from the first interview video, and the driver's current second state is determined based on the audio information, and then it is determined whether the first state and the second state are consistent. If the first state and the second state are inconsistent, a security assessment is performed on the video interview based on the first interview video to obtain an assessment result, and finally it is determined whether manual verification is required based on the assessment result. The above method is used to confirm whether the driver conducts the interview out of personal willingness, thereby improving the reliability and authenticity of the interview result.

[0099] As a further implementation of the driver video interview method, a safety assessment is performed on the video interview according to the first interview video to obtain an assessment result, which specifically includes the following steps:

[0100] Step S41, determining evaluation parameters according to the first interview video.

[0101] Among them, the evaluation parameters include the quantity of dangerous goods, the type of dangerous goods, the type of interview location and the time of the interview.

[0102] It should be noted that the types of dangerous goods include knives, repair tools, sticks, etc., and the types of interview locations include urban areas, suburbs, indoors, etc.

[0103] Step S42: input the evaluation parameters into a preset evaluation model to obtain an evaluation result of the video interview.

[0104] It should be noted that the preset evaluation models include:

[0105] Fa=x_1y_1+x_2y_2+x_3y_3+x_4y_4

[0106] Among them, Fa is used to represent the evaluation value of the evaluation result, y1 represents the first parameter value corresponding to the quantity of dangerous goods, y2 represents the second parameter value corresponding to the type of dangerous goods, y3 represents the third parameter value corresponding to the type of interview location, and y4 represents the fourth parameter value corresponding to the interview time; x1, x2, x3, and x4 represent the corresponding weights respectively. x1, x2, x3, and x4 can be set according to actual conditions. For example, x1, x2, x3, and x4 are all set to 0.25.

[0107] In the above implementation, in order to obtain a more accurate and reliable evaluation result, the evaluation parameters are first determined based on the first face-to-face interview video, and then the evaluation parameters are input into a preset evaluation model to obtain the evaluation result of the video face-to-face interview.

[0108] As a further implementation of the driver video interview method, determining whether the driver and the collaborator have both performed the interview operation corresponding to the interview instruction according to the second interview video and the interview instruction specifically includes the following steps:

[0109] Step S51: extracting a second image frame from the second face-to-face video at a preset time interval.

[0110] It can be understood that the second image frame usually consists of multiple images.

[0111] Step S52, detecting whether there is a face in the second image frame, and taking the second image frame with the face as the second face frame.

[0112] It is understandable that the second face frame may be one or more frames.

[0113] Step S53, matching the face signature object information with the face identity information, and determining the face image of the driver and the face image of the collaborator in the second face frame.

[0114] It can be understood that the second facial frame includes the driver's facial image and the collaborator's facial image. Through the above steps, it is possible to determine which facial image of the driver and which facial image of the collaborator in the second facial frame is used.

[0115] Step S54, judging whether the driver has performed the face-to-face signing operation corresponding to the face-to-face signing instruction based on the driver's facial image and the face-to-face signing instruction, and judging whether the collaborator has performed the face-to-face signing operation corresponding to the face-to-face signing instruction based on the collaborator's facial image and the face-to-face signing instruction.

[0116] In the above embodiment, in order to determine whether the driver and the collaborator have both performed the face-to-face signing operation corresponding to the face-to-face signing instruction, the second image frame is first extracted from the second face-to-face signing video at a preset time interval, and then it is detected whether there is a face in the second image frame, and the second image frame with the face is used as the second face frame, and then the face signing object information and the face identity information are matched to determine the driver's face image and the collaborator's face image in the second face frame, and then based on the driver's face image and the face signing instruction, it is judged whether the driver has performed the face signing operation corresponding to the face signing instruction, and based on the collaborator's face image and the face signing instruction, it is judged whether the collaborator has performed the face signing operation corresponding to the face signing instruction.

[0117] As a further implementation of the driver video face-to-face signing method, after sending the driver video face-to-face signing success information to the terminal, the following steps are also included:

[0118] Step S61: Bind the first face-to-face interview video, the second face-to-face interview video and the face-to-face interview object information, and generate face-to-face interview verification information.

[0119] Step S62, save the face-to-face verification information.

[0120] In the above implementation, in order to facilitate the subsequent review of the relevant information of the face-to-face interview, the first face-to-face interview video, the second face-to-face interview video and the face-to-face interview object information are bound, and the face-to-face interview review information is generated, and then the face-to-face interview review information is saved; when the relevant information of the face-to-face interview needs to be sorted and reviewed, the relevant information can be viewed quickly and accurately, thereby facilitating related processing.

[0121] As a further implementation method of the driver video interview method, obtaining a video interview request, determining an interview object according to the video interview request and generating interview object information specifically includes the following steps:

[0122] Step S71, obtain a video interview request, and generate interview form information in the user interface according to the video interview request; the driver and / or collaborator fills in the interview form information, and generates interview information through the interview input control.

[0123] Step S72, determining whether there is a collaborator in the video interview based on the interview information, and if so, determining the interview object based on the interview information, and extracting the interview object information from the interview information.

[0124] It can be understood that the face-to-face interview information includes driver information, collaborator information, interview time and other information; in addition, when there is no collaborator in the video interview, the interview object is the driver, and the interview object information is the driver's information.

[0125] In the above embodiment, a video interview request is first obtained, and interview form information is generated in the user interface according to the video interview request. Then the driver and / or collaborator fills in the interview form information on the terminal, and generates interview information through the interview input control. Then, it is determined whether there is a collaborator for the video interview based on the interview information. If there is a collaborator for the video interview, the interview object is determined based on the interview information, and the interview object information is extracted from the interview information.

[0126] The embodiment of the present application also discloses a driver video interview system.

[0127] refer to Figure 2 , a driver video face-to-face signing system, comprising:

[0128] The face-to-face interview object information generation module 21 is used to obtain a video face-to-face interview request, determine the face-to-face interview object according to the video face-to-face interview request, and generate face-to-face interview object information; the face-to-face interview object includes the driver and the collaborator;

[0129] The face-to-face signing instruction generating module 22 is used to collect the first face-to-face signing video in real time, and determine whether only the driver and the collaborator exist in the first face-to-face signing video according to the face-to-face signing object information, and if so, generate a face-to-face signing instruction;

[0130] The face-to-face signing operation judgment module 23 is used to collect the second face-to-face signing video in real time, and determine whether the driver and the collaborator have both performed the face-to-face signing operation corresponding to the face-to-face signing instruction according to the second face-to-face signing video and the face-to-face signing instruction;

[0131] The face-to-face signing success information generating module 24 is used to send the driver's video face-to-face signing success information to the terminal when the driver and the collaborator both perform the face-to-face signing operation corresponding to the face-to-face signing instruction.

[0132] The driver video interview system of the present invention can implement any one of the driver video interview methods, and the specific working process of the driver video interview system of the present invention can refer to the corresponding process in the above-mentioned driver video interview method.

[0133] The embodiment of the present application also discloses a computer device.

[0134] refer to Figure 3 A computer device includes a memory 31 and a processor 32. The memory 31 stores a computer program that can be run on the processor 32. When the processor 32 executes the computer program, any one of the above-mentioned driver video face-to-face signing system methods is implemented.

[0135] The embodiment of the present application also discloses a computer-readable storage medium.

[0136] A computer-readable storage medium stores a computer program that can be loaded by a processor and execute any of the above-mentioned driver video face-to-face signing system methods.

[0137] In some embodiments, the computer readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or various devices including one or any combination of the above memories. The computer may be various computing devices including intelligent terminals and servers.

[0138] In the above embodiments of the present disclosure, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0139] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0140] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed over multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0141] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0142] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable non-volatile storage medium. Based on this understanding, the technical solution of the present disclosure is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a non-volatile storage medium, including a number of instructions to enable a device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the various embodiments of the present disclosure. The aforementioned non-volatile storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0143] The above are only preferred embodiments of the present disclosure. It should be pointed out that, for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present disclosure. These improvements and modifications should also be regarded as the protection scope of the present disclosure.

Claims

1. A driver video interview method, characterized in that: include: Obtain a video interview request, determine an interview object according to the video interview request, and generate interview object information; The interview subjects include the driver and the collaborator; Collect the first face-to-face video in real time, and determine whether only the driver and the collaborator exist in the first face-to-face video according to the face-to-face object information, and if so, generate a face-to-face instruction; Collecting a second face-to-face interview video in real time, and determining whether the driver and the collaborator have both performed face-to-face interview operations corresponding to the face-to-face interview instruction according to the second face-to-face interview video and the face-to-face interview instruction; If yes, a successful video interview message of the driver is sent to the terminal; The obtaining of the video face-to-face interview request, determining the face-to-face interview object according to the video face-to-face interview request and generating face-to-face interview object information specifically includes: Obtaining a video face-to-face interview request, and generating face-to-face interview form information in a user interface according to the video face-to-face interview request; the driver and / or the collaborator fills in the face-to-face interview form information, and generates face-to-face interview information through a face-to-face interview input control; Determine whether there is a collaborator in the video face-to-face interview according to the face-to-face interview information. If so, determine the face-to-face interview object according to the face-to-face interview information, and extract the face-to-face interview object information from the face-to-face interview information.

2. A driver video interview method according to claim 1, characterized in that: The determining, according to the face-to-face interview object information, whether only the driver and the collaborator exist in the first face-to-face interview video at the same time specifically includes: Extracting a first image frame from the first face-to-face video according to a preset time interval; Detecting whether there is a human face in the first image frame, and taking the image frame in which the human face exists as a first face frame; Determine whether there are two faces in the first face frame, and if so, perform similarity matching on the faces in the first face frame in a preset face database to obtain corresponding face identity information; The face-to-face signing object information and the face identity information are compared to determine whether only the driver and the collaborator exist at the same time.

3. A driver video interview method according to claim 2, characterized in that: After detecting whether there is a face in the first image frame and taking the image frame with the face as the first face frame, the method further includes: Determining a first current state of the driver according to the first face frame; Extracting audio information from the first interview video, and determining the current second state of the driver according to the audio information; Determine whether the first state and the second state are consistent. If not, perform a security assessment on the video interview based on the first interview video to obtain an assessment result. Determine whether manual verification is required based on the evaluation results.

4. A driver video interview method according to claim 3, characterized in that: The step of performing a security assessment on the video interview according to the first interview video to obtain an assessment result specifically includes: Determine evaluation parameters based on the first interview video; the evaluation parameters include the quantity of dangerous goods, the type of dangerous goods, the type of interview location, and the interview time; The evaluation parameters are input into a preset evaluation model to obtain an evaluation result of the video interview.

5. A driver video interview method according to claim 2, characterized in that: The determining, according to the second face-to-face interview video and the face-to-face interview instruction, whether both the driver and the collaborator have performed the face-to-face interview operation corresponding to the face-to-face interview instruction specifically includes: Extracting a second image frame from the second face-to-face video at the preset time interval; Detecting whether there is a human face in the second image frame, and using the second image frame in which the human face exists as a second face frame; Matching the face signature object information with the face identity information to determine the face image of the driver and the face image of the collaborator in the second face frame; Based on the driver's facial image and the face-to-face signing instruction, determine whether the driver has performed the face-to-face signing operation corresponding to the face-to-face signing instruction; and based on the collaborator's facial image and the face-to-face signing instruction, determine whether the collaborator has performed the face-to-face signing operation corresponding to the face-to-face signing instruction.

6. A driver video interview method according to claim 1, characterized in that: After the driver's video face-to-face signing success information is sent to the terminal, the method further includes: Binding the first interview video, the second interview video and the interview object information, and generating interview review information; The face-to-face verification information is saved.

7. A driver video interview system, characterized in that: include: A face-to-face interview object information generation module (21), used for obtaining a video face-to-face interview request, determining a face-to-face interview object according to the video face-to-face interview request and generating face-to-face interview object information; The interview subjects include the driver and the collaborator; A face-to-face signing instruction generating module (22) is used to collect the first face-to-face signing video in real time, and determine whether only the driver and the collaborator exist in the first face-to-face signing video according to the face-to-face signing object information, and if so, generate a face-to-face signing instruction; An interview operation determination module (23) is used to collect a second interview video in real time, and determine whether the driver and the collaborator have both performed an interview operation corresponding to the interview instruction according to the second interview video and the interview instruction; A face-to-face signing success information generating module (24) is used to send the driver's video face-to-face signing success information to the terminal when the driver and the collaborator both perform the face-to-face signing operation corresponding to the face-to-face signing instruction; The obtaining of the video face-to-face interview request, determining the face-to-face interview object according to the video face-to-face interview request and generating face-to-face interview object information specifically includes: Obtaining a video face-to-face interview request, and generating face-to-face interview form information in a user interface according to the video face-to-face interview request; the driver and / or the collaborator fills in the face-to-face interview form information, and generates face-to-face interview information through a face-to-face interview input control; Determine whether there is a collaborator in the video face-to-face interview according to the face-to-face interview information. If so, determine the face-to-face interview object according to the face-to-face interview information, and extract the face-to-face interview object information from the face-to-face interview information.

8. A computer device, characterized in that: The invention comprises a memory (31) and a processor (32), wherein the memory (31) stores a computer program executable on the processor (32), and the processor (32) implements the method according to any one of claims 1 to 6 when executing the computer program.

9. A computer-readable storage medium, characterized in that: A computer program is stored which can be loaded by a processor and execute the method according to any one of claims 1 to 6.

Images