A face sign process generation method and device, electronic equipment and storage medium

By using modular and unstructured data storage for face-to-face verification, the system enables intuitive configuration and automatic storage of the face-to-face verification process, solving the problems of complex configuration and lack of virtual customer service in existing technologies, and improving the efficiency and security of the face-to-face verification process.

CN116342057BActive Publication Date: 2026-04-21CHENGDU NEW HOPE FINANCIAL INFORMATION CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
CHENGDU NEW HOPE FINANCIAL INFORMATION CO LTD
Filing Date
2023-02-24
Publication Date
2026-04-21

AI Technical Summary

Technical Problem

The existing face-to-face visa application process configuration platform uses a complex page button configuration method, which is not intuitive for users and lacks support for virtual face-to-face visa customer service and face-to-face visa algorithms.

Method used

The process configuration is achieved through face-to-face signing components, which supports branch connection relationships and the generation of virtual customer service avatars. Combined with face-to-face signing algorithms, the risk of fraud is reduced, and configuration information is stored in unstructured data and automatically stored in the database.

Benefits of technology

The face-to-face signing process has been simplified, improving configuration efficiency and usability. It supports virtual customer service for face-to-face signing, reducing fraud risks and improving user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116342057B_ABST
    Figure CN116342057B_ABST
Patent Text Reader

Abstract

The application provides a process generation method and device, electronic equipment and storage medium. The method comprises the following steps: receiving a face signing component configured by a user for generating a face signing process, and a connection relationship of the face signing component; obtaining component configuration information corresponding to the face signing component and connection information corresponding to the connection relationship; and generating the face signing process according to the component configuration information and the connection information. The method for configuring the face signing process based on the flowchart simplifies the process of configuring the face signing process, the user can intuitively configure the process, and the efficiency of the face signing configuration is improved. Moreover, the face signing process can be configured with branch conditions, the face signing virtual customer service in the face signing process can be configured, and the face signing algorithm can be configured, so that a more perfect face signing configuration scheme is formed. The information of the face signing component is saved in the database in real time, and the safety and stability of the configuration process data are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of computer technology, and more specifically, to a method, apparatus, electronic device, and storage medium for generating an interview process. Background Technology

[0002] In-person verification refers to the procedure where users bring valid identification documents to banks or securities firms for an interview, signing, and stamping. Currently, in-person verification can be implemented through human or automated methods, each with its own specific process. Existing in-person verification configuration platforms use page buttons to configure the verification process, which is relatively complex and not intuitive for users. Summary of the Invention

[0003] The purpose of this invention is to provide a face-to-face interview process method, device, electronic device, and storage medium, which utilizes the modularization of face-to-face interview processes to configure the process, making the operation more convenient and allowing users to configure the process more intuitively.

[0004] In a first aspect, embodiments of this application provide a face-to-face verification process method, including: receiving a face-to-face verification component configured by a user for generating a face-to-face verification process, and the connection relationship of the face-to-face verification component; obtaining component configuration information corresponding to the face-to-face verification component and connection information corresponding to the connection relationship; and generating a face-to-face verification process based on the component configuration information and the connection information.

[0005] In the above implementation process, based on the user-configured interview components and their connection relationships, the system obtains the component configuration information for each interview component and the connection information for each connection relationship. Then, based on the component configuration information and connection information, it generates the interview process, implementing a flowchart-based method for interview process configuration. This simplifies the interview process configuration, allowing users to intuitively configure the process and improving the efficiency of interview configuration.

[0006] Optionally, in this embodiment of the application, the connection information includes connection condition information; obtaining the connection information corresponding to the connection relationship includes: if the connection relationship between the face-to-face signing components is a branch connection relationship, then obtaining the configuration conditions corresponding to each branch in the branch connection relationship; parsing the configuration conditions corresponding to each branch to obtain condition constants and condition variables; and obtaining connection condition information based on the condition constants and condition variables.

[0007] In the above implementation process, the face-to-face verification process supports branch condition configuration, meaning that the connection relationship between face-to-face verification components can include branch connection relationships. By configuring connection condition information, the business process can be controlled to proceed to the corresponding branch based on the calculation results of the user's corresponding conditions. This makes the operation convenient and improves the usability of the face-to-face verification process.

[0008] Optionally, in this embodiment of the application, obtaining the component configuration information corresponding to the face-to-face signing component includes: obtaining the original configuration information of the face-to-face signing component; the original configuration information is generated using unstructured data based on a pre-set face-to-face signing component definition; the original configuration information includes attribute configuration and page configuration; receiving user modifications to the original configuration information and generating component configuration information; and storing the component configuration information in a database.

[0009] In the above implementation process, the definition of the face-to-face signing component is represented and stored using unstructured data, allowing users to modify the configuration information of the face-to-face signing component according to their actual needs. Furthermore, the component configuration information is automatically stored in the database in real time during the face-to-face signing process configuration, mitigating the risk of data loss during the configuration process.

[0010] Optionally, in this embodiment of the application, receiving the face-to-face signing component configured by the user for generating the face-to-face signing process, and the connection relationship of the face-to-face signing component, includes: displaying the face-to-face signing component to be processed to the user; the face-to-face signing component to be processed includes the face-to-face signing component; receiving the face-to-face signing component selected by the user from the face-to-face signing component and dragged to the process configuration interface; and receiving the connection relationship between the face-to-face signing components configured by the user through the connection line.

[0011] In the above implementation process, the face-to-face interview process is configured in the process configuration interface in the form of a flowchart, which visualizes the face-to-face interview process configuration process and improves the efficiency and convenience of face-to-face interview process configuration.

[0012] Optionally, in this embodiment of the application, the method further includes: generating a virtual customer service image for the face-to-face signing process based on a preset virtual customer service image using a posture-driven algorithm; obtaining virtual customer service configuration parameters; the virtual customer service configuration parameters include the background image of the virtual customer service, the position parameters of the virtual customer service on the page, and the dialogue page parameters of the virtual customer service; generating a face-to-face signing virtual customer service based on the virtual customer service image and the virtual customer service configuration parameters; and obtaining a face-to-face signing configuration scheme based on the face-to-face signing process and the face-to-face signing virtual customer service.

[0013] In the above implementation process, by configuring the virtual customer service avatar and virtual customer service configuration parameters, a virtual customer service representative for the face-to-face interview process can be obtained, thus improving the current problem that the face-to-face interview process does not support configuring a virtual customer service representative.

[0014] Optionally, in this embodiment of the application, the method further includes: obtaining the face-to-face verification algorithm configuration parameters for each face-to-face verification algorithm, the face-to-face verification algorithm configuration parameters including algorithm detection frequency, failure identification conditions and algorithm threshold; the face-to-face verification algorithm is used to determine whether the face-to-face verification business is successful; and obtaining the face-to-face verification configuration scheme according to the face-to-face verification process and the face-to-face verification virtual customer service, including: obtaining the face-to-face verification configuration scheme according to the face-to-face verification process, the face-to-face verification virtual customer service and the face-to-face verification algorithm configuration parameters.

[0015] In the above implementation process, configuring the interview verification algorithm within the interview verification process reduces the risk of interview fraud; and users can set the configuration parameters for each interview verification algorithm to improve the success rate and user experience. By configuring the interview verification process, virtual customer service, and interview verification algorithm separately, a more comprehensive interview verification configuration solution is formed.

[0016] Optionally, in this embodiment of the application, after receiving the face-to-face signing component configured by the user for generating the face-to-face signing process, and the connection relationship of the face-to-face signing component, the method further includes: generating a corresponding component instance based on the face-to-face signing component, and generating a connection instance based on the connection relationship; storing the component instance and the connection instance in a database.

[0017] In the above implementation process, an instance of the face-signing component is generated based on the user's configuration and stored in the database. This automatically generated and stored instance can be modified in real time without requiring manual saving by the user. Furthermore, configuration information is not lost due to network outages or unexpected webpage closures, thus improving the security and stability of the configuration process data.

[0018] Secondly, embodiments of this application also provide a face-to-face interview process generation device, including: a receiving module, used to receive face-to-face interview components configured by a user for generating face-to-face interview processes, and connection relationships of the face-to-face interview components; an information acquisition module, used to acquire component configuration information corresponding to the face-to-face interview components and connection information corresponding to the connection relationships; and a process generation module, used to generate face-to-face interview processes based on the component configuration information and connection information.

[0019] Thirdly, embodiments of this application also provide an electronic device, including: a processor and a memory, the memory storing machine-readable instructions executable by the processor, which, when executed by the processor, perform the method described above.

[0020] Fourthly, embodiments of this application also provide a computer-readable storage medium storing a computer program that, when executed by a processor, performs the methods described above.

[0021] This application provides a method, apparatus, electronic device, and storage medium for generating face-to-face interview processes. Through user-configured face-to-face interview components and their interconnections, a face-to-face interview process is generated, enabling flowchart-based configuration. This simplifies the process, allowing users to intuitively configure the process and improving efficiency. It also supports configuring virtual customer service representatives and algorithms within the interview process, resulting in a more comprehensive interview configuration solution. Attached Figure Description

[0022] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 A flowchart illustrating a face-to-face interview process generation method provided in this application embodiment;

[0024] Figure 2 The diagram shown is a schematic representation of the face-to-face verification component provided in an embodiment of this application.

[0025] Figure 3 The diagram shown illustrates the attribute configuration of the question-and-answer component provided in an embodiment of this application.

[0026] Figure 4 The illustration shows a page configuration diagram of the question-and-answer component provided in an embodiment of this application;

[0027] Figure 5 The diagram shown is a schematic flowchart of the configuration of the face-to-face signing component provided in an embodiment of this application;

[0028] Figure 6 The diagram shown is a configuration diagram of the virtual customer service avatar provided in the embodiment of this application;

[0029] Figure 7 The diagram shown illustrates the configuration of the face-to-face verification algorithm provided in this application embodiment.

[0030] Figure 8 This is a schematic diagram of the structure of the face-to-face interview process generation device provided in the embodiments of this application;

[0031] Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0032] The embodiments of the technical solution of this application will now be described in detail with reference to the accompanying drawings. These embodiments are only used to more clearly illustrate the technical solution of this application and are therefore merely examples, and should not be used to limit the scope of protection of this application.

[0033] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs; the terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this application.

[0034] In the description of the embodiments of this application, technical terms such as "first" and "second" are used only to distinguish different objects and should not be construed as indicating or implying relative importance or implicitly specifying the number, specific order, or primary and secondary relationship of the indicated technical features. In the description of the embodiments of this application, "multiple" means two or more, unless otherwise explicitly defined.

[0035] Please see Figure 1 The illustration shows a flowchart of a face-to-face interview process method provided in an embodiment of this application. The face-to-face interview process method provided in this embodiment can be applied to electronic devices, which can install a face-to-face interview process configuration system. This configuration system receives face-to-face interview process configuration operations from users. The electronic device may include a terminal and a server; specifically, the terminal may be a smartphone, tablet computer, computer, personal digital assistant (PDA), etc.; the server may be an application server or a web server. The face-to-face interview process method may include the following steps:

[0036] Step S110: The electronic device receives the face-to-face component configured by the user for generating the face-to-face process, as well as the connection relationship of the face-to-face component.

[0037] Step S120: The electronic device obtains the component configuration information corresponding to the face-to-face signing component and the connection information corresponding to the connection relationship.

[0038] Step S130: The electronic device generates the face-to-face verification process based on the component configuration information and connection information.

[0039] In step S110, the interview process may differ between organizations. The electronic device can display all available interview components for configuring the interview process on a screen. An interview component can represent a step or node in the interview process. The user selects the appropriate interview component from all configurable components based on actual business needs, and determines the connection relationships between the components by configuring connecting lines according to certain business logic. The connection relationships between the interview components represent the execution order of each step in the interview process.

[0040] For example, the face-to-face signing components received from the user include a question-and-answer component, a signature component, and a contract component; the question-and-answer component is followed by the signature component, and the signature component is followed by the contract component. This face-to-face signing process can be such that, after the question-and-answer process corresponding to the question-and-answer component is completed, the signature process corresponding to the signature component is performed; and after the signature process corresponding to the signature component is completed, the contract process corresponding to the contract component is performed.

[0041] In step S120, the component configuration information corresponding to the face-to-face signing component can be parameter configuration information stored in unstructured data based on a pre-set face-to-face signing component definition. A face-to-face signing component is defined as the configuration items that each component can implement. Unstructured data includes JSON format data. That is, the parameter configuration information of each component is stored in a JSON structure, and when the user selects the face-to-face signing component, the corresponding parameter configuration information is directly retrieved.

[0042] As one implementation method, component configuration information can also be obtained by the user modifying the original configuration information of the signature component. For example, the original configuration information of each component can be stored in advance using a JSON structure. After selecting the signature component, the user can modify it based on the original configuration information to obtain component configuration information that meets business requirements. The original configuration information includes attribute configuration information and page configuration information, etc.

[0043] The connection information corresponds to the connection relationship, that is, the connection information between the face-to-face signing components configured by the user. The connection information may include a unique connection identifier, the source component, the destination component, and connection condition information. Among them, the connection condition is an optional attribute, that is, the connection between face-to-face signing components may or may not include connection condition information.

[0044] In step S130, an interview process is generated based on the component configuration information corresponding to each interview component selected by the user and the connection information between the interview components. The interview process is presented in the form of a flowchart in the process configuration interface.

[0045] In the above implementation process, based on the user-configured interview components and their connection relationships, the system obtains the component configuration information for each interview component and the connection information for each connection relationship. Then, based on the component configuration information and connection information, it generates the interview process, implementing a flowchart-based method for interview process configuration. This simplifies the interview process configuration, allowing users to intuitively configure the process and improving the efficiency of interview configuration.

[0046] Please see Figure 2 The diagram shows a face-to-face verification component provided in an embodiment of this application.

[0047] In an optional embodiment, the face-to-face signing component may include a question-and-answer component, a customer service representative speaking component, a terms and conditions confirmation component, a document confirmation component, a signature component, and a waiting component. Each face-to-face signing component may include attribute configuration and page configuration. The attribute configuration and page configuration of each face-to-face signing component may be stored separately using JSON structured data.

[0048] Please see Figure 3 The diagram shows the attribute configuration of the question-and-answer component provided in the embodiment of this application.

[0049] The definition of a face-to-face verification component, for example, includes a question-and-answer component that can include attribute configuration and page configuration. Attribute configuration includes the question, question source, answer method, answer time, pass / fail answer, rejection answer, number of retries, retry question, and retry question source. The question is the configuration for the question the verification robot will ask the customer, such as, "Are you XX?" The question source is the method by which the verification robot or virtual human plays the question to the customer, such as synthesized speech or uploaded recorded speech. The answer method refers to whether the customer answers verbally or using body language. The answer time is the configuration for the duration of the customer's answer. A pass / fail answer means that if the customer's answer matches the preset pass / fail keyword, it indicates that the user's intent is affirmative. A rejection answer means that if the customer's answer matches the preset rejection keyword, it indicates that the user's intent is rejection. The number of retries refers to the number of times the customer can answer the question; for example, if the customer answers a question incorrectly, they can answer it a preset number of times. Retrying a question means that if a question is too long and causes the customer to fail to answer it during the interview, the question can be rephrased in a more concise way and asked again to improve the customer experience. The source of the repeated question is the audio played to the user during the retry; this can be either synthesized or recorded audio.

[0050] Please see Figure 4 The diagram shows a page configuration diagram of the question-and-answer component provided in an embodiment of this application.

[0051] Page configuration can include page area, whether the answer is displayed, background color, and hint text. Page area refers to the location where the answer is displayed, i.e., the hint area shown to the interviewee. Whether to display the answer is optional. Background color refers to the background color when the answer is displayed. Hint text refers to the content of the suggested answer and how it is displayed, such as font size, alignment, and rounded corners.

[0052] The customer service chat component includes attribute configurations, which can include settings such as chat content and chat source. Chat content can be configured as declarative statements, requiring no user response. The chat source can be configured as a chatbot or a human customer service representative, and the source of the broadcast voice can also be configured, such as real-time synthesized voice or pre-uploaded recorded voice.

[0053] The terms and conditions confirmation component includes attribute configuration. These configurations can include pop-up title, confirmation button text, terms content, and timeout period. The pop-up title configures the title displayed on the client side. The confirmation button text confirms the terms, and the terms content includes the displayed text, color, font, and font display style. The timeout period is the maximum time a user can spend reading the terms.

[0054] The document confirmation component includes attribute configuration. These attributes can include document source, parameter name, confirmation button text, timeout, document file, and signature location. Document source specifies whether the document is uploaded locally or retrieved via an API. Document file refers to the specific file, such as a contract. Document signature refers to selecting the signature location on the document. Confirmation button text refers to the text displayed on the confirmation button. Timeout refers to the time allotted for signing and reading the document.

[0055] The signature component includes attribute configuration. The signature component's attribute configuration can include a timeout setting, which configures the time allotted for the user to sign.

[0056] The waiting component includes attribute configuration, which can include waiting duration configuration. This is used to determine whether a pause is needed after a dialogue ends when a user interacts with a real or virtual person. By setting an appropriate waiting duration, the user experience can be improved.

[0057] Understandably, corresponding page attributes can also be set for customer service speaking components, terms confirmation components, document confirmation components, signature components, and waiting components to configure the page areas corresponding to each component and achieve personalized customization of the page for each process.

[0058] Optionally, in this embodiment of the application, the connection information includes connection condition information; obtaining the connection information corresponding to the connection relationship includes: if the connection relationship between the face-to-face signing components is a branch connection relationship, then obtaining the configuration conditions corresponding to each branch in the branch connection relationship; parsing the configuration conditions corresponding to each branch to obtain condition constants and condition variables; and obtaining connection condition information based on the condition constants and condition variables.

[0059] In the specific implementation process: if a face-checking component acts as a source component and connects to two or more destination components via connecting lines, the connection relationship between the face-checking components is considered a branch connection relationship. Each branch typically corresponds to different configuration conditions. For example, the configuration condition for the first branch is that the age is greater than a threshold, while the configuration condition for the second branch is that the age is not greater than a threshold.

[0060] The configuration conditions for each branch are parsed to obtain the condition constants and condition variables. The condition constants can be user attribute information, and the condition variables can be the numerical values ​​corresponding to each attribute. Based on these constants and variables, the connection condition information is obtained. After obtaining the user information, the user input information is calculated according to the connection conditions of each branch to obtain the condition calculation results. Based on the user's corresponding condition calculation results, the business process is controlled to proceed to the corresponding branch.

[0061] Specifically, for example, user input information can be obtained, parsed, and used to obtain user input constants and variables. The variable values ​​are then matched and calculated with the connection conditions of each branch to determine the user's flow branches. These flow branches represent the branching paths of the interview process within the corresponding connection relationships. As one implementation method, a voice parser can be established using DSL (Digital Subscriber Line). This parser collects and parses the user's voice input, such as "My age is 35 years old." The parsed user input constant is "age," and the user input variable is "35 years old." The user input variable is then calculated with the connection conditions of each branch. If the user's age satisfies the second branch, then the second branch is taken as the user's flow branch.

[0062] In the above implementation process, the face-to-face verification process supports branch condition configuration, meaning that the connection relationship between face-to-face verification components can include branch connection relationships. By configuring connection condition information, the business process can be controlled to proceed to the corresponding branch based on the calculation results of the user's corresponding conditions. This makes the operation convenient and improves the usability of the face-to-face verification process.

[0063] Optionally, in this embodiment of the application, obtaining the component configuration information corresponding to the face-to-face signing component includes: obtaining the original configuration information of the face-to-face signing component; the original configuration information is generated using unstructured data based on a pre-set face-to-face signing component definition; the original configuration information includes attribute configuration and page configuration; receiving user modifications to the original configuration information and generating component configuration information; and storing the component configuration information in a database.

[0064] In the specific implementation process: After setting the definition of the face-signing components, the original configuration information of each face-signing component can be generated using unstructured data based on the definition; where unstructured data can be JSON data. The definition of the face-signing components is as shown in the above embodiment, and the original configuration information is represented and stored using unstructured data to represent the definition of the face-signing components.

[0065] Taking the attribute configuration of the question-and-answer component as an example, the JSON data corresponding to the original configuration information of the question-and-answer component can be as follows: question represents the question, voiceType represents the speech synthesis method, staticVoice represents the local speech, answerType represents the answer type, answerTime represents the number of times the question has been answered, voiceOkAnswer represents the affirmative answer, actionShowType represents the action method, actionType represents the action type, retryCount represents the number of attempts, retryQuestion represents the repeated question, retryVoiceType represents the repeated speech type, and retryStaticVoice represents the synthesis method of the repeated speech.

[0066]

[0067]

[0068] The original configuration information for the above question-and-answer component attributes can be: the question is "Are you Zhang XX?", the voice spoken to the user is synthesized speech, the answer type is voice, the number of times to answer the question is 4, the affirmative answers include "yes", "okay", "good" and "okay", the action method is fixed, the action type is nodding, the number of attempts is 3, the repeated question is "Are you Zhang XX?", and the voice of the repeated question is synthesized speech.

[0069] Understandably, the original configuration information can include not only attribute configurations but also page configurations. Similar to the example of attribute configurations described above, the original configuration information corresponding to page configurations is also generated using unstructured data based on the page configuration definitions in the face-signing component.

[0070] After configuring the initial configuration information, users can modify it according to business needs when configuring the face-to-face signing process to obtain component configuration information corresponding to the business. Furthermore, during the face-to-face signing process configuration, the component configuration information is automatically stored in the database in real time.

[0071] In the above implementation process, the definition of the face-to-face signing component is represented and stored using unstructured data, allowing users to modify the configuration information of the face-to-face signing component according to their actual needs. Furthermore, the component configuration information is automatically stored in the database in real time during the face-to-face signing process configuration, mitigating the risk of data loss during the configuration process.

[0072] Please see Figure 5 The diagram shown is a flowchart illustrating the configuration of the face-to-face signing component provided in an embodiment of this application.

[0073] Optionally, in this embodiment of the application, receiving the face-to-face signing component configured by the user for generating the face-to-face signing process, and the connection relationship of the face-to-face signing component, includes: displaying the face-to-face signing component to be processed to the user; the face-to-face signing component to be processed includes the face-to-face signing component; receiving the face-to-face signing component selected by the user from the face-to-face signing component and dragged to the process configuration interface; and receiving the connection relationship between the face-to-face signing components configured by the user through the connection line.

[0074] In the specific implementation process: the face-to-face verification components to be processed are all the face-to-face verification components that users can select for configuring the face-to-face verification process. For example... Figure 5 As shown, the components to be processed include a Q&A component, a customer service representative speaking component, a terms confirmation component, a document confirmation component, a signature component, and a waiting component.

[0075] Users select the interview component to be configured from the pending interview components and drag it to the workflow configuration interface. The workflow configuration interface is used to configure the interview components and the connections between them. If multiple interview components are dragged to the workflow configuration interface, the connection relationships between them can be configured through connection lines.

[0076] For example, when configuring an interview process, a new interview configuration scenario can be created. This scenario includes a process configuration interface, which is essentially a canvas area. After dragging, dropping, or snagging a process component from the interview process onto the process configuration interface, the interface displays that component and its corresponding original configuration information. This allows users to modify the original configuration information and generate component configuration information within the process configuration interface. For example... Figure 5 As shown, dragging the customer service voice component into the process configuration interface displays the component's original configuration information, including the voice message "Welcome to the face-to-face verification process. This verification is for your personal confirmation and is not for guarantee or other business purposes." Users can modify this voice message. It's understood that both the face-to-face verification component's attribute configuration and the corresponding original configuration information for the page can be modified, and each modification is saved in real time.

[0077] The connection relationships between face-to-face verification components are configured through connection lines. For example, a waiting component can be connected after the customer service speaking component, a question and answer component can be connected after the waiting component is completed, and a waiting component can be connected again after the question and answer component is completed.

[0078] In the above implementation process, the face-to-face interview process is configured in the process configuration interface in the form of a flowchart, which visualizes the face-to-face interview process configuration process and improves the efficiency and convenience of face-to-face interview process configuration.

[0079] Optionally, in this embodiment of the application, the method further includes: generating a virtual customer service image for the face-to-face signing process based on a preset virtual customer service image using a posture-driven algorithm; obtaining virtual customer service configuration parameters; the virtual customer service configuration parameters include the background image of the virtual customer service, the position parameters of the virtual customer service on the page, and the dialogue page parameters of the virtual customer service; generating a face-to-face signing virtual customer service based on the virtual customer service image and the virtual customer service configuration parameters; and obtaining a face-to-face signing configuration scheme based on the face-to-face signing process and the face-to-face signing virtual customer service.

[0080] Please see Figure 6 The diagram shown illustrates the configuration of the virtual customer service avatar provided in the embodiments of this application.

[0081] In the specific implementation process: the face-to-face signing process can be a video signing, meaning that during the signing, the user needs to have a video call with a virtual customer service representative on the signing device, answer questions posed by the virtual representative, and complete the signing. Therefore, the face-to-face signing process also includes a virtual customer service representative, who is used to interact with the user, such as asking questions and prompting the user to sign and confirm terms.

[0082] The virtual customer service image can be a pre-captured single image or video containing a person's image. Using a pose-driven algorithm, a virtual customer service avatar is generated based on this image to create a virtual customer service representative for the face-to-face verification process. For example, a speaking face video synchronized with voice can be generated from a single image. The pose-driven algorithm can include lip-syncing algorithms or pose-lip-syncing algorithms, etc.

[0083] like Figure 6 The user can configure the virtual customer service settings, including the background image, position on the page, and dialogue parameters. The position can be set to the top left or top right corner of the face-to-face verification device interface. Dialogue parameters include the display position, color, font, and corner radius of the dialogue content. Additional parameters may include whether the call hang-up button is displayed, its background image, and the virtual customer service voice dot and its color.

[0084] Obtain the user-configured virtual customer service avatar and configuration parameters, and generate a virtual customer service representative for the face-to-face interview. Based on the face-to-face interview process and the virtual customer service representative, obtain the face-to-face interview configuration plan. The virtual customer service representative can interact with the user according to the configuration of the face-to-face interview components and the connection relationships between them, thus assisting the user in completing the face-to-face interview.

[0085] In the above implementation process, by configuring the virtual customer service avatar and configuration parameters, a virtual customer service representative for the face-to-face interview process is obtained, thus forming a more complete face-to-face interview configuration scheme. This improves the current face-to-face interview process's inability to configure a virtual customer service representative.

[0086] Please see Figure 7 The diagram shows a configuration diagram of the face-to-face verification algorithm provided in an embodiment of this application.

[0087] Optionally, in this embodiment of the application, the method further includes: obtaining the face-to-face verification algorithm configuration parameters for each face-to-face verification algorithm, the face-to-face verification algorithm configuration parameters including algorithm detection frequency, failure identification conditions and algorithm threshold; the face-to-face verification algorithm is used to determine whether the face-to-face verification business is successful; and obtaining the face-to-face verification configuration scheme according to the face-to-face verification process and the face-to-face verification virtual customer service, including: obtaining the face-to-face verification configuration scheme according to the face-to-face verification process, the face-to-face verification virtual customer service and the face-to-face verification algorithm configuration parameters.

[0088] In its implementation: the face-to-face verification algorithm is used to determine whether the face-to-face verification process is successful. Specifically, it determines whether the user meets the requirements during the verification process. If the algorithm detects that the number of failed verifications reaches a preset limit, the user is considered ineligible or the verification process has failed. The face-to-face verification algorithm may include face detection algorithms, multi-face detection algorithms, face comparison algorithms, face-facing-on-screen algorithms, real-person detection algorithms, voiceprint comparison algorithms, and face occlusion detection algorithms, etc.

[0089] For example, a face detection algorithm is used to detect whether the user's face is in the face-to-face signing screen; a multi-face detection algorithm is used to determine whether multiple faces appear in the face-to-face signing screen; a face comparison algorithm is used to detect whether the user is actually conducting the face-to-face signing; a face-to-screen algorithm is used to detect whether the user's face is facing the screen; a real person detection algorithm is used to detect whether the face in the face-to-face signing screen is a real person, and not a recorded video; a voiceprint comparison algorithm is used to detect whether the user is actually responding; and a face occlusion detection algorithm is used to detect whether the user's face is obscured.

[0090] Obtain the face-to-face verification algorithm configuration parameters for each algorithm configured by the user. These parameters include the algorithm detection frequency, failure criteria, and algorithm threshold. The algorithm detection frequency is the time period for starting the face-to-face verification algorithm to perform detection; the failure criteria are the conditions under which the face-to-face verification algorithm determines whether the detection has failed or not, such as reaching a preset number of failures or reaching a preset time; the algorithm threshold is the threshold for determining whether the detection passes or not.

[0091] It is understandable that, such as Figure 7As shown, different interview algorithms can be configured to be applied throughout the entire interview process, used in specific stages, or not activated at all, depending on the actual situation. Furthermore, the configuration parameters for different interview algorithms can be set according to specific needs. For example, for the face-to-screen algorithm, the failure condition can be set to fail if the face is not aligned with the screen five times; or it can be set to fail if the time for detecting face misalignment reaches a preset time.

[0092] After setting up the interview process, virtual customer service representative, and interview algorithm configuration parameters, you will obtain a complete interview configuration solution.

[0093] In the above implementation process, the risk of face-to-face fraud is reduced by configuring the face-to-face verification algorithm in the face-to-face verification process; and users can set the face-to-face verification algorithm configuration parameters for each algorithm to improve the success rate of face-to-face verification and the user experience.

[0094] Optionally, in this embodiment of the application, after receiving the face-to-face signing component configured by the user for generating the face-to-face signing process, and the connection relationship of the face-to-face signing component, the method further includes: generating a corresponding component instance based on the face-to-face signing component, and generating a connection instance based on the connection relationship; storing the component instance and the connection instance in a database.

[0095] In the specific implementation process: The user selects the interview component to be configured from the interview component list and drags it to the process configuration interface. A corresponding instance is generated in real time based on the interview component dragged to the process configuration interface, and this instance is automatically stored in the database. The unstructured data of this instance is consistent with the original configuration information of the interview component. Connection instances can also be generated and stored in the database for the connection relationships between components configured by the user in the process configuration interface.

[0096] In the above implementation process, an instance of the face-signing component is generated based on the user's configuration and stored in the database. This generated instance, automatically stored in the database, can be modified in real time without requiring manual saving by the user. Furthermore, configuration information is not lost due to network outages or unexpected webpage closures, thus improving the security and stability of the configuration process data.

[0097] Please see Figure 8 The diagram shown is a structural schematic of the face-to-face interview process generation device provided in an embodiment of this application; this application provides a face-to-face interview process generation device 200, including:

[0098] The receiving module 210 is used to receive the face-to-face signing components configured by the user for generating the face-to-face signing process, as well as the connection relationship of the face-to-face signing components;

[0099] The information acquisition module 220 is used to acquire the component configuration information corresponding to the face-to-face signing component and the connection information corresponding to the connection relationship.

[0100] The process generation module 230 is used to generate the face-to-face interview process based on the component configuration information and connection information.

[0101] Optionally, in this embodiment of the application, the face-to-face signing process generation device includes connection condition information in the connection information; the information acquisition module 220 is further configured to, if the connection relationship between the face-to-face signing components is a branch connection relationship, acquire the configuration conditions corresponding to each branch in the branch connection relationship; parse the configuration conditions corresponding to each branch to obtain condition constants and condition variables; and acquire connection condition information based on the condition constants and condition variables.

[0102] Optionally, in this embodiment of the application, the face-to-face signing process generation device, the information acquisition module 220, is further used to obtain the original configuration information of the face-to-face signing component; the original configuration information is generated using unstructured data based on the pre-set face-to-face signing component definition; the original configuration information includes attribute configuration and page configuration; receiving user modifications to the original configuration information, generating component configuration information; and storing the component configuration information in the database.

[0103] Optionally, in this embodiment of the application, the face-to-face interview process generation device, receiving module 210, is specifically used to display the face-to-face interview components to be processed to the user; the face-to-face interview components to be processed include face-to-face interview components; receiving the face-to-face interview components selected and dragged by the user from the face-to-face interview components to the process configuration interface; and receiving the connection relationship between the face-to-face interview components configured by the user through the connection line.

[0104] Optionally, in this embodiment, the face-to-face verification process generation device further includes: a virtual customer service configuration module, used to generate a virtual customer service image in the face-to-face verification process based on a preset virtual customer service image and through a posture-driven algorithm; obtain virtual customer service configuration parameters; the virtual customer service configuration parameters include the background image of the virtual customer service, the position parameters of the virtual customer service on the page, and the dialogue page parameters of the virtual customer service; generate a face-to-face verification virtual customer service based on the virtual customer service image and the virtual customer service configuration parameters; and obtain a face-to-face verification configuration scheme based on the face-to-face verification process and the face-to-face verification virtual customer service.

[0105] Optionally, in this embodiment of the application, the face-to-face verification process generation device further includes: a face-to-face verification algorithm configuration module, used to obtain face-to-face verification algorithm configuration parameters for each face-to-face verification algorithm, the face-to-face verification algorithm configuration parameters including algorithm detection frequency, number of failure identifications and algorithm threshold; the face-to-face verification algorithm is used to determine whether the face-to-face verification business is successful; and a face-to-face verification configuration scheme is obtained according to the face-to-face verification process and the face-to-face verification virtual customer service, including: obtaining the face-to-face verification configuration scheme according to the face-to-face verification process, the face-to-face verification virtual customer service and the face-to-face verification algorithm configuration parameters.

[0106] Optionally, in this embodiment of the application, the face-to-face verification process generation device further includes: a storage module, used to generate corresponding component instances based on the face-to-face verification components, and to generate connection instances based on connection relationships; and to store the component instances and connection instances in a database.

[0107] It should be understood that this device corresponds to the above-described face-to-face verification process generation method embodiment and is capable of executing the various steps involved in the above method embodiment. The specific functions of this device can be found in the description above, and detailed descriptions are omitted here to avoid repetition. The device includes at least one software functional module that can be stored in memory or embedded in the device's operating system (OS) in the form of software or firmware.

[0108] Please see Figure 9 The diagram shows a structural schematic of an electronic device provided in an embodiment of this application. An electronic device 300 provided in this application includes a processor 310 and a memory 320. The memory 320 stores machine-readable instructions executable by the processor 310. When the machine-readable instructions are executed by the processor 310, the method described above is performed.

[0109] This application also provides a storage medium storing a computer program, which is executed by a processor to perform the above-described method.

[0110] The storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Red-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0111] It should be understood that the disclosed apparatus and methods can also be implemented in other ways, given the several embodiments provided in this application. The apparatus embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code, which contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, or they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0112] In addition, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0113] The above description is only an optional implementation of the embodiments of this application, but the protection scope of the embodiments of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the embodiments of this application should be covered within the protection scope of the embodiments of this application.

Claims

1. A method for generating an in-person visa application process, characterized in that, include: Receive the face-to-face signing component configured by the user for generating the face-to-face signing process, as well as the connection relationship of the face-to-face signing component; Obtain the component configuration information corresponding to the face verification component and the connection information corresponding to the connection relationship; The face-to-face verification process is generated based on the component configuration information and the connection information; The method further includes: generating a virtual customer service image for the face-to-face signing process based on a preset virtual customer service image using a posture-driven algorithm; obtaining the virtual customer service configuration parameters; the virtual customer service configuration parameters include the background image of the virtual customer service, the position parameters of the virtual customer service on the page, and the dialogue page parameters of the virtual customer service; generating a face-to-face signing virtual customer service representative based on the virtual customer service image and the virtual customer service configuration parameters; and obtaining a face-to-face signing configuration scheme based on the face-to-face signing process and the face-to-face signing virtual customer service representative. The method further includes: obtaining the face-to-face verification algorithm configuration parameters for each face-to-face verification algorithm, the face-to-face verification algorithm configuration parameters including algorithm detection frequency, failure identification conditions and algorithm threshold; the face-to-face verification algorithm is used to determine whether the face-to-face verification business is successful; and obtaining the face-to-face verification configuration scheme according to the face-to-face verification process and the face-to-face verification virtual customer service, including: obtaining the face-to-face verification configuration scheme according to the face-to-face verification process, the face-to-face verification virtual customer service and the face-to-face verification algorithm configuration parameters. The face verification algorithm includes at least one of the following: face detection algorithm, multi-face detection algorithm, face comparison algorithm, face facing the screen algorithm, real person detection algorithm, voiceprint comparison algorithm, and face occlusion detection algorithm.

2. The method according to claim 1, characterized in that, The connection information includes connection condition information; obtaining the connection information corresponding to the connection relationship includes: If the connection relationship between the face-to-face signing components is a branch connection relationship, then obtain the configuration conditions corresponding to each branch in the branch connection relationship; The configuration conditions corresponding to each branch are parsed to obtain condition constants and condition variables; The connection condition information is obtained based on the condition constant and the condition variable.

3. The method according to claim 1, characterized in that, Obtain the component configuration information corresponding to the face-to-face verification component, including: Obtain the original configuration information of the face-to-face signing component; the original configuration information is generated using unstructured data based on a pre-set face-to-face signing component definition; the original configuration information includes attribute configuration and page configuration; Receive user modifications to the original configuration information and generate the component configuration information; The component configuration information is stored in the database.

4. The method according to claim 1, characterized in that, The receiving of the user-configured face-to-face signing component for generating the face-to-face signing process, and the connection relationships of the face-to-face signing component, include: Display the pending face-to-face verification component to the user; the pending face-to-face verification component includes the face-to-face verification component. The system receives the face-signing component selected and dragged by the user from the face-signing components to the process configuration interface; and receives the connection relationship between the face-signing components configured by the user via connection lines.

5. The method according to any one of claims 1-4, characterized in that, After receiving the user-configured interview component for generating the interview process, and the connection relationships of the interview component, the method further includes: Generate a corresponding component instance based on the face-to-face verification component, and generate a connection instance based on the connection relationship; Store the component instance and the connection instance in the database.

6. A face-to-face verification process device, characterized in that, include: The receiving module is used to receive the face-to-face signing component configured by the user for generating the face-to-face signing process, as well as the connection relationship of the face-to-face signing component; The information acquisition module is used to acquire the component configuration information corresponding to the face verification component and the connection information corresponding to the connection relationship; The process generation module is used to generate the face-to-face verification process based on the component configuration information and the connection information; The virtual customer service configuration module is used to generate a virtual customer service image in the face-to-face signing process based on a preset virtual customer service image and through a posture-driven algorithm; obtain the virtual customer service configuration parameters; the virtual customer service configuration parameters include the background image of the virtual customer service, the position parameters of the virtual customer service on the page, and the dialogue page parameters of the virtual customer service; generate a face-to-face signing virtual customer service based on the virtual customer service image and the virtual customer service configuration parameters; and obtain a face-to-face signing configuration scheme based on the face-to-face signing process and the face-to-face signing virtual customer service. The face-to-face verification algorithm configuration module is used to obtain the face-to-face verification algorithm configuration parameters for each face-to-face verification algorithm. The face-to-face verification algorithm configuration parameters include the algorithm detection frequency, failure identification conditions, and algorithm threshold. The face-to-face verification algorithm is used to determine whether the face-to-face verification process is successful. Based on the face-to-face verification process, the face-to-face verification virtual customer service, and the face-to-face verification algorithm configuration parameters, a face-to-face verification configuration scheme is obtained. The face verification algorithm includes at least one of the following: face detection algorithm, multi-face detection algorithm, face comparison algorithm, face facing the screen algorithm, real person detection algorithm, voiceprint comparison algorithm, and face occlusion detection algorithm.

7. An electronic device, characterized in that, include: A processor and a memory, the memory storing machine-readable instructions executable by the processor, which, when executed by the processor, perform the method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, performs the method as described in any one of claims 1 to 5.

Citation Information

Patent Citations

  • Establishment method and device of electronic signing software, terminal equipment and storage medium

    CN109710214A

  • Workflow-based configuration processing method and device, computer equipment and storage medium

    CN110704095A

  • Interviewing method and device, electronic equipment and storage medium

    CN113903338A