Financial business handling remote assistance system and method

Abstract

The invention discloses a remote assistance system and method for financial business handling. Comprising a business handling mobile phone APP, a camera, an iris recognition sensor, a mobile terminal controller, a picture recognizer, an anti-AI application tool, a data storage library and a financial institution remote business handling system, and the financial institution remote business handling system is electrically connected with the picture recognizer, the anti-AI application tool and the data storage library. The mobile terminal controller is used for installing a financial institution business handling mobile phone APP, and the camera and the iris recognition sensor are electrically connected with the mobile terminal controller. According to the invention, users who need to remotely handle financial institution business can be monitored in real time, and whether the currently handled user is a real person according with requirements is judged by using an AI identification technology; therefore, the problems that in the current remote handling process, target customer information is still not real, actual remote handling is a false customer or an AI customer, and final loss is serious are solved, and the safety and reliability of remote handling are improved.

Description

Technical Field

[0001] The present invention relates to the technical field related to remote network business processing, and in particular to a remote assistance system and method for financial institution business processing. Background Art

[0002] In daily life, many special types of customers will inevitably encounter many inconveniences when going to outlets to handle business, so special types of customers are more inclined to remote assistance in business handling. Among them, special types of customers can be customers with eye diseases, communication difficulties, and mobility difficulties. Therefore, how to provide a remote assistance business handling method to reduce the difficulty of special types of customers in the business handling process and provide special types of customers with convenient business handling methods is an issue that needs to be solved urgently.

[0003] Therefore, there is a remote-assisted business processing method, system, electronic device and storage medium disclosed in patent application number 202211143968.0, which includes sending a target session establishment message to a mobile financial institution; the mobile financial institution authenticates the target customer based on the encrypted target identity information and establishes a session with the core system; the core system determines multiple target businesses based on historical business processing records and business processing information to obtain a business processing combination; the core system determines the target special type of the target customer from the special types based on the target customer characteristic information, and sends a prompt type and prompt information to the mobile financial institution based on the target special type and the target business processing combination; the mobile financial institution guides the target customer to conduct business processing based on the prompt type and prompt information. However, with the continuous development of science and technology, it is still easy for the target customer information to be untrue during the remote processing process, and the actual remote processing is for a false customer or AI customer, resulting in serious losses in the end. Therefore, how to ensure that the customer information is true and the remote customer processed in real time is not a false customer or AI customer during the remote processing is particularly important. Summary of the invention

[0004] The purpose of the present invention is to provide a remote assistance system and method for handling financial business, so as to solve the problem raised in the above background technology that in the existing remote handling process, it is still easy for the target customer information to be untrue, and the actual remote handling is for a fake customer or an AI customer, resulting in serious losses in the end.

[0005] To achieve the above object, the present invention provides the following technical solutions: The business handling remote assistance system includes the following components: Financial institutions’ business handling mobile APP is used to facilitate users to register for remote assistance requests; A camera, which is provided on the mobile terminal, is used to identify the user who needs remote business handling assistance; An iris recognition sensor is provided on the mobile terminal and is used to perform iris recognition on users who need remote business handling assistance; A mobile terminal controller, wherein the mobile terminal controller is used to install a mobile phone APP for handling financial institution business, and the camera and iris recognition sensor are electrically connected to the mobile terminal controller; An image recognizer is used to perform image recognition on the received video of remote business handling assistance; Anti-AI application tool, used to perform anti-AI recognition on the received remote business handling assistance video to determine whether it is an AI character; Data repository, used to store AI-related data and user boarding identity information; The remote business handling system of a financial institution is a core component of the entire system. The remote business handling system of the financial institution is electrically connected to the image recognizer, the anti-AI application tool, and the data storage library. The remote business handling system of the financial institution is electrically connected to the mobile terminal controller, so that when the financial institution business handling mobile phone APP receives the business handling needs of the target customer, it sends a session establishment message to the mobile terminal controller according to the business handling needs, first performs user identity recognition, if the user identity information is not currently available, immediately creates the user target identity information and sends it to the remote business handling system of the financial institution, the remote business handling system of the financial institution obtains the user target identity information and saves it, if the user identity information is currently stored, the target customer is authenticated according to the encrypted target identity information, and a session is established with the remote business handling system of the financial institution after passing; during the session, the camera, iris recognition sensor, image recognizer and anti-AI application tool are used to determine in real time whether the user of the current session is a user that meets the requirements, if yes, the target customer is guided to perform the corresponding business according to the prompt type and prompt information, if not, no processing is performed.

[0006] As a preference, to further improve security, it also includes an ID account acquisition module that can obtain in real time the real-time ID address of the user who needs remote assistance and a GPS locator of the real-time location of the ID account. The GPS locator and ID account acquisition module are electrically connected to the remote business processing system of the financial institution.

[0007] Preferably, to further improve security, the financial institution remote business processing system is also connected to an alarm.

[0008] Preferably, the financial institution's remote business processing system is also connected to an encryption system for encrypting data.

[0009] Preferably, the mobile terminal controller is also connected to a session destruction command module, which saves session information generated during a session between the mobile terminal controller and the remote business processing system of the financial institution, and sends the session information to the mobile terminal controller. Once an abnormality is found during the session, the session data is encrypted and packaged and sent to the remote business processing system of the financial institution, and the session data in the mobile terminal controller is destroyed.

[0010] The present invention also discloses a remote assistance method for financial institution business handling, including the remote assistance system for financial institution business handling, characterized in that the specific steps are as follows: S1. Pre-create a suspicion threshold FM; S2. When the financial institution's business handling mobile phone APP receives the target customer's business handling needs, it sends a session establishment message to the mobile terminal controller according to the business handling needs, first performs user identity identification, and if the user identity information does not exist at present, immediately creates the user target identity information and sends it to the financial institution's remote business handling system. The financial institution's remote business handling system obtains the user target identity information and saves it; S3, the remote business processing system of the financial institution automatically generates the user head portrait picture frame HP and the user iris image NI according to the stored user identity information; S4. If it is detected that the user identity information is currently stored, the target customer is authenticated according to the encrypted target identity information, and a session is established with the remote business processing system of the financial institution after passing the authentication; S5. During the conversation, firstly, the real-time image information of the user who is handling the business in the mobile APP of the financial institution is obtained in real time through the camera; the real-time iris information of the user who is handling the business in the mobile APP of the financial institution is obtained in real time through the iris recognition sensor; the real-time image information of the user received by the picture recognizer through the remote business handling system of the financial institution; the anti-AI application tool obtains the real-time threshold of whether it is AI through the video received by the remote business handling system of the financial institution; then judge whether the current user is abnormal according to formula 1; if not, go to step S6; if so, do not process; Sy=IF(H1≠HP or / and N1≠NI or / and H2≠HP or / and X1≦FM ) (Formula 1) In the above formula, H1 is the user image information acquired by the camera in real time; N1 is the iris information acquired by the iris recognition sensor 3 in real time; H2 is the user image real-time information received by the image recognizer through the remote business processing system of the financial institution; X1 is the real-time threshold value of whether the anti-AI application tool is AI through the video received by the remote business processing system of the financial institution; S6. Guiding the target customer to perform corresponding business processing according to the prompt type and prompt information.

[0011] Preferably, in step S5, if it is determined that the target customer is abnormal according to the camera and the iris recognition sensor, the current session with the remote business processing system of the financial institution is terminated.

[0012] Preferably, a convolutional neural network is used for the real-time threshold calculation of AI.

[0013] Preferably, in the real-time threshold calculation process of AI, filtering, edge detection, color feature, and texture feature detection are required.

[0014] Preferably, in the calculation process of N1, it is necessary to calculate according to the following formula; N1=π*(pupil diameter / 2)^2 (Formula 2); Among them, π is pi, and pupil diameter is the diameter of the iris.

[0015] Positive and beneficial effects: The present invention can conduct real-time monitoring of users who need to handle financial institution business remotely, and use AI recognition technology to determine whether the current user is a real person who meets the requirements. This solves the problem that "the current remote handling process is still prone to untrue target customer information, and the actual remote handling is for fake customers or AI customers, resulting in serious losses in the end", and further improves the security and reliability of remote handling. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a schematic diagram of the connection structure of the remote assistance system for handling business of a financial institution in Example 1; Figure 2 This is a schematic diagram of the connection structure of the remote assistance system for handling business of a financial institution in Example 2; Figure 3 This is a schematic diagram of the connection structure of the remote assistance system for financial institution business handling in Example 3; Figure 4 This is a schematic diagram of the connection structure of the remote assistance system for handling business of a financial institution in Example 4; Figure 5 This is a schematic diagram of the connection structure of the remote assistance system for financial institution business processing in Example 5.

[0017] In the figure: financial institution business processing mobile phone APP 1, camera 2, iris recognition sensor 3, mobile terminal controller 4, image identifier 5, data storage library 6, financial institution remote business processing system 7, ID account acquisition module 8, GPS locator 9, alarm 10, encryption system 11, anti-AI application tool 12, session destruction command module 13. DETAILED DESCRIPTION

[0018] The following will be combined with the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention. Example 1

[0019] See also Figure 1 This embodiment provides a business handling remote assistance system, including the following components: Financial institution business handling mobile phone APP1, used to facilitate users to register for remote assistance requests; Camera 2, which is provided on the mobile terminal and is used to identify the user who needs remote business handling assistance; An iris recognition sensor 3, provided on the mobile terminal, is used to perform iris recognition on users who need remote business handling assistance; A mobile terminal controller 4, wherein the mobile terminal controller 4 is used to install a financial institution business handling mobile phone APP 1, and the camera 2 and the iris recognition sensor 3 are electrically connected to the mobile terminal controller 4; Image recognition device 5, used for performing image recognition on the received video of remote business handling assistance; The anti-AI application tool 12 is used to perform anti-AI recognition on the received remote business handling assistance video to determine whether it is an AI character; Data repository 6, used to store AI-related data information and user boarding identity information data; The financial institution remote business handling system 7 is a core component of the entire system. The financial institution remote business handling system 7 is electrically connected to the image recognizer 5, the anti-AI application tool 12, and the data storage library 6. The financial institution remote business handling system 7 is electrically connected to the mobile terminal controller 4, so that when the financial institution business handling mobile phone APP 1 receives the business handling needs of the target customer, it sends a session establishment message to the mobile terminal controller 4 according to the business handling needs, first performs user identity recognition, if the user identity information is not currently available, immediately creates the user target identity information and sends it to the financial institution remote business handling system 7, the financial institution remote business handling system 7 obtains the user target identity information and saves it, if the user identity information is currently stored, the target customer is authenticated according to the encrypted target identity information, and a session is established with the financial institution remote business handling system 7 after passing; during the session, the camera 2, the iris recognition sensor 3, the image recognizer 5 and the anti-AI application tool 12 are used to determine in real time whether the user of the current session is a user that meets the requirements, if it meets the requirements, the target customer is guided to perform the corresponding business according to the prompt type and prompt information, if it does not meet the requirements, no processing is performed.

[0020] The present invention also discloses a remote assistance method for financial institution business handling, including the remote assistance system for financial institution business handling, characterized in that the specific steps are as follows: S1. Pre-create a suspicion threshold FM; S2. When the financial institution business handling mobile phone APP 1 receives the business handling needs of the target customer, it sends a session establishment message to the mobile terminal controller 4 according to the business handling needs, first performs user identity identification, and if the user identity information is not currently available, immediately creates the user target identity information and sends it to the financial institution remote business handling system 7. The financial institution remote business handling system 7 obtains the user target identity information and saves it; S3, the financial institution remote business processing system 7 automatically generates the user head portrait picture frame HP and the user iris image NI according to the stored user target identity information; S4. If it is detected that the user identity information is currently stored, the target customer is authenticated according to the encrypted target identity information, and a session is established with the remote business processing system 7 of the financial institution after passing the authentication; S5. During the conversation, firstly, the real-time image information of the user who is handling the business in the mobile phone APP1 of the financial institution is obtained in real time through the camera 2; the real-time iris information of the user who is handling the business in the mobile phone APP1 of the financial institution is obtained in real time through the iris recognition sensor 3; the real-time image information of the user received by the remote business handling system 7 of the financial institution is received by the picture recognizer 5; the anti-AI application tool 12 obtains the real-time threshold of whether it is AI through the video received by the remote business handling system 7 of the financial institution; then judge whether the current user is abnormal according to formula 1; if not, enter step S6; if so, do not process; Sy=IF(H1≠HP or / and N1≠NI or / and H2≠HP or / and X1≦FM ) (Formula 1) In this embodiment, if one of the adjustments does not meet the requirements when H1≠HP or / and N1≠NI or / and H2≠HP or / and X1≦FM, it indicates that the user is abnormal; In the above formula, H1 is the user image information acquired in real time by the camera 2; N1 is the iris information acquired in real time by the iris recognition sensor 3; H2 is the real-time user image information received by the image recognizer 5 through the remote business processing system 7 of the financial institution; X1 is the real-time threshold value of whether the anti-AI application tool 12 is AI through the video received by the remote business processing system 7 of the financial institution; S6. Guiding the target customer to perform corresponding business processing according to the prompt type and prompt information.

[0021] Preferably, in step S5, if it is determined that the target customer is abnormal according to the camera 2 and the iris recognition sensor 3, the current session with the remote business processing system 7 of the financial institution is terminated.

[0022] Preferably, a convolutional neural network is used for the real-time threshold calculation of AI.

[0023] Preferably, in the real-time threshold calculation process of AI, filtering, edge detection, color feature, and texture feature detection are required.

[0024] Preferably, in the calculation process of N1, it is necessary to calculate according to the following formula; N1=π*(pupil diameter / 2)^2 (Formula 2); Among them, π is pi, and pupil diameter is the diameter of the iris.

[0025] The working principle of the present invention is as follows: when the financial institution business processing mobile phone APP1 receives the business processing demand of the target customer, it sends a session establishment message to the mobile terminal controller 4 according to the business processing demand, first performs user identity recognition, if the user identity information does not exist at present, immediately creates the user target identity information, and sends it to the financial institution remote business processing system 7, the financial institution remote business processing system 7 obtains the user target identity information and saves it; if it is detected that the user identity information is currently stored, the target customer is authenticated according to the encrypted target identity information, and after passing, a session is established with the financial institution remote business processing system 7; during the session, firstly, the real-time image information of the user being processed in the financial institution business processing mobile phone APP1 is obtained in real time through the camera 2; through the iris recognition sensor 3; the financial institution business processing mobile phone APP1 is obtained in real time The real-time iris information of the user being processed; the real-time information of the user image received by the picture recognizer 5 through the remote business processing system 7 of the financial institution; the anti-AI application tool 12 obtains the real-time threshold of AI through the video received by the remote business processing system 7 of the financial institution; then judges whether the current user is an abnormal user according to Formula 1; if not, enters step S6, and guides the target customer to perform corresponding business processing according to the prompt type and prompt information. Therefore, the present invention can monitor the users who need to remotely handle the business of financial institutions in real time, and use AI recognition technology to judge whether the current user is a real person who meets the requirements, thereby solving the problem that "the target customer information is still prone to being untrue in the current remote processing process, and the actual remote processing is for false customers or AI customers, resulting in serious losses in the end", and further improves the security and reliability of remote processing. Example 2

[0026] See also Figure 2 The present embodiment provides a remote assistance system for financial institution business processing, and the general structure is the same as that of Embodiment 1, except that, as a preferred embodiment, in order to further improve security, it also includes an ID account acquisition module 8 that can obtain the real-time ID address of the user who needs remote assistance in real time, and a GPS locator 9 of the real-time location of the ID account. The GPS locator 9 and the ID account acquisition module 8 are electrically connected to the financial institution remote business processing system 7. In the present embodiment, the ID account acquisition module 8 is set to detect the ID account of abnormal users, and the location of the abnormal user is located by the GPS locator 9, which further facilitates the subsequent supervision department to search, thereby improving security. Example 3

[0027] See also Figure 3The present embodiment provides a remote assistance system for financial institution business processing, and the general structure is the same as that of the embodiment 1, except that, as a preferred embodiment, in order to further improve security, the financial institution remote business processing system 7 is also connected to an alarm 10. In the present embodiment, the alarm 10 is set to issue an alarm reminder when a remote session abnormality occurs, thereby further improving security. Example 4

[0028] See also Figure 4 The present embodiment provides a remote assistance system for financial institution business processing, and the general structure is the same as that of Embodiment 1, except that, as a preference, the financial institution remote business processing system 7 is also connected to an encryption system 11 for encrypting data. In the present embodiment, encryption processing is implemented during data transmission by setting up the encryption system 11, thereby further improving the security of data transmission and avoiding data leakage. Example 5

[0029] See also Figure 5 The present embodiment provides a remote assistance system for financial institution business processing, and the general structure is the same as that of embodiment 1, except that, as a preferred embodiment, the mobile terminal controller 4 is also connected to a session destruction command module 13, and the session destruction command module 13 saves the session information generated during the session between the mobile terminal controller 4 and the remote business processing system 7 of the financial institution, and sends the session information to the mobile terminal controller 4. Once an abnormality is found during the session, the session data is encrypted and packaged and sent to the remote business processing system 7 of the financial institution, and the session data in the mobile terminal controller 4 is destroyed. In this embodiment, the session destruction command module 13 can save the session information generated during the session between the mobile terminal controller 4 and the remote business processing system 7 of the financial institution, so as to facilitate the later viewing of historical data. At the same time, once an abnormality is found during the session, the session data is encrypted and packaged and sent to the remote business processing system 7 of the financial institution, and the session data in the mobile terminal controller 4 is destroyed to improve the security of the data.

[0030] Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments, or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. Financial business remote assistance system, characterized by: Includes the following components: Banking business handling mobile phone APP (1), used to facilitate users to register for remote assistance requests; A camera (2) is provided on the mobile terminal and is used to identify the user who needs remote business handling assistance; An iris recognition sensor (3) is arranged on the mobile terminal and is used to perform iris recognition on a user who needs remote business handling assistance; A mobile terminal controller (4), the mobile terminal controller (4) being used to install a mobile phone APP (1) for handling banking business, the camera (2) and the iris recognition sensor (3) being electrically connected to the mobile terminal controller (4); An image recognition device (5) is used to perform image recognition on the received video of remote business handling assistance; An anti-AI application tool (12) is used to perform anti-AI recognition on the received remote business handling assistance video to determine whether it is an AI character; Data repository (6), used to store AI-related data information and user boarding identity information data; The bank remote business processing system (7) is a core component of the entire system. The bank remote business processing system (7) is electrically connected to the image recognition device (5), the anti-AI application tool (12), and the data storage library (6). The bank remote business processing system (7) is electrically connected to the mobile terminal controller (4) to realize that when the bank business processing mobile phone APP (1) receives the business processing requirements of the target customer, it sends a session establishment message to the mobile terminal controller (4) according to the business processing requirements, first performs user identity recognition, and if the user identity information is not currently available, immediately creates the user target identity information and sends it to the bank remote business The bank remote business processing system (7) obtains the target identity information of the user and saves it. If the user identity information is currently stored, the target customer is authenticated according to the encrypted target identity information. After passing the authentication, a session is established with the bank remote business processing system (7). During the session, the camera (2), the iris recognition sensor (3), the image recognizer (5) and the anti-AI application tool (12) are used to determine in real time whether the user of the current session is a user that meets the requirements. If the user meets the requirements, the target customer is guided to perform the corresponding business according to the prompt type and prompt information. If the user does not meet the requirements, no processing is performed.

2. The financial business remote assistance system according to claim 1, characterized in that: It also includes an ID account acquisition module (8) capable of acquiring the real-time ID address of a user who needs remote assistance, and a GPS locator (9) of the real-time location of the ID account. The GPS locator (9) and the ID account acquisition module (8) are electrically connected to the bank remote business processing system (7).

3. The remote assistance system for handling financial services according to claim 1 or 2, characterized in that: The bank remote business processing system (7) is also connected to an alarm (10).

4. The remote assistance system for handling financial services according to claim 3, characterized in that: The bank remote business processing system (7) is also connected to an encryption system (11) for encrypting data.

5. The remote assistance system for handling financial services according to claim 3, characterized in that: The mobile terminal controller (4) is also connected to a session destruction command module (13). The session destruction command module (13) saves session information generated during a session between the mobile terminal controller (4) and the bank's remote business processing system (7), and sends the session information to the mobile terminal controller (4). Once an abnormality is found during the session, the session data is encrypted and packaged and sent to the bank's remote business processing system (7), and the session data in the mobile terminal controller (4) is destroyed.

6. A remote assistance method for handling financial services, comprising the remote assistance system for handling financial services as claimed in any one of claims 1 to 5, characterized in that: The specific steps are as follows: S1. Pre-create a suspicion threshold FM; S2. When the business handling mobile phone APP (1) receives the business handling demand of the target customer, it sends a session establishment message to the mobile terminal controller (4) according to the business handling demand, first performs user identity identification, and if the user identity information does not exist at present, immediately creates the user target identity information and sends it to the bank remote business handling system (7). The bank remote business handling system (7) obtains the user target identity information and saves it; S3, the bank remote business processing system (7) automatically generates a user head portrait picture frame HP and a user iris image NI according to the stored user target identity information; S4. If it is detected that the user identity information is currently stored, the target customer is authenticated according to the encrypted target identity information, and a session is established with the bank's remote business processing system (7) after passing the authentication. S5. During the conversation, firstly, the real-time image information of the user who is handling the business in the business handling mobile phone APP (1) is obtained in real time through the camera (2); the real-time iris information of the user who is handling the business in the business handling mobile phone APP (1) is obtained in real time through the iris recognition sensor (3); the image recognizer (5) receives the real-time image information of the user through the bank's remote business handling system (7); the anti-AI application tool (12) performs real-time judgment on the video received by the bank's remote business handling system (7) to obtain the real-time threshold of whether it is AI; then, according to formula 1, it is judged whether the current user is an abnormal user; if not, it goes to step S6; if so, no processing is performed; Sy=IF(H1≠HP or / and N1≠NI or / and H2≠HP or / and X1≦FM ) (Formula 1) In the above formula, H1 is the user image information acquired in real time by the camera (2); N1 is the iris information acquired in real time by the iris recognition sensor (3); H2 is the user image real-time information received by the image recognizer (5) through the bank remote business processing system (7); X1 is the real-time threshold value of whether the anti-AI application tool (12) determines in real time whether the video received by the bank remote business processing system (7) is AI; S6. Guiding the target customer to perform corresponding business processing according to the prompt type and prompt information.

7. The financial business remote assistance system and method according to claim 6, characterized in that: In step S5, if it is determined that the target customer has an abnormality based on the camera (2) and the iris recognition sensor (3), the current session with the bank's remote business processing system (7) is terminated.

8. The remote assistance method for handling financial services according to claim 7, characterized in that: Convolutional neural network is used to calculate the real-time threshold of AI.

9. The remote assistance method for handling financial services according to claim 6, characterized in that: In the real-time threshold calculation process of AI, filtering, edge detection, color feature, and texture feature detection are required.

10. The remote assistance method for handling financial services according to claim 6, characterized in that: In the calculation process of N1, it is necessary to calculate according to the following formula; N1=π*(pupil diameter / 2)^2 (Formula 2); Among them, π is pi, and pupil diameter is the diameter of the iris.

Images