Business processing system and business processing method for hearing-impaired people

Abstract

This application discloses a business processing system and method for hearing-impaired individuals, relating to the field of financial technology. The system comprises: a gesture glove for collecting sign language information emitted by gesture movements of a first target object; a sign language conversion module for converting the sign language information collected by the gesture glove into text information, and vice versa; a speech conversion module for converting text information into speech information, and vice versa; and a speech recognition module for collecting speech information from a second target object. This application addresses the problem in the related art of a lack of business processing systems for financial institutions serving hearing-impaired individuals, resulting in relatively low efficiency for hearing-impaired individuals in handling business.

Description

Technical Field

[0001] The present application relates to the field of financial technology, and more specifically, to a business processing system and method for hearing-impaired persons. Background Art

[0002] Currently, there are nearly 28 million people with hearing impairments, and they face widespread communication barriers with the hearing-impaired, especially those who only know sign language and are illiterate. In a society designed to prioritize services for the able-bodied, hearing-impaired individuals often face inconvenience and difficulty, and smoothly completing financial institution transactions is one such challenge. The financial institution transaction process involves basic communication, the collection of personal privacy information, and the setting and input of account passwords. For hearing-impaired individuals, communication difficulties with financial institution staff who lack sign language skills and a lack of effective privacy protection present challenges.

[0003] There is currently no effective solution to the problem that there is a lack of business processing systems for financial institutions that serve the hearing-impaired, which leads to relatively low efficiency in handling business for the hearing-impaired. Summary of the Invention

[0004] The main purpose of this application is to provide a business processing system and business processing method for the hearing-impaired, so as to solve the problem in the related art that there is a lack of business processing systems of financial institutions serving the hearing-impaired, resulting in relatively low efficiency in handling business for the hearing-impaired.

[0005] To achieve the above objectives, according to one aspect of the present application, a business processing system for hearing-impaired persons is provided. The system comprises: a gesture glove for collecting sign language information emitted by gesture movements of a first target object, wherein the first target object is a hearing-impaired person; a sign language conversion module for converting the sign language information collected by the gesture glove into text information, and vice versa; a speech conversion module for converting the text information into speech information, and vice versa; and a speech recognition module for collecting speech information of a second target object, wherein the second target object is a non-hearing-impaired person. In the process of the first target object processing a target business, the gesture glove collects the sign language information of the first target object, the sign language conversion module and the speech conversion module convert the sign language information into text and speech information, and the text and speech information are sent to the second target object; the speech recognition module collects the speech information of the second target object, and the sign language conversion module and the speech conversion module convert the speech information of the second target object into sign language information, and the sign language information is displayed to the first target object to assist the first target object in processing the target business.

[0006] Furthermore, the sign language conversion module further includes: a sign language recognition submodule for performing semantic recognition on the sign language information to obtain target semantic information; and a sign language conversion submodule for converting the target semantic information into the text information.

[0007] Furthermore, the system also includes: a sign language action database, used to store the sign language information and key value information corresponding to the sign language information; a business processing module, used to display multiple businesses that can be handled through a preset display method, and respond to the selection instruction of the first target object to determine the target business from the multiple businesses, wherein the preset display method includes at least: text and video; an identity authentication module, used to verify the identity information of the first target object; a customer information database, used to store the identity information of the hearing-impaired person and the handled business information.

[0008] In order to achieve the above-mentioned purpose, according to one aspect of the present application, a business processing method for hearing-impaired people is provided. The method includes: displaying multiple businesses that can be handled through a preset display method, and responding to the selection instruction of the first target object to determine the target business from the multiple businesses, wherein the preset display method includes at least: text and video; collecting the first target sign language information of the first target object through a gesture glove, and collecting the target voice information of the second target object through a voice recognition module, wherein the first target sign language information is a gesture sign language representing the business data information required by the target business; converting the first target sign language information and the target voice information through a sign language conversion module and a voice recognition module to determine whether the business data information is accurate; if the business data information is accurate, verifying the account information of the first target object, and if the account information verification is passed, handling the target business according to the business data information.

[0009] Furthermore, before displaying multiple services that can be handled in a preset display method, the method also includes: determining whether the first target object has registered a target type account, wherein the target type account is an account corresponding to the hearing-impaired person; if the first target object has registered the target type account, the identity information of the first target object is verified through the identity authentication module; if the identity information of the first target object is verified, the business processing module for the hearing-impaired person is started.

[0010] Furthermore, the method also includes: if the first target object has not registered the target type account, starting the registration process of the target type account; obtaining the target data information of the first target object, wherein the target data information at least includes: the identity information of the first target object and the proof information of the hearing impairment of the first target object; verifying the authenticity of the target data information, and if the verification is successful, obtaining the first biometric feature of the first target object, and opening the target type account of the first target object based on the first biometric feature, wherein the first biometric feature is at least one of the following: facial image information, fingerprint information and finger vein information; entering the data information of the target type account into the target application in the mobile terminal of the first target object.

[0011] Furthermore, after the target type account of the first target object is opened based on the first biometric feature, the method also includes: starting the account password setting process of the target type account; determining multiple preset characters for setting the account password, and randomly matching a preset picture with each preset character, wherein the preset picture contains a specific object; displaying the preset characters and the corresponding preset pictures to the first target object; collecting the second target sign language information generated by the first target object in random order based on each preset picture through the gesture glove, and storing the second target sign language information in the customer information database; collecting the third target sign language information generated by the first target object for the preset picture through the gesture glove; converting the third target sign language information into a first target character combination through the sign language conversion module, wherein the first target character combination is the account password of the target type account; storing the account password of the target type account and the preset picture in the customer information database.

[0012] Furthermore, when the business data information is accurate, verifying the account information of the first target object includes: obtaining the preset pictures and randomly matching the preset characters for each preset picture; collecting the fourth target sign language information generated by the first target object for the preset pictures through the gesture gloves; judging whether the fourth target sign language information exists in the second target sign language information; if so, converting the fourth target sign language information into a second target character combination through the sign language conversion module; if the second target character combination is the same as the account password, obtaining the second biometric feature of the first target object, and verifying the second biometric feature and the first biometric feature. If the verification is successful, it indicates that the account information verification is successful.

[0013] In order to achieve the above-mentioned purpose, according to another aspect of the present application, a business processing device for hearing-impaired people is provided. The device includes: a determination unit, which is used to display multiple businesses that can be handled through a preset display method, and respond to the selection instruction of the first target object to determine the target business from the multiple businesses, wherein the preset display method includes at least: text and video; a first acquisition unit, which is used to collect the first target sign language information of the first target object through a gesture glove, and collect the target voice information of the second target object through a voice recognition module, wherein the first target sign language information is a gesture sign language representing the business data information required by the target business; a first conversion unit, which is used to convert the first target sign language information and the target voice information through a sign language conversion module and a voice recognition module to determine whether the business data information is accurate; a first verification unit, which is used to verify the account information of the first target object if the business data information is accurate, and if the account information verification is passed, handle the target business according to the business data information.

[0014] Furthermore, the device also includes: a first determination unit, used to determine whether the first target object has registered a target type account before displaying multiple services that can be handled in a preset display method, wherein the target type account is an account corresponding to the hearing-impaired person; a second verification unit, used to verify the identity information of the first target object through an identity authentication module if the first target object has registered the target type account; and a first starting unit, used to start the business processing module for the hearing-impaired person if the identity information of the first target object is verified.

[0015] Furthermore, the device also includes: a second starting unit, used to start the registration process of the target type account if the first target object has not registered the target type account; an acquisition unit, used to obtain target data information of the first target object, wherein the target data information at least includes: identity information of the first target object and proof information of hearing impairment of the first target object; an activation unit, used to verify the authenticity of the target data information, and if the verification is successful, obtain the first biometric feature of the first target object, and activate the target type account of the first target object based on the first biometric feature, wherein the first biometric feature is at least one of the following: facial image information, fingerprint information and finger vein information; an entry unit, used to enter the data information of the target type account into the target application in the mobile terminal of the first target object.

[0016] Furthermore, the device also includes: a third starting unit, used to start the account password setting process of the target type account after opening the target type account of the first target object based on the first biometric feature; a second determination unit, used to determine multiple preset characters for setting the account password, and randomly match a preset picture for each preset character, wherein the preset picture contains a specific object; a display unit, used to display the preset characters and the corresponding preset pictures to the first target object; a second collection unit, used to collect the second target sign language information generated by the first target object in random order based on each preset picture through the gesture glove, and store the second target sign language information in the customer information database; a third collection unit, used to collect the third target sign language information generated by the first target object for the preset picture through the gesture glove; a second conversion unit, used to convert the third target sign language information into a first target character combination through the sign language conversion module, wherein the first target character combination is the account password of the target type account; a storage unit, used to store the account password of the target type account and the preset picture in the customer information database.

[0017] Furthermore, the first verification unit includes: an acquisition module, used to acquire the preset picture and randomly match the preset characters for each preset picture; a collection module, used to collect the fourth target sign language information generated by the first target object for the preset picture through the gesture glove; a judgment module, used to judge whether the fourth target sign language information exists in the second target sign language information; a conversion module, used to convert the fourth target sign language information into a second target character combination through the sign language conversion module if it exists; a determination module, used to obtain the second biometric feature of the first target object if the second target character combination is the same as the account password, and verify the second biometric feature with the first biometric feature. If the verification is passed, it indicates that the account information verification is passed.

[0018] In order to achieve the above-mentioned purpose, according to one aspect of the present application, a processor is provided, which is used to run a program, wherein the program executes any one of the above-mentioned service processing methods for the hearing-impaired when running.

[0019] In order to achieve the above-mentioned purpose, according to one aspect of the present application, an electronic device is provided, which includes one or more processors and a memory, and the memory is used to store one or more processors to implement any of the above-mentioned business processing methods for the hearing-impaired.

[0020] In the business processing system for hearing-impaired persons provided in the present application, a gesture glove is used to collect sign language information emitted by gesture movements of a first target object, wherein the first target object is a hearing-impaired person; a sign language conversion module is used to convert the sign language information collected by the gesture glove into text information, and vice versa; a voice conversion module is used to convert text information into voice information, and vice versa; and a voice recognition module is used to collect voice information of a second target object, wherein the second target object is a non-hearing-impaired person. In the process of the first target object processing a target business, the gesture glove collects the sign language information of the first target object, the sign language conversion module and the voice conversion module convert the sign language information into text and voice information, and the text and voice information are sent to the second target object; the voice information of the second target object is collected by the voice recognition module, the sign language conversion module and the voice conversion module convert the voice information of the second target object into sign language information, and the sign language information is displayed to the first target object to assist the first target object in processing the target business. This solves the problem in the related art of the lack of business processing systems of financial institutions serving the hearing-impaired, which leads to relatively low efficiency in handling business for the hearing-impaired. The sign language information of the hearing-impaired is obtained through gesture gloves, the voice information of the non-hearing-impaired is obtained through the voice recognition module, and the sign language conversion module and the voice conversion module are used to simultaneously display sign language, text and voice information in the interaction between the non-hearing-impaired and the hearing-impaired, thereby overcoming the communication difficulties between the hearing-impaired and the non-hearing-impaired, and thus achieving the effect of improving the efficiency of the hearing-impaired in handling business. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings, which constitute part of this application, are intended to provide a further understanding of this application. The exemplary embodiments and descriptions of this application are intended to explain this application and do not constitute an improper limitation on this application. In the accompanying drawings:

[0022] Figure 1 is a schematic diagram of a service processing system for hearing-impaired persons provided according to an embodiment of the present application;

[0023] Figure 2 is a flowchart of a service processing method for hearing-impaired persons provided in accordance with an embodiment of the present application;

[0024] Figure 3 is a schematic diagram of registering a target type account according to an embodiment of the present application;

[0025] Figure 4 This is a flowchart of setting an account password according to an embodiment of the present application;

[0026] Figure 5 This is a flowchart of verifying account information according to an embodiment of the present application;

[0027] Figure 6 is a flowchart of an optional service processing method for hearing-impaired persons provided according to an embodiment of the present application;

[0028] Figure 7 This is a flowchart of the interaction between a hearing-impaired person and a business processing system for the hearing-impaired provided in an embodiment of the present application;

[0029] Figure 8 A schematic diagram of a service processing device for hearing-impaired persons provided according to an embodiment of the present application;

[0030] Figure 9 Schematic diagram of an electronic device provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0031] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in this application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0032] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0033] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0034] It should be noted that the relevant information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display and analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties. For example, an interface is set up between this system and the relevant user or organization. Before obtaining relevant information, it is necessary to send an acquisition request to the aforementioned user or organization through the interface, and obtain the relevant information after receiving the consent information fed back by the aforementioned user or organization.

[0035] The following describes the service processing system for hearing-impaired people proposed in this application. Figure 1 is a schematic diagram of a service processing system for hearing-impaired persons provided according to an embodiment of the present application. Figure 1 As shown, the system includes:

[0036] The gesture glove 10 is used to collect sign language information emitted by gesture movements of a first target object, wherein the first target object is a hearing-impaired person; the sign language conversion module 11 is used to convert the sign language information collected by the gesture glove into text information, and convert the text information into sign language information; the voice conversion module 12 is used to convert the text information into voice information, and convert the voice information into text information; the voice recognition module 13 is used to collect voice information of a second target object, wherein the second target object is a non-hearing-impaired person; wherein, in the process of the first target object processing the target business, the sign language information of the first target object is collected by the gesture glove, and the sign language information is converted into text and voice information by the sign language conversion module and the voice conversion module, and the text and voice information are sent to the second target object, the voice information of the second target object is collected by the voice recognition module, and the voice information of the second target object is converted into sign language information by the sign language conversion module and the voice conversion module, and the sign language information is displayed to the first target object to assist the first target object in processing the target business.

[0037] Specifically, if Figure 1As shown, the business processing system for hearing-impaired individuals can include the following components: a gesture glove 10, a sign language conversion module 11, a speech conversion module 12, and a speech recognition module 13. The gesture glove 10 collects sign language information generated by the gesture movements of the first target subject (the hearing-impaired individual) in real time. The speech recognition module 13 extracts the verbal expressions of the financial institution employee in real time and, through semantic recognition training using machine learning, identifies the most accurate meaning corresponding to the corpus. The speech recognition module 13 is connected to the speech conversion module 12 and transmits the recognized corpus to the speech conversion module 12. The sign language conversion module 11 extracts valid sign language data from the gesture glove 10 for hearing-impaired individuals in real time. Through repeated machine learning training and manual proofreading, it extracts the most accurate meaning corresponding to the sign language data and converts the sign language information into text information for display on the screen. The sign language conversion module 11 is connected to the speech conversion module 12. After receiving the text information, the speech conversion module 12 converts the text information into speech information. The speech conversion module 12 is responsible for converting text to speech and vice versa, facilitating rapid understanding between the financial institution employee (non-hearing-impaired) and the hearing-impaired individual.

[0038] In an optional embodiment, the specific business processing flow is as follows:

[0039] The system initiates a service transaction. The customer (the first target) wears a hand gesture glove to transmit sign language gesture data to the system. The system displays available services using both sign language animations (videos) and text captions. These services include at least transfers, deposits and withdrawals, account details inquiries, bill payments, and credit card repayments. The customer can determine the service they wish to process by reading the sign language / text on the screen and clicking on the desired service. The customer uses the hand gesture glove to communicate in sign language, and the system begins receiving data from the hand gesture glove. The system analyzes the data transmitted by the hand gesture glove, invokes the sign language conversion module 11 and the speech recognition module 13 to perform sign language recognition, and converts the sign language information into text or speech for the financial institution staff (the second target) to receive the customer's request. The staff confirms the service request via voice or text, invokes the sign language conversion module 11 and the speech recognition module 13 to convert the speech into text or sign language for the customer to confirm, and finally completes the service transaction.

[0040] In summary, the above system overcomes the communication difficulties between hearing-impaired people and non-hearing-impaired people, and improves the efficiency of hearing-impaired people in handling business.

[0041] The sign language conversion module 11 further includes: a sign language recognition submodule 111 for performing semantic recognition on sign language information to obtain target semantic information; and a sign language conversion submodule 112 for converting the target semantic information into text information.

[0042] The sign language recognition submodule 111 recognizes the semantic information of the sign language information and sends the recognized sign language information and its semantics to the sign language conversion submodule 112, waiting for the next step of text conversion. The sign language conversion submodule 112 restores the sign language information received in the sign language recognition submodule 111 into a gesture action animation video, which makes it easier for hearing-impaired customers to confirm the accuracy of the sign language received by the gesture gloves. At the same time, the sign language conversion submodule 112 converts the sign language information into text information based on the semantic information obtained in the sign language recognition submodule 111 and displays it on the screen. The sign language conversion submodule 112 is connected to the voice conversion module 12 and transmits the text information to the voice conversion module 12 so that the voice conversion module 12 can convert the text information into voice information.

[0043] Through the above sub-modules, the sign language information of the hearing-impaired and the voice information of the non-hearing-impaired can be accurately identified, thereby achieving barrier-free communication between the hearing-impaired and non-hearing-impaired people.

[0044] The above-mentioned system also includes: a sign language action database 14, which is used to store sign language information and key value information corresponding to the sign language information; a business processing module 15, which is used to display multiple businesses that can be handled through a preset display method, and respond to the selection instruction of the first target object to determine the target business from multiple businesses, wherein the preset display method includes at least: text and video; an identity authentication module 16, which is used to verify the identity information of the first target object; a customer information database 17, which is used to store the identity information of the hearing-impaired and the information of the business that has been handled.

[0045] The sign language action database 14 is used to collect the sign language data recorded by the gesture glove and store the key values of the sign language actions and corresponding meanings so that the sign language recognition submodule 111 can call them.

[0046] The business processing module 15 provides service selection and processing, including at least five basic services: transfers, deposits and withdrawals, account details inquiries, bill payments, and credit card repayments. To implement these functions, in accordance with the financial institution's business processes, the business processing module 15 is also responsible for setting and verifying account passwords to protect the privacy of hearing-impaired individuals. The business processing module 15 is connected to the customer information database 17. The business processing module 15 stores information generated during the business processing process, including the identity information of the hearing-impaired individual and actual business information such as account balances, in the customer information database 17.

[0047] The identity authentication module 16 verifies the identity information of the hearing-impaired person. After the verification, the module will automatically start the business processing module 15 dedicated to serving the hearing-impaired person. The identity of the hearing-impaired person can be verified in the following two ways: using a target type account dedicated to the hearing-impaired person (for example, a physical card) or using an APP (target mobile terminal). The identity information provided by both methods includes ID card information, disability certificate information, processed bank card information, first biometric information, etc. The identity authentication module 16 is connected to the customer information database 17, so that the identity authentication module 16 calls the existing customer data to verify the information of the hearing-impaired person who comes to the branch. In addition, the identity authentication module 16 is directly connected to the business processing module 15, which facilitates the identity authentication module 16 to transmit the legally authorized customer information to the business processing module 15 for further business processing.

[0048] In the business processing system for hearing-impaired persons provided in the present application, a gesture glove is used to collect sign language information emitted by gesture movements of a first target object, wherein the first target object is a hearing-impaired person; a sign language conversion module is used to convert the sign language information collected by the gesture glove into text information, and vice versa; a voice conversion module is used to convert text information into voice information, and vice versa; and a voice recognition module is used to collect voice information of a second target object, wherein the second target object is a non-hearing-impaired person. In the process of the first target object processing a target business, the gesture glove collects the sign language information of the first target object, the sign language conversion module and the voice conversion module convert the sign language information into text and voice information, and the text and voice information are sent to the second target object; the voice information of the second target object is collected by the voice recognition module, the sign language conversion module and the voice conversion module convert the voice information of the second target object into sign language information, and the sign language information is displayed to the first target object to assist the first target object in processing the target business. This solves the problem in the related art of the lack of business processing systems of financial institutions serving the hearing-impaired, which leads to relatively low efficiency in handling business for the hearing-impaired. The sign language information of the hearing-impaired is obtained through gesture gloves, the voice information of the non-hearing-impaired is obtained through the voice recognition module, and the sign language conversion module and the voice conversion module are used to simultaneously display sign language, text and voice information in the interaction between the non-hearing-impaired and the hearing-impaired, thereby overcoming the communication difficulties between the hearing-impaired and the non-hearing-impaired, and thus achieving the effect of improving the efficiency of the hearing-impaired in handling business.

[0049] The present invention will be described below in conjunction with preferred implementation steps. Figure 2 is a flowchart of a service processing method for hearing-impaired persons provided in accordance with an embodiment of the present application. Figure 2 As shown, the method includes the following steps:

[0050] Step S201 : Display multiple services that can be handled in a preset display mode, and determine a target service from the multiple services in response to a selection instruction of a first target object, wherein the preset display mode includes at least text and video.

[0051] Step S202: collecting first target sign language information of the first target object through the gesture glove, and collecting target voice information of the second target object through the voice recognition module, wherein the first target sign language information is a gesture sign language representing business data information required by the target business.

[0052] Step S203: converting the first target sign language information and the target voice information through the sign language conversion module and the voice recognition module to determine whether the service data information is accurate.

[0053] Step S204: If the business data information is accurate, verify the account information of the first target object, and if the account information verification passes, handle the target business according to the business data information.

[0054] Specifically, the business processing system displays selectable services in a pre-set display format, including at least the following: transfers, deposits and withdrawals, account details inquiries, bill payments, and credit card repayments. The hearing-impaired individual (i.e., the first target person) can select the desired service by clicking on the screen. The business processing system responds to the first target person's selection instruction and selects the target service from the multiple services.

[0055] A hearing-impaired person wears a hand gesture glove and uses sign language to express their needs. The system receives and analyzes the data transmitted by the hand gesture glove, calls the sign language conversion module 11 and the speech recognition module 13 to perform sign language recognition, and converts the sign language information into text or speech for the financial institution staff (the second target object mentioned above) to receive the customer's needs. The financial institution staff confirms the business needs through voice or text, and calls the sign language conversion module 11 and the speech recognition module 13 to convert the speech into text or sign language for the customer to confirm the information.

[0056] For example, a hearing-impaired person needs to confirm the correct names of the transferor and recipient, their card numbers, and the transfer amount. If correct, the hearing-impaired person's account information is obtained to complete the transaction. If incorrect, a new round of two-way communication using sign language and voice is initiated. It should be noted that this account information can include the password and biometric information that the hearing-impaired person previously set when applying for the target account type. After obtaining the hearing-impaired person's account information, the account information is verified, and if verified, the target transaction is processed.

[0057] In summary, using text as a medium to achieve a mutual conversion mechanism between sign language and speech facilitates communication between the hearing-impaired and non-hearing-impaired. Using gesture gloves to collect sign language data, rather than traditional video recording, not only accurately recognizes gestures but also overcomes the problem of gestures being obscured during video recording, improving the accuracy of sign language information recognition.

[0058] Before displaying multiple services that can be handled in a preset display method, the following operations need to be performed: determine whether the first target object has registered a target type account, where the target type account is an account corresponding to the hearing-impaired person; if the first target object has registered a target type account, verify the identity information of the first target object through the identity authentication module; if the identity information of the first target object is verified, start the business processing module for the hearing-impaired person.

[0059] Specifically, determine whether the first target object has registered relevant identity information in the above system and registered a dedicated account (i.e. the above target type account). If the hearing-impaired person is a registered hearing-impaired customer in the above system, the identity of the first target object is authenticated. The identity verification of the hearing-impaired person can be carried out in the following two ways: using a target type account dedicated to the hearing-impaired person (for example, a physical card) or using an APP. The identity information provided by both methods includes identity card information, disability certificate information, processed bank card information, first biometric information, etc. When the identity authentication is passed, the business processing module for the hearing-impaired person is started. For the first target object that has not yet registered, the registration process of the target type account is started.

[0060] Through the above steps, the identity authentication of the first target object is achieved to ensure the security of the information data.

[0061] For a first target object that has not yet registered, initiating a registration process for a target type account includes the following: obtaining target data information of the first target object, wherein the target data information at least includes: identity information of the first target object and proof information of the first target object's hearing impairment; verifying the authenticity of the target data information, and if the verification is successful, obtaining a first biometric feature of the first target object, and opening a target type account for the first target object based on the first biometric feature, wherein the first biometric feature is at least one of the following: facial image information, fingerprint information, and finger vein information; and entering the data information of the target type account into a target application in the mobile terminal of the first target object.

[0062] Specifically, if Figure 3As shown, the above-mentioned business processing system starts the registration process of the target type account, and the first target object provides identity documents such as identity card, hearing impairment certificate (such as disability certificate) (that is, the above-mentioned target data information). The above-mentioned business processing system verifies the authenticity of the target data information. If the verification is passed, the first biometric feature of the first target object is collected, and the first biometric feature includes at least facial image, fingerprint, finger vein and other features. The above-mentioned business processing system opens an exclusive target type account (for example, a physical card) based on the first biometric feature of the first target object. The physical card integrates the identity information of the first target object, the first biometric feature, account information, etc. The above-mentioned business processing system assists the first target object to enter the physical card information into the APP (that is, the above-mentioned target application) to facilitate identity information verification when handling business next time.

[0063] Through the above steps, it is ensured that the hearing-impaired can realize barrier-free business processing through the above-mentioned business processing system, thereby improving the efficiency of business processing for the hearing-impaired.

[0064] In order to ensure the information security of hearing-impaired people, the account password is set in the following way: start the account password setting process of the target type account; determine multiple preset characters for setting the account password, and randomly match a preset picture for each preset character, wherein the preset picture contains a specific object; display the preset characters and the corresponding preset picture to the first target object; collect the second target sign language information generated by the first target object in random order based on each preset picture through gesture gloves, and store the second target sign language information in the customer information database; collect the third target sign language information generated by the first target object for the preset picture through gesture gloves; convert the third target sign language information into a first target character combination through the sign language conversion module, wherein the first target character combination is the account password of the target type account; store the account password and preset picture of the target type account in the customer information database.

[0065] Specifically, if Figure 4As shown, the business processing system receives registered account information and initiates the account and password setting process. The business processing system determines multiple preset characters for setting the account and password, and randomly assigns a preset image to each preset character. For example, using the data 0-9 as the multiple preset characters, the numbers 0 to 9 are randomly assigned ten preset images, each of which depicts an animal. First, the first target user enters the sign language information for all preset images (i.e., the second target sign language information) as prompted by the system and stores it in the customer information database. The first target user enters the sign language gestures corresponding to the image content of the preset characters (i.e., the third target sign language information) as prompted by the system. The system receives the sign language data collected by the gesture glove and records it in the customer information database. A six-digit password is set by using sign language to represent the image content corresponding to the preset characters. The sign language conversion module converts the third target sign language information into the first target character combination (i.e., the account and password). The business processing system stores the sign language signal along with the converted account and password in the customer information database.

[0066] In summary, completing the account password setting process for hearing-impaired people through preset pictures can effectively improve the security of sensitive information.

[0067] In the business processing method for hearing-impaired persons provided in an embodiment of the present application, when the business data information is accurate, the account information of the first target object is verified in the following manner: obtaining preset pictures, and randomly matching preset characters with each preset picture; collecting the fourth target sign language information generated by the first target object for the preset pictures through gesture gloves; judging whether the fourth target sign language information exists in the second target sign language information; if so, converting the fourth target sign language information into a second target character combination through a sign language conversion module; if the second target character combination is the same as the account password, obtaining the second biometric feature of the first target object, and verifying the second biometric feature and the first biometric feature. If the verification passes, it indicates that the account information verification has passed.

[0068] Specifically, if Figure 5 As shown, the business processing system extracts multiple preset images from the customer information database that the first target person used when setting their account and password based on their identity information. It then randomly assigns a preset character to each image. For example, when setting their account and password, the image corresponding to the number 1 is a bear. When entering their account and password, the image corresponding to the number 1 is changed to another preset image, and the bear image is assigned to a different number. This process continues until all images are assigned to new, different numbers. This step effectively prevents unauthorized individuals from capturing the hand gestures used to express the password during password entry and impersonating hearing-impaired individuals to reproduce specific sign language combinations.

[0069] The gesture glove is used to collect the sign language information of the first target object according to the preset picture content currently corresponding to the account and password. First, it is determined whether the fourth target sign language information exists in the second target sign language information. This is to determine whether it is the sign language information of the same target object. After it is determined that it is the sign language information of the same target object (that is, the fourth target sign language information exists in the second target sign language information), the sign language information is converted into the corresponding character combination (that is, the above-mentioned second target character combination) through the sign language conversion module. It should be noted that in an optional embodiment, if it is determined three times in a row that the fourth target sign language information does not exist in the second target sign language information, the loop is exited.

[0070] The second target character combination is compared with the account password in the customer information database. If the password is correct, the first target subject's biometric characteristic (i.e., the second biometric characteristic) is collected and compared with the first biometric characteristic already entered in the customer information database. If the second biometric characteristic is correct, the account information verification is successful. If the number of incorrect answers exceeds three, the system will exit the verification process.

[0071] In an optional embodiment, the Figure 6 The flowchart shown in the figure is used to realize business processing. Figure 6 As shown, the system begins accepting new hearing-impaired customers. It checks whether the hearing-impaired customer has registered their identity information and applies for a dedicated physical card. If the customer is a registered hearing-impaired customer, they place the physical sign language card on an external identification device or use a pre-installed, customized sign language app to scan the QR code at the counter to verify their identity and activate the sign language system. For hearing-impaired customers who haven't registered yet, the account registration process begins. The screen displays available services using both text and sign language animations, including at least five: transfers, deposits and withdrawals, account details inquiries, bill payments, and credit card repayments. Hearing-impaired customers can select the desired service by tapping the screen. When hearing-impaired customers wear hand gesture gloves and communicate with financial institution staff using sign language to express their needs, the system invokes the sign language conversion module and the speech conversion module to convert the sign language information into text or speech for the staff to receive. The staff confirms the service request via voice or text and assists the customer in completing the service process. The sign language conversion module and the speech conversion module convert the speech information into text or sign language for the customer and staff to complete the communication. The customer confirms the transaction details and verifies the customer's account information. If the verification is successful, the transaction is processed.

[0072] In an optional embodiment, the Figure 7The flowchart shown implements the information exchange process between a hearing-impaired customer and the aforementioned service processing system. The system begins a new round of service processing. The hearing-impaired customer wears a hand gesture glove to transmit sign language gesture data to the aforementioned system. The aforementioned system displays various available services using both sign language animations and text titles. These services include at least: transfers, deposits and withdrawals, account details inquiries, bill payments, and credit card repayments. The hearing-impaired customer can determine the service they wish to handle by reading the sign language / text on the screen and clicking on the desired service. Simultaneously, the aforementioned system begins receiving sign language information from the hand gesture glove. The system uses the sign language recognition and conversion submodules to perform sign language recognition on the data transmitted by the hand gesture glove, analyze and recover the original sign language gestures conveyed by the hearing-impaired customer, and then reproduce the hearing-impaired customer's sign language on the screen in the form of an animation. The hearing-impaired customer confirms the sign language gestures received by the system. If the information is correct, the human-computer sign language interaction ends; otherwise, the user's sign language information is received again.

[0073] In summary, this application demonstrates outstanding advantages in the following aspects:

[0074] 1. The business processing system for the hearing-impaired uses text as a medium to realize the mutual conversion mechanism between sign language and voice, making it easier for the hearing-impaired and non-hearing-impaired people to communicate.

[0075] 2. During the business processing process, the account password is set by using a random pattern of sign language expressions corresponding to characters, which can effectively protect the sensitive information of hearing-impaired people from being leaked.

[0076] 3. Using gesture gloves to collect sign language data instead of traditional video recording can not only accurately recognize gestures, but also overcome the situation where gestures may be blocked during video recording, and have a faster data conversion processing speed.

[0077] The business processing method for the hearing-impaired provided in the embodiment of the present application displays multiple businesses that can be handled through a preset display method, and responds to the selection instruction of the first target object to determine the target business from the multiple businesses, wherein the preset display method includes at least: text and video; first target sign language information of the first target object is collected through gesture gloves, and target voice information of the second target object is collected through a voice recognition module, wherein the first target sign language information is a gesture sign language representing the business data information required by the target business; the first target sign language information and the target voice information are converted through a sign language conversion module and a voice recognition module to determine whether the business data information is accurate; if the business data information is accurate, the account information of the first target object is verified, and if the account information verification is passed, the target business is handled according to the business data information, which solves the problem in the related art that there is a lack of business processing systems for financial institutions serving the hearing-impaired, resulting in relatively low efficiency in handling business for the hearing-impaired. The sign language information of the hearing-impaired is obtained through gesture gloves, the voice information of the non-hearing-impaired is obtained through the voice recognition module, and the sign language conversion module and the voice conversion module are used to simultaneously display sign language, text and voice information in the interaction between the non-hearing-impaired and the hearing-impaired, thereby overcoming the communication difficulties between the hearing-impaired and the non-hearing-impaired, and thus achieving the effect of improving the efficiency of the hearing-impaired in handling business.

[0078] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0079] The present application also provides a service processing device for hearing-impaired persons. It should be noted that the service processing device for hearing-impaired persons in the present application can be used to execute the service processing method for hearing-impaired persons provided in the present application. The following describes the service processing device for hearing-impaired persons provided in the present application.

[0080] Figure 8 Schematic diagram of a service processing device for hearing-impaired persons according to an embodiment of the present application. Figure 8 As shown, the device includes: a determination unit 801 , a first acquisition unit 802 , a first conversion unit 803 and a first verification unit 804 .

[0081] The determining unit 801 is configured to display a plurality of available services in a preset display mode, and determine a target service from the plurality of services in response to a selection instruction from a first target object, wherein the preset display mode includes at least text and video.

[0082] A first collecting unit 802 is configured to collect first target sign language information of a first target subject through a gesture glove, and collect target voice information of a second target subject through a voice recognition module, wherein the first target sign language information is a gesture sign language indicating business data information required by a target business;

[0083] The first conversion unit 803 is configured to convert the first target sign language information and the target voice information through the sign language conversion module and the voice recognition module to determine whether the service data information is accurate;

[0084] The first verification unit 804 is used to verify the account information of the first target object when the business data information is accurate, and to process the target business according to the business data information when the account information verification passes.

[0085] The business processing device for the hearing-impaired provided in the embodiment of the present application is configured, through a determination unit 801, to display multiple businesses that can be handled through a preset display method, and to determine a target business from the multiple businesses in response to a selection instruction of a first target object, wherein the preset display method includes at least: text and video; a first collection unit 802 is configured to collect first target sign language information of the first target object through a gesture glove, and to collect target voice information of the second target object through a voice recognition module, wherein the first target sign language information is a gesture sign language representing business data information required by the target business; a first conversion unit 803 is configured to convert the first target sign language information and the target voice information through a sign language conversion module and a voice recognition module to determine whether the business data information is accurate; a first verification unit 804 is configured to verify the account information of the first target object when the business data information is accurate, and to handle the target business based on the business data information when the account information verification is passed, thereby solving the problem in the related art that there is a lack of business processing systems for financial institutions serving the hearing-impaired, resulting in relatively low efficiency in handling business for the hearing-impaired. The sign language information of the hearing-impaired is obtained through gesture gloves, the voice information of the non-hearing-impaired is obtained through the voice recognition module, and the sign language conversion module and the voice conversion module are used to simultaneously display sign language, text and voice information in the interaction between the non-hearing-impaired and the hearing-impaired, thereby overcoming the communication difficulties between the hearing-impaired and the non-hearing-impaired, and thus achieving the effect of improving the efficiency of the hearing-impaired in handling business.

[0086] Optionally, in the business processing device for the hearing-impaired provided in the embodiment of the present application, the device also includes: a first determination unit, used to determine whether the first target object has registered a target type account before displaying multiple businesses that can be handled in a preset display method, wherein the target type account is an account corresponding to the hearing-impaired person; a second verification unit, used to verify the identity information of the first target object through an identity authentication module if the first target object has registered a target type account; and a first starting unit, used to start the business processing module for the hearing-impaired if the identity information of the first target object is verified.

[0087] Optionally, in the business processing device for hearing-impaired persons provided in an embodiment of the present application, the device further includes: a second starting unit, for starting the registration process of a target type account if the first target object has not registered a target type account; an acquisition unit, for acquiring target data information of the first target object, wherein the target data information includes at least: identity information of the first target object and proof information of the hearing impairment of the first target object; an activation unit, for verifying the authenticity of the target data information, and if the verification is passed, obtaining the first biometric feature of the first target object, and activating the target type account of the first target object based on the first biometric feature, wherein the first biometric feature is at least one of the following: facial image information, fingerprint information and finger vein information; an entry unit, for entering the data information of the target type account into the target application in the mobile terminal of the first target object.

[0088] Optionally, in the business processing device for hearing-impaired persons provided in an embodiment of the present application, the device further includes: a third starting unit, for starting the account password setting process of the target type account after the target type account of the first target object is opened based on the first biometric feature; a second determination unit, for determining multiple preset characters for setting the account password, and randomly matching a preset picture with each preset character, wherein the preset picture contains a specific object; a display unit, for displaying the preset characters and the corresponding preset pictures to the first target object; a second collection unit, for collecting second target sign language information generated in random order by the first target object based on each preset picture through gesture gloves, and storing the second target sign language information in a customer information database; a third collection unit, for collecting third target sign language information generated by the first target object for the preset picture through gesture gloves; a second conversion unit, for converting the third target sign language information into a first target character combination through a sign language conversion module, wherein the first target character combination is the account password of the target type account; a storage unit, for storing the account password and preset picture of the target type account in the customer information database.

[0089] Optionally, in the business processing device for hearing-impaired persons provided in an embodiment of the present application, the first verification unit includes: an acquisition module for acquiring preset pictures and randomly matching preset characters with each preset picture; a collection module for collecting fourth target sign language information generated by the first target object for the preset pictures through gesture gloves; a judgment module for judging whether the fourth target sign language information exists in the second target sign language information; a conversion module for converting the fourth target sign language information into a second target character combination through the sign language conversion module if the fourth target sign language information exists; and a determination module for acquiring the second biometric feature of the first target object if the second target character combination is the same as the account password, and verifying the second biometric feature with the first biometric feature. If the verification passes, it indicates that the account information verification passes.

[0090] The business processing device for the hearing-impaired includes a processor and a memory. The above-mentioned determination unit 801, first acquisition unit 802, first conversion unit 803 and first verification unit 804 are all stored in the memory as program units, and the processor executes the above-mentioned program units stored in the memory to implement corresponding functions.

[0091] The processor contains a kernel, which retrieves the corresponding program unit from the memory. There can be one or more kernels, and business processing can be achieved by adjusting the kernel parameters.

[0092] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0093] An embodiment of the present invention provides a processor, which is used to run a program, wherein the program executes a service processing method for hearing-impaired people when running.

[0094] like Figure 9As shown, an embodiment of the present invention provides an electronic device, which includes a processor, a memory, and a program stored in the memory and capable of running on the processor. When the processor executes the program, the following steps are implemented: displaying multiple services that can be handled in a preset display method, and responding to the selection instruction of the first target object to determine the target business from the multiple services, wherein the preset display method at least includes: text and video; collecting first target sign language information of the first target object through gesture gloves, and collecting target voice information of the second target object through a voice recognition module, wherein the first target sign language information is a gesture sign language representing the business data information required by the target business; converting the first target sign language information and the target voice information through a sign language conversion module and a voice recognition module to determine whether the business data information is accurate; if the business data information is accurate, verifying the account information of the first target object, and if the account information verification is passed, handling the target business based on the business data information.

[0095] Optionally, before displaying multiple services that can be handled in a preset display manner, the method also includes: determining whether the first target object has registered a target type account, wherein the target type account is an account corresponding to the hearing-impaired person; if the first target object has registered a target type account, verifying the identity information of the first target object through the identity authentication module; if the identity information of the first target object is verified, starting the business processing module for the hearing-impaired person.

[0096] Optionally, the method also includes: if the first target object has not registered a target type account, starting a registration process for a target type account; obtaining target data information of the first target object, wherein the target data information at least includes: identity information of the first target object and proof information of the first target object's hearing impairment; verifying the authenticity of the target data information, and if the verification is successful, obtaining a first biometric feature of the first target object, and opening a target type account for the first target object based on the first biometric feature, wherein the first biometric feature is at least one of the following: facial image information, fingerprint information, and finger vein information; and entering the data information of the target type account into a target application in the mobile terminal of the first target object.

[0097] Optionally, after opening the target type account of the first target object based on the first biometric feature, the method also includes: starting the account password setting process of the target type account; determining multiple preset characters for setting the account password, and randomly matching a preset picture with each preset character, wherein the preset picture contains a specific object; displaying the preset characters and the corresponding preset pictures to the first target object; collecting second target sign language information generated by the first target object in random order based on each preset picture through gesture gloves, and storing the second target sign language information in the customer information database; collecting third target sign language information generated by the first target object for the preset picture through gesture gloves; converting the third target sign language information into a first target character combination through a sign language conversion module, wherein the first target character combination is the account password of the target type account; storing the account password and the preset picture of the target type account in the customer information database.

[0098] Optionally, when the business data information is accurate, verifying the account information of the first target object includes: obtaining preset pictures and randomly matching preset characters to each preset picture; collecting the fourth target sign language information generated by the first target object for the preset pictures through gesture gloves; judging whether the fourth target sign language information exists in the second target sign language information; if so, converting the fourth target sign language information into a second target character combination through a sign language conversion module; if the second target character combination is the same as the account password, obtaining the second biometric feature of the first target object, and verifying the second biometric feature and the first biometric feature. If the verification passes, it indicates that the account information verification is passed.

[0099] The devices in this article can be servers, PCs, PADs, mobile phones, etc.

[0100] The present application also provides a computer program product, which, when executed on a data processing device, is suitable for executing a program initialized with the following method steps: displaying multiple businesses that can be handled through a preset display method, and responding to the selection instruction of the first target object to determine the target business from the multiple businesses, wherein the preset display method at least includes: text and video; collecting first target sign language information of the first target object through a gesture glove, and collecting target voice information of the second target object through a voice recognition module, wherein the first target sign language information is a gesture sign language representing the business data information required by the target business; converting the first target sign language information and the target voice information through a sign language conversion module and a voice recognition module to determine whether the business data information is accurate; if the business data information is accurate, verifying the account information of the first target object, and if the account information verification is passed, handling the target business based on the business data information.

[0101] Optionally, before displaying multiple services that can be handled in a preset display manner, the method also includes: determining whether the first target object has registered a target type account, wherein the target type account is an account corresponding to the hearing-impaired person; if the first target object has registered a target type account, verifying the identity information of the first target object through the identity authentication module; if the identity information of the first target object is verified, starting the business processing module for the hearing-impaired person.

[0102] Optionally, the method also includes: if the first target object has not registered a target type account, starting a registration process for a target type account; obtaining target data information of the first target object, wherein the target data information at least includes: identity information of the first target object and proof information of the first target object's hearing impairment; verifying the authenticity of the target data information, and if the verification is successful, obtaining a first biometric feature of the first target object, and opening a target type account for the first target object based on the first biometric feature, wherein the first biometric feature is at least one of the following: facial image information, fingerprint information, and finger vein information; and entering the data information of the target type account into a target application in the mobile terminal of the first target object.

[0103] Optionally, after opening the target type account of the first target object based on the first biometric feature, the method also includes: starting the account password setting process of the target type account; determining multiple preset characters for setting the account password, and randomly matching a preset picture with each preset character, wherein the preset picture contains a specific object; displaying the preset characters and the corresponding preset pictures to the first target object; collecting second target sign language information generated by the first target object in random order based on each preset picture through gesture gloves, and storing the second target sign language information in the customer information database; collecting third target sign language information generated by the first target object for the preset picture through gesture gloves; converting the third target sign language information into a first target character combination through a sign language conversion module, wherein the first target character combination is the account password of the target type account; storing the account password and the preset picture of the target type account in the customer information database.

[0104] Optionally, when the business data information is accurate, verifying the account information of the first target object includes: obtaining preset pictures and randomly matching preset characters with each preset picture; collecting the fourth target sign language information generated by the first target object for the preset pictures through gesture gloves; judging whether the fourth target sign language information exists in the second target sign language information; if so, converting the fourth target sign language information into a second target character combination through a sign language conversion module; if the second target character combination is the same as the account password, obtaining the second biometric feature of the first target object, and verifying the second biometric feature and the first biometric feature. If the verification passes, it indicates that the account information verification is passed.

[0105] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0106] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0107] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0108] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0109] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0110] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0111] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0112] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0113] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0114] The above are merely embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should all be included within the scope of the claims of the present application.

Claims

1. A business processing system for hearing-impaired people, characterized in that: include: A gesture glove for collecting sign language information emitted by a gesture movement of a first target object, wherein the first target object is a hearing-impaired person; A sign language conversion module, configured to convert the sign language information collected by the gesture glove into text information, and to convert the text information into the sign language information; A voice conversion module, configured to convert the text information into voice information, and convert the voice information into the text information; a speech recognition module, configured to collect speech information of a second target object, wherein the second target object is a person who is not hearing-impaired; Wherein, in the process of the first target object processing the target business, the gesture glove collects the sign language information of the first target object, converts the sign language information into text information and voice information through the sign language conversion module and the voice conversion module, and sends the text information and the voice information to the second target object, collects the voice information of the second target object through the voice recognition module, converts the voice information of the second target object into sign language information through the sign language conversion module and the voice conversion module, and displays the sign language information to the first target object to assist the first target object in processing the target business; The target business to be processed by the first target object is obtained from a plurality of businesses that can be processed displayed in a preset display method; before the plurality of businesses that can be processed are displayed in a preset display method, it is determined whether the first target object has registered a target type account; If the first target object has not registered the target type account, start the registration process of the target type account; Acquire target data information of the first target object, wherein the target data information at least includes: identity information of the first target object and certification information of hearing impairment of the first target object; Verifying the authenticity of the target data information; if the verification passes, obtaining a first biometric characteristic of the first target object; and opening a target type account of the first target object based on the first biometric characteristic, wherein the first biometric characteristic is at least one of the following: facial image information, fingerprint information, and finger vein information; Enter the data information of the target type account into the target application in the mobile terminal of the first target object.

2. The system according to claim 1, wherein: The sign language conversion module also includes: A sign language recognition submodule, configured to perform semantic recognition on the sign language information to obtain target semantic information; The sign language conversion submodule is used to convert the target semantic information into the text information.

3. The system according to claim 1, wherein: The system further comprises: A sign language action database, used to store the sign language information and key value information corresponding to the sign language information; a business processing module, configured to present a plurality of available businesses in a preset presentation mode, and to determine a target business from the plurality of businesses in response to a selection instruction from the first target object, wherein the preset presentation mode includes at least text and video; An identity authentication module, configured to verify the identity information of the first target object; The customer information database is used to store the identity information of the hearing-impaired person and the business information that has been processed.

4. A service processing method for hearing-impaired persons, characterized in that: The method is applied to the service processing system for hearing-impaired persons according to any one of claims 1 to 3, comprising: Displaying a plurality of services that can be handled in a preset display mode, and determining a target service from the plurality of services in response to a selection instruction of the first target object, wherein the preset display mode includes at least: text and video; collecting first target sign language information of the first target object through the gesture glove, and collecting target voice information of the second target object through the voice recognition module, wherein the first target sign language information is a gesture sign language representing business data information required by the target business; Converting the first target sign language information and the target voice information through a sign language conversion module and a voice recognition module to determine whether the service data information is accurate; If the business data information is accurate, verify the account information of the first target object, and if the account information verification passes, handle the target business according to the business data information; The method further includes determining whether the first target object has registered a target type account before displaying the multiple services that can be handled in a preset display manner; If the first target object has not registered the target type account, start the registration process of the target type account; Acquire target data information of the first target object, wherein the target data information at least includes: identity information of the first target object and certification information of hearing impairment of the first target object; Verifying the authenticity of the target data information; if the verification passes, obtaining a first biometric characteristic of the first target object; and opening a target type account of the first target object based on the first biometric characteristic, wherein the first biometric characteristic is at least one of the following: facial image information, fingerprint information, and finger vein information; Enter the data information of the target type account into the target application in the mobile terminal of the first target object.

5. The method according to claim 4, characterized in that Before displaying the plurality of services that can be handled in a preset display manner, the method further includes: Determining whether the first target object has registered a target type account, wherein the target type account is an account corresponding to the hearing-impaired population; If the first target object has registered the target type account, verifying the identity information of the first target object through the identity authentication module; If the identity information of the first target object is verified, the service processing module for the hearing-impaired person is started.

6. The method according to claim 5, characterized in that After opening a target type account of the first target object based on the first biometric feature, the method further includes: Initiate the account password setting process for the target type account; Determining a plurality of preset characters for setting the account password, and randomly assigning a preset picture to each of the preset characters, wherein the preset picture includes a specific object; Displaying the preset character and the corresponding preset picture to the first target object; collecting, by the gesture glove, second target sign language information generated randomly by the first target object according to each preset picture, and storing the second target sign language information in a customer information database; collecting, by the gesture glove, third target sign language information generated by the first target object for the preset picture; converting the third target sign language information into a first target character combination by the sign language conversion module, wherein the first target character combination is the account password of the target type account; The account password of the target type account and the preset picture are stored in the customer information database.

7. The method according to claim 6, characterized in that When the business data information is accurate, verifying the account information of the first target object includes: Obtain the preset pictures, and randomly match the preset characters to each preset picture; collecting, by the gesture glove, fourth target sign language information generated by the first target object in response to the preset picture; determining whether the fourth target sign language information exists in the second target sign language information; If so, converting the fourth target sign language information into a second target character combination through the sign language conversion module; If the second target character combination is the same as the account password, the second biometric feature of the first target object is obtained, and the second biometric feature is verified with the first biometric feature. If the verification is successful, it indicates that the account information verification is successful.

8. A service processing device for hearing-impaired persons, characterized in that: include: a determination unit, configured to display a plurality of services that can be handled in a preset display mode, and determine a target service from the plurality of services in response to a selection instruction from a first target object, wherein the preset display mode includes at least text and video; a first collecting unit, configured to collect first target sign language information of the first target subject through a gesture glove, and collect target voice information of the second target subject through a voice recognition module, wherein the first target sign language information is a gesture sign language representing business data information required by the target business; a first conversion unit, configured to convert the first target sign language information and the target voice information through a sign language conversion module and a voice recognition module to determine whether the service data information is accurate; a first verification unit, configured to verify the account information of the first target object if the business data information is accurate, and to process the target business according to the business data information if the account information verification passes; The device is further configured to obtain, by the first target object, a target service from a plurality of services that can be handled by displaying the plurality of services that can be handled in a preset display manner; and determine whether the first target object has registered a target type account before displaying the plurality of services that can be handled in a preset display manner; The device is further configured to, if the first target object has not registered the target type account, initiate a registration process for the target type account; obtain target data information of the first target object, wherein the target data information includes at least: identity information of the first target object and proof of hearing impairment of the first target object; verify the authenticity of the target data information, and if the verification is successful, obtain a first biometric feature of the first target object, and activate a target type account for the first target object based on the first biometric feature, wherein the first biometric feature is at least one of the following: facial image information, fingerprint information, and finger vein information; and enter the data information of the target type account into a target application in the mobile terminal of the first target object.

9. A processor, characterized in that: The processor is used to run a program, wherein the program, when running, executes the service processing method for the hearing-impaired according to any one of claims 4 to 7.

10. An electronic device, characterized in that: The invention comprises one or more processors and a memory, wherein the memory is used to store one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the business processing method for the hearing-impaired as described in any one of claims 4 to 7.

Images