Self-service method and system

Abstract

This application provides a self-service method and system, relating to the field of intelligent service devices, and applicable to the financial sector and other fields. The method includes: collecting first operation information from user feedback based on received trigger information; obtaining corresponding coordinate base points based on the first operation information; acquiring multiple operation options from the current operation interface information of the self-service device; rearranging the operation options according to the coordinate base points using a random sorting algorithm to generate virtual operation options; generating voice guidance information based on the virtual operation options and the coordinate base points; obtaining input options based on second operation information from user feedback based on the voice guidance information and the virtual operation options; and completing the user self-service based on the input options.

Description

Technical Field

[0001] This application relates to the field of intelligent service devices, which can be applied to the financial sector and other fields, and particularly to a self-service method and system. Background Technology

[0002] Currently, there are a large number of visually impaired people in the market, but the design of self-service equipment is still relatively traditional, making it inconvenient for them to operate when depositing or withdrawing money. Although some self-service equipment now has tactile Braille, there is still a possibility that visually impaired people who cannot read Braille may use it. Furthermore, even if visually impaired people can read Braille and complete the input, the inherent limitations of the equipment mean that their operation is vulnerable to being spied on by others, leading to password leaks and significantly increasing the risk of financial loss.

[0003] To address this issue, existing technologies have proposed a self-service device with user identification capabilities. This device can identify the number of people in the current operating area and provide appropriate voice prompts to the operator to inform them of the risks. However, in scenarios where most users are concentrated, this prompt is not very effective, as it cannot effectively distinguish whether nearby non-operators are illegal individuals or users of adjacent devices. Therefore, this solution not only fails to effectively help visually impaired individuals confirm their surroundings but also causes unnecessary panic, affecting the user experience and significantly increasing the cost of modifying the device.

[0004] Therefore, the industry urgently needs a safe, effective, and low-cost self-service method to help visually impaired people complete self-service tasks. Summary of the Invention

[0005] The purpose of this application is to provide a self-service method and system that uses voice prompts in conjunction with a virtual keyboard to construct self-service logic, thereby avoiding unnecessary risks and losses for visually impaired individuals during the self-service process.

[0006] To achieve the above objectives, this application provides a self-service method, the method comprising: collecting first operation information from user feedback based on received trigger information; obtaining a corresponding coordinate base point based on the first operation information; acquiring multiple operation options from the current operation interface information of the self-service device; rearranging the operation options according to the coordinate base point using a random sorting algorithm to generate virtual operation options; generating voice guidance information based on the virtual operation options and the coordinate base point; obtaining input options based on second operation information from user feedback based on the voice guidance information and the virtual operation options; and completing the user self-service based on the input options.

[0007] In the above self-service method, optionally, collecting the first operation information based on the received trigger information includes: obtaining the usage status of a preset associated audio playback device based on the received trigger information; playing a preset prompt message through the audio playback device based on the usage status; and generating the first operation information based on the operation data fed back by the user based on the prompt message.

[0008] In the above self-service method, optionally, generating the first operation information based on the operation data fed back by the user according to the prompt information includes: monitoring the user's operation data on the input interface of the self-service device, starting from the completion time of the prompt information playback; and generating the first operation information based on the operation data.

[0009] In the above self-service method, optionally, broadcasting the preset prompt information through the audio playback device according to the usage status further includes: stopping the display screen output operation option of the self-service device according to the usage status; or, controlling the display screen of the self-service device to output preset image data according to the usage status.

[0010] In the above self-service method, optionally, obtaining the corresponding coordinate base point based on the first operation information includes: parsing the first operation information to obtain coordinate information; and generating a coordinate base point based on the coordinate information when the coordinate information is within a preset coordinate range.

[0011] Optionally, in the above self-service method, completing the user self-service according to the operation instruction further includes: when the operation instruction is an input password option, randomly sorting the numbers on the numeric keypad using a random sorting algorithm to generate a random virtual keyboard centered on the coordinate base point; generating input voice information based on the positional relationship between the user's touch position on the current operation interface and the coordinate base point and the random virtual keyboard; generating input instructions based on the input voice information and the third operation information fed back by the user; generating password data based on multiple input instructions combined in the input order; and providing the password data to a preset server.

[0012] Optionally, in the above self-service method, completing the user self-service according to the operation instruction further includes: when the operation instruction is an input password option, requesting password prompt voice data from a preset server based on the user identity information corresponding to the trigger information; playing multiple sets of different password prompt voice data under the same identifier through the audio playback device, and monitoring the user's sliding trajectory on the current operation interface; generating an input instruction based on the correspondence between the password prompt voice data and the sliding trajectory, merging multiple input instructions in the input order to generate password data; and providing the password data and the identifier to the preset server after associating and binding them.

[0013] This application also provides a self-service system applicable to the aforementioned self-service method. The system includes a self-service terminal and a server. The self-service terminal collects first operation information from user feedback based on received trigger information and obtains corresponding coordinate base points based on the first operation information. It acquires multiple operation options from the current operation interface information of the self-service terminal, rearranges the operation options according to the coordinate base points using a random sorting algorithm, and generates virtual operation options. It generates voice guidance information based on the virtual operation options and the coordinate base points, obtains input options through second operation information fed back by the user based on the voice guidance information and the virtual operation options, and provides the input options to the server to complete the user self-service processing.

[0014] In the aforementioned self-service system, optionally, the self-service terminal includes a processing module, an input module, an audio module, and a storage module; the audio module is stored in a preset slot of the self-service terminal through the storage module, and is used to play preset audio data according to the audio information provided by the processing module; the input module is located on the user side of the self-service terminal, and is used to collect user input data; the processing module is used to provide preset start-up audio information to the audio module according to the received trigger information, and collect the usage status of the audio module; play preset prompt information through the audio playback device according to the usage status; and obtain user operation data through the input module, generate input options according to the operation data; and provide the input options to the server to complete the user self-service processing; wherein, the audio module includes any one of in-ear headphones, bone conduction headphones, and noise-canceling headphones.

[0015] This application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the above-described method.

[0016] This application also provides a computer-readable storage medium storing a computer program that performs the above-described methods.

[0017] This application also provides a computer program product, including a computer program / instructions that, when executed by a processor, implement the steps of the above-described method.

[0018] The beneficial technical effects of this application are as follows: by turning off the display screen and using special audio equipment, prompts are effectively provided to the user while preventing others from watching; by using voice prompts to build different interaction methods with different users, the operation information cannot be reproduced, thereby avoiding financial losses caused by illegal copying operations. Attached Figure Description

[0019] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, do not constitute a limitation thereof. In the drawings:

[0020] Figure 1 A flowchart illustrating a self-service method provided in an embodiment of this application;

[0021] Figure 2 This is a schematic diagram illustrating the process of obtaining coordinate base points according to an embodiment of this application;

[0022] Figure 3 This is a schematic diagram of the process for obtaining first operation information provided in an embodiment of this application;

[0023] Figure 4 This is a schematic diagram of a password obfuscation input process provided in an embodiment of this application;

[0024] Figure 5 This is a schematic diagram of a password obfuscation input process provided in an embodiment of this application;

[0025] Figure 6 This is a schematic diagram of the structure of a self-service system provided in an embodiment of this application;

[0026] Figure 7 This is a schematic diagram of the structure of an ATM device provided in an embodiment of this application;

[0027] Figure 8 This is a schematic diagram of the original layout of a virtual keyboard provided in an embodiment of this application;

[0028] Figure 9 This is a schematic diagram of the adjusted layout of the virtual keyboard provided in one embodiment of this application;

[0029] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0030] The following will describe in detail the implementation methods of this application with reference to the accompanying drawings and embodiments, so as to fully understand how this application uses technical means to solve technical problems and achieve technical effects, and to implement it accordingly. It should be noted that, as long as there is no conflict, the various embodiments and features in each embodiment of this application can be combined with each other, and the resulting technical solutions are all within the protection scope of this application.

[0031] Furthermore, the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0032] Please refer to Figure 1 As shown, this application provides a self-service method, the method comprising:

[0033] S101 collects the first operation information fed back by the user based on the received trigger information, and obtains the corresponding coordinate base point based on the first operation information;

[0034] S102 obtains multiple operation options from the current operation interface information of the self-service device, and rearranges the operation options according to the coordinate base point using a random sorting algorithm to generate virtual operation options;

[0035] S103 generates voice guidance information based on the virtual operation options and the coordinate base point, and obtains input options through the second operation information fed back by the user based on the voice guidance information and the virtual operation options;

[0036] S104 completes the user self-service based on the input options.

[0037] In the above embodiments, the triggering information can be the initial information of various starting devices, such as the triggering information of an ATM or the button start information of a vending machine. This application does not impose any restrictions on this. The first operation information fed back by the user can be the touch information collected by specific button information, such as the position information of the user touching the touch screen once or multiple times after pressing a button with special texture (Braille). It can also be the position information collected by the user directly touching the touch screen after inserting the card, or the first key information pressed by the user in the preset keyboard area after inserting the card. The specific selection scheme can be set according to actual needs. This application does not impose any restrictions on this. Subsequently, after converting the location information into coordinate base points, virtual operation options can be constructed centered on these base points. For example, if the original input keyboard uses the standard 9 key and the center point is 5, when the user selects the 6 key from the coordinate base point, the center point of the virtual keyboard becomes the position of the 6 key. The physical 6 key corresponds to the virtual 5 key. In other words, the virtual operation options are constructed centered on the coordinate base point, creating a virtual keyboard layout known only to the user. Based on this, when the user presses the physical key 6, the corresponding option is the same as the option corresponding to the original physical key 5. Unauthorized personnel, even if they witness a user pressing the physical key 6, cannot determine whether the pressed information is 6 or something else, thus avoiding the risk of user operation information leakage. Then, based on the user's pressed operation information and the virtual operation options, the user's actual input options can be obtained, thereby completing the corresponding business processing.

[0038] Please refer to Figure 2As shown, in the above embodiments, obtaining the corresponding coordinate base point based on the first operation information may include:

[0039] S201 obtains coordinate information by parsing the first operation information;

[0040] S202 When the coordinate information is within the preset coordinate range, a coordinate base point is generated based on the coordinate information.

[0041] Specifically, since the coordinate base point serves as the center point of the virtual operation options, there are certain limitations on the range of its location. The virtual operation options are more effective when the base point is set at a non-boundary location. If the base point is set at a boundary location and that location is used as the center point, at least one side of the buttons will be difficult to correspond to the virtual operation options, greatly increasing the user's operational difficulty. Therefore, in practice, the coordinate information parsed from the first operation information can be compared with the preset coordinate range. If it does not conform to the relevant rules, the user should be prompted to re-determine the location, thereby reducing unnecessary operational difficulty and subsequent operation time costs.

[0042] Most existing self-service devices use images or videos to guide users, but these methods are not helpful for visually impaired individuals. Therefore, please refer to... Figure 3 As shown, in one embodiment of this application, the first operation information collected based on the received trigger information includes:

[0043] S301 obtains the usage status of a preset associated audio playback device based on the received trigger information, and plays the preset prompt information through the audio playback device according to the usage status;

[0044] S302 generates the first operation information based on the operation data provided by the user according to the prompt information.

[0045] The process of generating the first operation information based on the user's feedback operation data may include: monitoring the user's operation data on the input interface of the self-service device, starting from the completion time of the prompt information playback; and generating the first operation information based on the operation data.

[0046] Specifically, in the process of visually impaired individuals using self-service equipment, accidental touches are common in the early stages, rendering the collected operation information invalid. Therefore, for this group, the usage status of a specific audio playback device can be used to determine whether the user has acknowledged the start of a valid operation monitoring. Collecting relevant touch information only after the user acknowledges the start of monitoring significantly reduces the complexity of subsequent operations and helps the user quickly determine the coordinate base point. For example, after hearing a prompt, the user selects the first key pressed or the first touch as the center point. At this point, the user can determine the key or touch location and use it as the center to select the target operation option based on subsequent prompts. If the user does not promptly notice the coordinate base point, subsequent operations become difficult to continue. In this embodiment, to reduce the occurrence of misjudgments of the operation data, multiple short-frequency operations at the same location can also be set as the first operation information. For example, after prompting the user to confirm the coordinate base point, if the user quickly presses a physical button three times within 2 seconds, it indicates that the user has selected that location and that it is not an accidental touch. Similarly, a similar operation can be used to determine the first operation information for the touch screen.

[0047] In one embodiment of this application, broadcasting preset prompt information through the audio playback device according to the usage status further includes: stopping the self-service device's display screen output operation options according to the usage status; or, controlling the self-service device's display screen to output preset image data according to the usage status.

[0048] Specifically, in this embodiment, to prevent unauthorized personnel from viewing the user's input progress and inferring the user's relevant privacy information, the screen display content can be turned off or converted to preset image information after the user receives the voice prompt. In this way, when the user performs relevant operations, unauthorized personnel cannot know what information or operation the content corresponds to. This solution, combined with virtual operation options, will more effectively protect the user's privacy and provide a safe input experience for visually impaired people.

[0049] Please refer to Figure 4 As shown in one embodiment of this application, completing the user self-service according to the operation instructions further includes:

[0050] S401 When the operation instruction is to input a password option, the numbers in the numeric keypad are randomly sorted using a random sorting algorithm to generate a random virtual keypad centered on the coordinate base point.

[0051] S402 generates input voice information based on the positional relationship between the user's touch position on the current operation interface and the coordinate base point and the random virtual keyboard, and generates input commands based on the input voice information and the third operation information fed back by the user.

[0052] S403 generates password data based on a plurality of input instructions combined in the input order, and provides the password data to a preset server.

[0053] The above embodiments primarily address more reliable and secure input methods for more important input options, such as password input. Specifically, when confirming a user's password input, the original numeric keypad mapping is modified to a more complex randomized arrangement. For example, the original keypad layout typically uses a sequence where the first row, from left to right, is 123; the second row, from left to right, is 456; the third row, from left to right, is 789; and the key 8 is positioned directly below 0. The solution provided in this application modifies this sequence to a randomized structure, for example, using a sequence where the first row, from left to right, is 751; the second row, from left to right, is 832; and the third row, from left to right, is 906. The sorting structure directly below the number 0 is 4. The coordinate base point for this sorting structure is 3. When the user presses the original 3 key, a voice prompt will indicate that the 3 key represents 1, asking the user to confirm. If the user confirms, they press the original 3 key again. This process continues until the user has entered their password. The system then combines this voice prompt with the user's input information to generate an input command, which is submitted to the server for password verification. Unauthorized individuals, unable to hear the voice prompts and unaware of the digit represented by the pressed 3 key, cannot obtain the user's complete password.

[0054] Please refer to Figure 5 As shown in one embodiment of this application, completing the user self-service according to the operation instructions further includes:

[0055] S501 When the operation instruction is to input a password option, the system requests password prompt voice data from a preset server based on the user identity information corresponding to the trigger information.

[0056] S502 plays multiple sets of different password prompt voice data under the same identifier through the audio playback device, and monitors the user's sliding trajectory on the current operation interface;

[0057] S503 generates input instructions based on the correspondence between the password prompt voice data and the sliding trajectory, and merges multiple input instructions in the input order to generate password data;

[0058] S504 After associating and binding the password data and the identifier, it provides them to the preset server.

[0059] In certain application scenarios, self-service devices cannot obtain the user's real password information. In such cases, the user's real password can be deduced through the aforementioned voice prompts and the user's key input (third operation information), which does not meet the requirements of these special application scenarios and poses a certain risk of user privacy leakage. Therefore, in this embodiment, the self-service device requests relevant voice prompts from a remote server when confirming the password input option. The virtual keyboard is not constructed by the self-service device. Secondly, the server will generate one or more interference values ​​based on the actual set values ​​of each number in the user's real password (this can use existing cryptographic encryption algorithms). Then, these interference values ​​and the actual set values ​​are mapped to a trajectory. Finally, a password prompt voice is generated based on this correspondence. After hearing the password prompt voice, the user can select the corresponding sliding trajectory to confirm the real value. At this time, the self-service device can only collect the user's sliding trajectory data and cannot determine what value the sliding trajectory represents, thus it cannot deduce the user's real password. Subsequently, the server finds the correspondence based on the received identifier and compares the user's input password with the sliding trajectory to complete the relevant verification. This greatly improves the security of the user's password input process.

[0060] Please refer to Figure 6 As shown, this application also provides a self-service system applicable to the self-service method described above. The system includes a self-service terminal and a server. The self-service terminal collects first operation information from user feedback based on received trigger information, and obtains corresponding coordinate base points based on the first operation information. It acquires multiple operation options from the current operation interface information of the self-service terminal, and rearranges the operation options according to the coordinate base points using a random sorting algorithm to generate virtual operation options. It generates voice guidance information based on the virtual operation options and the coordinate base points, and obtains input options through second operation information fed back by the user based on the voice guidance information and the virtual operation options. The input options are then provided to the server to complete the user self-service processing.

[0061] The self-service terminal includes a processing module, an input module, an audio module, and a storage module. The audio module is stored in a preset slot within the self-service terminal via the storage module and is used to play preset audio data based on audio information provided by the processing module. The input module is located near the user on the self-service terminal and is used to collect user input data. The processing module provides preset startup audio information to the audio module based on received trigger information and collects the usage status of the audio module. Based on the usage status, it plays preset prompt information through the audio playback device. It also obtains user operation data through the input module, generates input options based on the operation data, and provides the input options to the server to complete user self-service processing. The audio module includes any one of in-ear headphones, bone conduction headphones, and noise-canceling headphones.

[0062] To facilitate a clearer understanding of the structure of the self-service system provided in this application, the following uses ATMs used by banks as self-service terminals to illustrate practical application scenarios. Those skilled in the art will understand that this example does not limit the technical solutions provided in this application.

[0063] Please refer to Figure 7 As shown, in one embodiment, the self-service terminal may include a card slot 1, a cash dispensing slot 2, a receipt slot 3, a voice prompt speaker 4, a button A5, a bone conduction wired headset 6, a retractable wired connection port 7, a button B8, a volume slider 9, and a virtual keyboard 10; in actual use, its operation process is as follows:

[0064] 1. Touch-sensitive Braille prompts are installed at the card slot 1, cash dispenser 2, and receipt slot 3 of the ATM machine for blind people who can read Braille to use.

[0065] 2. The ATM has a voice prompt speaker 4. After inserting the card, it will prompt you to click button A5 on the control panel to open the hidden compartment and get the bone conduction wired headphones 6. This can help blind people, especially those who cannot read Braille, to use the ATM and also protect their privacy when depositing or withdrawing money.

[0066] 3. The control panel has button A5 next to the hidden compartment. Button A5 also has a corresponding Braille prompt. After clicking button A5, the movable door above the hidden compartment will slide open, and the lifting plate in the hidden compartment will rise. The wire of the bone conduction wired headphones 6 is connected to the lifting plate. The voice prompt speaker 4 will indicate that the headphones have been raised and provide relevant usage instructions, so that the blind person can pick up and use the headphones.

[0067] 4. When in use, pull out the headphone cable. It will automatically position itself to adjust the cable length. There is a volume slider 9 on the lifting plate to adjust the headphone volume. There is also a button B8 on the lifting plate. Clicking it once will pause or resume, and clicking it twice will replay the audio. When finished using, pull out 2-3cm through the retractable wired connection port 7 to cancel the positioning. The headphone cable will automatically retract under the restoring force of the spring-loaded automatic retractable cable winder. This avoids the headphone cable from getting tangled and inconvenient to untangle, and also prevents blind users from accidentally closing the hidden compartment and getting the headphone cable stuck if it is not fully inserted.

[0068] 5. After clicking the hidden compartment button A5, the ATM screen will go black to prevent privacy leaks.

[0069] 6. After clicking the hidden compartment button A5, the headphones will begin playing a list of the buttons on the left and right sides of the ATM screen from top to bottom. For example: on the left side of the screen, the first button from top to bottom is for transfer services, the second button is for top-up and bill payment, the third button is... On the right side of the screen, the first button from top to bottom is for changing the password, the second button is for inquiry services, the third button is...

[0070] 7. After the blind person puts on the bone conduction wired headphones 6, they can adjust the volume to a suitable level using the volume slider 9 and start operating the service according to the prompts in the bone conduction wired headphones 6. Each time a button next to the ATM screen is clicked, the headphones will play the button being pressed and then start a new round of playback.

[0071] 8. When using the virtual keyboard 10 (which is tilted at a certain angle), the bone conduction wired headset 6 will display a prompt similar to the ATM virtual keyboard 10: To avoid privacy breaches when using the virtual keyboard 10, please press any non-edge key within the 5x5 square keys as the center key. This center key will be the number 5 on the virtual keyboard. The surrounding square keys will form a 3x3 virtual numeric keypad. From top to bottom, the first row from left to right will be numbered 1, 2, 3; the second row from left to right will be numbered 4, 5, 6; and the third row from left to right will be numbered 7, 8, 9. The circular key to the right of the 5x5 square keys, when pressed once, will be the number 0; pressed twice, it will clear; and pressed three times, it will confirm. If the blind person accidentally presses an edge square key, the bone conduction wired headset 6 will display a key error message and then continue to prompt that the blind person should press any non-edge key within the 5x5 square keys as the center key. The headset will also play the corresponding key presses when the key is pressed, making the keyboard operation clearer for the blind person. (See example) Figure 8 and Figure 9 )

[0072] 9. After the deposit or withdrawal operation is completed, follow the voice prompts in the headset, click the card eject button, the playback in the headset will stop, and the ATM machine's voice prompt will prompt you to put the bone conduction wired headset 6, click the hidden compartment button A5 to close the hidden compartment, and then you can retrieve your card.

[0073] 10. Different button shapes or sizes can be designed during setup to help blind people distinguish between the two buttons.

[0074] The beneficial technical effects of this application are as follows: by turning off the display screen and using special audio equipment, prompts are effectively provided to the user while preventing others from watching; by using voice prompts to build different interaction methods with different users, the operation information cannot be reproduced, thereby avoiding financial losses caused by illegal copying operations.

[0075] This application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the above-described method.

[0076] This application also provides a computer-readable storage medium storing a computer program that performs the above-described methods.

[0077] This application also provides a computer program product, including a computer program / instructions that, when executed by a processor, implement the steps of the above-described method.

[0078] like Figure 10 As shown, the electronic device 600 may also include: a communication module 110, an input unit 120, an audio processor 130, a display 160, and a power supply 170. It is worth noting that the electronic device 600 does not necessarily need to include these components. Figure 10 All components shown; in addition, the electronic device 600 may also include Figure 10 For components not shown, please refer to existing technologies.

[0079] like Figure 10 As shown, the central processing unit 100, sometimes also referred to as a controller or operating control, may include a microprocessor or other processor device and / or logic device. The central processing unit 100 receives inputs and controls the operation of various components of the electronic device 600.

[0080] The memory 140 may be, for example, one or more of a cache, flash memory, hard drive, removable media, volatile memory, non-volatile memory, or other suitable devices. It may store the aforementioned failure-related information, and also store a program for executing that information. The central processing unit 100 may execute the program stored in the memory 140 to perform information storage or processing, etc.

[0081] Input unit 120 provides input to central processing unit 100. Input unit 120 may be, for example, a keypad or touch input device. Power supply 170 provides power to electronic device 600. Display 160 displays images and text. Display may be, for example, an LCD display, but is not limited thereto.

[0082] The memory 140 can be a solid-state memory, such as a read-only memory (ROM), random access memory (RAM), a SIM card, etc. It can also be a memory that retains information even when power is off, can be selectively erased, and contains more data; examples of this type of memory are sometimes referred to as EPROMs. The memory 140 can also be some other type of device. The memory 140 includes a buffer memory 141 (sometimes referred to as a buffer). The memory 140 may include an application / function storage unit 142 for storing application programs and function programs or processes for executing the operation of the electronic device 600 via the central processing unit 100.

[0083] The memory 140 may also include a data storage unit (data 143) for storing data, such as contacts, digital data, pictures, sounds, and / or any other data used by the electronic device. The driver storage unit (driver 144) of the memory 140 may include various drivers for the electronic device's communication functions and / or for performing other functions of the electronic device (such as messaging applications, address book applications, etc.).

[0084] The communication module 110 is a transmitter / receiver 110 that transmits and receives signals via antenna 111. The communication module (transmitter / receiver) 110 is coupled to the central processing unit 100 to provide input signals and receive output signals, which can be the same as in a conventional mobile communication terminal.

[0085] Based on different communication technologies, multiple communication modules 110 can be configured in the same electronic device, such as cellular network modules, Bluetooth modules, and / or wireless LAN modules. The communication module (transmitter / receiver) 110 is also coupled to a speaker 131 and a microphone 132 via an audio processor 130 to provide audio output via the speaker 131 and receive audio input from the microphone 132, thereby enabling typical telecommunications functions. The audio processor 130 may include any suitable buffer, decoder, amplifier, etc. Additionally, the audio processor 130 is coupled to a central processing unit 100, enabling on-device recording via the microphone 132 and on-device playback of stored audio via the speaker 131.

[0086] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0087] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0088] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0089] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0090] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of this application. It should be understood that the above descriptions are merely specific embodiments of this application and are not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A self-service method, characterized in that, The method includes: Collect the first operation information fed back by the user based on the received trigger information, and obtain the corresponding coordinate base point based on the first operation information; The first operation information collected based on the received trigger information includes: The usage status of a preset associated audio playback device is obtained based on the received trigger information, and a preset prompt message is played through the audio playback device based on the usage status. The first operation information is generated based on the operation data provided by the user according to the prompt information. The system obtains multiple operation options from the current operation interface information of the self-service device, and rearranges the operation options according to the coordinate base point using a random sorting algorithm to generate virtual operation options. The virtual operation options are exclusive to the current user and are used to prevent peeping. When the operation command is to enter a password, the numbers on the numeric keypad are randomly sorted using a random sorting algorithm to generate a random virtual keypad centered on the coordinate base point. The system generates input voice information based on the positional relationship between the user's touch position on the current operation interface and the coordinate base point, and the random virtual keyboard. Input commands are then generated based on the input voice information and the third operation information fed back by the user. When the display screen of the self-service device is off, voice guidance information is generated based on the virtual operation options and the coordinate base point. Input options and input commands are obtained by the user through the second operation information, the third operation information, and the virtual operation options fed back by the voice guidance information. Complete the user self-service based on the input options and input instructions.

2. The self-service method according to claim 1, characterized in that, The first operation information is generated based on the operation data provided by the user according to the prompts, and includes: Starting from the completion time of the aforementioned prompt message playback, monitor the user's operation data on the input interface of the self-service device; First operation information is generated based on the operation data.

3. The self-service method according to claim 1, characterized in that, Playing preset prompts through the audio playback device according to the usage status also includes: The self-service device's display screen outputs operation options according to the usage status; or, the self-service device's display screen outputs preset image data according to the usage status.

4. The self-service method according to claim 1, characterized in that, The corresponding coordinate base point obtained based on the first operation information includes: The coordinate information is obtained by parsing the first operation information; When the coordinate information is within a preset coordinate range, a coordinate base point is generated based on the coordinate information.

5. The self-service method according to claim 1, characterized in that, Completing the user self-service according to the aforementioned operation instructions also includes: When the operation instruction is to input a password, the numbers on the numeric keypad are randomly sorted using a random sorting algorithm to generate a random virtual keypad centered on the coordinate base point. The system generates input voice information based on the positional relationship between the user's touch position on the current operation interface and the coordinate base point, and the random virtual keyboard. Input commands are then generated based on the input voice information and the third operation information fed back by the user. Password data is generated based on a combination of input instructions in the input order, and the password data is provided to a preset server.

6. The self-service method according to claim 1, characterized in that, Completing the user self-service according to the aforementioned operation instructions also includes: When the operation instruction is to enter a password option, the system requests password prompt voice data from a preset server based on the user identity information corresponding to the trigger information. The system plays multiple sets of different password prompt voice data under the same identifier through an audio playback device and monitors the user's swiping trajectory on the current operation interface. The input command is generated based on the correspondence between the password prompt voice data and the sliding trajectory, and multiple input commands are merged in the input order to generate password data; The password data and the identifier are associated and bound together and then provided to a preset server.

7. A self-service system applicable to the self-service method according to any one of claims 1 to 6, characterized in that, The system includes self-service terminals and servers; The self-service terminal collects the first operation information fed back by the user based on the received trigger information, and obtains the corresponding coordinate base point based on the first operation information; The first operation information collected based on the received trigger information includes: The usage status of a preset associated audio playback device is obtained based on the received trigger information, and a preset prompt message is played through the audio playback device based on the usage status. The first operation information is generated based on the operation data provided by the user according to the prompt information. The system obtains multiple operation options from the current operation interface information of the self-service terminal, and rearranges the operation options according to the coordinate base point using a random sorting algorithm to generate virtual operation options. The virtual operation options are exclusive to the current user and are used to prevent peeping. When the operation command is to enter a password, the numbers on the numeric keypad are randomly sorted using a random sorting algorithm to generate a random virtual keypad centered on the coordinate base point. The system generates input voice information based on the positional relationship between the user's touch position on the current operation interface and the coordinate base point, and the random virtual keyboard. Input commands are then generated based on the input voice information and the third operation information fed back by the user. When the display screen of the self-service device is off, voice guidance information is generated based on the virtual operation options and the coordinate base point. Input options and input commands are obtained by the user through the second operation information, the third operation information, and the virtual operation options fed back by the voice guidance information. The input options and input instructions are provided to the server to complete the user self-service processing.

8. The self-service system according to claim 7, characterized in that, The self-service terminal includes a processing module, an input module, an audio module, and a storage module; The audio module is stored in the preset card slot of the self-service terminal through the storage module, and is used to play preset audio data according to the audio information provided by the processing module; The input module is located near the user side of the self-service terminal and is used to collect user input data; The processing module is used to provide preset startup audio information to the audio module according to the received trigger information, and to collect the usage status of the audio module; Based on the usage status, preset prompts are played through the audio playback device; and, user operation data is obtained through the input module, and input options are generated based on the operation data; the input options are provided to the server to complete user self-service processing; The audio module includes any one of in-ear headphones, bone conduction headphones, and noise-canceling headphones.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method of any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that enables a computer to execute the method of any one of claims 1 to 6.

Images