Business handling method and device based on voice interaction, equipment and storage medium

Abstract

The invention discloses a business handling method and device based on voice interaction, electronic equipment and a storage medium, and relates to the technical field of financial science and technology. The method comprises the following steps: after a target user starts a financial application program, determining a to-be-handled service of the target user according to a service request voice of the target user, and entering a target page corresponding to the to-be-handled service; according to the process information of the to-be-handled service, determining at least one target control needing to be touched by the target user in the target page and the position of the target control; determining the moving direction and the moving distance of the target user according to the current touch point position of the target user in the target page and the position of the target control by aiming at the target control which needs to be touched by the target user at present; and converting the moving direction and the moving distance into natural language description, generating navigation voice according to the natural language description, and broadcasting the navigation voice to the target user so as to guide the target user to touch the target control. According to the invention, the business handling efficiency can be effectively improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of financial technology, and in particular to a business handling method and device based on voice interaction, an electronic device and a storage medium. BACKGROUND

[0002] Under the background of rapid development of financial technology, application programs in the financial field have become the main channel for users to handle various financial businesses, covering diversified functions such as money transfer, investment and finance, credit application, account management, etc. However, the current business handling mode of application programs in the financial field still has significant limitations, which is difficult to meet the needs of users to handle businesses efficiently, especially for special groups. Therefore, how to improve the business handling efficiency has become a technical problem to be solved. SUMMARY

[0003] The present application provides a business handling method and device based on voice interaction, an electronic device, a storage medium and a computer program product.

[0004] According to an aspect of the present application, a business handling method based on voice interaction is provided, comprising:

[0005] After the target user starts the financial application program, the pending business of the target user is determined according to the business request voice of the target user, and the target page corresponding to the pending business is entered;

[0006] According to the process information of the pending business, at least one target control and the position of the target control that the target user needs to touch in the target page in sequence are determined;

[0007] For the target control that the target user currently needs to touch, the moving direction and the moving distance of the target user are determined according to the current touch point position of the target user in the target page and the position of the target control;

[0008] The moving direction and the moving distance are converted into natural language description, and the navigation voice is generated according to the natural language description and played to the target user to guide the target user to touch the target control.

[0009] According to another aspect of the present application, a business handling device based on voice interaction is provided, comprising:

[0010] The business triggering module is configured to determine the pending business of the target user according to the business request voice of the target user after the target user starts the financial application program, and enter the target page corresponding to the pending business;

[0011] The position determination module is configured to determine at least one target control and the position of the target control that the target user needs to touch in the target page in sequence according to the process information of the pending business;

[0012] a calculation module configured to determine a moving direction and a moving distance of the target user according to a current touch point position of the target user in the target page and a position of the target control for which the target user currently needs to touch;

[0013] a control module configured to convert the moving direction and the moving distance into a natural language description, and generate a navigation voice according to the natural language description and play the navigation voice to the target user to guide the target user to touch the target control.

[0014] According to another aspect of the present application, an electronic device is provided, which comprises:

[0015] at least one processor; and a memory connected to the at least one processor in communication; wherein,

[0016] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the method for business handling based on voice interaction according to the embodiments of the present application.

[0017] According to another aspect of the present application, a computer readable storage medium is provided, which stores computer instructions for enabling a processor to implement the method for business handling based on voice interaction according to the embodiments of the present application when the processor executes the computer instructions.

[0018] According to another aspect of the present application, a computer program product is provided, which comprises a computer program for implementing the steps of the above method when executed by a processor.

[0019] The technical solution of the embodiments of the present application provides clear voice navigation for a user during business handling, helps the user to efficiently locate a target control needed to be touched for business handling, and improves the business handling efficiency.

[0020] It should be understood that the content described in this part is not intended to identify key or important features of the embodiments of the present application, nor to limit the scope of the present application. Other features of the present application will become apparent from the following description.

[0021] BRIEF DESCRIPTION OF DRAWINGS In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative effort on the basis of these drawings.

[0022]

[0023] Figure 1is a flow diagram of a service handling method based on voice interaction provided by an embodiment of the present application.

[0024] Figure 2 is a flow diagram of another service handling method based on voice interaction provided by an embodiment of the present application.

[0025] Figure 3 is a structural diagram of a service handling device based on voice interaction provided by an embodiment of the present application.

[0026] Figure 4 is a structural diagram of an electronic device implementing the service handling method based on voice interaction of an embodiment of the present application. DETAILED DESCRIPTION

[0027] In order for those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings of the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor should fall within the scope of protection of the present application.

[0028] Embodiment One

[0029] Figure 1 A flowchart of a service handling method based on voice interaction provided by an embodiment of the present application, the present embodiment can be applied to the scenario of a user handling a financial service. The method can be executed by a service handling device based on voice interaction, which can be realized in the form of hardware and / or software, and can be configured in an electronic device.

[0030] As shown in Figure 1 , the service handling method based on voice interaction includes:

[0031] S101, after a target user starts a financial application program, determining a to-be-handled service of the target user according to a service request voice of the target user, and entering a target page corresponding to the to-be-handled service.

[0032] In the embodiment of the present application, the financial application refers to a software program running on a mobile device (such as a smart phone, a tablet computer) or a computer terminal, which is specially designed for users to provide various financial services. It is an important carrier of the development of financial technology, which breaks the time and space limitations of traditional financial services through digital technology, so that users can conveniently handle financial business and manage personal finance. The target user refers to a user using the financial application. For example, the target user can be a visually impaired user who needs voice navigation assistance to handle business or other groups who rely on voice interaction. It can be understood that when the target user is a visually impaired user, the present application can assist the visually impaired user to quickly and accurately handle business. The business request voice is a specific business demand instruction (such as I want to transfer money, query credit card bill) issued by the user through voice, which is the core input for the system to identify the user's intention. The to-be-handled business is a specific financial business (such as transfer business, balance inquiry business, etc.) determined according to the user's business request voice and needed to be completed by the user. The target page is a function page corresponding to the to-be-handled business (such as a transfer operation page corresponding to the transfer business, an account detail page corresponding to the query business), which is an operation carrier for the user to complete the business.

[0033] In some embodiments, one implementation of the step can include: in response to the target user starting the financial application, acquiring and recognizing the voice instruction (such as transfer, query balance, repayment, etc. business request voice) of the user through the built-in voice recognition module; wherein the target user can start the financial application in an active touch mode or a voice control mode; performing semantic analysis on the recognized voice text, matching a preset business type library (such as transfer, financial management, credit card repayment, etc.) in the financial application, and determining the to-be-handled business of the target user; according to the mapping relationship between the to-be-handled business and the page (such as transfer corresponding to the transfer page), automatically jumping to the target page corresponding to the to-be-handled business to complete the page switching, thereby improving the efficiency of the user entering the target page.

[0034] S102, determining at least one target control and the position of the target control that the target user needs to touch in the target page according to the process information of the to-be-handled business.

[0035] In some embodiments, the process information of the to-be-handled business refers to the sequence of steps required to complete a certain financial business (such as the transfer process: selecting the payee → inputting the amount → verifying the password → confirming the submission), which is the basis for determining the operation sequence. The target control refers to an interface element (such as an input box, a button, a drop-down menu, etc. for example: the amount input box and the confirmation button of the transfer page) that the user needs to operate in the current page in the to-be-handled business process. The position of the target control refers to the spatial coordinates of the target control in the target page (usually represented by coordinates relative to the screen viewport), which is the core positioning data for subsequent navigation.

[0036] In some embodiments, the implementation of this step includes: calling preset flow information of the to-be-completed business (such as the transfer flow: selecting a payee account -> inputting an amount -> inputting a password -> confirming submission), and explicitly indicating a target control sequence (such as a payee account input box, an amount input box, a password box, a confirmation button, and the like) that needs to be operated by the user in the current target page according to the flow; and locating the position of each target control by analyzing the target page or a preset control coordinate mapping table. The position of each target control is the coordinate of the target control relative to the viewport. In order to facilitate calculation, the coordinate of the center point of the target control can be taken as the coordinate of the target control relative to the viewport.

[0037] It should be noted that, since the coordinates of the target controls are all relative to the viewport, if the target page is scrolled, the element properties of the target page will change in real time, causing the positions of the target controls to change accordingly. Therefore, in response to detecting that the target page is scrolled, the positions of the target controls in the screen viewport displaying the target page are updated, so as to ensure the accuracy of the positions of the target controls.

[0038] S103, for the target control currently needed to be touched by the target user, according to the current touch point position of the target user in the target page and the position of the target control, determining the moving direction and the moving distance of the target user.

[0039] In some embodiments, the current touch point position refers to the coordinate point of the real-time contact of the user's finger or stylus on the screen, reflecting the position of the current operation of the user. The target control position refers to the coordinate information of the target control in the screen viewport, which is the terminal coordinate of the navigation. The moving direction is the direction (up, down, left, right) in which the user's finger or stylus needs to move, which is determined by the coordinate difference between the current touch point and the target control position. The moving distance is the length (which can be calculated by the coordinate difference or converted into physical units such as centimeters) that the user's finger or stylus needs to move from the current touch point to the target control position.

[0040] In some embodiments, the implementation of this step includes: determining the first target control that the user currently needs to touch in the order of the business process; in response to detecting the touch event of the user on the target page, acquiring the coordinates of the current touch point in real time; calling the position data of the target control, and if the page has up and down scrolling, updating the position of the target control in real time by listening to the scrolling event; determining the horizontal coordinate difference dx and the vertical coordinate difference dy between the current touch point position and the position of the target control, that is, the horizontal coordinate of the current touch point minus the horizontal coordinate of the position of the target control to obtain a value as the horizontal coordinate difference dx, and the vertical coordinate of the current touch point minus the vertical coordinate of the position of the target control to obtain a value as the vertical coordinate difference dy; determining the moving distance and the moving direction of the target user according to the horizontal coordinate difference dx and the vertical coordinate difference dy. For example, if dx>0, it is determined that the moving direction is left, and if dx<0, it is determined that the moving direction is right; and the moving distance to the left or right is equal to the value of dx; similarly, if dy<0, the moving direction is up, and if dy>0, the moving direction is down; and the moving distance up or down is equal to the value of dy.

[0041] S104, converting the moving direction and the moving distance into a natural language description, and generating a navigation voice broadcast according to the natural language description to guide the target user to touch the target control.

[0042] In some embodiments, the natural language description refers to converting the moving direction and the moving distance into a colloquial expression that is easy for humans to understand (such as moving 1 centimeter to the right, sliding 2 centimeters downward), avoiding professional terms. The navigation voice refers to the guiding information output in the form of voice, which is a bridge connecting the system calculation result and the user operation, and is adapted to the information acquisition mode of the visually impaired user.

[0043] In some embodiments, the implementation of this step includes: converting the moving direction and the moving distance calculated in step S103 into a natural language according to a preset rule (such as dy>0 converted to slide 2 centimeters downward, and dx<0 converted to move 1 centimeter to the right); calling a text-to-speech engine to synthesize the natural language description into a voice (supporting clear speech speed and intonation, adapting to the hearing habits of visually impaired users); broadcasting the navigation voice in real time to guide the user to move the finger or stylus to the target control position until the touch point and the center point of the target control coincide. In this way, the user is guided to move the finger or stylus to the target control through the navigation voice to complete the clicking, inputting and other operations, and to promote the progress of the business process. It should be noted that the navigation voice can first guide the target user to move left / right, and then guide the target user to move up / down.

[0044] The embodiment scheme of the application provides clear voice navigation for the user (such as a visually impaired user) during the process of handling the business, helps the user to efficiently locate the target control that needs to be touched for handling the business, and improves the efficiency of handling the business.

[0045] Embodiment Two

[0046] Figure 2 A flow chart of a service handling method based on voice interaction is provided for the embodiment of the present application. Referring to Figure 2 , the method comprises the following steps:

[0047] S201, after a target user starts a financial application program, voice broadcast the position of a voice navigation button to the target user; in response to the target user touching the voice navigation button, start a voice interaction function in the financial application program for assisting the target user to handle a service.

[0048] In the embodiment of the present application, the voice navigation button is a switch for starting the voice interaction function for assisting the target user to handle the service; in response to the target user starting the financial application program, first voice broadcast the position of the voice navigation button to the target user, wherein the position of the voice navigation button can be pre-set, and in order to facilitate the target user to touch, the position of the voice navigation button can be configured at the lowest end of the home page of the financial application program. In response to the target user touching the voice navigation button, start the voice interaction function in the financial application program for assisting the target user to handle the service. In this way, the voice interaction function can actively ask the target user about the service to be handled, so as to determine the to-be-handled service of the target user according to the service request voice of the target user.

[0049] S202, determine the to-be-handled service of the target user according to the service request voice of the target user, and enter a target page corresponding to the to-be-handled service.

[0050] S203, according to the flow information of the to-be-handled service, determine at least one target control and the position of the target control which the target user needs to touch in sequence in the target page.

[0051] S204, for the target control which the target user currently needs to touch, according to the current touch point position of the target user in the target page and the position of the target control, determine the moving direction and the moving distance of the target user.

[0052] S205, convert the moving direction and the moving distance into natural language description, and generate navigation voice according to the natural language description and broadcast the navigation voice to the target user to guide the target user to touch the target control.

[0053] In the embodiment of the present application, the specific implementation process of steps S202-S205 can refer to the description of the above embodiment, which will not be described here.

[0054] S206, in response to the target user moving the finger or the stylus in the target page according to the navigation voice, calculate the real-time distance between the touch point of the target user in the target page and the target control in real time.

[0055] In the embodiment of the present application, the real-time distance between the touch point of the target user on the target page and the target control reflects the physical distance between the finger or stylus of the target user and the target control, and clearly indicates whether the target user is approaching the target control.

[0056] In the embodiment of the present application, when it is detected that the target user continuously moves the finger or stylus in the target page according to the navigation voice, the touch point coordinate of the target user on the target page is updated in real time, and the real-time distance between the touch point and the target control is calculated once for each determined touch point coordinate. It should be noted that if it is detected that the target page is scrolled during the movement of the target user in the target page according to the navigation voice, the position of the target control is updated, so as to ensure the accuracy of the calculated real-time distance between the touch point of the target user on the target page and the target control.

[0057] S207, when the real-time distance is less than or equal to the preset distance threshold, the target user is prompted by voice to stop moving.

[0058] In the embodiment of the present application, when the real-time distance is less than or equal to the preset distance threshold, the target user is prompted by voice to stop moving, so as to avoid missing the target control or mistakenly touching other controls due to excessive movement of the user.

[0059] S208, when it is detected that the target user lifts the finger or stylus, the target control is triggered, and the movement direction and distance of the target user are determined according to the position of the next target control to be triggered and the latest touch point position of the target user in the target page.

[0060] In the embodiment of the present application, when it is detected that the finger or stylus of the target user leaves the screen, it is determined that the user completes the touch action, and the function of the current target control (such as clicking the button to submit or activating the input box) is triggered; then the next target control to be touched (switched according to the business process sequence) is obtained from the target control list in step S203; then the target user is prompted by voice to prepare to trigger the next target control; in response to receiving the voice of the target user being ready to trigger the next target control, the movement direction and distance of the target user are determined according to the position of the next target control to be triggered and the latest touch point position of the target user in the target page, so as to guide the target user to trigger the new target control according to the newly determined movement direction and distance. In this way, after triggering the current target control, the movement guidance (movement direction and distance) of the next target control is automatically calculated, the seamless connection of the business process is realized, the user does not need to trigger the guidance additionally, the operation continuity is ensured, and the overall handling efficiency is improved.

[0061] In some embodiments, in response to detecting that the target user stops moving in the target page, and the distance between the stop point and the target control is greater than the preset distance threshold, it is indicated that the target user stops moving before moving to the position of the target control, at this time the target control cannot be triggered, and in order to ensure the smooth triggering of the target control, the moving distance and the moving direction need to be recalculated according to the position of the stop point and the position of the target control; for example, the horizontal coordinate difference and the vertical coordinate difference between the stop point position and the target control position are determined; the moving distance and the moving direction of the target user are determined according to the calculated horizontal coordinate difference and vertical coordinate difference; the recalculated moving direction and moving distance are converted into a natural language description, and a navigation voice is generated according to the natural language description and played to the target user to prompt the target user to continue moving. In this way, the operation process can be avoided to be interrupted, and the continuity of business handling can be ensured. In addition, the early stop may be caused by the perception error of the distance. At this time, by recalculating the accurate moving direction and distance, it is equivalent to providing secondary calibration, directly correcting the operation deviation of the user, avoiding the target control (or mis-touching other controls) from being triggered due to the stop point being too far away, and greatly improving the probability of successful operation once.

[0062] The application scheme significantly reduces the operation complexity of the financial application through the closed-loop design of entrance guidance, demand matching, accurate navigation, dynamic error correction and process connection, is more friendly to users with weak visual dependence and unskilled operation, and finally improves the success rate of business handling and user experience.

[0063] Embodiment three

[0064] Figure 3 A structure schematic diagram of a business handling device based on voice interaction provided by the embodiment of the application. The embodiment can be applied to the scene of visually impaired users handling financial business. The device can execute any business handling method based on voice interaction of the application. As shown in the figure, the business handling device based on voice interaction comprises: Figure 3

[0065] The business triggering module 301 is configured to, after the target user starts the financial application program, determine the to-be-handled business of the target user according to the business request voice of the target user, and enter the target page corresponding to the to-be-handled business.

[0066] The position determination module 302 is configured to determine at least one target control and the position of the target control which need to be touched in sequence by the target user in the target page according to the process information of the to-be-handled business.

[0067] The calculation module 303 is configured to, for the target control currently needed to be touched by the target user, determine the moving direction and the moving distance of the target user according to the current touch point position of the target user in the target page and the position of the target control.

[0068] ​The control module 304 is used to convert the movement direction and movement distance into natural language descriptions, and generate navigation voice broadcasts based on the natural language descriptions to guide the target user to touch the target control.

[0069] In some embodiments, it also includes:

[0070] The distance calculation module is used to respond to the target user's movement of their finger or stylus on the target page according to the navigation voice control, and to calculate the real-time distance between the target user's touch point on the target page and the target control.

[0071] The voice prompt to stop moving module is used to prompt the target user to stop moving when the real-time distance is less than or equal to a preset distance threshold.

[0072] The trigger module is used to trigger the target control when the target user lifts their finger or stylus, and to determine the target user's movement direction and movement distance based on the position of the next target control to be triggered and the latest touch point position of the target user on the target page.

[0073] In some embodiments, it also includes:

[0074] The recalculation module is used to recalculate the movement distance and direction based on the position of the stopping point and the position of the target control when it is detected that the target user stops moving on the target page and the distance between the stopping point and the target control is greater than a preset distance threshold.

[0075] The conversion module is used to convert the recalculated direction and distance of movement into natural language descriptions, and generate navigation voice prompts based on the natural language descriptions to prompt the target user to continue moving.

[0076] In some embodiments, the calculation module is specifically used to determine the target user's movement direction and movement distance based on the target user's current touch point position and the position of the target control on the target page:

[0077] Determine the difference in horizontal and vertical coordinates between the current touch point position and the target control position;

[0078] Based on the difference in the horizontal and vertical coordinates, determine the target user's movement distance and direction.

[0079] In some embodiments, it also includes:

[0080] The position update module is used to update the position of the target control on the target page in response to the detection of scrolling on the target page.

[0081] In some embodiments, a voice interaction initiation module is also included, for:

[0082] After the target user starts the financial application, the voice navigation button position is voice broadcasted to the target user;

[0083] In response to the target user touching the voice navigation button, a voice interaction function for assisting the target user to handle the business in the financial application is started.

[0084] In some embodiments, the target user is a visually impaired user.

[0085] The business handling device based on voice interaction provided by the embodiments of the present application can execute the business handling method based on voice interaction provided by any of the embodiments of the present application, and has the corresponding function modules and beneficial effects of the execution method.

[0086] According to the embodiments of the present application, the present application further provides an electronic device, a readable storage medium and a computer program product.

[0087] Embodiment four

[0088] Figure 4 A structural schematic diagram of an electronic device 10 that can be used to implement the embodiments of the present application is shown. The components shown herein, their connections and relationships, and their functions are merely examples, and are not intended to limit the implementation of the present application described herein and / or claimed.

[0089] As shown in Figure 4 The electronic device 10 includes at least one processor 11, and a memory, such as a read-only memory 12, a random access memory 13, etc., which is communicatively connected to the at least one processor 11, wherein the memory stores a computer program that can be executed by the at least one processor. The processor 11 can execute various appropriate actions and processes according to the computer program stored in the read-only memory 12 or loaded from the storage unit 18 to the random access memory 13. In the random access memory 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the read-only memory 12, and the random access memory 13 are connected to each other through a bus 14. An input / output interface 15 is also connected to the bus 14.

[0090] A plurality of components in the electronic device 10 are connected to the input / output interface 15, including: an input unit 16; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunications networks.

[0091] The processor 11 can be various general and / or special purpose processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, central processing units, graphics processing units, various specialized artificial intelligence computing chips, various processors running machine learning model algorithms, digital signal processors, and any appropriate processors, controllers, microcontrollers, and the like. The processor 11 performs various methods and processes described above, such as the voice interaction based service handling method.

[0092] In some embodiments, the voice interaction based service handling method can be implemented as a computer program tangibly embodied in a computer readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 10 via the read only memory 12 and / or the communication unit 19. When the computer program is loaded onto the random access memory 13 and executed by the processor 11, one or more steps of the voice interaction based service handling method described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to perform the voice interaction based service handling method by any other appropriate means, such as by means of firmware.

[0093] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, specially designed application specific integrated circuits, application specific standard products, chips, microprocessors, computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0094] Computer programs used to implement the methods of the application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the computer program, when executed, implements the functions / acts specified in the flowcharts and / or block diagrams. The computer program can be embodied in whole or in part (including both instructions and data) in a machine, a processor, or a memory of a machine or a processor. Furthermore, computer programs can be loaded onto a computer or other programmable data processing apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide operations for implementing the functions / acts specified in the flowcharts and / or block diagrams.

[0095] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer-readable storage medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of a machine-readable storage medium will include a one or more lines of a computer program, a portable computer diskette, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, an optical fiber, a portable compact disc read-only memory, an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0096] To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device or liquid crystal display (LCD) for displaying information to the user and a keyboard and a pointing device, e.g., a mouse or a trackball, by which the user can provide input to the electronic device. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0097] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0098] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. A server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and virtual private service.

[0099] It should be understood that the various forms of flow shown above can be used to reorder, add, or delete steps. For example, the steps recited in the present application can be performed in parallel, in series, or in a different order, as long as the desired results of the technical solutions of the present application can be achieved, which are not limited herein.

[0100] The above detailed description does not constitute a limitation on the protection scope of the present application. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent replacements, and improvements made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A voice interaction-based service handling method, characterized by, The method comprises the following steps: After a target user starts a financial application, a to-be-handled business of the target user is determined according to a business request voice of the target user, and a target page corresponding to the to-be-handled business is entered; According to the process information of the to-be-handled business, at least one target control and the position of the target control that the target user needs to touch in the target page are determined in sequence; For the target control that the target user currently needs to touch, the moving direction and the moving distance of the target user are determined according to the current touch point position of the target user in the target page and the position of the target control; The moving direction and the moving distance are converted into a natural language description, and a navigation voice is generated according to the natural language description and is broadcast to the target user to guide the target user to touch the target control.

2. The method of claim 1, wherein, Further comprising: In response to the target user moving a finger or a stylus in the target page according to the navigation voice, the real-time distance between the touch point of the target user in the target page and the target control is calculated in real time; When the real-time distance is less than or equal to a preset distance threshold, the target user is prompted to stop moving by voice; When it is detected that the target user lifts the finger or the stylus, the target control is triggered, and the moving direction and the moving distance of the target user are determined according to the position of the next target control to be triggered and the latest touch point position of the target user in the target page.

3. The method of claim 1, wherein, Further comprising: In response to detecting that the target user stops moving in the target page, and the distance between the stop point and the target control is greater than a preset distance threshold, the moving distance and the moving direction are recalculated according to the position of the stop point and the position of the target control; The recalculated moving direction and moving distance are converted into a natural language description, and a navigation voice is generated according to the natural language description and is broadcast to the target user to prompt the target user to continue moving.

4. The method of claim 1, wherein, The moving direction and the moving distance of the target user are determined according to the current touch point position of the target user in the target page and the position of the target control, comprising: The horizontal coordinate difference and the vertical coordinate difference between the current touch point position and the position of the target control are determined; The moving distance and the moving direction of the target user are determined according to the horizontal coordinate difference and the vertical coordinate difference.

5. The method of claim 1, wherein, Further comprising: In response to detecting that the target page scrolls, the position of the target control is updated.

6. The method of claim 1, wherein, Further comprising: After the target user starts the financial application, the position of the voice navigation button is broadcast to the target user by voice; In response to the target user touching the voice navigation button, the voice interaction function for assisting the target user in handling the business in the financial application is started.

7. The method according to any one of claims 1 to 6, characterized in that, The target user is a visually impaired user.

8. A voice interaction based service handling apparatus, characterized by The method comprises the following steps: A business triggering module is configured to determine a to-be-handled business of a target user according to a business request voice of the target user after the target user starts a financial application, and enter a target page corresponding to the to-be-handled business; A position determining module is configured to determine at least one target control and a position of the target control that the target user needs to touch in the target page according to process information of the to-do business; A calculating module is configured to determine a moving direction and a moving distance of the target user according to a current touch point position of the target user in the target page and the position of the target control for the target control currently needed to be touched by the target user; A control module is configured to convert the moving direction and the moving distance into a natural language description, and generate a navigation voice broadcast according to the natural language description to guide the target user to touch the target control.

9. An electronic device, comprising: Comprise: At least one processor; And The memory is in communication connection with the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the method of any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer instructions for enabling the processor to execute the method of any one of claims 1-7 when executed.

11. A computer program product comprising a computer program which, when executed by a processor, implements the method of any one of claims 1-7.

Images