Information playing method, device, electronic equipment and storage medium

Abstract

The present application provides an information playback method, including: when the target application is in a visually impaired user operation mode, determining the focus element in the target application; obtaining the to-be-played information corresponding to the focus element, the to-be-played information including operation prompt information for the focus element and functional information of the service function that the target application can provide after the focus element is operated according to the operation prompt information; and playing the to-be-played information by voice. Through this method, visually impaired users can not only obtain the text information of the focus element, but also the operation prompt information of the focus element, thereby ensuring that the user can obtain the functional service corresponding to the focus element, and ultimately improving the user experience.

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to an information playing method, an information playing device, an electronic device and a storage medium. Background Art

[0002] Nowadays, mainstream mobile phones generally support barrier-free mode. In barrier-free mode, mobile phones provide language assistance for visually impaired users so that visually impaired users can interact with the mobile phone effectively, such as barrier-free services provided by the mobile phone's built-in system. In barrier-free service mode, when a user triggers an element in the mobile phone's operating interface, the mobile phone will identify the text corresponding to the focus element and play the prompt voice corresponding to the text. For example, in the operation interface of a takeaway APP, when the user triggers the button to receive the red envelope, the mobile phone will voice broadcast "red envelope receive button".

[0003] However, for visually impaired users, for some buttons in the operation interface, simply playing the name of the button by voice cannot help visually impaired users obtain the corresponding functional information. For example, the above voice broadcast of "red envelope collection button" can only ensure that users can know that the focus element is the red envelope collection button, but visually impaired users do not know how to collect the red envelope, which leads to a poor user experience for visually impaired users. Summary of the invention

[0004] The embodiments of the present application provide an information playback method, device, electronic device and storage medium to solve the above technical problems.

[0005] The present application provides an information playback method, comprising: when the target application is in a visually impaired user operation mode, determining a focus element in the target application; obtaining information to be played corresponding to the focus element, the information to be played comprising operation prompt information for the focus element and function information of a service function that the target application can provide after the focus element is operated according to the operation prompt information; and playing the information to be played by voice.

[0006] Optionally, determining the focus element in the target application includes: determining a selected element in the target application, and determining the selected element in the target application as the focus element.

[0007] Optionally, determining the focus element in the target application includes: determining a selected element in the target application; judging whether the selected element in the target application is an element with delivery service characteristics, and if so, determining the selected element in the target application as the focus element.

[0008] Optionally, the method also includes: obtaining first delivery service characteristic identification information provided by the server for identifying whether the element selected in the target application is an element with delivery service characteristics; the judging whether the element selected in the target application is an element with delivery service characteristics includes: judging whether the element selected in the target application is an element with delivery service characteristics based on the first delivery service characteristic identification information of the element selected in the target application.

[0009] Optionally, determining the focus element in the target application includes: determining a selected element in the target application; judging whether element content of the selected element in the target application is element content that a visually impaired user currently using the target application is interested in, and if so, determining the selected element in the target application as the focus element.

[0010] Optionally, the method also includes: obtaining first attention identification information provided by the server for identifying whether the element content of the selected element in the target application is the element content that the visually impaired user is interested in; and judging whether the element content of the selected element in the target application is the element content that the visually impaired user currently using the target application is interested in, comprising: judging whether the element content of the selected element in the target application is the element content that the visually impaired user currently using the target application is interested in, based on the first attention identification information of the selected element in the target application.

[0011] Optionally, determining whether the element content of the element selected in the target application is the element content that is of interest to a visually impaired user who is currently using the target application includes: determining whether the element content of the element selected in the target application is the element content that is of interest to a visually impaired user who is currently using the target application based on historical behavior data of the visually impaired user with respect to the target application; or determining whether the element content of the element selected in the target application is the element content that is of interest to a visually impaired user who is currently using the target application based on usage experience information fed back by the visually impaired user with respect to the target application.

[0012] Optionally, the method also includes: obtaining the to-be-played information corresponding to multiple elements in the target application provided by the server; the obtaining of the to-be-played information corresponding to the focus element includes: obtaining the to-be-played information corresponding to the focus element from the to-be-played information corresponding to multiple elements in the target application provided by the server according to the identification information of the focus element.

[0013] Optionally, the method also includes: determining whether the focus element is an operable element on which the target application can provide service functions after a specific operation is performed; obtaining the information to be played corresponding to the focus element, including: if the focus element is an operable element on which the target application can provide service functions after a specific operation is performed, obtaining operation prompt information for the focus element and function information of the service functions that the target application can provide after the focus element is operated according to the operation prompt information; generating the information to be played based on the operation prompt information and the function information.

[0014] Optionally, the method also includes: obtaining operable element identification information provided by the server to indicate whether the focus element is an operable element; and judging whether the focus element is an operable element for which the target application can provide a service function after a specific operation is performed, comprising: judging whether the focus element is an operable element based on the operable element identification information of the focus element.

[0015] Optionally, there are multiple functional information for the focus element, and each functional information of the focus element corresponds to operation prompt information; generating the information to be played based on the operation prompt information and the functional information includes: selecting functional information with delivery service characteristics from multiple functional information for the focus element; obtaining operation prompt information corresponding to the delivery service characteristics; generating the information to be played based on the delivery service characteristics and the operation prompt information corresponding to the functional information with delivery service characteristics.

[0016] Optionally, the method also includes: obtaining second delivery service feature identification information provided by the server for identifying whether each piece of functional information of the focus element has delivery service features; selecting functional information with delivery service features from multiple functional information for the focus element includes: selecting functional information with delivery service features from multiple functional information for the focus element according to the second delivery service feature identification information.

[0017] Optionally, there are multiple functional information for the focus element, and each functional information of the focus element corresponds to operation prompt information; generating the information to be played based on the operation prompt information and the functional information includes: selecting functional information that is of interest to a visually impaired user who is currently using the target application from multiple functional information for the focus element; obtaining operation prompt information corresponding to the functional information that is of interest to the visually impaired user; generating the information to be played based on the functional information that is of interest to the visually impaired user and the operation prompt information corresponding to the functional information that is of interest to the visually impaired user.

[0018] Optionally, the method also includes: obtaining second attention identification information provided by the server for identifying whether each functional information of the focus element is functional information that the visually impaired user is interested in; selecting functional information that the visually impaired user who is currently using the target application is interested in from multiple functional information for the focus element includes: selecting functional information that the visually impaired user is interested in from multiple functional information for the focus element based on the second attention identification information.

[0019] Optionally, selecting the functional information that is of interest to a visually impaired user who is currently using the target application from multiple functional information for the focus element includes: selecting the functional information that is of interest to the visually impaired user from multiple functional information for the focus element based on historical behavior data of the visually impaired user with respect to the target application; or selecting the functional information that is of interest to the visually impaired user from multiple functional information for the focus element based on usage experience information provided by the visually impaired user with respect to the target application.

[0020] Optionally, the information to be played is generated according to the operation prompt information and the function information, including: if neither the operation prompt information nor the function information has the delivery service characteristics, determining an associated element that has the delivery service characteristics and has an association relationship with the focus element; obtaining the element content of the associated element that has the delivery service characteristics; and generating the information to be played with the delivery service characteristics according to the operation prompt information, the function information and the element content of the associated element that has the delivery service characteristics.

[0021] Optionally, the method also includes: obtaining association relationship identification information provided by the server for identifying the association relationship between elements and third delivery service feature identification information for identifying whether the element in the target application is an element with delivery service characteristics; determining the associated element with the delivery service characteristics and having an association relationship with the focus element includes: determining the associated element with the delivery service characteristics and having an association relationship with the focus element according to the association relationship identification information and the third delivery service feature identification information.

[0022] Optionally, the target application is an online-to-offline service application; the focus element is any one of the following elements: a virtual button element; an image element.

[0023] The present application also provides an information playback device, including: a focus element determination unit, used to determine the focus element in the target application when the target application is in a visually impaired user operation mode; a to-be-played information acquisition unit, used to obtain the to-be-played information corresponding to the focus element, the to-be-played information including operation prompt information for the focus element and function information of the service function that the target application can provide after the focus element is operated according to the operation prompt information; and a voice playback unit, used to voice play the to-be-played information.

[0024] The present application also provides an electronic device, comprising: a processor; and a memory for storing a computer program, wherein the computer program is run by the processor to execute the described method.

[0025] The present application also provides a storage medium, wherein the storage medium stores a computer program, and the computer program is executed by a processor to perform the method described.

[0026] Compared with the prior art, this application has the following advantages:

[0027] The present application provides an information playback method, including: when the target application is in a visually impaired user operation mode, determining the focus element in the target application; obtaining the to-be-played information corresponding to the focus element, the to-be-played information including operation prompt information for the focus element and functional information of the service function that the target application can provide after the focus element is operated according to the operation prompt information; and playing the to-be-played information by voice. Through this method, visually impaired users can not only obtain the text information of the focus element, but also the operation prompt information of the focus element, thereby ensuring that the user can obtain the functional service corresponding to the focus element, and ultimately improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A schematic diagram of the first scenario of the information playback method provided in an embodiment of the present application.

[0029] Figure 2 A schematic diagram of a second scenario of the information playback method provided in an embodiment of the present application.

[0030] Figure 3 This is a flowchart of an information playing method provided in the first embodiment of the present application.

[0031] Figure 4 This is a schematic diagram of an information playing device provided in the second embodiment of the present application.

[0032] Figure 5 A schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0033] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application. Therefore, the present application is not limited to the specific implementation disclosed below.

[0034] In order to more clearly demonstrate the information playback method provided by the embodiment of the present application, the application scenario of the information playback method provided by the embodiment of the present application is first introduced. The information playback method provided by the embodiment of the present application is generally applied to the scenario where a visually impaired user operates a food delivery application to order food when the food delivery application is in the visually impaired user operation mode, and can also be applied to the scenario where a visually impaired user operates other applications other than the food delivery application when the applications are in the visually impaired user operation mode, such as: a visually impaired user operates a music playback application to play music when the music playback application is in the visually impaired user operation mode.

[0035] In addition, the information playback method provided in the embodiment of the present application can also be applied to some other identical or similar scenarios. In the embodiment of the present application, the information playback method provided in the embodiment of the present application is specifically described by taking the scenario where the information playback method is applied to a visually impaired user who operates the takeaway application to order food when the takeaway application is in the visually impaired user operation mode as an example. For the case where the information playback method provided in the embodiment of the present application is applied to other scenarios, please refer to the case where the information playback method is applied to the scenario where a visually impaired user who operates the takeaway application to order food when the takeaway application is in the visually impaired user operation mode for detailed execution process or steps, which will not be repeated here one by one.

[0036] The execution subject of the information playback method provided in the embodiment of the present application is a user terminal that can implement the information playback method provided in the embodiment of the present application. The user terminal is generally an electronic device installed with a target application. Figure 1-Figure 2 A first scenario schematic diagram and a second scenario schematic diagram of the information playback method provided in an embodiment of the present application. Figure 1 The system includes: a user terminal 101. After the user terminal 101 turns on the visually impaired user operation mode based on the user's triggering operation, the food delivery APP is in the visually impaired user operation mode.

[0037] It should be noted that visually impaired users refer to users who, due to congenital or acquired reasons, have partial or complete impairments in the structure or function of their visual organs (optic nerves of the eyeball, visual center of the brain), and who are still unable (or very difficult) to visually identify external objects after treatment. The visually impaired user operation mode is an operation mode that provides language assistance to visually impaired users so that they can effectively interact with electronic devices or applications on electronic devices. Electronic devices are generally smart phones and a series of different types of computers including tablets. The target application is generally an APP (Application) or a computer application. The following specifically uses the electronic device as a mobile phone and the target application as a food delivery APP to explain in detail the scenario in which the information playback method is applied to a visually impaired user who operates the food delivery application to order food when the food delivery application is in the visually impaired user operation mode.

[0038] First, when the target application is in a visually impaired user operation mode, a focus element in a current page of the target application is determined.

[0039] The focus element refers to the target element currently selected by the visually impaired user. However, since there are multiple target elements on the takeaway page, such as virtual button elements (red envelope button), image elements (comprehensive sorting icons), supermarket icons, etc., it is necessary to determine whether the visually impaired user has selected the target element, and then determine that the selected target element is the focus element.

[0040] This embodiment mainly determines whether the target element is selected by judging whether the visually impaired user has performed a trigger operation on the target element, for example, judging whether the visually impaired user has performed a click operation on the receive red envelope button, or judging whether the visually impaired user has performed a long press operation on the comprehensive sorting icon, or judging whether the visually impaired user has performed a sliding operation on the supermarket icon, etc. Of course, there are many other ways to confirm whether the visually impaired user has selected the target element, which will not be introduced in detail here, as long as the target element can be selected.

[0041] Since the purpose of the visually impaired user's operation on the takeaway page is to order food, in order to make it easier for the visually impaired user to understand the takeaway service information provided by the takeaway page, the present application can also determine whether the target element selected by the visually impaired user on the takeaway page is an element with delivery service characteristics. If so, the selected target element can be used as the focus element, otherwise, the selected target element cannot be used as the focus element.

[0042] How to determine whether the target element selected by the visually impaired user on the takeaway page is an element with delivery service characteristics? In this embodiment, it can be determined by determining whether the selected target element has delivery service characteristic identification information. If the selected target element has delivery service characteristic identification information, the selected target element can be determined as an element with delivery service characteristics. Among them, the server can pre-set whether all target elements on the takeaway page have delivery service characteristic identification information. The user end only needs to determine whether the selected target element is an element with delivery service characteristics based on whether each target element provided by the server has delivery service characteristic identification information. Of course, if the target element does not have delivery service characteristic identification information, the element with delivery service characteristic identification information associated with the target element is determined, such as the button for collecting red envelopes does not have delivery service characteristic identification information, but if the red envelope is provided by a certain merchant, it has delivery service characteristic identification information, so the merchant can be regarded as an associated element.

[0043] It should be noted that delivery service features can be understood as parameters related to ordering or delivery during the ordering process for visually impaired users, such as the discount red envelopes sent by the merchant can save the consumption amount of visually impaired users, the merchant name and profile information can help visually impaired users understand the business conditions and delivery time of the merchant, and then decide whether to choose the merchant to place an order, etc. Non-delivery service features can be understood as parameters unrelated to ordering or delivery during the ordering process for visually impaired users, such as the city where the visually impaired user is currently located, weather conditions, etc.

[0044] In order to improve the ordering experience of visually impaired users, the user terminal will also determine whether the element content of the selected target element is the content that the visually impaired user is concerned about. If so, the selected target element will be used as the focus element, otherwise, the target element cannot become the focus element.

[0045] How to judge whether the element content of the selected target element is the content that the visually impaired user pays attention to? This embodiment provides a method for judging whether the element content of the selected target element is the content that the visually impaired user pays attention to based on the attention data of the selected element in the target application generated and provided by the server. If the attention data of the selected element indicates that the element content of the selected target element is the content that the visually impaired user pays attention to, then the element content of the selected target element is the content that the visually impaired user pays attention to. Otherwise, the element content of the selected target element is not the content that the visually impaired user pays attention to.

[0046] Of course, it is also possible to determine whether the element content of the selected element is the element content that the visually impaired user currently using the target application is interested in based on the historical behavior data of the visually impaired user. For example, based on the historical order information of the visually impaired user, it is known that the user tends to place orders at merchants that provide red envelopes, so red envelopes are the content that the visually impaired user is interested in.

[0047] It is also possible to determine whether the element content of the selected element is the element content that the visually impaired user currently using the target application is interested in, based on the user experience information fed back by the visually impaired user for the target application. For example, based on the historical feedback from the visually impaired user, it is known that the visually impaired user is more concerned about the distance of the merchants provided on the takeaway page, so the content corresponding to the comprehensive sorting icon on the takeaway page is the content that the user is interested in.

[0048] Secondly, it is determined whether the focus element is an operable element for which the target application can provide a service function after a specific operation is performed on the focus element.

[0049] Since there are many types of target elements on the takeaway page, some target elements can provide their functional information without interacting with visually impaired users. For example, for supermarket icons, visually impaired users only need to select the supermarket icon, and the takeaway page can provide information about each supermarket, and the visually impaired user does not need to operate to obtain the supermarket-related information provided by the takeaway page. However, some target elements require interaction with visually impaired users before the takeaway page can provide corresponding functional information. For example, for the receive red envelope button, when a visually impaired user selects the receive red envelope button, only the voice "receive red envelope button" will be played, and the user will not be told how to operate to receive the red envelope. Therefore, the visually impaired user can only complete the red envelope receiving function according to the "double-click to receive" prompt voice provided by the takeaway page. Therefore, it is necessary to determine whether the focus element selected by the visually impaired user is an operable element. Therefore, only the focus element that meets the above requirements can be used as an operable element.

[0050] So how to judge whether the focus element selected by the visually impaired user is an operable element? This application provides a method to judge whether the focus element is an operable element based on the operable element identification information provided by the server to indicate whether the focus element is an operable element. If yes, it means that the focus element is an operable element, otherwise, it means that the focus element is not an operable element.

[0051] For example, the “∨” symbol in the comprehensive sorting icon is used to indicate that the comprehensive sorting includes more functional services. Therefore, for visually impaired users, the voice playback is “Comprehensive sorting icon, swipe up to get comprehensive sorting results”. There are many similar ones, such as “Expand more sub-elements”, “View more sub-elements”, “Filter sub-elements”, “Show details sub-elements” and “Directory sub-elements”, etc. The corresponding symbols are “》”, “>”, “M” and Wait, there is no limitation on this.

[0052] Next, the to-be-played information corresponding to the focus element is obtained, wherein the to-be-played information includes operation prompt information for the focus element and function information of a service function that can be provided by the target application after the focus element is operated according to the operation prompt information.

[0053] Since visually impaired users have vision defects, the information to be played for the focus element needs to be very complete. If the focus element is an operable element, it is necessary to obtain the text information of the focus element, the operation prompt information, and the function information provided by the takeaway application after the focus element is operated. For example, for the red envelope collection button, the information to be played is: red envelope collection button, double-click to receive the red envelope of Merchant A. If the focus element is not an operable element, it is only necessary to play the text information of the focus element. For example, for the supermarket icon, the information to be played is: supermarket icon.

[0054] Then, how to obtain the to-be-played information corresponding to the above focus element? This embodiment mainly obtains it in the following ways:

[0055] Pre-configure operation prompt information corresponding to the focus element and functional information of service functions that the target application can provide after the focus element is operated according to the operation prompt information, and then establish a correspondence between the focus element, the operation prompt information and the functional information of service functions that the target application can provide after the focus element is operated according to the operation prompt information. Finally, based on the focus element and the corresponding relationship, the to-be-played information corresponding to the focus element can be obtained.

[0056] For example, for the "Receive Red Envelope Button", voice information corresponding to the "Receive Red Envelope Button" can be pre-configured, such as the "Receive Red Envelope Button" voice information and the "Double-click to receive the red envelope from Merchant A" voice information. Based on the "Receive Red Envelope Button", the "Receive Red Envelope Button" voice information and the "Double-click to receive the red envelope from Merchant A" voice information, a correspondence between the "Receive Red Envelope Button", the "Receive Red Envelope Button" voice information and the "Double-click to receive the red envelope from Merchant A" voice information can be established. When a visually impaired user selects the "Receive Red Envelope Button", the takeaway page will obtain the to-be-played information corresponding to the "Receive Red Envelope Button" according to the above correspondence, that is, "Receive Red Envelope Button, double-click to receive the red envelope from Merchant A".

[0057] It should be noted that the above-mentioned step of establishing the correspondence between the focus element, the operation prompt information, and the functional information of the service function that the target application can provide after operating the focus element according to the operation prompt information can be executed on the user side or on the server side. Of course, the server side can also directly obtain the to-be-played information corresponding to each element in the takeaway page, and the user side can send a request to the server side to obtain the to-be-played information corresponding to the focus element.

[0058] It should also be noted that, in order to facilitate the operation of visually impaired users, the above operation prompt information can be a click operation of visually impaired users, such as single click or double click, etc., or a sliding operation of visually impaired users, such as sliding up or sliding down or sliding in a circle, etc., or a long press operation of visually impaired users, such as pressing with two fingers or the pressing time or the contact area with the screen when pressing, etc., or a shaking operation of visually impaired users, such as shaking the phone or sliding the phone upward, etc. There is no limitation on this, as long as it is convenient for visually impaired users to operate.

[0059] It should also be noted that some focus elements have multiple corresponding operation prompt information. For example, for the comprehensive sorting icon, swiping up can obtain the merchant sorting results, and swiping down can retrieve the merchant sorting results. Therefore, for the comprehensive sorting icon, the information to be played is "comprehensive sorting icon, swipe up to obtain the merchant sorting results, swipe down to retrieve the merchant sorting results." Moreover, the principle of obtaining the to-be-played information of multiple operation prompt information is the same as the principle of obtaining the to-be-played information of one operation prompt information mentioned above, and will not be repeated here.

[0060] For another example, for a merchant icon, swiping up can obtain merchant details, swiping down can close merchant details, and double-clicking can evaluate the merchant. However, in order to facilitate visually impaired users, the user end will determine whether each function of each focus element provided by the server has delivery service feature identification information, and make a judgment on multiple functions. If the function has delivery service feature identification information, the to-be-played information corresponding to the function is retained, otherwise, the to-be-played information corresponding to the function is not retained. For example, the above-mentioned swiping up can obtain merchant details information and swiping down can close merchant details information, which will affect the user's ordering, so it has delivery service feature identification information, while double-clicking can evaluate the merchant and will not affect the user's ordering, so it does not have delivery service feature identification information. Therefore, the final to-be-played information is "Merchant icon, swiping up can obtain merchant details information, swiping down can close merchant details information".

[0061] Of course, it is also possible to retain the functional information that the visually impaired user is concerned about from multiple functional information. For example, according to the historical orders and historical feedback data of the visually impaired user, the visually impaired user is more concerned about the merchant details and is willing to evaluate the merchant. Therefore, the last information to be played is "merchant icon, swipe up to obtain merchant details, double-click to evaluate the merchant."

[0062] Finally, the information to be played is played by voice.

[0063] It should be noted that the user end can also send the information to be played to the server end for storage.

[0064] The above is a scenario implementation example of the information playback method. To facilitate a better understanding of this solution, a detailed description is given below in conjunction with a specific implementation example.

[0065] First embodiment

[0066] This embodiment provides an information playback method, and the execution subject is a user terminal. Since this embodiment is similar to the scheme described in the above scenario embodiment, the description is relatively simple. For relevant parts, please refer to the description of the scenario embodiment corresponding to the information playback method. Figure 3 The information playback method is described in detail.

[0067] Step S301: when a target application is in a visually impaired user operation mode, determining a focus element in the target application.

[0068] Step S302: obtaining the to-be-played information corresponding to the focus element, wherein the to-be-played information includes operation prompt information for the focus element and function information of a service function that can be provided by the target application after the focus element is operated according to the operation prompt information.

[0069] Step S303: voice play the information to be played.

[0070] Optionally, determining the focus element in the target application includes: determining a selected element in the target application, and determining the selected element in the target application as the focus element.

[0071] Optionally, determining the focus element in the target application includes: determining a selected element in the target application; judging whether the selected element in the target application is an element with delivery service characteristics, and if so, determining the selected element in the target application as the focus element.

[0072] Optionally, the method also includes: obtaining first delivery service characteristic identification information provided by the server for identifying whether the element selected in the target application is an element with delivery service characteristics; the judging whether the element selected in the target application is an element with delivery service characteristics includes: judging whether the element selected in the target application is an element with delivery service characteristics based on the first delivery service characteristic identification information of the element selected in the target application.

[0073] Optionally, determining the focus element in the target application includes: determining a selected element in the target application; judging whether element content of the selected element in the target application is element content that a visually impaired user currently using the target application is interested in, and if so, determining the selected element in the target application as the focus element.

[0074] Optionally, the method also includes: obtaining first attention identification information provided by the server for identifying whether the element content of the selected element in the target application is the element content that the visually impaired user is interested in; and judging whether the element content of the selected element in the target application is the element content that the visually impaired user currently using the target application is interested in, comprising: judging whether the element content of the selected element in the target application is the element content that the visually impaired user currently using the target application is interested in, based on the first attention identification information of the selected element in the target application.

[0075] Optionally, determining whether the element content of the element selected in the target application is the element content that is of interest to a visually impaired user who is currently using the target application includes: determining whether the element content of the element selected in the target application is the element content that is of interest to a visually impaired user who is currently using the target application based on historical behavior data of the visually impaired user with respect to the target application; or determining whether the element content of the element selected in the target application is the element content that is of interest to a visually impaired user who is currently using the target application based on usage experience information fed back by the visually impaired user with respect to the target application.

[0076] Optionally, the method also includes: obtaining the to-be-played information corresponding to multiple elements in the target application provided by the server; the obtaining of the to-be-played information corresponding to the focus element includes: obtaining the to-be-played information corresponding to the focus element from the to-be-played information corresponding to multiple elements in the target application provided by the server according to the identification information of the focus element.

[0077] Optionally, the method also includes: determining whether the focus element is an operable element on which the target application can provide service functions after a specific operation is performed; obtaining the information to be played corresponding to the focus element, including: if the focus element is an operable element on which the target application can provide service functions after a specific operation is performed, obtaining operation prompt information for the focus element and function information of the service functions that the target application can provide after the focus element is operated according to the operation prompt information; generating the information to be played based on the operation prompt information and the function information.

[0078] Optionally, the method also includes: obtaining operable element identification information provided by the server to indicate whether the focus element is an operable element; and judging whether the focus element is an operable element for which the target application can provide a service function after a specific operation is performed, comprising: judging whether the focus element is an operable element based on the operable element identification information of the focus element.

[0079] Optionally, there are multiple functional information for the focus element, and each functional information of the focus element corresponds to operation prompt information; generating the information to be played based on the operation prompt information and the functional information includes: selecting functional information with delivery service characteristics from multiple functional information for the focus element; obtaining operation prompt information corresponding to the delivery service characteristics; generating the information to be played based on the delivery service characteristics and the operation prompt information corresponding to the functional information with delivery service characteristics.

[0080] Optionally, the method also includes: obtaining second delivery service feature identification information provided by the server for identifying whether each piece of functional information of the focus element has delivery service features; selecting functional information with delivery service features from multiple functional information for the focus element includes: selecting functional information with delivery service features from multiple functional information for the focus element according to the second delivery service feature identification information.

[0081] Optionally, there are multiple functional information for the focus element, and each functional information of the focus element corresponds to operation prompt information; generating the information to be played based on the operation prompt information and the functional information includes: selecting functional information that is of interest to a visually impaired user who is currently using the target application from multiple functional information for the focus element; obtaining operation prompt information corresponding to the functional information that is of interest to the visually impaired user; generating the information to be played based on the functional information that is of interest to the visually impaired user and the operation prompt information corresponding to the functional information that is of interest to the visually impaired user.

[0082] Optionally, the method also includes: obtaining second attention identification information provided by the server for identifying whether each functional information of the focus element is functional information that the visually impaired user is interested in; selecting functional information that the visually impaired user who is currently using the target application is interested in from multiple functional information for the focus element includes: selecting functional information that the visually impaired user is interested in from multiple functional information for the focus element based on the second attention identification information.

[0083] Optionally, selecting the functional information that is of interest to a visually impaired user who is currently using the target application from multiple functional information for the focus element includes: selecting the functional information that is of interest to the visually impaired user from multiple functional information for the focus element based on historical behavior data of the visually impaired user with respect to the target application; or selecting the functional information that is of interest to the visually impaired user from multiple functional information for the focus element based on usage experience information provided by the visually impaired user with respect to the target application.

[0084] Optionally, the information to be played is generated according to the operation prompt information and the function information, including: if neither the operation prompt information nor the function information has the delivery service characteristics, determining an associated element that has the delivery service characteristics and has an association relationship with the focus element; obtaining the element content of the associated element that has the delivery service characteristics; and generating the information to be played with the delivery service characteristics according to the operation prompt information, the function information and the element content of the associated element that has the delivery service characteristics.

[0085] Optionally, the method also includes: obtaining association relationship identification information provided by the server for identifying the association relationship between elements and third delivery service feature identification information for identifying whether the element in the target application is an element with delivery service characteristics; determining the associated element with the delivery service characteristics and having an association relationship with the focus element includes: determining the associated element with the delivery service characteristics and having an association relationship with the focus element according to the association relationship identification information and the third delivery service feature identification information.

[0086] Optionally, the target application is an online-to-offline service application; the focus element is any one of the following elements: a virtual button element; an image element.

[0087] The present application provides an information playback method, including: when the target application is in a visually impaired user operation mode, determining the focus element in the target application; obtaining the to-be-played information corresponding to the focus element, the to-be-played information including operation prompt information for the focus element and functional information of the service function that the target application can provide after the focus element is operated according to the operation prompt information; and playing the to-be-played information by voice. Through this method, visually impaired users can not only obtain the text information of the focus element, but also the operation prompt information of the focus element, thereby ensuring that the user can obtain the functional service corresponding to the focus element, and ultimately improving the user experience.

[0088] Second embodiment

[0089] Corresponding to the application scenario of the information playback method provided in the embodiment of the present application and the information playback method provided in the first embodiment, the second embodiment of the present application also provides an information playback device. Since the device embodiment is basically similar to the application scenario of the information playback method provided in the embodiment of the present application and the information playback method provided in the first embodiment, the description is relatively simple. For relevant parts, please refer to the application scenario of the information playback method provided in the embodiment of the present application and the partial description of the information playback method provided in the first embodiment. The device embodiment described below is only illustrative.

[0090] Please refer to Figure 4 , which is a schematic diagram of an information playing device provided in the second embodiment of the present application.

[0091] The information playback device provided in the second embodiment of the present application includes:

[0092] A focus element determination unit 401 is used to determine a focus element in a target application when the target application is in a visually impaired user operation mode; a to-be-played information acquisition unit 402 is used to obtain to-be-played information corresponding to the focus element, wherein the to-be-played information includes operation prompt information for the focus element and functional information of a service function that can be provided by the target application after the focus element is operated according to the operation prompt information; and a voice playback unit 403 is used to voice play the to-be-played information.

[0093] Optionally, determining the focus element in the target application includes: determining a selected element in the target application, and determining the selected element in the target application as the focus element.

[0094] Optionally, determining the focus element in the target application includes: determining a selected element in the target application; judging whether the selected element in the target application is an element with delivery service characteristics, and if so, determining the selected element in the target application as the focus element.

[0095] Optionally, the device is also used to: obtain first delivery service characteristic identification information provided by the server for identifying whether the element selected in the target application is an element with delivery service characteristics; the judging whether the element selected in the target application is an element with delivery service characteristics includes: judging whether the element selected in the target application is an element with delivery service characteristics based on the first delivery service characteristic identification information of the element selected in the target application.

[0096] Optionally, determining the focus element in the target application includes: determining a selected element in the target application; judging whether element content of the selected element in the target application is element content that a visually impaired user currently using the target application is interested in, and if so, determining the selected element in the target application as the focus element.

[0097] Optionally, the device is also used to: obtain first attention identification information provided by the server for identifying whether the element content of the element selected in the target application is the element content that the visually impaired user is interested in; the judging whether the element content of the element selected in the target application is the element content that the visually impaired user currently using the target application is interested in, comprising: judging whether the element content of the element selected in the target application is the element content that the visually impaired user currently using the target application is interested in, based on the first attention identification information of the element selected in the target application.

[0098] Optionally, determining whether the element content of the element selected in the target application is the element content that is of interest to a visually impaired user who is currently using the target application includes: determining whether the element content of the element selected in the target application is the element content that is of interest to a visually impaired user who is currently using the target application based on historical behavior data of the visually impaired user with respect to the target application; or determining whether the element content of the element selected in the target application is the element content that is of interest to a visually impaired user who is currently using the target application based on usage experience information fed back by the visually impaired user with respect to the target application.

[0099] Optionally, the device is also used to: obtain the to-be-played information corresponding to multiple elements in the target application provided by the server; the obtaining of the to-be-played information corresponding to the focus element includes: obtaining the to-be-played information corresponding to the focus element from the to-be-played information corresponding to multiple elements in the target application provided by the server according to the identification information of the focus element.

[0100] Optionally, the device is also used to: determine whether the focus element is an operable element that can provide service functions after a specific operation is performed on the target application; obtaining the information to be played corresponding to the focus element includes: if the focus element is an operable element that can provide service functions after a specific operation is performed on the target application, then obtaining operation prompt information for the focus element and function information of the service function that the target application can provide after the focus element is operated according to the operation prompt information; and generating the information to be played based on the operation prompt information and the function information.

[0101] Optionally, the device is also used to: obtain operable element identification information provided by the server to indicate whether the focus element is an operable element; and the judging whether the focus element is an operable element for which the target application can provide a service function after a specific operation is performed includes: judging whether the focus element is an operable element based on the operable element identification information of the focus element.

[0102] Optionally, there are multiple functional information for the focus element, and each functional information of the focus element corresponds to operation prompt information; generating the information to be played based on the operation prompt information and the functional information includes: selecting functional information with delivery service characteristics from multiple functional information for the focus element; obtaining operation prompt information corresponding to the delivery service characteristics; generating the information to be played based on the delivery service characteristics and the operation prompt information corresponding to the functional information with delivery service characteristics.

[0103] Optionally, the device is also used to: obtain second delivery service feature identification information provided by the server for identifying whether each functional information of the focus element has delivery service features; the selecting functional information with delivery service features from multiple functional information for the focus element includes: selecting functional information with delivery service features from multiple functional information for the focus element according to the second delivery service feature identification information.

[0104] Optionally, there are multiple functional information for the focus element, and each functional information of the focus element corresponds to operation prompt information; generating the information to be played based on the operation prompt information and the functional information includes: selecting functional information that is of interest to a visually impaired user who is currently using the target application from multiple functional information for the focus element; obtaining operation prompt information corresponding to the functional information that is of interest to the visually impaired user; generating the information to be played based on the functional information that is of interest to the visually impaired user and the operation prompt information corresponding to the functional information that is of interest to the visually impaired user.

[0105] Optionally, the device is also used to: obtain second attention identification information provided by the server for identifying whether each functional information of the focus element is functional information that the visually impaired user is interested in; and select the functional information that the visually impaired user who is currently using the target application is interested in from multiple functional information for the focus element, including: selecting the functional information that the visually impaired user is interested in from multiple functional information for the focus element according to the second attention identification information.

[0106] Optionally, selecting the functional information that is of interest to a visually impaired user who is currently using the target application from multiple functional information for the focus element includes: selecting the functional information that is of interest to the visually impaired user from multiple functional information for the focus element based on historical behavior data of the visually impaired user with respect to the target application; or selecting the functional information that is of interest to the visually impaired user from multiple functional information for the focus element based on usage experience information provided by the visually impaired user with respect to the target application.

[0107] Optionally, the information to be played is generated according to the operation prompt information and the function information, including: if neither the operation prompt information nor the function information has the delivery service characteristics, determining an associated element that has the delivery service characteristics and has an association relationship with the focus element; obtaining the element content of the associated element that has the delivery service characteristics; and generating the information to be played with the delivery service characteristics according to the operation prompt information, the function information and the element content of the associated element that has the delivery service characteristics.

[0108] Optionally, the device is also used to: obtain association relationship identification information provided by the server for identifying the association relationship between elements and third delivery service feature identification information for identifying whether the element in the target application is an element with delivery service characteristics; the determining of the associated element having the delivery service characteristics and having an association relationship with the focus element includes: determining the associated element having the delivery service characteristics and having an association relationship with the focus element based on the association relationship identification information and the third delivery service feature identification information.

[0109] Optionally, the target application is an online-to-offline service application; the focus element is any one of the following elements: a virtual button element; an image element.

[0110] Third embodiment

[0111] Corresponding to the application scenario of the information playback method provided in the embodiment of the present application, the information playback method provided in the first embodiment, and the information playback device provided in the second embodiment of the present application, the third embodiment of the present application also provides an electronic device. Since the third embodiment is basically similar to the application scenario of the information playback method provided in the embodiment of the present application, the information playback method provided in the first embodiment, and the information playback device provided in the second embodiment of the present application, the description is relatively simple. For relevant parts, please refer to the partial description of the application scenario of the information playback method provided in the embodiment of the present application, the information playback method provided in the first embodiment, and the information playback device provided in the second embodiment of the present application. The third embodiment described below is only exemplary.

[0112] Please refer to Figure 5 , which is a schematic diagram of an electronic device provided in an embodiment of the present application.

[0113] The electronic device includes: a processor 501;

[0114] The memory 502 is used to store a computer program, which is executed by the processor and the information playing method provided in the embodiment of the present application.

[0115] It should be noted that the detailed description of the electronic device provided in the third embodiment of the present application can refer to the application scenario of the information playback method provided in the embodiment of the present application, the information playback method provided in the first embodiment, and the relevant description of the information playback device provided in the second embodiment of the present application, which will not be repeated here.

[0116] Fourth embodiment

[0117] Corresponding to the application scenario of the information playback method provided in the embodiment of the present application, the information playback method provided in the first embodiment, and the information playback device provided in the second embodiment of the present application, the fourth embodiment of the present application also provides a computing storage medium. Since the fourth embodiment is basically similar to the application scenario of the information playback method provided in the embodiment of the present application, the information playback method provided in the first embodiment, and the information playback device provided in the second embodiment of the present application, the description is relatively simple. For relevant parts, please refer to the partial description of the application scenario of the information playback method provided in the embodiment of the present application, the information playback method provided in the first embodiment, and the information playback device provided in the second embodiment of the present application. The device embodiment described below is only illustrative.

[0118] The storage medium stores a computer program, and the computer program is run by a processor to execute the information playing method provided in the embodiment of the present application.

[0119] It should be noted that the detailed description of the computing storage medium provided in the fourth embodiment of the present application can refer to the application scenario of the information playback method provided in the embodiment of the present application, the information playback method provided in the first embodiment, and the relevant description of the information playback device provided in the second embodiment of the present application, and will not be repeated here.

[0120] Although the present application is disclosed as above in the form of a preferred embodiment, it is not intended to limit the present application. Any technical personnel in this field may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.

[0121] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0122] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0123] 1. Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include non-transitory media such as modulated data signals and carrier waves.

[0124] 2. Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems or computer program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

Claims

1. A method for playing information, characterized in that: include: When the target application is in a visually impaired user operation mode, determining a focus element in the target application; Obtaining to-be-played information corresponding to the focus element, the to-be-played information including operation prompt information for the focus element and function information of a service function that the target application can provide after the focus element is operated according to the operation prompt information; Voice playing of the information to be played; The information to be played is generated in the following manner: if neither the operation prompt information nor the function information has the delivery service feature, determining an associated element that has the delivery service feature and has an associated relationship with the focus element; obtaining element content of the associated element that has the delivery service feature; generating the information to be played that has the delivery service feature according to the operation prompt information, the function information, and the element content of the associated element that has the delivery service feature; The method further includes: obtaining association relationship identification information provided by the server for identifying the association relationship between elements and third delivery service feature identification information for identifying whether the element in the target application is an element with a delivery service feature; The determining of the associated element having the delivery service feature and having an associated relationship with the focus element includes: determining the associated element having the delivery service feature and having an associated relationship with the focus element according to the associated relationship identification information and the third delivery service feature identification information.

2. The method according to claim 1, characterized in that The determining the focus element in the target application includes: determining a selected element in the target application, and determining the selected element in the target application as the focus element.

3. The method according to claim 1, characterized in that Also includes: Obtaining first delivery service feature identification information provided by the server for identifying whether the selected element in the target application is an element with a delivery service feature; Determining whether the element selected in the target application is an element with a delivery service feature includes: determining whether the element selected in the target application is an element with a delivery service feature based on first delivery service feature identification information of the element selected in the target application.

4. The method according to claim 1, characterized in that: Also includes: Obtaining to-be-played information corresponding to a plurality of elements in the target application provided by the server; The obtaining of the to-be-played information corresponding to the focus element includes: obtaining the to-be-played information corresponding to the focus element from the to-be-played information corresponding to a plurality of elements in the target application provided by the server according to the identification information of the focus element.

5. The method according to claim 1, characterized in that Also includes: Determine whether the focus element is an operable element for which the target application can provide a service function after a specific operation is performed; The obtaining the to-be-played information corresponding to the focus element includes: If the focus element is an operable element that can provide a service function after a specific operation is performed on the focus element, obtaining operation prompt information for the focus element and function information of the service function that can be provided by the target application after the focus element is operated according to the operation prompt information; The information to be played is generated according to the operation prompt information and the function information.

6. The method according to claim 5, characterized in that Also includes: Obtaining operable element identification information provided by the server, which is used to indicate whether the focus element has an operable element; The determining whether the focus element is an operable element for which the target application can provide a service function after a specific operation is performed includes: determining whether the focus element is an operable element according to operable element identification information of the focus element.

7. The method according to claim 1, characterized in that The target application is an online-to-offline service application; The focus element is any of the following elements: Virtual button element; Graphic element.

8. An information playing device, characterized in that: include: A focus element determination unit, configured to determine a focus element in a target application when the target application is in a visually impaired user operation mode; a to-be-played information obtaining unit, configured to obtain the to-be-played information corresponding to the focus element, wherein the to-be-played information includes operation prompt information for the focus element and function information of a service function that the target application can provide after the focus element is operated according to the operation prompt information; A voice playing unit, used for playing the information to be played by voice; The information to be played is generated in the following manner: if neither the operation prompt information nor the function information has the delivery service feature, determining an associated element that has the delivery service feature and has an associated relationship with the focus element; obtaining element content of the associated element that has the delivery service feature; generating the information to be played that has the delivery service feature according to the operation prompt information, the function information, and the element content of the associated element that has the delivery service feature; The to-be-played information obtaining unit is further used to obtain association relationship identification information provided by the server for identifying the association relationship between elements and third delivery service feature identification information for identifying whether the element in the target application is an element with a delivery service feature; The determining of the associated element having the delivery service feature and having an associated relationship with the focus element includes: determining the associated element having the delivery service feature and having an associated relationship with the focus element according to the associated relationship identification information and the third delivery service feature identification information.

9. An electronic device, characterized in that: include: processor; A memory for storing a computer program, wherein the computer program is executed by a processor to perform the method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium stores a computer program, which is executed by a processor to perform the method according to any one of claims 1 to 7.

Images