Voice announcement method and apparatus

Abstract

The application discloses a voice broadcast method and device, and relates to the technical field of big data processing. A specific implementation of the method comprises the following steps: receiving a selection operation input by a user for a target page; determining a plurality of focus elements from a plurality of page elements of the target page according to the selection operation; performing clustering processing on the plurality of focus elements according to element types and element contents of the focus elements, and generating at least one element cluster; determining a playing order according to priority levels of the element clusters; for each element cluster: combining element contents of the plurality of focus elements in the element cluster to generate cluster content corresponding to the element cluster; combining the cluster content corresponding to each element cluster in the playing order to generate broadcast content; and playing the broadcast content in a voice mode. The implementation can play content friendly to users and better meet the reading needs of different users.

Description

Technical Field

[0001] This invention relates to the field of big data processing technology, and in particular to a voice broadcasting method and apparatus. Background Technology

[0002] Website accessibility ensures that anyone can easily access media content placed on web pages, making online content "approachable" and easily understood and used by different users. Screen readers are an assistive technology for accessible reading, used to help blind, visually impaired, illiterate, or learning-disabled individuals read web page content. However, the content played by screen readers is often not user-friendly and cannot adequately meet the reading needs of different users. Summary of the Invention

[0003] In view of this, embodiments of the present invention provide a voice broadcasting method and apparatus that can play user-friendly content and better meet the reading needs of different users.

[0004] In a first aspect, embodiments of the present invention provide a voice broadcasting method, including:

[0005] Receive user selection input for the target page;

[0006] Based on the selected operation, multiple focus elements are determined from multiple page elements of the target page;

[0007] Based on the element type and element content of each of the focal elements, the multiple focal elements are clustered to generate at least one element cluster;

[0008] The playback order is determined based on the priority of each element cluster.

[0009] For each element cluster: combine the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster;

[0010] Based on the playback order, the cluster content corresponding to each element cluster is combined to generate the broadcast content;

[0011] The broadcast content is played via voice.

[0012] Optionally, determining multiple focus elements from multiple page elements of the target page based on the selection operation includes:

[0013] In response to the selected operation being a swipe operation, the multiple page elements to which the selected operation is swiped are determined from the multiple page elements of the target page;

[0014] The multiple page elements that the selected operation slides to are identified as the multiple focus elements.

[0015] Optionally, determining multiple focus elements from multiple page elements of the target page based on the selection operation includes:

[0016] In response to the selected operation being a drawing operation, the target area defined by the selected operation in the target page is determined;

[0017] Multiple page elements in the target area are identified as the multiple focus elements.

[0018] Optionally, the step of clustering the multiple focus elements according to their element type and content to generate at least one element cluster includes:

[0019] Based on the element type of each of the focal elements, the multiple focal elements are clustered to generate a navigation element cluster and a non-navigation element set;

[0020] Retrieve multiple non-navigation elements from the set of non-navigation elements;

[0021] Based on the element type and element content of each non-navigation element, the multiple non-navigation elements are clustered to generate at least one interface element cluster.

[0022] Optionally, the element clustering is a navigation element clustering;

[0023] The step of combining the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster includes:

[0024] Determine the position information of multiple navigation elements in the navigation element cluster on the target page;

[0025] Based on the position information of the multiple navigation elements in the target page, determine the combination order of the multiple navigation elements;

[0026] Based on the combination order of the multiple navigation elements, the element content corresponding to each navigation element is combined to generate the cluster content corresponding to the navigation element cluster.

[0027] Optionally, the step of combining the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster includes:

[0028] Determine the attribute information of each focal element in the element cluster; wherein, the attribute information includes: element text, element type, and element state;

[0029] For each of the focus elements: combine the attribute information of the focus elements to generate the element content of the focus elements.

[0030] Optionally, the step of combining the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster includes:

[0031] For each focal element in the element cluster: determine the relevant content of the focal element in the element cluster; based on the element content and relevant content of the focal element in the element cluster, generate the complete content of the focal element in the element cluster;

[0032] The complete content of each focal element in the element cluster is combined to generate the cluster content corresponding to the element cluster.

[0033] The complete content of each focal element in the element cluster is combined to generate the cluster content corresponding to the element cluster.

[0034] Secondly, embodiments of the present invention provide a voice broadcasting device, comprising:

[0035] The operation receiving module is used to receive the selected operation entered by the user for the target page;

[0036] The element determination module is used to determine multiple focus elements from multiple page elements of the target page according to the selected operation.

[0037] The clustering module is used to perform clustering processing on the multiple focus elements according to the element type and element content of each focus element, and generate at least one element cluster.

[0038] The sequence determination module is used to determine the playback order based on the priority level of each element cluster;

[0039] The combination module is used to combine the element content of multiple focus elements in each element cluster to generate the cluster content corresponding to the element cluster for each element cluster.

[0040] The content generation module is used to combine the cluster content corresponding to each element cluster in the playback order to generate broadcast content; the content playback module is used to play the broadcast content in a voice manner.

[0041] Optionally, the element determination module is specifically used for:

[0042] In response to the selected operation being a swipe operation, the multiple page elements to which the selected operation is swiped are determined from the multiple page elements of the target page;

[0043] The multiple page elements that the selected operation slides to are identified as the multiple focus elements.

[0044] Optionally, the element determination module is specifically used for:

[0045] In response to the selected operation being a drawing operation, the target area defined by the selected operation in the target page is determined;

[0046] Multiple page elements in the target area are identified as the multiple focus elements.

[0047] Optionally, the clustering module is specifically used for:

[0048] Based on the element type of each of the focal elements, the multiple focal elements are clustered to generate a navigation element cluster and a non-navigation element set;

[0049] Retrieve multiple non-navigation elements from the set of non-navigation elements;

[0050] Based on the element type and element content of each non-navigation element, the multiple non-navigation elements are clustered to generate at least one interface element cluster.

[0051] Optionally, the element clustering is a navigation element clustering;

[0052] The combined module is specifically used for:

[0053] Determine the position information of multiple navigation elements in the navigation element cluster on the target page;

[0054] Based on the position information of the multiple navigation elements in the target page, determine the combination order of the multiple navigation elements;

[0055] Based on the combination order of the multiple navigation elements, the element content corresponding to each navigation element is combined to generate the cluster content corresponding to the navigation element cluster.

[0056] Thirdly, embodiments of the present invention provide an electronic device, including:

[0057] One or more processors;

[0058] A storage device for storing one or more programs that, when executed by one or more processors, cause the one or more processors to perform the method described in any of the above embodiments.

[0059] Fourthly, embodiments of the present invention provide a computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the methods described in any of the above embodiments.

[0060] Fifthly, embodiments of the present invention provide a computer program product, including a computer program that, when executed by a processor, implements the methods described in any of the above embodiments.

[0061] One embodiment of the above invention has the following advantages or beneficial effects: Based on the user's selection operation on the target page, multiple focus elements are determined from multiple page elements on the target page. Based on the element type and content of each focus element, the multiple focus elements are clustered to generate at least one element cluster. The playback order is determined according to the priority level of the element clusters, and the playback order can be reasonably set according to each element cluster. The cluster content corresponding to each element cluster is combined according to the playback order to generate the broadcast content. The playback content is complete and user-friendly, and can better meet the reading needs of different users.

[0062] The further effects of the aforementioned unconventional alternative methods will be explained below in conjunction with specific implementation methods. Attached Figure Description

[0063] The accompanying drawings are provided to better understand the invention and are not intended to unduly limit the scope of the invention. Wherein:

[0064] Figure 1 This is a flowchart illustrating a voice broadcasting method provided in the first embodiment of the present invention;

[0065] Figure 2 This is a flowchart illustrating a voice broadcasting method provided in the second embodiment of the present invention;

[0066] Figure 3 This is a flowchart illustrating a voice broadcasting method provided in the third embodiment of the present invention;

[0067] Figure 4 This is a schematic diagram of a payment mechanism for visually impaired users provided in an embodiment of the present invention;

[0068] Figure 5 This is a schematic diagram of the structure of a voice broadcasting device provided in an embodiment of the present invention;

[0069] Figure 6 This is a schematic diagram of the structure of a computer system suitable for implementing terminal devices or servers of the present invention. Detailed Implementation

[0070] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of the present invention, including various details to aid understanding. These details should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the invention. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0071] The acquisition, transmission, storage, use, and processing of data in this application all comply with the relevant provisions of national laws and regulations.

[0072] It should be noted that in the embodiments of this application, certain software, components, models and other existing solutions in the industry may be mentioned. These should be regarded as exemplary and are only intended to illustrate the feasibility of implementing the technical solution of this application. However, it does not mean that the applicant has used or necessarily used the solution.

[0073] Figure 1 This is a flowchart illustrating a voice broadcasting method provided in the first embodiment of the present invention, as shown below. Figure 1 As shown, the method includes:

[0074] Step 101: Receive the user's selection action for the target page.

[0075] Step 102: Based on the selected operation, identify multiple focus elements from multiple page elements on the target page.

[0076] Users can select multiple focus elements from a range of page elements on a target page through swiping, drawing, or continuous clicking. Page elements can include: buttons, labels, text boxes, radio buttons, checkboxes, etc.

[0077] In one embodiment of the present invention, determining multiple focus elements from multiple page elements of a target page based on a selected operation includes: in response to the selected operation being a swipe operation, determining multiple page elements that the selected operation swipes to from multiple page elements of the target page; and determining the multiple page elements that the selected operation swipes to as multiple focus elements. If the selected operation is a swipe operation, the multiple page elements that the swipe operation swipes to are determined as multiple focus elements.

[0078] In one embodiment of the present invention, determining multiple focus elements from multiple page elements of a target page according to a selection operation includes: in response to a selection operation being a drawing operation, determining a target area defined by the selection operation on the target page; and determining multiple page elements in the target area as multiple focus elements. If the selection operation is a drawing operation, determining the target area defined by the selection operation on the target page, and determining multiple page elements in the target area as multiple focus elements. The drawing operation is used to draw a closed area on the target page.

[0079] Step 103: Based on the element type and element content of each focal element, perform clustering processing on multiple focal elements to generate at least one element cluster.

[0080] Element types can include navigation elements, interface elements, etc. Element types can be further categorized into: buttons, labels, text boxes, etc. Element content can be element text. Element text is used to represent the function and purpose of the focused element. Element text can be the text displayed on the focused element. Element text can be set according to business needs.

[0081] At least one focal element with the same element type can be clustered into one element cluster. At least one focal element with similar element content can also be clustered into one element cluster.

[0082] Step 104: Determine the playback order based on the priority of each element cluster.

[0083] The priority of element clusters can be preset. If the priority of the first element cluster is higher than that of the second element cluster, the cluster content of the first element cluster will be played first, followed by the cluster content of the second element cluster.

[0084] Step 105: Clustering for each element: Combine the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster.

[0085] Step 106: Combine the cluster content corresponding to each element cluster in the playback order to generate the broadcast content.

[0086] In one embodiment of the present invention, the element content of multiple focal elements in an element cluster is combined to generate cluster content corresponding to the element cluster, including: determining the attribute information of each focal element in the element cluster; wherein, the attribute information includes: element text, element type and element status; for each focal element: combining the attribute information of the focal element to generate element content of the focal element.

[0087] Element types can include buttons, labels, text boxes, etc. Element states can include selected, unselected, etc. For each focused element, the various attribute information of the focused element is combined, that is, the element text, element type, and element state of the focused element are combined to generate the element content of the focused element. Through the element content, users can fully and clearly understand the relevant information of the focused element.

[0088] Step 107: Play the announcement via voice.

[0089] In this embodiment of the invention, based on the user's selection operation on the target page, multiple focus elements are determined from multiple page elements on the target page. Based on the element type and content of each focus element, the multiple focus elements are clustered to generate at least one element cluster. The playback order is determined according to the priority level of the element clusters, and the playback order can be reasonably set according to each element cluster. The cluster content corresponding to each element cluster is combined according to the playback order to generate the broadcast content. The playback content is complete and user-friendly, and can better meet the reading needs of different users.

[0090] Figure 2 This is a flowchart illustrating a voice broadcasting method provided in the second embodiment of the present invention, as shown below. Figure 2 As shown, the method includes:

[0091] Step 201: Receive the user's selection action for the target page.

[0092] Step 202: Based on the selected operation, identify multiple focus elements from multiple page elements on the target page.

[0093] Step 203: Based on the element type of each focus element, perform clustering on multiple focus elements to generate a navigation element cluster and a non-navigation element set.

[0094] If the focused element is a navigation element, it is placed in the navigation element cluster. If the focused element is a non-navigation element, it is placed in the non-navigation element cluster.

[0095] Step 204: Obtain multiple non-navigation elements from the non-navigation element set; based on the element type and content of each non-navigation element, perform clustering processing on the multiple non-navigation elements to generate at least one interface element cluster.

[0096] Based on the element type and text of each non-navigation element, multiple non-focus elements are clustered to generate at least one interface element cluster, that is, non-navigation elements with the same element type and similar element text are grouped into the same interface element cluster.

[0097] For example, all non-navigation elements are buttons. These non-navigation elements include: water bill, electricity bill, housing provident fund service, and personal credit report. Clustering these non-navigation elements yields two interface element clusters: utility payment and government services. Utility payment includes: water bill and electricity bill. Government services include: housing provident fund service and personal credit report.

[0098] Step 205: Determine the playback order based on the priority of each element cluster.

[0099] Step 206: Clustering for each element: Combine the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster.

[0100] First, determine the combination order of multiple focal elements in the element cluster; based on the combination order of multiple focal elements in the element cluster, combine the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster.

[0101] For element clustering, which is defined as interface element clustering, the combination order of multiple focus elements within an interface cluster can be determined by the order in which the user selects the focus elements. Alternatively, the combination order can be determined based on the position of the focus elements on the target page, following a left-to-right or top-to-bottom order.

[0102] For element clustering as navigation element clustering, the content of multiple focus elements in the element cluster is combined to generate the cluster content corresponding to the element cluster. This includes: determining the position information of multiple navigation elements in the navigation element cluster on the target page; determining the combination order of multiple navigation elements according to the position information of multiple navigation elements on the target page; and combining the element content of each navigation element according to the combination order to generate the cluster content corresponding to the navigation element cluster.

[0103] Navigation elements are page elements within the target page's navigation. Based on their position on the target page, the combination order of multiple navigation elements can be determined from left to right and top to bottom. Then, based on this combination order, clustering content corresponding to the navigation element clusters is generated.

[0104] For navigation elements, the playback order of multiple focused elements can be determined from left to right and top to bottom. The playback order of the generated broadcast content is consistent with the normal browsing order of the page, improving the user's browsing experience of the target page.

[0105] Step 207: Combine the cluster content corresponding to each element cluster in the playback order to generate the broadcast content.

[0106] Step 208: Combine the attribute information of the focused element and play the broadcast content by voice.

[0107] In the embodiment of this invention, each focus element is first clustered into a navigation element cluster and a non-navigation element set. Then, the non-navigation element set is further subdivided into at least one interface element cluster. This allows for the generation of different clustered content based on different element clusters, resulting in more organized and user-friendly broadcast content.

[0108] Figure 3 This is a flowchart illustrating a voice broadcasting method provided in the third embodiment of the present invention, as shown below. Figure 3 As shown, the method includes:

[0109] Step 301: Receive the user's selection action for the target page.

[0110] Step 302: Based on the selected operation, identify multiple focus elements from multiple page elements on the target page.

[0111] Step 303: Based on the element type and element content of each focal element, perform clustering processing on multiple focal elements to generate at least one element cluster.

[0112] Step 304: Determine the playback order based on the priority of each element cluster.

[0113] Step 305: For each focal element in the element cluster: determine the relevant content of the focal element in the element cluster; based on the element content and relevant content of the focal element in the element cluster, generate the complete content of the focal element in the element cluster;

[0114] Step 306: Combine the complete content of each focal element in the element cluster to generate the cluster content corresponding to the element cluster.

[0115] The content of the focus element can be set according to business needs. If the focus element's content is "paying electricity bills," then the related content could include: account name, account number, home address, etc. Combining the focus element's content and related content generates the focus element's complete content. Using the complete content of each focus element, a broadcast message is generated. This complete information provides users with more comprehensive and specific broadcast content, improving the accuracy of information retrieval and increasing user efficiency.

[0116] Step 307: Combine the cluster content corresponding to each element cluster in the playback order to generate the broadcast content.

[0117] Step 308: Play the announcement via voice.

[0118] In the solution of this embodiment of the invention, for each focal element in the element cluster, complete content of the focal element in the element cluster is generated based on the element content and related content of the focal element in the element cluster; the complete content of each focal element in the element cluster is combined to generate the cluster content corresponding to the element cluster. The playback content obtained by using the solution of this embodiment of the invention has better organization, more comprehensive content, and is easier for users to understand the relevant content displayed on the page.

[0119] In one embodiment of the present invention, the element types of the multiple focal elements include: a first type and a second type. Based on the element type and element content of each focal element, the multiple focal elements are clustered to generate at least one element cluster, including: determining multiple first focal elements corresponding to the first type and placing the multiple first focal elements into the first cluster; determining multiple second focal elements corresponding to the second type and placing the multiple second focal elements into the second cluster.

[0120] Determine the first combination order corresponding to the first cluster; determine the second combination order corresponding to the second cluster; determine the playback order corresponding to the first type and the second type.

[0121] Element types can include: buttons, labels, pages, navigation elements, text boxes, etc. For example, the first type is navigation elements, and the second type is text box elements. For the first type (navigation elements), determine the multiple first focus elements corresponding to the navigation elements, and determine the first combination order corresponding to the first cluster. The combination order corresponding to the first cluster can be determined by the order in which the user selects the focus elements. Alternatively, it can be determined based on the position information of the first focus elements on the target page, in a left-to-right, top-to-bottom order.

[0122] Similarly, for the second type of text box element, determine the multiple second focus elements corresponding to the text box, and determine the second combination order corresponding to the second cluster.

[0123] The method of combining the element content of multiple focal elements in an element cluster to generate the cluster content corresponding to the element cluster includes: combining the element content of each first focal element in the first cluster according to a first combination order to generate the first cluster content corresponding to the first cluster; combining the element content of each second focal element in the second cluster according to a second combination order to generate the second cluster content corresponding to the second cluster; and combining the first cluster content and the second cluster content according to the playback order to generate the broadcast content.

[0124] For example, the first type is a navigation element, and the second type is a text box element. First cluster content is generated for the first cluster, and second cluster content is generated for the second cluster. Finally, based on the playback order, the first and second cluster contents are combined to generate the broadcast content. The playback order can be determined based on the priority level corresponding to the element type.

[0125] Elderly people or visually impaired individuals are accustomed to swiping on screens with their hands rather than using their fingers for precise taps. Based on this swiping interaction method, multiple focus elements on the target page are identified. The content of the focus elements can include: element text, element type, and element status. For element text, the principle of "what you see is what you read" is followed, and the text is kept as concise as possible. Element types can include: buttons, labels, pages, etc. Element status can include: selected, unselected, etc. Elements in a focused active state can be read. For navigation elements, element announcements can be made from left to right and from top to bottom. Appropriate element text, element type, and element status are set for each element, and it is determined whether the screen reader mode for the target page is enabled.

[0126] The development logic for voice announcement is as follows: Set appropriate element content for page elements. Attribute information of page elements can be saved through layout files. Then, the attribute information in the layout text is called through code. Set the correct element type for page elements. It is necessary to ensure that visually impaired users understand the type of the element being clicked, such as a button or image. The system announces the element type when the control gains focus.

[0127] Set focus navigation for page elements. Accessible focus navigation typically reads information sequentially from left to right and top to bottom, requiring careful control of the page's focus view. Assemble navigation elements in the focus navigation bar, and read the element information to be read sequentially to complete the accessible voice broadcast.

[0128] Interface elements are primarily arranged between icons and text, between icons, or between text. Grouping elements of the same type together, or elements with similar functions together, helps visually impaired users avoid distractions when using the functions and also improves convenience.

[0129] Page content is generally processed in modules, with similar modules grouped together, but the content within each module needs to maintain a logical and reasonable layout. The page structure design mainly analyzes the conversion relationships between functions; the hierarchical relationship between the main interface and secondary interfaces directly determines the navigation between functional interfaces. The information on the parent page provides an overview of the functions on the next level interface, while the information on the next level interface provides detailed content or explanations of the parent page.

[0130] Figure 4This is a schematic diagram of a payment mechanism for visually impaired users provided in an embodiment of the present invention. Figure 4 As shown, the utility floor card is a commonly used quick access point for payment. The card is displayed in the payment section of the main page. The system integrates and refines the information from the payment card, providing a seamless payment announcement in a complete and accessible format. The announcement, from beginning to end, may include: outstanding bills, water bill, account name, account number, and "Pay Now." This then redirects to the payment details page.

[0131] Since the basic payment information is already clearly displayed during the payment card reading process, no further confirmation is needed; the user is directly redirected to the payment details page. This is highly user-friendly for visually impaired users, allowing them to quickly find their bills. The payment card already contains all the basic payment information; users simply need to listen and read it aloud. By playing the complete payment information, users can complete the payment without any additional clicks or operations. The voice broadcast is fully encapsulated in card format, ensuring uninterrupted playback and reducing user intervention. Users can also clearly locate the payment information on the card; if anything is unclear, they can simply click the card again and listen to the information again. This method effectively improves the browsing experience and operational efficiency for visually impaired individuals.

[0132] Figure 5 This is a schematic diagram of the structure of a voice broadcasting device provided in one embodiment of the present invention, as shown below. Figure 5 As shown, the device includes:

[0133] The operation receiving module 501 is used to receive the selected operation input by the user for the target page;

[0134] The element determination module 502 is used to determine multiple focus elements from multiple page elements on the target page based on the selected operation.

[0135] Clustering module 503 is used to perform clustering processing on multiple focal elements according to the element type and element content of each focal element, and generate at least one element cluster.

[0136] The sequence determination module 504 is used to determine the playback order based on the priority level of each element cluster;

[0137] The combination module 505 is used to cluster each element: combine the element content of multiple focus elements in the element cluster to generate the cluster content corresponding to the element cluster.

[0138] The content generation module 506 is used to combine the cluster content corresponding to each element cluster in the playback order to generate broadcast content.

[0139] The content playback module 507 is used to play broadcast content via voice.

[0140] Optionally, the element determination module 502 is specifically used for:

[0141] In response to the selected action being a swipe action, determine the multiple page elements to which the selected action will swipe from among multiple page elements on the target page;

[0142] Select multiple page elements that the selected operation has slid to, and designate them as multiple focus elements.

[0143] Optionally, the element determination module 502 is specifically used for:

[0144] In response to a selection operation being a checkmark operation, the target area defined by the selection operation on the target page is determined.

[0145] Identify multiple page elements in the target area as multiple focus elements.

[0146] Optionally, clustering module 503 is specifically used for:

[0147] Based on the element type of each focus element, multiple focus elements are clustered to generate a navigation element cluster and a non-navigation element set;

[0148] Retrieves multiple non-navigation elements from a collection of non-navigation elements;

[0149] Based on the element type and content of each non-navigation element, multiple non-navigation elements are clustered to generate at least one interface element cluster.

[0150] Optionally, the element clustering is for navigation elements;

[0151] The combined module 505 is specifically used for:

[0152] Determine the position information of multiple navigation elements in the navigation element cluster on the target page;

[0153] Determine the combination order of multiple navigation elements based on their position information on the target page;

[0154] Based on the combination order of multiple navigation elements, the content of each navigation element is combined to generate the cluster content corresponding to the navigation element cluster.

[0155] Optionally, the combination module 505 is specifically used for:

[0156] Determine the attribute information of each focal element in the element cluster; the attribute information includes: element text, element type, and element status;

[0157] For each focused element: combine the attribute information of the focused element to generate the element content of the focused element.

[0158] Optionally, the combination module 505 is specifically used for:

[0159] For each focal element in the element cluster: determine the relevant content of the focal element in the element cluster; based on the element content and relevant content of the focal element in the element cluster, generate the complete content of the focal element in the element cluster;

[0160] Combine the complete content of each focal element in the element cluster to generate the corresponding cluster content.

[0161] Combine the complete content of each focal element in the element cluster to generate the corresponding cluster content.

[0162] This invention provides an electronic device, comprising:

[0163] One or more processors;

[0164] A storage device for storing one or more programs that, when executed by one or more processors, cause the one or more processors to implement the methods of any of the above embodiments.

[0165] This invention provides a computer program product, including a computer program that, when executed by a processor, implements the voice broadcasting method of this invention.

[0166] The following is for reference. Figure 6 It shows a schematic diagram of the structure of a computer system 600 suitable for implementing a terminal device of the present invention. Figure 6 The terminal device shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.

[0167] like Figure 6 As shown, the computer system 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 602 or programs loaded from storage section 608 into random access memory (RAM) 603. The RAM 603 also stores various programs and data required for the operation of the system 600. The CPU 601, ROM 602, and RAM 603 are interconnected via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0168] The following components are connected to I / O interface 605: an input section 606 including a keyboard, mouse, etc.; an output section 607 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN card, modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to I / O interface 605 as needed. A removable medium 611, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on drive 610 as needed so that computer programs read from it can be installed into storage section 608 as needed.

[0169] In particular, according to the embodiments disclosed in this invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 609, and / or installed from removable medium 611. When the computer program is executed by central processing unit (CPU) 601, it performs the functions defined above in the system of this invention.

[0170] It should be noted that the computer-readable medium shown in this invention can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this invention, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0171] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0172] The modules described in the embodiments of the present invention can be implemented in software or hardware. The described modules can also be housed in a processor, and for example, can be described as: an operation receiving module, an element determination module, a clustering module, a sequence determination module, a combination module, a content generation module, and a content playback module. The names of these modules do not necessarily limit the module itself; for example, the operation receiving module can also be described as "a module that receives selected operations input by the user for a target page."

[0173] In another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiments; or it may exist independently and not assembled into the device. The computer-readable medium carries one or more programs, which, when executed by the device, cause the device to include:

[0174] Receive user selection input for the target page;

[0175] Based on the selected operation, identify multiple focus elements from multiple page elements on the target page;

[0176] Based on the element type and content of each focal element, multiple focal elements are clustered to generate at least one element cluster.

[0177] The playback order is determined based on the priority of each element's cluster.

[0178] For each element cluster: combine the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster;

[0179] Based on the playback order, combine the cluster content corresponding to each element cluster to generate the broadcast content;

[0180] The announcement is played via voice.

[0181] According to the technical solution of this invention, based on the user's selection operation on the target page, multiple focus elements are determined from multiple page elements on the target page. Based on the element type and content of each focus element, the multiple focus elements are clustered to generate at least one element cluster. The playback order is determined according to the priority level of the element clusters, and the playback order can be reasonably set according to each element cluster. The cluster content corresponding to each element cluster is combined according to the playback order to generate the broadcast content. The playback content is complete and user-friendly, and can better meet the reading needs of different users.

[0182] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can occur depending on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A voice broadcasting method, characterized in that, include: Receive user selection input for the target page; Based on the selected operation, multiple focus elements are determined from multiple page elements of the target page; Based on the element type and element content of each of the focal elements, the multiple focal elements are clustered to generate at least one element cluster; The playback order is determined based on the priority of each element cluster. For each element cluster: combine the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster; Based on the playback order, the cluster content corresponding to each element cluster is combined to generate the broadcast content; The broadcast content is played via voice.

2. The method according to claim 1, characterized in that, The step of determining multiple focus elements from multiple page elements of the target page based on the selected operation includes: In response to the selected operation being a swipe operation, the multiple page elements to which the selected operation is swiped are determined from the multiple page elements of the target page; The multiple page elements that the selected operation slides to are identified as the multiple focus elements.

3. The method according to claim 1, characterized in that, The step of determining multiple focus elements from multiple page elements of the target page based on the selected operation includes: In response to the selected operation being a drawing operation, the target area defined by the selected operation in the target page is determined; Multiple page elements in the target area are identified as the multiple focus elements.

4. The method according to claim 1, characterized in that, The step of clustering the multiple focus elements according to their element type and content to generate at least one element cluster includes: Based on the element type of each of the focal elements, the multiple focal elements are clustered to generate a navigation element cluster and a non-navigation element set; Retrieve multiple non-navigation elements from the set of non-navigation elements; Based on the element type and element content of each non-navigation element, the multiple non-navigation elements are clustered to generate at least one interface element cluster.

5. The method according to claim 1, characterized in that, The element clustering is a navigation element clustering; The step of combining the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster includes: Determine the position information of multiple navigation elements in the navigation element cluster on the target page; Based on the position information of the multiple navigation elements in the target page, determine the combination order of the multiple navigation elements; Based on the combination order of the multiple navigation elements, the element content corresponding to each navigation element is combined to generate the cluster content corresponding to the navigation element cluster.

6. The method according to claim 1, characterized in that, The step of combining the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster includes: Determine the attribute information of each focal element in the element cluster; wherein, the attribute information includes: element text, element type, and element state; For each focal element in the element cluster: combine the attribute information of the focal element to generate the element content of the focal element.

7. The method according to claim 1, characterized in that, The step of combining the element content of multiple focal elements in the element cluster to generate the cluster content corresponding to the element cluster includes: For each focal element in the element cluster: determine the relevant content of the focal element in the element cluster; based on the element content and relevant content of the focal element in the element cluster, generate the complete content of the focal element in the element cluster; The complete content of each focal element in the element cluster is combined to generate the cluster content corresponding to the element cluster.

8. A voice broadcasting device, characterized in that, include: The operation receiving module is used to receive the selected operation entered by the user for the target page; The element determination module is used to determine multiple focus elements from multiple page elements of the target page according to the selected operation. The clustering module is used to perform clustering processing on the multiple focus elements according to the element type and element content of each focus element, and generate at least one element cluster. The sequence determination module is used to determine the playback order based on the priority level of each element cluster; The combination module is used to combine the element content of multiple focus elements in each element cluster to generate the cluster content corresponding to the element cluster for each element cluster. The content generation module is used to combine the cluster content corresponding to each element cluster in the playback order to generate broadcast content; the content playback module is used to play the broadcast content in a voice manner.

9. The apparatus according to claim 8, characterized in that, The element determination module is specifically used for: In response to the selected operation being a swipe operation, the multiple page elements to which the selected operation is swiped are determined from the multiple page elements of the target page; The multiple page elements that the selected operation slides to are identified as the multiple focus elements.

10. The apparatus according to claim 8, characterized in that, The element determination module is specifically used for: In response to the selected operation being a drawing operation, the target area defined by the selected operation in the target page is determined; Multiple page elements in the target area are identified as the multiple focus elements.

11. The apparatus according to claim 8, characterized in that, The clustering module is specifically used for: Based on the element type of each of the focal elements, the multiple focal elements are clustered to generate a navigation element cluster and a non-navigation element set; Retrieve multiple non-navigation elements from the set of non-navigation elements; Based on the element type and element content of each non-navigation element, the multiple non-navigation elements are clustered to generate at least one interface element cluster.

12. The apparatus according to claim 8, characterized in that, The element clustering is a navigation element clustering; The combined module is specifically used for: Determine the position information of multiple navigation elements in the navigation element cluster on the target page; Based on the position information of the multiple navigation elements in the target page, determine the combination order of the multiple navigation elements; Based on the combination order of the multiple navigation elements, the element content corresponding to each navigation element is combined to generate the cluster content corresponding to the navigation element cluster.

13. An electronic device, characterized in that, include: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1-7.

14. A computer-readable medium having a computer program stored thereon, characterized in that... When the program is executed by the processor, it implements the method as described in any one of claims 1-7.

15. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1-7.

Images