Voice broadcasting method and device

Abstract

The invention discloses a voice broadcasting method and device, and relates to the technical field of big data processing. A specific embodiment of the method comprises the steps of receiving a selection operation input by a user for a target page; determining a plurality of focus elements from a plurality of page elements of the target page according to the selection operation; according to the element type and the element content of each focus element, performing clustering processing on the plurality of focus elements to generate at least one element cluster; determining a playing sequence according to the priority level of each element cluster; for each element cluster, combining the element contents of the plurality of focus elements in the element cluster, and generating cluster contents corresponding to the element cluster; combining the clustering contents corresponding to the element clusters according to a playing sequence to generate broadcast contents; and playing the broadcast content in a voice mode. According to the embodiment, the content friendly to the user can be played, and the reading requirements of different users can be well met.

Description

Technical Field

[0001] The present invention relates to the technical field of big data processing, and in particular to a voice broadcasting method and device. Background Art

[0002] Website accessibility is used to ensure that anyone can easily access the media content placed on the web page, that is, to make the content on the Internet "easy to approach" and easy for different users to understand and use. Screen readers are an assistive technology for barrier-free reading, which can be used to help the blind, visually impaired, illiterate or learning disabled people read the content of the page. However, the content played by screen readers is usually not user-friendly and cannot meet the reading needs of different users. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a voice broadcast method and device, which can play user-friendly content and better meet the reading needs of different users.

[0004] In a first aspect, an embodiment of the present invention provides a voice broadcast method, comprising:

[0005] Receive a selected operation input by the user for the target page;

[0006] According to the selection operation, a plurality of focus elements are determined from a plurality of page elements of the target page;

[0007] Clustering the multiple focus elements according to the element type and element content of each of the focus elements to generate at least one element cluster;

[0008] Determining a playback order according to the priority level of each element cluster;

[0009] For each of the element clusters: combining element contents of a plurality of focus elements in the element cluster to generate cluster contents corresponding to the element cluster;

[0010] Combining the cluster contents corresponding to each of the element clusters in the playback order to generate broadcast content;

[0011] Play the announcement content in voice mode.

[0012] Optionally, the determining of a plurality of focus elements from a plurality of page elements of the target page according to the selection operation includes:

[0013] In response to the selected operation being a sliding operation, determining, from a plurality of page elements of the target page, a plurality of page elements to which the selected operation slides;

[0014] The multiple page elements to which the selection operation is slid are determined as the multiple focus elements.

[0015] Optionally, the determining of a plurality of focus elements from a plurality of page elements of the target page according to the selection operation includes:

[0016] In response to the selected operation being a drawing operation, determining a target area defined by the selected operation in the target page;

[0017] The multiple page elements in the target area are determined as the multiple focus elements.

[0018] Optionally, clustering the multiple focus elements according to the element type and element content of each of the focus elements to generate at least one element cluster includes:

[0019] Clustering the multiple focus elements according to the element type of each focus element to generate a navigation element cluster and a non-navigation element set;

[0020] Acquire multiple non-navigation elements in the non-navigation element set;

[0021] According to the element type and element content of each of the non-navigation elements, clustering processing is performed on the multiple non-navigation elements to generate at least one interface element cluster.

[0022] Optionally, the element clustering is navigation element clustering;

[0023] The combining the element contents of the plurality of focus elements in the element cluster to generate cluster contents corresponding to the element cluster includes:

[0024] Determining location information of a plurality of navigation elements in the navigation element cluster in a target page;

[0025] Determining a combination order corresponding to the plurality of navigation elements according to position information of the plurality of navigation elements in the target page;

[0026] According to the combination order corresponding to the plurality of navigation elements, element contents corresponding to the navigation elements are combined to generate cluster contents corresponding to the navigation element cluster.

[0027] Optionally, combining the element contents of the plurality of focus elements in the element cluster to generate cluster content corresponding to the element cluster includes:

[0028] Determine the attribute information of each focus element in the element cluster; wherein the attribute information includes: element text, element type and element status;

[0029] For each of the focus elements: combining each attribute information of the focus element to generate element content of the focus element.

[0030] Optionally, combining the element contents of the plurality of focus elements in the element cluster to generate cluster content corresponding to the element cluster includes:

[0031] For each focus element in the element cluster: determining relevant content of the focus element in the element cluster; generating complementary content of the focus element in the element cluster according to the element content and relevant content of the focus element in the element cluster;

[0032] The completion contents of each focus element in the element cluster are combined to generate cluster contents corresponding to the element cluster.

[0033] The completion contents of each focus element in the element cluster are combined to generate cluster contents corresponding to the element cluster.

[0034] In a second aspect, an embodiment of the present invention provides a voice broadcasting device, comprising:

[0035] An operation receiving module, used for receiving a selected operation input by a user for a target page;

[0036] An element determination module, used to determine a plurality of focus elements from a plurality of page elements of the target page according to the selection operation;

[0037] A clustering module, configured to perform clustering processing on the plurality of focus elements according to the element type and element content of each of the focus elements, and generate at least one element cluster;

[0038] An order determination module, used to determine the playback order according to the priority level of each element cluster;

[0039] A combining module, configured to combine, for each of the element clusters, the element contents of a plurality of focus elements in the element cluster to generate cluster contents corresponding to the element cluster;

[0040] The content generation module is used to combine the cluster contents corresponding to each of the element clusters in the playback order to generate the announcement content; the content playback module is used to play the announcement content in voice mode.

[0041] Optionally, the element determination module is specifically used to:

[0042] In response to the selected operation being a sliding operation, determining, from a plurality of page elements of the target page, a plurality of page elements to which the selected operation slides;

[0043] The multiple page elements to which the selection operation is slid are determined as the multiple focus elements.

[0044] Optionally, the element determination module is specifically used to:

[0045] In response to the selected operation being a drawing operation, determining a target area defined by the selected operation in the target page;

[0046] The multiple page elements in the target area are determined as the multiple focus elements.

[0047] Optionally, the clustering module is specifically used for:

[0048] Clustering the multiple focus elements according to the element type of each focus element to generate a navigation element cluster and a non-navigation element set;

[0049] Acquire multiple non-navigation elements in the non-navigation element set;

[0050] According to the element type and element content of each of the non-navigation elements, clustering processing is performed on the multiple non-navigation elements to generate at least one interface element cluster.

[0051] Optionally, the element clustering is navigation element clustering;

[0052] The combined module is specifically used for:

[0053] Determining location information of a plurality of navigation elements in the navigation element cluster in a target page;

[0054] Determining a combination order corresponding to the plurality of navigation elements according to position information of the plurality of navigation elements in the target page;

[0055] According to the combination order corresponding to the plurality of navigation elements, element contents corresponding to the navigation elements are combined to generate cluster contents corresponding to the navigation element cluster.

[0056] In a third aspect, an embodiment of the present invention provides an electronic device, including:

[0057] one or more processors;

[0058] A storage device is used to store one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any of the above embodiments.

[0059] In a fourth aspect, an embodiment of the present invention provides a computer-readable medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the method described in any of the above embodiments.

[0060] In a fifth aspect, an embodiment of the present invention provides a computer program product, including a computer program, which implements the method described in any of the above embodiments when executed by a processor.

[0061] An embodiment of the above invention has the following advantages or beneficial effects: according to the user's selection operation on the target page, multiple focus elements are determined from multiple page elements of the target page. According to the element type and element content of each focus element, the multiple focus elements are clustered to generate at least one element cluster. The playback order is determined according to the priority level of the element cluster, and the playback order can be reasonably set according to each element cluster. In the playback order, the cluster content corresponding to each element cluster is combined to generate the broadcast content. The playback content is complete and friendly, and can better meet the reading needs of different users.

[0062] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0064] Figure 1 It is a flowchart of a voice broadcast method provided by the first embodiment of the present invention;

[0065] Figure 2 It is a flow chart of a voice broadcast method provided by the second embodiment of the present invention;

[0066] Figure 3 is a flow chart of a voice broadcast method provided by the third embodiment of the present invention;

[0067] Figure 4 is a schematic diagram of a payment development mechanism for visually impaired users provided by an embodiment of the present invention;

[0068] Figure 5 It is a structural schematic diagram of a voice broadcasting device provided by an embodiment of the present invention;

[0069] Figure 6 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION

[0070] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0071] The acquisition, transmission, storage, use, and processing of data in the technical solution of this application comply with the relevant provisions of national laws and regulations.

[0072] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0073] Figure 1 FIG. 1 is a flow chart of a voice broadcast method provided by the first embodiment of the present invention. Figure 1 As shown, the method includes:

[0074] Step 101: Receive a selected operation input by a user for a target page.

[0075] Step 102: According to the selection operation, a plurality of focus elements are determined from a plurality of page elements of the target page.

[0076] The user can determine multiple focus elements from multiple page elements of the target page through sliding operations, drawing operations, continuous clicking operations, etc. The page elements may include: buttons, labels, text boxes, radio buttons, check boxes, etc.

[0077] In one embodiment of the present invention, according to the selected operation, multiple focus elements are determined from multiple page elements of the target page, including: in response to the selected operation being a sliding operation, determining multiple page elements to which the selected operation slides from multiple page elements of the target page; and determining the multiple page elements to which the selected operation slides as multiple focus elements. If the selected operation is a sliding operation, the multiple page elements to which the sliding operation slides are determined as multiple focus elements.

[0078] In one embodiment of the present invention, multiple focus elements are determined from multiple page elements of a target page according to a selection operation, including: in response to the selection operation being a drawing operation, determining a target area defined by the selection operation in the target page; and determining multiple page elements in the target area as multiple focus elements. If the selection operation is a drawing operation, determining the target area defined by the selection operation in the target page, and determining multiple page elements in the target area as multiple focus elements. The drawing operation is used to draw a closed area in the target page.

[0079] Step 103: Clustering the multiple focus elements according to the element type and element content of each focus element to generate at least one element cluster.

[0080] Element types may include: navigation elements, interface elements, etc. Element types may be further divided into: buttons, labels, text boxes, etc. Element content may be element text. Element text is used to represent the function and effect of the focus element. Element text may be text displayed on the focus element. Element text may be set according to business needs.

[0081] At least one focus element with the same element type may be clustered into one element cluster. At least one focus element with similar element content may also be clustered into one element cluster.

[0082] Step 104: Determine the playback order according to the priority level of each element cluster.

[0083] The priority of the element clusters can be preset. If the priority of the first element cluster is higher than the priority of the second element cluster, the cluster content of the first element cluster is played first, and then the cluster content of the second element cluster is played.

[0084] Step 105: for each element cluster: combining the element contents of multiple focus elements in the element cluster to generate cluster content corresponding to the element cluster.

[0085] Step 106: Combine the cluster contents corresponding to each element cluster in the playback order to generate the broadcast content.

[0086] In one embodiment of the present invention, element contents of multiple focus elements in an element cluster are combined to generate cluster content corresponding to the element cluster, including: determining attribute information of each focus element in the element cluster; wherein the attribute information includes: element text, element type and element status; for each focus element: combining each attribute information of the focus element to generate element content of the focus element by combining each attribute information of the focus element.

[0087] Element types may include: buttons, labels, text boxes, etc. Element states may include: selected, unselected, etc. For each focus element, the attribute information of the focus element is combined, that is, the element text, element type and element state of the focus element are combined to generate the element content of the focus element. Through the element content, users can fully and clearly understand the relevant information of the focus element.

[0088] Step 107: Play the announcement content in voice mode.

[0089] In the scheme of the embodiment of the present invention, according to the user's selection operation on the target page, multiple focus elements are determined from multiple page elements of the target page. According to the element type and element content of each focus element, the multiple focus elements are clustered to generate at least one element cluster. The playback order is determined according to the priority level of the element cluster, and the playback order can be reasonably set according to each element cluster. In the playback order, the cluster content corresponding to each element cluster is combined to generate the broadcast content. The playback content is complete and friendly, and can better meet the reading needs of different users.

[0090] Figure 2 FIG. 1 is a flow chart of a voice broadcast method provided by the second embodiment of the present invention. Figure 2 As shown, the method includes:

[0091] Step 201: Receive a selected operation input by a user for a target page.

[0092] Step 202: According to the selection operation, a plurality of focus elements are determined from a plurality of page elements of the target page.

[0093] Step 203: clustering the multiple focus elements according to the element type of each focus element to generate a navigation element cluster and a non-navigation element set.

[0094] If the focus element is a navigation element, the focus element is placed in a navigation element cluster. If the focus element is a non-navigation element, the focus element is placed in a non-navigation element cluster.

[0095] Step 204: Acquire multiple non-navigation elements in the non-navigation element set; perform clustering processing on the multiple non-navigation elements according to the element type and element content of each non-navigation element to generate at least one interface element cluster.

[0096] According to the element type and element text of each non-navigation element, a plurality of non-focus elements are clustered to generate at least one interface element cluster, that is, non-navigation elements with the same element type and similar element text are clustered into the same interface element cluster.

[0097] For example, each non-navigation element is a button. Non-navigation elements include: water bills, electricity bills, provident fund services, and personal credit reports. The above non-navigation elements are clustered to obtain two interface element clusters: living expenses and government services. Among them, living expenses include: water bills and electricity bills. Government services include: provident fund services and personal credit reports.

[0098] Step 205: Determine the playback order according to the priority level of each element cluster.

[0099] Step 206: for each element cluster: combining the element contents of the multiple focus elements in the element cluster to generate cluster contents corresponding to the element cluster.

[0100] First, determine the combination order corresponding to multiple focus elements in the element cluster; combine the element contents of the multiple focus elements in the element cluster according to the combination order corresponding to the multiple focus elements in the element cluster to generate cluster contents corresponding to the element cluster.

[0101] For element clustering as interface element clustering, the combination order of multiple focus elements in the interface clustering can be determined by the order in which the focus elements are selected by the user. The combination order of multiple focus elements can also be determined from left to right and from top to bottom according to the position information of the focus element in the target page.

[0102] For an element clustering into a navigation element clustering, element contents of a plurality of focus elements in the element clustering are combined to generate cluster contents corresponding to the element clustering, including: determining position information of a plurality of navigation elements in the navigation element clustering in a target page; determining a combination order corresponding to the plurality of navigation elements according to the position information of the plurality of navigation elements in the target page; and combining element contents corresponding to the respective navigation elements according to the combination order corresponding to the plurality of navigation elements to generate cluster contents corresponding to the navigation element clustering.

[0103] The navigation element is a page element in the page navigation of the target page. According to the position information of the navigation element in the target page, the combination order corresponding to the multiple navigation elements can be determined from left to right and from top to bottom. And according to the combination order corresponding to the multiple navigation elements, the cluster content corresponding to the navigation element cluster is generated.

[0104] For navigation elements, the playback order of multiple focus elements can be determined from left to right and from top to bottom. The playback order of the generated announcement content is consistent with the browsing order of the user's normal browsing page, which improves the user's browsing experience of the target page.

[0105] Step 207: Combine the cluster contents corresponding to each element cluster in the playback order to generate the broadcast content.

[0106] Step 208 of combining attribute information of the focus element: playing the announcement content in voice mode.

[0107] In the solution of the embodiment of the present invention, each focus element is first clustered into a navigation element cluster and a non-navigation element set, and then the non-navigation element set is further split into at least one interface element cluster. Different cluster contents can be generated according to different element clusters, so that the final generated broadcast content is better organized and easier for users to understand.

[0108] Figure 3 FIG. 1 is a flow chart of a voice broadcast method provided by the third embodiment of the present invention. Figure 3 As shown, the method includes:

[0109] Step 301: Receive a selected operation input by a user for a target page.

[0110] Step 302: According to the selection operation, a plurality of focus elements are determined from a plurality of page elements of the target page.

[0111] Step 303: Clustering the multiple focus elements according to the element type and element content of each focus element to generate at least one element cluster.

[0112] Step 304: Determine the playback order according to the priority level of each element cluster.

[0113] Step 305: for each focus element in the element cluster: determining the relevant content of the focus element in the element cluster; generating the complementary content of the focus element in the element cluster according to the element content and the relevant content of the focus element in the element cluster;

[0114] Step 306: Combine the completion contents of each focus element in the element cluster to generate cluster contents corresponding to the element cluster.

[0115] The relevant content of the focus element can be set according to business needs. If the element content of the focus element is to pay the electricity bill, the relevant content of the focus element may include: account name, account number, home address, etc. The element content of the focus element and the related content are combined to generate the complementary content of the focus element. The broadcast information is generated through the complementary content of each focus element. The complementary information can provide users with more comprehensive and specific broadcast content, improve the accuracy of users' acquisition of page information, and improve users' operation efficiency.

[0116] Step 307: Combine the cluster contents corresponding to each element cluster in the playback order to generate the broadcast content.

[0117] Step 308: Play the announcement content in voice mode.

[0118] In the scheme of the embodiment of the present invention, for each focus element in the element cluster, according to the element content and related content of the focus element in the element cluster, the complementary content of the focus element in the element cluster is generated; the complementary content of each focus element in the element cluster is combined to generate the cluster content corresponding to the element cluster. The playback content obtained by the scheme of the embodiment of the present invention is more organized, the content is more comprehensive, and it is easier for users to understand the relevant content disclosed on the page.

[0119] In one embodiment of the present invention, the element types of multiple focus elements include: a first type and a second type. According to the element type and element content of each focus element, the multiple focus elements are clustered to generate at least one element cluster, including: respectively determining multiple first focus elements corresponding to the first type, and placing the multiple first focus elements into the first cluster; determining multiple second focus elements corresponding to the second type, and placing the multiple second focus elements into the second cluster.

[0120] Determine a first combination order corresponding to the first cluster; determine a second combination order corresponding to the second cluster; and determine a playback order corresponding to the first type and the second type.

[0121] Element types may include: buttons, labels, pages, navigation elements, text boxes, etc. For example, the first type is a navigation element, and the second type is a text box element. For the first type being a navigation element, multiple first focus elements corresponding to the navigation element are determined, and a first combination order corresponding to the first cluster is determined. The combination order corresponding to the first cluster can be determined by the order in which the user selects the focus elements. The playback order corresponding to the first focus element can also be determined according to the position information of the first focus element in the target page, in a left-to-right, top-to-bottom order.

[0122] Similarly, for the second type of text box element, a plurality of second focus elements corresponding to the text box are determined, and a second combination order corresponding to the second cluster is determined.

[0123] Combining the element contents of multiple focus elements in an element cluster to generate cluster contents corresponding to the element cluster, including: combining the element contents of each first focus element in the first cluster according to a first combination order to generate first cluster contents corresponding to the first cluster; combining the element contents of each second focus element in the second cluster according to a second combination order to generate second cluster contents corresponding to the second cluster; combining the first cluster contents and the second cluster contents according to a playback order to generate broadcast content.

[0124] For example, the first type is a navigation element, and the second type is a text box element. Generate the first cluster content corresponding to the first cluster and the second cluster content corresponding to the second cluster respectively. Finally, according to the play order, combine the first cluster content and the second cluster content to generate the announcement content. The play order can be determined according to the priority level corresponding to the element type.

[0125] Elderly people or visually impaired people are used to sliding their hands on the screen instead of using their fingers to click accurately. Based on this sliding interaction method, multiple focus elements in the target page are determined. The element content of the focus element may include: element text, element type and element status, etc. For element text, adhering to the principle of what you see is what you read, the text is as concise as possible. Element types may include: buttons, labels, pages, etc. Element status may include: selected, unselected, etc. Elements in the focus activation state can be read. For navigation elements, element broadcasting can be performed from left to right and from top to bottom. Set reasonable element text, element type and element status for the element, and determine whether the screen reading mode for the target page is turned on.

[0126] The development logic of voice broadcast is as follows: Set reasonable element content for page elements. The attribute information of page elements can be saved through layout files. Then call the attribute information in the layout text through code. Set the correct element type for page elements. It is necessary to let the visually impaired know the type of element currently clicked, such as buttons, pictures, etc. The system broadcasts the element type when the control gets the focus.

[0127] Set focus navigation for page elements. Accessible focus navigation is usually broadcast from left to right and from top to bottom in sequence, and the focus view of the page needs to be well controlled. Assemble the navigation elements in the focus navigation bar, broadcast the element information to be read in sequence, and complete the barrier-free voice broadcast.

[0128] Interface elements mainly exist in the arrangement between icons and text, or between icons and icons, or between text and text. Grouping the content of interface elements of the same type and the content of interface elements with similar functions together can avoid distraction of visually impaired users when applying functions, and can also bring better convenience.

[0129] The page content is generally processed in modules. Modules of the same category are classified as a whole, but the content in each module needs to maintain a logical and reasonable layout. The design of the page structure mainly analyzes the mutual conversion relationship between functions. The hierarchical relationship between the main interface and the secondary interface directly determines the jump relationship between the functional interfaces. The functional information of the previous level page can be an overview of the next level functional interface, and the information of the next level functional interface is the detailed content or description of the previous level.

[0130] Figure 4FIG. 1 is a schematic diagram of a payment development mechanism for visually impaired users provided by an embodiment of the present invention. Figure 4 As shown in the figure, the living floor card for payment is a common quick entry for payment. The card is displayed in the payment column of the main page channel. The system integrates and improves the information in the payment card and makes barrier-free payment broadcasts in the form of complete payment information. The broadcast content may include: bills issued, water charges, account name, account number, immediate payment, etc. Then jump to the payment details page.

[0131] Since the basic information that needs to be paid has been clarified during the payment card reading process, there is no need to confirm again, and the user can jump directly to the payment details page. This is very friendly to visually impaired users, and users can quickly find the bills they need to pay. The payment card has assembled all the basic payment information, and the user only needs to listen and read along. By playing the complete payment information, the payment can be completed without the user making extra clicks and operations. The voice broadcast is completely encapsulated in the form of a card, and the broadcast information is not interrupted, reducing user operations. The user can also clearly locate the payment information on the card. If there is any ambiguity, just click on the card again and listen to the information again. This method can effectively improve the browsing experience and operation efficiency of visually impaired people.

[0132] Figure 5 FIG. 1 is a structural diagram of a voice broadcasting device provided by an embodiment of the present invention. Figure 5 As shown, the device comprises:

[0133] The operation receiving module 501 is used to receive the selected operation input by the user for the target page;

[0134] An element determination module 502 is used to determine a plurality of focus elements from a plurality of page elements of a target page according to a selection operation;

[0135] A clustering module 503, configured to perform clustering processing on a plurality of focus elements according to the element type and element content of each focus element, and generate at least one element cluster;

[0136] The sequence determination module 504 is used to determine the playback sequence according to the priority level of each element cluster;

[0137] A combining module 505 is used for combining, for each element cluster, element contents of a plurality of focus elements in the element cluster to generate cluster contents corresponding to the element cluster;

[0138] The content generation module 506 is used to combine the cluster contents corresponding to each element cluster in a play order to generate broadcast content;

[0139] The content playing module 507 is used to play the announcement content in voice mode.

[0140] Optionally, the element determination module 502 is specifically configured to:

[0141] In response to the selected operation being a sliding operation, determining, from a plurality of page elements of the target page, a plurality of page elements to which the selected operation slides;

[0142] The multiple page elements to which the selected operation is slid are determined as multiple focus elements.

[0143] Optionally, the element determination module 502 is specifically configured to:

[0144] In response to the selected operation being a drawing operation, determining a target area defined by the selected operation in the target page;

[0145] Multiple page elements in the target area are determined as multiple focus elements.

[0146] Optionally, the clustering module 503 is specifically used for:

[0147] Clustering multiple focus elements according to the element type of each focus element to generate a navigation element cluster and a non-navigation element set;

[0148] Get multiple non-navigation elements in the non-navigation element set;

[0149] Clustering is performed on the plurality of non-navigation elements according to the element type and element content of each non-navigation element to generate at least one interface element cluster.

[0150] Optionally, the element clustering is a navigation element clustering;

[0151] The combination module 505 is specifically used for:

[0152] Determine location information of multiple navigation elements in the navigation element cluster in the target page;

[0153] Determine a combination order corresponding to the multiple navigation elements according to position information of the multiple navigation elements in the target page;

[0154] According to the combination order corresponding to the multiple navigation elements, the element contents corresponding to the navigation elements are combined to generate the cluster contents corresponding to the navigation element cluster.

[0155] Optionally, the combination module 505 is specifically used for:

[0156] Determine the attribute information of each focus element in the element cluster; wherein the attribute information includes: element text, element type and element status;

[0157] For each focus element: combine the attribute information of the focus element to generate the element content of the focus element.

[0158] Optionally, the combination module 505 is specifically used for:

[0159] For each focus element in the element cluster: determining relevant content of the focus element in the element cluster; generating complementary content of the focus element in the element cluster according to the element content and relevant content of the focus element in the element cluster;

[0160] The completion contents of each focus element in the element cluster are combined to generate cluster contents corresponding to the element cluster.

[0161] The completion contents of each focus element in the element cluster are combined to generate cluster contents corresponding to the element cluster.

[0162] An embodiment of the present invention provides an electronic device, including:

[0163] one or more processors;

[0164] The storage device is used to store one or more programs. When the one or more programs are executed by one or more processors, the one or more processors implement the method of any of the above embodiments.

[0165] An embodiment of the present invention provides a computer program product, including a computer program. When the computer program is executed by a processor, the voice broadcast method in the embodiment of the present invention is implemented.

[0166] Reference below Figure 6 , which shows a schematic diagram of the structure of a computer system 600 of a terminal device suitable for implementing an embodiment of the present invention. Figure 6 The terminal device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0167] like Figure 6 As shown, the computer system 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage part 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the system 600 are also stored. The CPU 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0168] The following components are connected to the I / O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN card, a modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage section 608 as needed.

[0169] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 609, and / or installed from the removable medium 611. When the computer program is executed by the central processing unit (CPU) 601, the above-mentioned functions defined in the system of the present invention are executed.

[0170] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0171] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0172] The modules involved in the embodiments of the present invention may be implemented by software or hardware. The modules described may also be set in a processor, for example, they may be described as: an operation receiving module, an element determination module, a clustering module, an order determination module, a combination module, a content generation module, and a content playback module. The names of these modules do not, in some cases, constitute limitations on the modules themselves. For example, the operation receiving module may also be described as a "module for receiving a selected operation input by a user for a target page."

[0173] As another aspect, the present invention further provides a computer-readable medium, which may be included in the device described in the above embodiment; or may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device includes:

[0174] Receive a selected operation input by the user for the target page;

[0175] According to the selected operation, multiple focus elements are determined from multiple page elements of the target page;

[0176] Clustering the multiple focus elements according to the element type and element content of each focus element to generate at least one element cluster;

[0177] Determine the playback order according to the priority level of each element cluster;

[0178] For each element cluster: combining the element contents of multiple focus elements in the element cluster to generate cluster contents corresponding to the element cluster;

[0179] In the order of playback, the cluster contents corresponding to each element cluster are combined to generate the broadcast content;

[0180] Play the announcement content in voice mode.

[0181] According to the technical solution of the embodiment of the present invention, multiple focus elements are determined from multiple page elements of the target page according to the user's selection operation on the target page. According to the element type and element content of each focus element, the multiple focus elements are clustered to generate at least one element cluster. The playback order is determined according to the priority level of the element cluster, and the playback order can be reasonably set according to each element cluster. In the playback order, the cluster content corresponding to each element cluster is combined to generate the broadcast content. The playback content is complete and friendly, and can better meet the reading needs of different users.

[0182] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A voice broadcast method, characterized in that: include: Receive a selected operation input by the user for the target page; According to the selection operation, a plurality of focus elements are determined from a plurality of page elements of the target page; Clustering the multiple focus elements according to the element type and element content of each of the focus elements to generate at least one element cluster; Determining a playback order according to the priority level of each element cluster; For each of the element clusters: combining element contents of a plurality of focus elements in the element cluster to generate cluster contents corresponding to the element cluster; Combining the cluster contents corresponding to each of the element clusters in the playback order to generate broadcast content; Play the announcement content in voice mode.

2. The method according to claim 1, characterized in that The step of determining a plurality of focus elements from a plurality of page elements of the target page according to the selection operation includes: In response to the selected operation being a sliding operation, determining, from a plurality of page elements of the target page, a plurality of page elements to which the selected operation slides; The multiple page elements to which the selection operation is slid are determined as the multiple focus elements.

3. The method according to claim 1, characterized in that The step of determining a plurality of focus elements from a plurality of page elements of the target page according to the selection operation includes: In response to the selected operation being a drawing operation, determining a target area defined by the selected operation in the target page; The multiple page elements in the target area are determined as the multiple focus elements.

4. The method according to claim 1, characterized in that: The clustering of the plurality of focus elements according to the element type and element content of each of the focus elements to generate at least one element cluster includes: Clustering the multiple focus elements according to the element type of each focus element to generate a navigation element cluster and a non-navigation element set; Acquire multiple non-navigation elements in the non-navigation element set; According to the element type and element content of each of the non-navigation elements, clustering processing is performed on the multiple non-navigation elements to generate at least one interface element cluster.

5. The method according to claim 1, characterized in that The element clustering is a navigation element clustering; The combining the element contents of the plurality of focus elements in the element cluster to generate cluster contents corresponding to the element cluster includes: Determining location information of a plurality of navigation elements in the navigation element cluster in a target page; Determining a combination order corresponding to the plurality of navigation elements according to position information of the plurality of navigation elements in the target page; According to the combination order corresponding to the plurality of navigation elements, element contents corresponding to the navigation elements are combined to generate cluster contents corresponding to the navigation element cluster.

6. The method according to claim 1, characterized in that The combining the element contents of the plurality of focus elements in the element cluster to generate cluster contents corresponding to the element cluster includes: Determine the attribute information of each focus element in the element cluster; wherein the attribute information includes: element text, element type and element status; For each focus element in the element cluster: combining each attribute information of the focus element to generate element content of the focus element.

7. The method according to claim 1, characterized in that The combining the element contents of the plurality of focus elements in the element cluster to generate cluster contents corresponding to the element cluster includes: For each focus element in the element cluster: determining relevant content of the focus element in the element cluster; generating complementary content of the focus element in the element cluster according to the element content and relevant content of the focus element in the element cluster; The completion contents of each focus element in the element cluster are combined to generate cluster contents corresponding to the element cluster.

8. A voice broadcasting device, characterized in that: include: An operation receiving module, used for receiving a selected operation input by a user for a target page; An element determination module, used to determine a plurality of focus elements from a plurality of page elements of the target page according to the selection operation; A clustering module, configured to perform clustering processing on the plurality of focus elements according to the element type and element content of each of the focus elements, and generate at least one element cluster; An order determination module, used to determine the playback order according to the priority level of each element cluster; A combining module, configured to combine, for each of the element clusters, the element contents of a plurality of focus elements in the element cluster to generate cluster contents corresponding to the element cluster; The content generation module is used to combine the cluster contents corresponding to each of the element clusters in the playback order to generate the announcement content; the content playback module is used to play the announcement content in voice mode.

9. The device according to claim 8, characterized in that The element determination module is specifically used for: In response to the selected operation being a sliding operation, determining, from a plurality of page elements of the target page, a plurality of page elements to which the selected operation slides; The multiple page elements to which the selection operation is slid are determined as the multiple focus elements.

10. The device according to claim 8, characterized in that The element determination module is specifically used for: In response to the selected operation being a drawing operation, determining a target area defined by the selected operation in the target page; The multiple page elements in the target area are determined as the multiple focus elements.

11. The device according to claim 8, characterized in that The clustering module is specifically used for: Clustering the multiple focus elements according to the element type of each focus element to generate a navigation element cluster and a non-navigation element set; Acquire multiple non-navigation elements in the non-navigation element set; According to the element type and element content of each of the non-navigation elements, clustering processing is performed on the multiple non-navigation elements to generate at least one interface element cluster.

12. The device according to claim 8, characterized in that The element clustering is a navigation element clustering; The combined module is specifically used for: Determining location information of a plurality of navigation elements in the navigation element cluster in a target page; Determining a combination order corresponding to the plurality of navigation elements according to position information of the plurality of navigation elements in the target page; According to the combination order corresponding to the plurality of navigation elements, element contents corresponding to the navigation elements are combined to generate cluster contents corresponding to the navigation element cluster.

13. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

14. A computer readable medium having a computer program stored thereon, characterized in that When the program is executed by a processor, the method described in any one of claims 1 to 7 is implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images