Screen reading method and electronic device

Abstract

The present application provides a screen reading method and an electronic device. The electronic device can select, from the nodes of a user interface according to a preset rule, a plurality of nodes that a user is most likely to want to use, so as to obtain an important focus list. In a sliding and browsing scenario, the electronic device can switch a focus on the basis of the important focus list so as to only read the description information of the nodes in the important focus list in a skip reading mode. In this way, the efficiency of searching for a target node by a user in a sliding and browsing scenario can be improved.

Description

Screen reading method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on November 23, 2023, with application number 202311578173.7, and priority to the Chinese patent application entitled “Screen Reading Method and Electronic Device”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal technology, and in particular to a screen reading method and an electronic device. Background Art

[0003] Electronic devices can provide a screen reading function. This screen reading function can help users use electronic devices when they cannot see or cannot see the screen clearly. When the screen reading function is turned on, the electronic device can read aloud the content displayed on the screen at the user's touch position based on the user's touch operation on the screen. In this way, even if the user cannot see the screen, the user can determine the control displayed at the touch position on the screen based on the content read by the electronic device, and use the electronic device to complete the corresponding task, such as opening an application, playing music, making a call, etc.

[0004] The user interface displayed on an electronic device typically features multiple nodes. Users can navigate through these nodes one by one using preset operations to find the node they need. However, when the node a user needs is displayed relatively far back, the user must perform multiple operations to select the desired node. This indicates that the efficiency of finding the target node using the screen reading function is low, resulting in a poor user experience. Summary of the Invention

[0005] This application provides a screen reading method and electronic device. In a sliding browsing scenario, the electronic device can switch focus based on a list of important focus nodes, skipping nodes not in the list and reading aloud descriptions of nodes in the list. The list of important focus nodes includes multiple nodes that the user is most likely to use, selected from the nodes in the user interface. This method can improve the efficiency of users in finding target nodes.

[0006] In a first aspect, the present application provides a screen reading method. The method can be applied to an electronic device, and the screen reading function of the electronic device is turned on. The electronic device displays a first interface, and the first node in the first interface is selected as the focus; the electronic device receives a first operation, and the first operation is used to switch the next focus; in response to the first operation, the electronic device skips the second node in the first interface according to the first list associated with the first interface, switches the focus from the first node to the third node in the first interface, and reads the description information of the third node; the first list includes one or more nodes in the first interface, the first list includes the third node, and does not include the second node, the first node in the first interface is displayed before the second node, and the second node is displayed before the third node.

[0007] The first operation can refer to the operation of sliding down with one finger as shown in Figure 6A of the present application. The first list can refer to the important focus list 621 shown in Figure 6A. The above-mentioned scenario of skipping the second node to switch the focus from the first node to the third node can refer to the scenario of skipping the node whose display position is between the clock logo 612 and the music logo 613 as shown in Figures 6A and 6B, and switching the focus from the clock logo 612 to the music logo 613, or can refer to the scenario of skipping the node whose display position is between the music logo 613 and the sports health logo 614 as shown in Figures 6B and 6C, and switching the focus from the music logo 613 to the sports health logo 614.

[0008] Wherein, not limited to the second node, when the focus is switched from the first node to the third node, the electronic device may also skip more nodes whose display positions are between the first node and the third node.

[0009] It can be seen that the first list may include some nodes in the first interface. When an operation for switching the next focus is detected, the electronic device can switch the focus according to the first list. Among them, the electronic device can skip the nodes that are not in the first list in the order in which the nodes are displayed in the first interface, and switch the focus to the nodes in the first list. When the first list contains the nodes that the user wants to use, since the electronic device can skip the nodes that are not in the first list, the user can find the nodes he wants to use by switching the next focus fewer times. This can improve the efficiency of users in finding target nodes in sliding browsing scenarios and improve the user experience of using the screen reading function.

[0010] In combination with the first aspect, in some embodiments, the order in which the nodes in the first list are sequentially traversed and selected as the focus is consistent with the order in which the nodes in the first list are displayed in the first interface.

[0011] As can be seen, even if the electronic device skips one or more nodes in the first interface when switching focus according to the first list, the order in which the electronic device switches focus is still consistent with the order in which the nodes are displayed in the first interface. This can reduce the impact of skipping one or more nodes when switching focus on the user's perception of the page layout, making it easier for the user to find nodes not in the first list based on their understanding of the page layout.

[0012] In combination with the first aspect, in some embodiments, the order in which the nodes in the first list are traversed and selected as the focus is irrelevant to the usage frequency of the nodes in the first list.

[0013] Among them, some nodes with low usage frequency in the first interface may be displayed before some nodes with high usage frequency. If the order in which the nodes in the first interface are switched and selected as the focus is consistent with the order in which the nodes are used frequently, the order of the nodes heard by the user when the electronic device switches the focus in the sliding browsing scene may be disrupted, which is different from the order in which the nodes are displayed in the first interface. Moreover, as the frequency of use changes, the order of nodes heard by the user may be different when switching the focus in the sliding browsing scene at different times. This will affect the user's perception of the page layout. The user cannot understand the distribution of the nodes on the first interface based on the order of the nodes he hears. Therefore, in the present application, the order in which the nodes in the first list are traversed and selected as the focus has nothing to do with the frequency of use of the nodes in the first list, which can reduce the impact of skipping one or more nodes when switching the focus in the sliding browsing scene on the user's perception of the page layout.

[0014] In conjunction with the first aspect, in some embodiments, the first list includes a first node, and the third node is the node next to the first node in the first list. In other embodiments, the first list may not include the first node. The third node may be the node that is displayed after the first node in the first interface and is the first node in the first list.

[0015] In combination with the first aspect, in some embodiments, the electronic device receives a second operation, which is used to switch the previous focus; in response to the second operation, the electronic device skips the second node according to the first list, switches the focus from the third node to the first node, and reads aloud the description information of the first node.

[0016] The second operation may refer to the operation of sliding upward with one finger as shown in FIG. 1B of the present application.

[0017] It can be seen that when an operation for switching the previous focus is detected, the electronic device can also switch the focus according to the first list. Among them, the electronic device can skip the nodes that are not in the first list according to the order in which the nodes are displayed in the first interface, and switch the focus to the nodes in the first list. When the first list contains the nodes that the user wants to use, since the electronic device can skip the nodes that are not in the first list, the user can find the node he wants to use by switching the next focus fewer times. This can improve the efficiency of users finding target nodes in sliding browsing scenarios and improve the user experience of using the screen reading function.

[0018] In combination with the first aspect, in some embodiments, the electronic device receives a third operation, which is used to mark k1 nodes in the first interface as important focuses, where k1 is a positive integer; the electronic device determines a first list based on the third operation, and the first list includes k1 nodes.

[0019] The above-mentioned third operation can refer to the operation of sliding down and then sliding left with a single finger as shown in Figure 4D of this application.

[0020] In combination with the first aspect, in some embodiments, the electronic device receives a fourth operation, which is used to mark k2 nodes in the first interface as filtering focuses, where k2 is a positive integer; the electronic device determines the first list based on the fourth operation, and the first list does not include k2 nodes.

[0021] The fourth operation mentioned above can refer to the operation of sliding down and then sliding to the right with one finger as shown in Figure 4E of this application.

[0022] In some embodiments, the user can also cancel the mark of the above-mentioned important focus or filtered focus.

[0023] As can be seen, the electronic device can determine the nodes included in the first list based on the important focus and / or filtered focus marked by the user. In this way, the user can mark one or more nodes that he or she needs to use frequently or most wants to use as important focus, thereby improving the efficiency of finding these one or more nodes in the sliding browsing scene.

[0024] In combination with the first aspect, in some embodiments, the electronic device determines a first list based on the usage frequency of nodes in the first interface, wherein the first list includes nodes in the first interface whose usage frequency is higher than the first frequency, and does not include nodes in the first interface whose usage frequency is not higher than the first frequency.

[0025] Nodes in a user interface that are frequently used or have been used for a long time are generally the nodes that users are most likely to want to find and use. By determining a first list based on the frequency of node use, the electronic device can skip nodes that are less frequently used or have been used for a short time in a sliding browsing scenario and switch the focus between nodes that are frequently used or have been used for a long time, thereby improving the efficiency of the user in finding the target node.

[0026] In combination with the first aspect, in some embodiments, the first interface includes k3 nodes in a parallel relationship, k3 is a positive integer, and the electronic device determines a first list based on the node characteristics of the nodes in the first interface, wherein k4 nodes are a group of nodes with the same node characteristics and the largest number of nodes among the k3 nodes, the k3 nodes also include k5 nodes, the node characteristics of the k5 nodes are different from the node characteristics of the k4 nodes, the first list does not include k5 nodes, and k4 and k5 are both positive integers less than k3.

[0027] In some embodiments, k4 nodes are nodes corresponding to non-advertisement information, and k5 nodes are nodes corresponding to advertisement information.

[0028] In some embodiments, node characteristics may include the number, layout, display style, type, and other characteristics of the child nodes contained in the node.

[0029] In some app user interfaces, a small number of nodes that differ from the majority in node characteristics are called outliers. These outliers are likely to contain advertising information. Electronic devices identify these outliers as filtering points and can skip them when switching focus in a scrolling browsing scenario. This reduces the impact of advertising on the user's search for nodes and improves the efficiency of finding the target node in a scrolling browsing scenario.

[0030] In combination with the first aspect, in some embodiments, the first node in the first list is the fourth node, the last node in the first list is the fifth node, and the fifth node is selected as the focus; the electronic device receives an operation for switching the next focus, switches the focus from the fifth node to the fourth node according to the first list, and reads the description information of the fourth node aloud, and the fourth node in the first interface is displayed before the fifth node.

[0031] In combination with the first aspect, in some embodiments, after the nodes in the first list are traversed in sequence and selected as the focus, the electronic device receives an operation for switching to the next focus, switches the focus to the sixth node in the first interface, and reads aloud the description information of the sixth node. The first list does not include the sixth node.

[0032] In some embodiments, the focus switches from the seventh node in the first list to the sixth node, where the sixth node is the first node displayed in the first interface after the seventh node that is not in the first list. The seventh node is the last node selected as the focus when the nodes in the first list are sequentially traversed and selected as the focus. The seventh node can be any node in the first list.

[0033] It is understandable that after the electronic device traverses the nodes in the first list in the sliding browsing scenario, if it continues to receive an operation to switch the next focus or switch the previous focus, it can indicate that the node the user is looking for is not in the first list. The electronic device can continue to skip the first list based on the operation to switch focus in the sliding browsing scenario, and switch the focus on the user interface between nodes that are not in the first list. This can reduce the situation where a node is repeatedly determined as the focus, and improve the efficiency of the user in finding nodes.

[0034] In combination with the first aspect, in some embodiments, the electronic device receives a fifth operation, which is used to select the eighth node in the first interface; in response to the fifth operation, the electronic device switches the focus to the eighth node and reads aloud the description information of the eighth node.

[0035] The fifth operation mentioned above may refer to the single-finger tapping operation shown in FIG6E .

[0036] In some embodiments, the first list does not include the eighth node.

[0037] It can be seen that although the electronic device can switch the focus between the nodes in the first list in the sliding browsing scenario, the user can still switch the focus to a node that is not in the first list by clicking the screen. The user can choose the method of finding nodes in the first interface as needed. If the node the user wants to find exists in the first list, the user can trigger the electronic device to switch the focus according to the first list by switching the next focus or switching the previous focus, so as to quickly find the node he needs. If the user wants to find a node outside the first list, the user can click at the corresponding position on the screen based on his perception of the page layout to find the target node.

[0038] In a second aspect, the present application provides an electronic device, which may include a screen, an audio output device, a memory, and a processor. The screen may be configured to display a first interface. The audio output device may be configured to read aloud a description of a node selected as the focus on the screen. The memory may be configured to store a computer program. The processor may be configured to invoke the computer program, causing the electronic device to execute any possible implementation method described in the first aspect.

[0039] In a third aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, enables the electronic device to execute any possible implementation method in the first aspect.

[0040] In a fourth aspect, the present application provides a computer program product, which may include computer instructions. When the computer instructions are run on an electronic device, the electronic device executes any possible implementation method as in the first aspect.

[0041] In a fifth aspect, the present application provides a chip, which is applied to an electronic device. The chip includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute any possible implementation method as in the first aspect.

[0042] It is understandable that the electronic device provided in the second aspect, the computer-readable storage medium provided in the third aspect, the computer program product provided in the fourth aspect, and the chip provided in the fifth aspect are all used to execute the methods provided in the embodiments of the present application. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] FIG1A to FIG1E are schematic diagrams of some screen reading scenarios provided by embodiments of the present application;

[0044] FIG2 is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;

[0045] FIG3 is a software structure block diagram of an electronic device 100 provided in an embodiment of the present application;

[0046] 4A to 4F are schematic diagrams of some scenarios in which users set important focuses and filtered focuses, provided by embodiments of the present application;

[0047] FIG5 is a flow chart of a method for determining an important focus list provided by an embodiment of the present application;

[0048] 6A to 6F are schematic diagrams of some screen reading scenarios provided by embodiments of the present application;

[0049] FIG7 is a flow chart of a screen reading method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0051] References to "one embodiment" or "some embodiments" etc. described in this specification mean that the specific features, structures or characteristics described in conjunction with the embodiment are included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in another way. The term "connected" includes direct and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0052] In the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.

[0053] The term "user interface (UI)" in the following embodiments of the present application refers to a medium interface for interaction and information exchange between an application (APP) or an operating system (OS) and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can include visual interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0054] To facilitate understanding, the concepts of the user interface nodes involved in this application are first introduced here.

[0055] A node can represent an element that constitutes a user interface. For example, a node can include text, icons, buttons, status bars, etc. displayed on the user interface. The relationship between nodes can include parallel relationships and parent-child relationships. For example, a node contains one or more child nodes. This node is the parent node of these one or more child nodes. The above-mentioned parallel relationship can also be called a sibling relationship. Nodes with a parallel relationship can be sibling nodes of each other. The nodes of a user interface can be organized into a tree structure in a hierarchical structure. The tree structure can intuitively and effectively reflect the relationship between nodes on the user interface. The electronic device can traverse all nodes on a user interface and obtain the node features of these nodes. For example, node features can include but are not limited to: the type of node, the number of child nodes contained in the node, the parent node of the node, the display position of the node, the layout of the child nodes contained in the node, the type of child nodes contained in the node, etc.

[0056] Nodes can also be called components, controls, and so on.

[0057] After enabling the screen reading function, the electronic device can determine which node is in focus and then read aloud the description of the selected node. The node description information may include, but is not limited to, the node name and the operations that can be performed on the node. In this way, after hearing the node description information, the user can understand what the node is and how to use it.

[0058] In some embodiments, an electronic device can determine focus based on the uniqueness of a node's response to a user operation. If a node's response to a user operation is unique, the electronic device can determine that node as the focus when the user touches the node. A node's unique response to a user operation can mean that the electronic device will respond uniquely to the same operation performed by the user at any location on the node. For example, a node may contain multiple child nodes. The responses to the same user operation on these child nodes are all unique. When a node is in focus, the electronic device can read aloud the descriptions of the child nodes. If a node's response to a user operation is not unique, the electronic device can further subdivide the focus determination based on the child nodes contained within the node. A node's non-unique response to a user operation can mean that the electronic device will respond differently to the same operation performed by the user at different locations on the node. For example, a node may contain multiple child nodes. These child nodes may be different functional controls that can each respond differently to a user operation. When detecting that the user touches a sub-node of the node, the electronic device may determine the touched sub-node as the focus, and then read aloud the description information of the sub-node.

[0059] The above method of selecting node fine-grainedness when determining the focus is merely an exemplary description of the present application and should not constitute a limitation to the present application.

[0060] 1A to 1E exemplarily show some schematic diagrams of screen reading scenarios.

[0061] As shown in Figure 1A, the electronic device 100 can display a user interface 210. The user interface 210 can be a desktop of the electronic device 100. The user interface 210 may include one or more APP identifiers. For example, a clock identifier 211, a calendar identifier 212, a gallery identifier 213, and the like. The APP identifier can be used to open the corresponding APP. In some embodiments, an APP identifier can be a node. The multiple APP identifiers displayed on the user interface 210 can be nodes with a parallel relationship. An APP identifier can contain two sub-nodes: an APP icon and an APP name. For example, the clock identifier 211 contains two sub-nodes: a clock icon and the name of the clock application "Clock". When switching focus, the electronic device 100 can switch between different APP identifiers without subdividing the focus into sub-nodes of the APP identifier.

[0062] In some embodiments, after the screen reading function is turned on, the electronic device 100 can mark the node where the focus is located to indicate which node is currently in focus.

[0063] As shown in Figure 1A, electronic device 100 may display a marking box 214. Marking box 214 is currently located at the location of clock mark 211, indicating that the current focus is clock mark 211. Not limited to the above marking box 214, electronic device 100 may also mark the node at the focus in other ways.

[0064] When the current focus is on the clock icon 211, in response to the downward sliding operation shown in FIG1A, the electronic device 100 may switch the focus to the next node of the clock icon 211. The nodes on the user interface 210 may be arranged in order from left to right and from top to bottom according to their display positions. Therefore, the next node of the clock icon 211 may be the calendar icon 212 shown in FIG1A.

[0065] In response to the downward sliding operation shown in Figure 1A, the electronic device 100 can display the user interface 210 shown in Figure 1B and voice broadcast "Calendar". Comparing Figure 1A and Figure 1B, it can be seen that the display position of the mark box 214 changes from the position of the clock logo 211 shown in Figure 1A to the position of the calendar logo 212 shown in Figure 1B. This may indicate that the focus has been switched from the clock logo 211 to the calendar logo 212. The content "Calendar" voice broadcasted by the electronic device 100 is the description information of the calendar logo 212. In this way, the user can determine that the current calendar logo 212 is in the selected state and the current focus is the calendar logo 212 based on the content of the voice broadcast of the electronic device 100.

[0066] When the current focus is on the calendar icon 212 , in response to the upward sliding operation shown in FIG1B , the electronic device 100 may switch the focus to the previous node of the calendar icon 212 . The previous node of the calendar icon 212 is the clock icon 211 .

[0067] In response to the upward sliding operation shown in Figure 1B, the electronic device 100 can display the user interface 210 shown in Figure 1C and voice broadcast "Clock". Comparing Figure 1B and Figure 1C, it can be seen that the display position of the mark box 214 changes from the position of the calendar mark 212 shown in Figure 1B to the position of the clock mark 211 shown in Figure 1C. This may indicate that the focus has been switched from the calendar mark 212 to the clock mark 211. The content "Clock" voice broadcasted by the electronic device 100 is the description information of the clock mark 211. In this way, the user can determine that the current clock mark 211 is in the selected state and the current focus is the clock mark 211 based on the content of the voice broadcast of the electronic device 100.

[0068] In some embodiments, when a single-finger click operation is detected on the screen, the electronic device 100 can determine the focus based on the position of the single-finger click operation.

[0069] As shown in Figure 1D, when the current focus is the clock logo 211, in response to a single-finger click operation on the location of the music logo 215, the electronic device 100 can switch the focus to the music logo 215, display the user interface 210 shown in Figure 1E, and voice broadcast "music".

[0070] Comparing Figures 1D and 1E , it can be seen that the display position of the marking box 214 has changed from the position of the clock mark 211 shown in Figure 1D to the position of the music mark 215 shown in Figure 1E . The content "Music" announced by the electronic device 100 is the description information of the music mark 215. In this way, the user can determine that the music mark 215 is currently selected and the current focus is on the music mark 215 based on the content announced by the electronic device 100.

[0071] As can be seen, when the screen reading function is turned on, users can adjust the focus by clicking anywhere on the screen with one finger and determine the content of the node at the clicked location. Users can also switch the focus between nodes one by one by swiping up or down according to the order in which the nodes are displayed in the user interface.

[0072] The order in which the nodes are displayed in the user interface can represent the position distribution relationship of the nodes in the user interface. In some embodiments, the electronic device 100 can determine the order in which the nodes are displayed in the user interface according to a preset arrangement order. For example, the preset arrangement order can be in order from left to right and from top to bottom according to the display position. Among them, among the nodes whose display positions are in the same row, the node whose display position is on the left is arranged before the node whose display position is on the right. Among the nodes whose display positions are in different rows, the node whose display position is in the upper row is arranged before the node whose display position is in the lower row. In the user interface, a node being displayed before another node can mean that this node is arranged before this other node in the above arrangement order. For example, in the user interface 210 shown in Figure 1A, the clock mark 211 is displayed before the calendar mark 212, the calendar mark 212 is displayed before the gallery mark 213, and the memo mark is displayed before the file management mark.

[0073] This application does not limit the above arrangement order. For example, the arrangement order can also be from top to bottom and then from left to right according to the display position. Among them, when the display positions are in the same column, the node displayed at the upper position is arranged before the node displayed at the lower position. Among the nodes displayed at different columns, the node displayed in the left column is arranged before the node displayed in the right column.

[0074] It should be noted that the above-mentioned user operation of switching focus is only an exemplary description of this application and should not constitute a limitation of this application. In addition, the screen reading function is not limited to the desktop and can also be applied to other user interfaces, such as the user interfaces of apps such as clock applications, music applications, and video applications.

[0075] The above-mentioned scenario in which the focus is switched from front to back one by one according to the order in which the nodes are displayed in the user interface through user operations (such as a downward sliding operation), and the above-mentioned scenario in which the focus is switched from back to front one by one according to the order in which the nodes are displayed in the user interface through user operations (such as an upward sliding operation) can both be referred to as sliding browsing scenarios. That is, the scenario of switching focus shown in Figures 1A and 1B is a sliding browsing scenario. In the above-mentioned sliding browsing scenario, the user can browse the nodes one by one from front to back or from back to front according to the order in which the nodes are displayed in the user interface through preset operations to determine the content of each node (such as the node name, the function of the node, etc.).

[0076] After the electronic device 100 turns on the screen reading function, the user can switch nodes one by one by swiping up or down to find the node they want to use. However, the number of nodes in a user interface is usually large. When the node the user needs to find is displayed relatively far back on the screen, the user needs to perform multiple swiping operations to find the node they need to use. For example, in Figure 1A, the current focus is the clock icon 211. If the node the user needs to use is the dial icon of the dial application, the user needs to swipe down 18 times to switch the focus to the dial icon and then open the dial application. The above 18 downward swipe operations switch the focus from the clock icon 211 to the dial icon in the following order: clock icon 211 → calendar icon 212 → gallery icon 213 → memo icon → file management icon → email icon → music icon → calculator icon → video icon → sports and health icon → weather icon → browser icon → smart life icon → settings icon → recorder icon → app store icon → camera icon → contact icon → dial icon. Obviously, the efficiency of users finding nodes in the above sliding browsing scenario is low. Users have a poor experience using the screen reading function.

[0077] The present application provides a screen reading method. Among them, the electronic device 100 can filter out multiple nodes that the user is most likely to want to use from the nodes of the user interface according to preset rules to obtain an important focus list. In response to the operation of switching the focus forward or backward (for example, the operation of sliding down as shown in Figure 1A, the operation of sliding up as shown in Figure 1B), the electronic device 100 can switch the focus one by one among the multiple nodes selected above. That is to say, when the operation of switching the focus forward or backward by the user is detected, the electronic device 100 can read aloud only the description information of the nodes in the important focus list in a skipping manner, without switching the focus one by one among all the nodes in the user interface.

[0078] In response to the user's operation of switching the focus forward or backward, the electronic device 100 can switch the focus to the nodes in the important focus list in sequence according to the order in which the nodes are displayed in the user interface.

[0079] If the node the user wants to use is in the important focus list, the electronic device 100 can skip the nodes that are not in the important focus list, so the user can find the node they want to use with fewer forward or backward focus switches. The above method can improve the efficiency of users finding nodes in the sliding browsing scene and enhance the user's experience of using the screen reading function.

[0080] The specific process of filtering nodes based on the preset rules to obtain the important focus list will be described in subsequent embodiments and will not be expanded here.

[0081] The structure of the electronic device 100 involved in this application is introduced below.

[0082] The electronic device 100 may be a mobile phone, a tablet computer, a laptop computer, a smart watch, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. The embodiment of the present application does not limit the specific type of the electronic device 100.

[0083] FIG2 exemplarily shows a schematic diagram of the hardware structure of the electronic device 100 .

[0084] As shown in Figure 2, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0085] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0086] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0087] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0088] Processor 110 may also include a memory for storing instructions and data. In some examples, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces processor 110 latency, and thus improves system efficiency.

[0089] In the present application, a computer program may be stored in the memory, configured to cause a controller or processor to implement the screen reading method of the present application through an interface or protocol. For example, the computer program stored in the memory may be used to: traverse nodes on a user interface and obtain node features, identify user operations on the screen, determine the node with focus, read aloud the description of the node with focus, filter based on preset rules to obtain a list of important focus points of the user interface, switch focus based on the list of important focus points, and so on.

[0090] The USB interface 130 is an interface that complies with the USB standard. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. The USB interface 130 can also be used to connect headphones to play audio through the headphones.

[0091] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While charging the battery 142, the charging management module 140 can also power the electronic device through the power management module 141.

[0092] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to provide power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160.

[0093] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0094] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0095] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low-noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor and convert them into electromagnetic waves for radiation via the antenna 1.

[0096] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0097] The electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.

[0098] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

[0099] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0100] The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then transmitted to the ISP for processing and converted into an image visible to the naked eye.

[0101] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0102] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0103] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0104] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0105] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0106] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0107] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some examples, the audio module 170 can be set in the processor 110, or some functional modules of the audio module 170 can be set in the processor 110. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 170D is used to connect wired headphones.

[0108] The speaker 170A and receiver 170B described above may constitute an audio output device of the electronic device 100. The audio output device of the electronic device 100 is not limited to the speaker 170A and receiver 170B, and may also include other devices for playing audio. The microphone 170C described above may constitute an audio input device of the electronic device 100. The audio input device of the electronic device 100 is not limited to the microphone 170C, and may also include other devices for collecting sound signals.

[0109] The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a gravity sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0110] Buttons 190 include a power button, a volume button, etc. Motor 191 can generate vibration prompts. Indicator 192 can be an indicator light that can be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0111] The SIM card interface 195 is used to connect a SIM card. A SIM card can be connected to and disconnected from the electronic device 100 by inserting or removing it from the SIM card interface 195. The electronic device 100 may support one or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some examples, the electronic device 100 uses an eSIM, or embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0112] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the electronic device 100 is exemplarily described.

[0113] FIG3 exemplarily shows a software structure block diagram of the electronic device 100 .

[0114] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, The system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime (Android Runtime) and system library, and kernel layer.

[0115] The application layer can include a series of application packages.

[0116] As shown in Figure 3, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, short message, accessibility service, etc. Among them, the accessibility service can be used to turn on or off the screen reading function. Optionally, the accessibility service can also be used to set the speech speed when the electronic device 100 performs screen reading. The accessibility service can also be used to provide the function of setting nodes on the user interface as important focus or filter focus. Among them, the node set as important focus can be included in the important focus list. The node set as filter focus can be removed from the important focus list. In other words, the user can adjust the nodes included in the important focus list by setting important focus and / or filter focus, thereby improving the efficiency of finding nodes. In addition, in addition to the important focus or filter focus set by the user, the accessibility service can also filter the nodes in the user interface according to other preset rules to determine the important focus list. The accessibility service can also be called an accessible screen reading service or other names. The embodiments of the present application are not limited to this.

[0117] The application framework layer provides APIs and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions.

[0118] As shown in FIG3 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, an activity manager, and the like.

[0119] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0120] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0121] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0122] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0123] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0124] The Notification Manager allows applications to display notification information in the status bar (such as the pull-down notification bar). It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the Notification Manager is used to notify the completion of downloads, message reminders, etc. The Notification Manager can also be used to display notifications in the form of icons or scrolling text in the status bar at the top of the system, such as notifications from applications running in the background, or notifications that appear on the screen in the form of dialog windows. For example, text messages can be displayed in the status bar, prompts can be sounded, electronic devices can vibrate, indicator lights can flash, etc.

[0125] The Activity Manager is responsible for managing activities, starting, switching, and scheduling components in the system, as well as managing and scheduling applications. The Activity Manager can be called by upper-level applications to open corresponding activities.

[0126] In some embodiments, the application framework layer may further include a gesture recognition module. The gesture recognition module may be used to identify user operations on the screen of the electronic device 100, such as a single-finger click, a single-finger swipe up, a single-finger swipe down, and the like. The gesture recognition module may send information about the recognized gesture to the accessibility service. The accessibility service may then provide corresponding feedback based on the user's gesture, such as switching focus and reading a description of the node that has switched focus.

[0127] Android Runtime includes core libraries and a virtual machine. Android Runtime is responsible for scheduling and management of the Android system.

[0128] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0129] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0130] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0131] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0132] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0133] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0134] A 2D graphics engine is a drawing engine for 2D drawings.

[0135] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0136] The following introduces some preset rules provided by this application for determining the important focus list.

[0137] In some embodiments, the electronic device 100 may determine an important focus list based on the important focus and / or filtered focus marked by the user in the user interface. The user may mark some nodes on the user interface as important focuses and other nodes as filtered focuses according to their needs. The important focus list may include nodes marked as important focuses but not nodes marked as filtered focuses.

[0138] In some embodiments, the user may only mark one or more nodes on the user interface as important focuses without marking them as filtering focuses. Optionally, the electronic device 100 may determine the nodes in the user interface that are not marked by the user as filtering focuses based on the important focuses marked by the user, and then determine the important focus list based on the important focuses and filtering focuses.

[0139] Alternatively, the user may only mark one or more nodes on the user interface as filtering focuses without marking important focuses. Optionally, the electronic device 100 may determine the nodes in the user interface that are not marked by the user as important focuses based on the filtering focuses marked by the user, and then determine an important focus list based on the important focuses and filtering focuses.

[0140] In this way, the user can mark one or more nodes that he needs to use frequently or wants to use most as important focuses, thereby improving the efficiency of finding the one or more nodes in the sliding browsing scene.

[0141] In some embodiments, the electronic device 100 can also detect the user's usage habits, record the user's usage frequency and / or usage duration of each node in the user interface, and create a high-frequency node library. Among them, the usage frequency of a node can indicate the frequency of operating this node to trigger the electronic device 100 to provide the function corresponding to this node. The usage duration of a node can indicate the duration that the electronic device 100 provides the function corresponding to a node. For example, a node is the APP identifier of an APP. The APP indicates that it can be used to open this APP. Then, the usage frequency of this APP identifier can be the frequency of the electronic device 100 opening the APP corresponding to the APP identifier. The usage duration of this APP identifier can be the duration that the APP interface is displayed after the electronic device 100 opens the APP corresponding to the APP identifier.

[0142] The high-frequency node library may include nodes with a usage frequency higher than a preset frequency, and / or may include nodes with a usage duration higher than a preset duration. For example, the preset frequency may be 5 times a day, 30 times a month, and so on. The usage duration of the node may be the usage duration within a period of time, or the total usage duration of the node. The embodiments of the present application do not limit the values ​​of the preset frequency and preset duration.

[0143] The nodes in the high-frequency node library can change dynamically according to changes in user usage habits.

[0144] The electronic device 100 may determine an important focus list based on the high-frequency node library. The electronic device 100 may determine nodes in the user interface that are in the high-frequency node library as important focuses and include them in the important focus list. Nodes in the user interface that are not in the high-frequency node library may be filtered focuses. The important focus list may not include nodes that are not in the high-frequency node library.

[0145] Nodes in the user interface that are frequently used or have been used for a long time are generally the nodes that users are most likely to want to find and use. The electronic device 100 determines an important focus list based on the high-frequency node library, and can skip nodes that are less frequently used or have been used for a short time in the sliding browsing scenario, switching the focus between nodes that are frequently used or have been used for a long time, thereby improving the efficiency of the user in finding the target node.

[0146] In some embodiments, the electronic device 100 may determine one or more nodes as filtering focuses based on the node characteristics of the nodes in the user interface, and remove the one or more nodes determined as filtering focuses when determining the important focus list. Node characteristics may include the number, layout, display style, type, and other features of the sub-nodes contained in the node. For example, when there are multiple nodes with a parallel relationship in the user interface, the electronic device 100 may determine whether there are a few nodes that contain sub-nodes that are different from the majority of nodes in one or more features such as the number, layout, display style, and type based on the node characteristics of these multiple nodes. If so, the electronic device 100 may determine these few nodes as filtering focuses.

[0147] In some app user interfaces, a small number of nodes that differ from the majority in node characteristics can be called outliers. These outliers are likely to correspond to advertisements. The electronic device 100 identifies these outliers as filtering focus points and can skip them when switching focus in a scrolling browsing scenario. This reduces the impact of advertisements on the user's search for nodes and improves the efficiency of finding the target node in a scrolling browsing scenario.

[0148] It can be seen that the preset rules for determining the important focus list may include one or more of the following: screening of important focuses and / or filtered focuses based on user markings, screening based on a high-frequency node library, and screening based on node features of nodes in the user interface. When determining the important focus list, the electronic device 100 may filter out nodes that are filtered focuses on the user interface. The filtered focus may be set by the user, determined based on a high-frequency node library, or determined based on node features.

[0149] In addition to the above-mentioned methods for determining the important focus list, the electronic device 100 may also use other methods to determine the important focus list to improve the efficiency of the user in finding nodes.

[0150] It should be noted that, among the above-mentioned preset rules, the rule based on the important focus and / or filtered focus screening marked by the user may have the highest priority among all the rules.

[0151] For example, if a node is marked as an important focus by the user but the node is not in the high-frequency node library, the electronic device 100 can still include the node in the important focus list.

[0152] If a node is marked as a filtering focus by the user but is in the high-frequency node library, this node may not be included in the important focus list.

[0153] If a node is marked as an important focus by the user but the electronic device 100 determines the node as a filtered focus based on its node characteristics, the electronic device 100 can still include the node in the important focus list. Optionally, the electronic device 100 can also include other nodes in the user interface whose node characteristics are consistent with the node characteristics of the node in the important focus list.

[0154] If a node is marked as a filtering focus by the user but the electronic device 100 does not determine the node as a filtering focus based on the node characteristics of the node, the important focus list may not include the node. Optionally, the important focus list may also not include other nodes with the same characteristics as the node.

[0155] In some embodiments, the order in which the nodes are arranged in the important focus list can be consistent with the order in which the nodes are displayed in the user interface. For example, the order in which the nodes are displayed in the user interface can be determined from left to right and from top to bottom according to the display position. If the display position of a node in the important focus list is before the display position of another node, then this node is arranged before the other node in the important focus list. The order in which the nodes are arranged in the important focus list is the order in which the electronic device 100 switches focus according to the important focus list, that is, the order in which the nodes are arranged in the important focus list is the order in which the nodes in the important focus list are traversed and selected as focus in sequence. The above-mentioned ordering of the nodes in the important focus list according to the order in which the nodes are displayed in the user interface can reduce the impact of skipping one or more nodes when switching focus on the user's perception of the page layout.

[0156] 4A to 4F exemplarily show some schematic diagrams of scenarios in which users set important focuses and filter focuses.

[0157] As shown in FIG4A , electronic device 100 may display user interface 410. User interface 410 may be a user interface of a settings application. User interface 410 may include an accessibility option 411. In response to an operation on accessibility option 411, electronic device 100 may display user interface 420 shown in FIG4B .

[0158] As shown in FIG. 4B , the user interface 420 may include a screen reading switch control 421 , a speech rate control 422 , a voice control 423 , a shortcut gesture control 424 , and a smart skip switch control 425 .

[0159] The screen reading switch control 421 can be used to turn on or off the screen reading function. The screen reading function may also be referred to as an accessibility mode or the like. For example, the screen reading switch control 421 is in the off state shown in FIG4B , which may indicate that the screen reading function is currently off. When the screen reading switch control 421 is in the off state shown in FIG4B , the electronic device 100 may turn on the screen reading function in response to an operation on the screen reading switch control 421, such as a click operation. After the screen reading function is turned on, when the focus is on the screen reading switch control 421, the electronic device 100 may turn off the screen reading function in response to an operation to turn on the selected focus (such as an operation of double-clicking the screen with one finger).

[0160] The speech rate control 422 can be used to adjust the speed at which the electronic device 100 reads the node description information after the screen reading function is turned on.

[0161] The voice control 423 may be used to trigger the electronic device 100 to display options for voice features (such as timbre, language, etc.) for reading aloud the node description information, so that the user can make a selection.

[0162] The quick gesture control 424 can be used to trigger the electronic device 100 to display one or more functions that can be triggered by user operations after the screen reading function is turned on.

[0163] The smart skip switch control 425 can be used to turn on or off the smart skip function. When the smart skip function is turned on, the electronic device 100 can determine the important focus list of the user interface currently displayed on the screen according to preset rules. When the user's operation of switching focus forward or backward is detected, the electronic device 100 can read aloud only the description information of the nodes in the important focus list in a skipping manner, without switching the focus one by one among all the nodes in the user interface. When the smart skip function is turned off, the electronic device 100 can switch the focus one by one among all the nodes in the user interface in accordance with the arrangement order of the nodes on the user interface (for example, from left to right, from top to bottom) in response to the operation of switching focus forward or backward.

[0164] It can be seen that users can manually turn on and off the smart skipping function.

[0165] As shown in FIG4B , in response to an operation on the quick gesture control 424, the electronic device 100 may display the user interface 430 shown in FIG4C . The user interface 430 may display an introduction to functions that can be triggered by one or more user operations after the screen reading function is enabled on the electronic device 100. This can help the user understand how to use the electronic device 100 when the screen reading function is enabled.

[0166] For example, a user operation of "single-finger tapping once" can be used to trigger the electronic device 100 to read the focus. A user operation of "single-finger double-tapping" can be used to trigger the electronic device 100 to enable the selected focus. A user operation of "single-finger swipe up" (i.e., sliding one finger upward) can be used to trigger the electronic device 100 to switch to the previous focus. A user operation of "single-finger swipe down" (i.e., sliding one finger downward) can be used to trigger the electronic device 100 to switch to the next focus. A user operation of "single-finger swipe up then left" can be used to trigger the electronic device 100 to mark the currently selected node as an important focus. A user operation of "single-finger swipe up then right" can be used to trigger the electronic device 100 to mark the currently selected node as a filtered focus. The above user operations are merely exemplary of this application and should not constitute a limitation of this application. The user interface 430 may further list more or fewer gestures for operating the electronic device 100 when the screen reading function is enabled. For example, the user operations used to control the electronic device 100 may also include user operations to cancel the important focus or filtered focus marking. In this way, the user can also manually cancel the important focus marking or filtered focus marking of a node. For another example, the operation for triggering the electronic device 100 to mark the currently selected node as an important focus may also include tapping the side of the electronic device 100 twice.

[0167] As shown in Figure 4D, the electronic device 100 can display a user interface 440. The user interface 440 can be the desktop of the electronic device 100. The user interface 440 may include a marking box 441 and a sports health logo 442. The screen reading function of the electronic device 100 is currently on. Among them, the marking box 441 is currently located at the position where the sports health logo 442 is located, which can indicate that the current focus is the sports health logo 442. In response to the operation of sliding down and then to the left with a single finger as shown in Figure 4D, the electronic device 100 can mark the sports health logo 442 as an important focus, and voice broadcast "Sports health has been marked as an important focus." In this way, the user can know that the sports health logo 442 has been marked as an important focus through the content of the above voice broadcast.

[0168] As shown in FIG4E , electronic device 100 may display user interface 440. User interface 440 may include an email identifier 443. Marking box 441 is currently located at the location of email identifier 443, indicating that email identifier 443 is currently in focus. In response to the single-finger downward-then-right swipe operation shown in FIG4E , electronic device 100 may mark email identifier 443 as a filter focus and announce by voice, "The email identifier has been marked as a filter focus." In this way, the user can be informed by the above-mentioned voice announcement that email identifier 443 has been marked as a filter focus.

[0169] Not limited to marking application logos on the desktop, users can also mark nodes in the APP's user interface.

[0170] As shown in Figure 4F, the electronic device 100 can display a user interface 450. The user interface 450 can be a user interface of a video application. The user interface 450 may include a marking box 451. The marking box 451 is currently located at the position where the animation option is located, which can indicate that the current focus is the animation option. The above-mentioned animation option can be used to trigger the video application to call out the user interface corresponding to the animation option. In response to the operation of sliding down and then to the right with a single finger as shown in Figure 4F, the electronic device 100 can mark the animation option as a filter focus and voice broadcast "The animation has been marked as a filter focus." In this way, the user can know that the above-mentioned animation option has been marked as a filter focus through the content of the above-mentioned voice broadcast.

[0171] As shown in FIG4F , the previous node of the animation option is the popular option. The next node of the animation option is the film and television option. When the animation option is the filter focus, if the current focus is the popular option, in response to the operation of switching the next focus (such as swiping down with one finger), the electronic device 100 can skip the animation option, switch the focus to the film and television option, and voice broadcast the description information of the film and television option (such as "film and television").

[0172] The contents of the voice broadcasts shown in the above-mentioned Figures 4D to 4F are merely exemplary descriptions of the present application and should not constitute a limitation on the present application.

[0173] In some embodiments, in response to operations of marking an important focus and marking a filtering focus, the electronic device 100 may store information of nodes marked as important focuses and nodes marked as filtering focuses. When displaying a user interface, the electronic device 100 may traverse the nodes in the user interface to determine which nodes in the user interface are marked as important focuses and which nodes are marked as filtering focuses.

[0174] Here, a method for the electronic device 100 to determine a node as a filtering focus according to node characteristics is introduced by taking the user interface 450 shown in FIG. 4F as an example.

[0175] As shown in FIG4F , user interface 450 may include nodes 452 through 457. User interface 450 is not limited to nodes 452 through 457 and may include more nodes. For example, in response to sliding the content displayed in user interface 450 upward, electronic device 100 may display more nodes after nodes 456 and 457. The currently partially or completely hidden nodes after nodes 456 and 457 may all be nodes in user interface 450. Nodes 452 through 457 are used as an example for illustration.

[0176] The electronic device 100 may traverse the nodes in the user interface 450 and obtain node features of the nodes. For example, the electronic device 100 may obtain node features of nodes 452 to 457. Nodes 452 to 457 may be nodes in a parallel relationship.

[0177] Node 452 can be used to trigger the electronic device 100 to play the video corresponding to node 452. Node 452 can include four subnodes: subnode 452A, subnode 452B, subnode 452C, and subnode 452D. Subnode 452A can be a picture and is displayed in the upper center position of node 452. Subnode 452B can be the name of the video corresponding to node 452 (e.g., "Video 1"), displayed below subnode 452A and aligned to the left. Subnode 452C can be the avatar of the video publisher corresponding to node 452, displayed below subnode 452B and aligned to the left. Subnode 452D can be the name of the video publisher corresponding to node 452 (e.g., "User 1"), displayed to the right of subnode 452C and aligned to the left.

[0178] Nodes 453, 454, 456, and 457 can all be used to trigger electronic device 100 to play their corresponding videos. As shown in FIG4F , the number, layout, display style, and type of child nodes contained in nodes 453, 454, 456, and 457 are the same as those in node 452.

[0179] However, node 455 is a node corresponding to advertising information, which is used to trigger the electronic device 100 to display a user interface corresponding to the advertising information (e.g., advertising information for XX game). Node 455 may include four subnodes: subnode 455A, subnode 455B, subnode 455C, and subnode 455D. Subnode 455A may be an image and is displayed in the upper center position of node 452. Subnode 455B may be the theme name of the advertising information (e.g., "XX game"), displayed below subnode 455A, centered, and displayed in bold font. Subnode 455C may be the logo of the advertising information (e.g., "game"), which can be used to indicate that node 455 is a node corresponding to a game advertisement. Subnode 455C is displayed below subnode 455B and is aligned to the left. Subnode 455D may be the publisher name of the advertising information (e.g., "aa company"), displayed to the right of subnode 455C and aligned to the right.

[0180] It can be seen that although node 455 contains the same number of child nodes as node 452, the layout of the child nodes in node 455 is different from the layout of the child nodes in nodes 452 to 454, node 456, and node 457, and the display style of the child nodes in node 455 is also different from the display style of the child nodes in nodes 452 to 454, node 456, and node 457. Therefore, node 455 may be an abnormal node in user interface 450. Electronic device 100 can determine node 455 as the filtering focus. When the current focus is node 454, in response to the operation of switching the next focus, electronic device 100 can skip node 455 and switch the focus to node 456. In this way, when the user searches for a node by switching the next focus in user interface 450, electronic device 100 can skip advertising information, thereby improving the efficiency of the user in finding the target node.

[0181] In some embodiments, there are multiple nodes with a parallel relationship in the user interface. The electronic device 100 can divide these multiple nodes into multiple categories according to different node characteristics. Among them, nodes with the same node characteristics (for example, the number of sub-nodes contained in the node is the same, and the layout, display style, and type of the sub-nodes are the same) can be divided into one category. The electronic device 100 can determine whether the ratio of the number of nodes in a category with the largest number of nodes to the number of nodes in other categories is higher than a preset ratio. If the ratio of the number of nodes in a category with the largest number of nodes to the number of nodes in another category is higher than a preset ratio, the electronic device 100 can determine the node in the other category as the filtering focus.

[0182] It can be understood that the ratio of the number of nodes in a category with the largest number of nodes to the number of nodes in another category is higher than the preset ratio, which can indicate that the nodes in this other category in the user interface are in the minority and are more likely to be nodes corresponding to advertising information.

[0183] For example, the electronic device 100 divides a plurality of nodes having a parallel relationship in the user interface into a plurality of categories according to different node characteristics. These multiple categories include category C1 and category C2. Category C1 is the category with the largest number of nodes among these multiple categories, including n1 nodes. Category C2 includes n2 nodes. If the value of n1:n2 is higher than the preset ratio, the electronic device 100 may determine these n2 nodes as filtering focuses. These n2 nodes may not be included in the important focus list. The embodiment of the present application does not limit the above-mentioned preset ratio. For example, the preset ratio can be 3 or 4, etc.

[0184] The above embodiment is merely an example of a method for determining an important focus list based on node features provided by the present application and should not constitute a limitation to the present application.

[0185] In some embodiments, if a node that is determined to be a filtering focus based on node features is marked as an important focus by the user, the electronic device 100 can give priority to the user mark and include this node as an important focus in the important focus list. For example, the user selects node 455 by tapping the location of node 455 shown in Figure 4F with a single finger, and marks node 455 as an important focus. The electronic device 100 can add node 455 to the important focus list of the user interface 450. When the current focus is node 454 shown in Figure 4F, in response to the operation of switching the next focus, the electronic device 100 can switch the focus to node 455 and voice broadcast the description information of node 455. This can avoid skipping the node that the user wants to find when switching the focus in the sliding browsing scene, thereby improving the efficiency of the user in finding the target node.

[0186] In some embodiments, the above-mentioned rule of obtaining an important focus list based on node feature screening can be applied to one or more applications in the electronic device 100 .

[0187] FIG5 exemplarily shows a flow chart of a method for determining an important focus list provided in the present application.

[0188] As shown in FIG5 , the electronic device 100 may determine an important focus list of a user interface according to the important focus and / or filtered focus marked by the user, the high-frequency node library, and the filtered focus determined based on node features.

[0189] S511 , traverse the nodes in user interface 1 .

[0190] The user interface 1 may be, for example, the desktop shown in Figure 4D , or the user interface of an APP (such as a video application, etc.) shown in Figure 4F . The embodiment of the present application does not limit the type of the user interface 1 .

[0191] S512. Determine the important focus list of user interface 1. The important focus list includes nodes in user interface 1 that are marked as important focuses by the user and nodes in the high-frequency node library, and does not include nodes in user interface 1 that are filtered focuses and nodes that are not marked by the user and are not in the high-frequency node library.

[0192] The electronic device 100 can determine which nodes in the user interface 1 are marked as important focuses by the user, and / or which nodes are marked as filtering focuses by the user. The electronic device 100 can also determine which nodes in the user interface 1 exist in the high-frequency node library. The electronic device 100 can include the nodes in the user interface 1 marked as important focuses by the user, as well as the nodes in the high-frequency node library, into the important focus list. Moreover, when determining the important focus list, the electronic device 100 can eliminate the nodes in the user interface 1 that are filtering focuses, as well as the nodes that are not marked by the user and are not in the high-frequency node library. Among them, the method for users to mark important focuses and filtering focuses, and the method for determining filtering focuses based on node features can refer to the introduction of the aforementioned embodiments.

[0193] This can ensure that the nodes in the important focus list are the nodes that the user is most likely to find and use in the user interface 1. In the sliding browsing scenario, the electronic device 100 switches the focus according to the important focus list to improve the efficiency of the user in finding the target node, thereby improving the user's experience of using the screen reading function.

[0194] The following describes the screen reading scenario provided by the embodiment of the present application, taking switching focus on the desktop of the electronic device 100 as an example for explanation.

[0195] 6A to 6F exemplarily show some schematic diagrams of screen reading scenarios.

[0196] As shown in Figure 6A, the electronic device 100 can display a user interface 610. The user interface 610 is the desktop of the electronic device 100. The user interface 610 can refer to the introduction of the user interface 210 shown in Figure 1A above. The nodes in the user interface 610 may include: a clock logo 612, a music logo 613, a sports and health logo 614, and a dial logo 615. The user interface 610 may also include APP logos of other APPs. Among them, on the user interface 610, in the order from left to right and from top to bottom, the display position of the clock logo 612 is in front of the music logo 613, the display position of the music logo 613 is in front of the sports and health logo 614, and the display position of the sports and health logo 614 is in front of the dial logo 615.

[0197] When the screen reading function is enabled, the user interface 610 may further include a marking box 611. As shown in FIG6A, the marking box 611 is currently located at the position of the clock mark 612, indicating that the current focus is the clock mark 612.

[0198] The electronic device 100 can traverse the nodes in the user interface 610, and filter the nodes in the user interface 610 according to preset rules to determine the important focus list of the user interface 610. The above method of determining the important focus list according to preset rules can refer to the introduction of the aforementioned embodiment. For example, the important focus list of the user interface 610 can be the important focus list 621 shown in Figure 6A. The important focus list 621 may include nodes: music (i.e., music identifier 613), sports health (i.e., sports health identifier 614), and dialing (i.e., dialing identifier 615). Among them, the order of arrangement of the nodes in the important focus list 621 can be consistent with the order in which the nodes are displayed in the user interface 610.

[0199] The important focus list 621 is merely an illustrative description of the present application and should not constitute a limitation to the present application.

[0200] In response to the single-finger downward sliding (or swiping) operation shown in FIG6A , the electronic device 100 can search for the node that is located after the current focus (i.e., the clock mark 612), is ranked closest to the current focus, and is located in the important focus list 621. It can be seen that the music mark 613 is located after the clock mark 612 in the important focus list 621 and is ranked closest to the clock mark 612. Therefore, the electronic device 100 can directly switch the focus from the clock mark 612 to the music mark 613.

[0201] In response to the single-finger downward sliding operation shown in Figure 6A, the electronic device 100 can display the user interface 610 shown in Figure 6B and voice broadcast "Music". Comparing Figures 6A and 6B, it can be seen that the display position of the mark box 611 changes from the position of the clock logo 612 shown in Figure 6A to the position of the music logo 613 shown in Figure 6B. This may indicate that the focus has been switched from the clock logo 612 to the music logo 613. The content "Music" voice broadcasted by the electronic device 100 is the description information of the music logo 613. In this way, the user can determine that the current music logo 613 is in the selected state and the current focus is the music logo 613 based on the content of the voice broadcast of the electronic device 100. It can be seen that in response to an operation for switching the next focus, the electronic device 100 can skip the node between the clock logo 612 and the music logo 613 and switch the focus to the node in the important focus list 621.

[0202] In some embodiments, when the electronic device 100 calls up the user interface 610, it may determine the initial focus as a node in the important focus list 621. For example, in response to the operation of calling up the user interface 610, the electronic device 100 may display the user interface 610, determine the focus as the first node in the important focus list 621: the music identifier 613, and voice broadcast the description information of the music identifier 613.

[0203] Further, in response to the single-finger downward sliding operation shown in FIG. 6B , the electronic device 100 may continue to switch the focus according to the important focus list 621 .

[0204] When the current focus is the music identifier 613 shown in Figure 6B, in response to the single-finger downward sliding operation shown in Figure 6B, the electronic device 100 can display the user interface 610 shown in Figure 6C and voice broadcast "sports health". Comparing Figure 6B and Figure 6C, it can be seen that the display position of the mark box 611 changes from the position of the music identifier 613 shown in Figure 6B to the position of the sports health identifier 614 shown in Figure 6C. This can indicate that the focus has been switched from the music identifier 613 to the sports health identifier 614. The sports health identifier 614 is the next node of the music identifier 613 in the important focus list 621. The content "sports health" voice broadcasted by the electronic device 100 is the description information of the sports health identifier 614. In this way, the user can determine that the current sports health identifier 614 is in the selected state and the current focus is the sports health identifier 614 based on the content of the voice broadcast of the electronic device 100.

[0205] In some embodiments, when the current focus is a node in the important focus list 621, in response to an operation of switching the next focus or switching the previous focus, the electronic device 100 may switch the focus according to the important focus list 621. If the current focus is not a node in the important focus list 621, in response to an operation of switching the next focus or switching the previous focus, the electronic device 100 may switch the focus according to the order in which the nodes are displayed in the user interface 610.

[0206] Exemplarily, if the current focus is the clock logo 612 shown in Figure 6A, in response to the operation of switching the next focus (such as a single-finger downward swipe operation), the electronic device 100 can switch the focus to the calendar logo shown in Figure 6A. Since the electronic device 100 can determine that the clock logo 612 is not in the important focus list, the electronic device 100 can switch the focus to the next node of the clock logo 612 in the user interface 610, that is, the calendar logo. If the current focus is the music logo 613 shown in Figure 6A, in response to the operation of switching the next focus, the electronic device 100 can switch the focus to the sports and health logo 614 shown in Figure 6A. Since the electronic device 100 can determine that the music logo 613 is in the important focus list 621, the electronic device 100 can switch the focus to the next node of the music logo 613 in the important focus list 621, that is, the sports and health logo 614.

[0207] When the current focus is the sports health mark 614 shown in Figure 6C, in response to the single-finger downward sliding operation shown in Figure 6C, the electronic device 100 can display the user interface 610 shown in Figure 6D and voice broadcast "Dial". Comparing Figure 6C and Figure 6D, it can be seen that the display position of the mark box 611 changes from the position of the sports health mark 614 shown in Figure 6C to the position of the dial mark 615 shown in Figure 6D. This can indicate that the focus has been switched from the sports health mark 614 to the dial mark 615. The dial mark 615 is the next node of the sports health mark 614 in the important focus list 621. The content "Dial" voice broadcasted by the electronic device 100 is the description information of the dial mark 615. In this way, the user can determine that the current dial mark 615 is in the selected state and the current focus is the dial mark 615 based on the content of the voice broadcast of the electronic device 100.

[0208] When the current focus is the dial mark 615 shown in Figure 6D, in response to the single-finger downward sliding operation shown in Figure 6D, the electronic device 100 can display the user interface 610 shown in Figure 6E and voice broadcast "Music". Comparing Figure 6D and Figure 6E, it can be seen that the display position of the mark box 611 changes from the position where the dial mark 615 shown in Figure 6D is located to the position where the music mark 613 shown in Figure 6E is located. This can indicate that the focus has been switched from the dial mark 615 to the music mark 613. The content "Music" voice broadcasted by the electronic device 100 is the description information of the music mark 613. In this way, the user can determine that the current music mark 613 is in the selected state and the current focus is the music mark 613 based on the content of the voice broadcast of the electronic device 100.

[0209] Among them, dial identifier 615 is the last node in important focus list 621. Music identifier 613 is the first node in important focus list 621. In response to the operation of switching the focus to the next node of dial identifier 615, electronic device 100 can cycle through important focus list 621 and switch the focus to the first node in important focus list 621, namely, music identifier 613. In other words, in the sliding browsing scenario, electronic device 100 can switch the focus between nodes in important focus list 621.

[0210] As shown in Figure 6E, in response to a single-finger tap on the location of the file management identifier 616, the electronic device 100 can switch the focus to the file management identifier 616. When the focus is switched to the file management identifier 616, the electronic device 100 can display the user interface 610 shown in Figure 6F and voice broadcast "File Management". Comparing Figure 6E and Figure 6F, it can be seen that the display position of the mark box 611 changes from the location of the music identifier 613 shown in Figure 6E to the location of the file management identifier 616 shown in Figure 6F. This can indicate that the focus has been switched from the music identifier 613 to the file management identifier 616. The content "File Management" voice broadcasted by the electronic device 100 is the description information of the file management identifier 616. In this way, the user can determine that the current file management identifier 616 is in the selected state and the current focus is the file management identifier 616 based on the content of the voice broadcast of the electronic device 100. It can be seen that although the focus in the sliding browsing scenario switches between nodes in the important focus list 621, the user can still switch the focus to a node that is not in the important focus list 621 by clicking the screen.

[0211] As can be seen from the above scenario, the user can choose the method of searching for nodes in the user interface as needed. If the node the user wants to find is in the important focus list, the user can trigger the electronic device 100 to switch the focus according to the important focus list by switching the next focus or switching the previous focus, thereby quickly finding the node they need. If the user wants to find a node outside the important focus list, the user can click at the corresponding position on the screen based on their perception of the page layout to find the target node.

[0212] In addition, users who cannot see or cannot see the screen clearly can rely on the electronic device 100 to voice broadcast the description information of each node to establish their own understanding of the page layout. For example, in a sliding browsing scenario, the user switches to the next focus one by one, and the electronic device 100 switches the focus one by one and voice broadcasts the description information of the node after switching. Usually, the user will think that the node corresponding to the description information heard later is located after the node corresponding to the description information heard earlier on the user interface. The user can roughly understand the distribution of each node on the user interface based on the information they hear. In this application, the order of arrangement of nodes in the important focus list is consistent with the order in which the nodes are displayed in the user interface. In this way, even if one or more nodes on the user interface are skipped when switching focus according to the important focus list, the order of switching focus still conforms to the order in which the nodes are displayed in the user interface. This can reduce the impact of skipping one or more nodes when switching focus on the user's understanding of the page layout, making it easier for the user to find nodes that are not in the important focus list based on their understanding of the page layout.

[0213] In some embodiments, in a sliding browsing scenario, after the electronic device 100 switches focus to traverse the nodes in the important focus list, the electronic device 100 can switch the focus between nodes that are not in the important focus list on the user interface according to the order in which the nodes are displayed in the user interface. For example, referring to Figures 6B to 6D, the electronic device 100 can switch the focus to the music identifier 613, the sports and health identifier 614, and the dial identifier 615 in sequence according to the important focus list 621. Then, when the current focus is the dial identifier 615, in response to the operation of switching the next focus, the electronic device 100 can switch the focus to the information identifier according to the order in which the nodes are displayed in the user interface 610, and voice broadcast the description information of the information identifier. The information identifier is the next node displayed after the dial identifier 615 in the user interface 610. After the focus is switched in sequence to the information icon, clock icon 612, calendar icon, gallery icon, memo icon, file management icon, and email icon in the user interface 610 shown in Figure 6B, in response to the operation of switching the next focus, the electronic device 100 can skip the music icon 613 in the important focus list 621, switch the focus to the calculator icon, and voice broadcast the description information of the computer icon.

[0214] Optionally, the electronic device 100 may also sequentially traverse the nodes in the important focus list starting from a non-first node in the important focus list and select them as the focus. For example, the electronic device 100 starts traversing the nodes in the important focus list 621 from the dialing identifier 615 in the important focus list 621. The electronic device 100 may switch the focus from the dialing identifier 615 to the music identifier 613 and the sports and health identifier 614 in sequence according to the order of the nodes in the important focus list 621. After the nodes in the important focus list 621 are sequentially traversed and selected as the focus, the sports and health identifier 614 is the last node in the important focus list 621 to be selected as the focus. When the current focus is the sports and health identifier 614, in response to the operation of switching the next focus, the electronic device 100 may switch the focus to the weather identifier according to the order of the node display positions in the user interface 610, and voice broadcast the description information of the weather identifier. The weather identifier is the next node displayed after the sports and health identifier 614 in the user interface 610.

[0215] It is understandable that after the electronic device 100 traverses the nodes in the important focus list 621 in the sliding browsing scenario, it continues to receive the operation of switching the next focus or switching the previous focus, which may indicate that the node the user wants to find is not in the important focus list. The electronic device 100 can continue to skip the important focus list 621 according to the operation of switching focus in the sliding browsing scenario, and switch the focus between nodes on the user interface that are not in the important focus list 621. This can reduce the situation where a node is repeatedly determined as the focus, and improve the efficiency of the user in finding nodes.

[0216] In some embodiments, in a sliding browsing scenario, after the electronic device 100 switches focus to traverse the nodes in the important focus list, the electronic device 100 can switch the focus between all nodes on the user interface according to the order in which the nodes are displayed in the user interface.

[0217] FIG7 exemplarily shows a flow chart of a screen reading method provided in an embodiment of the present application.

[0218] As shown in FIG. 7 , the screen reading method may include steps S711 to S716 .

[0219] S711 : When the screen reading function is turned on, the electronic device 100 currently displays the user interface 1 , and the current focus is the node 1 on the user interface 1 .

[0220] User interface 1 may be, for example, user interface 610 shown in FIG. 6A . This embodiment of the present application does not limit user interface 1. Node 1 may be a node in the important focus list of user interface 1, or may be a node outside the important focus list of user interface 1. For example, node 1 may be the clock logo 612 shown in FIG. 6A , or may be the music logo 613 shown in FIG. 6B .

[0221] S712: The electronic device 100 receives operation 1 on the user interface 1, where operation 1 is used to switch the focus backward.

[0222] Switching the focus backwards is also switching the next focus. For example, operation 1 may be the operation of sliding downwards with one finger as shown in FIG6A .

[0223] S713. In response to operation 1, the electronic device 100 searches for node 2 that is located after node 1, is ranked closest to node 1, and is located in the important focus list. The important focus list can be obtained by the electronic device 100 by filtering the nodes included in the user interface 1 based on preset rules.

[0224] The above-mentioned sorting closest to node 1 may mean closest to node 1 in the order in which the nodes are displayed in user interface 1. For example, the order in which the nodes are displayed in user interface 1 may be determined from left to right and from top to bottom according to the display positions.

[0225] S714 : The electronic device 100 switches the focus from node 1 to node 2 and reads the description information of node 2 aloud.

[0226] The above scenario of switching the focus from node 1 to node 2 can refer to the scenario of switching the focus from the clock logo 612 to the music logo 613 shown in Figures 6A and 6B.

[0227] S715 : The electronic device 100 receives operation 2 on the user interface 1 , where operation 2 is used to select node 3 , and node 3 is not in the important focus list.

[0228] For example, the above-mentioned operation 2 may be the single-finger click operation shown in FIG. 6E .

[0229] S716 . In response to operation 3 , the electronic device 100 switches the focus from node 2 to node 3 , and reads aloud the description information of node 3 .

[0230] It can be seen that the user can switch the focus to a node that is not in the important focus list by selecting the node that is not in the important focus list.

[0231] As can be seen from the method shown in FIG. 7 , in a sliding browsing scenario, the electronic device 100 can switch focus based on the important focus list in the user interface. The important focus list may include nodes that the electronic device 100 has selected based on preset rules as the most likely nodes that the user would like to find and use. In this way, in a sliding browsing scenario, the electronic device 100 can help the user quickly find the target node by skipping, thereby improving the efficiency of the user's search for the target node.

[0232] It is understood that the various user interfaces described in the embodiments of this application are merely exemplary interfaces and do not limit the scope of this application. In other embodiments, the user interface may adopt a different interface layout, include more or fewer controls, and add or remove other functional options. As long as they are based on the same inventive concept provided by this application, they are all within the scope of protection of this application.

[0233] It should be noted that, without causing any contradiction or conflict, any feature in any embodiment of the present application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of the present application.

[0234] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A screen reading method, characterized in that: The method is applied to an electronic device, the screen reading function of the electronic device is turned on, and the method includes: The electronic device displays a first interface, and a first node in the first interface is selected as a focus; The electronic device receives a first operation, where the first operation is used to switch a next focus; In response to the first operation, the electronic device skips the second node in the first interface according to the first list associated with the first interface, switches the focus from the first node to the third node in the first interface, and reads aloud the description information of the third node; the first list includes one or more nodes in the first interface, the first list includes the third node but does not include the second node, the first node in the first interface is displayed before the second node, and the second node is displayed before the third node.

2. The method according to claim 1, characterized in that The order in which the nodes in the first list are traversed and selected as the focus is consistent with the order in which the nodes in the first list are displayed in the first interface.

3. The method according to claim 1 or 2, characterized in that: The order in which the nodes in the first list are traversed and selected as the focus is irrelevant to the usage frequency of the nodes in the first list.

4. The method according to any one of claims 1 to 3, characterized in that The first list includes the first node, and the third node is a next node of the first node in the first list.

5. The method according to claim 4, characterized in that The method further comprises: The electronic device receives a second operation, where the second operation is used to switch the previous focus; In response to the second operation, the electronic device skips the second node according to the first list, switches the focus from the third node to the first node, and reads aloud the description information of the first node.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: The electronic device receives a third operation, where the third operation is used to mark k1 nodes in the first interface as important focuses, where k1 is a positive integer; The electronic device determines the first list according to the third operation, where the first list includes the k1 nodes.

7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: The electronic device receives a fourth operation, where the fourth operation is used to mark k2 nodes in the first interface as filtering focuses, where k2 is a positive integer; The electronic device determines the first list according to the fourth operation, and the first list does not include the k2 nodes.

8. The method according to any one of claims 1 to 7, characterized in that The method further comprises: The electronic device determines the first list according to the usage frequency of nodes in the first interface, wherein the first list includes nodes in the first interface whose usage frequency is higher than a first frequency, and does not include nodes in the first interface whose usage frequency is not higher than the first frequency.

9. The method according to any one of claims 1 to 8, characterized in that The first interface includes k3 nodes in a parallel relationship, k3 is a positive integer, and the method further includes: The electronic device determines the first list based on the node characteristics of the nodes in the first interface, wherein k4 nodes are a group of nodes with the same node characteristics and the largest number of nodes among the k3 nodes, the k3 nodes also include k5 nodes, the node characteristics of the k5 nodes are different from the node characteristics of the k4 nodes, the first list does not include the k5 nodes, and k4 and k5 are both positive integers less than k3.

10. The method according to claim 9, characterized in that The k4 nodes are nodes corresponding to non-advertisement information, and the k5 nodes are nodes corresponding to advertisement information.

11. The method according to any one of claims 1 to 10, characterized in that The first node in the first list is the fourth node, the last node in the first list is the fifth node, and the fifth node is selected as the focus; the method further includes: The electronic device receives an operation for switching the next focus, switches the focus from the fifth node to the fourth node according to the first list, and reads aloud the description information of the fourth node, and the fourth node is displayed before the fifth node in the first interface.

12. The method according to any one of claims 1 to 10, characterized in that After the nodes in the first list are traversed in sequence and selected as the focus, the method further includes: The electronic device receives an operation for switching the next focus, switches the focus to a sixth node in the first interface, and reads aloud description information of the sixth node, wherein the first list does not include the sixth node.

13. The method according to claim 12, characterized in that The focus is switched from the seventh node in the first list to the sixth node, and the sixth node is the first node displayed in the first interface after the seventh node that is not in the first list.

14. The method according to any one of claims 1 to 13, characterized in that The method further comprises: The electronic device receives a fifth operation, where the fifth operation is used to select an eighth node in the first interface; In response to the fifth operation, the electronic device switches focus to the eighth node and reads aloud description information of the eighth node.

15. The method according to claim 14, characterized in that The first list does not include the eighth node.

16. An electronic device, characterized in that: The electronic device includes a screen, an audio output device, a memory and a processor, wherein the screen is used to display a first interface; the audio output device is used to read aloud the description information of the node selected as the focus in the screen; the memory is used to store a computer program; and the processor is used to call the computer program so that the electronic device executes the method described in any one of claims 1 to 15.

17. A computer-readable storage medium storing instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.

18. A computer program product, characterized in that The computer program product comprises computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.

Images