Screen reading method and electronic equipment

Abstract

The invention provides a screen reading method and electronic equipment. The electronic equipment can screen out a plurality of nodes most likely to be used by a user from nodes of a user interface according to a preset rule, and an important focus list is obtained. In the sliding browsing scene, the electronic equipment can switch the focuses according to the important focus list, and only reads description information of the nodes in the important focus list in a skip reading mode. Therefore, the efficiency of searching the target node by the user in the sliding browsing scene can be improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a screen reading method and an electronic device. Background Art

[0002] Electronic devices can provide a screen reading function. The screen reading function can help users use electronic devices when they cannot see or cannot see the screen clearly. When the screen reading function is turned on, the electronic device can read the content displayed on the screen at the user's touch position according to the user's touch operation on the screen. In this way, even if the user cannot see the screen, the user can determine the control displayed at the touch position on the screen according to the content read by the electronic device, so as to use the electronic device to complete the corresponding task, such as opening an application, playing music, making a call, etc.

[0003] There are usually multiple nodes on the user interface displayed by an electronic device. Users can switch among these multiple nodes one by one through preset operations to find the node they need to use. When the node that the user needs to use is displayed at a relatively backward position, the user needs to perform multiple operations to select the node he needs. It can be seen that the efficiency of users finding the target node through the screen reading function is low, and the user experience is poor. Summary of the invention

[0004] The present application provides a screen reading method and an electronic device. In a sliding browsing scenario, the electronic device can switch the focus according to the important focus list, skip the nodes that are not in the important focus list, and read the description information of the nodes in the important focus list. The important focus list includes multiple nodes that the user is most likely to want to use, which are screened from the nodes of the user interface. The method can improve the efficiency of users in finding target nodes.

[0005] In a first aspect, the present application provides a screen reading method. The method can be applied to an electronic device, and the screen reading function of the electronic device is turned on. The electronic device displays a first interface, and the first node in the first interface is selected as the focus; the electronic device receives a first operation, and the first operation is used to switch the next focus; in response to the first operation, the electronic device skips the second node in the first interface according to the first list associated with the first interface, switches the focus from the first node to the third node in the first interface, and reads the description information of the third node; the first list includes one or more nodes in the first interface, the first list includes the third node, and does not include the second node, the first node in the first interface is displayed before the second node, and the second node is displayed before the third node.

[0006] The first operation can refer to this application Fig. 6A The first list can refer to Fig. 6AThe important focus list 621 is shown. For the above scenario of skipping the second node and switching the focus from the first node to the third node, please refer to Fig. 6A and Figure 6B The scene in which the display position of the node between the clock mark 612 and the music mark 613 is skipped and the focus is switched from the clock mark 612 to the music mark 613 can be referred to. Figure 6B and Figure 6C The scene shown skips the node whose display position is between the music logo 613 and the sports and health logo 614 , and switches the focus from the music logo 613 to the sports and health logo 614 .

[0007] Wherein, not limited to the second node, when the focus is switched from the first node to the third node, the electronic device may also skip more nodes whose display positions are between the first node and the third node.

[0008] It can be seen that the first list may include some nodes in the first interface. When an operation for switching the next focus is detected, the electronic device can switch the focus according to the first list. Among them, the electronic device can skip the nodes that are not in the first list and switch the focus to the nodes in the first list according to the order in which the nodes are displayed in the first interface. When the first list contains the nodes that the user wants to use, since the electronic device can skip the nodes that are not in the first list, the user can find the nodes he wants to use by switching the next focus fewer times. This can improve the efficiency of users finding target nodes in sliding browsing scenarios and improve the user experience of using the screen reading function.

[0009] In combination with the first aspect, in some embodiments, the order in which the nodes in the first list are sequentially traversed and selected as the focus is consistent with the order in which the nodes in the first list are displayed in the first interface.

[0010] It can be seen that even if the electronic device skips one or more nodes in the first interface when switching the focus according to the first list, the order in which the electronic device switches the focus is still consistent with the order in which the nodes are displayed in the first interface. This can reduce the impact of skipping one or more nodes on the user's cognition of the page layout when switching the focus, and facilitate the user to find nodes that are not in the first list according to their own cognition of the page layout.

[0011] In combination with the first aspect, in some embodiments, the order in which the nodes in the first list are traversed and selected as the focus is independent of the usage frequency of the nodes in the first list.

[0012] Among them, some nodes with low usage frequency in the first interface may be displayed before some nodes with high usage frequency. If the order in which the nodes in the first interface are switched and selected as the focus is consistent with the order in which the nodes are used frequently, the order of the nodes heard by the user when the electronic device switches the focus in the sliding browsing scene may be disrupted, which is different from the order in which the nodes are displayed in the first interface. Moreover, as the frequency of use changes, the order of nodes heard by the user may be different when switching the focus in the sliding browsing scene at different times. This will affect the user's perception of the page layout. The user cannot understand the distribution of the nodes on the first interface based on the order of the nodes he hears. Therefore, in the present application, the order in which the nodes in the first list are traversed and selected as the focus has nothing to do with the frequency of use of the nodes in the first list, which can reduce the impact of skipping one or more nodes when switching the focus in the sliding browsing scene on the user's perception of the page layout.

[0013] In conjunction with the first aspect, in some embodiments, the first list includes the first node, and the third node is the next node of the first node in the first list. In other embodiments, the first list may also not include the first node. The third node may be a node that is displayed after the first node in the first interface and is the first node in the first list.

[0014] In combination with the first aspect, in some embodiments, the electronic device receives a second operation, which is used to switch the previous focus; in response to the second operation, the electronic device skips the second node according to the first list, switches the focus from the third node to the first node, and reads aloud the description information of the first node.

[0015] The second operation can refer to this application Figure 1B The operation of sliding one finger upwards is shown.

[0016] It can be seen that when an operation for switching the previous focus is detected, the electronic device can also switch the focus according to the first list. Among them, the electronic device can skip the nodes that are not in the first list according to the order in which the nodes are displayed in the first interface, and switch the focus to the nodes in the first list. When the first list contains the nodes that the user wants to use, since the electronic device can skip the nodes that are not in the first list, the user can find the nodes he wants to use by switching the next focus fewer times. This can improve the efficiency of users finding target nodes in sliding browsing scenarios and improve the user experience of using the screen reading function.

[0017] In combination with the first aspect, in some embodiments, the electronic device receives a third operation, and the third operation is used to mark k1 nodes in the first interface as important focuses, where k1 is a positive integer; the electronic device determines a first list based on the third operation, and the first list includes k1 nodes.

[0018] The third operation mentioned above can refer to this application Figure 4D Shown is a single-finger swipe down and then left operation.

[0019] In combination with the first aspect, in some embodiments, the electronic device receives a fourth operation, and the fourth operation is used to mark k2 nodes in the first interface as filtering focuses, where k2 is a positive integer; the electronic device determines the first list based on the fourth operation, and the first list does not include k2 nodes.

[0020] The fourth operation can refer to this application Figure 4E The operation shown is a single-finger swipe down and then to the right.

[0021] In some embodiments, the user can also cancel the mark of the above-mentioned important focus or filter focus.

[0022] It can be seen that the electronic device can determine the nodes included in the first list according to the important focus and / or filter focus marked by the user. In this way, the user can mark one or more nodes that he needs to use frequently or wants to use most as important focus, thereby improving the efficiency of finding the one or more nodes in the sliding browsing scene.

[0023] In combination with the first aspect, in some embodiments, the electronic device determines a first list based on the usage frequency of nodes in the first interface, wherein the first list includes nodes in the first interface whose usage frequency is higher than the first frequency, and does not include nodes in the first interface whose usage frequency is not higher than the first frequency.

[0024] Nodes in the user interface that are frequently used or have been used for a long time are usually the nodes that the user is most likely to want to find and use. The electronic device determines the first list based on the usage frequency of the nodes, and can skip nodes with low usage frequency or low usage time in the sliding browsing scene, and switch the focus between nodes with high usage frequency or high usage time, thereby improving the efficiency of users finding target nodes.

[0025] In combination with the first aspect, in some embodiments, the first interface includes k3 nodes in a parallel relationship, k3 is a positive integer, and the electronic device determines a first list based on the node characteristics of the nodes in the first interface, wherein k4 nodes are a group of nodes with the same node characteristics and the largest number of nodes among the k3 nodes, the k3 nodes also include k5 nodes, the node characteristics of the k5 nodes are different from the node characteristics of the k4 nodes, the first list does not include k5 nodes, and k4 and k5 are both positive integers less than k3.

[0026] In some embodiments, k4 nodes are nodes corresponding to non-advertisement information, and k5 nodes are nodes corresponding to advertisement information.

[0027] In some embodiments, node features may include the number, layout, display style, type, and other features of the child nodes contained in the node.

[0028] In the user interface of some apps, a few nodes that are different from the majority of nodes in terms of node characteristics can be called abnormal nodes. There is a high probability that the abnormal nodes are nodes corresponding to advertising information. The electronic device determines the abnormal nodes as filtering focus and can skip the abnormal nodes when switching focus in the sliding browsing scene. This can reduce the interference of advertising information on users' search for nodes and improve the efficiency of users in finding target nodes in the sliding browsing scene.

[0029] In combination with the first aspect, in some embodiments, the first node in the first list is the fourth node, the last node in the first list is the fifth node, and the fifth node is selected as the focus; the electronic device receives an operation for switching the next focus, switches the focus from the fifth node to the fourth node according to the first list, and reads aloud the description information of the fourth node, and the fourth node in the first interface is displayed before the fifth node.

[0030] In combination with the first aspect, in some embodiments, after the nodes in the first list are traversed in sequence and selected as the focus, the electronic device receives an operation for switching the next focus, switches the focus to the sixth node in the first interface, and reads aloud the description information of the sixth node. The first list does not include the sixth node.

[0031] In some embodiments, the focus is switched from the seventh node in the first list to the sixth node, and the sixth node is the first node that is not in the first list and is displayed after the seventh node in the first interface. The seventh node is the last node selected as the focus when the nodes in the first list are traversed and selected as the focus in sequence. The seventh node can be any node in the first list.

[0032] It is understandable that after the electronic device traverses the nodes in the first list in the sliding browsing scenario, it continues to receive the operation of switching the next focus or switching the previous focus, which can indicate that the node the user wants to find is not in the first list. The electronic device can continue to skip the first list according to the operation of switching the focus in the sliding browsing scenario, and switch the focus between the nodes that are not in the first list on the user interface. This can reduce the situation where a node is repeatedly determined as the focus, and improve the efficiency of users in finding nodes.

[0033] In combination with the first aspect, in some embodiments, the electronic device receives a fifth operation, which is used to select an eighth node in the first interface; in response to the fifth operation, the electronic device switches the focus to the eighth node and reads aloud the description information of the eighth node.

[0034] The fifth operation mentioned above can refer to Fig. 6E The single-finger tap operation is shown.

[0035] In some embodiments, the first list does not include the eighth node.

[0036] It can be seen that although the electronic device can switch the focus between the nodes in the first list in the sliding browsing scenario, the user can still switch the focus to a node that is not in the first list by clicking the screen. The user can choose the way to find the node in the first interface as needed. If the node the user wants to find exists in the first list, the user can trigger the electronic device to switch the focus according to the first list by switching the next focus or the user operation of switching the previous focus, so as to quickly find the node he needs. If the user wants to find a node outside the first list, the user can click at the corresponding position on the screen based on his perception of the page layout to find the target node.

[0037] In a second aspect, the present application provides an electronic device, which may include a screen, an audio output device, a memory, and a processor. The screen may be used to display a first interface. The audio output device may be used to read aloud the description information of the node selected as the focus on the screen. The memory may be used to store a computer program. The processor may be used to call the computer program so that the electronic device executes any possible implementation method as in the first aspect.

[0038] In a third aspect, the present application provides a computer-readable storage medium, comprising instructions, which, when executed on an electronic device, enable the electronic device to execute any possible implementation method in the first aspect.

[0039] In a fourth aspect, the present application provides a computer program product, which may include computer instructions. When the computer instructions are run on an electronic device, the electronic device executes any possible implementation method in the first aspect.

[0040] In a fifth aspect, the present application provides a chip, which is applied to an electronic device, and the chip includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute any possible implementation method as in the first aspect.

[0041] It can be understood that the electronic device provided in the second aspect, the computer-readable storage medium provided in the third aspect, the computer program product provided in the fourth aspect, and the chip provided in the fifth aspect are all used to execute the method provided in the embodiment of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1A to Figure 1ESchematic diagrams of some screen reading scenarios provided in embodiments of the present application;

[0043] Figure 2 is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;

[0044] Figure 3 is a software structure block diagram of an electronic device 100 provided in an embodiment of the present application;

[0045] Figure 4A to Figure 4F It is a schematic diagram of some scenarios in which users set important focus and filter focus provided in the embodiments of the present application;

[0046] Figure 5 is a flow chart of a method for determining an important focus list provided in an embodiment of the present application;

[0047] Figure 6A to Figure 6F Schematic diagrams of some screen reading scenarios provided in embodiments of the present application;

[0048] Figure 7 It is a flow chart of a screen reading method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "a kind", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in a "or" relationship.

[0050] References to "one embodiment" or "some embodiments" etc. described in this specification mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Thus, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways. The term "connection" includes direct connection and indirect connection, unless otherwise specified. "First" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0051] In the embodiments of the present application, the words "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0052] The term "user interface (UI)" in the following embodiments of the present application refers to the medium interface for interaction and information exchange between an application (APP) or an operating system (OS) and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that can be recognized by the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can include visual interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0053] To facilitate understanding, the concepts of the user interface nodes involved in this application are first introduced here.

[0054] A node may represent an element constituting a user interface. For example, a node may include text, icons, buttons, status bars, etc. displayed on a user interface. The relationship between nodes may include a parallel relationship and a parent-child relationship. For example, a node contains one or more child nodes. This node is the parent node of the one or more child nodes. The above-mentioned parallel relationship may also be referred to as a brother relationship. Nodes with a parallel relationship may be brother nodes of each other. The nodes of a user interface may be organized into a tree structure in a hierarchical structure. The tree structure may intuitively and effectively reflect the relationship between nodes on a user interface. An electronic device may traverse all nodes on a user interface and obtain node features of these nodes. For example, node features may include, but are not limited to: the type of node, the number of child nodes contained in a node, the parent node of a node, the display position of a node, the layout of child nodes contained in a node, the type of child nodes contained in a node, and the like.

[0055] Nodes can also be called components, controls, and so on.

[0056] After the screen reading function is turned on, the electronic device can determine which node is the focus, and then read the description information of the node selected as the focus. The description information of the node may include but is not limited to: the name of the node, the operation method that can be performed on the node, etc. In this way, after hearing the description information of the node, the user can know what the node is and how to use the node.

[0057] In some embodiments, the electronic device can determine the focus according to the uniqueness of the node's response result to the user's operation. Among them, if the response result of a node to the user's operation is unique, the electronic device can determine this node as the focus when the user touches this node. The unique response result of a node to the user's operation can indicate that the user performs the same operation on any position of this node, and the response given by the electronic device is unique. For example, a node contains multiple sub-nodes. The response results of the same user operation on these multiple sub-nodes are all unique. When this node is the focus, the electronic device can read aloud the description information of the multiple sub-nodes contained in this node. If the response result of a node to the user's operation is not unique, the electronic device can be subdivided into the sub-nodes contained in this node when determining the focus. The non-unique response result of a node to the user's operation can indicate that the user performs the same operation on different positions of this node, and the response given by the electronic device is different. For example, a node contains multiple sub-nodes. These multiple sub-nodes can be different functional controls, which can respond to user operations and give different responses respectively. When detecting that the user touches a sub-node of the node, the electronic device may determine the touched sub-node as the focus, and then read aloud the description information of the sub-node.

[0058] The above method of selecting node fine-grainedness when determining the focus is merely an exemplary description of the present application and should not constitute a limitation on the present application.

[0059] Figure 1A to Figure 1E Some schematic diagrams of screen reading scenarios are shown as examples.

[0060] like Figure 1A As shown, the electronic device 100 can display a user interface 210. The user interface 210 can be a desktop of the electronic device 100. The user interface 210 may include one or more APP identifiers. For example, a clock identifier 211, a calendar identifier 212, a gallery identifier 213, and the like. The APP identifier can be used to open the corresponding APP. In some embodiments, an APP identifier can be a node. The multiple APP identifiers displayed on the user interface 210 can be nodes with a parallel relationship. An APP identifier can include two sub-nodes: an APP icon and an APP name. For example, the clock identifier 211 includes two sub-nodes: a clock icon and the name of the clock application "clock". When switching focus, the electronic device 100 can switch between different APP identifiers without subdividing the focus into sub-nodes of the APP identifier.

[0061] In some embodiments, after the screen reading function is turned on, the electronic device 100 can mark the node where the focus is located to indicate which node is currently in focus.

[0062] like Figure 1A As shown, the electronic device 100 may display a marking box 214. The marking box 214 is currently located at the position of the clock mark 211, which may indicate that the current focus is the clock mark 211. Not limited to the above marking box 214, the electronic device 100 may also mark the node where the focus is in other ways.

[0063] When the current focus is the clock mark 211, in response to Figure 1A By sliding down as shown, the electronic device 100 can switch the focus to the next node of the clock mark 211. The nodes on the user interface 210 can be arranged in order from left to right and from top to bottom according to the display position. Therefore, the next node of the clock mark 211 can be Figure 1A The calendar identifier 212.

[0064] In response to Figure 1A The downward sliding operation shown in FIG. Figure 1B The user interface 210 shown in FIG. 1 and the voice broadcast "Calendar" are displayed. Figure 1A and Figure 1B It can be seen that the display position of the mark box 214 is determined by Figure 1A The position of the clock mark 211 shown changes to Figure 1B The location of the calendar mark 212 is shown. This may indicate that the focus has been switched from the clock mark 211 to the calendar mark 212. The content "calendar" announced by the electronic device 100 is the description information of the calendar mark 212. In this way, the user can determine that the current calendar mark 212 is in the selected state and the current focus is the calendar mark 212 according to the content announced by the electronic device 100.

[0065] When the current focus is the calendar indicator 212, in response to Figure 1B As shown in the upward sliding operation, the electronic device 100 can switch the focus to the previous node of the calendar mark 212. The previous node of the calendar mark 212 is the clock mark 211.

[0066] In response to Figure 1B The upward sliding operation shown in FIG. Figure 1C The user interface 210 shown in the figure and the voice broadcast "clock". Figure 1B and Figure 1C It can be seen that the display position of the mark box 214 is determined by Figure 1B The position of the calendar mark 212 shown changes to Figure 1C The position of the clock mark 211 is shown. This may indicate that the focus has been switched from the calendar mark 212 to the clock mark 211. The content "clock" announced by the electronic device 100 is the description information of the clock mark 211. In this way, the user can determine that the current clock mark 211 is in the selected state and the current focus is the clock mark 211 according to the content announced by the electronic device 100.

[0067] In some embodiments, when a single-finger click operation on the screen is detected, the electronic device 100 can determine the focus based on the position of the single-finger click operation.

[0068] like Figure 1D As shown, when the current focus is the clock mark 211, in response to a single-finger click operation on the location of the music mark 215, the electronic device 100 can switch the focus to the music mark 215 and display Figure 1E The user interface 210 is shown, and the voice announces “Music”.

[0069] contrast Figure 1D and Figure 1E It can be seen that the display position of the mark box 214 is determined by Figure 1D The position of the clock mark 211 shown changes to Figure 1EThe position of the music mark 215 is shown. The content "music" broadcasted by the electronic device 100 is the description information of the music mark 215. In this way, the user can determine that the current music mark 215 is in the selected state according to the content broadcasted by the electronic device 100, and the current focus is the music mark 215.

[0070] It can be seen that when the screen reading function is turned on, the user can adjust the focus by clicking anywhere on the screen with one finger and determine the content of the node at the clicked position. The user can also switch the focus between nodes one by one according to the order in which the nodes are displayed in the user interface by swiping up or down.

[0071] The order in which the nodes are displayed in the user interface can represent the position distribution relationship of the nodes in the user interface. In some embodiments, the electronic device 100 can determine the order in which the nodes are displayed in the user interface according to a preset arrangement order. For example, the preset arrangement order can be from left to right and from top to bottom according to the display position. Among them, among the nodes whose display positions are in the same row, the node whose display position is on the left is arranged before the node whose display position is on the right. Among the nodes whose display positions are in different rows, the node whose display position is in the previous row is arranged before the node whose display position is in the next row. The fact that a node is displayed before another node in the user interface can indicate that the node is arranged before the other node in the above arrangement order. For example, in Figure 1A In the user interface 210 shown, a clock logo 211 is displayed before a calendar logo 212 , the calendar logo 212 is displayed before a gallery logo 213 , and a memo logo is displayed before a file management logo.

[0072] The present application does not limit the above arrangement order. For example, the arrangement order can also be from top to bottom and then from left to right according to the display position. Among them, when the display positions are in the same column, the nodes with the upper display position are arranged before the nodes with the lower display position. Among the nodes with display positions in different columns, the nodes with the display position in the left column are arranged before the nodes with the display position in the right column.

[0073] It should be noted that the above-mentioned user operation of switching focus is only an exemplary description of the present application and should not be construed as limiting the present application. In addition, the screen reading function is not limited to the desktop, and can also be applied to other user interfaces, such as the user interfaces of APPs such as clock applications, music applications, and video applications.

[0074] The above scenario where the focus is switched from front to back one by one according to the order of the nodes displayed in the user interface through user operations (such as sliding down), and the above scenario where the focus is switched from back to front one by one according to the order of the nodes displayed in the user interface through user operations (such as sliding up) can both be called sliding browsing scenarios. Figure 1A and Figure 1B The scene for switching focus is a sliding browsing scene. In the above sliding browsing scene, the user can browse the nodes one by one from front to back or from back to front according to the order of the nodes displayed in the user interface through preset operations to determine the content of each node (such as the node name, the function of the node, etc.).

[0075] After the screen reading function is turned on in the electronic device 100, the user can switch nodes one by one by sliding up or sliding down to find the node to be used. However, the number of nodes in a user interface is usually large. When the node that the user needs to find is displayed at a relatively backward position on the screen, the user needs to perform multiple sliding operations to find the node to be used. For example, Figure 1A , the current focus is the clock logo 211. If the node that the user needs to use is the dialing logo of the dialing application, the user needs to swipe down 18 times to switch the focus to the dialing logo and then open the dialing application. The above 18 downward swipe operations switch the focus from the clock logo 211 to the dialing logo in the following order: clock logo 211→calendar logo 212→gallery logo 213→memo logo→file management logo→email logo→music logo→calculator logo→video logo→sports health logo→weather logo→browser logo→smart life logo→settings logo→recorder logo→app store logo→camera logo→contact logo→dial logo. Obviously, the efficiency of users finding nodes in the above sliding browsing scenario is low. The user experience of using the screen reading function is poor.

[0076] The present application provides a screen reading method. The electronic device 100 can filter out multiple nodes that the user is most likely to use from the nodes of the user interface according to a preset rule to obtain an important focus list. In response to an operation of switching the focus forward or backward (for example, Figure 1A The downward sliding operation is shown. Figure 1B In other words, when detecting the user's operation of switching the focus forward or backward, the electronic device 100 can read aloud only the description information of the nodes in the important focus list in a skipping manner, without switching the focus among all the nodes in the user interface one by one.

[0077] In response to the user's operation of switching the focus forward or backward, the electronic device 100 can switch the focus to the nodes in the important focus list in sequence according to the order in which the nodes are displayed in the user interface.

[0078] If the node that the user wants to use is in the important focus list, since the electronic device 100 can skip the nodes that are not in the important focus list, the user can find the node that the user wants to use by switching the focus forward or backward fewer times. The above method can improve the efficiency of users finding nodes in the sliding browsing scene and improve the user's experience of using the screen reading function.

[0079] The specific process of filtering nodes based on the preset rules to obtain the important focus list will be introduced in the subsequent embodiments, but will not be expanded here.

[0080] The structure of the electronic device 100 involved in this application is introduced below.

[0081] The electronic device 100 may be a mobile phone, a tablet computer, a laptop computer, a smart watch, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. The specific type of the electronic device 100 is not limited in the embodiment of the present application.

[0082] Figure 2 The schematic diagram of the hardware structure of the electronic device 100 is exemplarily shown.

[0083] like Figure 2 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0084] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0085] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0086] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0087] The processor 110 may also be provided with a memory for storing instructions and data. In some examples, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0088] In the present application, a computer program may be stored in the memory, which is used to enable a controller or a processor to implement the screen reading method of the present application through an interface or a protocol. Exemplarily, the computer program stored in the memory can be used to: traverse the nodes on the user interface and obtain node features, identify user operations acting on the screen, determine the node where the focus is, read the description information of the node where the focus is, filter based on preset rules to obtain an important focus list of the user interface, switch the focus according to the important focus list, etc.

[0089] The USB interface 130 is an interface that complies with the USB standard. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and a peripheral device. The USB interface 130 can also be used to connect an earphone to play audio through the earphone.

[0090] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While the charging management module 140 charges the battery 142, it can also power the electronic device through the power management module 141.

[0091] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

[0092] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0093] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0094] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.

[0095] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0096] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.

[0097] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

[0098] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0099] The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.

[0100] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0101] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0102] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0103] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0104] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0105] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0106] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some examples, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 170D is used to connect wired headphones.

[0107] The above-mentioned speaker 170A and receiver 170B may belong to the audio output device of the electronic device 100. Not limited to the speaker 170A and receiver 170B, the audio output device of the electronic device 100 may also include other devices for playing audio. The above-mentioned microphone 170C may belong to the audio input device of the electronic device 100. Not limited to the microphone 170C, the audio input device of the electronic device 100 may also include other devices for collecting sound signals.

[0108] The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a gravity sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0109] The buttons 190 include a power button, a volume button, etc. The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, messages, missed calls, notifications, etc.

[0110] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some examples, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0111] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the electronic device 100 is exemplified.

[0112] Figure 3 The software structure block diagram of the electronic device 100 is exemplarily shown.

[0113] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. The system is divided into four layers, from top to bottom: application layer, application framework layer, Android Runtime and system library, and kernel layer.

[0114] The application layer can include a series of application packages.

[0115] like Figure 3 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, short message, barrier-free service, etc. Among them, barrier-free service can be used to turn on or off the screen reading function. Optionally, barrier-free service can also be used to set the speech speed when the electronic device 100 performs screen reading. Barrier-free service can also be used to provide a function of setting nodes on the user interface as important focus or filter focus. Among them, the node set as important focus can be included in the important focus list. The node set as filter focus can be removed from the important focus list. In other words, the user can adjust the nodes included in the important focus list by setting the important focus and / or filter focus, thereby improving the efficiency of finding nodes. In addition, in addition to the important focus or filter focus set by the user, the barrier-free service can also filter the nodes in the user interface according to other preset rules to determine the important focus list. Barrier-free service can also be called barrier-free screen reading service and the like. The embodiments of the present application are not limited to this.

[0116] The application framework layer provides API and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0117] like Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, an activity manager, and the like.

[0118] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0119] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0120] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0121] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0122] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0123] The notification manager enables applications to display notification information in the status bar (such as the pull-down notification bar). It can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0124] The activity manager is responsible for managing activities, starting, switching, and scheduling components in the system, as well as managing and scheduling applications. The activity manager can be called by upper-level applications to open corresponding activities.

[0125] In some embodiments, the application framework layer may further include a gesture recognition module. The gesture recognition module may be used to recognize user operations on the screen of the electronic device 100, such as a single-finger click operation, a single-finger swipe up operation, a single-finger swipe down operation, and the like. The gesture recognition module may send information about the recognized gesture to the accessibility service. The accessibility service may then give corresponding feedback based on the user's gesture, such as switching the focus and reading aloud the description information of the node that is the focus after switching.

[0126] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.

[0127] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0128] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0129] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0130] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0131] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0132] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0133] A 2D graphics engine is a drawing engine for 2D drawings.

[0134] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0135] The following is an introduction to some preset rules provided by this application for determining the important focus list.

[0136] In some embodiments, the electronic device 100 can determine the important focus list based on the important focus and / or filter focus marked by the user in the user interface. The user can mark a part of the nodes on the user interface as important focus and mark another part of the nodes as filter focus according to their own usage needs. The important focus list may include nodes marked as important focus, but does not include nodes marked as filter focus.

[0137] In some embodiments, the user may only mark one or more nodes on the user interface as important focuses without marking a filtering focus. Optionally, the electronic device 100 may determine the nodes in the user interface that are not marked by the user as filtering focuses based on the important focuses marked by the user, and then determine an important focus list based on the important focuses and the filtering focuses.

[0138] Alternatively, the user may only mark one or more nodes on the user interface as filtering focuses without marking important focuses. Optionally, the electronic device 100 may determine nodes in the user interface that are not marked by the user as important focuses based on the filtering focuses marked by the user, and then determine an important focus list based on the important focuses and filtering focuses.

[0139] In this way, the user can mark one or more nodes that he needs to use frequently or wants to use most as important focuses, thereby improving the efficiency of finding the one or more nodes in the sliding browsing scene.

[0140] In some embodiments, the electronic device 100 can also detect the user's usage habits, record the user's usage frequency and / or usage duration of each node in the user interface, and create a high-frequency node library. Among them, the usage frequency of a node can indicate the frequency of operating this node to trigger the electronic device 100 to provide the function corresponding to this node. The usage duration of a node can indicate the duration for which the electronic device 100 provides the function corresponding to a node. For example, a node is an APP identifier of an APP. The APP indicates that it can be used to open this APP. Then, the usage frequency of this APP identifier can be the frequency of the electronic device 100 opening the APP corresponding to the APP identifier. The usage duration of this APP identifier can be the duration for which the APP interface is displayed after the electronic device 100 opens the APP corresponding to the APP identifier.

[0141] The high-frequency node library may include nodes with a usage frequency higher than a preset frequency, and / or may include nodes with a usage duration higher than a preset duration. For example, the preset frequency may be used 5 times a day, or 30 times a month, etc. The usage duration of the node may be the usage duration within a period of time, or may be the total usage duration of the node. The embodiments of the present application do not limit the values ​​of the preset frequency and preset duration.

[0142] The nodes in the high-frequency node library can change dynamically according to changes in user usage habits.

[0143] The electronic device 100 may determine an important focus list based on the high-frequency node library. The electronic device 100 may determine the nodes in the high-frequency node library in the user interface as important focuses and include them in the important focus list. Nodes in the user interface that are not in the high-frequency node library may be filtered focuses. The important focus list may not include nodes that are not in the high-frequency node library.

[0144] Nodes with high frequency of use or long usage time in the user interface are usually the nodes that users are most likely to want to find and use. The electronic device 100 determines the important focus list based on the high-frequency node library, and can skip nodes with low frequency of use or low usage time in the sliding browsing scene, and switch the focus between nodes with high frequency of use or high usage time, thereby improving the efficiency of users finding target nodes.

[0145] In some embodiments, the electronic device 100 may determine one or more nodes as filtering focuses based on the node features of the nodes in the user interface, and remove the one or more nodes determined as filtering focuses when determining the important focus list. Node features may include the number, layout, display style, type, and other features of the sub-nodes contained in the node. Exemplarily, when there are multiple nodes with a parallel relationship in the user interface, the electronic device 100 may determine whether there are a few nodes that contain sub-nodes that are different from the majority of nodes in one or more features such as the number, layout, display style, and type based on the node features of the multiple nodes. If so, the electronic device 100 may determine these few nodes as filtering focuses.

[0146] In the user interface of some apps, a few nodes that are different from the majority of nodes in terms of node characteristics can be called abnormal nodes. There is a high probability that the abnormal nodes are nodes corresponding to advertising information. The electronic device 100 determines the abnormal nodes as filtering focuses and can skip the abnormal nodes when switching the focus in the sliding browsing scene. This can reduce the interference of advertising information on the user's search for nodes and improve the efficiency of users in finding target nodes in the sliding browsing scene.

[0147] It can be seen that the preset rules for determining the important focus list may include one or more of the following: screening of important focus and / or filter focus based on user marking, screening based on a high-frequency node library, and screening based on node features of nodes in the user interface. When determining the important focus list, the electronic device 100 may filter out nodes that are filter focuses on the user interface. The filter focus may be set by the user, or determined based on a high-frequency node library, or determined based on node features.

[0148] The embodiments of the present application do not limit the above-mentioned preset rules. In addition to the above-mentioned methods for determining the important focus list, the electronic device 100 may also use other methods to determine the important focus list to improve the efficiency of the user in finding nodes.

[0149] It should be noted that, among the above-mentioned preset rules, the rules for screening important focuses and / or filtered focuses marked by users may have the highest priority among all the rules.

[0150] For example, if a node is marked as an important focus by the user but the node is not in the high-frequency node library, the electronic device 100 can still include the node in the important focus list.

[0151] If a node is marked as a filtering focus by the user but this node is in the high-frequency node library, this node may not be included in the important focus list.

[0152] If a node is marked as an important focus by the user but the electronic device 100 determines the node as a filtering focus based on the node characteristics of the node, the electronic device 100 can still include the node in the important focus list. Optionally, the electronic device 100 can also include other nodes in the user interface whose node characteristics are consistent with the node characteristics of the node in the important focus list.

[0153] If a node is marked as a filtering focus by the user but the electronic device 100 does not determine the node as a filtering focus according to the node characteristics of the node, the important focus list may not include the node. Optionally, the important focus list may not include other nodes with the same characteristics as the node.

[0154] In some embodiments, the order in which the nodes in the important focus list are arranged can be consistent with the order in which the nodes are displayed in the user interface. For example, the order in which the nodes are displayed in the user interface can be determined from left to right and from top to bottom according to the display position. If the display position of a node in the important focus list is before the display position of another node, then the node is arranged before the other node in the important focus list. The order in which the nodes in the important focus list are arranged is the order in which the electronic device 100 switches focus according to the important focus list, that is, the order in which the nodes in the important focus list are arranged is the order in which the nodes in the important focus list are traversed and selected as the focus in sequence. The above-mentioned ordering of the nodes in the important focus list according to the order in which the nodes are displayed in the user interface can reduce the impact of skipping one or more nodes when switching focus on the user's cognitive page layout.

[0155] Figure 4A to Figure 4F Schematic diagrams of some scenarios in which users set important focus and filter focus are exemplified.

[0156] like Figure 4A As shown, the electronic device 100 may display a user interface 410. The user interface 410 may be a user interface for setting an application. The user interface 410 may include an accessibility option 411. In response to an operation on the accessibility option 411, the electronic device 100 may display Figure 4B User interface 420 is shown.

[0157] like Figure 4B As shown, the user interface 420 may include a screen reading switch control 421 , a speech speed control 422 , a voice control 423 , a shortcut gesture control 424 , and a smart skip switch control 425 .

[0158] The screen reading switch control 421 can be used to turn on or off the screen reading function. The screen reading function can also be called an accessibility mode or the like. For example, the screen reading switch control 421 is in Figure 4B The off state shown may indicate that the screen reading function is currently off. Figure 4B In the off state shown, in response to an operation on the screen reading switch control 421, such as a click operation, the electronic device 100 can turn on the screen reading function. After the screen reading function is turned on, when the focus is the screen reading switch control 421, the electronic device 100 can turn off the screen reading function in response to an operation to turn on the selected focus (such as a single-finger double-click on the screen).

[0159] The speech rate control 422 may be used to adjust the speed at which the electronic device 100 reads the node description information after the screen reading function is turned on.

[0160] The voice control 423 may be used to trigger the electronic device 100 to display options for voice features (such as timbre, language, etc.) for reading the node description information, so that the user can make a selection.

[0161] The quick gesture control 424 may be used to trigger the electronic device 100 to display one or more functions that can be triggered by user operations after the screen reading function is turned on.

[0162] The smart skip switch control 425 can be used to turn on or off the smart skip function. When the smart skip function is turned on, the electronic device 100 can determine the important focus list of the user interface currently displayed on the screen according to preset rules. When the user's operation of switching the focus forward or backward is detected, the electronic device 100 can read aloud only the description information of the nodes in the important focus list in a skipping manner, without switching the focus one by one among all the nodes in the user interface. When the smart skip function is turned off, the electronic device 100 can switch the focus one by one among all the nodes in the user interface in response to the operation of switching the focus forward or backward, according to the arrangement order of the nodes on the user interface (for example, from left to right, from top to bottom).

[0163] It can be seen that users can manually turn on and off the smart skip function.

[0164] like Figure 4B As shown, in response to the operation of the shortcut gesture control 424, the electronic device 100 may display Figure 4C The user interface 430 shown in FIG. 4 may display an introduction to functions that may be triggered by one or more user operations after the screen reading function is turned on in the electronic device 100. This may help the user understand how to use the electronic device 100 when the screen reading function is turned on.

[0165] Exemplarily, the user operation of "single-finger tap once" can be used to trigger the electronic device 100 to read the focus. The user operation of "single-finger tap twice" can be used to trigger the electronic device 100 to turn on the selected focus. The user operation of "single-finger swipe up" (i.e., single-finger slide up) can be used to trigger the electronic device 100 to switch the previous focus. The user operation of "single-finger swipe down" (i.e., single-finger slide down) can be used to trigger the electronic device 100 to switch the next focus. The user operation of "single-finger first slide up and then left" can be used to trigger the electronic device 100 to mark the currently selected node as an important focus. The user operation of "single-finger first slide up and then right" can be used to trigger the electronic device 100 to mark the currently selected node as a filtered focus. The above user operations are only exemplary descriptions of the present application and should not be construed as limiting the present application. The user interface 430 can also list more or fewer gesture introductions for operating the electronic device 100 when the electronic device 100 turns on the screen reading function. For example, the user operation for controlling the electronic device 100 can also include a user operation for canceling an important focus or a filtered focus mark. In this way, the user can also manually cancel the important focus mark or the filtered focus mark of the node. For another example, the operation for triggering the electronic device 100 to mark the currently selected node as an important focus may also include the operation of tapping the side of the electronic device 100 twice.

[0166] like Figure 4D As shown, the electronic device 100 may display a user interface 440. The user interface 440 may be the desktop of the electronic device 100. The user interface 440 may include a mark box 441 and a sports health logo 442. The screen reading function of the electronic device 100 is currently turned on. Among them, the mark box 441 is currently located at the position where the sports health logo 442 is located, which may indicate that the current focus is the sports health logo 442. In response to Figure 4D In the operation of sliding one finger downward and then to the left, the electronic device 100 can mark the sports health indicator 442 as an important focus, and announce "sports health has been marked as an important focus" by voice. In this way, the user can know that the sports health indicator 442 has been marked as an important focus through the content of the above voice announcement.

[0167] like Figure 4E As shown, the electronic device 100 may display a user interface 440. The user interface 440 may include an email identifier 443. The mark box 441 is currently located at the position where the email identifier 443 is located, which may indicate that the current focus is the email identifier 443. Figure 4E In the operation of sliding one finger downward and then to the right, the electronic device 100 can mark the email identifier 443 as the filtering focus, and announce "The email identifier has been marked as the filtering focus" by voice. In this way, the user can know that the email identifier 443 has been marked as the filtering focus through the content of the above voice announcement.

[0168] Not limited to marking application logos on the desktop, users can also mark nodes in the user interface of the APP.

[0169] like Figure 4F As shown, the electronic device 100 may display a user interface 450. The user interface 450 may be a user interface of a video application. The user interface 450 may include a marking box 451. The marking box 451 is currently located at the position where the animation option is located, which may indicate that the current focus is the animation option. The above animation option may be used to trigger the video application to call out the user interface corresponding to the animation option. In response to Figure 4F In the operation of sliding one finger downward and then to the right, the electronic device 100 can mark the animation option as the filter focus and announce “the animation has been marked as the filter focus” by voice. In this way, the user can know that the animation option has been marked as the filter focus through the content of the voice announcement.

[0170] like Figure 4F As shown, the previous node of the animation option is the hot option. The next node of the animation option is the film and television option. In the case where the animation option is the filter focus, if the current focus is the hot option, in response to the operation of switching the next focus (such as swiping down with one finger), the electronic device 100 can skip the animation option, switch the focus to the film and television option, and voice broadcast the description information of the film and television option (such as "film and television").

[0171] Above Figure 4D to Figure 4F The content of the voice broadcast shown is only an exemplary description of the present application and should not constitute a limitation on the present application.

[0172] In some embodiments, in response to the operations of marking important focus and marking filtering focus, the electronic device 100 may store information of nodes marked as important focus and information of nodes marked as filtering focus. When displaying a user interface, the electronic device 100 may traverse the nodes in the user interface to determine which nodes in the user interface are marked as important focus and which nodes are marked as filtering focus.

[0173] Here Figure 4F The user interface 450 shown is used as an example to introduce a method for the electronic device 100 to determine a node as a filtering focus according to node characteristics.

[0174] like Figure 4FAs shown, the user interface 450 may include nodes 452 to 457. Not limited to nodes 452 to 457, the user interface 450 may also include more nodes. For example, in response to the operation of sliding the content displayed in the user interface 450 upward, the electronic device 100 may also display more nodes after nodes 456 and 457. Among them, the currently partially or completely hidden display nodes after nodes 456 and 457 may all belong to the nodes of the user interface 450. Here, nodes 452 to 457 are taken as an example for explanation.

[0175] The electronic device 100 may traverse the nodes in the user interface 450 and obtain node features of the nodes. For example, the electronic device 100 may obtain node features of nodes 452 to 457. Nodes 452 to 457 may be nodes in a parallel relationship.

[0176] Node 452 can be used to trigger the electronic device 100 to play the video corresponding to node 452. Node 452 can include 4 subnodes: subnode 452A, subnode 452B, subnode 452C, and subnode 452D. Subnode 452A can be a picture and is displayed in the upper position of node 452. Subnode 452B can be the name of the video corresponding to node 452 (e.g., "Video 1"), which is displayed below subnode 452A and aligned to the left. Subnode 452C can be the avatar of the publisher of the video corresponding to node 452, which is displayed below subnode 452B and aligned to the left. Subnode 452D can be the name of the publisher of the video corresponding to node 452 (e.g., "User 1"), which is displayed to the right of subnode 452C and aligned to the left.

[0177] Node 453, node 454, node 456 and node 457 can all be used to trigger the electronic device 100 to play their corresponding videos. Figure 4F It can be seen that the number, layout, display style and type of child nodes contained in nodes 453 , 454 , 456 and 457 are the same as those of node 452 .

[0178] However, node 455 is a node corresponding to an advertisement information, which is used to trigger the electronic device 100 to display a user interface corresponding to the advertisement information (e.g., advertisement information of XX game). Node 455 may include 4 subnodes: subnode 455A, subnode 455B, subnode 455C, and subnode 455D. Subnode 455A may be a picture, and is displayed in the upper position of node 452. Subnode 455B may be the theme name of the advertisement information (e.g., "XX game"), which is displayed below subnode 455A, centered, and displayed in bold font. Subnode 455C may be an identifier of the advertisement information (e.g., "game"), which may be used to indicate that node 455 is a node corresponding to a game advertisement. Subnode 455C is displayed below subnode 455B and is aligned to the left. Subnode 455D may be the publisher name of the advertisement information (e.g., "aa company"), which is displayed to the right of subnode 455C and is aligned to the right.

[0179] It can be seen that although node 455 contains the same number of subnodes as node 452, the layout of the subnodes in node 455 is different from the layout of the subnodes in nodes 452 to 454, node 456, and node 457, and the display style of the subnodes in node 455 is also different from the display style of the subnodes in nodes 452 to 454, node 456, and node 457. Therefore, node 455 may be an abnormal node in user interface 450. Electronic device 100 may determine node 455 as a filtering focus. When the current focus is node 454, in response to the operation of switching the next focus, electronic device 100 may skip node 455 and switch the focus to node 456. In this way, when a user searches for a node in user interface 450 by switching the next focus, electronic device 100 may skip advertising information, thereby improving the efficiency of the user in finding the target node.

[0180] In some embodiments, there are multiple nodes with a parallel relationship in the user interface. The electronic device 100 can divide these multiple nodes into multiple categories according to different node features. Among them, nodes with the same node features (for example, the nodes contain the same number of sub-nodes, and the layout, display style, and type of the sub-nodes are the same) can be divided into one category. The electronic device 100 can determine whether the ratio of the number of nodes in a category with the largest number of nodes to the number of nodes in other categories is higher than a preset ratio. If the ratio of the number of nodes in a category with the largest number of nodes to the number of nodes in another category is higher than a preset ratio, the electronic device 100 can determine the nodes in this other category as the filtering focus.

[0181] It can be understood that the ratio of the number of nodes in a category with the largest number of nodes to the number of nodes in another category is higher than the preset ratio, which can indicate that the nodes in the other category in the user interface are in the minority and are more likely to be nodes corresponding to advertising information.

[0182] For example, the electronic device 100 divides a plurality of nodes having a parallel relationship in the user interface into a plurality of categories according to different node characteristics. The plurality of categories include category C1 and category C2. Category C1 is the category with the largest number of nodes among the plurality of categories, including n1 nodes. Category C2 includes n2 nodes. If the value of n1:n2 is higher than a preset ratio, the electronic device 100 may determine the n2 nodes as filtering focuses. The n2 nodes may not be included in the important focus list. The embodiments of the present application do not limit the above-mentioned preset ratio. For example, the preset ratio may be 3 or 4, etc.

[0183] The above embodiment is merely an example of a method for determining an important focus list based on node features provided by the present application and shall not constitute a limitation to the present application.

[0184] In some embodiments, if a node determined as a filtering focus based on node features is marked as an important focus by the user, the electronic device 100 may prioritize the user's mark and include the node as an important focus in the important focus list. Figure 4F The position of the node 455 shown is used to select the node 455 and mark the node 455 as an important focus. The electronic device 100 can add the node 455 to the important focus list of the user interface 450. Figure 4F When the user is at node 454, in response to the operation of switching the next focus, the electronic device 100 can switch the focus to node 455 and voice broadcast the description information of node 455. This can avoid skipping the node that the user wants to find when switching the focus in the sliding browsing scene, and improve the efficiency of the user in finding the target node.

[0185] In some embodiments, the above-mentioned rule of obtaining an important focus list based on node feature screening can be applied to one or more applications in the electronic device 100 .

[0186] Figure 5 A flowchart of a method for determining an important focus list provided by the present application is exemplified.

[0187] like Figure 5 As shown, the electronic device 100 can determine an important focus list of a user interface according to the important focus and / or filtering focus marked by the user, the high-frequency node library, and the filtering focus determined based on the node characteristics.

[0188] S511 , traverse the nodes in user interface 1 .

[0189] The user interface 1 may be, for example, the aforementioned Figure 4D The desktop shown, or the aforementioned Figure 4FThe user interface of the APP (such as a video application, etc.) shown in the figure. The embodiment of the present application does not limit the type of the user interface 1.

[0190] S512. Determine an important focus list of user interface 1, where the important focus list includes nodes in user interface 1 that are marked as important focuses by the user and nodes in the high-frequency node library, and does not include nodes in user interface 1 that are filter focuses and nodes that are not marked by the user and are not in the high-frequency node library.

[0191] The electronic device 100 can determine which nodes in the user interface 1 are marked as important focuses by the user, and / or which nodes are marked as filtering focuses by the user. The electronic device 100 can also determine which nodes of the user interface 1 exist in the high-frequency node library. The electronic device 100 can include the nodes in the user interface 1 that are marked as important focuses by the user, and the nodes in the high-frequency node library into the important focus list. In addition, when determining the important focus list, the electronic device 100 can eliminate the nodes in the user interface 1 that are filtering focuses, and the nodes that are not marked by the user and are not in the high-frequency node library. Among them, the method for users to mark important focuses and filtering focuses, and the method for determining filtering focuses based on node features can refer to the introduction of the aforementioned embodiments.

[0192] This can ensure that the nodes in the important focus list are the nodes that the user is most likely to find and use in the user interface 1. In the sliding browsing scenario, the electronic device 100 switches the focus according to the important focus list to improve the efficiency of the user in finding the target node, thereby improving the user's experience of using the screen reading function.

[0193] The following describes the screen reading scenario provided by the embodiment of the present application, taking switching focus on the desktop of the electronic device 100 as an example for explanation.

[0194] Figure 6A to Figure 6F Some schematic diagrams of screen reading scenarios are shown as examples.

[0195] like Fig. 6A As shown, the electronic device 100 can display a user interface 610. The user interface 610 is the desktop of the electronic device 100. The user interface 610 can refer to the aforementioned Figure 1A Nodes in the user interface 610 may include: a clock logo 612, a music logo 613, a sports health logo 614, and a dial logo 615. The user interface 610 may also include APP logos of other APPs. Among them, on the user interface 610, in the order from left to right and from top to bottom, the display position of the clock logo 612 is in front of the music logo 613, the display position of the music logo 613 is in front of the sports health logo 614, and the display position of the sports health logo 614 is in front of the dial logo 615.

[0196] When the screen reading function is turned on, the user interface 610 may further include a marking box 611. Fig. 6A As shown, the mark box 611 is currently located at the position where the clock mark 612 is located, which can indicate that the current focus is the clock mark 612.

[0197] The electronic device 100 can traverse the nodes in the user interface 610 and filter the nodes in the user interface 610 according to the preset rules to determine the important focus list of the user interface 610. The above method of determining the important focus list according to the preset rules can refer to the introduction of the above embodiment. For example, the important focus list of the user interface 610 can be Fig. 6A The important focus list 621 shown. The important focus list 621 may include nodes: music (i.e., music identifier 613), sports and health (i.e., sports and health identifier 614), and dialing (i.e., dialing identifier 615). The order of arrangement of the nodes in the important focus list 621 may be consistent with the order of the nodes displayed in the user interface 610.

[0198] The important focus list 621 is merely an exemplary description of the present application and should not constitute a limitation on the present application.

[0199] In response to Fig. 6A In the operation of sliding downward (or swiping) with one finger, the electronic device 100 can search for a node that is located after the current focus (i.e., the clock mark 612), is closest to the current focus, and is located in the important focus list 621. It can be seen that the music mark 613 is a node that is located after the clock mark 612 in the important focus list 621 and is closest to the clock mark 612. Therefore, the electronic device 100 can directly switch the focus from the clock mark 612 to the music mark 613.

[0200] In response to Fig. 6A The electronic device 100 can display the single finger downward sliding operation shown in FIG. Figure 6B The user interface 610 is shown, and the voice announces "Music". Fig. 6A and Figure 6B It can be seen that the display position of the mark box 611 is determined by Fig. 6A The position of the clock mark 612 shown changes to Figure 6BThe position of the music identifier 613 is shown. This can indicate that the focus has been switched from the clock identifier 612 to the music identifier 613. The content "music" voice broadcasted by the electronic device 100 is the description information of the music identifier 613. In this way, the user can determine that the current music identifier 613 is in a selected state and the current focus is the music identifier 613 based on the content voice broadcasted by the electronic device 100. It can be seen that in response to an operation for switching the next focus, the electronic device 100 can skip the node between the clock identifier 612 and the music identifier 613 and switch the focus to the node in the important focus list 621.

[0201] In some embodiments, when the electronic device 100 calls up the user interface 610, the initial focus may be determined as a node in the important focus list 621. For example, in response to the operation of calling up the user interface 610, the electronic device 100 may display the user interface 610, and determine the focus as the first node in the important focus list 621: the music identifier 613, and voice broadcast the description information of the music identifier 613.

[0202] Further, in response to Figure 6B As shown in the single-finger downward sliding operation, the electronic device 100 can continue to switch the focus according to the important focus list 621.

[0203] In the current focus Figure 6B When the music mark 613 is shown, in response to Figure 6B The electronic device 100 can display the single-finger downward sliding operation shown in FIG. Figure 6C The user interface 610 shown in the figure is displayed, and the voice broadcast "exercise health" is announced. Figure 6B and Figure 6C It can be seen that the display position of the mark box 611 is determined by Figure 6B The position of the music logo 613 shown changes to Figure 6C The position of the sports health logo 614 is shown. This can indicate that the focus has been switched from the music logo 613 to the sports health logo 614. The sports health logo 614 is the next node of the music logo 613 in the important focus list 621. The content "sports health" voice broadcasted by the electronic device 100 is the description information of the sports health logo 614. In this way, the user can determine that the current sports health logo 614 is in the selected state and the current focus is the sports health logo 614 based on the content of the voice broadcast of the electronic device 100.

[0204] In some embodiments, when the current focus is a node in the important focus list 621, in response to the operation of switching the next focus or switching the previous focus, the electronic device 100 can switch the focus according to the important focus list 621. If the current focus is not a node in the important focus list 621, in response to the operation of switching the next focus or switching the previous focus, the electronic device 100 can switch the focus according to the front-to-back order of the node display positions in the user interface 610.

[0205] For example, if the current focus is Fig. 6A In response to an operation of switching the next focus (such as a single-finger downward sliding operation), the electronic device 100 may switch the focus to Fig. 6A Since the electronic device 100 can determine that the clock mark 612 is not in the important focus list, the electronic device 100 can switch the focus to the next node after the clock mark 612 in the user interface 610, that is, the calendar mark. Fig. 6A In response to the operation of switching the next focus, the electronic device 100 may switch the focus to Fig. 6A The sports health mark 614 is shown. Since the electronic device 100 can determine that the music mark 613 is in the important focus list 621, the electronic device 100 can switch the focus to the next node of the music mark 613 in the important focus list 621, that is, the sports health mark 614.

[0206] In the current focus Figure 6C When the sports health mark 614 is shown, in response to Figure 6C The electronic device 100 can display the single-finger downward sliding operation shown in FIG. Fig.6D The user interface 610 shown in FIG. 1 is displayed, and the voice broadcast "Dial" is announced. Figure 6C and Fig.6D It can be seen that the display position of the mark box 611 is determined by Figure 6C The position of the sports health logo 614 shown changes to Fig.6D The position of the dial mark 615 is shown. This can indicate that the focus has been switched from the sports health mark 614 to the dial mark 615. The dial mark 615 is the next node of the sports health mark 614 in the important focus list 621. The content "Dial" voice broadcasted by the electronic device 100 is the description information of the dial mark 615. In this way, the user can determine that the current dial mark 615 is in the selected state and the current focus is the dial mark 615 according to the content of the voice broadcast of the electronic device 100.

[0207] In the current focus Fig.6D When the dialing mark 615 is shown, in response to Fig.6DThe electronic device 100 can display the single finger downward sliding operation shown in FIG. Fig. 6E The user interface 610 is shown, and the voice announces "Music". Fig.6D and Fig. 6E It can be seen that the display position of the mark box 611 is determined by Fig.6D The position of the dial mark 615 shown changes to Fig. 6E The position of the music mark 613 is shown. This may indicate that the focus has been switched from the dial mark 615 to the music mark 613. The content "music" voice broadcasted by the electronic device 100 is the description information of the music mark 613. In this way, the user can determine that the current music mark 613 is in the selected state and the current focus is the music mark 613 according to the content voice broadcasted by the electronic device 100.

[0208] Among them, the dialing mark 615 is the last node in the important focus list 621. The music mark 613 is the first node in the important focus list 621. In response to the operation of switching the focus to the next node of the dialing mark 615, the electronic device 100 can cycle through the important focus list 621 and switch the focus to the first node in the important focus list 621, that is, the music mark 613. That is to say, in the sliding browsing scenario, the electronic device 100 can switch the focus between the nodes in the important focus list 621.

[0209] like Fig. 6E As shown, in response to a single-finger tap on the location of the file management mark 616, the electronic device 100 can switch the focus to the file management mark 616. When the focus is switched to the file management mark 616, the electronic device 100 can display Fig. 6F The user interface 610 shown in FIG. 1 is displayed, and the voice broadcast "File Management" is displayed. Fig. 6E and Fig. 6F It can be seen that the display position of the mark box 611 is determined by Fig. 6E The position of the music logo 613 shown changes to Fig. 6F The location of the file management identifier 616 is shown. This can indicate that the focus has been switched from the music identifier 613 to the file management identifier 616. The content "file management" announced by the electronic device 100 is the description information of the file management identifier 616. In this way, the user can determine that the current file management identifier 616 is in a selected state and the current focus is the file management identifier 616 based on the content announced by the electronic device 100. It can be seen that although the focus in the sliding browsing scene is switched between the nodes in the important focus list 621, the user can still switch the focus to a node that is not in the important focus list 621 by clicking the screen.

[0210] As can be seen from the above scenario, the user can choose the method of finding nodes in the user interface as needed. If the node that the user wants to find exists in the important focus list, the user can trigger the electronic device 100 to switch the focus according to the important focus list by switching the next focus or the previous focus, so as to quickly find the node he needs. If the user wants to find a node outside the important focus list, the user can click at the corresponding position on the screen based on his perception of the page layout to find the target node.

[0211] In addition, users who cannot see or cannot see the screen clearly can rely on the electronic device 100 to voice broadcast the description information of each node to establish their own cognition of the page layout. For example, in the sliding browsing scene, the user switches the next focus one by one, and the electronic device 100 switches the focus one by one and voice broadcasts the description information of the node after switching. Usually the user thinks that the node corresponding to the description information heard later is located after the node corresponding to the description information heard earlier on the user interface. The user can roughly understand the distribution of each node on the user interface based on the information he hears. The order of arrangement of nodes in the important focus list in this application is consistent with the order in which the nodes are displayed in the user interface. In this way, even if one or more nodes on the user interface are skipped when switching the focus according to the important focus list, the order of switching the focus still conforms to the order in which the nodes are displayed in the user interface. This can reduce the impact of skipping one or more nodes on the user's cognition of the page layout when switching the focus, and facilitate the user to find nodes that are not in the important focus list according to their cognition of the page layout.

[0212] In some embodiments, in the sliding browsing scenario, after the electronic device 100 switches the focus and traverses the nodes in the important focus list, the electronic device 100 can switch the focus between the nodes that are not in the important focus list on the user interface according to the order in which the nodes are displayed in the user interface. Figure 6B to Figure 6D , the electronic device 100 can switch the focus to the music mark 613, the sports health mark 614, and the dial mark 615 in sequence according to the important focus list 621. Then, when the current focus is the dial mark 615, in response to the operation of switching the next focus, the electronic device 100 can switch the focus to the information mark according to the order of the node display positions in the user interface 610, and voice broadcast the description information of the information mark. The information mark is the next node displayed after the dial mark 615 in the user interface 610. When the focus is switched to Figure 6BAfter the information logo, clock logo 612, calendar logo, gallery logo, memo logo, file management logo, and email logo in the user interface 610 shown, in response to the operation of switching the next focus, the electronic device 100 can skip the music logo 613 located in the important focus list 621, switch the focus to the calculator logo, and voice broadcast the description information of the computer logo.

[0213] Optionally, the electronic device 100 may also traverse the nodes in the important focus list in sequence starting from the non-first node in the important focus list and select them as the focus. For example, the electronic device 100 traverses the nodes in the important focus list 621 starting from the dialing mark 615 in the important focus list 621. The electronic device 100 may switch the focus from the dialing mark 615 to the music mark 613 and the sports health mark 614 in sequence according to the sequence of the nodes in the important focus list 621. After the nodes in the important focus list 621 are traversed and selected as the focus in sequence, the sports health mark 614 is the last node selected as the focus in the important focus list 621. When the current focus is the sports health mark 614, in response to the operation of switching the next focus, the electronic device 100 may switch the focus to the weather mark according to the sequence of the node display positions in the user interface 610, and voice broadcast the description information of the weather mark. The weather mark is the next node displayed after the sports health mark 614 in the user interface 610.

[0214] It is understandable that after the electronic device 100 traverses the nodes in the important focus list 621 in the sliding browsing scenario, it continues to receive the operation of switching the next focus or switching the previous focus, which can indicate that the node the user wants to find is not in the important focus list. The electronic device 100 can continue to skip the important focus list 621 according to the operation of switching the focus in the sliding browsing scenario, and switch the focus between the nodes that are not in the important focus list 621 on the user interface. This can reduce the situation where a node is repeatedly determined as the focus, and improve the efficiency of the user in finding nodes.

[0215] In some embodiments, in a sliding browsing scenario, after the electronic device 100 switches focus to traverse the nodes in the important focus list, the electronic device 100 can switch the focus between all the nodes on the user interface according to the order in which the nodes are displayed in the user interface.

[0216] Figure 7 The following is a flowchart of a screen reading method provided by an embodiment of the present application.

[0217] like Figure 7 As shown, the screen reading method may include steps S711 to S716.

[0218] S711 , when the screen reading function is turned on, the electronic device 100 currently displays the user interface 1 , and the current focus is the node 1 on the user interface 1 .

[0219] The user interface 1 may be, for example, the aforementioned Fig. 6A The user interface 610 shown in the figure. The embodiment of the present application does not limit the user interface 1. Node 1 can be a node in the important focus list of the user interface 1, or it can also be a node outside the important focus list of the user interface 1. For example, node 1 can be the aforementioned Fig. 6A The clock mark 612 shown, or the aforementioned Figure 6B Music logo 613 is shown.

[0220] S712: The electronic device 100 receives operation 1 on the user interface 1, where operation 1 is used to switch the focus backward.

[0221] Switching the focus backwards means switching the next focus. For example, operation 1 may be the aforementioned Fig. 6A The operation of sliding one finger downward is shown.

[0222] S713. In response to operation 1, the electronic device 100 searches for node 2 which is located after node 1, is ranked closest to node 1 and is located in an important focus list. The important focus list can be obtained by filtering the electronic device 100 from the nodes included in the user interface 1 based on preset rules.

[0223] The above-mentioned sorting closest to node 1 may mean closest to node 1 in the order in which the nodes are displayed in user interface 1. For example, the order in which the nodes are displayed in user interface 1 may be determined from left to right and from top to bottom according to the display positions.

[0224] S714 : The electronic device 100 switches the focus from node 1 to node 2 , and reads the description information of node 2 aloud.

[0225] The above scenario of switching the focus from node 1 to node 2 can refer to the above Fig. 6A and Figure 6B The scene shown is one in which the focus is switched from the clock logo 612 to the music logo 613 .

[0226] S715: The electronic device 100 receives an operation 2 on the user interface 1, where the operation 2 is used to select a node 3, and the node 3 is not in the important focus list.

[0227] For example, the above operation 2 can be the above Fig. 6E The single-finger click operation is shown.

[0228] S716 . In response to operation 3 , the electronic device 100 switches the focus from node 2 to node 3 , and reads aloud the description information of node 3 .

[0229] It can be seen that the user can switch the focus to a node that is not in the important focus list by selecting the node that is not in the important focus list.

[0230] By the above Figure 7 As can be seen from the method shown, in the sliding browsing scenario, the electronic device 100 can switch the focus according to the important focus list of the user interface. The important focus list may include nodes that the user is most likely to want to find and use, which are filtered by the electronic device 100 according to preset rules. In this way, in the sliding browsing scenario, the electronic device 100 can help the user quickly find the target node by skipping, thereby improving the efficiency of the user in finding the target node.

[0231] It is understandable that the various user interfaces described in the embodiments of the present application are only example interfaces and do not limit the present application scheme. In other embodiments, the user interface may adopt a different interface layout, may include more or fewer controls, and may increase or decrease other functional options, as long as they are based on the same inventive concept provided by the present application, they are all within the scope of protection of the present application.

[0232] It should be noted that, without causing any contradiction or conflict, any feature in any embodiment of the present application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of the present application.

[0233] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A screen reading method, It is characterized in that The method is applied to an electronic device, the screen reading function of the electronic device is turned on, and the method includes: The electronic device displays a first interface, and a first node in the first interface is selected as a focus; The electronic device receives a first operation, where the first operation is used to switch a next focus; In response to the first operation, the electronic device skips the second node in the first interface according to the first list associated with the first interface, switches the focus from the first node to the third node in the first interface, and reads aloud the description information of the third node; the first list includes one or more nodes in the first interface, the first list includes the third node but does not include the second node, the first node in the first interface is displayed before the second node, and the second node is displayed before the third node.

2. The method according to claim 1, It is characterized in that The order in which the nodes in the first list are traversed and selected as the focus is consistent with the order in which the nodes in the first list are displayed in the first interface.

3. The method according to claim 1 or 2, It is characterized in that The order in which the nodes in the first list are traversed and selected as the focus is irrelevant to the usage frequency of the nodes in the first list.

4. The method according to any one of claims 1 to 3, It is characterized in that The first list includes the first node, and the third node is a next node of the first node in the first list.

5. The method according to claim 4, It is characterized in that The method further comprises: The electronic device receives a second operation, where the second operation is used to switch the previous focus; In response to the second operation, the electronic device skips the second node according to the first list, switches the focus from the third node to the first node, and reads aloud the description information of the first node.

6. The method according to any one of claims 1 to 5, It is characterized in that The method further comprises: The electronic device receives a third operation, where the third operation is used to mark k1 nodes in the first interface as important focuses, where k1 is a positive integer; The electronic device determines the first list according to the third operation, where the first list includes the k1 nodes.

7. The method according to any one of claims 1 to 6, It is characterized in that The method further comprises: The electronic device receives a fourth operation, where the fourth operation is used to mark k2 nodes in the first interface as filtering focuses, where k2 is a positive integer; The electronic device determines the first list according to the fourth operation, and the first list does not include the k2 nodes.

8. The method according to any one of claims 1 to 7, It is characterized in that The method further comprises: The electronic device determines the first list according to the usage frequency of nodes in the first interface, wherein the first list includes nodes in the first interface whose usage frequency is higher than a first frequency, and does not include nodes in the first interface whose usage frequency is not higher than the first frequency.

9. The method according to any one of claims 1 to 8, It is characterized in that The first interface includes k3 nodes in a parallel relationship, k3 is a positive integer, and the method further includes: The electronic device determines the first list based on the node characteristics of the nodes in the first interface, wherein k4 nodes are a group of nodes with the same node characteristics and the largest number of nodes among the k3 nodes, the k3 nodes also include k5 nodes, the node characteristics of the k5 nodes are different from the node characteristics of the k4 nodes, the first list does not include the k5 nodes, and k4 and k5 are both positive integers less than k3.

10. The method according to claim 9, It is characterized in that The k4 nodes are nodes corresponding to non-advertisement information, and the k5 nodes are nodes corresponding to advertisement information.

11. The method according to any one of claims 1 to 10, It is characterized in that The first node in the first list is the fourth node, the last node in the first list is the fifth node, and the fifth node is selected as the focus; the method further includes: The electronic device receives an operation for switching the next focus, switches the focus from the fifth node to the fourth node according to the first list, and reads aloud the description information of the fourth node, and the fourth node is displayed before the fifth node in the first interface.

12. The method according to any one of claims 1 to 10, It is characterized in that After the nodes in the first list are traversed in sequence and selected as the focus, the method further includes: The electronic device receives an operation for switching the next focus, switches the focus to a sixth node in the first interface, and reads aloud description information of the sixth node, wherein the first list does not include the sixth node.

13. The method according to claim 12, It is characterized in that The focus is switched from the seventh node in the first list to the sixth node, and the sixth node is the first node displayed in the first interface after the seventh node that is not in the first list.

14. The method according to any one of claims 1 to 13, It is characterized in that The method further comprises: The electronic device receives a fifth operation, where the fifth operation is used to select an eighth node in the first interface; In response to the fifth operation, the electronic device switches focus to the eighth node and reads aloud description information of the eighth node.

15. The method according to claim 14, It is characterized in that The first list does not include the eighth node.

16. An electronic device, It is characterized in that The electronic device includes a screen, an audio output device, a memory and a processor, wherein the screen is used to display a first interface; the audio output device is used to read aloud the description information of the node selected as the focus in the screen; the memory is used to store a computer program; and the processor is used to call the computer program so that the electronic device executes the method described in any one of claims 1 to 15.

17. A computer-readable storage medium storing instructions, It is characterized in that When the instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.

18. A computer program product, It is characterized in that The computer program product comprises computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.

Images