On-demand reading method and electronic device

Abstract

The application is suitable for the terminal technical field, and provides a random reading method and an electronic device. The random reading method comprises the following steps: when an opening operation of a point selection reading mode for a random reading function is listened to, the point selection reading mode is opened, and an accessibility mode is entered; in the point selection reading mode, if a click operation is listened to, a target interface element corresponding to the click operation is determined, and configuration information of the target interface element is acquired; when it is determined according to the configuration information that the target interface element meets a preset characteristic of a readable interface element, reading text corresponding to the target interface element is read, and the target interface element is highlighted; after the target interface element is highlighted for a first time length, the accessibility mode is exited, so that the problem that the read content is inconsistent with the content seen by a user can be avoided, and the convenience of user operation of the electronic device in the point selection reading mode can be improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a method for on-demand reading and an electronic device. Background Art

[0002] With the continuous development of electronic devices, electronic devices can provide different services for different users. For example, screen reading functions can be provided for users with dyslexia or visual impairments. By reading aloud the text on the display interface of the electronic device, these users can conveniently and effectively access or operate the content on the display interface when using the electronic device.

[0003] Screen reading features typically include full-text reading mode and tap-to-read mode. In full-text reading mode, the electronic device reads aloud all the content on the current display interface in sequence; in tap-to-read mode, the electronic device only reads aloud the content in the area of ​​the current display interface that the user taps. Compared to full-text reading mode, tap-to-read mode is more widely used in real life because it can flexibly read aloud content on the display interface based on user needs.

[0004] Generally, the area that an electronic device is reading aloud can usually be called a focus area. In the click-to-read mode, in order to determine the focus area selected by the user in the display interface, the electronic device will first create a transparent view located at the top layer of the display interface. When the user inputs a click operation in the display interface, the screen reading service will intercept the user's click operation through the transparent view and determine the coordinate information of the click area where the click operation is located; thereafter, the electronic device will determine the focus area selected by the user based on the coordinate information of the click area and the coordinate information of the display area corresponding to each interface element, and read aloud the text in the focus area. However, when there are multiple stacked interface elements in the click area, the above method will cause the electronic device to read aloud the text in the multiple stacked interface elements, and the user can only see the top interface element among the multiple stacked interface elements. Therefore, the above method will cause the content read aloud by the electronic device to be inconsistent with the content seen by the user. Summary of the Invention

[0005] The embodiments of the present application provide a method for on-demand reading and an electronic device, which can not only avoid the problem of inconsistency between the content read aloud and the content viewed by the user, but also improve the convenience of the user operating the electronic device in the on-demand reading mode.

[0006] In a first aspect, an embodiment of the present application provides a method for on-demand reading, comprising:

[0007] Upon detecting an activation operation of a click-to-read mode for the on-demand reading function, activating the click-to-read mode and entering an accessibility mode;

[0008] In the point-to-point reading mode, if a click operation is detected, the target interface element targeted by the click operation is determined, and configuration information of the target interface element is obtained;

[0009] When it is determined based on the configuration information that the target interface element meets the characteristics of a preset readable interface element, reading aloud the reading text corresponding to the target interface element and highlighting the target interface element;

[0010] After highlighting the target interface element for a first period of time, exit the accessibility mode.

[0011] Optionally, when the electronic device detects a click operation in the click-to-read mode of the on-demand read function, it can directly determine the target interface element targeted by the click operation from the current display interface based on the click operation.

[0012] The current display interface is a user interface displayed by the electronic device when the electronic device detects a click operation in the click-to-read mode of the on-demand reading function.

[0013] It should be noted that since the user can only input click operations on the interface elements located at the top layer of the display interface, in the embodiment of the present application, the interface elements targeted by the click operations input by the user can only be the interface elements located at the top layer of the click area in the display interface where the click operation is located.

[0014] Optionally, after the electronic device determines the target interface element, it can obtain the configuration information of the target interface element from the application corresponding to the target interface element. For example, when the target interface element is an interface element in a first APP, the electronic device can obtain the configuration information of the target interface element from the first APP.

[0015] Optionally, the configuration information of the interface element may include the visibility of the interface element and the existence of the read-aloud text.

[0016] Among them, the visibility of the interface element is used to describe whether the interface element can be seen by the user. Exemplarily, the visibility of the interface element can include visible and invisible. Visible is used to indicate that the interface element can be seen by the user; invisible is used to indicate that the interface element cannot be seen by the user. In specific applications, the visibility of the interface element can be described, for example, by the transparency of the interface element; for example, when the transparency of the interface element is 0, the visibility of the interface element can be visible; when the transparency of the interface element is 100%, the visibility of the interface element can be invisible.

[0017] The existence of the read-aloud text of an interface element is used to describe whether the interface element has a corresponding read-aloud text. Exemplarily, the existence of the read-aloud text of an interface element can include the existence of the read-aloud text and the absence of the read-aloud text. The existence of the read-aloud text indicates that the interface element has a corresponding read-aloud text; the absence of the read-aloud text indicates that the interface element does not have a corresponding read-aloud text.

[0018] Optionally, the text read aloud corresponding to an interface element refers to a text description used to introduce the interface element. For example, if the interface element is a text interface element, the text read aloud corresponding to the interface element can be the text interface element itself; if the interface element is a non-text interface element (such as a control), the text read aloud corresponding to the interface element can include the name, status description, and activation method of the non-text interface element.

[0019] Optionally, the configuration information of the interface element can be configured in the service corresponding to the interface element. For example, the configuration information of a certain interface element in the first APP can be configured in the first APP.

[0020] Optionally, the characteristics of the preset readable interface element may include but are not limited to: the visibility of the interface element is visible, and the existence of the readable text of the interface element is the existence of the readable text.

[0021] Optionally, the electronic device may highlight the target interface element in the following manners, but not limited to:

[0022] Method 1: highlight the entire display area corresponding to the target interface element.

[0023] Method 2: highlight the border of the display area corresponding to the target interface element.

[0024] According to the on-demand reading method provided by this embodiment, in the click-to-read mode of the on-demand reading function, when a click operation is detected, the target interface element targeted by the click operation is directly determined. Since the target interface element targeted by the click operation can only be the interface element located at the top layer of the display interface, even if there are other non-target interface elements below the target interface element, since only the reading text corresponding to the target interface element is read aloud, the problem of inconsistency between the content read aloud and the content seen by the user can be avoided. Since the target interface element is also highlighted when the reading text corresponding to the target interface element is read aloud, it is convenient for the user to know the location of the content being read aloud in the display interface. In addition, since the barrier-free mode is exited after the target interface element is highlighted for a first period of time, the user can use the user operation method corresponding to the normal mode to operate the electronic device after each click operation in the click-to-read mode, thereby improving the convenience of the user operating the electronic device in the click-to-read mode.

[0025] In an optional implementation of the first aspect, the on-demand reading method further includes:

[0026] When it is determined based on the configuration information that the target interface element does not meet the characteristics of the readable interface element, the number of consecutive times that the target interface element does not meet the characteristics is increased by 1, and whether the current number of times is equal to a preset number threshold is determined;

[0027] When the current number of times is equal to the preset number threshold, exit the barrier-free mode;

[0028] When the current number of times is less than the preset number threshold, no response is given, or a first prompt message is output; the first prompt message is used to prompt that the readable content is not selected.

[0029] It should be noted that the initial value of the number of times that the feature of the readable interface element is not met is 0.

[0030] The current number of consecutive failures to meet the characteristics of a readable interface element refers to the number of consecutive failures to meet the characteristics of a readable interface element after the electronic device determines that the target interface element does not meet the characteristics of a readable interface element and adds 1 to the number of consecutive failures to meet the characteristics of a readable interface element.

[0031] Optionally, when the current number of consecutive times that the characteristics of the readable interface elements are not met is equal to a preset threshold, it means that the user has clicked on the blank area in the display interface multiple times in a row when the click-to-read mode of the on-demand reading function is turned on, which means that the user may not need to listen to the content in the display interface. At this time, the electronic device can exit the accessibility mode, thereby improving the user's operating experience of the electronic device.

[0032] According to the on-demand reading method provided in this embodiment, by not responding or outputting a first prompt message when the current number of consecutive times that the characteristics of the readable interface element are not met is less than a preset threshold, the user is provided with the opportunity to select the readable content in the click-to-read mode for a preset threshold number of times. This is compatible with the situation where the user fails to select the readable content due to accidental touch, further improving the convenience of the user operating the electronic device in the click-to-read mode of the on-demand reading function.

[0033] In an optional implementation of the first aspect, the on-demand reading method further includes:

[0034] When it is determined based on the configuration information that the target interface element meets the preset characteristics of the readable interface element, the number of times that the target interface element fails to meet the characteristics is set to 0.

[0035] According to the method for reading on demand provided in the embodiment, by setting the number of times of continuous non-compliance with the characteristics of the readable interface element to 0 when the target interface element meets the characteristics of the preset readable interface element, the user can be provided with multiple opportunities to select the readable content after each selection of the readable content, thereby improving the operation experience of the user.

[0036] In an optional implementation of the first aspect, in the case of outputting the first prompt information, the outputting the first prompt information comprises:

[0037] playing voice prompt information for prompting the non-selected readable content.

[0038] In an optional implementation of the first aspect, in the case of outputting the first prompt information, the outputting the first prompt information comprises:

[0039] displaying text prompt information for prompting the non-selected readable content;

[0040] Correspondingly, after the outputting the first prompt information, the method for reading on demand further comprises:

[0041] after a second time length after the displaying the text prompt information, canceling the displaying of the text prompt information.

[0042] For example, the text corresponding to the voice prompt information and the text prompt information can both be "non-selected readable content, please select again".

[0043] According to the method for reading on demand provided in the embodiment, in the case of non-selection of the readable content by the user, by outputting voice prompt information for prompting the non-selected readable content, the user can know the current operation state through listening; by displaying text prompt information for prompting the non-selected readable content, the user can know the current operation state through reading. After a second time length after the displaying of the text prompt information, the displaying of the text prompt information is canceled, thereby facilitating the user to select the readable content from the display interface again.

[0044] In an optional implementation of the first aspect, the configuration information comprises visibility and readability text existence; the visibility comprises visible and invisible; the readability text existence comprises existence of readability text and non-existence of readability text.

[0045] Correspondingly, the reading, when it is determined that the target interface element meets the characteristics of the preset readable interface element based on the configuration information, of the readability text corresponding to the target interface element comprises:

[0046] when the visibility of the target interface element is visible and the read aloud text existence of the target interface element is existing read aloud text, determining that the target interface element meets the preset characteristic of the readable interface element, and reading the read aloud text corresponding to the target interface element.

[0047] In an optional implementation of the first aspect, when it is determined, based on the configuration information, that the target interface element does not meet the characteristic of the readable interface element, the number of times of continuously not meeting the characteristic is increased by 1, including:

[0048] when the visibility of the target interface element is invisible and / or the read aloud text existence of the target interface element is non-existing read aloud text, determining that the target interface element does not meet the preset characteristic of the readable interface element, and increasing the number of times of continuously not meeting the characteristic by 1.

[0049] In an optional implementation of the first aspect, the selective reading method further includes:

[0050] If the read aloud text corresponding to the target interface element is not read completely when the accessibility mode is exited, the read aloud text corresponding to the target interface element is continued to be read.

[0051] According to the selective reading method provided in the embodiment, in the case that the read aloud text corresponding to the target interface element is not read completely when the accessibility mode is exited, the read aloud text corresponding to the target interface element is continued to be read, so that the user can listen to the read aloud text corresponding to the target interface element and normally perform subsequent operations on the electronic device, which does not affect the user to listen to the read aloud text corresponding to the target interface element and enables the user to continue to operate the electronic device in the normal mode, and further improves the convenience of the user to operate the electronic device.

[0052] In an optional implementation of the first aspect, the selective reading method further includes:

[0053] When the accessibility mode is exited, the highlighting of the target interface element is canceled.

[0054] In an optional implementation of the first aspect, the selective reading method is applied to an electronic device, and the electronic device includes a screen reading service, an accessibility service, and a speech synthesis service; the screen reading service includes a selective reading function and a user experience (UX) display module.

[0055] Correspondingly, the starting the point selection reading mode and entering the accessibility mode when the starting operation for the point selection reading mode is listened to, includes:

[0056] The on-demand reading function calls a service interface of the accessibility service to set parameters of the accessibility service when a click operation for the point-reading control is detected.

[0057] After the parameter setting is completed, the electronic device enters the accessibility reading mode.

[0058] In an optional implementation of the first aspect, the calling of the service interface of the accessibility service to set parameters of the accessibility service includes:

[0059] The on-demand reading function calls a service interface of the accessibility service, sets a tag value of configuration information of the accessibility service to a first preset value, and adds a view hover event in a listening event of the accessibility service; the first preset value is used to indicate that the accessibility service enters a touch exploration mode, and the view hover event is used to indicate that the accessibility service listens to a click operation.

[0060] In an optional implementation of the first aspect, in the point-reading mode, if a click operation is detected, a target interface element to which the click operation is directed is determined, and configuration information of the target interface element is obtained, including:

[0061] In the point-reading mode, the UX display module calls the accessibility service to determine a target interface element to which a click operation is directed and obtain configuration information of the target interface element when the click operation input by a user is received.

[0062] The accessibility service sends the configuration information to the on-demand reading function.

[0063] In an optional implementation of the first aspect, when it is determined based on the configuration information that the target interface element meets a preset characteristic of a readable interface element, the target interface element corresponding reading text is read, including:

[0064] The on-demand reading function highlights the target interface element when it is determined based on the configuration information that the target interface element meets a preset characteristic of a readable interface element.

[0065] The on-demand reading function sends the target interface element corresponding reading text to the speech synthesis service when it is determined based on the configuration information that the target interface element meets a preset characteristic of a readable interface element.

[0066] The speech synthesis service converts the reading text into corresponding audio information and plays the audio information.

[0067] In an optional implementation of the first aspect, the highlighting the target interface element comprises:

[0068] The on-demand reading function highlights the entire display region corresponding to the target interface element; or

[0069] The on-demand reading function highlights a border of the display region corresponding to the target interface element.

[0070] In a second aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors; one or more memories; the one or more memories store one or more computer executable programs, the one or more computer executable programs comprise instructions, when the instructions are executed by the one or more processors, causing the electronic device to perform each step in the on-demand reading method according to any implementation of the first aspect.

[0071] In a third aspect, an embodiment of the present application provides a computer readable storage medium, the computer readable storage medium stores a computer executable program, when the computer executable program is invoked by a computer, causing the computer to perform each step in the on-demand reading method according to any implementation of the first aspect.

[0072] In a fourth aspect, an embodiment of the present application provides a computer executable program product, when the computer executable program product is run on an electronic device, causing the electronic device to perform each step in the on-demand reading method according to any implementation of the first aspect.

[0073] In a fifth aspect, an embodiment of the present application provides a chip system, comprising a processor and a memory, the processor executes a computer executable program stored in the memory, to implement each step in the on-demand reading method according to any implementation of the first aspect. The chip system can be a single chip, or a chip module composed of multiple chips.

[0074] It can be understood that the beneficial effects of the second aspect to the fifth aspect can be referred to the related description in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0075] Figure 1A to Figure 1B A schematic diagram of a mobile phone desktop provided by an embodiment of the present application;

[0076] Figure 2 A structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0077] Figure 3 A software architecture schematic diagram of an electronic device provided by an embodiment of the present application;

[0078] Figures 4A to 4Y A schematic diagram of some GUIs that may be involved in the screen reading process provided in an embodiment of the present application;

[0079] Figures 5A to 5H A schematic diagram of other GUIs that may be involved in the screen reading process provided in an embodiment of the present application;

[0080] Figure 6 A schematic flow chart of an on-demand reading method provided in an embodiment of the present application;

[0081] Figure 7 A schematic flow chart of a method for on-demand reading provided in another embodiment of the present application

[0082] Figure 8 A timing diagram of an on-demand reading method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0083] It should be noted that the terms used in the implementation methods section of the embodiments of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is merely a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more than two, "at least one" and "one or more" mean one, two or more than two.

[0084] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly specifying the number of the technical features indicated. Therefore, the definition of "first" and "second" features may explicitly or implicitly include one or more of the features.

[0085] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0086] With the rapid development of the mobile internet, more and more services are now available online. People with dyslexia or visual impairments can now access services online just like the general public. Because people with dyslexia may encounter difficulties recognizing words, reversing the order of words, or confusing similar characters, and people with visual impairments face reading difficulties due to blindness, low vision, or color blindness, electronic devices offer screen reading features to facilitate their access to online services. By reading aloud the content on the electronic device's display interface, these people can effectively access or operate the content on the display interface, thereby effectively accessing services online.

[0087] When the software operating system running on the electronic device is Android When the system is running, the Android system usually provides two screen reading modes: one is full-text reading mode and the other is tap-to-read mode. In full-text reading mode, the electronic device reads aloud all the contents of the current display interface in sequence; in tap-to-read mode, the electronic device only reads aloud the content in the area of ​​the current display interface that the user taps. Compared with full-text reading mode, tap-to-read mode is more widely used in real life because it can flexibly read aloud the content of the display interface based on user needs.

[0088] Typically, electronic devices enter accessibility mode after turning on the screen reading function. In accessibility mode, the electronic device can read aloud the content of the current display interface according to the screen reading mode selected by the user. The area where the electronic device is reading aloud can usually be called the focus area. In full-text reading mode, the focus area traverses all areas on the display interface where text exists; in point-to-point reading mode, the focus area is the area selected by the user on the display interface.

[0089] In addition, in the accessibility mode, the entire operation mode of the electronic device is changed. For example, in the accessibility mode, a click operation input by the user for a certain control in the display interface is no longer used to activate the function of the control, but is used to instruct the electronic device to switch the focus area to the display area corresponding to the control and read the text in the display area; for another example, after the electronic device switches the focus area to the display area corresponding to a certain control, the user needs to input a double-click operation to activate the function of the control; for another example, in the accessibility mode, the user needs to input a double-finger sliding operation to trigger the electronic device to perform scrolling display on the content in the display interface. The user wants to normally operate the electronic device and needs to manually close the screen reading function of the electronic device to make the electronic device exit the accessibility mode, otherwise the electronic device will always be in the accessibility mode, so the user has to activate the function of each control in the display interface through relatively cumbersome operation, and ordinary users usually have difficulty quickly adapting to such a cumbersome operation mode, reducing the convenience of the user operating the electronic device.

[0090] In addition, after the electronic device starts the screen reading function, in the point selection reading mode, in order to locate the focus area pointed and selected by the user in the display interface, the screen reading service first creates a transparent view located at the uppermost layer of the display interface. When the user inputs a click operation in the display interface, the screen reading service intercepts the click operation of the user through the transparent view and determines the coordinate information of the click area where the click operation is located; then, the screen reading service calls the service interface corresponding to the accessibility mode to obtain the coordinate information of the display area corresponding to each interface element in the display interface, and based on the coordinate information of the click area and the coordinate information of the display area corresponding to each interface element, the target interface element corresponding to the display area containing the click area is filtered out from all interface elements, and the reading text corresponding to the target interface element is read.

[0091] However, when there are multiple stacked interface elements in the display interface of the electronic device, if the click area where the click operation input by the user in the point selection reading mode is contained in the display areas corresponding to the multiple stacked interface elements, the screen reading service will determine all the multiple stacked interface elements as target interface elements and read the text in the multiple stacked interface elements. For example, as shown in FIGS. 1 and 2, when the weather card 11 and the music card 12 are arranged in a stacked manner in the first display area 10 of the desktop of the mobile phone, in the case where the screen reading function is closed, the user can switch the cards displayed in the first display area 10 by inputting a sliding operation in the first display area 10. For example, as shown in FIG. 1, when the weather card 11 is displayed in the first display area 10, if the user inputs a sliding operation in the first display area 10, the screen reading service will determine the weather card 11 and the music card 12 as target interface elements and read the text in the weather card 11 and the music card 12. Figure 1A and Figure 1B As shown in FIGS. 1 and 2, when the weather card 11 and the music card 12 are arranged in a stacked manner in the first display area 10 of the desktop of the mobile phone, in the case where the screen reading function is closed, the user can switch the cards displayed in the first display area 10 by inputting a sliding operation in the first display area 10. For example, as shown in FIG. 1, when the weather card 11 is displayed in the first display area 10, if the user inputs a sliding operation in the first display area 10, the screen reading service will determine the weather card 11 and the music card 12 as target interface elements and read the text in the weather card 11 and the music card 12. Figure 1AAs shown, when the first display area 10 currently displays the weather card 11, the user can input an upward sliding operation in the first display area 10, and after the electronic device receives the upward sliding operation, as shown in FIG. Figure 1B As shown, the electronic device can display a music card 12 in the first display area 10 in response to the swipe-up operation. When the electronic device enters the click-to-read mode, if the click operation input by the user falls within the first display area 10, regardless of whether the first display area 10 currently displays a weather card 11 or a music card 12, the electronic device will read aloud both the text in the weather card 11 and the text in the music card 12. For example, the electronic device will read aloud the text "8:00, Monday, October 10, September 15, Renyin Year, 28 degrees Celsius, sunny, good air", and the text "Glory (Honor Mobile Chinese Theme Song), Singer 1-Honor Mobile Chinese Theme Song, 0:00, 3:00". However, during the screen reading process, since the user can only see the content of the interface element located at the top layer of the display interface among multiple stacked interface elements, the above screen reading method has the problem that the content read by the electronic device is inconsistent with the content seen by the user, thereby causing trouble for the user in using the electronic device.

[0092] In order to solve the technical problems of the above-mentioned screen reading method, such as the inconsistency between the read content and the content seen by the user, and the low convenience of user operation of the electronic device in the click-to-read mode, the embodiments of the present application provide a method and electronic device for on-demand reading. By monitoring a click operation in the click-to-read mode of the on-demand reading function, the target interface element of the click operation is directly determined. Since the target interface element of the click operation can only be the interface element located at the top layer of the display interface, even if there are other non-target interface elements below the target interface element, only the text corresponding to the target interface element is read aloud, thereby avoiding the problem of inconsistency between the read content and the content seen by the user. Since the target interface element is highlighted when the text corresponding to the target interface element is read aloud, it is convenient for the user to know the location of the content being read aloud in the display interface. In addition, since the barrier-free mode is exited after the target interface element is highlighted for a first period of time, the user can use the user operation method corresponding to the normal mode to operate the electronic device after each click operation in the click-to-read mode, thereby improving the convenience of user operation of the electronic device in the click-to-read mode.

[0093] The on-demand reading method provided in the embodiments of the present application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0094] The following describes the structure of the electronic device to which the on-demand reading method provided in the embodiment of the present application is applicable, taking a mobile phone as an example. Figure 2 , which is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

[0095] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a display 191, and a subscriber identification module (SIM) card interface 192. The sensor module 180 may include a pressure sensor 180A, a fingerprint sensor 180B, a touch sensor 180C, and the like.

[0096] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0097] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0098] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0099] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0100] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180C, a charger, a flash, etc. via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180C via the I2C interface, allowing the processor 110 and the touch sensor 180C to communicate via the I2C bus interface, thereby implementing the touch function of the electronic device 100.

[0101] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0102] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0103] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality.

[0104] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 191. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like.

[0105] The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the display 191, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0106] The USB interface 130 is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect to other terminals, such as AR devices.

[0107] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0108] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the terminal via the power management module 141.

[0109] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 191, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0110] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0111] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transfer the same to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor, and radiate the same as electromagnetic waves through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the same device as at least part of the modules of the processor 110.

[0112] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the receiver 170B), or displays an image or a video through the display screen 191. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110, and disposed in the same device as the mobile communication module 150 or other functional modules.

[0113] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (WIFI) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0114] The electronic device 100 can implement a display function through a GPU, a display screen 191 , and an application processor.

[0115] Display screen 191 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 191, where N is a positive integer greater than 1. In some embodiments, display screen 191 may be a touch screen.

[0116] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy. The video codec is used to compress or decompress digital video. The NPU is a neural network (NN) computing processor that quickly processes input information by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, and can also continuously self-learn.

[0117] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0118] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0119] The electronic device 100 can implement audio functions such as music playback, recording, screen reading, etc. through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0120] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 191. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 191, electronic device 100 detects the touch intensity based on pressure sensor 180A. Electronic device 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, an instruction to create a new short message is executed.

[0121] The fingerprint sensor 180B is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0122] Touch sensor 180C is also called a "touch device." Touch sensor 180C can be provided on display screen 191. The touch sensor 180C and display screen 191 form a touch screen, also called a "touch screen." Touch sensor 180C is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via display screen 191. In other embodiments, touch sensor 180C can also be provided on the surface of electronic device 100, at a location different from that of display screen 191.

[0123] The buttons 190 include a power button (also known as a power button), a volume button, and the like. The buttons 190 may be mechanical buttons (also known as physical buttons) or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0124] It is understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware, and the embodiments of the present application do not limit this.

[0125] For example, the software operating system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, or a cloud architecture. The system is used as an example to illustrate the software architecture of the electronic device 100. Figure 3 , is a schematic diagram of the software architecture of an electronic device 100 provided in an embodiment of the present application. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system of the electronic device 100 is divided into four layers, namely, from top to bottom, the application layer, the application framework layer, the Android runtime (Android runtime) and the system layer, and the kernel layer.

[0126] The application layer may include a series of application packages. For example, Figure 3 As shown, the application package may include a camera, a gallery, a calendar, a call, a news, a short message, a WLAN, an on-demand reading, a screen reading (talkback), a user experience (UX) display module, etc.

[0127] Optionally, screen reading may be a service (or function) provided by the software operating system of the electronic device 100 , that is, screen reading may be a service developed by the developer of the software operating system and configured in the software operating system.

[0128] Screen reading is used to provide voice feedback to the user. For example, screen reading can announce the content in the display interface of the electronic device 100 to the user so that the user can know the content in the display interface of the electronic device 100 without reading.

[0129] On-demand reading is a voice feedback service (or function) that is an improvement on the screen reading service. It should be noted that the difference between the on-demand reading function and the screen reading function is that when the on-demand reading function is turned on, the user can operate the electronic device in a more convenient way. Exemplarily, the on-demand reading function may include a full-text reading mode and a point-to-point reading mode. For the above two reading modes of the on-demand reading function, please refer to the relevant description in the subsequent embodiments, and will not be described in detail here.

[0130] The application framework layer provides an application programming interface (API) and a programming framework for applications of the application layer. The application framework layer includes some pre-defined functions.

[0131] As shown in Figure 3 , the application framework layer can include a window manager, a content provider, a notification manager, a view system, a text to speech (TTS) service, an accessibility service, etc.

[0132] The window manager is used to manage window programs. The window manager can acquire a display screen size, determine whether there is a status bar, lock a screen, and capture a screen, etc.

[0133] The content provider is used to store and acquire data, and make the data accessible to applications. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, a phone book, etc.

[0134] The notification manager makes applications display notification information in a status bar, which can be used to convey a type of message, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform a download completion, a message reminder, etc. The notification manager can also be a notification in a form of a chart or a scroll bar text appearing in a system top status bar, such as a notification of a background running application, and can also be a notification in a form of a dialog window appearing on a screen. For example, a text information is prompted in a status bar, a prompt sound is emitted, the electronic device vibrates, an indicator light flashes, etc.

[0135] The view system includes visual controls, such as a control for displaying text, a control for displaying pictures, etc. The view system can be used to build an application. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0136] It can be understood that in some embodiments, the TTS service can also be referred to as a text to speech service.

[0137] Optionally, the TTS service can be a service provided by a software operating system of the electronic device 100, i.e., the TTS service can be a service developed by a developer of the software operating system and configured in the software operating system. In this case, the TTS service can be located in the application framework layer of the software operating system of the electronic device 100.

[0138] Optionally, the TTS service may be a service developed by a third-party software developer and installed by the user in the electronic device 100. In this case, the TTS service may be located in the application layer of the software operating system of the electronic device 100.

[0139] It is understandable that, for ease of description, the subsequent embodiments of this application are illustrative using the example of the TTS service being located in the application framework layer of the software operating system of the electronic device 100 .

[0140] Accessibility Service is an auxiliary function provided by the software operating system of the electronic device 100, which is used to provide visual assistance or auditory assistance to people with reading disabilities or visual impairments, so as to assist these people in reading or listening to the content on the display interface of the electronic device 100. For example, after the user turns on the screen reading function, the Accessibility Service can be used to assist the screen reading function in announcing the content on the display interface of the electronic device 100. It should be noted that the specific functions of the Accessibility Service can be referred to the relevant description in the subsequent method embodiments, which will not be described in detail here.

[0141] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0142] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0143] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0144] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (such as OpenGL ES), and a 2D graphics engine (such as SGL).

[0145] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0146] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0147] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, layer processing, etc.

[0148] A 2D graphics engine is a drawing engine for 2D drawings.

[0149] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, sensor driver, etc.

[0150] The on-demand reading method provided in the embodiment of the present application can be applied to scenarios where the user needs to obtain the content in the display interface by listening. That is, when the user needs to obtain the content in the display interface of the electronic device by listening, the on-demand reading method provided in the embodiment of the present application can avoid the problem of inconsistency between the content read by the electronic device and the content seen by the user, and can improve the convenience of the user operating the electronic device in the click-to-read mode.

[0151] For example, Figures 4A to 4Y as well as Figures 5A to 5H As shown in FIG, a schematic diagram of some graphical user interfaces (GUIs) that may be involved in the on-demand reading process provided by the embodiment of the present application. Figures 4A to 4Y as well as Figures 5A to 5H The GUI shown is an interface in a mobile phone and is described as an example.

[0152] In an embodiment of the present application, the mobile phone supports an on-demand reading function. The on-demand reading function can be used to read aloud (i.e., broadcast) the content in the display interface of the mobile phone. Optionally, the on-demand reading function may include a full-text reading mode and a click-to-read mode. In the full-text reading mode, the mobile phone can read aloud all the content in the display interface from top to bottom; in the click-to-read mode, the mobile phone can only read aloud the content in the area selected by the user in the display interface. Based on this, the user can turn on or off the on-demand reading function of the mobile phone according to actual needs. For example, in a specific application, when the user needs to obtain the content in the display interface of the mobile phone by listening, the user can turn on the on-demand reading function of the mobile phone.

[0153] Exemplarily, a mobile phone may be configured with a switch control for a read-aloud function. The switch control for the read-aloud function is used to control the on-demand read-aloud function of the mobile phone to be turned on or off. Based on this, the user can turn the read-aloud function on or off by operating the switch control for the read-aloud function. Specifically, the switch control for the read-aloud function may include an on state and an off state. Exemplarily, when the switch control for the read-aloud function is in the off state, it means that the read-aloud function is not turned on in the mobile phone. At this time, the user can control the mobile phone to turn on the read-aloud function by operating the switch control for the read-aloud function; when the switch control for the read-aloud function is in the on state, it means that the read-aloud function is turned on in the mobile phone. At this time, the user can control the mobile phone to turn off the read-aloud function by operating the switch control for the read-aloud function.

[0154] For example, the switch control of the on-demand reading function can be configured in the settings APP of the mobile phone. Figure 4A As shown, when the user needs to turn on or off the on-demand reading function of the mobile phone, the user can input a first operation for the icon 401 of the setting APP on the mobile phone desktop 40. The first operation can be, for example, a click operation. After receiving the first operation input by the user, the mobile phone can respond to the first operation and display the following Figure 4B The main interface 41 of the settings APP is shown. For example, Figure 4B As shown, the main interface 41 of the settings APP may include a settings item search box 411 and an auxiliary function settings item 412. Based on this, the user can enter the settings interface of the on-demand reading function in but not limited to the following two ways.

[0155] Method 1, such as Figure 4C As shown, when the mobile phone displays the main interface 41 of the Settings APP, the user can directly search for the Select-to-Read setting item through the Settings item search box 411 in the Settings APP main interface 41. For example, the user can input a second operation for the Settings item search box 411, and the second operation can be, for example, a click operation. After receiving the second operation input by the user, the mobile phone can respond to the second operation and display the following Figure 4D The setting item search interface 42 shown. Figure 4DAs shown, the setting item search interface 42 may also include a setting item search box 411, and the user may search for the on-demand reading setting item by entering keywords related to the on-demand reading function in the setting search box 411. Keywords related to the on-demand reading function may include, for example: "speak", "read", "read aloud", "on-demand" or "on-demand reading", etc. Exemplarily, when the user enters keywords related to the on-demand reading function (such as "on-demand") in the setting item search box 411 of the setting item search interface 42, the mobile phone may display matching items that match the keywords entered by the user below the setting item search box 411. When the matching items include the on-demand reading setting item 421, the user may enter a third operation for the on-demand reading setting item 421, and the third operation may be, for example, a click operation. After receiving the third operation entered by the user, the mobile phone may respond to the third operation and display the following. Figure 4E The accessibility settings interface 43 is shown.

[0156] Method 2, such as Figure 4F As shown, when the mobile phone displays the main interface 41 of the setting APP, the user can input a fourth operation for the auxiliary function setting item 412. The fourth operation can be, for example, a click operation. After receiving the fourth operation input by the user, the mobile phone can respond to the fourth operation and display the following Figure 4G The auxiliary function setting interface 44 shown. Figure 4G As shown, the accessibility setting interface 44 may include an accessibility setting item 441. The user may input a fifth operation for the accessibility setting item 441. The fifth operation may be, for example, a click operation. After receiving the fifth operation input by the user, the mobile phone may respond to the fifth operation and display the following information: Figure 4H The barrier-free setting interface 43 shown. It should be noted that, Figure 4H The barrier-free setting interface 43 shown is the same as Figure 4E The barrier-free setting interface 43 shown is the same display interface.

[0157] like Figure 4E or Figure 4H As shown, the barrier-free setting interface 43 may include visual assistance setting items and auditory assistance setting items. For example, the visual assistance setting items may include a screen reading setting item 431 and an on-demand reading setting item 432. Among them, the screen reading setting item 431 is used for the user to set the screen reading function of the mobile phone, for example, for the user to turn on or off the screen reading function of the mobile phone; the on-demand reading setting item 432 is used for the user to set the on-demand reading function of the on-demand reading function, for example, for the user to turn on or off the on-demand reading function of the on-demand reading function.

[0158] Optionally, a first text description about the on / off status of the screen reading function may be displayed in the display area corresponding to the screen reading setting item 431. For example, when the screen reading function is in the off state, the first text description may be "off"; when the screen reading function is in the on state, the first text description may be "on". Similarly, a second text description about the on / off status of the on / off reading function may be displayed in the display area corresponding to the on / off reading setting item 432. For example, when the on / off reading function of the on / off reading function is in the off state, the second text description may be "off"; when the on / off reading function of the on / off reading function is in the on state, the second text description may be "on".

[0159] For example, when the screen reading function of the mobile phone is turned off, Figure 4I As shown, the user can input a sixth operation for the screen reading setting item 431 in the barrier-free setting interface 43. The sixth operation can be, for example, a click operation. After the mobile phone receives the sixth operation input by the user, it can respond to the sixth operation and display the following Figure 4J The screen reading setting interface 45 is shown. Figure 4J As shown, the screen reading setting interface 45 may include a switch control 451 of the screen reading function and an operation instruction 452 of the screen reading function. The user may input a seventh operation for the switch control 451 of the screen reading function, and the seventh operation may be, for example, a click operation. After the mobile phone receives the seventh operation input by the user, Figure 4K As shown, the mobile phone can set the switch control 451 of the screen reading function to the on state, and at the same time, the mobile phone can also display the on prompt box 453 of the screen reading function. The on prompt box 453 of the screen reading function may include a confirmation control 4531 for determining to turn on the screen reading function, a cancel control 4532 for canceling the turning on of the screen reading function, and text descriptions of some operations that the mobile phone may perform after turning on the screen reading function. Based on this, when the user determines to turn on the screen reading function, the user can input the eighth operation for the confirmation control 4531, and the eighth operation can be, for example, a click operation. After the mobile phone receives the eighth operation input by the user, as shown Figure 4LAs shown, the mobile phone can cancel the prompt box 453 for turning on the screen reading function and broadcast the first voice prompt "Screen reading is turned on". Afterwards, when the user clicks on any interface element in the display interface, the mobile phone can highlight the display area corresponding to the interface element and read aloud the reading text corresponding to the interface element. Exemplarily, in the case where the interface element is a text-type interface element, the reading text corresponding to the interface element can be the text-type interface element itself; in the case where the interface element is a non-text-type interface element (such as a control), the reading text corresponding to the interface element can include the name, status description and activation method of the non-text-type interface element. Exemplarily, the way in which the mobile phone highlights the display area corresponding to the interface element can include, for example: highlighting the entire display area corresponding to the interface element, or highlighting the border of the display area corresponding to the interface element, etc.

[0160] For example, Figure 4M As shown, after the screen reading function of the mobile phone is turned on, when the user inputs a click operation on the switch control 451 of the screen reading function in the screen reading setting interface 45, as shown in FIG. Figure 4N As shown, the mobile phone can respond to the click operation by highlighting the border of the display area corresponding to the switch control 451. At the same time, the mobile phone can broadcast the reading text corresponding to the switch control 451, such as "Selected, switch, tap twice to switch". Figure 4O As shown, when the user inputs a double-click operation on the switch control 451 of the screen reading function, as shown in FIG. Figure 4P As shown, in response to the double-click operation, the mobile phone can set the switch control 451 to the off state and display a prompt box 454 for determining whether to disable the reading function. Exemplarily, the prompt box 454 for determining whether to disable the reading function may include a confirmation control 4541 for determining whether to disable the screen reading function, a cancel control 4542 for canceling the disabling of the screen reading function, and a prompt message for determining whether to disable the screen reading function. The prompt message for determining whether to disable the screen reading function may include, for example, "Do you want to disable screen reading?" and "Click "OK" to disable screen reading." It should be noted that while displaying prompt box 454, the mobile phone may also announce the text corresponding to the prompt message in prompt box 454. The text corresponding to the prompt message in prompt box 454 may include, for example, "Reminder, do you want to disable screen reading?" and "Click "OK" to disable screen reading." At the same time, the mobile phone may highlight the border of the display area corresponding to the prompt message in prompt box 454.

[0161] Based on this, Figure 4QAs shown, when the user determines that the screen reading function of the mobile phone needs to be turned off, the user can input a click operation for the confirmation control 4541 in the prompt box 454. After the mobile phone receives the click operation input by the user for the confirmation control 4541, as shown in FIG. Figure 4R As shown, the mobile phone can respond to the click operation by highlighting the display area corresponding to the confirmation control 4541 and announcing the reading text corresponding to the confirmation control 4541, such as "Confirm button, click twice to activate". After that, the user can input a double-click operation on the confirmation control 4541. After the mobile phone receives the double-click operation input by the user on the confirmation control 4541, as shown in FIG. Figure 4S As shown, the mobile phone can cancel the prompt box 454 for determining whether to disable the reading function in response to the double-click operation, and broadcast the second voice prompt "Screen reading is turned off".

[0162] As can be seen, after the screen reading function is turned on on a mobile phone, users need to use a relatively cumbersome operation method to operate the phone, which reduces the convenience of user operation. In order to improve the inconvenience of users who listen to the content on the display interface, users can turn off the screen reading function of the mobile phone and turn on the on-demand reading function of the mobile phone.

[0163] Specifically, if Figure 4T As shown, when the mobile phone displays the barrier-free setting interface 43, the user can input a ninth operation for the on-demand reading setting item 432 in the barrier-free setting interface 43. The ninth operation can be, for example, a click operation. After the mobile phone receives the ninth operation input by the user, it can display the following Figure 4U As shown in the on-demand reading settings interface 46. Figure 4U As shown, the on-demand reading setting interface 46 may include a switch control 461 of the on-demand reading function and an operation instruction 462 of the on-demand reading function. The user may input a tenth operation for the on-demand reading function switch control 461, and the tenth operation may be, for example, a click operation. After the mobile phone receives the tenth operation input by the user, Figure 4V As shown, the mobile phone can respond to the tenth operation by setting the switch control 461 of the on-demand reading function to the on state. At the same time, the mobile phone can also display the on prompt box 463 of the on-demand reading function. The on prompt box 463 of the on-demand reading function may include a confirmation control 4631 for confirming the on-demand reading function, a cancel control 4632 for canceling the on-demand reading function, and text descriptions of some operations that the mobile phone may perform after the on-demand reading function is turned on. Based on this, when the user determines to turn on the on-demand reading function, the user can input the eleventh operation for the confirmation control 4631. The eleventh operation can be, for example, a click operation. After the mobile phone receives the eleventh operation input by the user, as shown in FIG. Figure 4WAs shown, the mobile phone can cancel the prompt box 463 for the on-demand reading function, and display a floating window 465 for the on-demand reading function, and broadcast a third voice prompt "On-demand reading is on." It should be noted that the mobile phone enters the barrier-free mode after the on-demand reading function is turned on.

[0164] like Figure 4W As shown, the floating window 465 of the on-demand reading function may include a control 4651 for turning on the click-to-read mode of the on-demand reading function, a control 4652 for turning on or off the full-text reading mode of the on-demand reading function, a speed setting control 4653 for setting the speed at which the mobile phone reads text, a close control 4654 for closing the floating window 465, and an expand control 4655 for expanding the floating window 465. For example, Figure 4X As shown, when the user needs to turn on the click-to-read mode of the on-demand reading function, the user can input a twelfth operation for the control 4651 for turning on the click-to-read mode of the on-demand reading function in the floating window 465. The twelfth operation can be, for example, a click operation or a double-click operation. Figure 4Y As shown, after the mobile phone receives the twelfth operation input by the user, it can respond to the twelfth operation by canceling the display of the floating window 465 and displaying the floating ball 466 of the on-demand reading function in the first state, with a click mark indicating the on-demand reading mode displayed in the floating ball 466 in the first state. Afterwards (that is, when the floating ball 466 is in the first state), the user can click on any interface element in the currently displayed interface to make the mobile phone announce the interface element clicked by the user.

[0165] For example, Figure 5A As shown, when the user clicks on more settings options in the screen reading settings interface 46, as shown in FIG. Figure 5B As shown, the mobile phone can respond to the click operation on the more settings option by highlighting the border of the display area where the more settings option is located. At the same time, the mobile phone can broadcast the reading text corresponding to the more settings option, such as "more settings", and the mobile phone can put the floating ball 466 into the second state. The floating ball 466 in the second state displays an expansion control for expanding the floating window of the on-demand reading function. It should be noted that after the mobile phone highlights the border of the display area where the more settings option is located for the first time, as shown in FIG. Figure 5C As shown, the mobile phone can cancel the highlighting of the border of the display area where more setting options are located, exit the barrier-free mode, and continue to display the floating ball 466 in the second state.

[0166] It should be noted that after the mobile phone exits the barrier-free mode, the user can operate the mobile phone using the user operation method corresponding to the normal mode. Figure 5D As shown, for example, Figure 5D As shown, when the mobile phone displays the on-demand reading setting interface 46, when the user needs to return to the previous menu, the user can enter an operation for returning to the previous menu in the on-demand reading setting interface 46. For example, the operation for returning to the previous menu can be an operation of swiping from the right side of the mobile phone to the left, or an operation of swiping from the left side of the mobile phone to the right, or a click operation on the previous menu return control 464 in the on-demand reading setting interface 46, etc.

[0167] When the mobile phone receives the operation of returning to the previous menu in the on-demand reading setting interface 46, the mobile phone can respond to the operation of returning to the previous menu and return to the previous menu. Figure 5E The barrier-free setting interface 43 shown in FIG. 4 is displayed, and the floating ball 466 in the second state continues to be displayed. Figure 4E or Figure 4H The difference between the barrier-free setting interface 43 shown is that Figure 5E In the illustrated barrier-free setting interface 43 , the second text description regarding the switch status of the select-to-read function in the display area corresponding to the select-to-read setting item 432 is “ON”.

[0168] Afterwards (ie, when the floating ball 466 is in the second state), when the user needs to reopen the click-to-read mode of the on-demand reading function, as shown in FIG. Figure 5E As shown, the user can input a click operation for the floating ball 466 in the second state. The mobile phone receives the click operation input by the user for the floating ball 466 in the second state, as shown in FIG. Figure 5F As shown, the mobile phone can cancel the display of the floating ball 466 in response to the click operation, and display the floating window 465 of the on-demand reading function.

[0169] After that, users can continue to use Figures 4X to 5F The method in the corresponding embodiment enables the click-to-read mode of the on-demand reading function of the mobile phone, and this process will not be described in detail here.

[0170] It should be noted that the control 4652 for turning on or off the full text reading mode of the on-demand reading function in the floating window 465 of the on-demand reading function can include two states: stopped playback and playing. Based on this, when the on-demand reading function is turned on on the mobile phone and the control 4652 for turning on or off the full text reading mode of the on-demand reading function is in the stopped playback state, when the user needs to turn on the full text reading mode of the on-demand reading function, such as Figure 5GAs shown, the user can input a click operation on the control 4652 for turning on or off the full-text reading mode of the select-to-read function in the floating window 465. When the mobile phone receives the motor operation input by the user on the control 4652 for turning on or off the full-text reading mode of the select-to-read function, it can respond to the click operation and put the control 4652 for turning on or off the full-text reading mode of the select-to-read function into the playing state and read the content of the current display interface from top to bottom. Afterwards, the user can input a click operation on the control 4652 in the playing state to control the mobile phone to pause reading the content of the displayed interface.

[0171] In another optional implementation, the user can also control the mobile phone to turn on or off the on-demand reading function through voice commands. For example, when the user needs to turn on the on-demand reading function of the mobile phone, the user can issue a voice command "Xiao E, turn on the on-demand reading function." Based on this, when the mobile phone receives the voice command "Xiao E, turn on the on-demand reading function" issued by the user, the on-demand reading function is turned on. Of course, the mobile phone can also use other methods (such as shortcut operations) to turn on or off the on-demand reading function, and this embodiment of the application is not limited to this.

[0172] See also Figure 6 , which is a schematic flow chart of a method for on-demand reading provided in an embodiment of the present application. The execution subject of the on-demand reading method may be an electronic device, and the on-demand reading method may specifically include S601 to S604, which are described in detail as follows:

[0173] S601 , when an operation of starting a click-to-read mode for a select-to-read function is monitored, the click-to-read mode is started and an accessibility mode is entered.

[0174] In some embodiments, the operation of starting the click-to-read mode for the on-demand reading function may be, for example, a user clicking Figure 4X The twelfth operation is inputted in the floating window 465 of the on-demand reading function for the control 4651 for turning on the click-to-read mode of the on-demand reading function. The twelfth operation may be, for example, a click operation. Figure 4Y As shown, after the electronic device turns on the click-to-read mode of the on-demand reading function, a floating ball 466 of the on-demand reading function can be displayed in the current display interface. Thereafter, the electronic device can monitor the click operation input by the user.

[0175] S602: In the click-to-read mode of the on-demand reading function, if a click operation is detected, the target interface element targeted by the click operation is determined, and configuration information of the target interface element is obtained.

[0176] When an electronic device detects a click operation in the tap-to-read mode of the select-to-read feature, the electronic device can directly determine the target interface element of the click operation from the current display interface based on the click operation. The current display interface is the user interface displayed by the electronic device when the electronic device detects the click operation in the tap-to-read mode of the select-to-read feature.

[0177] It should be noted that since the user can only input click operations on the interface elements located at the top layer of the display interface, in the embodiment of the present application, the interface elements targeted by the click operations input by the user can only be the interface elements located at the top layer of the click area in the display interface where the click operation is located.

[0178] In some embodiments, after the electronic device determines the target interface element, it can obtain the configuration information of the target interface element from the application corresponding to the target interface element. For example, when the target interface element is an interface element in a first app, the electronic device can obtain the configuration information of the target interface element from the first app.

[0179] Optionally, the configuration information of each interface element in the mobile phone may include the visibility of the interface element and the existence of the read-aloud text.

[0180] Among them, the visibility of the interface element is used to describe whether the interface element can be seen by the user. Exemplarily, the visibility of the interface element can include visible and invisible. Visible is used to indicate that the interface element can be seen by the user; invisible is used to indicate that the interface element cannot be seen by the user. In specific applications, the visibility of the interface element can be described, for example, by the transparency of the interface element; for example, when the transparency of the interface element is 0, the visibility of the interface element can be visible; when the transparency of the interface element is 100%, the visibility of the interface element can be invisible.

[0181] The existence of the read-aloud text of an interface element is used to describe whether the interface element has a corresponding read-aloud text. Exemplarily, the existence of the read-aloud text of an interface element can include the existence of the read-aloud text and the absence of the read-aloud text. The existence of the read-aloud text indicates that the interface element has a corresponding read-aloud text; the absence of the read-aloud text indicates that the interface element does not have a corresponding read-aloud text.

[0182] In some embodiments, the text read aloud corresponding to an interface element refers to a text description used to introduce the interface element. For example, if the interface element is a text interface element, the text read aloud corresponding to the interface element can be the text interface element itself; if the interface element is a non-text interface element (such as a control), the text read aloud corresponding to the interface element can include the name, status description, and activation method of the non-text interface element.

[0183] Optionally, the configuration information of the interface element can be configured in the service corresponding to the interface element. For example, the configuration information of a certain interface element in the first APP can be configured in the first APP.

[0184] S603: When it is determined based on the configuration information of the target interface element that the target interface element meets the preset characteristics of a readable interface element, a reading text corresponding to the target interface element is read aloud, and the target interface element is highlighted.

[0185] In some embodiments, the characteristics of the preset readable interface element may include but are not limited to: the visibility of the interface element is visible, and the existence of the read-aloud text of the interface element is the existence of the read-aloud text.

[0186] Based on this, the step of the electronic device determining in S603 that the target interface element meets the characteristics of the preset readable interface element may specifically include the following steps:

[0187] When the visibility of the target interface element is visible and the existence of the read text of the target interface element is that the read text exists, it is determined that the target interface element meets the preset characteristics of the read-aloud interface element, and the read text corresponding to the target interface element is read aloud.

[0188] In some embodiments, the electronic device may highlight the target interface element in the following manners, but not limited to:

[0189] Method 1: highlight the entire display area corresponding to the target interface element.

[0190] Method 2: highlight the border of the display area corresponding to the target interface element.

[0191] S604: After highlighting the target interface element for a first period of time, exit the barrier-free mode.

[0192] In an embodiment of the present application, after highlighting a target interface element for a first period of time, the electronic device can cancel the highlighting of the target interface element and exit accessibility mode. Since the user can operate the electronic device using the user operation method corresponding to normal mode after the electronic device exits accessibility mode, the convenience of operating the electronic device after the select-to-speak function is enabled can be improved.

[0193] In another embodiment of the present application, the on-demand reading method may further include: Figure 7 S701 to S703 shown are described in detail as follows:

[0194] S701, when it is determined based on the configuration information of the target interface element that the target interface element does not meet the characteristics of the readable interface element, the number of consecutive times that the target interface element does not meet the characteristics of the readable interface element is increased by 1, and it is determined whether the current number of consecutive times that the target interface element does not meet the characteristics of the readable interface element is equal to a preset number threshold.

[0195] In a specific embodiment of the present application, S701 may specifically include the following steps:

[0196] When the visibility of the target interface element is invisible and / or the existence of the read text of the target interface element is that there is no read text, it is determined that the target interface element does not meet the preset characteristics of the readable interface element, and the number of consecutive times that it does not meet the characteristics of the readable interface element is increased by 1.

[0197] It should be noted that the initial value of the number of times that the feature of the readable interface element is not met is 0.

[0198] The current number of consecutive failures to meet the characteristics of a readable interface element refers to the number of consecutive failures to meet the characteristics of a readable interface element after the electronic device determines that the target interface element does not meet the characteristics of a readable interface element and adds 1 to the number of consecutive failures to meet the characteristics of a readable interface element.

[0199] S702: When the number of times that the current feature of the interface element that can be read aloud is not met continuously is equal to a preset threshold, exit the barrier-free mode.

[0200] When the current number of consecutive times that the characteristics of the readable interface elements are not met is equal to the preset threshold, it means that the user has clicked on the blank area in the display interface multiple times in a row when the click-to-read mode of the on-demand reading function is turned on, which means that the user may not need to listen to the content in the display interface. At this time, the electronic device can exit the accessibility mode, thereby improving the user's operating experience of the electronic device.

[0201] S703: When the number of times that the current feature of the readable interface element is not met continuously is less than a preset threshold, no response is given or a first prompt message is output.

[0202] The first prompt information is used to prompt that the readable content is not selected.

[0203] The preset number threshold can be set according to actual needs, for example, the preset number threshold can be 3.

[0204] For example, the electronic device may output the first prompt information in the following manner, but not limited to:

[0205] Method 1: broadcasting a voice prompt message for prompting unselected readable content.

[0206] Method 2: Displaying a text prompt message to indicate that the content that can be read aloud is not selected.

[0207] For example, the text corresponding to the voice prompt information and the text prompt information may both be "No readable content is selected, please reselect."

[0208] By not responding or outputting a first prompt message when the current number of consecutive times that the characteristics of the readable interface elements are not met is less than a preset threshold, the user is provided with the opportunity to select the readable content in the click-to-read mode for a preset threshold number of times, thereby being compatible with the situation where the user fails to select the readable content due to accidental touch, further improving the convenience of users operating electronic devices in the click-to-read mode of the on-demand reading function.

[0209] In addition, when the user has not selected the content that can be read aloud, by outputting voice prompt information to indicate that the content that can be read aloud has not been selected, the user can know the current operation status by listening; by displaying text prompt information to indicate that the content that can be read aloud has not been selected, the user can know the current operation status by reading.

[0210] In another embodiment of the present application, when the electronic device outputs the first prompt information by displaying text prompt information, the on-demand reading method may further include the following steps:

[0211] After the second time period after the text prompt information is displayed, the text prompt information is canceled.

[0212] In the case that the user has not selected the readable content, in order to facilitate the user to select the readable content again from the display interface, the electronic device may cancel the display of the text prompt information after displaying the text prompt information for a second period of time.

[0213] Please continue reading Figure 7 In another embodiment of the present application, the on-demand reading method may further include S704, which is described in detail as follows:

[0214] S704 : When it is determined based on the configuration information of the target interface element that the target interface element meets the preset characteristics of the readable interface element, the number of times that the target interface element fails to meet the characteristics of the readable interface element is set to 0.

[0215] By setting the number of times the target interface element fails to meet the characteristics of the preset readable interface element to 0 when the target interface element meets the characteristics of the preset readable interface element, the user can be provided with multiple opportunities to not select the readable content each time after selecting the readable content, thereby improving the user's operating experience.

[0216] Please continue reading Figure 7In another embodiment of the present application, the on-demand reading method may further include S705, which is described in detail as follows:

[0217] S705: If the reading text corresponding to the target interface element has not been finished when exiting the barrier-free mode, continue to read the reading text corresponding to the target interface element.

[0218] By continuing to read the text corresponding to the target interface element when the text corresponding to the target interface element has not been read out when exiting the accessibility mode, the user can listen to the text corresponding to the target interface element while performing subsequent operations on the electronic device normally. This does not affect the user's ability to listen to the text corresponding to the target interface element, and allows the user to continue to operate the electronic device using the user operation method corresponding to the normal mode, further improving the convenience of the user's operation of the electronic device.

[0219] Please continue reading Figure 7 In another embodiment of the present application, the on-demand reading method may further include S706, which is described in detail as follows:

[0220] S706 , when exiting the barrier-free mode, cancel highlighting of the target interface element.

[0221] In a specific embodiment of the present application, the on-demand reading method can be implemented through multiple services (i.e., software modules) in the software operating system of the electronic device. Exemplarily, the on-demand reading method can be implemented through the screen reading service, accessibility service, text-to-speech (TTS) service, and UX display module in the software operating system of the electronic device. Figure 3 The screen reading service and UX display module can be located in the application layer of the electronic device's software operating system, the TTS service can be located in the application layer or application framework layer of the electronic device's software operating system, and the accessibility service can be located in the application framework layer of the electronic device's software operating system. This embodiment of the application is schematically illustrated using the example of the TTS service being located in the application framework layer.

[0222] Based on this, Figure 8 As shown, S601 may specifically include S6011 to S6012, which are described in detail as follows:

[0223] S6011: When the on-demand reading service monitors a click operation on the click-to-read control of the on-demand reading function, the service interface of the accessibility service is called to set parameters for the accessibility service.

[0224] For example, the click-to-read control of the on-demand reading function can be as follows: Figure 4W A control 4651 is shown for enabling the click-to-speak mode of the select-to-speak feature.

[0225] In an optional implementation, the on-demand reading service calls the service interface of the accessibility service to set parameters of the accessibility service, which can specifically include:

[0226] The on-demand reading service calls the service interface of the accessibility service, sets a flag value of configuration information of the accessibility service to a first preset value, and adds a view hover event to a listening event of the accessibility service; the first preset value is used to indicate the accessibility service to enter a touch exploration mode, and the view hover event is used to indicate the accessibility service to listen to a click operation.

[0227] By setting the flag value of the configuration information of the accessibility service to the first preset value, the click operation of the user can be the same as the mouse operation. By adding the view hover event to the listening event of the accessibility service, the electronic device can obtain all the click operations of the user in the point-and-click reading mode of the on-demand reading function.

[0228] For example, the first preset value can be FLAG_REQUEST_TOUCH_EXPLORATION_MODE.

[0229] The view hover event can be a TYPE_VIEW_HOVER_ENTER event.

[0230] S6012, after the parameter setting is completed, the electronic device enters the accessibility reading mode.

[0231] In an implementation, S602 can specifically include S6021-S6022, which are described as follows.

[0232] S6021, in the point-and-click reading mode of the on-demand reading function, the UX display module, when receiving a click operation input by the user, calls the accessibility service to determine a target interface element to which the click operation is directed, and obtains configuration information of the target interface element.

[0233] For example, the UX display module calls the accessibility service to determine the target interface element to which the click operation is directed, and obtains the configuration information of the target interface element, which can specifically be: the UX display module calls the accessibility service to determine the target interface element to which the click operation is directed based on the click operation, and obtains the configuration information of the target interface element.

[0234] For example, the accessibility service can obtain the configuration information of the target interface element from a service (for example, an APP) in which the target interface element is located.

[0235] S6022, the accessibility service sends the configuration information of the target interface element to the on-demand reading service.

[0236] After obtaining the configuration information of the target interface element, the accessibility service can send the configuration information of the target interface element to the select-on-demand reading service.

[0237] In a specific implementation, S603 may include S6031 to S6033, which are described in detail as follows:

[0238] S6031: When the on-demand reading service determines, based on the configuration information of the target interface element, that the target interface element meets the characteristics of a preset readable interface element, the target interface element is highlighted.

[0239] Specifically, the on-demand reading service may highlight the target interface element by:

[0240] The on-demand reading service highlights the entire display area corresponding to the target interface element; or

[0241] The on-demand reading service highlights the border of the display area corresponding to the target interface element.

[0242] S6032: When the on-demand reading service determines that the target interface element meets the preset characteristics of a readable interface element based on the configuration information of the target interface element, the on-demand reading service sends the reading text corresponding to the target interface element to the speech synthesis service.

[0243] S6033: The speech synthesis service converts the read text corresponding to the target interface element into corresponding audio information and broadcasts the audio information.

[0244] Based on the same technical concept, an embodiment of the present application also provides an electronic device, which may include: a display; one or more processors; one or more memories; the one or more memories store one or more computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the electronic device performs one or more steps in any of the above methods.

[0245] Based on the same technical concept, an embodiment of the present application also provides a computer-readable storage medium, which stores a computer-executable program. When the computer-executable program is called by the computer, the computer executes one or more steps in any of the above methods.

[0246] Based on the same technical concept, an embodiment of the present application further provides a chip system, including a processor coupled to a memory, wherein the processor executes a computer-executable program stored in the memory to implement one or more steps of any of the above methods. The chip system can be a single chip or a chip module composed of multiple chips.

[0247] Based on the same technical concept, an embodiment of the present application also provides a computer executable program product. When the computer executable program product runs on an electronic device, it enables the electronic device to execute one or more steps in any of the above methods.

[0248] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described or recorded in detail in a particular embodiment, please refer to the relevant descriptions of other embodiments. It should be understood that the order of the sequence numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0249] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted via the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)).

[0250] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0251] The above merely illustrates the specific implementation of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited to this. Any change or replacement within the technical scope disclosed by the embodiments of the present application should be covered in the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application should be subject to the protection scope of the claims.

Claims

1. A method for on-demand reading, characterized in that: include: Upon detecting an activation operation of a click-to-read mode for the on-demand reading function, activating the click-to-read mode and entering an accessibility mode; In the click-to-read mode, if a click operation is detected, the target interface element of the click operation is determined, and configuration information of the target interface element is obtained; the target interface element is the topmost interface element in the click area where the click operation occurs; the configuration information includes visibility and the existence of the read text; When it is determined based on the configuration information that the target interface element meets the characteristics of a preset readable interface element, reading aloud the reading text corresponding to the target interface element and highlighting the target interface element; After highlighting the target interface element for a first period of time, exiting the accessibility mode; If the reading text corresponding to the target interface element has not been completed when exiting the barrier-free mode, the reading text corresponding to the target interface element continues to be read.

2. The on-demand reading method according to claim 1, wherein: Also includes: When it is determined based on the configuration information that the target interface element does not meet the characteristics of the readable interface element, the number of consecutive times that the target interface element does not meet the characteristics is increased by 1, and whether the current number of times is equal to a preset number threshold is determined; When the current number of times is equal to the preset number threshold, exit the barrier-free mode; When the current number of times is less than the preset number threshold, no response is given, or a first prompt message is output; The first prompt information is used to prompt that the readable content is not selected.

3. The on-demand reading method according to claim 2, wherein: Also includes: When it is determined based on the configuration information that the target interface element meets the preset characteristics of the readable interface element, the number of times that the target interface element fails to meet the characteristics is set to 0.

4. The on-demand reading method according to claim 2, wherein: In the case of outputting the first prompt information, the outputting the first prompt information includes: The voice prompt message used to announce the unselected readable content.

5. The on-demand reading method according to claim 2, wherein: In the case of outputting the first prompt information, the outputting the first prompt information includes: Display text prompts for unselected readable content; Correspondingly, after outputting the first prompt information, the on-demand reading method further includes: After the second time period after the text prompt information is displayed, the text prompt information is canceled from being displayed.

6. The on-demand reading method according to claim 1, wherein: The visibility includes visible and invisible; the existence of the read-aloud text includes the existence of the read-aloud text and the absence of the read-aloud text; Correspondingly, when it is determined based on the configuration information that the target interface element meets the preset characteristics of the readable interface element, reading aloud the reading text corresponding to the target interface element includes: When the visibility of the target interface element is visible and the existence of the read-aloud text of the target interface element is that the read-aloud text exists, it is determined that the target interface element meets the preset characteristics of the read-aloud interface element, and the read-aloud text corresponding to the target interface element is read aloud.

7. The on-demand reading method according to claim 6, wherein: When it is determined based on the configuration information that the target interface element does not meet the characteristics of the readable interface element, adding 1 to the number of consecutive times that the target interface element does not meet the characteristics, the method includes: When the visibility of the target interface element is invisible, and / or the existence of the read-aloud text of the target interface element is that there is no read-aloud text, it is determined that the target interface element does not meet the preset characteristics of the readable interface element, and the number of consecutive times that the characteristics are not met is increased by 1.

8. The on-demand reading method according to any one of claims 1 to 7, characterized in that: Also includes: When exiting the barrier-free mode, the highlighting of the target interface element is canceled.

9. The on-demand reading method according to any one of claims 1 to 8, characterized in that: The on-demand reading method is applied to an electronic device, which includes a screen reading service, an accessibility service, and a speech synthesis service; the screen reading service includes an on-demand reading function and a user experience UX display module; Correspondingly, when an operation to enable the click-to-read mode is detected, enabling the click-to-read mode and entering the barrier-free mode includes: When the on-demand reading function monitors a click operation on the click-to-read control, it calls the service interface of the accessibility service to set parameters for the accessibility service; After the parameter setting is completed, the electronic device enters the barrier-free reading mode.

10. The on-demand reading method according to claim 9, wherein: The calling of the service interface of the barrier-free service to set parameters of the barrier-free service includes: The on-demand reading function calls the service interface of the accessibility service, sets the tag value of the configuration information of the accessibility service to a first preset value, and adds a view hover event to the listening event of the accessibility service; the first preset value is used to instruct the accessibility service to enter the touch exploration mode, and the view hover event is used to instruct the accessibility service to listen for click operations.

11. The on-demand reading method according to claim 9, wherein: In the point-to-point reading mode, if a click operation is detected, determining a target interface element targeted by the click operation and obtaining configuration information of the target interface element includes: In the click-to-read mode, upon receiving a click operation input by the user, the UX display module calls the accessibility service to determine the target interface element targeted by the click operation and obtains configuration information of the target interface element; The accessibility service sends the configuration information to the select-on-demand reading function.

12. The on-demand reading method according to claim 9, wherein: When it is determined based on the configuration information that the target interface element meets the preset characteristics of the readable interface element, reading aloud the reading text corresponding to the target interface element includes: The on-demand reading function highlights the target interface element when it is determined based on the configuration information that the target interface element meets the characteristics of the preset readable interface element; When the on-demand reading function determines that the target interface element meets the characteristics of a preset readable interface element based on the configuration information, the on-demand reading function sends the reading text corresponding to the target interface element to the speech synthesis service; The speech synthesis service converts the read text into corresponding audio information and broadcasts the audio information.

13. The on-demand reading method according to claim 12, wherein: The highlighting of the target interface element includes: The on-demand reading function highlights the entire display area corresponding to the target interface element; or The on-demand reading function highlights the border of the display area corresponding to the target interface element.

14. An electronic device, characterized in that: include: one or more processors; one or more memories; The one or more memories store one or more computer executable programs, and the one or more computer executable programs include instructions. When the instructions are executed by the one or more processors, the electronic device performs each step in the on-demand reading method as described in any one of claims 1-13.

15. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer-executable program, and when the computer-executable program is called by a computer, the computer executes each step of the on-demand reading method according to any one of claims 1 to 13.

16. A chip system, characterized in that: The chip system includes a processor coupled to a memory, wherein the memory is used to store computer program instructions. When the processor executes the computer program instructions, the chip system implements each step in the on-demand reading method as described in any one of claims 1 to 13.

Images