Accessibility screen reading method and electronic device

Abstract

Embodiments of the present application provide an accessibility screen reading method and an electronic device. The method comprises: acquiring accessibility reading configuration information of an image, wherein the accessibility reading configuration information comprises text information and position information corresponding to the text information; saving the image and the accessibility reading configuration information; displaying the image; and on the basis of the accessibility reading configuration information, performing accessibility screen reading for the image. The accessibility screen reading method in the embodiments of the present application can achieve accessibility screen reading for images, thereby expanding the application scenarios of accessibility screen reading, and improving the user experience of accessibility screen reading.

Description

An accessible screen reading method and electronic device

[0001] This application claims priority to Chinese Patent Application No. 202411016890.5, filed on July 26, 2024, entitled "A Method and Electronic Device for Accessible Screen Reading", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of computer technology, and in particular to an accessible screen reading method and electronic device. Background Technology

[0003] With the increasing accessibility of current terminal devices, it has become possible for people with disabilities to use these devices normally.

[0004] One way for people with disabilities to use terminal devices is through screen reading. Generally, screen reading capabilities rely on accessibility information in the application interface. Without accessibility information from the actual application interface, such as images within the application, screen reading is not possible.

[0005] Therefore, a new accessible screen reading method is needed to achieve accessible screen reading functionality for images. Summary of the Invention

[0006] To address the issue of how to implement screen reading functionality for images, this application provides an accessible screen reading method and an electronic device, and also provides a computer-readable storage medium.

[0007] The embodiments of this application adopt the following technical solutions:

[0008] Firstly, this application provides an accessible screen reading method, the method comprising:

[0009] Obtain the accessibility reading configuration information for the image, which includes text information and the location information corresponding to the text information;

[0010] Save the image and accessibility text configuration information;

[0011] Show pictures;

[0012] Based on the accessibility reading configuration information, perform accessible screen reading for images.

[0013] The method described in the first aspect enables accessible screen reading of images, expanding the application scenarios of accessible screen reading and improving the user experience of accessible screen reading.

[0014] In one implementation of the first aspect:

[0015] The barrier-free reading configuration information of a picture includes one or more pieces of text information.

[0016] Each piece of text information corresponds to an image element in the picture.

[0017] The text information is used to describe the function of the image element corresponding to the text information.

[0018] The position information corresponding to the text information is the position of the image element corresponding to the text information on the picture.

[0019] Specifically, in an implementation mode, a picture includes a plurality of image elements. The image elements in the picture can be any content elements in the picture, for example, buttons, windows, frames, etc. in the picture. The barrier-free reading configuration information of the picture includes text information of image elements in the picture that can support barrier-free reading and position information of the image elements. The barrier-free reading configuration information of a picture includes text information and position information corresponding to the text information. The barrier-free reading configuration information of a picture includes one or more pieces of text information. Each piece of text information in the barrier-free reading configuration information of a picture corresponds to an image element in the picture that can support barrier-free reading. The position information corresponding to the text information is the position information of the image element corresponding to the text information in the picture. The text information of the image element is used to describe the function of the image element and / or the content included in the image element. Specifically, the text information of the image element can be the text content included in the image element, or a text description of the content indicated by the image element.

[0020] In an implementation mode of the first aspect, obtaining the barrier-free reading configuration information of the picture includes:

[0021] Obtaining all barrier-free node information corresponding to the system interface or the application interface corresponding to the picture, and generating the barrier-free reading configuration information of the picture according to the barrier-free node information.

[0022] And / or,

[0023] For the picture content of the picture, performing text recognition through optical character recognition capability to obtain a recognition result, and generating the barrier-free reading configuration information of the picture according to the recognition result.

[0024] In an implementation mode of the first aspect, obtaining the barrier-free reading configuration information of the picture includes:

[0025] When the picture is saved as a screenshot, obtaining all barrier-free node information corresponding to the system interface or the application interface corresponding to the picture, and generating the barrier-free reading configuration information of the picture according to the barrier-free node information.

[0026] When the picture is saved in a non-screenshot manner, text recognition is performed on the picture content of the picture by using an optical character recognition capability to obtain a recognition result, and the accessibility reading configuration information of the picture is generated according to the recognition result.

[0027] According to the above implementation manner, for different picture saving manners, the corresponding accessibility reading configuration information acquisition manner is used, the acquisition of the accessibility reading configuration information can be simply and quickly realized, the system overhead is reduced, and the acquisition efficiency of the accessibility reading configuration information is improved.

[0028] In an implementation manner of the first aspect, the accessibility reading configuration information of the picture is acquired by:

[0029] For the system interface or the application interface corresponding to the picture, it is determined whether there is corresponding accessibility node information;

[0030] When the corresponding accessibility node information exists, all the accessibility node information corresponding to the system interface or the application interface corresponding to the picture is acquired, and the accessibility reading configuration information of the picture is generated according to the accessibility node information;

[0031] When the accessibility node information does not exist, text recognition is performed on the picture content of the picture by using an optical character recognition capability to obtain a recognition result, and the accessibility reading configuration information of the picture is generated according to the recognition result.

[0032] According to the above implementation manner, the accessibility node information is preferentially acquired, the accessibility reading configuration information is generated according to the accessibility node information, and when the accessibility node information cannot be acquired, the accessibility reading configuration information is generated based on the OCR capability, so that the accessibility node information can be smoothly acquired under the premise of ensuring the accuracy and comprehensiveness of the accessibility reading configuration information.

[0033] In an implementation manner of the first aspect, the accessibility reading configuration information of the picture is acquired by:

[0034] All the accessibility node information corresponding to the system interface or the application interface corresponding to the picture is acquired, and the first accessibility reading configuration information is generated according to the accessibility node information;

[0035] Text recognition is performed on the picture content of the picture by using an optical character recognition capability to obtain a recognition result, and the second accessibility reading configuration information is generated according to the recognition result;

[0036] The first accessibility reading configuration information and the second accessibility reading configuration information are integrated to generate the accessibility reading configuration information of the picture.

[0037] Specifically, in an implementation, the first barrier-free reading configuration information and the second barrier-free reading configuration information are integrated to generate the barrier-free reading configuration information of the picture, including:

[0038] When the first barrier-free reading configuration information and the second barrier-free reading configuration information contain the same position information, the repeated position information and the text information corresponding to the position information are deleted from the second barrier-free reading configuration information.

[0039] The first barrier-free reading configuration information and the remaining second barrier-free reading configuration information are merged to generate the barrier-free reading configuration information of the picture.

[0040] According to the above implementation, on the basis of generating the barrier-free reading configuration information according to the barrier-free node information, the barrier-free reading configuration information is further obtained based on the OCR capability to supplement, so that complete and comprehensive barrier-free reading configuration information can be ensured.

[0041] In an implementation of the first aspect, saving the picture and the barrier-free reading configuration information includes:

[0042] The barrier-free reading configuration information is saved into the exchangeable image file information of the picture.

[0043] Alternatively,

[0044] The barrier-free reading configuration information is saved as an independent barrier-free reading configuration file, and the storage path description of the barrier-free reading configuration file is saved into the exchangeable image file information of the picture.

[0045] Alternatively,

[0046] The barrier-free reading configuration information is saved as an independent barrier-free reading configuration file, and the barrier-free reading configuration file is saved under the storage path of the picture; for example, the barrier-free reading configuration file of the picture is a same-name file (with different extensions) under the same path of the picture file.

[0047] Alternatively,

[0048] A barrier-free reading configuration summary file is created, and the barrier-free reading configuration information is saved into the barrier-free reading configuration summary file, wherein the barrier-free reading configuration summary file is used to save the barrier-free reading configuration information of one or more pictures.

[0049] In an implementation of the first aspect, before obtaining the barrier-free reading configuration information of the picture, the method further includes:

[0050] When saving the picture is triggered, it is confirmed whether saving of the barrier-free reading configuration information is triggered by saving of the picture.

[0051] Optionally, in an implementation form of the first aspect, a picture barrier-free reading switch is configured in a system setting, when the picture barrier-free reading switch is configured to be turned on, the barrier-free reading configuration information saving for the picture is triggered synchronously after the picture saving is triggered; when the picture barrier-free reading switch is configured to be turned off, the barrier-free reading configuration information saving for the picture is not triggered after the picture saving is triggered.

[0052] According to the above implementation form, by configuring the picture barrier-free reading switch to turn on or turn off the saving of the barrier-free reading configuration information for the picture, the user can flexibly and freely choose whether to realize the barrier-free screen reading for the picture content, and the user experience is effectively improved.

[0053] Optionally, in an implementation form of the first aspect, a separate configuration switch is not set for the saving of the barrier-free reading configuration information, and whether the picture saving triggers the saving of the barrier-free reading configuration information for the picture is determined according to the current device application scenario.

[0054] According to the above implementation form, whether the saving of the barrier-free reading configuration information for the picture is triggered is determined according to the current device application scenario, a separate configuration switch does not need to be additionally set for the saving of the barrier-free reading configuration information, the system configuration setting item can be simplified, the degree of complexity of configuring the system setting item is reduced, and the operation experience of the user when configuring the system setting item is improved.

[0055] Optionally, in an implementation form of the first aspect, whether the saving of the barrier-free reading configuration information for the picture is triggered is determined according to the picture saving mode. Optionally, when the current triggered saving mode is a non-screenshot mode, the saving of the barrier-free reading configuration information for the picture is not triggered; when the current triggered saving mode is a screenshot, the saving of the barrier-free reading configuration information for the picture is triggered.

[0056] Further, whether the saving of the barrier-free reading configuration information for the picture is triggered can be determined in combination with the picture saving mode and the picture barrier-free reading switch, or in combination with the picture saving mode and the device application scenario.

[0057] According to the above implementation form, whether the saving of the barrier-free reading configuration information for the picture is triggered is determined according to the picture saving mode, which can effectively determine whether the saving of the barrier-free reading configuration information for the picture is triggered according to the application scenario demand of the user, and avoid unnecessary waste of storage space caused by automatically saving the barrier-free reading configuration information.

[0058] Optionally, in an implementation form of the first aspect, a prompt box is popped up before saving the barrier-free reading configuration information, and a user is requested to confirm whether to save the barrier-free reading configuration information. Optionally, the request to the user to confirm whether to save the barrier-free reading configuration information through the prompt box can be combined with the previous confirmation of whether to trigger the saving of the barrier-free reading configuration information for the picture, as the final step of the confirmation of whether to trigger the saving of the barrier-free reading configuration information for the picture.

[0059] According to the above implementation form, the prompt box is popped up, and the user finally confirms whether to save the barrier-free reading configuration information for the picture, which can effectively confirm the picture that needs to implement barrier-free reading according to the demand of the user, and avoid unnecessary waste of storage space caused by automatic saving of the barrier-free reading configuration information.

[0060] In an implementation form of the first aspect, the method further includes:

[0061] An icon of the picture is displayed, and a barrier-free reading mark is added on the icon.

[0062] According to the above implementation form, the barrier-free reading mark is added on the icon when the picture of the barrier-free reading picture is displayed, which can enable the user to conveniently and quickly confirm the barrier-free reading picture, thereby facilitating the user to operate to implement the barrier-free reading based on the picture.

[0063] In an implementation form of the first aspect, before the barrier-free screen reading is performed on the picture according to the barrier-free reading configuration information, the method further includes:

[0064] When the picture is displayed, it is confirmed whether the display of the picture triggers the barrier-free screen reading for the picture.

[0065] Optionally, in an implementation form, it is identified whether the picture is a barrier-free reading picture, and when the picture is the barrier-free reading picture, it is confirmed that the currently triggered display of the picture triggers the barrier-free screen reading for the picture. According to the above implementation form, when the picture is the barrier-free reading picture, the currently triggered display of the picture is automatically confirmed to trigger the barrier-free screen reading for the picture, which can simplify the user operation process and improve the user experience of the barrier-free reading.

[0066] Optionally, in an implementation form, according to a picture barrier-free reading switch configured in a system setting, it is confirmed whether the currently triggered display of the picture triggers the barrier-free screen reading for the picture. According to the above implementation form, the picture barrier-free reading switch is configured to start or stop the barrier-free reading for the picture, which can enable the user to flexibly and freely select whether to perform the barrier-free screen reading for the picture content, and effectively improve the user experience.

[0067] Optionally, in an implementation, according to the current device application scenario, it is determined whether the picture display triggered currently triggers the barrier-free screen reading for the picture. According to the implementation, whether the barrier-free screen reading for the picture is triggered is determined according to the current device application scenario, without the need of an additional configuration switch for the barrier-free reading configuration information, which can simplify the system configuration setting item and reduce the complexity of the system configuration setting, thereby improving the operation experience of the user when configuring the system setting.

[0068] Optionally, in an implementation, a prompt box is popped up to request the user to confirm whether the picture display triggers the barrier-free screen reading for the picture. Optionally, the user is requested to confirm whether the barrier-free screen reading is performed through the prompt box, which can be combined with the previous scheme of confirming whether the barrier-free screen reading for the picture is triggered, as the final step of confirming whether the barrier-free screen reading for the picture is triggered.

[0069] According to the implementation, the user finally confirms whether the barrier-free screen reading for the picture is performed through the prompt box, which can effectively perform the barrier-free screen reading according to the user's demand and avoid the automatic barrier-free screen reading from affecting the user experience.

[0070] Optionally, in an implementation, a picture barrier-free reading button is provided on the picture display page, and the user can confirm whether the barrier-free screen reading for the picture is triggered through the operation of the picture barrier-free reading button. According to the implementation, the picture barrier-free reading button is provided, and the user can control whether the barrier-free screen reading for the picture is started at any time, which can effectively perform the barrier-free screen reading according to the user's demand and avoid the automatic barrier-free screen reading from affecting the user experience. According to the implementation, when the picture is displayed, whether the barrier-free screen reading for the picture is performed can be selected according to the user's demand. Moreover, during the picture display, whether the barrier-free screen reading for the picture is started or interrupted can be selected according to the user's demand at any time, so that the barrier-free screen reading can be completely matched with the user's demand, the user operation flexibility is improved, and the user experience of the barrier-free screen reading is improved.

[0071] Optionally, in an implementation, a prompt box is first popped up to request the user to confirm whether the picture display triggers the accessibility screen reading for the picture. After the user confirms that the picture display does not trigger the accessibility screen reading for the picture based on the prompt box, the prompt box is closed, and then the picture accessibility reading button is provided on the picture display page, so that the user can subsequently confirm whether to trigger the accessibility screen reading for the picture by operating the picture accessibility reading button. According to the above implementation, when starting to display the picture, whether to perform the accessibility screen reading for the picture can be selected according to the user demand. Moreover, during the picture display, whether to start to perform the accessibility screen reading for the picture can be selected according to the user demand at any time, so that the enabling of the accessibility screen reading can completely match the user demand, the user operation flexibility is improved, and the user experience of the accessibility screen reading is improved.

[0072] In an implementation of the first aspect, the accessibility screen reading for the picture according to the accessibility reading configuration information comprises:

[0073] The click position of the user is acquired.

[0074] According to the click position of the user, the position information in the accessibility reading configuration information is matched to acquire the text information corresponding to the position information.

[0075] The text information is sent to the voice reading component for text reading.

[0076] According to the above implementation, the accessibility screen reading is performed on the object specified by the user according to the user operation, so that the accessibility screen reading can completely match the user demand, the user operation flexibility is improved, and the user experience of the accessibility screen reading is improved.

[0077] In an implementation of the first aspect, the accessibility screen reading for the picture according to the accessibility reading configuration information comprises:

[0078] According to the position information in the accessibility reading configuration information, the text information in the accessibility reading configuration information is read one by one in a predetermined order (for example, from top to bottom, from left to right).

[0079] Optionally, in an implementation, during the reading of the text information in the accessibility reading configuration information one by one, the image area corresponding to the text information currently being read is marked on the picture display page.

[0080] According to the above implementation, after starting the accessibility screen reading for the picture, the accessibility screen reading for the picture is automatically performed without manual operation of the user, the user operation process is simplified, the accessibility screen reading can be automatically implemented, and the user experience of the accessibility screen reading is improved.

[0081] In a second aspect, the present application provides an electronic device comprising a memory for storing computer program instructions and a processor for executing the computer program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to perform the method steps of the first aspect.

[0082] In a third aspect, the present application provides a chip device comprising a processor for executing a computer program, wherein when the computer program is executed by the processor, the chip device is triggered to perform the method steps of the first aspect.

[0083] In a fourth aspect, the present application provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and when the computer program is run on a computer, the computer is caused to perform the method of the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0084] Fig. 1 shows an interface display diagram according to an embodiment of the present application;

[0085] Fig. 2 shows a barrier-free screen reading method flow diagram according to an embodiment of the present application;

[0086] Fig. 3 shows an interface display diagram according to an embodiment of the present application;

[0087] Fig. 4 shows a barrier-free screen reading method flow diagram according to an embodiment of the present application;

[0088] Fig. 5 shows an interface display diagram according to an embodiment of the present application;

[0089] Fig. 6 shows a barrier-free screen reading method flow diagram according to an embodiment of the present application;

[0090] Fig. 7 shows a barrier-free screen reading method flow diagram according to an embodiment of the present application;

[0091] Fig. 8 shows a barrier-free screen reading method flow diagram according to an embodiment of the present application;

[0092] Fig. 9 shows an interface display diagram according to an embodiment of the present application;

[0093] Fig. 10 shows an interface display diagram according to an embodiment of the present application;

[0094] Fig. 11 shows a picture data storage structure diagram according to an embodiment of the present application;

[0095] Fig. 12 shows a picture storage method flow diagram according to an embodiment of the present application;

[0096] Fig. 13 shows a flowchart of a picture saving method according to an embodiment of the present application;

[0097] Fig. 14 shows a flowchart of a picture saving method according to an embodiment of the present application;

[0098] Fig. 15 shows an interface display diagram according to an embodiment of the present application;

[0099] Fig. 16 shows a part flowchart of a barrier-free screen reading method according to an embodiment of the present application;

[0100] Fig. 17 shows a part flowchart of a barrier-free screen reading method according to an embodiment of the present application;

[0101] Fig. 18 shows an interface display diagram according to an embodiment of the present application;

[0102] Fig. 19 shows a part flowchart of a barrier-free screen reading method according to an embodiment of the present application;

[0103] Fig. 20 shows an interface display diagram according to an embodiment of the present application;

[0104] Fig. 21 shows a part flowchart of a barrier-free screen reading method according to an embodiment of the present application;

[0105] Fig. 22 shows a part flowchart of a barrier-free screen reading method according to an embodiment of the present application;

[0106] Fig. 23 is a structural diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0107] To make the objectives, technical solutions, and advantages of the present application clearer, the technical solutions of the present application will be described below in conjunction with specific embodiments of the present application and corresponding drawings. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0108] The terms used in the embodiment part of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.

[0109] For the barrier-free screen reading application scenario, a feasible technical solution is to rely on the barrier-free node information of the current interface to perform barrier-free screen reading.

[0110] For example, Fig. 1 shows an interface display diagram according to an embodiment of the present application.

[0111] In an application scenario, the system settings > accessibility > barrier-free > screen reading of the mobile phone is entered, and the mobile phone screen displays an interface as shown in FIG. 1. The screen reading switch 101 is turned on to start the screen reading mode.

[0112] In the screen reading mode, the mobile phone system starts the barrier-free reading framework in the background. In the case that the barrier-free reading framework is started in the background of the mobile phone system, the application interface of the mobile phone is returned, and the barrier-free screen reading of the application interface is realized.

[0113] Specifically, in the screen reading mode, when double-clicking (clicking twice in succession) an interface element (for example, a button, a window, a frame, etc.) on the application interface, the operation corresponding to the interface element on the application interface is performed (for example, jumping to a new interface, opening a floating window, etc.).

[0114] In the screen reading mode, when single-clicking (clicking once) an interface element on the application interface, the barrier-free reading framework confirms the interface element clicked according to the click position, calls the barrier-free node information corresponding to the interface element, and performs barrier-free screen reading according to the barrier-free node information. The barrier-free node information corresponding to the interface element includes text information for describing the function of the interface element.

[0115] For example, for an application A supporting barrier-free screen reading, the application interface of the application A at least includes buttons A1, A2, and A3. For the application A, there is barrier-free node information of the application A, which at least includes barrier-free node information B1, B2, and B3 corresponding to A1, A2, and A3 respectively. The barrier-free node information B1, B2, and B3 are text information for describing the functions of the buttons A1, A2, and A3 respectively.

[0116] FIG. 2 shows a barrier-free screen reading method flowchart according to an embodiment of the present application.

[0117] The electronic device performs the following flow as shown in FIG. 2 to realize barrier-free screen reading.

[0118] S200, receiving a first operation of a user, the first operation configuring the screen reading switch 101 to be turned on.

[0119] S201, in response to the first operation, starting and loading the barrier-free reading framework.

[0120] S202, receiving a second operation of a user, and returning to the application interface in response to the second operation.

[0121] S203, receiving a third operation of a user, the third operation being a single click on the display screen.

[0122] S204, the barrier-free reading framework determines the interface element on the application interface corresponding to the click position according to the click position.

[0123] S205, the barrier-free reading framework calls the barrier-free node information corresponding to the interface element.

[0124] S206, the barrier-free reading framework sends the barrier-free node information to the voice reading component for text reading.

[0125] S207, a fourth operation of the user is received, and the fourth operation is a double-click on the display screen.

[0126] S208, the double-click position on the application interface is determined according to the click position.

[0127] S209, the function corresponding to the interface element is executed.

[0128] For example, FIG. 3 shows a schematic diagram of an interface display according to an embodiment of the present application.

[0129] In the screen reading mode, enter the application interface of the text editing application as shown in 300 of FIG. 3. In the application interface, there are a new document button 301, an open document button 302, and a save document button 303.

[0130] For example, as shown in 310 of FIG. 3, in the screen reading mode, double-click the new document button 301, and enter the application interface of the text editing application as shown in 311 of FIG. 3, and a title input box 312 is popped up to request the user to input the title of the new document to establish a new document.

[0131] As shown in 320 of FIG. 3, in the screen reading mode, click the new document button 301, and the barrier-free reading framework confirms that the click object is the new document button 301 according to the click position. The barrier-free reading framework obtains the barrier-free node information corresponding to the new document button 301 as "establish a new document" according to the barrier-free node information of the text editing application. The barrier-free reading framework sends the text data "establish a new document" to the voice reading component for text reading. As shown in 321 of FIG. 3, the speaker of the mobile phone plays the voice "establish a new document", thereby realizing barrier-free screen reading.

[0132] In the above application scenario of barrier-free screen reading, the implementation of barrier-free screen reading depends on the barrier-free node information corresponding to the click position. When the user views a historical picture on the terminal, even if the picture viewing application supports barrier-free screen reading, because the barrier-free node information corresponding to the picture viewing application has no association with the picture content, the barrier-free reading framework cannot obtain the barrier-free node information corresponding to the click position in the picture content in the barrier-free node information corresponding to the picture viewing application. Therefore, the barrier-free reading framework cannot realize barrier-free screen reading for the picture content.

[0133] In view of the above, an embodiment of the present application provides a barrier-free screen reading method. Specifically, while saving a picture, barrier-free node information corresponding to picture content of the picture is saved as barrier-free reading configuration information. When the picture is displayed, the barrier-free reading configuration information saved together with the picture is called to realize barrier-free screen reading for the picture content.

[0134] Fig. 4 shows a barrier-free screen reading method flowchart according to an embodiment of the present application.

[0135] In an embodiment, the electronic device performs the following flow as shown in Fig. 4.

[0136] S400, confirming whether picture saving is triggered.

[0137] In an embodiment, the picture saving mode includes a non-screenshot saving mode. For example, a save button is clicked to save the currently viewed picture; for another example, a picture is right-clicked to select "picture save as" to save the currently viewed picture.

[0138] In an embodiment, the picture saving also includes a screenshot.

[0139] S401, when the picture saving is triggered, the picture itself file is saved.

[0140] S410, confirming whether the currently triggered picture saving triggers saving of barrier-free reading configuration information for the picture.

[0141] Optionally, in an embodiment, a picture barrier-free reading switch is configured in the system setting. When the picture barrier-free reading switch is configured to be turned on, after the picture saving is triggered, saving of the barrier-free reading configuration information for the picture is triggered synchronously. When the picture barrier-free reading switch is configured to be turned off, after the picture saving is triggered, saving of the barrier-free reading configuration information for the picture is not triggered.

[0142] Fig. 5 shows an interface display diagram according to an embodiment of the present application.

[0143] In an application scenario, the system setting> auxiliary function> barrier-free> screen reading of the mobile phone is entered, and the mobile phone screen displays the interface as shown in Fig. 5.

[0144] As shown in Fig. 5, in the barrier-free reading function setting interface, a screen reading switch 501 is configured. The user can configure whether to turn on the barrier-free screen reading function by turning on the screen reading switch 501.

[0145] In the system setting interface of the barrier-free reading function, a picture barrier-free reading switch 502 is further configured. A user can configure whether to start the picture barrier-free reading function through the switch barrier-free reading switch 502, so as to set whether the picture saving triggers the barrier-free reading configuration information saving of the picture.

[0146] According to the method of the embodiment of the present application, the picture barrier-free reading switch is configured to start or close the saving of the barrier-free reading configuration information of the picture, so that the user can flexibly and freely select whether to realize the barrier-free screen reading of the picture content, and the user experience is effectively improved.

[0147] Optionally, in another embodiment, no independent configuration switch is set for the saving of the barrier-free reading configuration information, and whether the picture saving triggers the saving of the barrier-free reading configuration information of the picture is confirmed according to the current device application scenario.

[0148] Specifically, in an embodiment, it is set that the picture saving triggers the saving of the barrier-free reading configuration information of the picture only in the barrier-free reading scenario. Then, in the barrier-free reading scenario, after the picture saving is triggered, the saving of the barrier-free reading configuration information of the picture is triggered synchronously. In the non-barrier-free reading scenario, after the picture saving is triggered, the saving of the barrier-free reading configuration information of the picture is not triggered.

[0149] For example, in an application scenario, the system setting> auxiliary function> barrier-free> screen reading of the mobile phone is entered, and the interface shown in FIG. 1 is displayed on the screen of the mobile phone.

[0150] In the interface shown in FIG. 1, the screen reading switch 101 is configured to be turned on, and the screen reading mode is entered. In the screen reading mode, when the picture saving is triggered, the saving of the barrier-free reading configuration information of the picture is triggered synchronously.

[0151] In the interface shown in FIG. 1, the screen reading switch 101 is configured to be turned off, and the screen reading mode is not entered. In the non-screen reading mode, when the picture saving is triggered, the saving of the barrier-free reading configuration information of the picture is not triggered.

[0152] According to the method of the embodiment of the present application, whether to trigger the saving of the barrier-free reading configuration information of the picture is determined according to the current device application scenario, no independent configuration switch needs to be additionally set for the saving of the barrier-free reading configuration information, the system configuration setting item can be simplified, the degree of complexity of configuring the system setting item is reduced, and the operation experience of the user when configuring the system setting item is improved.

[0153] Optionally, in another embodiment, whether to trigger the saving of the barrier-free reading configuration information of the picture is confirmed according to the picture saving mode.

[0154] Specifically, in most practical application scenarios, the picture saved by the non-screenshot mode is usually an existing ready-made picture, such as a network sharing picture. The picture usually does not contain picture content corresponding to the accessibility node information. For the picture content of the picture saved by the non-screenshot mode, the user does not have a screen reading requirement.

[0155] And the picture saved by the screenshot mode usually contains the picture content of the system interface or the application interface of the mobile phone. The picture usually contains picture content corresponding to the accessibility node information. For the picture content of the picture saved by the screenshot mode, the user has a screen reading requirement.

[0156] Therefore, in an embodiment, when the current trigger is the non-screenshot mode saving, the accessibility reading configuration information saving for the picture is not triggered; when the current trigger is the screenshot, the accessibility reading configuration information saving for the picture is triggered.

[0157] Further, in another embodiment, whether to trigger the accessibility reading configuration information saving for the picture can be determined in combination with the picture saving mode and the picture accessibility reading switch, or in combination with the picture saving mode and the device application scenario.

[0158] For example, in the accessibility reading function setting interface shown in FIG. 5, the picture accessibility reading switch 502 is configured to be turned on. Then when the picture saving is triggered, if the current trigger is the non-screenshot mode saving, the accessibility reading configuration information saving for the picture is not triggered; if the current trigger is the screenshot, the accessibility reading configuration information saving for the picture is triggered.

[0159] In the accessibility reading function setting interface shown in FIG. 5, the picture accessibility reading switch 502 is configured to be turned off. Then when the picture saving is triggered, whether the current trigger is the non-screenshot mode saving or the screenshot, the accessibility reading configuration information saving for the picture is not triggered.

[0160] FIG. 6 shows a part of the flow of the accessibility screen reading method according to an embodiment of the present application.

[0161] The electronic device executes the following flow shown in FIG. 6 to determine whether to trigger the accessibility reading configuration information saving for the picture.

[0162] S600, triggering the picture saving.

[0163] S601, determining whether the picture accessibility reading switch 502 is turned on.

[0164] If the picture accessibility reading switch 502 is not turned on, S604 is executed.

[0165] If the picture barrier-free reading switch 502 is opened, S602 is executed.

[0166] S602, determine the picture saving mode of the current triggered picture saving.

[0167] If the picture saving mode of the current triggered picture saving is screenshot, S603 is executed.

[0168] S603, determine whether to trigger the picture barrier-free reading configuration information saving.

[0169] If the picture saving mode of the current triggered picture saving is non-screenshot saving, S604 is executed.

[0170] S604, determine not to trigger the picture barrier-free reading configuration information saving.

[0171] For another example, in the interface as shown in FIG. 1, the screen reading switch 101 is configured to be opened, and the screen reading mode is entered. In the screen reading mode, when the picture saving is triggered, if the current triggered is non-screenshot saving, the picture barrier-free reading configuration information saving is not triggered; if the current triggered is screenshot, the picture barrier-free reading configuration information saving is triggered.

[0172] In the interface as shown in FIG. 1, the screen reading switch 101 is configured to be closed, and the screen reading mode is not entered. In the non-screen reading mode, when the picture saving is triggered, no matter the current triggered is non-screenshot saving or screenshot, the picture barrier-free reading configuration information saving is not triggered.

[0173] FIG. 7 shows a part of the flow of the barrier-free screen reading method according to an embodiment of the present application.

[0174] The electronic device executes the following flow as shown in FIG. 7 to determine whether to trigger the picture barrier-free reading configuration information saving.

[0175] S700, trigger the picture saving.

[0176] S701, confirm whether the screen reading switch 101 is opened.

[0177] If the screen reading switch 101 is not opened, S704 is executed.

[0178] If the screen reading switch 101 is opened, S702 is executed.

[0179] S702, determine the picture saving mode of the current triggered picture saving.

[0180] If the picture saving mode triggered currently is a screenshot, S703 is performed.

[0181] S703, it is determined whether the picture saving mode triggered currently is a screenshot.

[0182] If the picture saving mode triggered currently is a non-screenshot mode, S704 is performed.

[0183] S704, it is determined whether the picture saving mode triggered currently is a non-screenshot mode.

[0184] According to the method of the embodiment of the present application, whether the picture saving mode triggered currently is a screenshot or a non-screenshot mode is determined, and whether the picture saving mode triggered currently is a screenshot or a non-screenshot mode is determined, which can effectively determine whether the picture saving mode triggered currently is a screenshot or a non-screenshot mode according to the application scene requirement of the user, and avoid unnecessary storage space waste caused by automatic saving of the picture saving mode.

[0185] Further, in another embodiment, in order to avoid unnecessary storage space waste caused by automatic saving of the picture saving mode, a prompt box is popped up before saving the picture saving mode, and the user is requested to confirm whether to save the picture saving mode.

[0186] Optionally, the user is requested to confirm whether to save the picture saving mode through the prompt box, which can be combined with the previous scheme of determining whether the picture saving mode triggered currently is a screenshot or a non-screenshot mode, and serve as the final step of determining whether the picture saving mode triggered currently is a screenshot or a non-screenshot mode.

[0187] For example, in the picture saving mode triggered currently is a screenshot or a non-screenshot mode, and the picture saving mode triggered currently is a screenshot or a non-screenshot mode, which can be combined with the previous scheme of determining whether the picture saving mode triggered currently is a screenshot or a non-screenshot mode, and serve as the final step of determining whether the picture saving mode triggered currently is a screenshot or a non-screenshot mode.

[0188] FIG. 8 shows a part of the flow of the picture saving method according to an embodiment of the present application.

[0189] The electronic device performs the following flow shown in FIG. 8 to determine whether the picture saving mode triggered currently is a screenshot or a non-screenshot mode.

[0190] S800, the picture saving mode triggered currently is a screenshot or a non-screenshot mode.

[0191] S801, it is determined whether the picture saving mode triggered currently is a screenshot or a non-screenshot mode.

[0192] If the picture saving mode triggered currently is a screenshot or a non-screenshot mode, S805 is performed.

[0193] If the picture saving mode triggered currently is a screenshot or a non-screenshot mode, S802 is performed.

[0194] S802, outputting a prompt box, the prompt box containing prompt information "whether to save the barrier-free reading configuration information of the picture" and a "confirm" button and a "cancel" button.

[0195] S803, receiving a click operation of the user on the prompt box.

[0196] If the click operation of the user on the prompt box is clicking the "confirm" button, S804 is executed.

[0197] S804, determining whether to trigger the saving of the barrier-free reading configuration information of the picture.

[0198] If the click operation of the user on the prompt box is clicking the "cancel" button, S805 is executed.

[0199] S805, determining not to trigger the saving of the barrier-free reading configuration information of the picture.

[0200] FIG. 9 shows a schematic diagram of an interface display according to an embodiment of the present application.

[0201] In an application scenario, in the barrier-free reading function setting interface shown in FIG. 5, the picture barrier-free reading switch 502 is configured to be turned on. Then the user enters the interface shown in the left part of FIG. 9 by pulling down the application interface menu. The user clicks the "screenshot" button in the pull-down menu to take a screenshot.

[0202] As shown in the right part of FIG. 9, a prompt box is popped up to request the user to confirm whether to save the barrier-free reading configuration information of the picture. If the user clicks "yes", the barrier-free reading configuration information of the current screenshot is triggered to be saved. If the user clicks "no", the barrier-free reading configuration information of the current screenshot is not triggered to be saved.

[0203] For another example, in the barrier-free reading function setting interface shown in FIG. 5, the picture barrier-free reading switch 502 is configured to be turned on. When the picture saving is triggered, if the current trigger is a screenshot, a prompt box is popped up on the display screen of the electronic device to request the user to confirm whether to save the barrier-free reading configuration information of the picture.

[0204] For another example, in the interface shown in FIG. 1, the screen reading switch 101 is configured to be turned on to enter the screen reading mode. In the screen reading mode, when the picture saving is triggered, a prompt box is popped up on the display screen of the electronic device to request the user to confirm whether to save the barrier-free reading configuration information of the picture.

[0205] For example, in the interface shown in FIG. 1, the configuration screen reading switch 101 is configured to be turned on, and the screen reading mode is entered. In the screen reading mode, when the picture saving is triggered, if the current trigger is a screenshot, a prompt box is popped up in the display screen of the electronic device, requesting the user to confirm whether to save the accessibility reading configuration information of the picture.

[0206] According to the method of the embodiment of the present application, the prompt box is popped up, and the user finally confirms whether to save the accessibility reading configuration information of the picture, which can effectively confirm the picture that needs to realize the accessibility reading according to the needs of the user, and avoid unnecessary waste of storage space caused by automatically saving the accessibility reading configuration information.

[0207] S420, if the accessibility reading configuration information of the picture is triggered to be saved, the accessibility reading configuration information of the picture is obtained, and the accessibility reading configuration information of the picture is saved.

[0208] Specifically, in an embodiment, the picture contains a plurality of image elements. The image element in the picture can be any content element in the picture, for example, a button, a window, a frame, etc. in the picture.

[0209] The accessibility reading configuration information of the picture contains text information of an image element in the picture that can support accessibility reading and position information of the image element.

[0210] Specifically, the accessibility reading configuration information of a picture contains text information and position information corresponding to the text information. The accessibility reading configuration information of a picture contains one or more pieces of text information. Each piece of text information in the accessibility reading configuration information of a picture corresponds to an image element in the picture that can support accessibility reading. The position information corresponding to the text information is the position information of the image element corresponding to the text information in the picture.

[0211] In an embodiment, the text information of the image element is used to describe the function of the image element and / or the content contained in the image element. Specifically, the text information of the image element can be the text content contained in the image element, or a text description describing the content indicated by the image element.

[0212] For example, FIG. 10 shows a schematic diagram of an interface display according to an embodiment of the present application.

[0213] As shown in FIG. 10, the image element 1001 is a button, and the text information of the image element 1001 is a text description "save" describing the content indicated by the image element 1001.

[0214] The image element 1002 is a button, and the text information of the image element 1002 is the text content "New" contained in the image element 1002. The text information of the image element 1002 can also be a text description "Create a new file" used to explain the text content "New".

[0215] The image element 1003 is a window, and the text information of the image element 1003 is a text description "Prompt information window" describing the content (the function of the image element 1003) referred to by the image element 1003.

[0216] The image element 1004 is a text box, and the text information of the image element 1004 is the text content "Title 1" contained in the image element 1004. The text information of the image element 1004 can also be a text description, for example, "Title text box", used to explain the function of the image element 1004 and / or the text content "Title 1".

[0217] Optionally, a person skilled in the art can configure the barrier-free reading configuration information according to actual needs in any feasible data format to implement S420, which is not specifically limited in the embodiments of the application.

[0218] For example, in an embodiment, it is assumed that A represents position information and B represents text information. The barrier-free reading configuration information of the picture can be in the following format and its extension: {A: [x1, y1, x2, y2], B: "Text 1"}. Alternatively, the barrier-free reading configuration information of the picture can be in the following format and its extension: {B: "Text 1", A: [x1, y1, x2, y2]}. Wherein, x1, y1, x2, y2 respectively represent the coordinates of the four corners of a rectangular region on the picture; and the actual text content is specifically "Text 1".

[0219] For another example, in another embodiment, it is assumed that the first half of a piece of barrier-free reading configuration information is position information, and the second half is text information. The barrier-free reading configuration information of the picture can be in the following format and its extension: {[x1, y1, x2, y2], "Text 1"}. For another example, in another embodiment, it is assumed that the first half of a piece of barrier-free reading configuration information is text information, and the second half is position information. The barrier-free reading configuration information of the picture can be in the following format and its extension: {"Text 1", [x1, y1, x2, y2]}.

[0220] Optionally, a person skilled in the art can adopt any feasible data saving method according to actual needs in the process of implementing S420, which is not specifically limited in the embodiments of the application.

[0221] For example, in one embodiment, in S420, the saving of the barrier-free reading configuration information is realized based on the Exchangeable Image File (exif) information.

[0222] The exif information is set specially for the photos of digital cameras, and is used to record various information at the time of shooting an image. For example, image information (manufacturer, resolution, etc.), camera shooting record (ISO, white balance, saturation, sharpness, etc.), thumbnail information (thumbnail width, height, etc.), position information (longitude, latitude, altitude at the time of shooting), etc. The exif information is placed in the image file header according to the JPEG file standard.

[0223] Since the exif information has editability, in one embodiment, the barrier-free reading configuration information of a picture is saved into the exif information of the picture.

[0224] For example, in one embodiment, the following code information is written in the exif information of the picture "Picture1.jpg".

[0225] description:

[0226] {A1: [x11, y11, x12, y12], B1: "Text 1"}

[0227] {A2: [x21, y21, x22, y22], B2: "Text 2"}

[0228] {A3: [x31, y31, x32, y32], B3: "Text 3"}

[0229] {A4: [x41, y41, x42, y42], B4: "Text 4"}

[0230] In the above barrier-free reading configuration information, "description" is a section identifier, and is used to indicate that the information section after it is barrier-free reading configuration information, so as to be distinguished from other description information in the exif information.

[0231] Each {} after "description" represents one piece of barrier-free reading configuration information, that is, the barrier-free reading configuration information of the picture "Picture1.jpg" contains 4 pieces of barrier-free reading configuration information. "A" represents position information, and "B" represents text information. Different numbers of A and B indicate different barrier-free reading configuration information.

[0232] Further, considering that all the barrier-free reading configuration information is saved into the exif information of the picture, the data amount of the exif information is increased, and the reading and loading speed of the exif information is slowed down. Therefore, in another embodiment, the barrier-free reading configuration information of the picture is saved as an independent barrier-free reading configuration file. The saving path of the barrier-free reading configuration file is saved into the exif information of the picture. In this way, when the barrier-free reading configuration information is needed to be loaded, the barrier-free reading configuration file of the picture can be located through the exif information of the picture, so as to obtain the barrier-free reading configuration information.

[0233] FIG. 11 shows a picture data saving structure according to an embodiment of the present application.

[0234] As shown in FIG. 11, after the picture is saved into the file storage system, the file storage system saves the picture itself file 1111 of the picture and the barrier-free reading configuration file 1112 of the picture.

[0235] For example, in an embodiment, the barrier-free reading configuration information of the picture “Picture1.jpg” is saved as a json file “description_Picture1.json”. The description_Picture1.json contains the following code information.

[0236] {A1: [x11, y11, x12, y12], B1: “text 1”}

[0237] {A2: [x21, y21, x22, y22], B2: “text 2”}

[0238] {A3: [x31, y31, x32, y32], B3: “text 3”}

[0239] {A4: [x41, y41, x42, y42], B4: “text 4”}

[0240] The following code information is written in the exif information of the picture “Picture1.jpg”.

[0241] desc: / / storage / emulate / 0 / picture / description_Picture1.json

[0242] In the above barrier-free reading configuration information, “desc:” is used to represent that the subsequent file path is the saving path of the barrier-free reading configuration file, so as to be distinguished from other description information in the exif information.

[0243] Further, in another embodiment, in the system configuration, the accessibility reading configuration file of a picture is a same name file (with different extensions, for example, the picture file name is Picture1.jpg, and the accessibility reading configuration file of the picture is description_Picture1.json) in the same path, or the accessibility reading configuration file of a picture is a file named according to a preset rule (for example, the picture file name is Picture1.jpg, and the accessibility reading configuration file of the picture is description_Picture1.json) in the same path. In S130, the accessibility reading configuration information of the picture is saved as an independent accessibility reading configuration file, and the accessibility reading configuration file is saved in the same path of the picture, the file name of the accessibility reading configuration file is the same as the picture name, or the accessibility reading configuration file is named according to a preset rule. In this way, when the accessibility reading configuration information needs to be loaded, the same name (or named according to a preset rule) accessibility reading configuration file in the same path of the picture can be searched according to the system setting.

[0244] Further, in another embodiment, an accessibility reading configuration summary file is created, and the accessibility reading configuration summary file contains the accessibility reading configuration information of multiple pictures. In the accessibility reading configuration summary file, the accessibility reading configuration information of different pictures is saved in segments. The accessibility reading configuration information of different pictures is distinguished by the saved path of the picture. In S130, the accessibility reading configuration information of the picture is written into the accessibility reading configuration summary file.

[0245] For example, in an application scenario, the accessibility reading configuration summary file contains the following content:

[0246] desc: / / storage / emulate / 0 / picture / Picture1.jpg

[0247] {A1: [x11, y11, x12, y12], B1: "Text 1"}

[0248] {A2: [x21, y21, x22, y22], B2: "Text 2"}

[0249] {A3: [x31, y31, x32, y32], B3: "Text 3"}

[0250] {A4: [x41, y41, x42, y42], B4: "Text 4"}

[0251] desc: / / storage / emulate / 0 / picture / Picture2.jpg

[0252] {A1: [x51, y51, x52, y52], B1: "Text 5"}

[0253] {A2: [x61, y61, x62, y62], B2: "Text 6"}

[0254] {A3: [x71, y71, x72, y72], B3: "Text 7"}

[0255] {A4: [x81, y81, x82, y82], B4: "Text 8"}

[0256] In the above-mentioned accessibility reading configuration summary file, the accessibility reading configuration information of two pictures, "Picture1.jpg" and "Picture2.jpg", is included.

[0257] Optionally, in an embodiment, on a device, one accessibility reading configuration summary file can be created, and when the saving of the accessibility reading configuration information is performed on the device, all the accessibility reading configuration information is written into the only one accessibility reading configuration summary file.

[0258] Optionally, in another embodiment, on a device, multiple accessibility reading configuration summary files can be created, and different accessibility reading configuration summary files correspond to different scenarios, for example, different picture types, and / or different picture folders, and / or different accounts, and / or different applications. In S130, according to the scenario corresponding to the picture, the accessibility reading configuration information is written into the corresponding accessibility reading configuration summary file.

[0259] In the accessibility reading configuration summary file, the accessibility reading configuration information of different pictures is segmented and distinguished by the saving path of the picture.

[0260] Optionally, in an embodiment, the accessibility reading configuration summary file is saved in a pre-configured saving path.

[0261] Optionally, in another embodiment, the accessibility reading configuration summary file is saved in an arbitrary saving path. The saving path of the accessibility reading configuration summary file is saved into the exif information of the picture.

[0262] Optionally, in the process of implementing S420, a person skilled in the art can adopt any feasible way to obtain the accessibility reading configuration information of the picture. The embodiments of the present application do not make specific limitations on this.

[0263] For example, in an embodiment, when a screenshot of an application interface of an application is taken, if the application supports accessibility screen reading, the accessibility reading configuration information can be obtained through the accessibility capability of the application itself. That is, the accessibility node information of each interface element on the application interface is obtained from the accessibility node information of the application, and the accessibility reading configuration information of the application interface is generated according to the accessibility node information of each interface element on the application interface.

[0264] In another embodiment, when the picture content of a picture contains text information, the text information in the picture can be recognized through an optical character recognition (OCR) capability, and the accessibility reading configuration information of the picture is generated according to the recognized text information.

[0265] Further, in most actual application scenarios, the pictures saved in a non-screenshot manner are usually existing ready-made pictures, such as network sharing pictures, etc. The pictures usually do not contain picture content corresponding to the accessibility node information. The accessibility node information cannot be directly obtained for the pictures. The picture content of the picture saved in a screenshot manner is usually a system interface or an application interface. The accessibility node information can be directly obtained for the picture.

[0266] Therefore, in an embodiment, for different picture saving manners, corresponding accessibility reading configuration information obtaining manners are adopted.

[0267] For example, FIG. 12 shows a picture saving method flowchart according to an embodiment of the present application.

[0268] In an embodiment, the electronic device performs the following flow as shown in FIG. 12.

[0269] S1100, it is confirmed whether the picture saving is triggered. Refer to S400.

[0270] S1101, when the picture saving is triggered, the picture itself file is saved. Refer to S401.

[0271] S1110, it is confirmed whether the picture saving triggered currently triggers the saving of the accessibility reading configuration information for the picture. Refer to S410.

[0272] S1120, if the saving of the accessibility reading configuration information for the picture is triggered, the picture saving manner is confirmed.

[0273] If the picture is saved in a non-screenshot manner, S1121 is executed.

[0274] S1121, for the picture content of the picture saved currently, the text in the picture is recognized through an OCR capability, and the text content and the position of each recognized text are obtained.

[0275] S1122, generate the accessibility reading configuration information of the picture according to the text content and the position of the text in the picture.

[0276] If it is a screenshot, perform S1123.

[0277] S1123, call the accessibility reading framework, and obtain the accessibility node information of all interface elements on the current application interface that have the accessibility node information and the positions of the interface elements through the accessibility reading framework.

[0278] S1124, generate the accessibility reading configuration information of the picture according to the accessibility node information of the interface elements and the positions of the interface elements.

[0279] According to the method of an embodiment of the present application, corresponding accessibility reading configuration information acquisition methods are adopted for different picture saving methods, which can simply and quickly realize the acquisition of the accessibility reading configuration information, reduce system overhead, and improve the acquisition efficiency of the accessibility reading configuration information.

[0280] Further, in an embodiment, the accessibility reading configuration information acquisition method is not limited according to the picture saving method. For example, for a picture saved in a screenshot mode, the accessibility reading configuration information can be generated based on the OCR capability, or the accessibility node information can be obtained, and the accessibility reading configuration information can be generated according to the accessibility node information.

[0281] Further, some interface elements do not contain recognizable text, and therefore, the corresponding accessibility reading configuration information cannot be generated through the OCR capability for the interface elements. If the interface elements have the accessibility node information, the corresponding accessibility reading configuration information can be generated according to the accessibility node information. Therefore, in an embodiment, in the process of acquiring the accessibility reading configuration information, the accessibility reading framework is preferentially called to obtain the accessibility node information through the accessibility reading framework, and the accessibility reading configuration information is generated according to the accessibility node information.

[0282] Further, in some application scenarios, a picture saved in a screenshot mode has a system interface or an application interface as the picture content, but the system interface or the application interface does not support accessibility screen reading, and the accessibility node information cannot be obtained for the system interface or the application interface.

[0283] Therefore, in an embodiment, for a picture saved in a screenshot mode, the accessibility reading configuration information is preferentially acquired through the accessibility capability of the application, and in the case where the current system interface or the application interface does not support accessibility screen reading, the accessibility reading configuration information is acquired through the OCR capability.

[0284] For example, FIG. 13 shows a flowchart of a picture saving method according to an embodiment of the present application.

[0285] In an embodiment, the electronic device performs the following flow as shown in FIG. 13.

[0286] S1200, confirming whether picture saving is triggered. Refer to S400.

[0287] S1201, when picture saving is triggered, saving the picture itself file. Refer to S401.

[0288] S1210, confirming whether the currently triggered picture saving triggers picture accessibility reading configuration information saving. Refer to S410.

[0289] S1220, if picture accessibility reading configuration information saving is triggered, confirming picture saving mode.

[0290] If it is non-screenshot saving, S1221 is executed.

[0291] S1221, for the picture content of the currently saved picture, recognizing the text in the picture by OCR capability, and obtaining the text content and position of each recognized text.

[0292] S1222, generating picture accessibility reading configuration information according to the text content and position of the text in the picture.

[0293] If it is screenshot, S1223 is executed.

[0294] S1223, confirming whether the current system interface or application interface supports accessibility screen reading.

[0295] If the current system interface or application interface supports accessibility screen reading, S1224 is executed.

[0296] S1124, calling the accessibility reading framework, and obtaining the accessibility node information of all interface elements with accessibility node information and the position of the interface elements on the current application interface by the accessibility reading framework.

[0297] S1125, generating picture accessibility reading configuration information according to the accessibility node information of the interface elements and the position of the interface elements.

[0298] If the current system interface or application interface does not support accessibility screen reading, S1221 is executed.

[0299] According to the method of the embodiment of the present application, the barrier-free node information is preferentially acquired, the barrier-free reading configuration information is generated according to the barrier-free node information, and the barrier-free reading configuration information is generated based on the OCR capability when the barrier-free node information cannot be acquired, so that the barrier-free node information can be successfully acquired under the premise of ensuring the accuracy and comprehensiveness of the barrier-free reading configuration information.

[0300] Further, in some application scenarios, the picture saved in the screenshot mode contains the system interface or the application interface supporting the barrier-free screen reading, but the picture content also contains the system interface or the application interface not supporting the barrier-free screen reading, or the picture content also contains the image element of the non-system interface or the application interface. In this case, if the barrier-free reading configuration information of the picture is generated only according to the barrier-free node information of the system interface or the application interface supporting the barrier-free screen reading, part of the image elements in the picture may be missed.

[0301] Therefore, in an embodiment, for the picture saved in the screenshot mode, the first barrier-free reading configuration information is acquired through the barrier-free capability of the application itself, the second barrier-free reading configuration information is acquired through the OCR capability recognition, and the barrier-free reading configuration information of the picture is acquired by comprehensively combining the first barrier-free reading configuration information and the second barrier-free reading configuration information.

[0302] For example, FIG. 14 shows a flowchart of a picture saving method according to an embodiment of the present application.

[0303] In an embodiment, the electronic device performs the following flow as shown in FIG. 14.

[0304] S1300, it is confirmed whether the picture saving is triggered. Refer to S400.

[0305] S1301, when the picture saving is triggered, the picture itself file is saved. Refer to S401.

[0306] S1310, it is confirmed whether the picture saving triggered at present triggers the barrier-free reading configuration information saving for the picture. Refer to S410.

[0307] S1320, if the barrier-free reading configuration information saving for the picture is triggered, the picture saving mode is confirmed.

[0308] If it is saved in the non-screenshot mode, S1321 is executed.

[0309] S1321, for the picture content of the picture saved at present, the text in the picture is recognized through the OCR capability, and the text content and the position of each recognized text are acquired.

[0310] S1322, generate the accessibility reading configuration information of the picture according to the text content and the position of the text in the picture.

[0311] If it is a screenshot, perform S1323.

[0312] S1323, determine whether the current system interface or application interface supports the accessibility screen reading.

[0313] If the current system interface or application interface does not support the accessibility screen reading, perform S1321.

[0314] If the current system interface or application interface supports the accessibility screen reading, perform S1324.

[0315] S1324, call the accessibility reading framework, and obtain the accessibility node information of all interface elements on the current application interface and the positions of the interface elements through the accessibility reading framework.

[0316] S1325, generate the first accessibility reading configuration information according to the accessibility node information of the interface elements and the positions of the interface elements.

[0317] S1326, identify the text in the picture through the OCR capability according to the picture content of the currently saved picture, and obtain the text content and the position of each identified text.

[0318] S1327, generate the second accessibility reading configuration information according to the text content and the position of the text in the picture.

[0319] S1328, compare the first accessibility reading configuration information and the second accessibility reading configuration information, and delete the repeated position information and the text information corresponding to the position information from the second accessibility reading configuration information when the first accessibility reading configuration information and the second accessibility reading configuration information contain the same position information.

[0320] S1329, merge the first accessibility reading configuration information and the remaining second accessibility reading configuration information to generate the accessibility reading configuration information of the picture.

[0321] According to the method of the embodiment of the application, on the basis of generating the accessibility reading configuration information according to the accessibility node information, the accessibility reading configuration information is further obtained based on the OCR capability to supplement, so that complete and comprehensive accessibility reading configuration information can be ensured.

[0322] Further, after S420, the saved pictures include at least two types, pictures supporting barrier-free reading (corresponding pictures have barrier-free reading configuration information) and pictures not supporting barrier-free reading (corresponding pictures have no barrier-free reading configuration information). In order to facilitate subsequent implementation of corresponding application functions for different types of pictures, in an embodiment, after S420, the pictures having barrier-free reading configuration information are marked as barrier-free reading pictures.

[0323] For example, the following code information is added in the exif information of the picture.

[0324] For example, description:(Y) or description:(N), where description:(Y) indicates that the picture is a barrier-free reading picture, and description:(N) indicates that the picture is not a barrier-free reading picture.

[0325] For example, for the case of saving barrier-free reading configuration information and / or the saving path of the barrier-free reading configuration file in the exif information, the barrier-free reading configuration information and / or the saving path of the barrier-free reading configuration file saved in the exif information are used as marking information. If the barrier-free reading configuration information and / or the saving path of the barrier-free reading configuration file are saved in the exif information, the picture is a barrier-free reading picture; if the barrier-free reading configuration information and / or the saving path of the barrier-free reading configuration file are not saved in the exif information, the picture is not a barrier-free reading picture.

[0326] Further, in an embodiment, after S420, for pictures marked as barrier-free reading pictures, a barrier-free reading mark is added to the picture icon when the picture icon is displayed.

[0327] For example, FIG. 15 shows a schematic diagram of an interface display according to an embodiment of the present application.

[0328] As shown in FIG. 15, icons of pictures 1-7 are displayed, where pictures 1 and 3 are barrier-free reading pictures, and a barrier-free reading mark 1400 is added to the icons of pictures 1 and 3.

[0329] According to the method of an embodiment of the present application, a barrier-free reading mark is added to the icon when a picture of a barrier-free reading picture is displayed, which allows the user to conveniently and quickly confirm the barrier-free reading picture, thereby facilitating the user to operate to implement barrier-free reading based on the picture.

[0330] S430, confirming whether the picture display is triggered.

[0331] For example, the user double-clicks the picture icon; for another example, the user right-clicks the picture icon and selects “open”.

[0332] Further, in an embodiment, the picture for which the picture presentation is triggered in S430 is the picture saved in S400-S420. In another embodiment, S430 and the following steps can also be performed for pictures acquired in other ways. For example, pictures sent by other electronic devices.

[0333] S431, when the picture presentation is triggered, presenting the picture.

[0334] S440, confirming whether the picture presentation triggered currently triggers the screen reading for the picture.

[0335] Optionally, in an embodiment, in S810, it is identified whether the picture is an accessibility reading picture, and when the picture is an accessibility reading picture, it is confirmed that the picture presentation triggered currently triggers the screen reading for the picture.

[0336] For example, the exif information of the picture is loaded, and it is identified whether the value of the "description:" field is (Y) or (N). If it is (Y), it is confirmed that the picture presentation triggered currently triggers the screen reading for the picture.

[0337] For another example, the exif information of the picture is loaded, and it is identified whether the "description:" field or the "desc: / / " field is contained in the exif information. If the "description:" field or the "desc: / / " field is contained, it is confirmed that the picture presentation triggered currently triggers the screen reading for the picture.

[0338] According to the method of an embodiment of the present application, when the picture is an accessibility reading picture, it is automatically confirmed that the picture presentation triggered currently triggers the screen reading for the picture, which can simplify the user operation process and improve the user experience of the screen reading.

[0339] Optionally, in an embodiment, according to the picture accessibility reading switch configured in the system setting, it is confirmed whether the picture presentation triggered currently triggers the screen reading for the picture.

[0340] For example, in an embodiment, as shown in FIG. 5, in the accessibility reading function setting interface, the picture accessibility reading switch 502 is configured. In the state that the picture accessibility reading switch 502 is turned on, in S810, it is identified whether the picture is an accessibility reading picture, and when the picture is an accessibility reading picture, it is confirmed that the picture presentation triggered currently triggers the screen reading for the picture.

[0341] In the case that the picture accessibility reading switch 502 is closed, in S810, it is not necessary to identify whether the picture is an accessibility reading picture, and it is directly determined that the picture display triggered currently does not trigger the accessibility screen reading for the picture.

[0342] Fig. 16 shows a partial flowchart of an accessibility screen reading method according to an embodiment of the present application.

[0343] The electronic device executes the following flow as shown in Fig. 16 to determine whether the accessibility screen reading for the picture is triggered.

[0344] S1500, a picture display is triggered.

[0345] S1501, the picture is displayed.

[0346] S1502, the state of the picture accessibility reading switch 502 is confirmed.

[0347] In the case that the picture accessibility reading switch 502 is closed, S1503 is executed.

[0348] S1503, it is determined that the accessibility screen reading for the picture is not triggered.

[0349] In the case that the picture accessibility reading switch 502 is opened, S1504 is executed.

[0350] S1504, it is confirmed whether the picture is an accessibility reading picture.

[0351] If the picture is not an accessibility reading picture, S1503 is executed.

[0352] If the picture is an accessibility reading picture, S1505 is executed.

[0353] S1505, it is determined that the accessibility screen reading for the picture is triggered.

[0354] According to the method of the embodiment of the present application, the accessibility reading for the picture is enabled or disabled by configuring the picture accessibility reading switch, which enables the user to flexibly and freely select whether to perform the accessibility screen reading for the picture content, and effectively improves the user experience.

[0355] Optionally, in another embodiment, according to the current device application scenario, it is confirmed whether the picture display triggered currently triggers the accessibility screen reading for the picture.

[0356] Specifically, in an embodiment, it is configured that the picture display in the barrier-free reading scenario triggers the barrier-free screen reading of the picture. Then, in the barrier-free reading scenario, after the picture display is triggered, the barrier-free screen reading of the picture is triggered synchronously for the barrier-free reading picture. In the non-barrier-free reading scenario, after the picture display is triggered, even if the currently displayed picture is a barrier-free reading picture, the barrier-free screen reading of the picture is not triggered.

[0357] For example, in an embodiment, in the interface as shown in FIG. 1, the screen reading switch 101 is configured to be turned on, and the screen reading mode is entered. In the screen reading mode, when the picture display is triggered, it is determined whether the picture is a barrier-free reading picture, and when the picture is a barrier-free reading picture, it is determined to trigger the barrier-free screen reading of the picture; when the picture is not a barrier-free reading picture, it is determined not to trigger the barrier-free screen reading of the picture.

[0358] In the interface as shown in FIG. 1, the screen reading switch 101 is configured to be turned off, and the screen reading mode is not entered. In the non-screen reading mode, when the picture display is triggered, it is not determined whether the picture is a barrier-free reading picture, and it is directly determined not to trigger the barrier-free screen reading of the picture.

[0359] According to the method of an embodiment of the present application, whether to trigger the barrier-free screen reading of the picture is determined according to the current device application scenario, and no additional independent configuration switch needs to be set for the saving of barrier-free reading configuration information, which can simplify the system configuration setting items, reduce the complexity of configuring the system setting items, and improve the operation experience of the user when configuring the system setting items.

[0360] Further, in another embodiment, a prompt box is popped up to request the user to confirm whether the picture display triggers the barrier-free screen reading of the picture.

[0361] Optionally, the user is requested to confirm whether to perform the barrier-free screen reading through the prompt box, which can be combined with the previous scheme of confirming whether to trigger the barrier-free screen reading of the picture as the final step of confirming whether to trigger the barrier-free screen reading of the picture.

[0362] For example, after the picture display is triggered, it is confirmed whether the picture is a barrier-free reading picture, and when the picture is a barrier-free reading picture, a prompt box is popped up on the display screen of the electronic device to request the user to confirm whether to perform the barrier-free screen reading.

[0363] FIG. 17 shows a partial flow diagram of a barrier-free screen reading method according to an embodiment of the present application.

[0364] The electronic device performs the following flow as shown in FIG. 17 to determine whether to trigger the barrier-free screen reading of the picture.

[0365] S1600, triggering picture display.

[0366] S1601, displaying the picture.

[0367] S1602, determining whether the picture is an accessible reading picture.

[0368] If the picture is not an accessible reading picture, S1603 is executed.

[0369] S1603, determining not to trigger the accessible screen reading for the picture.

[0370] If the picture is an accessible reading picture, S1604 is executed.

[0371] S1604, outputting a prompt box, the prompt box containing prompt information “whether to perform the accessible screen reading” and a “yes” button and a “no” button.

[0372] S1605, receiving a click operation of the user on the prompt box.

[0373] If the click operation of the user on the prompt box is clicking the “yes” button, S1606 is executed.

[0374] S1606, determining to trigger the accessible screen reading for the picture.

[0375] If the click operation of the user on the prompt box is clicking the “no” button, S1603 is executed.

[0376] FIG. 18 shows a schematic diagram of an interface display according to an embodiment of the present application.

[0377] As shown in FIG. 18, when the picture is displayed, if the picture is an accessible reading picture, a prompt box is popped up to request the user to confirm whether to trigger the accessible screen reading for the picture.

[0378] For another example, in the accessible reading function setting interface as shown in FIG. 5, the picture accessible reading switch 502 is configured to be turned on. In the state that the picture accessible reading switch 502 is turned on, when the picture display is triggered, it is determined whether the picture is an accessible reading picture, and when the picture is an accessible reading picture, a prompt box is popped up in the display screen of the electronic device to request the user to confirm whether to perform the accessible screen reading.

[0379] In the accessible reading function setting interface as shown in FIG. 5, the picture accessible reading switch 502 is configured to be turned off. In the state that the picture accessible reading switch 502 is turned off, when the picture display is triggered, it is not necessary to determine whether the picture is an accessible reading picture, and no prompt box is popped up, and it is directly determined not to trigger the accessible screen reading for the picture.

[0380] For example, in the interface shown in FIG. 1, the screen reading switch 101 is configured to be turned on, and the screen reading mode is entered. In the screen reading mode, when the picture display is triggered, it is determined whether the picture is an accessible screen reading picture. When the picture is an accessible screen reading picture, a prompt box is popped up on the display screen of the electronic device, and the user is requested to confirm whether to perform the accessible screen reading for the picture.

[0381] In the interface shown in FIG. 1, the screen reading switch 101 is configured to be turned off, and the screen reading mode is exited. In the non-screen reading mode, when the picture display is triggered, it is not necessary to determine whether the picture is an accessible screen reading picture, and no prompt box is popped up. The accessible screen reading for the picture is directly determined not to be triggered.

[0382] According to the method of the embodiment of the present application, the prompt box is popped up, and the user finally confirms whether to perform the accessible screen reading for the picture. The accessible screen reading can be effectively performed according to the user's needs, and the user experience is not affected by the automatic performance of the accessible screen reading.

[0383] Further, in another embodiment, an accessible picture reading button is provided on the picture display page, and the user can confirm whether to trigger the accessible screen reading for the picture by operating the accessible picture reading button.

[0384] Optionally, the display of the accessible picture reading button can be combined with the previous scheme of confirming whether to trigger the accessible screen reading for the picture.

[0385] For example, after the picture display is triggered, it is confirmed whether the picture is an accessible screen reading picture. When the picture is an accessible screen reading picture, the electronic device provides an accessible picture reading button on the display page of the picture. When the picture is not an accessible screen reading picture, the accessible picture reading button is not provided on the display page of the picture.

[0386] FIG. 19 shows a part of the flow diagram of the accessible screen reading method according to an embodiment of the present application.

[0387] The electronic device performs the following flow shown in FIG. 19 to determine whether to trigger the accessible screen reading for the picture.

[0388] S1800, the picture display is triggered.

[0389] S1801, the picture is displayed.

[0390] S1802, it is confirmed whether the picture is an accessible screen reading picture.

[0391] If the picture is not an accessible screen reading picture, S1803 is performed.

[0392] S1803, it is determined that the accessible screen reading for the picture is not triggered.

[0393] If the picture is an accessible read picture, S1804 is performed.

[0394] S1804, a picture accessible read button is displayed.

[0395] S1805, when receiving a click operation of the user on the picture accessible read button, it is determined that the accessible screen reading for the picture is triggered.

[0396] FIG. 20 shows an interface display diagram according to an embodiment of the present application.

[0397] As shown in FIG. 20, when the picture is displayed, if the picture is an accessible read picture, a button 1901 is displayed in the picture display interface. The user can start or close the accessible screen reading for the picture through the button 1901.

[0398] For another example, in the accessible read function setting interface as shown in FIG. 5, the picture accessible read switch 502 is opened. After the picture display is triggered, it is confirmed whether the picture is an accessible read picture, and when the picture is an accessible read picture, a picture accessible read button is provided on the display page of the picture. When the picture is not an accessible read picture, the picture accessible read button is not provided on the display page of the picture.

[0399] In the accessible read function setting interface as shown in FIG. 5, the picture accessible read switch 502 is closed. After the picture display is triggered, it is not necessary to confirm whether the picture is an accessible read picture, and the picture accessible read button is not provided on the display page of the picture.

[0400] For another example, in the interface as shown in FIG. 1, the screen reading switch 101 is opened, and the screen reading mode is entered. In the screen reading mode, when the picture display is triggered, it is determined whether the picture is an accessible read picture, and when the picture is an accessible read picture, a picture accessible read button is provided on the display page of the picture. When the picture is not an accessible read picture, the picture accessible read button is not provided on the display page of the picture.

[0401] In the interface as shown in FIG. 1, the screen reading switch 101 is closed, and the screen reading mode is exited. In the non-screen reading mode, when the picture display is triggered, it is not necessary to determine whether the picture is an accessible read picture, the picture accessible read button is not provided, and it is directly determined that the accessible screen reading for the picture is not triggered.

[0402] According to the method of the embodiment of the present application, the picture accessible read button is provided, and the user can control whether to start the accessible screen reading for the picture at any time, which can effectively perform the accessible screen reading according to the needs of the user, and avoid affecting the user experience caused by automatically performing the accessible screen reading.

[0403] According to the method, when starting to display the picture, whether to perform the barrier-free screen reading for the picture can be selected according to the user demand. Moreover, during the picture display, whether to start or interrupt the barrier-free screen reading for the picture can be selected according to the user demand at any time, so that the enabling of the barrier-free screen reading can completely match the user demand, the user operation flexibility is improved, and the user experience of the barrier-free screen reading is improved.

[0404] Optionally, in an embodiment, a prompt box is first popped up to request the user to confirm whether the picture display triggers the barrier-free screen reading for the picture. After the user confirms, based on the prompt box, that the picture display does not trigger the barrier-free screen reading for the picture, the prompt box is closed, and then a picture barrier-free reading button is provided on the picture display page, so that the user can subsequently confirm whether to trigger the barrier-free screen reading for the picture by operating the picture barrier-free reading button.

[0405] As shown in FIG. 18, when the picture is displayed, if the picture is a barrier-free reading picture, a prompt box is popped up to request the user to confirm whether to trigger the barrier-free screen reading for the picture. If the user clicks Yes, the barrier-free reading is started. If the user clicks No, the barrier-free reading is not started. Moreover, after the user clicks No, the prompt box is closed, and an interface as shown in FIG. 20 is displayed, and a button 1901 is displayed in the picture display interface. The user can start or close the barrier-free screen reading for the picture by operating the button 1901.

[0406] According to the method, when starting to display the picture, whether to perform the barrier-free screen reading for the picture can be selected according to the user demand. Moreover, during the picture display, whether to start or interrupt the barrier-free screen reading for the picture can be selected according to the user demand at any time, so that the enabling of the barrier-free screen reading can completely match the user demand, the user operation flexibility is improved, and the user experience of the barrier-free screen reading is improved.

[0407] S441, if the currently triggered picture display triggers the barrier-free screen reading for the picture, barrier-free reading configuration information of the picture is acquired.

[0408] The acquisition process of the barrier-free reading configuration information of the picture corresponds to the saving process of the barrier-free reading configuration information of the picture in S420.

[0409] S450, based on the barrier-free reading configuration information of the picture, the barrier-free screen reading for the picture is performed.

[0410] According to the method, the barrier-free screen reading for the picture can be implemented, the application scenario of the barrier-free screen reading is expanded, and the user experience of the barrier-free screen reading is improved.

[0411] Specifically, those skilled in the art can implement S450 in any feasible manner according to actual needs, which is not limited specifically herein.

[0412] For example, in an embodiment, according to the click position of the user, the image area corresponding to the click position is read on the barrier-free screen.

[0413] FIG. 21 shows a partial flowchart of a barrier-free screen reading method according to an embodiment of the present application.

[0414] In an embodiment, the electronic device implements the following flow shown in FIG. 21 to implement S450.

[0415] S2000, obtaining the click position of the user.

[0416] S2001, according to the click position of the user, matching the position information in the barrier-free reading configuration information, obtaining the text information corresponding to the position information.

[0417] S2002, sending the text information to the voice reading component for text reading.

[0418] According to the method of the embodiment of the present application, according to the user operation, the barrier-free screen reading of the object specified by the user is performed, so that the barrier-free screen reading can completely match the user demand, improve the user operation flexibility, and improve the user experience of the barrier-free screen reading.

[0419] For another example, in another embodiment, the text information corresponding to the barrier-free reading configuration information of the picture is read one by one.

[0420] Specifically, according to the position information in the barrier-free reading configuration information, the text information in the barrier-free reading configuration information is read one by one in a predetermined order (for example, from top to bottom, from left to right).

[0421] Optionally, during the reading of the text information in the barrier-free reading configuration information one by one, the image area corresponding to the text information being currently read is marked on the picture display page.

[0422] FIG. 22 shows a partial flowchart of a barrier-free screen reading method according to an embodiment of the present application.

[0423] In an embodiment, the electronic device implements the following flow shown in FIG. 21 to implement S450.

[0424] S2100, according to the position information in the barrier-free reading configuration information, extracting the first position information in the order from top to bottom, from left to right, and marking it as the first position information.

[0425] S2101, acquire first text information corresponding to first position information in the barrier-free reading configuration information.

[0426] S2102, send the first text information to a voice reading component for text reading.

[0427] S2103, during reading of the first text information, mark an image area corresponding to the first position information on the picture display page (for example, mark the image area with a red rectangular frame).

[0428] S2104, after reading the first text information, stop marking the image area corresponding to the first position information.

[0429] S2105, after reading the first text information, determine whether there is un-read text information in the barrier-free reading configuration information.

[0430] If not, the barrier-free screen reading is ended.

[0431] If yes, perform S2106.

[0432] S2106, according to the position information in the barrier-free reading configuration information, extract next position information of the first position information in the order from top to bottom and from left to right, and mark it as new first position information.

[0433] Return to S2101 after S2106.

[0434] According to the method of the embodiment of the application, after starting the barrier-free screen reading for the picture, the barrier-free screen reading for the picture is automatically performed without manual operation of the user, which simplifies the user operation process, enables the barrier-free screen reading to be automatically implemented, and improves the user experience of the barrier-free screen reading.

[0435] An embodiment of the application further provides a picture editing method. While a user edits a picture, barrier-free reading configuration information corresponding to the picture is loaded to enable the user to edit the barrier-free reading configuration information of the picture.

[0436] For example, in an embodiment, while editing the barrier-free reading picture, the text editing box is opened and the barrier-free reading configuration information of the picture is loaded in the text editing box when the picture image data is loaded, so that the user can edit the barrier-free reading configuration information of the picture through the text editing box.

[0437] For example, in an embodiment, when editing the barrier-free reading picture, the barrier-free reading configuration information of the picture is loaded and recognized at the same time of loading the picture image data, the text information in the barrier-free reading configuration information is corresponded to the picture area in the picture editing interface based on the position information in the barrier-free reading configuration information, and when the user edits the image area in the picture, the text information corresponding to the image area is synchronously provided for the user to perform synchronous editing.

[0438] In the description of the embodiments of the present application, in order to facilitate the description, the apparatus is described as various modules for description, and the division of each module is only a logical function division. In the implementation of the embodiments of the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0439] Specifically, the apparatus proposed in the embodiments of the present application can be integrated into a physical entity (for example, a GPU or other type of processor) in whole or in part, or can be physically separated. These modules can be all implemented in the form of software invoked by a processing element; or all implemented in the form of hardware; or some modules are implemented in the form of software invoked by a processing element, and some modules are implemented in the form of hardware. For example, the detection module can be a separately established processing element, or can be implemented in a certain chip of the electronic device. The implementation of other modules is similar. In addition, all or part of these modules can be integrated together, or can be independently implemented. In the implementation process, each step of the above method or each of the above modules can be completed by the integrated logic circuit of hardware in the processor element or the instruction in the form of software.

[0440] For example, the above modules can be one or more integrated circuits configured to implement the above method, for example: one or more application specific integrated circuits (ASIC), or one or more digital signal processors (DSP), or one or more field programmable gate arrays (FPGA), etc. For another example, these modules can be integrated together to implement in the form of system-on-a-chip (SOC).

[0441] An embodiment of the present application further proposes an electronic device. The electronic device is used to execute the method process or part of the method process described in the embodiments of the present application.

[0442] FIG. 23 is a structural schematic diagram of an electronic device according to an embodiment of the present application.

[0443] As shown in FIG. 23, the electronic device 2500 includes a memory 2502 for storing computer program instructions and a processor 2501 for executing the program instructions, wherein when the computer program instructions are executed by the processor 2501, the electronic device 2500 is triggered to perform the method steps as described in the embodiments of the present application.

[0444] Specifically, in an embodiment of the present application, the one or more computer programs described above are stored in the memory 2502, and the one or more computer programs include instructions that, when executed by the electronic device 2500, cause the electronic device 2500 to perform the method steps described in the embodiments of the present application.

[0445] It can be understood that the structural description of the electronic device 2500 in the embodiments of the present application does not constitute a specific limitation on the electronic device 2500. In other embodiments of the present application, the electronic device 2500 can include other components in addition to the processor 2501 and the memory 2502.

[0446] The processor 2501 can be a system on chip (SOC), and the processor 2501 can include a central processing unit (CPU) and can further include other types of processors.

[0447] The processor involved in the processor 2501 can include, for example, a CPU, a DSP, a microcontroller, or a digital signal processor, and can further include a GPU, an embedded neural network processing unit (NPU), and an image signal processor (ISP), and can further include necessary hardware accelerators or logic processing hardware circuits such as ASIC, or one or more integrated circuits for controlling the execution of the program of the technical solution of the present application. In addition, the processor can have the function of operating one or more software programs, and the software programs can be stored in a storage medium.

[0448] The processor 2501 can include one or more processing units. For example, the processor can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video code, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent components or integrated in one or more processors. In some embodiments, the electronic device 2500 can also include one or more processors 2501. Among them, the controller can generate operation control signals according to instruction operation codes and timing signals, complete the control of fetching and executing instructions.

[0449] In some embodiments, the processor 2501 can include one or more interfaces. The interface can include an inter-integrated circuit (I2C) interface, an integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a USB interface, etc. Among them, the USB interface is an interface that meets the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface can be used to connect a charger to charge the electronic device, or to transmit data between the electronic device and a peripheral device.

[0450] The electronic device 2500 can also include an external memory interface for connecting an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 2501 through the external memory interface to implement a data storage function. For example, files such as music and videos are saved in the external memory card.

[0451] The memory 2502 can include a code storage area and a data storage area. The code storage area can store an operating system, for example. The data storage area can store data created during the use of the electronic device 2500, etc. In addition, the memory 2502 can include a high-speed random access memory, and can also include a nonvolatile memory such as one or more disk storage components, flash memory components, universal flash storage (UFS), etc.

[0452] The memory 2502 can be read-only memory (ROM), other types of static storage devices that can store static information and instructions, random access memory (RAM), or other types of dynamic storage devices that can store information and instructions, electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disk storage, magneto-optical storage, solid state storage (including compact flash, secure digital, etc.), magnetic disk storage or other magnetic storage devices, or any other non-transitory computer-readable medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

[0453] The processor 2501 and the memory 2502 can be combined into one processing device, or more commonly, separate components from each other.

[0454] An embodiment of the present application also provides a chip device (electronic chip). The chip device is used to execute the method flow or part of the method flow described in the embodiments of the present application.

[0455] Specifically, the chip device includes a processor for executing program instructions, when the computer program instructions are executed by the processor, triggering the electronic chip to execute the method steps as described in the embodiments of the present application. The processor of the chip device can refer to the processor of the electronic device described above.

[0456] Optionally, the devices, apparatuses, modules, etc. described in the embodiments of the present application can be specifically implemented by computer chips or entities, or by products with certain functions.

[0457] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, device, or computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. In addition, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including a magnetic disk, optical disk, or CD-ROM) containing computer usable program code.

[0458] In several embodiments provided by the present application, any function if realized in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the parts of the prior art that make contributions or parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the embodiments of the present application.

[0459] Specifically, an embodiment of the present application further provides a computer readable storage medium, which stores a computer program. When the computer program runs on a computer, the computer program causes the computer to execute the method provided by the embodiments of the present application.

[0460] An embodiment of the present application further provides a computer program product, which includes a computer program. When the computer program runs on a computer, the computer program causes the computer to execute the method provided by the embodiments of the present application.

[0461] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, devices (apparatuses), and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and combinations of flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate an apparatus for implementing the functions specified in one or more flows in the flowcharts and / or one or more blocks in the block diagrams.

[0462] These computer program instructions can also be stored in a computer readable storage medium that can direct the computer or other programmable data processing devices to work in a specific manner, so that the instructions stored in the computer readable storage medium produce the manufactured product including the instruction apparatus, which implements the functions specified in one or more flows in the flowcharts and / or one or more blocks in the block diagrams.

[0463] These computer program instructions can also be loaded into a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart and / or block diagram block or blocks.

[0464] It should also be noted that, in the embodiments of the present application, "at least one" means one or more, and "multiple" means two or more. The "and / or" describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the cases of A alone, A and B together, and B alone. Wherein A and B can be singular or plural. The character " / " generally represents an "or" relationship between the front and rear associated objects. "At least one of the following" and the like means any combination of these items, including any combination of single or multiple items. For example, at least one of a, b and c can represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, c can be single or multiple.

[0465] In the embodiments of the present application, the terms "comprise", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitation, the element defined by the sentence "comprising a" does not exclude the presence of other identical elements in the process, method, article or device comprising the element.

[0466] The present application can be described in the general context of computer-executable instructions, such as program modules, executed by computers. Generally, program modules include routines, programs, objects, components, data structures, and the like, which perform particular tasks or implement particular abstract data types. The present application can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules can be located in both local and remote computer storage media including storage devices.

[0467] Each of the embodiments in the present application is described in a progressive manner, and the same or similar parts of each embodiment can be referred to each other. Each embodiment focuses on the difference from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0468] Those skilled in the art can understand that each unit and algorithm step described in the embodiments of the present application can be implemented by electronic hardware, computer software or a combination of the two. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0469] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described devices, apparatuses and units can refer to the corresponding processes in the foregoing method embodiments, which will not be described here.

[0470] The above is only a specific implementation of the present application. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by the present application, which should be covered within the protection scope of the present application. The protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A barrier-free screen reading method, characterized by, The method comprises: acquiring accessibility reading configuration information of a picture, wherein the accessibility reading configuration information comprises text information and position information corresponding to the text information; storing the picture and the accessibility reading configuration information; displaying the picture; performing accessibility screen reading on the picture according to the accessibility reading configuration information.

2. The method of claim 1, wherein: the accessibility reading configuration information comprises one or more pieces of text information; each piece of the text information corresponds to an image element in the picture; the text information is used to describe the function of the image element corresponding thereto; the position information corresponding to the text information is the position of the image element corresponding to the text information on the picture.

3. The method of claim 1, wherein, The acquiring of the accessibility reading configuration information of the picture comprises: acquiring all accessibility node information corresponding to a system interface or an application interface corresponding to the picture, and generating the accessibility reading configuration information of the picture according to the accessibility node information; and / or, performing text recognition on the picture content of the picture by optical character recognition capability to obtain a recognition result, and generating the accessibility reading configuration information of the picture according to the recognition result.

4. The method of claim 3, wherein, The acquiring of the accessibility reading configuration information of the picture comprises: when the picture is stored as a screenshot, acquiring all accessibility node information corresponding to a system interface or an application interface corresponding to the picture, and generating the accessibility reading configuration information of the picture according to the accessibility node information; when the picture is stored in a non-screenshot manner, performing text recognition on the picture content of the picture by optical character recognition capability to obtain a recognition result, and generating the accessibility reading configuration information of the picture according to the recognition result.

5. The method of claim 3, wherein, The acquiring of the accessibility reading configuration information of the picture comprises: determining whether there is corresponding accessibility node information for a system interface or an application interface corresponding to the picture; when there is corresponding accessibility node information, acquiring all accessibility node information corresponding to a system interface or an application interface corresponding to the picture, and generating the accessibility reading configuration information of the picture according to the accessibility node information; when there is no accessibility node information, performing text recognition on the picture content of the picture by optical character recognition capability to obtain a recognition result, and generating the accessibility reading configuration information of the picture according to the recognition result.

6. The method of claim 3, wherein, The acquiring of the accessibility reading configuration information of the picture comprises: acquiring all accessibility node information corresponding to a system interface or an application interface corresponding to the picture, and generating first accessibility reading configuration information according to the accessibility node information; performing text recognition on the picture content of the picture by optical character recognition capability to obtain a recognition result, and generating second accessibility reading configuration information according to the recognition result; integrating the first accessibility reading configuration information and the second accessibility reading configuration information to generate the accessibility reading configuration information of the picture.

7. The method according to any one of claims 1 to 6, characterized in that, The storing of the picture and the accessibility reading configuration information comprises: saving the barrier-free reading configuration information into the exchangeable image file information of the picture; or, saving the barrier-free reading configuration information as an independent barrier-free reading configuration file, and saving the storage path description of the barrier-free reading configuration file into the exchangeable image file information of the picture; or, saving the barrier-free reading configuration information as an independent barrier-free reading configuration file, and saving the barrier-free reading configuration file into a storage path of the picture; or, creating a barrier-free reading configuration summary file, and saving the barrier-free reading configuration information into the barrier-free reading configuration summary file, wherein the barrier-free reading configuration summary file is used to save the barrier-free reading configuration information of one or more pictures.

8. The method according to any one of claims 1-7, characterized in that, Before the barrier-free reading configuration information of the picture is acquired, the method further comprises: When the picture is triggered to be saved, it is confirmed whether the saving of the picture triggers the saving of the barrier-free reading configuration information.

9. The method according to any one of claims 1-8, characterized in that, The method further comprises: displaying an icon of the picture, and adding a barrier-free reading mark on the icon.

10. The method according to any one of claims 1-9, characterized in that, Before the picture is subjected to barrier-free screen reading according to the barrier-free reading configuration information, the method further comprises: When the picture is triggered to be displayed, it is confirmed whether the display of the picture triggers the barrier-free reading of the picture.

11. An electronic device, comprising: The electronic device comprises a memory for storing computer program instructions and a processor for executing the computer program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method steps of any one of claims 1-10.

12. A chip device, characterized by The chip device comprises a processor for executing a computer program, and when the computer program is executed by the processor, the chip device is triggered to execute the method of any one of claims 1-10.

13. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and when the computer program is run on a computer, the computer is caused to execute the method of any one of claims 1-10.

Images