A page access method, device, equipment and medium

Abstract

This invention discloses a page access method, apparatus, device, and medium, relating to the field of communication technology. The page access method applied to a client includes: after displaying the current HTML5 page on the screen, obtaining the text content corresponding to a target semantic element in the current HTML5 page, wherein the text content is obtained by character recognition of the target semantic element; obtaining the audio data corresponding to the text content, and performing voice playback on the audio data. The page access method provided by this invention improves the convenience of page access for visually impaired users and enhances their user experience by converting the text content of semantic elements in the current HTML5 page into audio data and performing voice playback.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of communication technology, and in particular to a page access method, device, equipment and medium. Background Art

[0002] With the development of information technology and the popularization of the Internet, people's work and life have undergone tremendous changes, and more and more people with disabilities are also using the Internet, including online shopping, learning, etc. However, due to the characteristics of the APP itself and the limitations of some pages, people with disabilities, such as visually impaired users, have certain obstacles when accessing pages.

[0003] For visually impaired users, the web pages in the APP enhance the convenience of page access by supporting functions such as image zooming.

[0004] In the process of implementing the present invention, the inventors found that the prior art has the following technical problems:

[0005] Although supporting the image zooming function can alleviate the problem of visually impaired users having difficulties accessing web pages to a certain extent, the inconvenience faced by visually impaired users in accessing web pages cannot be effectively and thoroughly improved due to the limited scale of image zooming and the fixed screen size. Summary of the invention

[0006] The embodiments of the present invention provide a page access method, apparatus, device and medium to improve the convenience of visually impaired users in accessing pages and enhance user experience.

[0007] In a first aspect, an embodiment of the present invention provides a page access method, comprising:

[0008] Acquire text content corresponding to a target semantic element in a currently displayed HTML5 page, wherein the text content is obtained after character recognition is performed on the target semantic element;

[0009] Obtaining audio data corresponding to the text content;

[0010] The audio data is voiced.

[0011] In a second aspect, an embodiment of the present invention further provides a page access method, comprising:

[0012] Receive a text acquisition request sent by a client, wherein the text acquisition request includes a target semantic element in a current HTML5 page displayed by the client;

[0013] Acquire text content corresponding to the target semantic element according to the text acquisition request, wherein the text content is obtained after character recognition is performed on the target semantic element;

[0014] The text content is sent to the client, so that the client obtains the audio data corresponding to the text content and performs voice broadcasting on the audio data.

[0015] In a third aspect, an embodiment of the present invention further provides a page access device, including:

[0016] A text content acquisition module, used to acquire text content corresponding to a target semantic element in a currently displayed HTML5 page, wherein the text content is obtained after character recognition is performed on the target semantic element;

[0017] An audio data acquisition module, used to acquire audio data corresponding to the text content;

[0018] The voice broadcast module is used to perform voice broadcast on the audio data.

[0019] In a fourth aspect, an embodiment of the present invention further provides a page access device, comprising:

[0020] A text acquisition request receiving module, used to receive a text acquisition request sent by a client, wherein the text acquisition request includes a target semantic element in a current HTML5 page displayed by the client;

[0021] A text content acquisition module, used to acquire text content corresponding to the target semantic element according to the text acquisition request, wherein the text content is obtained after character recognition is performed on the target semantic element;

[0022] The text content sending module is used to send the text content to the client, so that the client obtains the audio data corresponding to the text content and performs voice broadcasting on the audio data.

[0023] In a fifth aspect, an embodiment of the present invention further provides a computer device, the device comprising:

[0024] one or more processors;

[0025] A storage device for storing one or more programs;

[0026] When the one or more programs are executed by the one or more processors, the one or more processors implement the page access method provided in the first aspect of any embodiment of the present invention, and / or implement the page access method provided in the second aspect of any embodiment of the present invention.

[0027] In a sixth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a page access method as provided in the first aspect of any embodiment of the present invention, and / or implements a page access method as provided in the second aspect of any embodiment of the present invention.

[0028] The embodiment of the present invention obtains the text content corresponding to the target semantic element in the current HTML5 page being displayed, wherein the text content is obtained after character recognition of the target semantic element; obtains audio data corresponding to the text content, and voice broadcasts the audio data. By converting the text content in the semantic element in the current HTML5 page into audio data and voice broadcasting it, the convenience of visually impaired users in accessing the page is improved, and the user experience of the visually impaired users when accessing the page is enhanced. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 is a flow chart of a page access method provided by Embodiment 1 of the present invention;

[0030] Figure 2 is a flow chart of a page access method provided by Embodiment 2 of the present invention;

[0031] Figure 3a This is an interactive flow chart of a page access method provided by Embodiment 3 of the present invention;

[0032] Figure 3b is an interactive flow chart of another page access method provided by Embodiment 3 of the present invention;

[0033] Figure 4 is a flow chart of a page access method provided by Embodiment 4 of the present invention;

[0034] Figure 5 It is a structural diagram of a page access device provided by Embodiment 5 of the present invention;

[0035] Figure 6 It is a structural diagram of a page access device provided by Embodiment 6 of the present invention;

[0036] Figure 7 It is a structural diagram of a computer device provided in Embodiment 7 of the present invention. DETAILED DESCRIPTION

[0037] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0038] Embodiment 1

[0039] Figure 1 1 is a flow chart of a page access method provided by the first embodiment of the present invention. This embodiment can preferably be applied to a client, and can be applicable to the situation where a user, especially a visually impaired user, accesses a page. The method can be executed by a page access device, and the page access device can be implemented in software and / or hardware. For example, the page access device can be configured in a computer device. Figure 1 As shown, the method includes:

[0040] S110: Acquire text content corresponding to a target semantic element in a currently displayed Hypertext Markup Language (HTML) 5 page, wherein the text content is obtained after character recognition is performed on the target semantic element.

[0041] In this embodiment, the current HTML5 page can be a page provided by various application software in the client, and the page can preferably be an HTML5 page composed of pictures. Exemplarily, the current HTML5 page can be a product picture and text details page or a product browsing home page in a shopping application, or a detailed answer page for questions in a learning application, etc. The semantic elements in the current HTML5 page can be text, pictures, videos (preferably silent videos), buttons and other controls in the current HTML5 page. The target semantic elements can be all the semantic elements displayed in the current HTML5 page, or one or more semantic elements selected by the user by touching the screen or clicking the corresponding button.

[0042] Taking the current HTML5 page as a product picture and text details page as an example, the page includes a product text introduction, product pictures and a product silent video, among which the product text introduction, product pictures and product silent video are all semantic elements of the current HTML5 page, and the text in the product text introduction, as well as the text descriptions used to describe the product in the product pictures and product silent videos are all text content corresponding to the semantic elements.

[0043] Although the semantic elements of the current HTML5 page usually contain text content, for visually impaired users, especially completely blind visually impaired users, even if the client has a picture zooming function, they cannot know the specific text content contained in the picture. Therefore, preferably, the text content corresponding to the target semantic element in the current HTML5 page can be extracted, and fed back to the visually impaired user after corresponding processing, so that the visually impaired user can know the actual meaning expressed by the semantic element.

[0044] Exemplarily, the user sends a current HTML5 page acquisition request to the client through the screen display interface, and the client displays the current HTML5 page according to the current HTML5 page acquisition request, and determines the target semantic element in the current HTML5 page according to the specific operation of the user. After that, the client can directly obtain the text content corresponding to the target semantic element in the current HTML5 page, or indirectly obtain the text content corresponding to the target semantic element in the current HTML5 page from the server. Specifically, the client can directly obtain the text content corresponding to the target semantic element using a character recognition method, or send a text content acquisition request to the server (for example, the text content acquisition request includes the unique identification information of the target semantic element, and / or the target semantic element), and the server obtains the corresponding text content from the database and sends it to the client, wherein the database may be pre-stored with the corresponding text content, and can also send a text content acquisition request to the server (for example, the text content acquisition request includes the unique identification information of the target semantic element and the target semantic element), and the server obtains the text content corresponding to the target semantic element using a character recognition method and sends it to the client. The above-mentioned character recognition method may include a recognition method based on template matching, a recognition method based on character structure, a recognition method based on neural network, etc. Exemplarily, the character recognition method may be an OCR (Optical Character Recognition) character recognition method.

[0045] In one embodiment of the present invention, in order to be able to promptly respond to a user's request to obtain text content corresponding to a target semantic element, the text content corresponding to the target semantic element in the current HTML5 page is obtained, including: obtaining an HTML file corresponding to the current HTML5 page; traversing each page element in the HTML file, and for the traversed semantic elements, adding a click event code of the semantic element in the HTML file to monitor and process the click event of the semantic element; when monitoring the click event of the target semantic element in the current HTML5 page, obtaining the text content corresponding to the target semantic element.

[0046] Preferably, JS (JavaScript) code can be used to add a click event and a unique identifier of the semantic element to all semantic elements in the HTML file, wherein the click event can be used to determine whether the client responds to the click event when the user clicks the semantic element, and the unique identifier of the semantic element can be used to uniquely mark the semantic element. Exemplarily, all semantic elements in the HTML file can be traversed, and "onclick" events can be added to all semantic elements in the HTML file using JS code.

[0047] Preferably, during the process of the user using the client, the client can continuously monitor whether there is a user click event on the semantic element in the current HTML5 page. When the client monitors the user clicking on the semantic element in the current HTML5 page, it is determined that the clicked semantic element is the target semantic element, and the text content corresponding to the target semantic element can be obtained at this time. Exemplarily, the current HTML5 page includes picture 1, picture 2 and picture 3, the user clicks on picture 2 by touching the screen, and the client monitors the user clicking on picture 2 in the current HTML5 page, then picture 2 is used as the target semantic element of the current HTML5 page, and the text content in picture 2 is obtained; or, the current HTML5 page includes picture 1 and silent video 1, the user clicks on silent video 1 by touching the screen, and the client monitors the user clicking on silent video 1 in the current HTML5 page, then silent video 1 is used as the target semantic element of the current HTML5 page, and the text content in silent video 1 is obtained. It can be understood that the text content in the silent video can be the text content in each frame of the image constituting the silent video.

[0048] In one embodiment of the present invention, in order to prevent the user from missing the semantic elements in the current HTML5 page, obtaining the text content corresponding to the target semantic element in the current HTML5 page may include: obtaining each semantic element contained in the current HTML5 page; according to the position of each semantic element in the current HTML5 page, taking each semantic element as the target semantic element in turn and obtaining the text content corresponding to the target semantic element.

[0049] For example, if the semantic elements in the current HTML5 page are picture 1, picture 2 and picture 3 from top to bottom, then picture 1, picture 2 and picture 3 can be used as the target semantic elements of the current HTML5 page in turn, and the text content corresponding to picture 1, picture 2 and picture 3 can be obtained in turn.

[0050] The above example only refers to the case where the semantic element is a picture, and it does not constitute a limitation that obtaining the text content corresponding to the target semantic element in the current HTML5 page may include: obtaining each semantic element contained in the current HTML5 page; according to the position of each semantic element in the current HTML5 page, taking each semantic element as the target semantic element in turn and obtaining the text content corresponding to the target semantic element.

[0051] Exemplarily, obtaining the text content corresponding to the target semantic element in the current HTML5 page may also include: obtaining each image and each silent video contained in the current HTML5 page; according to the position of each image and each silent video in the current HTML5 page, taking each image and each silent video as the target semantic element in turn and obtaining the text content corresponding to the target semantic element. Exemplarily, obtaining the text content corresponding to the target semantic element in the current HTML5 page may also include: obtaining each image, each silent video and each button contained in the current HTML5 page; according to the position of each image, each silent video and each button in the current HTML5 page, taking each image, each silent video and each button as the target semantic element in turn and obtaining the text content corresponding to the target semantic element.

[0052] In one embodiment of the present invention, in order to accurately obtain the text content corresponding to the target semantic element, obtaining the text content corresponding to the target semantic element may include: performing character recognition on the target semantic element to obtain the text content corresponding to the target semantic element; or, sending a text acquisition request containing the target semantic element to a server, and receiving the text content obtained after performing character recognition on the target semantic element returned by the server.

[0053] Exemplarily, if the target semantic element is a target image, then obtaining the text content corresponding to the target semantic element may be that the client uses an OCR character recognition method to perform text recognition on the target image to obtain the text content corresponding to the target image, or the client sends a text acquisition request containing the target image to the server, and receives the text content returned by the server. Among them, the server can obtain the text content corresponding to the target image from the database according to the target image or the unique identifier of the target image and send it to the client. The database pre-stores the text content corresponding to each image in the current HTML5 page, and the pre-stored text content in the database is obtained from the corresponding image using the text recognition method. If the database does not include the text content corresponding to the target image, the server can also use the OCR character recognition method to obtain the text content corresponding to the target image and send it to the client. It can be understood that in order to facilitate the subsequent direct acquisition of the text content corresponding to the target image, the server can store the text content corresponding to the target image in the database after obtaining the text content corresponding to the target image using the OCR character recognition method.

[0054] On the basis of the above scheme, in order to facilitate the subsequent acquisition of the text content corresponding to the target semantic element directly in the database, after obtaining the text content corresponding to the target semantic element, the page access method may also include: sending the text content corresponding to the target semantic element to the server, so that the server adds the text content corresponding to the target semantic element to the database for storage, so that the client can subsequently request to obtain the text content corresponding to the target semantic element from the server.

[0055] The text content may be stored in the database in a manner that the text content is stored in correspondence with the unique identifier of the target semantic element, or in a manner that the text content is stored in correspondence with the target semantic element, or in a manner that the text content, the unique identifier of the target semantic element, and the target semantic element are stored in correspondence with each other.

[0056] S120: Acquire audio data corresponding to the text content.

[0057] Exemplarily, the client can directly obtain the audio data corresponding to the text content, or indirectly obtain the audio data corresponding to the text content from the server. Specifically, the client can directly obtain the audio data corresponding to the text content using the text-to-audio conversion method, or send a request to obtain the audio data corresponding to the text content to the server (exemplarily, the acquisition request can include the unique identification information of the target semantic element, and / or the text content corresponding to the target semantic element), and the server obtains the audio data corresponding to the corresponding text content from the database and sends it to the client, wherein the database can be pre-stored with text content and corresponding audio data, or send a request to obtain the audio data corresponding to the text content to the server (exemplarily, the acquisition request can include the unique identification information of the target semantic element, and / or the text content corresponding to the target semantic element), and the server obtains the audio data corresponding to the text content using the text-to-audio conversion method and sends it to the client, or when the client sends a request to obtain the text content to the server, the server obtains the corresponding text content and the audio data corresponding to the text content from the database and sends it to the client, and when the client needs to obtain the audio data corresponding to the text content, the audio data corresponding to the corresponding text content is directly obtained from the data received from the server.

[0058] The above-mentioned text-to-audio conversion method can preferably be a TTS (Text To Speech) method, which uses linguistics and psychology at the same time. With the support of a built-in chip, the text content can be converted into a natural speech stream in real time through a neural network.

[0059] In one embodiment of the present invention, in order to facilitate the subsequent acquisition of audio data directly based on the text content corresponding to the semantic element, the audio data corresponding to the text content is obtained, including: updating the content of the element attribute of the target semantic element in the HTML file corresponding to the current HTML5 page to the text content corresponding to the target semantic element; reading the content of the element attribute in the HTML file, and generating audio data corresponding to the read content.

[0060] After obtaining the text content of the target semantic element, the element attribute content of the target semantic element can be updated to the text content corresponding to the target semantic element. In subsequent use, the text content corresponding to the target semantic element can be directly determined in the element attribute content without using a character recognition method or sending a text content acquisition request to the server. The element attribute can be the Alt attribute of the HTML5 page.

[0061] Exemplarily, if the target semantic element is a target image, the Alt attribute of the target image in the HTML file may be modified to change the Alt attribute content to the text content corresponding to the target image.

[0062] On the basis of the above scheme, in order to facilitate the subsequent acquisition of audio data corresponding to the text content directly in the database, after generating the audio data corresponding to the read content, the page access method also includes: sending the generated audio data to the server, so that the server adds the audio data to the database for storage, so that the client can subsequently request the audio data of the text content corresponding to the target semantic element from the server.

[0063] The audio data may be stored in a manner that the audio data is stored in correspondence with the corresponding text content and the unique identifier of the corresponding semantic element, or the audio data may be stored in a manner that the audio data is stored in correspondence with the corresponding text content.

[0064] S130: Voice broadcast the audio data.

[0065] In this embodiment, after acquiring the audio data, the client can realize voice broadcasting of the audio data by providing an external speaker function.

[0066] A page access method provided in this embodiment obtains text content corresponding to a target semantic element in the current HTML5 page after the current HTML5 page is displayed on the screen, wherein the text content is obtained after character recognition of the target semantic element; obtains audio data corresponding to the text content, and voice broadcasts the audio data. By converting the text content in the semantic element in the current HTML5 page into audio data and voice broadcasting it, the convenience of visually impaired users in accessing pages is improved, and the user experience of visually impaired users when accessing pages is enhanced.

[0067] In one embodiment of the present invention, the page access method may further include: controlling the current HTML5 page to slide according to the progress of the voice broadcast of the audio data.

[0068] In this embodiment, in addition to controlling the sliding of the current HTML5 page according to the user's sliding operation, the client can also control the sliding of the current HTML5 page according to the progress of the voice broadcast of the audio data. By automatically sliding the current HTML5 page according to the progress of the voice broadcast, the user can know the approximate content of the current HTML5 page without having to operate the current HTML5 page, thereby improving the user experience.

[0069] Specifically, it is possible to obtain whether the coordinates of the control corresponding to the target semantic element of the current voice broadcast are within the current screen range. If not, the scrollable view carrying the current HTML5 page is controlled to slide so that the control corresponding to the target semantic element of the current voice broadcast enters the current screen range.

[0070] Embodiment 2

[0071] Figure 2 : is a flow chart of a page access method provided by the second embodiment of the present invention. This embodiment can preferably be applied to the server, and can be applicable to the situation when sending page response information to the client. The method can be executed by a page access device, and the page access device can be implemented in software and / or hardware. For example, the page access device can be configured in a computer device. Figure 2 As shown, the method includes:

[0072] S210: Receive a text acquisition request sent by a client, where the text acquisition request includes a target semantic element in a current HTML5 page displayed by the client.

[0073] In this example, the text acquisition request may include not only the target semantic element but also the unique identification information corresponding to the target semantic element.

[0074] S220. Acquire text content corresponding to the target semantic element according to the text acquisition request, wherein the text content is obtained after character recognition is performed on the target semantic element.

[0075] Preferably, the text content corresponding to the target semantic element can be determined based on the target semantic element in the text acquisition request, or the text content corresponding to the target semantic element can be matched from the database based on the target semantic element in the text acquisition request or the unique identification information corresponding to the target semantic element.

[0076] In one embodiment of the present invention, in order to accurately determine the text content corresponding to the target semantic element, obtaining the text content corresponding to the target semantic element may include: obtaining the text content corresponding to the target semantic element from a database; or, performing character recognition on the target semantic element to obtain the text content corresponding to the target semantic element.

[0077] In the database of the server, a data table including unique identification information (or semantic elements) corresponding to semantic elements and text content corresponding to the semantic elements may be pre-stored, wherein the unique identification information (or semantic elements) corresponding to the semantic elements and the text content corresponding to the semantic elements correspond one to one, and the text content corresponding to the semantic elements may be obtained by pre-character recognition of the semantic elements. After obtaining the text acquisition request, the server may obtain the text content corresponding to the target semantic element from the database according to the unique identification information or target semantic element corresponding to the target semantic element in the text acquisition request.

[0078] If the database does not include text content corresponding to the target semantic element, it is preferred to perform character recognition on the target semantic element in the text acquisition request to obtain the text content corresponding to the target semantic element.

[0079] On the basis of the above scheme, in order to facilitate the subsequent acquisition of the text content corresponding to the target semantic element directly in the database, after obtaining the text content corresponding to the target semantic element, it also includes: adding the text content corresponding to the target semantic element to the database for storage, so that the client can subsequently request to obtain the text content corresponding to the target semantic element.

[0080] Preferably, the text content is stored in the database in a manner that the text content is stored in correspondence with the unique identifier of the target semantic element, or in a manner that the text content is stored in correspondence with the target semantic element, or in a manner that the text content, the unique identifier of the target semantic element, and the target semantic element are stored in correspondence.

[0081] On the basis of the above scheme, in order to facilitate the subsequent acquisition of the text content corresponding to the target semantic element directly in the database, before obtaining the text content corresponding to the target semantic element from the database, it also includes: receiving the text content corresponding to the target semantic element sent by the client; adding the text content corresponding to the target semantic element to the database for storage.

[0082] The storage method of the text content in the database in this embodiment is the same as the storage method of the text content in the database described above, and will not be repeated here.

[0083] S230: Send the text content to the client, so that the client obtains audio data corresponding to the text content and performs voice broadcasting on the audio data.

[0084] After obtaining the text content corresponding to the target semantic element, the server may send the text content to the client, so that the client obtains the audio data corresponding to the text content and performs voice broadcasting of the audio data.

[0085] Based on the above scheme, the specific process of enabling the client to obtain the audio data corresponding to the text content and voice broadcast the audio data can be: the server receives an audio data acquisition request sent by the client to obtain the audio data corresponding to the text content, determines the audio data corresponding to the text content according to the audio data acquisition request, and sends the audio data to the client, so that the client can voice broadcast the audio data.

[0086] In this example, the audio data acquisition request may include one or more of a target semantic element, unique identification information corresponding to the target semantic element, and corresponding text content.

[0087] In the database of the server, a data table including unique identification information (or semantic elements) corresponding to semantic elements, text content corresponding to the semantic elements, and audio data corresponding to the text content may be pre-stored, or a first data table including unique identification information (or semantic elements) corresponding to semantic elements and text content corresponding to the semantic elements and a second data table including text content and audio data corresponding to the text content may be pre-stored. The text content corresponding to the semantic elements may be obtained by pre-character recognition of the semantic elements, and the audio data corresponding to the text content may be obtained by pre-text-to-speech conversion of the text content.

[0088] After the server obtains the audio data acquisition request, in one embodiment of the present invention, determining the audio data corresponding to the text content includes: obtaining the audio data corresponding to the text content from a database. Preferably, the audio data corresponding to the text content can be obtained from the database based on one or more of the unique identification information corresponding to the target semantic element in the audio data acquisition request, the target semantic element, and the text content.

[0089] If the database does not include audio data corresponding to the text content, it is preferred to perform text-to-speech conversion on the text content in the audio data acquisition request to obtain the audio data corresponding to the text content.

[0090] After the server obtains the audio data corresponding to the text content, the method may further include: adding the audio data corresponding to the text content to a database for storage, so that the client can subsequently request to obtain the audio data corresponding to the text content.

[0091] On the basis of the above scheme, in order to facilitate the subsequent acquisition of audio data corresponding to the text content directly in the database, before acquiring the audio data corresponding to the text content from the database, it can also include: receiving audio data sent by the client, wherein the audio data is generated by the client according to the content of the element attributes in the HTML file corresponding to the current HTML5 page, and the content of the element attributes in the HTML file includes the text content corresponding to the target semantic element; adding the audio data to the database for storage, so that the client can subsequently request from the server to obtain the audio data of the text content corresponding to the target semantic element.

[0092] A page access method provided by this embodiment receives a text acquisition request sent by a client, wherein the text acquisition request includes a target semantic element in a current HTML5 page displayed by the client; acquires text content corresponding to the target semantic element according to the text acquisition request, wherein the text content is obtained after character recognition of the target semantic element; and sends the text content to the client, so that the client acquires audio data corresponding to the text content and performs voice broadcasting of the audio data, thereby improving the convenience of visually impaired users in accessing pages and enhancing the user experience of visually impaired users when accessing pages.

[0093] Embodiment 3

[0094] Figure 3a is an interactive flow chart of a page access method provided by the third embodiment of the present invention. This embodiment is applicable to situations where page access is required. The method can be interactively executed by the client and the server. Figure 3a As shown, the method may specifically include the following steps:

[0095] S301: The client sends a text acquisition request to the server, where the text acquisition request includes a target semantic element in the current HTML5 page displayed by the client.

[0096] S302: The server receives a text acquisition request sent by the client.

[0097] S303: The server obtains text content corresponding to the target semantic element according to the text acquisition request, wherein the text content is obtained after character recognition is performed on the target semantic element.

[0098] S304: The server sends the text content corresponding to the target semantic element to the client.

[0099] S305: The client receives the text content corresponding to the target semantic element, obtains the audio data corresponding to the text content, and performs voice broadcasting on the audio data.

[0100] A page access method provided by this embodiment includes sending a text acquisition request from a client to a server, wherein the text acquisition request includes a target semantic element in a current HTML5 page displayed by the client; the server receives the text acquisition request sent by the client; the server acquires text content corresponding to the target semantic element according to the text acquisition request, wherein the text content is obtained after character recognition of the target semantic element; the server sends the text content corresponding to the target semantic element to the client; the client receives the text content corresponding to the target semantic element, acquires audio data corresponding to the text content and voice broadcasts the audio data, thereby improving the convenience of visually impaired users in accessing pages and enhancing the user experience of visually impaired users when accessing pages.

[0101] Figure 3b is an interactive flow chart of a page access method provided by Embodiment 3 of the present invention, such as Figure 3b As shown, the method may specifically include the following steps:

[0102] S306: The client sends a text acquisition request to the server, where the text acquisition request includes a target semantic element in the current HTML5 page displayed by the client.

[0103] S307: The server receives the text acquisition request sent by the client.

[0104] S308: The server obtains text content corresponding to the target semantic element from the database according to the text acquisition request, or performs character recognition on the target semantic element to obtain text content corresponding to the target semantic element.

[0105] S309: The server sends the text content corresponding to the target semantic element to the client.

[0106] S310: The client receives the text content corresponding to the target semantic element, and sends an audio data acquisition request for the audio data corresponding to the text content to the server.

[0107] S311. The server receives an audio data acquisition request sent by the client to acquire audio data corresponding to text content.

[0108] S312: The server obtains the audio data corresponding to the text content from the database according to the audio data acquisition request, or performs text-to-speech conversion on the text content to obtain the audio data corresponding to the text content.

[0109] S313: The server sends the audio data corresponding to the text content to the client.

[0110] S314: The client receives the audio data corresponding to the text content and performs voice broadcasting of the audio data.

[0111] A page access method provided by this embodiment is that after the current HTML5 page is displayed on the screen, the client sends a text acquisition request containing a target semantic element to the server, the server receives the text acquisition request, and then acquires the text content corresponding to the target semantic element from a database according to the text acquisition request, or performs character recognition on the target semantic element to obtain the text content corresponding to the target semantic element, and sends the text content to the client, the client receives the text content, and sends an audio data acquisition request for the audio data corresponding to the text content to the server, the server receives the audio data acquisition request, and then acquires the audio data corresponding to the text content from the database according to the audio data acquisition request, or performs text-to-speech conversion on the text content to obtain the audio data corresponding to the text content, and sends the audio data to the client, the client receives the audio data, and voice broadcasts the audio data, thereby improving the convenience of visually impaired users accessing pages and enhancing the user experience of visually impaired users when accessing pages, and can facilitate the subsequent direct acquisition of the text content corresponding to the target semantic element and the audio data corresponding to the text content in the database.

[0112] Embodiment 4

[0113] Figure 4 1 is a flow chart of a page access method provided by Embodiment 4 of the present invention. This embodiment provides a preferred embodiment based on the above embodiments. Figure 4 As shown, the client turns on the H5 page adaptation function according to the user operation. At this time, you can use JS to obtain each image in the current HTML5 page in the API that successfully loads the current HTML5 page view, and add a click identification method and a unique image identifier for each image. You can also mark whether accessibility information needs to be adapted. Specifically, traverse all images in HTML element, and add an "onclick" event, which can trigger the specified response interface called by the current HTML5 page when the image is clicked.

[0114] The user performs a click operation on the current HTML5 page, and the client obtains the screen contact point, determines the image resource (target semantic element) in the current HTML5 page based on the screen contact point, and obtains the text content corresponding to the image resource from the text content and image unique identifier database on the server side based on the image unique identifier of the image resource. If the text content corresponding to the image resource is not matched from the text content and image unique identifier database, the client uploads the image resource to the server side, and the server side identifies the text content corresponding to the image resource through OCR character recognition technology and sends the text content to the client side. After receiving the text content, the client uses the TTS text-to-audio conversion method to convert the text content into audio data, and uses the external speaker function to voice broadcast the audio data.

[0115] In order to enable quick reading and reduce time and operating costs during subsequent recycling, the above-mentioned server uses OCR character recognition technology to identify the text content corresponding to the image resource, and then stores the text content and the image resource's image unique identifier in a text content and image unique identifier database, where the image unique identifier is the keyword key and the text content is the value corresponding to the keyword key.

[0116] After receiving the text content, the client converts the text content into audio data using the TTS text-to-audio conversion method and performs voice broadcasting on the audio data. Specifically, the client obtains the HTML file corresponding to the current HTML5 page, and converts the corresponding image resource in the HTML file into an image according to the image identifier corresponding to the text content. The alt attribute information of the tag is updated to text content, and the text content is converted into audio data using the TTS text-to-audio conversion method.

[0117] Embodiment 5

[0118] Figure 5 1 is a schematic diagram of the structure of a page access device provided in Embodiment 5 of the present invention. The page access device can be implemented in software and / or hardware. For example, the page access device can be configured on a client to be configured in a computer device. Figure 5 As shown, the device includes a text content acquisition module 510, an audio data acquisition module 520 and a voice broadcast module 530, wherein:

[0119] The text content acquisition module 510 is used to acquire the text content corresponding to the target semantic element in the currently displayed HTML5 page, wherein the text content is obtained after character recognition is performed on the target semantic element.

[0120] An audio data acquisition module 520 is used to acquire audio data corresponding to the text content;

[0121] The voice broadcast module 530 is used to perform voice broadcasting on the audio data.

[0122] This embodiment provides a page access device, which uses a text content acquisition module to acquire text content corresponding to a target semantic element in a currently displayed HTML5 page, wherein the text content is obtained after character recognition of the target semantic element; uses an audio data acquisition module to acquire audio data corresponding to the text content, and uses a voice broadcast module to voice broadcast the audio data. By converting the text content in the semantic elements in the current HTML5 page into audio data and performing voice broadcast, the inconvenience of visually impaired users accessing pages is improved, and the user experience of visually impaired users when accessing pages is enhanced.

[0123] Optionally, based on the above scheme, the text content acquisition module 510 can be specifically used to: obtain the hypertext markup language HTML file corresponding to the current HTML5 page; traverse each page element in the HTML file, and for the traversed semantic elements, add the click event code of the semantic element in the HTML file to monitor and process the click event of the semantic element; when monitoring the click event of the target semantic element in the current HTML5 page, obtain the text content corresponding to the target semantic element.

[0124] Optionally, based on the above scheme, the text content acquisition module 510 can also be used to: obtain each semantic element contained in the current HTML5 page; according to the position of each semantic element in the current HTML5 page, take each semantic element as the target semantic element in turn and obtain the text content corresponding to the target semantic element.

[0125] Optionally, based on the above scheme, the text content acquisition module 510 can also be used to: perform character recognition on the target semantic element to obtain the text content corresponding to the target semantic element; or, send a text acquisition request containing the target semantic element to the server, and receive the text content obtained after character recognition of the target semantic element returned by the server.

[0126] Optionally, based on the above scheme, the page access device may also include a text content sending module, which is used to send the text content corresponding to the target semantic element to the server after obtaining the text content corresponding to the target semantic element, so that the server adds the text content corresponding to the target semantic element to the database for storage, so that the client can subsequently request to obtain the text content corresponding to the target semantic element from the server.

[0127] Optionally, based on the above scheme, the audio data acquisition module 520 can be specifically used to: update the content of the element attributes of the target semantic element in the HTML file corresponding to the current HTML5 page to the text content corresponding to the target semantic element; read the content of the element attributes in the HTML file, and generate audio data corresponding to the read content.

[0128] Optionally, based on the above scheme, the page access device may also include an audio data sending module, which is used to send the generated audio data to the server after generating the audio data corresponding to the read content, so that the server adds the audio data to the database for storage, so that the client can subsequently request the audio data of the text content corresponding to the target semantic element from the server.

[0129] Optionally, based on the above solution, the page access device may further include a page sliding module for controlling the current HTML5 page to slide according to the progress of the voice broadcast of the audio data.

[0130] The page access device provided in the embodiment of the present invention can execute the page access method provided in the first embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0131] Embodiment 6

[0132] Figure 6 1 is a schematic diagram of the structure of a page access device provided by Embodiment 6 of the present invention. The page access device can be implemented in software and / or hardware. For example, the page access device can be configured on the server side, or configured in a computer device. Figure 6 As shown, the device includes a text acquisition request receiving module 610, a text content acquisition module 620 and a text content sending module 630, wherein:

[0133] The text acquisition request receiving module 610 is used to receive a text acquisition request sent by a client, where the text acquisition request includes a target semantic element in a current HTML5 page displayed by the client;

[0134] A text content acquisition module 620 is used to acquire text content corresponding to a target semantic element according to a text acquisition request, wherein the text content is obtained after character recognition is performed on the target semantic element;

[0135] The text content sending module 630 is used to send the text content to the client, so that the client can obtain the audio data corresponding to the text content and perform voice broadcasting on the audio data.

[0136] A page access device provided by the present embodiment receives a text acquisition request sent by a client by utilizing a text acquisition request receiving module, wherein the text acquisition request includes a target semantic element in the current HTML5 page displayed by the client; acquires text content corresponding to the target semantic element according to the text acquisition request by utilizing a text content acquisition module, wherein the text content is obtained after character recognition of the target semantic element; and sends the text content to the client by utilizing a text content sending module, so that the client acquires audio data corresponding to the text content and performs voice broadcasting of the audio data, thereby improving the inconvenience of visually impaired users in accessing pages and enhancing the user experience of visually impaired users when accessing pages.

[0137] Optionally, based on the above solution, the text content acquisition module 620 can be specifically used to: acquire text content corresponding to the target semantic element from a database; or perform character recognition on the target semantic element to obtain text content corresponding to the target semantic element.

[0138] Optionally, based on the above scheme, the page access device may also include a database storage module, which is used to add the text content corresponding to the target semantic element to the database for storage after obtaining the text content corresponding to the target semantic element, so that the client can subsequently request to obtain the text content corresponding to the target semantic element.

[0139] Optionally, based on the above scheme, the database storage module can also be used to: receive the text content corresponding to the target semantic element sent by the client before obtaining the text content corresponding to the target semantic element from the database; and add the text content corresponding to the target semantic element to the database for storage.

[0140] Optionally, based on the above scheme, the database storage module can also be used for: receiving audio data sent by the client, wherein the audio data is generated by the client based on the content of element attributes in the HTML file corresponding to the current HTML5 page, and the content of the element attributes in the HTML file includes the text content corresponding to the target semantic element; adding the audio data to the database for storage, so that the client can subsequently request from the server to obtain the audio data of the text content corresponding to the target semantic element.

[0141] The page access device provided in the embodiment of the present invention can execute the page access method provided in the second embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0142] Embodiment 7

[0143] Figure 7 It is a structural diagram of a computer device provided in Embodiment 7 of the present invention. Figure 7A block diagram of an exemplary computer device 712 suitable for use in implementing embodiments of the present invention is shown. Figure 7 The computer device 712 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0144] like Figure 7 As shown, the computer device 712 is in the form of a general-purpose computing device. The components of the computer device 712 may include, but are not limited to: one or more processors 716, a system memory 728, and a bus 718 that connects different system components (including the system memory 728 and the processor 716).

[0145] Bus 718 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a local bus to processor 716, or a bus structure using any of a variety of bus architectures. These architectures include, by way of example, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MAC) bus, an Enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.

[0146] The computer device 712 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computer device 712, including volatile and non-volatile media, removable and non-removable media.

[0147] The system memory 728 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 730 and / or cache memory 732. The computer device 712 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage device 734 may be used to read and write non-removable, non-volatile magnetic media ( Figure 7 not shown, usually called a "hard drive"). Although Figure 7 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 718 via one or more data medium interfaces. The memory 728 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present invention.

[0148] A program / utility 740 having a set (at least one) of program modules 742 may be stored, for example, in the memory 728, such program modules 742 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 742 generally perform the functions and / or methods of the embodiments described herein.

[0149] The computer device 712 may also communicate with one or more external devices 714 (e.g., keyboard, pointing device, display 724, etc.), may also communicate with one or more devices that enable a user to interact with the computer device 712, and / or communicate with any device that enables the computer device 712 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication may be performed via an input / output (I / O) interface 722. In addition, the computer device 712 may also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN) and / or public network, such as the Internet) via a network adapter 720. As shown, the network adapter 720 communicates with other modules of the computer device 712 via a bus 718. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the computer device 712, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0150] The processor 716 executes various functional applications and data processing by running the program stored in the system memory 728, such as implementing the page access method provided in the embodiment of the present invention, which includes:

[0151] Obtaining text content corresponding to a target semantic element in the currently displayed HTML5 page, wherein the text content is obtained after character recognition of the target semantic element;

[0152] Get the audio data corresponding to the text content;

[0153] Voice broadcast of audio data.

[0154] And / or, implementing the page access method provided by an embodiment of the present invention, the method comprising:

[0155] Receive a text acquisition request sent by a client, where the text acquisition request includes a target semantic element in a current HTML5 page displayed by the client;

[0156] Acquire text content corresponding to the target semantic element according to the text acquisition request, wherein the text content is obtained after character recognition of the target semantic element;

[0157] The text content is sent to the client so that the client can obtain the audio data corresponding to the text content and perform voice broadcasting on the audio data.

[0158] Of course, those skilled in the art can understand that the processor can also implement the technical solution of the page access method provided by any embodiment of the present invention.

[0159] Embodiment 8

[0160] Embodiment 8 of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the page access method provided by the embodiment of the present invention is implemented. The method includes:

[0161] Obtaining text content corresponding to a target semantic element in the currently displayed HTML5 page, wherein the text content is obtained after character recognition of the target semantic element;

[0162] Get the audio data corresponding to the text content;

[0163] Voice broadcast of audio data.

[0164] And / or, implementing the page access method provided by an embodiment of the present invention, the method comprising:

[0165] Receive a text acquisition request sent by a client, wherein the text acquisition request includes a target semantic element in a current HTML5 page displayed by the client;

[0166] Acquire text content corresponding to the target semantic element according to the text acquisition request, wherein the text content is obtained after character recognition is performed on the target semantic element;

[0167] The text content is sent to the client, so that the client obtains the audio data corresponding to the text content and performs voice broadcasting on the audio data.

[0168] Of course, the computer program stored in a computer-readable storage medium provided by an embodiment of the present invention is not limited to the method operations described above, but can also execute related operations of the page access method provided by any embodiment of the present invention.

[0169] The computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0170] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0171] Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0172] Computer program code for performing the operations of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0173] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A page access method, characterized in that: include: Get the HTML file corresponding to the current Hypertext Markup Language HTML5 page displayed; Traversing each page element in the HTML file, and for the traversed semantic elements, adding a click event code of the semantic element in the HTML file to monitor and process the click event of the semantic element; When a click event on a target semantic element in the current HTML5 page is monitored, the text content corresponding to the target semantic element is obtained; or, each semantic element included in the current HTML5 page is obtained; According to the position of each semantic element in the current HTML5 page, each semantic element is taken as a target semantic element in turn and text content corresponding to the target semantic element is obtained, wherein the text content is obtained after character recognition is performed on the target semantic element; Sending the text content corresponding to the target semantic element to the server, so that the server adds the text content corresponding to the target semantic element to a database for storage, so that the client can subsequently request the text content corresponding to the target semantic element from the server; Update the content of the element attribute of the target semantic element in the HTML file corresponding to the current HTML5 page to the text content corresponding to the target semantic element; read the content of the element attribute in the HTML file, and generate audio data corresponding to the read content; Perform voice broadcasting on the audio data; and control the current HTML5 page to slide according to the progress of the voice broadcasting of the audio data; The generated audio data is sent to the server, so that the server adds the audio data to a database for storage, so that the client can subsequently request the audio data of the text content corresponding to the target semantic element from the server.

2. The method according to claim 1, characterized in that Obtaining the text content corresponding to the target semantic element includes: Performing character recognition on the target semantic element to obtain text content corresponding to the target semantic element; or, A text acquisition request including the target semantic element is sent to the server, and text content returned by the server after character recognition is performed on the target semantic element is received.

3. A page access method, characterized in that: include: Receive a text acquisition request sent by a client, wherein the text acquisition request includes a target semantic element in a current HTML5 page displayed by the client; According to the text acquisition request, the text content corresponding to the target semantic element is acquired from a database; or, character recognition is performed on the target semantic element to obtain the text content corresponding to the target semantic element; Adding the text content corresponding to the target semantic element to a database for storage, so that the client can subsequently request to obtain the text content corresponding to the target semantic element; Sending the text content to the client, so that the client obtains audio data corresponding to the text content and performs voice broadcasting of the audio data, and controls the current HTML5 page to slide according to the progress of the voice broadcasting of the audio data; Receive the audio data sent by the client, wherein the audio data is generated by the client according to the content of element attributes in the HTML file corresponding to the current HTML5 page, and the content of the element attributes in the HTML file includes the text content corresponding to the target semantic element; add the audio data to a database for storage, so that the client can subsequently request the audio data of the text content corresponding to the target semantic element from the server.

4. The method according to claim 3, characterized in that Before acquiring the text content corresponding to the target semantic element from the database, the method further includes: Receiving text content corresponding to the target semantic element sent by the client; The text content corresponding to the target semantic element is added to a database for storage.

5. A page access device, characterized in that: include: The text content acquisition module is used to obtain the HTML file corresponding to the current HTML5 page being displayed; Traversing each page element in the HTML file, and for the traversed semantic elements, adding a click event code of the semantic element in the HTML file to monitor and process the click event of the semantic element; When a click event on a target semantic element in the current HTML5 page is monitored, the text content corresponding to the target semantic element is obtained; or, each semantic element included in the current HTML5 page is obtained; According to the position of each semantic element in the current HTML5 page, each semantic element is taken as a target semantic element in turn and text content corresponding to the target semantic element is obtained, wherein the text content is obtained after character recognition is performed on the target semantic element; A text content sending module is used to send the text content corresponding to the target semantic element to the server, so that the server adds the text content corresponding to the target semantic element to the database for storage, so that the client can subsequently request the text content corresponding to the target semantic element from the server; An audio data acquisition module is used to update the content of the element attribute of the target semantic element in the HTML file corresponding to the current HTML5 page to the text content corresponding to the target semantic element; read the content of the element attribute in the HTML file, and generate audio data corresponding to the read content; A voice broadcast module, used for voice broadcasting the audio data; The page sliding module is used to control the sliding of the current HTML5 page according to the progress of the voice broadcast of the audio data; The audio data sending module is used to send the generated audio data to the server after generating the audio data corresponding to the read content, so that the server adds the audio data to the database for storage, so that the client can subsequently request the audio data of the text content corresponding to the target semantic element from the server.

6. A page access device, characterized in that: include: A text acquisition request receiving module, used to receive a text acquisition request sent by a client, wherein the text acquisition request includes a target semantic element in a current HTML5 page displayed by the client; A text content acquisition module, used to acquire text content corresponding to the target semantic element from a database according to the text acquisition request; or to perform character recognition on the target semantic element to obtain text content corresponding to the target semantic element; A database storage module is used to add the text content corresponding to the target semantic element to the database for storage, so that the client can subsequently request to obtain the text content corresponding to the target semantic element; A text content sending module, used to send the text content to the client, so that the client obtains the audio data corresponding to the text content and performs voice broadcasting on the audio data, and controls the current HTML5 page to slide according to the progress of the voice broadcasting of the audio data; The database storage module is also used for: Receive audio data sent by the client, where the audio data is generated by the client based on the content of element attributes in the HTML file corresponding to the current HTML5 page, and the content of the element attributes in the HTML file includes the text content corresponding to the target semantic element; add the audio data to the database for storage so that the client can subsequently request the audio data of the text content corresponding to the target semantic element from the server.

7. A computer device, characterized in that: The device comprises: one or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the page access method as described in any one of claims 1-2, and / or implement the page access method as described in any one of claims 3-4.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, it implements the page access method as described in any one of claims 1-2, and / or implements the page access method as described in any one of claims 3-4.

Images