Electronic book control method, electronic device and storage medium

Abstract

The present disclosure provides an e-book control method, electronic device and storage medium. The e-book control method includes: in response to receiving a user's control operation on an e-book reading page, determining whether the control operation is an operation of broadcasting the reading content of interest; in the case where the control operation is an operation of broadcasting the reading content of interest, determining the operation position of the operation of broadcasting the reading content of interest in the e-book reading page; determining the reading content of interest according to the operation position; switching the first audio segment currently being broadcast to the second audio segment corresponding to the reading content of interest. With the method provided by the present disclosure, the user can directly control the broadcasting of the reading content of interest without paying attention to other areas, thereby ensuring the user's attention to the reading. In addition, since the reading content of interest to the user can be directly broadcasted instead of the second audio segment corresponding to the opening content of the e-book reading page, the content of interest to the user can be quickly broadcasted, thereby improving the user experience.

Description

Technical Field

[0001] The present disclosure relates to the technical field of electronic books, and in particular to an electronic book control method, an electronic device and a storage medium. Background Art

[0002] Currently, in addition to providing users with an e-book reading interface display, e-book applications can also provide an e-book narration function, allowing users to obtain e-book content through multiple senses. When reading an e-book, users may actively turn pages based on their personal preferences and e-book content, causing the e-book reading interface of the e-book application to display other reading pages. When the e-book reading interface displays other reading pages, the narration function module still plays the content of the original reading page.

[0003] In order to match the content played by the narration function module with the display on the e-book reading interface, some e-book applications provide a narration content switching button. When the user clicks the narration content switching button, the audio played by the narration function module switches to the audio corresponding to the content displayed on the latest reading page. However, in order to switch the audiobook content through the narration content switching button, the user needs to switch between focusing on the reading content and the narration content switching button, which affects the user's concentration when reading. In addition, when the narration function module of the e-book application receives an operation on the narration content switching button, it plays the audio corresponding to the beginning content of the latest reading page, instead of playing the audio corresponding to the content that the user is focusing on, resulting in a poor user experience. Summary of the invention

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an e-book control method, an electronic device and a storage medium.

[0005] In a first aspect, an embodiment of the present disclosure provides an e-book control method, comprising:

[0006] In response to receiving a control operation of a user on an e-book reading page, determining whether the control operation is an operation of broadcasting a focused reading content;

[0007] In a case where the control operation is the operation of broadcasting the focused reading content, determining the operation position of the operation of broadcasting the focused reading content in the electronic book reading page;

[0008] Determine the reading content of interest according to the operation position;

[0009] The first audio segment currently being played is switched to the second audio segment corresponding to the focused reading content.

[0010] In a second aspect, an embodiment of the present disclosure provides an electronic device, including a processor and a memory, wherein the memory is used to store executable instructions, and the executable instructions enable the processor to perform the following operations:

[0011] In response to receiving a control operation of a user on an e-book reading page, determining whether the control operation is an operation of broadcasting a focused reading content;

[0012] In a case where the control operation is the operation of broadcasting the focused reading content, determining the operation position of the operation of broadcasting the focused reading content in the electronic book reading page;

[0013] Determine the reading content of interest according to the operation position;

[0014] The first audio segment currently being played is switched to the second audio segment corresponding to the focused reading content.

[0015] In a third aspect, an embodiment of the present disclosure provides a computer-readable storage medium, wherein the storage medium stores a computer program. When the computer program is executed by a processor, the processor implements the electronic book control method described in the first aspect.

[0016] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:

[0017] By adopting the technical solution provided by the embodiment of the present disclosure, when a user's control operation on an e-book reading page is received and it is determined that the control operation is an operation of broadcasting the reading content of interest, the operation position of the operation of broadcasting the reading content of interest in the e-book reading page is first determined, and then the reading content of interest is determined according to the operation position, and then the second audio clip corresponding to the reading content of interest is broadcast. In other words, the user can directly control the broadcasting of the reading content of interest without paying attention to other areas, thereby ensuring the user's reading attention. In addition, since the reading content of interest to the user can be directly broadcasted instead of the second audio clip corresponding to the opening content of the e-book reading page, the content of interest to the user can be quickly broadcasted, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0019] Figure 1 is a flow chart of an e-book control method provided by an embodiment of the present disclosure;

[0020] Figure 2is a flow chart of an e-book control method provided by another embodiment of the present disclosure;

[0021] Figure 3 is a flow chart of a method for determining focused reading content according to an operation position provided by some embodiments of the present disclosure;

[0022] Figure 4 A schematic structural diagram of an electronic device provided by an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0023] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0024] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0025] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0026] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0027] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0028] Figure 1 is a flow chart of the e-book control method provided by the embodiment of the present disclosure. Figure 1 As shown, the electronic book control method provided by the embodiment of the present disclosure includes steps S110-S140.

[0029] It should be noted that the electronic book control method provided in the embodiments of the present disclosure can be executed by an electronic device that can provide an electronic book reading function. In a specific embodiment, the aforementioned electronic device may include but is not limited to mobile terminals such as smart phones, laptops, personal digital assistants (PDAs), tablet computers (PADs), portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), and fixed terminals such as digital TVs, desktop computers, and smart home devices.

[0030] Step S110: In response to receiving a control operation of the user on the e-book reading page, determining whether the control operation is a preset operation of broadcasting the focused reading content.

[0031] The e-book reading page is an interface used by electronic devices to display the text content of e-books. Users can view the e-books displayed through the e-book reading page.

[0032] In the disclosed embodiment, when a user uses an electronic device to read an e-book, the user can operate the e-book reading interface. The user's control operation on the e-book reading page may be various types of operations, such as page turning operations, bookmarking operations, exiting the reading page operations, and broadcasting operations of the reading content of interest. Among them, the page turning operation is the operation of controlling the e-book reading interface to turn pages; the bookmarking operation is the operation of setting a reading tag on the e-book reading page; the exiting reading page operation is the operation of controlling the e-book to exit the current reading page and return to the main interface of the reading program; the broadcasting operation of the reading content of interest is the operation of triggering the electronic device to broadcast the e-book content that the user is interested in.

[0033] In the embodiment of the present disclosure, when the display screen of the electronic device is a touch screen, the aforementioned control operation may be a touch operation on the touch screen, such as a sliding touch operation, a single-click touch operation, or a double-click touch operation. When the display screen of the electronic device is a non-touch screen, the aforementioned control operation may be an operation performed by various keys, such as an operation performed by controlling the display icon of the display screen with a mouse, and the control operation may include a long-press sliding operation, a single-click operation, a double-click operation, or an operation performed using a specific trajectory.

[0034] After receiving the user's control operation on the e-book reading page, the electronic device will determine whether the control operation is an operation of broadcasting the focused reading content. In some embodiments of the present disclosure, the display screen of the electronic device is a touch screen, and the electronic device pre-sets a double-click touch operation as an operation of broadcasting the focused reading content. In other words, when the electronic device determines whether the control operation is an operation of broadcasting the focused reading content, it actually determines whether the control operation is a double-click operation.

[0035] Of course, in actual applications, the control operation may also be other types of control operations, such as a page turning operation or an operation of adding a reading tag. In one embodiment of the present disclosure, when the display screen of the electronic device is a touch screen, a sliding touch operation may be used as a page turning operation, for example, a left sliding touch operation or an upward sliding touch operation may be used as an operation of turning the page forward, and a right sliding touch operation or a downward sliding touch operation may be used as an operation of turning the page backward; for another example, the electronic device may use a single click touch operation as an operation of adding a reading bookmark.

[0036] Step S120: When the control operation is an operation of broadcasting the focused reading content, determine the operation position of the operation of broadcasting the focused reading content in the electronic book reading page.

[0037] In the embodiment of the present disclosure, if the electronic device determines that the control operation is an operation of broadcasting the focused reading content, the electronic device will determine the operation position of broadcasting the focused reading content on the electronic book reading interface.

[0038] For example, when the display screen of the electronic device is a touch screen, the electronic device will obtain the double-click touch position of the touch screen detecting the operation of broadcasting the focused reading content, and determine the operation position of the operation of broadcasting the focused reading content in the e-book reading page based on the double-click position and the display area of ​​the e-book reading interface.

[0039] For another example, when a user uses a mouse to control an electronic device to generate a control operation, the electronic device will determine the double-click position for broadcasting the focused reading content based on the position of the indicator mark of the mouse on the display screen, and determine the operation position of the operation for broadcasting the focused reading content on the e-book reading page based on the double-click position and the display area of ​​the e-book reading interface.

[0040] Step S130: determining the reading content of interest according to the operation position.

[0041] After determining the operation position, the electronic device determines the reading content that the user is interested in, that is, the focused reading content, according to the operation position. Specifically, the electronic device determines the focused reading content corresponding to the operation position according to the parsing rules, configuration parameters and size of the e-book reading page of the e-book parsing engine.

[0042] It should be noted that the focused reading content may be a chapter in an e-book, a paragraph in a chapter, or a sentence in a paragraph, and the embodiments of the present disclosure do not specifically limit this.

[0043] In one embodiment of the present disclosure, the electronic device determines the content displayed on the e-book reading page based on the font size, character spacing, line spacing, paragraph spacing and the size of the e-book reading interface configured in the typesetting engine, and determines the reading content of interest corresponding to the operation position based on the relationship between the displayed content and the e-book reading page displayed on the display screen.

[0044] The focused reading content is the content that the user focuses on when reading the e-book. For example, the focused reading content may be a main content paragraph, a wonderful content paragraph, or a key paragraph in the e-book.

[0045] Step S140: Switch the first audio segment currently being played to the second audio segment corresponding to the focused reading content.

[0046] The electronic device provided by the embodiment of the present disclosure is provided with an audio playback device in addition to providing a display screen for displaying e-book reading pages. The audio playback device can realize audio broadcasting of e-book contents.

[0047] In one embodiment, the electronic device is equipped with an audio presentation engine that is independent of the e-book reading display engine. When the electronic device uses the e-book reading display engine to drive the display screen to display the e-book reading page, it can simultaneously use the audio presentation engine to drive the audio playback device to present the content of the e-book. In one embodiment, the audio presentation engine can send an audio resource acquisition request to the server, obtain the audio resource sent by the server and present it. In another embodiment, the audio presentation engine can perform text content analysis on the e-book content in advance, obtain the audio content corresponding to the e-book content and present it.

[0048] It should be noted that, because the audio presentation engine is a presentation engine independent of the e-book reading display engine, there is no necessary correspondence between the audio content presented by the audio presentation engine and the content displayed on the e-book reading page driven by the e-book reading display engine. In some embodiments, the audio content presented by the audio presentation engine may be the content currently displayed on the e-book reading page, or may not be the content currently displayed on the e-book reading page. In some special cases, the audio content presented by the audio presentation engine and the content currently displayed on the e-book reading page belong to two separate e-books.

[0049] Of course, in some embodiments of the present disclosure, the audio playback engine may also be a sub-engine of the e-book reading and display engine, but the audio playback engine playback content is independent of the e-book reading engine driving the e-book reading page display content.

[0050] After determining the focused reading content according to the operation position, the electronic device switches the first audio segment currently being played to the second audio segment corresponding to the focused reading content. The electronic device switches the first audio segment currently being played to the second audio segment corresponding to the focused reading content by stopping the playing of the first audio segment and then playing the second audio segment corresponding to the focused content.

[0051] The method provided by the embodiment of the present disclosure is introduced below in conjunction with a specific example. Assume that a user is reading a collection of short stories using an electronic device, and the user is only interested in some short stories in the collection of poems. The user controls the electronic device to open a short story, so that it is displayed on the e-book reading page and the audio broadcast engine is used for audio broadcast. Subsequently, the user finds that the short story currently being broadcast is not the type he likes, so he quickly turns the pages of the e-book by controlling the e-book reading page. After the electronic device performs several page turning operations, it displays the short stories that the user really likes on the lower half of the e-book reading page. At this time, the user double-clicks the e-book reading page to display the lower half of the favorite short story, triggering the generation of an operation to broadcast the reading content of interest, and then the electronic device determines that the operation of broadcasting the reading content of interest is an operation for the lower half of the e-book reading page, and determines the reading content of interest based on this, and then the electronic device broadcasts the audio clip corresponding to the reading content of interest.

[0052] With the e-book control method provided by the embodiment of the present disclosure, when the electronic device receives the user's control operation on the e-book reading page and determines that the control operation is an operation of broadcasting the focused reading content, the electronic device determines the operation position of the operation of broadcasting the focused reading content in the e-book reading page, determines the focused reading content according to the operation position, and broadcasts the second audio clip corresponding to the focused reading content. That is, when the user sees the focused reading content through the e-book reading page, the electronic device can be controlled to broadcast the second audio clip corresponding to the focused content by triggering a specific control operation.

[0053] By adopting the e-book control method provided by the embodiment of the present disclosure, after the user performs the operation corresponding to the broadcasting of the reading content of interest at the reading content of interest, the electronic device can determine the reading content of interest to the user and broadcast the corresponding audio clip, thereby broadcasting the audio clip corresponding to the corresponding reading content. In other words, the user can directly control the broadcasting of the reading content of interest without paying attention to other areas, thereby ensuring the user's reading attention. In addition, directly broadcasting the reading content of interest to the user, rather than broadcasting the second audio clip corresponding to the opening content of the e-book reading page, realizes the rapid broadcasting of the content of interest to the user, thereby improving the user experience.

[0054] Figure 2 FIG. 1 is a flow chart of an electronic book control method provided by another embodiment of the present disclosure. Figure 2 As shown, in some other embodiments of the present disclosure, the electronic book control method includes steps S210-S260.

[0055] Step S210: In response to receiving a control operation of the user on the e-book reading page, determining whether the control operation is an operation of broadcasting the focused reading content.

[0056] Step S220: when the control operation is an operation of broadcasting the focused reading content, determining the operation position of the operation of broadcasting the focused reading content in the electronic book reading page.

[0057] Step S230: determining the reading content of interest according to the operation position.

[0058] In the embodiment of the present disclosure, the specific execution process of steps S210-S230 is the same as that of steps S110-S130 in the previous embodiment, and reference may be made to the previous description, which will not be repeated here.

[0059] Step S240: determining a content offset according to the focused reading content, where the content offset is the offset of the focused reading content relative to the start mark of the electronic book.

[0060] In some embodiments of the present disclosure, the electronic device may pre-mark the offset of each content area relative to the starting point of the electronic book mark. The aforementioned offset may be a word offset or a time offset, which is not particularly limited in the embodiments of the present disclosure.

[0061] In some other embodiments of the present disclosure, when a user opens an e-book and uses a narration engine to narrate the e-book contents, the electronic device can determine the offset of each content area in real time according to the narration speed and the e-book text contents.

[0062] It should be noted that the electronic book start mark in the embodiment of the present disclosure may be a mark set at the start page of the electronic book, or a mark set at the start position of a certain middle chapter of the electronic book, and the embodiment of the present disclosure does not specifically limit this.

[0063] Step S250: Determine the start point of the second audio segment according to the content offset.

[0064] After determining the content offset, the electronic device will then determine the start point of playing the audio segment corresponding to the content that the user is focusing on reading based on the content offset.

[0065] In some embodiments of the present disclosure, after determining the content offset, the electronic device searches for pre-downloaded audio track information to determine the corresponding audio segment playback start point. In other embodiments of the present disclosure, after determining the content offset, the electronic device determines the corresponding audio segment playback start point in the pre-converted audio content.

[0066] In some other embodiments of the present disclosure, after determining the content offset, the electronic book obtains the minimum content area including the focused reading content according to the content offset. For example, when the user's focused reading content is the third line in a paragraph, the electronic device determines the starting point of the paragraph including the user's focused reading content as the playback starting point according to the aforementioned content offset.

[0067] Step S260: Stop the broadcasting of the first audio segment, and broadcast the second audio segment from the broadcasting starting point.

[0068] After determining the broadcast start point, the electronic device stops broadcasting the first audio segment currently being played, and broadcasts the second audio segment from the broadcast start point determined in step S250.

[0069] Using the e-book reading method provided by the embodiment of the present disclosure, the electronic device determines the offset of the focused content according to the focused reading content and the pre-set e-book start mark, determines the playback start point of the second audio segment according to the content offset, and plays the second audio segment from the playback start point, thereby realizing rapid positioning and rapid playback of the second audio segment.

[0070] In addition to using the aforementioned steps S210-S260 to determine the second audio segment corresponding to the focused reading content to be played, in some other embodiments of the present disclosure, after determining the focused reading content, the electronic device may also perform the following operations: perform text to voice (T2V) conversion based on the focused reading content to generate the second audio segment. Subsequently, the electronic device may stop broadcasting the first audio segment and broadcast the second audio segment from the broadcast starting point.

[0071] Optionally, in some embodiments of the present disclosure, after the electronic device generates the second audio clip and plays the second audio clip, the following operation may be performed: recording the content offset of the focused reading content relative to the starting mark of the electronic book. By recording the content offset of the focused reading content relative to the starting mark of the electronic book, the current reading position and the speaking position may be recorded. If the user immediately closes the electronic book, the electronic device may determine the last reading position and the speaking position based on the content offset when the electronic book is opened next time, and then quickly switch to the last reading position and the speaking position.

[0072] Optionally, in some embodiments of the present disclosure, if the electronic device continues to play a third audio segment corresponding to the reading content after the focused reading content, the electronic device may also update the content offset based on the content offset and the length of the subsequent reading content.

[0073] Figure 31 is a flow chart of a method for determining the focused reading content according to the operation position provided by some embodiments of the present disclosure. Figure 3 As shown, the embodiment of the present disclosure may adopt steps S310 - S330 to determine the reading content of interest.

[0074] Step S310: Determine whether text content is displayed at the operation position; if so, execute step S320; if not, execute step S330.

[0075] Step S320: The text content displayed at the operation position is used as the focused reading content.

[0076] Step S330: The text content displayed in the vicinity of the operation position is used as the focused reading content.

[0077] When actually using an electronic device, the user may trigger the operation of focusing on reading content on the electronic device for various reasons, and the actual triggering position of the operation may not be the position where the operation is actually triggered. For example, a user may want to perform an operation of broadcasting the focused reading content on a certain paragraph of text content, but the shaking of the electronic device triggers the blank area next to it. According to common sense, if the user triggers a blank operation, the focused reading content is not determined, and the aforementioned steps S140 or steps S240-S260 will not be executed. At this time, the user needs to correctly trigger the operation of broadcasting the focused content in order to realize the broadcasting of the corresponding second audio clip. However, this will reduce the user experience. In order to avoid reducing the user experience, in the embodiment of the present disclosure, when the text content is not displayed at the operation position, the text content displayed in the adjacent area of ​​the operation position is used as the focused reading content, thereby avoiding the situation where the user operates at the wrong position and needs to re-execute the control operation.

[0078] Of course, if there is text content displayed at the operation position, the displayed text content can be used as the focus reading content.

[0079] Specifically, in some embodiments of the present disclosure, the electronic device may include steps S331-S332 when executing step S330.

[0080] Step S331: according to the operation position, determine the previous text content, the left text content or the right text content adjacent to the operation position.

[0081] Step S332: taking the adjacent preceding text content, the left text content or the right text content as the focused reading content.

[0082] More preferably, in order to more accurately make the second audio clip include the focused reading content, in the embodiment of the present disclosure, after determining the operation position, the text content in front, the text content in the back, or the text content in the back of the operation position is used as the focused reading content, so as to make the second audio clip include the user's focused content as much as possible.

[0083] For example, in some embodiments, if the operation of broadcasting the focused reading content triggered by the user is performed in the blank area between the left and right sides of the e-book reading page, the electronic device will use the previous paragraph as the focused reading content. For another example, if the operation of broadcasting the focused reading content triggered by the user is performed in the blank area on the left side of the e-book reading page, the electronic device will use the right paragraph as the focused reading content. For another example, if the operation of broadcasting the focused content triggered by the user is performed in the blank area on the right side of the e-book reading page, the electronic device will use the left paragraph as the focused reading content.

[0084] Optionally, in some embodiments of the present disclosure, the electronic device may further execute the following steps S150-S170 before executing step 140 or step S260.

[0085] Step S150: Determine a first content similarity between the focused reading content and the second audio segment.

[0086] Step S160: Determine whether the first content similarity reaches a preset similarity threshold; if so, execute step S140 or step S260; if not, execute step S170.

[0087] Step S170: Continue playing the first audio clip.

[0088] In the embodiment of the present disclosure, after determining the content that the user is interested in, the electronic device obtains the corresponding second audio segment by requesting the server, or determines the second audio segment by searching for pre-converted audio content. However, in some cases, the second audio segment obtained by the user may not match the interested reading content.

[0089] In order to avoid this situation, the disclosed embodiment first determines the content similarity between the focused reading content and the second audio clip. When the similarity reaches a preset similarity threshold, the second audio clip is played to avoid the problem of playing the wrong content. If the similarity does not reach the preset similarity threshold, the first audio clip continues to be played. Of course, in some embodiments, if the content similarity does not reach the preset similarity threshold, the electronic device can also stop playing the audio clip.

[0090] In some embodiments of the present disclosure, the electronic device executes step S150 to determine the content similarity between the focused reading content and the second audio segment, which may include steps S151-S153.

[0091] Step S151: Perform audio recognition on the audio clip to obtain recognized text content.

[0092] Step S152: Determine a second content similarity between the focused reading content and the recognized text content.

[0093] Step S153: Taking the second content similarity as the first content similarity.

[0094] In some other embodiments of the present disclosure, the electronic device executes step S150 to determine the content similarity between the focused reading content and the second audio segment, which may include steps S154-S156.

[0095] Step S154: Perform audio conversion on the focused reading content to obtain a converted audio segment.

[0096] Step S155: determining a third content similarity between the converted audio segment and the second audio segment;

[0097] Step S156: taking the second content similarity or the third content similarity as the first content similarity.

[0098] In some applications of the present disclosure, the e-book displayed on the e-book reading page and the e-book being narrated are not the same e-book. If the second audio clip is directly determined by using the narration start point determined in the aforementioned step S250, the narration content may be incorrect. To avoid this problem, in some embodiments of the present disclosure, before executing the aforementioned step S250, step S270 may be further included.

[0099] Step S270: Determine whether the e-book corresponding to the currently played audio clip and the e-book to which the focused reading content belongs are the same e-book; if so, execute step S250.

[0100] If the electronic book corresponding to the currently played audio clip and the electronic book to which the focused reading content belongs are the same electronic book, the determination of the playing start point can be directly applied to the aforementioned electronic book, and thus step S250 can be executed.

[0101] In some embodiments, if step S270 is determined to be no, the electronic device may further execute step S280: close the currently playing e-book audio, load the audio corresponding to the e-book to which the focused reading content belongs, and play the second audio segment from the starting point of the playback.

[0102] By closing the currently playing e-book audio and loading the audio corresponding to the e-book to which the focused reading content belongs, the correspondence between the playing audio content and the playing starting point can be achieved, and then the second audio segment can be played correctly.

[0103] Of course, in some embodiments, if the e-book corresponding to the currently played audio segment is not the same as the e-book to which the focused reading content belongs, the electronic device may also stop playing any audio.

[0104] Optionally, in some embodiments of the present disclosure, the electronic device may further execute step S180 while executing the aforementioned step S140 or S260.

[0105] Step S180: Mark the text corresponding to the audio content on the e-book reading page.

[0106] By playing the text corresponding to the audio content on the e-book reading page, the user can know in real time what content is being played, and can then track the progress of the playing and more accurately understand the location of the played content on the e-book reading page.

[0107] Similar to the above, in some embodiments of the present disclosure, the electronic device uses an e-book engine to monitor the user's control operation on the e-book reading page, and uses the e-book narration engine to narrate the currently narrated audio segment and the audio segment corresponding to the focused reading content. In other embodiments of the present disclosure, the electronic device can also use one engine to simultaneously perform the control operation on the e-book reading page, and narrate the currently narrated audio segment and the audio segment corresponding to the focused reading content.

[0108] Figure 4 The schematic diagram of the structure of an electronic device provided by an embodiment of the present invention is shown. The electronic device provided by the embodiment of the present disclosure may specifically be a server. The electronic device may execute the inverted index table construction method or resource retrieval method provided by the above embodiment.

[0109] It should be noted that Figure 4 The electronic device 400 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0110] The electronic device 400 conventionally includes a processor 410 and a computer program product or computer-readable medium in the form of a memory 420. The memory 420 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk or a ROM. The memory 420 has a storage space 421 for executable instructions (or program codes) 4211 for executing any method steps in the above-mentioned material processing method. For example, the storage space 421 for executable instructions may include individual executable instructions 4211 respectively used to implement various steps in the above-mentioned material processing method. These executable instructions may be read from or written to one or more computer program products. These computer program products include program code carriers such as a hard disk, a compact disk (CD), a memory card or a floppy disk. Such a computer program product is typically a portable or fixed storage unit. The storage unit may have a storage device 4211 having a storage medium 4212 and a storage medium 4213. Figure 4 The memory 420 in the electronic device 400 is similarly arranged as a storage segment or storage space. The executable instructions can be compressed, for example, in an appropriate form. Generally, the storage unit includes executable instructions for executing the steps of the material processing method according to the present invention, that is, codes that can be read by a processor such as the processor 410, and when these codes are executed by the electronic device 400, the electronic device 400 executes the various steps in the material processing method described above.

[0111] Of course, to simplify, Figure 4 Only some of the components related to the present invention in the electronic device 400 are shown, and components such as a bus, an input / output interface, an input device, an output device, etc. are omitted. In addition, according to specific application conditions, the electronic device 400 may also include any other appropriate components.

[0112] An embodiment of the present invention further provides a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the material processing method provided by each embodiment of the present invention.

[0113] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0114] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0115] In an embodiment of the present invention, program code for performing the operation of the present invention may be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0116] The present invention discloses:

[0117] A1. An electronic book control method, comprising:

[0118] In response to receiving a control operation of a user on an e-book reading page, determining whether the control operation is an operation of broadcasting a focused reading content;

[0119] In a case where the control operation is the operation of broadcasting the focused reading content, determining the operation position of the operation of broadcasting the focused reading content in the electronic book reading page;

[0120] Determine the reading content of interest according to the operation position;

[0121] The first audio segment currently being played is switched to the second audio segment corresponding to the focused reading content.

[0122] A2. The method according to A1, wherein determining the reading content of interest according to the operation position comprises:

[0123] Determining whether the operation position displays text content;

[0124] In the case where text content is displayed at the operation position, the text content displayed at the operation position is used as the focused reading content.

[0125] A3. The method according to A2, further comprising:

[0126] In the case that no text content is displayed at the operation position, the text content displayed in the vicinity of the operation position is used as the focused reading content.

[0127] A4. The method according to A3, wherein the text content displayed in the vicinity of the operation position is used as the focused reading content, including:

[0128] According to the operation position, determining the previous text content, the left text content or the right text content adjacent to the operation position;

[0129] The preceding text content, the left text content or the right text content is used as the focused reading content.

[0130] A5. According to any one of the methods 1-A4, before switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the method further includes:

[0131] Determine a content offset according to the focused reading content, wherein the content offset is an offset of the focused reading content relative to a start mark of the electronic book;

[0132] Determining a start point for playing the second audio segment according to the content offset;

[0133] The step of switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content includes:

[0134] Stop playing the first audio segment, and start playing the second audio segment from the playing start point.

[0135] A6. According to any one of A1-A5, before switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the method further includes:

[0136] Determining a first content similarity between the focused reading content and the second audio segment;

[0137] The step of switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content includes:

[0138] When the first content similarity reaches a preset similarity threshold, the currently played first audio segment is switched to the second audio segment.

[0139] A7. According to the method of A6, determining the first content similarity between the focused reading content and the second audio segment comprises:

[0140] Performing audio recognition on the second audio segment to obtain recognized text content;

[0141] determining a second content similarity between the focused reading content and the recognized text content; or,

[0142] Performing audio conversion on the reading content of interest to obtain a converted audio segment;

[0143] determining a third content similarity between the converted audio segment and the second audio segment;

[0144] The second content similarity or the third content similarity is used as the first content similarity.

[0145] A8. The method according to any one of A2-A7, stopping the broadcasting of the first audio segment, and broadcasting the second audio segment from the broadcasting starting point, the method further comprising:

[0146] Determine whether the e-book corresponding to the currently played audio clip and the e-book to which the focused reading content belongs are the same e-book;

[0147] When the electronic book corresponding to the currently played audio segment and the electronic book to which the focused reading content belongs are the same electronic book, the playing of the first audio segment is stopped, and the second audio segment is played from the playing starting point.

[0148] A9. The method according to A8, further comprising:

[0149] When the e-book corresponding to the currently played audio clip is not the same as the e-book described in the focused reading content, the currently played e-book audio is closed, the audio corresponding to the e-book to which the focused reading content belongs is loaded, and the second audio clip is played from the starting point of the playback.

[0150] A10. According to any one of A1-A4, before switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the method further includes:

[0151] Performing text-to-speech conversion based on the focused reading content to generate the second audio segment;

[0152] The step of switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content includes:

[0153] Stop playing the first audio clip, and play the second audio clip.

[0154] A11. The method according to A10, further comprising:

[0155] Recording the content offset of the focused reading content relative to the start mark of the electronic book; and updating the recorded content offset according to the content offset and the duration after the second audio segment is played.

[0156] A12. According to the method described in any one of A1-A11, while switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the method further includes:

[0157] The text corresponding to the audio content is marked on the e-book reading page.

[0158] A13. The method according to any one of A1 to A12,

[0159] An e-book engine is used to monitor the user's control operation on the e-book reading page, and an e-book narration engine is used to narrate the currently narrated audio segment and the audio segment corresponding to the focused reading content.

[0160] B14. An electronic device, comprising a processor and a memory, wherein the memory is used to store executable instructions, and the executable instructions enable the processor to perform the following operations:

[0161] In response to receiving a control operation of a user on an e-book reading page, determining whether the control operation is an operation of broadcasting a focused reading content;

[0162] In a case where the control operation is the operation of broadcasting the focused reading content, determining the operation position of the operation of broadcasting the focused reading content in the electronic book reading page;

[0163] Determine the reading content of interest according to the operation position;

[0164] The first audio segment currently being played is switched to the second audio segment corresponding to the focused reading content.

[0165] B15. According to the electronic device described in B14, when the processor executes the step of determining the focused reading content according to the operation position, the executable instructions specifically cause the processor to perform the following operations:

[0166] Determining whether the operation position displays text content;

[0167] In the case where text content is displayed at the operation position, the text content displayed at the operation position is used as the focused reading content.

[0168] B16. The electronic device according to B15, wherein when the processor determines that no text content is displayed at the operating position, the executable instructions further cause the processor to perform the following operations:

[0169] The text content displayed in the vicinity of the operation position is used as the focused reading content.

[0170] B17. The electronic device according to B16, wherein the processor uses the text content displayed in the vicinity of the operation position as the focused reading content, and the executable instructions specifically cause the processor to perform the following operations:

[0171] Determining, according to the operation position, a preceding text content, a left text content, or a right text content adjacent to the operation position;

[0172] The preceding text content, the left text content or the right text content is used as the focused reading content.

[0173] B18. According to any one of B14-B17, the electronic device, before the processor switches the currently played audio segment to the audio segment corresponding to the focused reading content, the executable instructions further cause the processor to perform the following operations:

[0174] Determine a content offset according to the focused reading content, wherein the content offset is an offset of the focused reading content relative to a start mark of the electronic book;

[0175] Determining a start point for playing the second audio segment according to the content offset;

[0176] When the processor executes the step of switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the executable instruction specifically causes the processor to perform the following operations:

[0177] Stop playing the first audio segment, and start playing the second audio segment from the playing start point.

[0178] B19. According to the electronic device described in B14-B17, before broadcasting the second audio segment from the broadcast starting point, the executable instructions further cause the processor to perform the following operations:

[0179] Determining a first content similarity between the focused reading content and the second audio segment;

[0180] When the processor executes the step of switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the executable instructions specifically cause the processor to perform the following operations:

[0181] When the first content similarity reaches a preset similarity threshold, the second audio segment is broadcasted from the broadcast starting point.

[0182] B20. According to the electronic device described in B19, when the processor executes the step of determining the first content similarity between the focused reading content and the second audio segment, the executable instructions specifically cause the processor to perform the following operations:

[0183] Performing audio recognition on the second audio segment to obtain recognized text content;

[0184] determining a second content similarity between the focused reading content and the recognized text content; or,

[0185] Performing audio conversion on the reading content of interest to obtain a converted audio segment;

[0186] determining a third content similarity between the converted audio segment and the second audio segment;

[0187] The second content similarity or the third content similarity is used as the first content similarity.

[0188] B21. The electronic device according to any one of B18-B20, before the processor executes the stopping of the broadcasting of the first audio segment and broadcasting the second audio segment from the broadcasting starting point, the executable instructions further cause the processor to perform the following operations:

[0189] Determine whether the e-book corresponding to the currently played audio clip and the e-book to which the focused reading content belongs are the same e-book;

[0190] When the processor determines that the electronic book corresponding to the currently played audio segment and the electronic book to which the focused reading content belongs are the same electronic book, the processor stops playing the first audio segment and plays the second audio segment from the playing starting point.

[0191] B22. The electronic device according to B21, when the processor determines that the e-book corresponding to the currently played audio clip and the e-book described in the focused reading content are not the same e-book, the executable instructions specifically cause the processor to perform the following operations:

[0192] The currently played e-book audio is closed, the audio corresponding to the e-book to which the focused reading content belongs is loaded, and the second audio segment is played from the playing starting point.

[0193] B23. According to any one of B14-B17, the electronic device, before the processor switches the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the executable instructions further cause the processor to perform the following operations:

[0194] Perform text-to-speech conversion based on the focused reading content to generate the second audio segment.

[0195] B24. The electronic device according to B23, wherein the executable instructions further cause the processor to perform the following operations:

[0196] Recording the content offset of the focused reading content relative to the start mark of the electronic book; and

[0197] In the case of continuing to play the third audio segment corresponding to the reading content after the focused reading content, the content offset is updated according to the content offset and the length of the subsequent reading content.

[0198] B25. The electronic device according to any one of B14-B24, wherein while the processor is executing the step of switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the executable instructions further cause the processor to perform the following operations:

[0199] The text corresponding to the broadcast content is marked on the e-book reading page.

[0200] B26. An electronic device according to any one of B14-B25,

[0201] The processor uses an electronic book engine to monitor the user's control operation on the electronic book reading page, and uses an electronic book narration engine to narrate the currently narrated audio segment and the audio segment corresponding to the focused reading content.

[0202] C27. A computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the processor implements the electronic book control method described in any one of C1-C14 above.

[0203] The various component embodiments of the present invention can be implemented in hardware in all or part of the steps, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or a digital signal processor (DSP) can be used in practice to implement some or all functions of some or all components in an electronic device according to an embodiment of the present invention. The present invention can also be implemented as a device or apparatus program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program implementing the present invention can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0204] The above description is only a preferred embodiment of the present invention and an explanation of the technical principles used. Those skilled in the art should understand that the disclosure scope involved in the present invention is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present invention (but not limited to) by each other.

[0205] In addition, although each operation is described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present invention. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0206] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. An electronic book control method, characterized in that: include: In response to receiving a control operation of a user on an e-book reading page, determining whether the control operation is an operation of broadcasting a focused reading content; In a case where the control operation is the operation of broadcasting the focused reading content, determining the operation position of the operation of broadcasting the focused reading content in the electronic book reading page; Determine the reading content of interest according to the operation position; Determine a content offset according to the focused reading content, wherein the content offset is an offset of the focused reading content relative to a start mark of the electronic book; Determining a speaking start point in the existing second audio segment according to the content offset; Switch the first audio segment currently being played to the second audio segment corresponding to the focused reading content, The step of switching the currently played first audio segment to the second audio segment corresponding to the focused reading content includes: Stop playing the first audio segment, and start playing the second audio segment from the playing start point.

2. The method according to claim 1, characterized in that The determining of the focused reading content according to the operation position includes: Determining whether the operation position displays text content; In the case where text content is displayed at the operation position, the text content displayed at the operation position is used as the focused reading content.

3. The method according to claim 2, characterized in that The method further comprises: In the case that no text content is displayed at the operation position, the text content displayed in the vicinity of the operation position is used as the focused reading content.

4. The method according to claim 3, characterized in that The step of using the text content displayed in the vicinity of the operation position as the focused reading content includes: According to the operation position, determining the previous text content, the left text content or the right text content adjacent to the operation position; The preceding text content, the left text content or the right text content is used as the focused reading content.

5. The method according to claim 1, characterized in that Before switching the currently played first audio segment to the second audio segment corresponding to the focused reading content, the method further includes: Determining a first content similarity between the focused reading content and the second audio segment; The step of switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content includes: When the first content similarity reaches a preset similarity threshold, the currently played first audio segment is switched to the second audio segment.

6. The method according to claim 5, characterized in that The determining of a first content similarity between the focused reading content and the second audio segment includes: Performing audio recognition on the second audio segment to obtain recognized text content; Determining a second content similarity between the focused reading content and the recognized text content; or, Performing audio conversion on the reading content of interest to obtain a converted audio segment; determining a third content similarity between the converted audio segment and the second audio segment; The second content similarity or the third content similarity is used as the first content similarity.

7. The method according to any one of claims 1 to 4, characterized in that Before switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the method further includes: Perform text-to-speech conversion based on the focused reading content to generate the second audio segment.

8. The method according to claim 7, characterized in that Also includes: When the e-book corresponding to the first audio clip currently being played is not the same as the e-book to which the focused reading content belongs, the audio of the e-book currently being played is closed, the audio corresponding to the e-book to which the focused reading content belongs is loaded, and the second audio clip is played from the starting point of the playback.

9. The method according to claim 7, characterized in that: Also includes: Recording the content offset of the focused reading content relative to the start mark of the e-book; And, the recorded content offset is updated according to the content offset and the duration after the second audio segment is played.

10. The method according to any one of claims 1 to 4, characterized in that While switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the method further includes: The text corresponding to the audio content is marked on the e-book reading page.

11. The method according to any one of claims 1 to 4, characterized in that: An e-book engine is used to monitor the user's control operation on the e-book reading page, and an e-book narration engine is used to narrate the currently narrated audio segment and the audio segment corresponding to the focused reading content.

12. An electronic device, characterized in that: The invention comprises a processor and a memory, wherein the memory is used to store executable instructions, and the executable instructions enable the processor to perform the following operations: In response to receiving a control operation of a user on an e-book reading page, determining whether the control operation is an operation of broadcasting a focused reading content; In a case where the control operation is the operation of broadcasting the focused reading content, determining the operation position of the operation of broadcasting the focused reading content in the electronic book reading page; Determine the reading content of interest according to the operation position; Determine a content offset according to the focused reading content, wherein the content offset is an offset of the focused reading content relative to a start mark of the electronic book; Determining a speaking start point in the existing second audio segment according to the content offset; Switch the first audio segment currently being played to the second audio segment corresponding to the focused reading content, The step of switching the currently played first audio segment to the second audio segment corresponding to the focused reading content includes: Stop playing the first audio segment, and start playing the second audio segment from the playing start point.

13. The electronic device according to claim 12, wherein when the processor executes the step of determining the focused reading content according to the operation position, the executable instructions specifically cause the processor to perform the following operations: Determining whether the operation position displays text content; In the case where text content is displayed at the operation position, the text content displayed at the operation position is used as the focused reading content.

14. The electronic device according to claim 13, characterized in that: When the processor determines that no text content is displayed at the operating position, the executable instructions further cause the processor to perform the following operations: The text content displayed in the vicinity of the operation position is used as the focused reading content.

15. The electronic device according to claim 14, characterized in that: When the processor uses the text content displayed in the vicinity of the operation position as the focused reading content, the executable instruction specifically enables the processor to perform the following operations: According to the operation position, determining the previous text content, the left text content or the right text content adjacent to the operation position; The preceding text content, the left text content or the right text content is used as the focused reading content.

16. The electronic device according to claim 12, characterized in that: Before speaking the second audio segment from the speaking start point, the executable instructions further cause the processor to perform the following operations: Determining a first content similarity between the focused reading content and the second audio segment; When the processor executes the step of switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the executable instructions specifically cause the processor to perform the following operations: When the first content similarity reaches a preset similarity threshold, the second audio segment is broadcasted from the broadcast starting point.

17. The electronic device according to claim 16, characterized in that: When the processor executes the step of determining the first content similarity between the focused reading content and the second audio segment, the executable instruction specifically causes the processor to perform the following operations: Performing audio recognition on the second audio segment to obtain recognized text content; Determining a second content similarity between the focused reading content and the recognized text content; or, Performing audio conversion on the reading content of interest to obtain a converted audio segment; determining a third content similarity between the converted audio segment and the second audio segment; The second content similarity or the third content similarity is used as the first content similarity.

18. The electronic device according to claim 12, characterized in that: Before the processor stops playing the first audio segment and plays the second audio segment from the start point of the playing, the executable instructions further cause the processor to perform the following operations: Determine whether the e-book corresponding to the currently played audio clip and the e-book to which the focused reading content belongs are the same e-book; When the processor determines that the electronic book corresponding to the currently played audio segment and the electronic book to which the focused reading content belongs are the same electronic book, the processor stops playing the first audio segment and plays the second audio segment from the playing starting point.

19. The electronic device according to claim 18, characterized in that: When the processor determines that the electronic book corresponding to the first audio clip currently being played is not the same electronic book as the electronic book to which the focused reading content belongs, the executable instructions specifically cause the processor to perform the following operations: The currently played e-book audio is closed, the audio corresponding to the e-book to which the focused reading content belongs is loaded, and the second audio segment is played from the playing starting point.

20. The electronic device according to any one of claims 12 to 15, characterized in that: Before the processor switches the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the executable instructions further cause the processor to perform the following operations: Perform text-to-speech conversion based on the focused reading content to generate the second audio segment.

21. The electronic device according to claim 20, characterized in that: The executable instructions further cause the processor to: Recording the content offset of the focused reading content relative to the start mark of the electronic book; and In the case of continuing to play the third audio segment corresponding to the reading content after the focused reading content, the content offset is updated according to the content offset and the length of the subsequent reading content.

22. The electronic device according to any one of claims 12 to 15, characterized in that: While the processor is executing the step of switching the first audio segment currently being played to the second audio segment corresponding to the focused reading content, the executable instructions further cause the processor to perform the following operations: The text corresponding to the broadcast content is marked on the e-book reading page.

23. The electronic device according to any one of claims 12 to 15, characterized in that: The processor uses an electronic book engine to monitor the user's control operation on the electronic book reading page, and uses an electronic book narration engine to narrate the currently narrated audio segment and the audio segment corresponding to the focused reading content.

24. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the electronic book control method according to any one of claims 1 to 11.

Images