Audio switching method, device and equipment, computer readable storage medium and product

By establishing a text mapping relationship between TTS tones and real-person tones in audio books, the problem of progress positioning after tone switching is solved, seamless broadcasting is achieved, and user experience is improved.

CN118963620APending Publication Date: 2024-11-15BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411009654.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-25
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

During the audio book tone switching process, the playback progress between the TTS tone and the real person tone is often independent of each other, which makes it impossible for the user to accurately locate the current listening progress after switching tone, affecting the user's reading experience.

Method used

By pre-establishing the text mapping relationship between the TTS tone and the real person tone, determining the text clip corresponding to the current playback progress, and determining the matching playback progress in the target audio, thereby achieving seamless resumption after the audio type switch.

Benefits of technology

It avoids changes in playback progress, improves users' reading experience of audio books, reduces the playback of repeated content, and improves the connection after audio switching.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118963620A_ABST
    Figure CN118963620A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an audio switching method and device, equipment, a computer readable storage medium and a product, and the method comprises the steps: responding to an audio type switching operation triggered by a user, determining a first playing progress corresponding to a currently played first audio, and enabling the first audio to be generated based on a first text; determining a first text fragment matched with the first playing progress in the first text; according to a preset text mapping relation between the first text and a second text, a second text fragment matched with the first text fragment in the second text is determined, and the first text and the second text are different versions of texts corresponding to the same text media content; and determining a second playing progress of a second audio generated based on the second text based on the second text segment, and playing the second audio according to the second playing progress. Therefore, after the audio types are switched, the playing progress does not change, a user does not need to manually adjust the playing progress, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of data processing technology, and in particular to an audio switching method, device, equipment, computer-readable storage medium, and product. Background Art

[0002] Users can play audio associated with audiobooks in the book application. As users' demands for audiobook timbre diversify, the book application can provide users with at least two different reading timbres. Among them, the reading timbre can include the text to speech (TTS) timbre generated based on the big model, and the real person timbre recorded by the host.

[0003] For each audio book in the book application, it can be associated with a book audio with a TTS voice and a book audio with a real voice. The user can switch the audio book voice according to actual needs.

[0004] However, since the playback progress of book audio with TTS voice and book audio with real voice and the book text on which they are based are often independent of each other, when the user triggers the voice switching operation, it is impossible to accurately locate the user's current listening progress. Summary of the invention

[0005] The embodiments of the present disclosure provide an audio switching method, apparatus, device, computer-readable storage medium and product, which are used to solve the technical problem of changes in playback progress caused by switching the tone of an audio book.

[0006] In a first aspect, an embodiment of the present disclosure provides an audio switching method, including:

[0007] In response to an audio type switching operation triggered by a user, determining a first playback progress corresponding to a first audio currently being played, wherein the first audio is generated based on a first text;

[0008] Determining a first text segment matching the first playback progress in the first text;

[0009] Determining, according to a preset text mapping relationship between a first text and a second text, a second text segment in the second text that matches the first text segment, wherein the first text and the second text are different versions of text corresponding to the same text media content;

[0010] Based on the second text segment, a second playback progress of a second audio generated based on the second text is determined, and the second audio is played according to the second playback progress.

[0011] In a second aspect, an embodiment of the present disclosure provides an audio switching device, including:

[0012] A determination module, configured to determine, in response to an audio type switching operation triggered by a user, a first playback progress corresponding to a first audio currently being played, wherein the first audio is generated based on a first text;

[0013] A processing module, configured to determine a first text segment matching the first playback progress in the first text;

[0014] A positioning module, configured to determine a second text segment in the second text that matches the first text segment according to a preset text mapping relationship between the first text and the second text, wherein the first text and the second text are different versions of text corresponding to the same text media content;

[0015] A playing module is used to determine, based on the second text segment, a second playing progress of a second audio generated based on the second text, and to play the second audio according to the second playing progress.

[0016] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0017] The memory stores computer-executable instructions;

[0018] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the audio switching method as described in the first aspect and various possible designs of the first aspect.

[0019] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the audio switching method described in the first aspect and various possible designs of the first aspect is implemented.

[0020] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the audio switching method as described in the first aspect and various possible designs of the first aspect.

[0021] The audio switching method, apparatus, device, computer-readable storage medium and product provided in this embodiment pre-establish a text mapping relationship between the first text and the second text of different versions corresponding to the same text media content, so that when the audio type switching operation triggered by the user for the first audio is obtained, the first text segment matching the first playback progress can be determined in the first text based on the current first playback progress of the first audio. Furthermore, the second text segment can be determined in the second text based on the first text and the text mapping relationship. The second playback progress matching the second text segment is determined in the second audio, so that the second audio can be resumed from the second playback progress. After the audio type is switched, the playback progress does not change, and the user does not need to manually adjust the playback progress, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0023] Figure 1 A flowchart of an audio switching method provided by an embodiment of the present disclosure;

[0024] Figure 2 A schematic diagram of a display interface provided in an embodiment of the present disclosure;

[0025] Figure 3 A flowchart of an audio switching method provided by another embodiment of the present disclosure;

[0026] Figure 4 A schematic diagram of a first text segment provided in an embodiment of the present disclosure;

[0027] Figure 5 A flowchart of an audio switching method provided by another embodiment of the present disclosure;

[0028] Figure 6 A flowchart of an audio switching method provided by another embodiment of the present disclosure;

[0029] Figure 7 A flowchart of an audio switching method provided by another embodiment of the present disclosure;

[0030] Figure 8 A schematic diagram of the structure of an audio switching device provided in an embodiment of the present disclosure;

[0031] Fig. 9A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0033] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0034] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0035] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0036] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0037] In order to solve the technical problem that the playback progress changes during the audio book timbre switching process, the present disclosure provides an audio switching method, device, equipment, computer-readable storage medium and product.

[0038] It should be noted that the audio switching method, apparatus, device, computer-readable storage medium and product provided by the present disclosure can be applied to any scenario of subsequent playback after content switching.

[0039] In order to improve the user's reading experience for audiobooks, the book application can provide at least two timbres for the user to choose from. Among them, the timbre can include a TTS timbre generated based on a large model and a real-person timbre manually recorded by the host. The TTS timbre corresponds to an audio file, and the real-person timbre corresponds to another audio file. When the user reads an audiobook in the book application, the timbre can be switched according to actual needs. In response to the switching operation, another audio file can be switched for playback. Since the playback progress between the TTS timbre and the real-person timbre is often independent of each other. Therefore, after switching the timbre, the playback progress may often change, affecting the user's reading experience.

[0040] In actual applications, the text corresponding to the real person's voice is the Automatic Speech Recognition (ASR) text, while the text corresponding to the TTS voice is the original text. ASR text has certain similarities with the original text, but there are also some minor differences and they are not one-to-one corresponding.

[0041] In the process of solving the above technical problems, the inventors discovered through research that in order to avoid progress difference text caused by tone switching operations, a mapping relationship between the ASR text and the original text can be established in advance.

[0042] In response to a switching operation triggered by the user, the current playback progress of the first audio can be determined, and the corresponding first text segment can be determined in the first text associated with the first audio based on the playback progress. The second text segment corresponding to the first text segment is determined based on the mapping relationship between the ASR text and the original text. The second playback progress corresponding to the second text segment is determined in the second audio. The audio resume playback operation is performed based on the second playback progress. In this way, when the timbre switching is realized, the difference in playback progress can be avoided, and the user's reading experience for audiobooks can be effectively improved.

[0043] Figure 1 A flowchart of an audio switching method provided by an embodiment of the present disclosure is shown in FIG. Figure 1 As shown, the method includes:

[0044] Step 101: In response to an audio type switching operation triggered by a user, determine a first playback progress corresponding to a first audio currently being played, wherein the first audio is generated based on a first text.

[0045] The execution subject of this embodiment is an audio switching device. The audio switching device can be coupled to a terminal device, so that based on an audio type switching operation triggered by a user on the terminal device, the second playback progress associated with the first playback progress of the currently playing first audio in the second audio can be located, and then the second audio can be played from the second playback progress.

[0046] Alternatively, the audio switching device may also be coupled to a server. The server is in communication with the terminal device. Thus, when the audio type switching operation triggered by the user on the terminal device is acquired, the second playback progress associated with the first playback progress of the currently playing first audio in the second audio can be located, and the terminal device can be controlled to perform the playback operation of the second audio from the second playback progress.

[0047] In this embodiment, the user can perform audio playback operation in the application software preset in the terminal device. The application software can be a book application. The user can play the audio associated with the audio book in the book application.

[0048] Optionally, in book applications, in order to meet the user's diversified needs for audio book timbre, audio book audio with different timbres can be pre-built. Among them, the timbre of the audio book audio can include TTS timbre generated based on a large model and real-person timbre recorded by the host. When the user is playing audio associated with an audio book, the user can switch the timbre according to actual needs, that is, switch the audio book audio corresponding to different timbre types. Because the playback progress between TTS timbre and real-person timbre is often independent of each other. Therefore, after switching the timbre, the playback progress may often change, affecting the user's reading experience.

[0049] Taking practical applications as an example, the user can play the first audio with TTS voice. When the first audio is played to chapter 100, the user can switch to the second audio with real voice for playback according to actual needs. However, since the user has not played the second audio in history, the second audio can be replayed from the first chapter, resulting in repeated playback of the content. If the user needs to play the audio from chapter 100, it is necessary to manually locate the playback progress, which is often cumbersome and difficult to locate.

[0050] Furthermore, in order to avoid playing repeated audio content, in response to the audio type switching operation triggered by the user, the first playback progress corresponding to the first audio currently being played is determined. Then, based on the second playback progress associated with the first playback progress of the first audio currently being played in the second audio, the terminal device can be controlled to play the second audio from the second playback progress.

[0051] The first audio may be an audio with a TTS tone, and the second audio may be an audio with a real person's tone. Alternatively, the first audio may be an audio with a real person's tone, and the second audio may be a video with a TTS tone. The present disclosure does not limit this. The first audio may be pre-generated based on the first text, and the second audio may be pre-generated based on the second text.

[0052] Step 102: Determine a first text segment matching the first playback progress in the first text.

[0053] In this embodiment, since the first audio is generated based on the first text, after determining the first playback progress corresponding to the first audio, the first text segment in the first text that matches the first playback progress can be determined based on the mapping relationship between the first audio progress and the first text.

[0054] Step 103: Determine a second text segment in the second text that matches the first text segment according to a preset text mapping relationship between the first text and the second text, wherein the first text and the second text are different versions of text corresponding to the same text media content.

[0055] In this embodiment, the first text and the second text are different versions of text corresponding to the same text media content. In order to accurately implement the continued broadcasting operation of the second audio after switching, a text mapping relationship between the first text and the second text can be established in advance. Since the first text and the second text have substantially the same content, but there may be some different sentences, the text mapping relationship between the first text and the second text can be established in advance based on text similarity.

[0056] Furthermore, after the first text segment matching the first playback progress in the first text is acquired, the second text segment matching the first text segment in the second text can be quickly located based on the preset text mapping relationship.

[0057] Step 104: Determine a second play progress of a second audio generated based on the second text based on the second text segment, and play the second audio according to the second play progress.

[0058] In this embodiment, after determining the second text segment that matches the first text segment in the second text, the second play progress corresponding to the second audio can be determined based on the second text, so that the play operation of the second audio can be started from the second play progress.

[0059] Since the second playback progress is determined based on the second text segment, and the second text segment is determined based on the first text segment corresponding to the first playback progress, after the playback progress is determined, the content can be played continuously according to the playback progress of the first audio, effectively avoiding repeated playback of the played content.

[0060] The audio switching method provided in this embodiment pre-establishes a text mapping relationship between the first text and the second text, so that when the audio type switching operation triggered by the user for the first audio is obtained, the first text segment matching the first playback progress can be determined in the first text based on the current first playback progress of the first audio. Furthermore, the second text segment can be determined in the second text based on the first text and the text mapping relationship. The second playback progress matching the second text segment is determined in the second audio, so that the second audio can be resumed from the second playback progress. After the audio type is switched, the playback progress does not change, and the user does not need to manually adjust the playback progress, thereby improving the user experience.

[0061] Optionally, based on any of the above embodiments, step 101 includes:

[0062] Display the preset audio type switching controls on the audio playback page.

[0063] In response to the user's triggering operation on the audio type switching control, the playback chapter and playback duration corresponding to the first audio are determined.

[0064] The first playback progress is determined based on the playback chapter and the playback duration.

[0065] In this embodiment, in order to enable the user to switch the audio type more flexibly, a preset audio type switching control can be displayed for the audio playback page. The user can quickly switch the audio type by triggering the audio type switching control. Among them, the audio type switching control may include identification information corresponding to the TTS timbre and the real person timbre. The timbre of the first audio currently being played can be displayed differently, such as bold display, enlarged font display, highlighted display, etc., so that the user can more intuitively determine the timbre of the first audio currently being played. When the user needs to switch the timbre, the timbre that is not displayed differently can be triggered.

[0066] Furthermore, since the audio book has a lot of content and the first audio is long, the first audio can be divided according to the chapters of the audio book. Therefore, in order to accurately determine the first playback progress, in response to the user's triggering operation on the audio type switching control, the playback chapter and playback duration corresponding to the first audio are determined. The first playback progress is determined based on the playback chapter and the playback duration.

[0067] Figure 2 A schematic diagram of a display interface provided by an embodiment of the present disclosure, such as Figure 2As shown, a preset audio type switching control 22 may be displayed in the audio playback page 21, and the user can switch the current playback tone of the audio book by triggering the audio type switching control 22. In addition, the audio playback page 21 also includes a playback progress control 23 and a book text 24 corresponding to the currently playing audio book, and the display content of the book text 24 can be switched accordingly with the adjustment of the playback progress. Therefore, when the user triggers the switching of the audio type, the current playback progress can be determined through the playback progress control 23, and the first text segment currently being played can be determined based on the book text 24.

[0068] The audio switching method provided in this embodiment displays a preset audio type switching control in the audio playback page, so that the user can flexibly switch the audio book playback tone based on the audio type switching control, thereby improving the user experience.

[0069] Figure 3 A flowchart of an audio switching method provided by another embodiment of the present disclosure is provided. Based on any of the above embodiments, Figure 3 As shown, step 102 includes:

[0070] Step 301: determine a target sentence currently being played in the first text based on the first playing progress.

[0071] Step 302: Determine the target sentence and a context sentence associated with the target sentence as the first text segment.

[0072] In this embodiment, in order to accurately implement the content resume operation after the audio type is switched, a first text segment can be determined, and a second text segment matching the first text segment can be determined based on the text mapping relationship between the first text and the second text.

[0073] Since the first text and the second text often contain more content, locating the second text segment based only on the currently played sentence often requires a large amount of calculation. Therefore, in order to improve the efficiency of locating the second text segment, the currently played sentence and its context sentence can be determined as the first text segment.

[0074] Optionally, after determining the first playing progress, the target sentence currently being played may be determined based on the first playing progress. The target sentence and a context sentence associated with the target sentence are determined as the first text segment.

[0075] The context sentence may be the previous sentence text and the next sentence text of the target sentence. Alternatively, the context sentence may be the first N non-sentence texts and the next N sentence texts of the target sentence. Alternatively, the user may adjust the scope of the context sentence according to actual needs, and the present disclosure does not limit this.

[0076] Figure 4 A schematic diagram of a first text segment provided in an embodiment of the present disclosure, such as Figure 4 As shown, after determining the target sentence 41 currently being played in the first text based on the first playing progress, the sentence 42 before the target sentence 41 and the sentence 43 after the target sentence 41 can be determined as the first text segment 44 .

[0077] The audio switching method provided in this embodiment determines the target sentence currently being played in the first text based on the first playback progress, and jointly determines the target sentence and the context sentence associated with the target sentence as the first text segment, so that the corresponding second text segment in the second text can be accurately determined based on the preset mapping relationship between the first text and the text segment in the second text, thereby improving the accuracy of locating the second text segment.

[0078] Further, based on any of the above embodiments, before step 103, the method further includes:

[0079] The first text is divided into a plurality of first text segments according to a preset segmentation condition.

[0080] For each first text segment, a second text segment whose similarity with the first text segment meets a preset condition is determined in the second text.

[0081] An association relationship is established between each first text segment and a second text segment whose similarity to the first text segment meets a preset condition, to obtain the text mapping relationship.

[0082] In this embodiment, the audio associated with the TTS voice is often generated by the large model based on the original text, while the audio associated with the real voice is generated by the host based on the ASR manuscript. Therefore, the content of the first text and the second text is roughly the same, but there may be some different sentences.

[0083] In order to accurately implement the continued broadcasting operation of the switched second audio, a text mapping relationship between the first text and the second text may be established in advance.

[0084] Optionally, the first text may be divided into a plurality of first text segments according to a preset segmentation condition, wherein the segmentation condition may be segmentation according to a preset number of words, segmentation according to a preset number of lines, segmentation according to a plot, etc., which is not limited in the present disclosure.

[0085] Further, for each first text segment, a second text segment whose similarity with the first text segment satisfies a preset condition is determined in the second text. Among them, any algorithm capable of calculating text similarity can be used to calculate the second text segment whose similarity with the first text segment satisfies the preset condition, and the present disclosure does not limit this. An association relationship is established between each first text segment and the second text segment whose similarity with the first text segment satisfies the preset condition, respectively, to obtain a text mapping relationship. Among them, the similarity satisfying the preset condition can be that the text segment in the second text with the highest similarity to the first text segment is determined as the second text segment.

[0086] The audio switching method provided in this embodiment pre-establishes a text mapping relationship between the first text and the second text, so that the second text segment can be accurately located based on the text mapping relationship, thereby ensuring that the playback progress does not change after the tone is switched, thereby improving the user experience.

[0087] Figure 5 A flowchart of an audio switching method provided by another embodiment of the present disclosure is provided. Based on any of the above embodiments, Figure 5 As shown, step 104 includes:

[0088] Step 501: determine a target sentence currently being played in the first text based on the first playing progress.

[0089] Step 502: Determine whether the second text segment includes the target sentence, and obtain a processing result.

[0090] Step 503: determine the second play progress according to the processing result, and play the second audio according to the second play progress.

[0091] In this embodiment, after determining the second text segment that matches the first text segment in the second text, the second play progress corresponding to the second audio can be determined based on the second text, so that the play operation of the second audio can be started from the second play progress.

[0092] Optionally, since there are some differences between the first text and the second text, in order to minimize the playback of repeated content and improve the accuracy of content playback, the target sentence currently being played can be determined in the first text based on the first playback progress. It is determined whether the second text segment includes the target sentence to obtain a processing result. The second playback progress is determined according to the processing result, and the second audio is played according to the second playback progress.

[0093] The audio switching method provided in this embodiment determines the target sentence currently being played in the first text based on the first playback progress, and determines whether the target sentence is included in the second text segment, so that the subsequent continued playback of the second audio can be more accurately implemented, effectively reducing the playback of repeated content.

[0094] Further, based on any of the above embodiments, step 403 includes:

[0095] If the second text segment includes the target sentence, the playback progress corresponding to the first text of the target sentence is determined as the second playback progress.

[0096] The second audio is played starting from the second playing progress.

[0097] In this embodiment, if the second text segment includes a target sentence, in order to improve the connectivity between the second audio and the first audio after the audio type is switched, the content resume operation may be performed starting from the target sentence.

[0098] Optionally, the playback progress corresponding to the first text of the target sentence can be determined as the second playback progress. The second audio is played from the second playback progress. At this time, only the currently played target sentence needs to be replayed, which effectively reduces the playback of repeated content.

[0099] The audio switching method provided in this embodiment can avoid repeated playback of the played sentence and improve the user experience by continuing to play from the second playback progress corresponding to the target sentence when the target sentence is included in the second text segment.

[0100] Further, based on any of the above embodiments, step 403 includes:

[0101] If the second text segment includes the target sentence, the target field currently being played is determined based on the first text and the first playing progress.

[0102] Determine a field to be played in the second text that matches the target field.

[0103] The playback progress corresponding to the to-be-played field is determined as the second playback progress.

[0104] The second audio is played starting from the second playing progress.

[0105] In this embodiment, if the second text segment includes the target sentence, in order to improve the connectivity between the second audio and the first audio after the audio type is switched, the playback may be continued from the currently played field.

[0106] For example, if the target sentence currently being played is "It seems that they are all very impressive", the field currently being played may be "impressive". In order to reduce the playback of repeated content, after switching the second audio, the playback operation may be continued from the field "impressive". This allows the second playback progress of the switched second audio to be seamlessly connected with the first audio.

[0107] Optionally, if the second text segment includes a target sentence, the target field currently being played is determined based on the first text and the first playback progress. A field to be played that matches the target field in the second text is determined. The playback progress corresponding to the field to be played is determined as the second playback progress. The second audio is played starting from the second playback progress.

[0108] The audio switching method provided in this embodiment can accurately achieve the playback connection between the first audio and the second audio by continuing to play the second playback progress corresponding to the to-be-played field that matches the currently played target field when the target sentence is included in the second text segment, thereby avoiding repeated playback of the content being played and avoiding omission of the content that has not been played, thereby improving the accuracy of content playback.

[0109] Further, based on any of the above embodiments, step 403 includes:

[0110] If the second text segment does not include the target sentence, the playback progress corresponding to the first field in the second text segment is determined as the second playback progress.

[0111] The second audio is played starting from the second playing progress.

[0112] In this embodiment, when the second text segment does not include a target sentence matching the first text segment, in order to minimize the playback of repeated content, the content playback operation may be started from the second text segment.

[0113] Optionally, if the second text segment does not include the target sentence, the play progress corresponding to the first field in the second text segment is determined as the second play progress, and the second audio is played starting from the second play progress.

[0114] The audio switching method provided in this embodiment can minimize the playback of repeated content and improve user experience by playing the second audio from the second playback progress when the target sentence is not included in the second text segment.

[0115] Figure 6 A flowchart of an audio switching method provided by another embodiment of the present disclosure is provided. Based on any of the above embodiments, Figure 6 As shown, step 104 includes:

[0116] Step 601: Determine the content type corresponding to the second text segment.

[0117] Step 602: Determine a second play progress of the second audio according to the content type.

[0118] In this embodiment, after determining the second text segment that matches the first text segment in the second text, the second play progress corresponding to the second audio can be determined based on the second text, so that the play operation of the second audio can be started from the second play progress.

[0119] Optionally, due to the partial differences between the first text and the second text, in order to minimize the playback of repeated content and improve the accuracy of content playback, the content type corresponding to the second text segment can be determined. The second playback progress of the second audio is determined according to the content type. The content type includes but is not limited to the plot type, the character image type, and the environment description type, and different content types contribute differently to the user's understanding of the content.

[0120] Further, based on any of the above embodiments, step 602 includes:

[0121] If the content type is a storyline type, determining the playback progress in the second audio that matches the first field in the second text segment as the second playback progress;

[0122] If the content type is a character image type, a target sentence currently being played is determined in the first text based on the first playback progress, a related sentence matching the target sentence is determined in the second text segment, and a playback progress matching the related sentence in the second audio is determined as the second playback progress;

[0123] If the content type is an environment description type, the target field currently being played is determined in the first text based on the first playback progress, an associated field matching the target field is determined in the second text segment, and the playback progress in the second audio matching the associated field is determined as the second playback progress.

[0124] In this embodiment, the content type includes a plot type. For example, the first text and the second text are different versions of text associated with a book. The plot is generally the skeleton of the book, which can show the character of the characters and express the theme of the book. The importance is often high. In order to avoid users from missing the plot, after determining the second text segment, the second audio can be continued from the first field of the second text segment. Therefore, the play progress in the second audio that matches the first field in the second text segment can be determined as the second play progress.

[0125] Optionally, the content type also includes a character image type. Continuing with the above example, the character image can often show the thoughts and personality of the characters in the book, and make a certain contribution to the understanding of the storyline. Therefore, in order to enable users to understand the book in more detail, the second audio can be continued according to the granularity of the sentence. Based on the first playback progress, the target sentence currently being played is determined in the first text, and based on the text mapping relationship between the first text and the second text, the associated sentence matching the target sentence is determined in the second text segment, and the playback progress matching the associated sentence in the second audio is determined as the second playback progress.

[0126] Optionally, the content type may also include an environment description type. Following the above example, the environment description generally provides background support for the storyline of the book. Therefore, in order to prevent the user from repeatedly browsing the content that has been browsed, the target field currently being played can be determined in the first text based on the first playback progress, the associated field matching the target field can be determined in the second text segment, and the playback progress matching the associated field in the second audio can be determined as the second playback progress.

[0127] The audio switching method provided in this embodiment determines the second playback progress by using different resume granularities for different content types corresponding to the second text segment, thereby preventing the user from missing specific storylines while avoiding reducing the playback of repeated content.

[0128] Figure 7 A flowchart of an audio switching method provided by another embodiment of the present disclosure is provided. Based on any of the above embodiments, Figure 7 As shown, step 104 includes:

[0129] Step 701: Determine the target chapter to which the second text segment belongs.

[0130] Step 702: Determine a second audio that matches the second text segment in at least one audio corresponding to the target chapter.

[0131] Step 703: Determine a second playback progress corresponding to the second audio based on the second text segment.

[0132] In this embodiment, the first text and the second text may be text contents of different versions corresponding to the same book. Since the book has a lot of content, multiple audios may be applied to the same text or the same chapter in the text.

[0133] In order to accurately locate the second playback progress, after determining the second text segment, the target chapter to which the second text segment belongs can be determined. Multiple audios corresponding to the target chapter are determined, and the second audio matching the second text segment is determined among the multiple audios. Then, the second playback progress corresponding to the second audio can be determined based on the second text segment.

[0134] For example, if the second text segment belongs to the second chapter of a book, the second chapter may correspond to three preset audios. A preset audio matching the second text segment may be determined from the three preset audios, and the preset audio is determined as the second audio.

[0135] The audio switching method provided in this embodiment determines the target chapter to which the second text segment belongs. A second audio matching the second text segment is determined in at least one audio corresponding to the target chapter. A second playback progress corresponding to the second audio is determined based on the second text segment, so that the second playback progress can be accurately determined in multiple audios corresponding to the second text, thereby improving the accuracy of subsequent playback after audio switching.

[0136] Figure 8 A schematic diagram of the structure of the audio switching device provided in the embodiment of the present disclosure is shown in FIG. Figure 8 As shown, the device includes: a determination module 81, a processing module 82, a positioning module 83 and a playing module 84. The determination module 81 is used to determine the first playing progress corresponding to the first audio currently being played in response to the audio type switching operation triggered by the user, wherein the first audio is generated based on the first text. The processing module 82 is used to determine a first text segment matching the first playing progress in the first text. The positioning module 83 is used to determine a second text segment matching the first text segment in the second text according to a preset text mapping relationship between the first text and the second text, wherein the first text and the second text are different versions of text corresponding to the same text media content. The playing module 84 is used to determine the second playing progress of the second audio generated based on the second text based on the second text segment, and play the second audio according to the second playing progress.

[0137] Further, based on any of the above embodiments, the processing module is used to: determine a target sentence currently being played in the first text based on the first playing progress, and determine the target sentence and a context sentence associated with the target sentence as the first text segment.

[0138] Further, on the basis of any of the above embodiments, the device further comprises: a division module, for dividing the first text into a plurality of first text segments according to a preset segmentation condition; a determination module, for determining, for each first text segment, a second text segment in the second text whose similarity with the first text segment meets a preset condition; and a mapping module, for respectively establishing an association relationship between each first text segment and a second text segment whose similarity with the first text segment meets a preset condition, to obtain the text mapping relationship.

[0139] Further, based on any of the above embodiments, the playback module is used to: determine a target sentence currently being played in the first text based on the first playback progress, determine whether the second text segment includes the target sentence, and obtain a processing result, determine the second playback progress according to the processing result, and play the second audio according to the second playback progress.

[0140] Further, based on any of the above embodiments, the playback module is configured to: if the second text segment includes the target sentence, determine the playback progress corresponding to the first text of the target sentence as the second playback progress, and start playing the second audio from the second playback progress.

[0141] Further, based on any of the above embodiments, the playback module is used to: if the second text segment includes the target sentence, determine the target field currently being played based on the first text and the first playback progress. Determine a field to be played in the second text that matches the target field. Determine the playback progress corresponding to the field to be played as the second playback progress. Start playing the second audio from the second playback progress.

[0142] Further, based on any of the above embodiments, the playback module is used to: if the second text segment does not include the target sentence, determine the playback progress corresponding to the first field in the second text segment as the second playback progress, and start playing the second audio from the second playback progress.

[0143] Further, based on any of the above embodiments, the playing module is used to: determine a content type corresponding to the second text segment, and determine a second playing progress of the second audio according to the content type.

[0144] Further, based on any of the above embodiments, the playback module is used to: if the content type is a storyline type, determine the playback progress in the second audio that matches the first field in the second text segment as the second playback progress. If the content type is a character image type, determine the target sentence currently being played in the first text based on the first playback progress, determine the associated sentence matching the target sentence in the second text segment, and determine the playback progress in the second audio that matches the associated sentence as the second playback progress. If the content type is an environment description type, determine the target field currently being played in the first text based on the first playback progress, determine the associated field matching the target field in the second text segment, and determine the playback progress in the second audio that matches the associated field as the second playback progress.

[0145] Further, based on any of the above embodiments, the determination module is used to: display a preset audio type switching control on the audio playback page. In response to the user's triggering operation on the audio type switching control, determine the playback chapter and playback duration corresponding to the first audio. Determine the first playback progress based on the playback chapter and the playback duration.

[0146] Further, based on any of the above embodiments, the playback module is used to: determine the target chapter to which the second text segment belongs, determine a second audio matching the second text segment in at least one audio corresponding to the target chapter, and determine a second playback progress corresponding to the second audio based on the second text segment.

[0147] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar, and this embodiment will not be repeated here.

[0148] In order to implement the above embodiments, the embodiments of the present disclosure further provide a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the audio switching method described in any of the above embodiments is implemented.

[0149] In order to implement the above embodiments, the embodiments of the present disclosure further provide a computer program product, including a computer program, and when the computer program is executed by a processor, the audio switching method as described in any of the above embodiments is implemented.

[0150] In order to implement the above embodiment, the embodiment of the present disclosure further provides an electronic device, including: a processor and a memory;

[0151] The memory stores computer-executable instructions;

[0152] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the audio switching method as described in any of the above embodiments.

[0153] Fig. 9 The electronic device 900 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure, and the electronic device 900 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (Portable Media Players, PMPs), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig. 9 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0154] like Fig. 9 As shown, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 to a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0155] Typically, the following devices may be connected to the I / O interface 905: input devices 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 908 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although Fig. 9 The electronic device 900 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0156] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0157] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0158] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0159] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0160] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0161] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0162] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0163] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0164] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0165] In a first aspect, according to one or more embodiments of the present disclosure, there is provided an audio switching method, including:

[0166] In response to an audio type switching operation triggered by a user, determining a first playback progress corresponding to a first audio currently being played, wherein the first audio is generated based on a first text;

[0167] Determining a first text segment matching the first playback progress in the first text;

[0168] Determining, according to a preset text mapping relationship between a first text and a second text, a second text segment in the second text that matches the first text segment, wherein the first text and the second text are different versions of text corresponding to the same text media content;

[0169] Based on the second text segment, a second playback progress of a second audio generated based on the second text is determined, and the second audio is played according to the second playback progress.

[0170] According to one or more embodiments of the present disclosure, determining in the first text a first text segment matching the first playback progress includes:

[0171] Determining a target sentence currently being played in the first text based on the first playing progress;

[0172] The target sentence and a context sentence associated with the target sentence are determined as the first text segment.

[0173] According to one or more embodiments of the present disclosure, before determining the second text segment in the second text that matches the first text segment according to the preset text mapping relationship between the first text and the second text, the method further includes:

[0174] Dividing the first text into a plurality of first text segments according to a preset segmentation condition;

[0175] For each first text segment, determining in the second text a second text segment whose similarity with the first text segment meets a preset condition;

[0176] An association relationship is established between each first text segment and a second text segment whose similarity to the first text segment meets a preset condition, to obtain the text mapping relationship.

[0177] According to one or more embodiments of the present disclosure, determining, based on the second text segment, a second playback progress of a second audio generated based on the second text, and performing a playback operation on the second audio according to the second playback progress includes:

[0178] Determining a target sentence currently being played in the first text based on the first playing progress;

[0179] Determining whether the second text segment includes the target sentence, and obtaining a processing result;

[0180] The second playing progress is determined according to the processing result, and the second audio is played according to the second playing progress.

[0181] According to one or more embodiments of the present disclosure, determining the second playback progress according to the processing result, and performing a playback operation on the second audio according to the second playback progress includes:

[0182] If the second text segment includes the target sentence, determining the playback progress corresponding to the first text of the target sentence as the second playback progress;

[0183] The second audio is played starting from the second playing progress.

[0184] According to one or more embodiments of the present disclosure, determining the second playback progress according to the processing result, and performing a playback operation on the second audio according to the second playback progress includes:

[0185] If the second text segment includes the target sentence, determining the target field currently being played based on the first text and the first playing progress;

[0186] Determining a field to be played in the second text that matches the target field;

[0187] Determine the playback progress corresponding to the to-be-played field as the second playback progress;

[0188] The second audio is played starting from the second playing progress.

[0189] According to one or more embodiments of the present disclosure, determining the second playback progress according to the processing result, and performing a playback operation on the second audio according to the second playback progress includes:

[0190] If the second text segment does not include the target sentence, determining the playback progress corresponding to the first field in the second text segment as the second playback progress;

[0191] The second audio is played starting from the second playing progress.

[0192] According to one or more embodiments of the present disclosure, determining, based on the second text segment, a second playback progress of a second audio generated based on the second text includes:

[0193] Determining a content type corresponding to the second text segment;

[0194] Determine a second play progress of the second audio according to the content type.

[0195] According to one or more embodiments of the present disclosure, determining the second playback progress of the second audio according to the content type includes:

[0196] If the content type is a storyline type, determining the playback progress in the second audio that matches the first field in the second text segment as the second playback progress;

[0197] If the content type is a character image type, a target sentence currently being played is determined in the first text based on the first playback progress, a related sentence matching the target sentence is determined in the second text segment, and a playback progress matching the related sentence in the second audio is determined as the second playback progress;

[0198] If the content type is an environment description type, the target field currently being played is determined in the first text based on the first playback progress, an associated field matching the target field is determined in the second text segment, and the playback progress in the second audio matching the associated field is determined as the second playback progress.

[0199] According to one or more embodiments of the present disclosure, in response to the audio type switching operation triggered by the user, determining the first playback progress corresponding to the first audio currently being played includes:

[0200] Display the preset audio type switching controls on the audio playback page;

[0201] In response to the user's triggering operation on the audio type switching control, determining a playback chapter and a playback duration corresponding to the first audio;

[0202] The first playback progress is determined based on the playback chapter and the playback duration.

[0203] According to one or more embodiments of the present disclosure, the second text includes a plurality of preset chapters, and determining, based on the second text segment, a second playback progress of a second audio generated based on the second text includes:

[0204] determining a target chapter to which the second text segment belongs;

[0205] Determining a second audio matching the second text segment in at least one audio corresponding to the target chapter;

[0206] A second playback progress corresponding to the second audio is determined based on the second text segment.

[0207] In a second aspect, according to one or more embodiments of the present disclosure, there is provided an audio switching device, including:

[0208] A determination module, configured to determine, in response to an audio type switching operation triggered by a user, a first playback progress corresponding to a first audio currently being played, wherein the first audio is generated based on a first text;

[0209] A processing module, configured to determine a first text segment matching the first playback progress in the first text;

[0210] A positioning module, configured to determine a second text segment in the second text that matches the first text segment according to a preset text mapping relationship between the first text and the second text, wherein the first text and the second text are different versions of text corresponding to the same text media content;

[0211] A playing module is used to determine, based on the second text segment, a second playing progress of a second audio generated based on the second text, and to play the second audio according to the second playing progress.

[0212] According to one or more embodiments of the present disclosure, the processing module is used to:

[0213] Determining a target sentence currently being played in the first text based on the first playing progress;

[0214] The target sentence and a context sentence associated with the target sentence are determined as the first text segment.

[0215] According to one or more embodiments of the present disclosure, the device further includes:

[0216] A segmentation module, used for dividing the first text into a plurality of first text segments according to a preset segmentation condition;

[0217] A determination module, configured to determine, for each first text segment, in the second text, a second text segment whose similarity with the first text segment satisfies a preset condition;

[0218] The mapping module is used to respectively establish an association relationship between each first text segment and a second text segment whose similarity with the first text segment meets a preset condition, so as to obtain the text mapping relationship.

[0219] According to one or more embodiments of the present disclosure, the playback module is used to:

[0220] Determining a target sentence currently being played in the first text based on the first playing progress;

[0221] Determining whether the second text segment includes the target sentence, and obtaining a processing result;

[0222] The second playing progress is determined according to the processing result, and the second audio is played according to the second playing progress.

[0223] According to one or more embodiments of the present disclosure, the playback module is used to:

[0224] If the second text segment includes the target sentence, determining the playback progress corresponding to the first text of the target sentence as the second playback progress;

[0225] The second audio is played starting from the second playing progress.

[0226] According to one or more embodiments of the present disclosure, the playback module is used to:

[0227] If the second text segment includes the target sentence, determining the target field currently being played based on the first text and the first playing progress;

[0228] Determining a field to be played in the second text that matches the target field;

[0229] Determine the playback progress corresponding to the to-be-played field as the second playback progress;

[0230] The second audio is played starting from the second playing progress.

[0231] According to one or more embodiments of the present disclosure, the playback module is used to:

[0232] If the second text segment does not include the target sentence, determining the playback progress corresponding to the first field in the second text segment as the second playback progress;

[0233] The second audio is played starting from the second playing progress.

[0234] According to one or more embodiments of the present disclosure, the playback module is used to:

[0235] Determining a content type corresponding to the second text segment;

[0236] Determine a second play progress of the second audio according to the content type.

[0237] According to one or more embodiments of the present disclosure, the playback module is used to:

[0238] If the content type is a storyline type, determining the playback progress in the second audio that matches the first field in the second text segment as the second playback progress;

[0239] If the content type is a character image type, a target sentence currently being played is determined in the first text based on the first playback progress, a related sentence matching the target sentence is determined in the second text segment, and a playback progress matching the related sentence in the second audio is determined as the second playback progress;

[0240] If the content type is an environment description type, the target field currently being played is determined in the first text based on the first playback progress, an associated field matching the target field is determined in the second text segment, and the playback progress in the second audio matching the associated field is determined as the second playback progress.

[0241] According to one or more embodiments of the present disclosure, the determining module is used to:

[0242] Display the preset audio type switching controls on the audio playback page;

[0243] In response to the user's triggering operation on the audio type switching control, determining a playback chapter and a playback duration corresponding to the first audio;

[0244] The first playback progress is determined based on the playback chapter and the playback duration.

[0245] According to one or more embodiments of the present disclosure, the playback module is used to:

[0246] determining a target chapter to which the second text segment belongs;

[0247] Determining a second audio matching the second text segment in at least one audio corresponding to the target chapter;

[0248] A second playback progress corresponding to the second audio is determined based on the second text segment.

[0249] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0250] The memory stores computer-executable instructions;

[0251] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor performs the audio switching method described in the first aspect and various possible designs of the first aspect.

[0252] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the audio switching method described in the first aspect and various possible designs of the first aspect is implemented.

[0253] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program, which, when executed by a processor, implements the audio switching method described in the first aspect and various possible designs of the first aspect.

[0254] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0255] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0256] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. An audio switching method, characterized in that: include: In response to an audio type switching operation triggered by a user, determining a first playback progress corresponding to a first audio currently being played, wherein the first audio is generated based on a first text; Determining a first text segment matching the first playback progress in the first text; Determining, according to a preset text mapping relationship between a first text and a second text, a second text segment in the second text that matches the first text segment, wherein the first text and the second text are different versions of text corresponding to the same text media content; Based on the second text segment, a second playback progress of a second audio generated based on the second text is determined, and the second audio is played according to the second playback progress.

2. The method according to claim 1, characterized in that: The determining, in the first text, a first text segment matching the first playback progress includes: Determining a target sentence currently being played in the first text based on the first playing progress; The target sentence and a context sentence associated with the target sentence are determined as the first text segment.

3. The method according to claim 2, characterized in that Before determining the second text segment in the second text that matches the first text segment according to the preset text mapping relationship between the first text and the second text, the method further includes: Dividing the first text into a plurality of first text segments according to a preset segmentation condition; For each first text segment, determining in the second text a second text segment whose similarity with the first text segment meets a preset condition; An association relationship is established between each first text segment and a second text segment whose similarity to the first text segment meets a preset condition, to obtain the text mapping relationship.

4. The method according to claim 1, characterized in that: The determining, based on the second text segment, a second playback progress of a second audio generated based on the second text, and performing a playback operation on the second audio according to the second playback progress includes: Determining a target sentence currently being played in the first text based on the first playing progress; Determining whether the second text segment includes the target sentence, and obtaining a processing result; The second playing progress is determined according to the processing result, and the second audio is played according to the second playing progress.

5. The method according to claim 4, characterized in that The determining the second playing progress according to the processing result, and performing a playing operation on the second audio according to the second playing progress, includes: If the second text segment includes the target sentence, determining the playback progress corresponding to the first text of the target sentence as the second playback progress; The second audio is played starting from the second playing progress.

6. The method according to claim 4, characterized in that The determining the second playing progress according to the processing result, and performing a playing operation on the second audio according to the second playing progress, includes: If the second text segment includes the target sentence, determining the target field currently being played based on the first text and the first playing progress; Determining a field to be played in the second text that matches the target field; Determine the playback progress corresponding to the to-be-played field as the second playback progress; The second audio is played starting from the second playing progress.

7. The method according to claim 4, characterized in that The determining the second playing progress according to the processing result, and performing a playing operation on the second audio according to the second playing progress, includes: If the second text segment does not include the target sentence, determining the playback progress corresponding to the first field in the second text segment as the second playback progress; The second audio is played starting from the second playing progress.

8. The method according to claim 1, characterized in that The determining, based on the second text segment, a second playback progress of a second audio generated based on the second text includes: Determining a content type corresponding to the second text segment; Determine a second play progress of the second audio according to the content type.

9. The method according to claim 8, characterized in that The determining a second playback progress of the second audio according to the content type includes: If the content type is a storyline type, determining the playback progress in the second audio that matches the first field in the second text segment as the second playback progress; If the content type is a character image type, a target sentence currently being played is determined in the first text based on the first playback progress, a related sentence matching the target sentence is determined in the second text segment, and a playback progress matching the related sentence in the second audio is determined as the second playback progress; If the content type is an environment description type, the target field currently being played is determined in the first text based on the first playback progress, an associated field matching the target field is determined in the second text segment, and the playback progress in the second audio matching the associated field is determined as the second playback progress.

10. The method according to any one of claims 1 to 9, characterized in that: The determining, in response to the audio type switching operation triggered by the user, a first playback progress corresponding to the first audio currently being played includes: Display the preset audio type switching controls on the audio playback page; In response to the user's triggering operation on the audio type switching control, determining a playback chapter and a playback duration corresponding to the first audio; The first playback progress is determined based on the playback chapter and the playback duration.

11. The method according to any one of claims 1 to 9, characterized in that: The second text includes a plurality of preset chapters, and determining, based on the second text segment, a second playback progress of a second audio generated based on the second text includes: determining a target chapter to which the second text segment belongs; Determining a second audio matching the second text segment in at least one audio corresponding to the target chapter; A second playback progress corresponding to the second audio is determined based on the second text segment.

12. An audio switching device, characterized in that: include: A determination module, configured to determine, in response to an audio type switching operation triggered by a user, a first playback progress corresponding to a first audio currently being played, wherein the first audio is generated based on a first text; A processing module, configured to determine a first text segment matching the first playback progress in the first text; A positioning module, configured to determine a second text segment in the second text that matches the first text segment according to a preset text mapping relationship between the first text and the second text, wherein the first text and the second text are different versions of text corresponding to the same text media content; A playing module is used to determine, based on the second text segment, a second playing progress of a second audio generated based on the second text, and to play the second audio according to the second playing progress.

13. An electronic device, characterized in that: include: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the audio switching method according to any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the processor executes the computer-executable instructions, the audio switching method according to any one of claims 1 to 11 is implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the audio switching method according to any one of claims 1 to 11 is implemented.