Interface skin updating method, device, equipment, medium and program product

By determining the target interface skin based on the context information of the text to be synthesized, and updating the interface skin during the voice playback, the problem of invisible speech synthesis output in the prior art is solved, and a higher quality voice display and user experience is achieved.

CN114154491BActive Publication Date: 2025-05-02APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111361449.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-17
Publication Date
2025-05-02
Estimated Expiration
2041-11-17

AI Technical Summary

Technical Problem

Existing voice synthesis technology is difficult to display synthesized voice vividly and vividly, and cannot meet users' needs for high-quality voice output.

Method used

The target interface skin is determined based on the context information of the text to be synthesized, and the current interface skin is updated during the speech playback to match the context and content of the speech.

Benefits of technology

It realizes dynamic adjustment of the interface skin based on context information, making the voice synthesis output more vivid and vivid, and improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114154491B_ABST
    Figure CN114154491B_ABST
Patent Text Reader

Abstract

The present disclosure provides an interface skin update method, device, equipment, medium and program product, which relates to the field of artificial intelligence technology, especially to the field of vehicle networking and smart cockpit. The specific implementation scheme is: according to the context information of the text to be synthesized, determine the target interface skin that matches the text to be synthesized; in the process of playing the voice synthesized by the text to be synthesized, use the target interface skin to update the current interface skin. The technical solution of the embodiment of the present disclosure can realize the update of the interface skin according to the context information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, in particular to the field of voice technology, and specifically to an interface skin updating method, device, equipment, medium and program product. Background Art

[0002] Text to Speech (TTS) is a technology that generates artificial speech through mechanical and electronic methods. Speech synthesis technology can convert text information obtained through computer processing or external input into speech output.

[0003] With the development of intelligent voice technology, users have higher and higher requirements for speech synthesis. How to play and display synthesized speech vividly has attracted the attention of developers. Summary of the invention

[0004] The present disclosure provides an interface skin updating method, device, equipment, medium and program product.

[0005] According to one aspect of the present disclosure, a method for updating an interface skin is provided, comprising:

[0006] Determining a target interface skin matching the text to be synthesized according to context information of the text to be synthesized;

[0007] During the process of playing the speech synthesized from the text to be synthesized, the target interface skin is used to update the current interface skin.

[0008] According to another aspect of the present disclosure, there is provided an interface skin updating device, comprising:

[0009] A target interface skin determination module, used to determine a target interface skin matching the text to be synthesized according to the context information of the text to be synthesized;

[0010] The current interface skin updating module is used to update the current interface skin by using the target interface skin during the process of playing the speech synthesized by the text to be synthesized.

[0011] According to another aspect of the present disclosure, there is provided an electronic device, comprising:

[0012] at least one processor; and

[0013] a memory communicatively connected to at least one processor; wherein,

[0014] The memory stores instructions that can be executed by at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the interface skin updating method of any embodiment of the present disclosure.

[0015] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable a computer to execute the interface skin updating method of any embodiment of the present disclosure.

[0016] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the interface skin updating method of any embodiment of the present disclosure is implemented.

[0017] The disclosed embodiments can update the interface skin according to context information.

[0018] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0020] Figure 1a is a schematic diagram of an interface skin updating method provided according to an embodiment of the present disclosure;

[0021] Figure 1b is a flow chart of updating an interface skin according to an embodiment of the present disclosure;

[0022] Figure 2a is a schematic diagram of an interface skin updating method provided according to an embodiment of the present disclosure;

[0023] Figure 2b is a flow chart of updating an interface skin according to an embodiment of the present disclosure;

[0024] Figure 3 is a schematic diagram of an interface skin updating method provided according to an embodiment of the present disclosure;

[0025] Figure 4 is a schematic diagram of an interface skin renewal device provided according to an embodiment of the present disclosure;

[0026] Figure 5 It is a block diagram of an electronic device used to implement the interface skin updating method of the embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0028] Figure 1a This is a flow chart of an interface skin updating method disclosed in an embodiment of the present disclosure. This embodiment can be applied to the case where the interface skin is adjusted according to context information. The method of this embodiment can be executed by an interface skin updating device, which can be implemented in software and / or hardware, and is specifically configured in an electronic device with certain data computing capabilities, which can be a client device or a server device, and the client device can be a mobile phone, a tablet computer, a vehicle terminal, a desktop computer, etc.

[0029] S110: Determine a target interface skin that matches the text to be synthesized according to the context information of the text to be synthesized.

[0030] Among them, the text to be synthesized is text information that needs to be voice synthesized and voice broadcasted in order to interact with the user. The text to be synthesized can be interactive information in text form generated by the computer according to the voice command input by the user, or it can be text information input externally. Exemplarily, the user inputs the voice command "play a gentle song", and the computer generates interactive information in text form according to the voice command input by the user, for example, "OK, the song "XXX" will be played for you soon", and the above interactive information is the text to be synthesized. The context information of the text to be synthesized indicates the context in which the text to be synthesized is played. For example, the context of the text to be synthesized can be different scenes such as music, navigation or chatting.

[0031] In the disclosed embodiment, the target interface skin matching the text to be synthesized is determined based on the context information of the text to be synthesized. Specifically, the context information of the current text to be synthesized can be determined by semantically recognizing the text to be synthesized, and then the identification of the interface skin matching the context information of the text to be synthesized can be determined based on the mapping relationship between the pre-stored context information and the identification of the interface skin, and finally the corresponding interface skin is obtained locally or in the cloud as the interface skin matching the text to be synthesized based on the identification of the interface skin.

[0032] It is also possible to determine the target interface skin to be matched with the text to be synthesized according to the specific scene in different contexts. Exemplarily, in the context of music, the target interface skin is determined according to the type of music. When the music type is soft, the target interface skin is the interface skin of petals slowly falling. When the music type is dynamic, the target interface skin is the interface skin showing a virtual character dancing or exercising. Another example is that in the context of chatting, it can be determined whether the person chatting is the driver in the main cab. If so, the target interface skin is determined to be a warning interface. If not, the target interface skin is determined to be an interface for two virtual characters to talk.

[0033] S120. In the process of playing the speech synthesized from the text to be synthesized, the target interface skin is used to update the current interface skin.

[0034] In the embodiment of the present disclosure, in order to vividly display the text to be synthesized to the user, during the process of playing the voice synthesized by the text to be synthesized, the target interface skin matching the text to be synthesized is used to adjust the current interface skin. Figure 1b As shown, the target interface skin can be used to replace the current interface skin, so that during the playback of the speech synthesized by the text to be synthesized, the interface skin that matches its context is displayed, thereby optimizing the display effect of the visual dimension. According to the pre-set context information priority, the interface skin corresponding to the high priority of the context information can be displayed first. For example, when the priority of the context information corresponding to the current interface skin is lower than the priority of the context information corresponding to the text to be synthesized, the target interface skin is used to replace the current interface skin. Conversely, when the priority of the context information corresponding to the current interface skin is higher than the priority of the context information corresponding to the text to be synthesized, the current interface skin remains unchanged. The target interface skin and the current interface skin can also be displayed simultaneously, for example, in a split-screen format.

[0035] In a specific example, it is determined that the target interface skin that matches the text to be synthesized is a soft picture, and the currently displayed interface skin is a dynamic picture. Obviously, the current interface skin and the target interface skin are different. At this time, during the process of playing the voice synthesized by the text to be synthesized, the currently displayed dynamic picture can be directly switched to a soft picture, so that the currently displayed interface skin matches the currently played voice, providing a good visual experience for the user.

[0036] In another specific example, the context information is navigation, news, music and chatting, and the priority of the above context information is set in advance. Specifically, the priority of the above context information is navigation, news, music and chatting from high to low. The text to be synthesized is "will broadcast the morning news for you", the context information of the text to be synthesized is news, and the target interface skin corresponding to the news is a virtual character in the image of a broadcaster, but the current interface skin is a soft picture, and it is obvious that the current interface skin and the target interface skin are different. At this time, according to the mapping relationship between the interface skin and the context information, it can be determined that the context information of the current interface skin is music, and according to the above priority sorting, it can be obtained that the priority of news is higher than that of music. In the process of playing the voice synthesized by the text to be synthesized, the virtual character in the image of the broadcaster is used to replace the currently displayed soft picture, so as to realize the priority display of the interface skin matched by the context information with higher priority. On the contrary, if the current interface skin is a virtual character in the image of a traffic policeman, it is different from the target interface skin (the virtual character in the image of the broadcaster). At this time, based on the mapping relationship between the interface skin and the context information, it can be determined that the context information of the current interface skin is navigation, and based on the above priority sorting, it can be obtained that the priority of navigation is higher than that of news. In the process of playing the voice synthesized by the text to be synthesized, the virtual character of the announcer image will not be used to replace the virtual character of the current traffic police image, and the interface skin that matches the context information with a higher priority will be given priority display.

[0037] In another specific example, the target interface skin corresponding to the text to be synthesized is a soft picture, but the current interface skin is a dynamic picture. During the process of playing the synthesized speech of the text to be synthesized, the above two interface skins can be displayed simultaneously in a split screen manner, while improving the user's visual experience and maintaining the normal display of the current interface skin.

[0038] The technical solution of the disclosed embodiment determines the target interface skin that matches the text to be synthesized based on the context information of the text to be synthesized, and then uses the target interface skin to update the current interface skin during the process of playing the speech synthesized by the text to be synthesized, thereby achieving the effect of adjusting the interface skin based on the context information of the text to be synthesized.

[0039] Figure 2a This is a schematic diagram of an interface skin updating method in an embodiment of the present disclosure, which further refines the above embodiment and provides specific steps for updating the current interface skin using a target interface skin, as well as specific steps before determining a target interface skin matching the text to be synthesized based on the context information of the text to be synthesized. Figure 2a A method for updating an interface skin provided by an embodiment of the present disclosure is described, including the following:

[0040] S210, performing semantic recognition on the text to be synthesized to obtain context information of the text to be synthesized.

[0041] In the embodiment of the present disclosure, after obtaining the text to be synthesized, semantic analysis is performed on the text to be synthesized to obtain context information of the text to be synthesized, so as to determine the interface skin corresponding to the context information, so that the text to be synthesized is vividly displayed. For example, a recurrent neural network can be used to perform semantic analysis on the text to be synthesized.

[0042] S220: Determine a target interface skin that matches the text to be synthesized according to the context information of the text to be synthesized.

[0043] S230. During the process of playing the speech synthesized by the text to be synthesized, when the current interface skin and the target interface skin are different, respectively obtain the first priority of the context information corresponding to the current interface skin and the second priority of the context information corresponding to the text to be synthesized.

[0044] In the embodiment of the present disclosure, priorities are set in advance for different context information to form a context information priority list. The interface skin corresponding to the context information with a higher priority can be displayed first, thereby improving the convenience of user use. Figure 2b As shown, in the process of playing the speech synthesized by the text to be synthesized, it is possible to first determine whether the current interface skin and the target interface skin are the same. If they are the same, there is no need to adjust the current interface skin. If they are different, the priority of the context information corresponding to the current interface skin can be further obtained as the first priority, and the priority of the context information corresponding to the text to be synthesized can be obtained as the second priority, so as to determine the update method of the current interface skin according to the priority of the context information.

[0045] When obtaining the priority, firstly, the context information corresponding to the current interface skin is obtained according to the mapping relationship between the interface skin and the context information. Further, the second priority of the context information corresponding to the above-mentioned text to be synthesized and the first priority of the context information corresponding to the current interface skin are searched in the pre-configured context information priority list.

[0046] Exemplarily, the context information of the text to be synthesized includes music, navigation, chatting and news. According to the context information priority list, it can be obtained that the priorities of the above context information are navigation, news, music and chatting from high to low. In a specific example, the context information of the text to be synthesized is navigation, and the corresponding target interface skin is a virtual character in the image of a traffic policeman, while the current interface skin is a virtual character in the image of a broadcaster. Obviously, the current interface skin and the target interface skin are inconsistent. In this case, firstly, based on the mapping relationship between the interface skin and the context information, it is determined that the context information corresponding to the current interface skin (i.e., the virtual character in the image of the broadcaster) is news. Furthermore, according to the pre-configured context information priority list, the priority of the context information of the current interface skin (i.e., the priority of news) is determined, and it is used as the first priority. At the same time, the priority of the context information of the text to be synthesized (i.e., the priority of navigation) is obtained, and it is used as the second priority.

[0047] Based on obtaining the first priority of the context information corresponding to the current interface skin and the second priority of the context information corresponding to the text to be synthesized, the first priority and the second priority can be used to determine how to adjust the current interface skin during the process of playing the speech synthesized by the text to be synthesized.

[0048] S240: When the second priority is higher than the first priority, the current interface skin is replaced with the target interface skin.

[0049] In the disclosed embodiment, when the second priority of the context information corresponding to the text to be synthesized is higher than the first priority of the context information corresponding to the current interface skin, it is determined that the display priority of the target interface skin is higher than the current interface skin, and the current interface skin can be directly replaced with the target interface skin, so that during the playback of the voice synthesized by the text to be synthesized, the corresponding target interface skin can be displayed at the same time, thereby improving the user interaction experience. Conversely, when the second priority of the context information corresponding to the text to be synthesized is lower than the first priority of the context information corresponding to the current interface skin, it is determined that the display priority of the target interface skin is lower than the current interface skin, and the current interface skin can be kept unchanged, ensuring that the user can continue to watch the current interface skin with a higher priority.

[0050] In addition, when the second priority of the context information corresponding to the text to be synthesized is the same as the first priority of the context information corresponding to the current interface skin, it can be set according to actual needs. For example, when the priorities are the same, the current interface skin can be kept unchanged.

[0051] Exemplarily, the context information corresponding to the text to be synthesized is navigation, and the context information corresponding to the current interface skin is music. The priority of navigation is higher than the priority of music. During the process of playing the speech synthesized by the text to be synthesized, the target interface skin corresponding to the text to be synthesized can be directly used to replace the current interface skin, and the interface skin corresponding to the navigation is displayed preferentially.

[0052] As another example, the context information corresponding to the text to be synthesized is chatting, and the context information corresponding to the current interface skin is music. The priority of music is higher than chatting. During the process of playing the speech synthesized by the text to be synthesized, the current interface skin can be kept unchanged, and the interface skin matched by the context information with a higher priority can be displayed normally.

[0053] The technical solution of the disclosed embodiment performs semantic recognition on the text to be synthesized, obtains the context information of the text to be synthesized, and then determines the target interface skin that matches the text to be synthesized according to the context information of the text to be synthesized, and in the process of playing the voice synthesized by the text to be synthesized, when the current interface skin and the target interface skin are different, respectively obtains the first priority of the context information corresponding to the current interface skin and the second priority of the context information corresponding to the text to be synthesized, and finally replaces the current interface skin with the target interface skin when the second priority is higher than the first priority, so that the interface skin can be adjusted through the context information, the vivid display of the text to be synthesized can be realized, and the interface skin with higher context priority is displayed preferentially, thereby improving user convenience.

[0054] Figure 3 This is a schematic diagram of an interface skin updating method in an embodiment of the present disclosure, which further refines the above embodiment and provides specific steps for determining a target interface skin matching the text to be synthesized according to the context information of the text to be synthesized, and specific steps for updating the current interface skin using the target interface skin. Figure 3 A method for updating an interface skin provided by an embodiment of the present disclosure is described, including the following:

[0055] S310: Determine a target interface skin that matches the text to be synthesized based on the context information of the text to be synthesized.

[0056] Optionally, determining a target interface skin matching the text to be synthesized according to context information of the text to be synthesized includes:

[0057] In the case where the context information of the text to be synthesized is music, the type of music and the singer of the music are determined according to the name of the music contained in the text to be synthesized, and the singer of the music is used as the speaker of the text to be synthesized;

[0058] According to the type of music and the speaker of the text to be synthesized, a target interface skin matching the text to be synthesized is determined.

[0059] In this optional embodiment, a method is provided for determining a target interface skin that matches the text to be synthesized based on the context information of the text to be synthesized, specifically: first, in the case where the context information of the text to be synthesized is music, the type of application and the singer of the music can be determined based on the name of the music contained in the text to be synthesized, and the singer of the music is used as the speaker of the speech synthesis of the text to be synthesized. Further, based on the type of music and the speaker of the text to be synthesized, the target interface skin that matches the text to be synthesized is jointly determined, so that when the speech synthesized by the text to be synthesized is played, the interface skin that matches its context information can be displayed at the same time, and the user's interaction needs in the visual and auditory dimensions can be met at the same time.

[0060] Exemplarily, the text to be synthesized is "The song "XXX" will be played for you soon". After semantic analysis, it can be determined that the context information of the text to be synthesized is music. At this time, it can be further obtained through the network based on the song name, and the type of the song is sweet and the singer is singer A. At this time, singer A can be used as the speaker of the synthesized speech of the current text to be synthesized. Finally, the target interface skin that matches the text to be synthesized can be determined as a sweet type interface skin based on the type of music (sweet) and the speaker (singer A). Among them, the type of music and the speaker can be input into the pre-trained neural network model to obtain the target interface skin output by the model. It can also be determined based on the mapping relationship between the pre-stored type of music and the speaker and the interface skin to determine the target interface skin corresponding to the current type of music and the speaker, that is, the target interface skin corresponding to the text to be synthesized.

[0061] Optionally, determining a target interface skin matching the text to be synthesized according to the context information of the text to be synthesized further includes:

[0062] When the context information of the text to be synthesized is navigation, obtaining the type of navigation information contained in the text to be synthesized;

[0063] In the case where the type of the navigation information is a warning type, determining that the target interface skin corresponding to the text to be synthesized is a warning interface;

[0064] When the type of the navigation information is a non-warning type, it is determined that the target interface skin corresponding to the text to be synthesized is a map navigation interface.

[0065] In this optional embodiment, another method is provided for determining a target interface skin that matches the text to be synthesized based on the context information of the text to be synthesized, specifically: when the context information of the text to be synthesized is navigation, the type of navigation information contained in the text to be synthesized can be obtained, specifically including: when the type of navigation information is an alarm type, determining that the target interface skin corresponding to the text to be synthesized is a warning interface, so as to serve as an information prompt to the user and improve the user's travel safety; when the type of navigation information is a non-alarm type, determining that the target interface skin corresponding to the text to be synthesized is a map navigation interface, so as to continue to provide navigation information to the user and meet the user's travel needs.

[0066] Exemplarily, the text to be synthesized is "The current road section has a speed limit of 30, you are speeding." By performing semantic analysis on the text to be synthesized, the context information is obtained as navigation. At this time, it can be further determined that the type of navigation information is a warning type, and the target interface skin corresponding to the text to be synthesized is determined to be a warning interface. For example, the interface displays eye-catching colors such as yellow or orange, and prompts the user in text form that he or she has exceeded the speed limit.

[0067] Optionally, determining a target interface skin matching the text to be synthesized according to the context information of the text to be synthesized further includes:

[0068] In the case where the context information of the text to be synthesized is chatting, determining whether the current chatting user is located in the main driving cabin;

[0069] When the current chatting user is in the main driving cabin, determining that the target interface skin corresponding to the text to be synthesized is a warning interface;

[0070] When the current chatting user is located at a location other than the main driving cabin, it is determined that the target interface skin corresponding to the text to be synthesized is a virtual character chatting interface.

[0071] In this optional embodiment, another method is provided for determining the target interface skin that matches the text to be synthesized based on the context information of the text to be synthesized. Specifically, when the context of the text to be synthesized is chatting, it is determined whether the current chatting user is located in the main driver's cab. If so, the target interface skin corresponding to the text to be synthesized is determined to be a warning interface to remind the user to pay attention to safety during driving. If not, the target interface skin corresponding to the text to be synthesized can be determined to be a virtual character chat interface.

[0072] Exemplarily, the text to be synthesized is "I will tell you a joke". At this time, it can be determined that the context information of the text to be synthesized is chatting. At this time, it is necessary to judge whether the current chatting user is the driver in the main cab. For example, the position of the current chatting user can be determined based on the pronunciation direction of the chatting user. If the chatting user is in the main cab, the target interface skin is determined to be a warning interface to provide a safety warning to the driver. If the chatting user is in a location other than the main cab, it means that the current chatting user is not the driver, then a virtual character chat interface can be displayed to meet the user's visual and auditory needs at the same time.

[0073] S320. During the process of playing the speech synthesized from the text to be synthesized, if the current interface skin is different from the target interface skin, the current interface skin and the target interface skin are simultaneously displayed in a split screen format.

[0074] In the disclosed embodiment, during the process of playing the speech synthesized by the text to be synthesized, if the current interface skin is different from the target interface skin, then in order not to interrupt the current interface skin currently being displayed, the target interface skin matching the text to be synthesized can also be displayed at the same time. The current interface skin and the target interface skin can be displayed simultaneously in a split screen form. Without affecting the content currently being watched by the user, the target skin interface corresponding to the synthesized speech being played can also be displayed, thereby enhancing the user interaction experience.

[0075] Exemplarily, the current interface skin is a map navigation interface. If the target interface skin determined based on the contextual information of the text to be synthesized is an aesthetic type interface skin, then during the process of playing the voice synthesized by the text to be synthesized, the map navigation interface and the aesthetic type interface skin are displayed simultaneously in split screen form.

[0076] Optionally, the current interface skin and the target interface skin are displayed simultaneously in a split screen format, including:

[0077] Respectively obtain the first priority of the context information corresponding to the current interface skin and the second priority of the context information corresponding to the text to be synthesized;

[0078] Determine the screen ratio of the target interface skin and the current interface skin according to the first priority and the second priority;

[0079] Display the current interface skin and the target interface skin simultaneously according to the split-screen ratio.

[0080] In this optional embodiment, a specific method is provided for simultaneously displaying the current interface skin and the target interface skin in the form of a split screen: first, the first priority of the context information corresponding to the current interface skin and the second priority of the text to be synthesized for the context information can be obtained respectively. Further, the split-screen ratio of the target interface skin and the current interface skin is determined according to the first priority and the second priority. Specifically, the split-screen ratio of the interface skin corresponding to a high priority of the context information can be higher than the split-screen ratio of the interface skin corresponding to a low priority of the context information. Determining the split-screen ratio of the interface skin according to the priority of the context information can highlight the interface skins with higher user demand and improve user convenience compared to displaying multiple interface skins in split screen with the same ratio.

[0081] The technical solution of the disclosed embodiment determines the target interface skin that matches the text to be synthesized according to the context information of the text to be synthesized, and during the process of playing the speech synthesized by the text to be synthesized, when the current interface skin is different from the target interface skin, the current interface skin and the target interface skin are displayed simultaneously in the form of split screen. On the one hand, the matching target interface skin can be displayed during the process of playing the speech synthesized by the text to be synthesized. On the other hand, when the current interface skin and the target interface skin to be displayed are different, there is no need to terminate the current interface skin, so that the effect of displaying the current interface skin and the target interface skin at the same time is achieved, thereby improving the user experience.

[0082] According to an embodiment of the present disclosure, Figure 4 1 is a structural diagram of an interface skin updating device in an embodiment of the present disclosure, and the present disclosure embodiment is applicable to the case where the interface skin is adjusted according to context information. The device is implemented by software and / or hardware and is specifically configured in an electronic device with certain data computing capabilities.

[0083] like Figure 4 The interface skin updating device 400 shown in the figure comprises: a target interface skin determining module 410 and a current interface skin updating module 420; wherein,

[0084] A target interface skin determination module 410 is used to determine a target interface skin matching the text to be synthesized according to the context information of the text to be synthesized;

[0085] The current interface skin updating module 420 is used to update the current interface skin by using the target interface skin during the process of playing the speech synthesized by the text to be synthesized.

[0086] The technical solution of the disclosed embodiment determines the target interface skin that matches the text to be synthesized based on the context information of the text to be synthesized, and then uses the target interface skin to update the current interface skin during the process of playing the speech synthesized by the text to be synthesized, thereby achieving the effect of adjusting the interface skin based on the context information of the text to be synthesized.

[0087] Furthermore, the current interface skin updating module 420 includes:

[0088] A context priority acquisition unit, used to respectively acquire the first priority of the context information corresponding to the current interface skin and the second priority of the context information corresponding to the text to be synthesized when the current interface skin is different from the target interface skin;

[0089] The interface skin replacement unit is used to replace the current interface skin with a target interface skin when the second priority is higher than the first priority.

[0090] Furthermore, the current interface skin updating module 420 includes:

[0091] The split-screen display unit is used to simultaneously display the current interface skin and the target interface skin in a split-screen form when the current interface skin and the target interface skin are different.

[0092] Furthermore, the split-screen display unit includes:

[0093] A context priority acquisition subunit, used to respectively acquire the first priority of the context information corresponding to the current interface skin and the second priority of the context information corresponding to the text to be synthesized;

[0094] A split-screen ratio determination subunit, used to determine the split-screen ratio of the target interface skin and the current interface skin according to the first priority and the second priority;

[0095] The split-screen display subunit is used to display the current interface skin and the target interface skin simultaneously according to the split-screen proportions.

[0096] Furthermore, the target interface skin determination module 410 includes:

[0097] A music information acquisition unit, for determining the type of music and the singer of the music according to the name of the music contained in the text to be synthesized, and using the singer of the music as the speaker of the text to be synthesized, when the context information of the text to be synthesized is music;

[0098] The target interface skin determination unit is used to determine the target interface skin matching the text to be synthesized according to the type of music and the speaker of the text to be synthesized.

[0099] Furthermore, the target interface skin determination module 410 includes:

[0100] A navigation information acquisition unit, used to acquire the type of navigation information contained in the text to be synthesized when the context information of the text to be synthesized is navigation;

[0101] A warning interface determination unit, used to determine that the target interface skin corresponding to the to-be-synthesized text is a warning interface when the type of the navigation information is a warning type;

[0102] The navigation interface determination unit is used to determine that the target interface skin corresponding to the to-be-synthesized text is a map navigation interface when the type of the navigation information is a non-warning type.

[0103] Furthermore, the interface skin updating device 400 further includes:

[0104] The context information acquisition module is used to perform semantic recognition on the text to be synthesized and acquire the context information of the text to be synthesized before determining the target interface skin matching the text to be synthesized based on the context information of the text to be synthesized.

[0105] The interface skin updating device provided in the embodiments of the present disclosure can execute the interface skin updating method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0106] In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0107] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0108] Figure 5 A schematic block diagram of an example electronic device 500 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0109] like Figure 5As shown, the device 500 includes a computing unit 501, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 502 or a computer program loaded from a storage unit 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the device 500 can also be stored. The computing unit 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0110] A number of components in the device 500 are connected to the I / O interface 505, including: an input unit 506, such as a keyboard, a mouse, etc.; an output unit 507, such as various types of displays, speakers, etc.; a storage unit 508, such as a disk, an optical disk, etc.; and a communication unit 509, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 509 allows the device 500 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0111] The computing unit 501 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 501 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 501 performs the various methods and processes described above, such as the interface skin update method. For example, in some embodiments, the interface skin update method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 508. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 500 via the ROM 502 and / or the communication unit 509. When the computer program is loaded into the RAM 503 and executed by the computing unit 501, one or more steps of the interface skin update method described above may be performed. Alternatively, in other embodiments, the computing unit 501 may be configured to perform the interface skin update method in any other appropriate manner (e.g., by means of firmware).

[0112] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0113] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0114] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0115] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0116] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0117] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0118] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0119] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for updating an interface skin, comprising: Perform semantic recognition on the text to be synthesized to obtain contextual information of the text to be synthesized; Determining a target interface skin matching the text to be synthesized according to the context information of the text to be synthesized; During the process of playing the speech synthesized from the text to be synthesized, the target interface skin is used to update the current interface skin.

2. The method according to claim 1, wherein: Adopting the target interface skin to update the current interface skin includes: When the current interface skin is different from the target interface skin, respectively obtaining the first priority of the context information corresponding to the current interface skin and the second priority of the context information corresponding to the text to be synthesized; When the second priority is higher than the first priority, the current interface skin is replaced with the target interface skin.

3. The method according to claim 1, wherein: Adopting the target interface skin to update the current interface skin includes: When the current interface skin is different from the target interface skin, the current interface skin and the target interface skin are displayed simultaneously in a split screen format.

4. The method according to claim 3, wherein: Display the current interface skin and the target interface skin simultaneously in split screen form, including: Respectively obtaining the first priority of the context information corresponding to the current interface skin and the second priority of the context information corresponding to the text to be synthesized; Determining the split screen ratio of the target interface skin and the current interface skin according to the first priority and the second priority; The current interface skin and the target interface skin are displayed simultaneously according to the split-screen ratio.

5. The method according to claim 1, wherein: Determining a target interface skin matching the text to be synthesized according to context information of the text to be synthesized includes: In the case where the context information of the text to be synthesized is music, the type of music and the singer of the music are determined according to the name of the music contained in the text to be synthesized, and the singer of the music is used as the speaker of the text to be synthesized; According to the type of music and the speaker of the text to be synthesized, a target interface skin matching the text to be synthesized is determined.

6. The method according to claim 1, wherein: Determining a target interface skin matching the text to be synthesized according to the context information of the text to be synthesized, further comprising: When the context information of the text to be synthesized is navigation, obtaining the type of navigation information contained in the text to be synthesized; In the case where the type of the navigation information is a warning type, determining that the target interface skin corresponding to the text to be synthesized is a warning interface; When the type of the navigation information is a non-warning type, it is determined that the target interface skin corresponding to the text to be synthesized is a map navigation interface.

7. An interface skin updating device, comprising: A context information acquisition module is used to perform semantic recognition on the text to be synthesized and obtain context information of the text to be synthesized; A target interface skin determination module, used to determine a target interface skin matching the text to be synthesized according to the context information of the text to be synthesized; The current interface skin updating module is used to update the current interface skin by using the target interface skin during the process of playing the speech synthesized by the text to be synthesized.

8. The device according to claim 7, wherein: The current interface skin updating module includes: A context priority acquisition unit, used to respectively acquire the first priority of the context information corresponding to the current interface skin and the second priority of the context information corresponding to the text to be synthesized when the current interface skin is different from the target interface skin; The interface skin replacement unit is used to replace the current interface skin with a target interface skin when the second priority is higher than the first priority.

9. The device according to claim 7, wherein: The current interface skin updating module includes: The split-screen display unit is used to simultaneously display the current interface skin and the target interface skin in a split-screen form when the current interface skin and the target interface skin are different.

10. The device according to claim 9, wherein: The split-screen display unit comprises: A context priority acquisition subunit, used to respectively acquire the first priority of the context information corresponding to the current interface skin and the second priority of the context information corresponding to the text to be synthesized; A split-screen ratio determination subunit, used to determine the split-screen ratio of the target interface skin and the current interface skin according to the first priority and the second priority; The split-screen display subunit is used to display the current interface skin and the target interface skin simultaneously according to the split-screen proportions.

11. The device according to claim 7, wherein: The target interface skin determination module includes: A music information acquisition unit, for determining the type of music and the singer of the music according to the name of the music contained in the text to be synthesized, and using the singer of the music as the speaker of the text to be synthesized, when the context information of the text to be synthesized is music; The target interface skin determination unit is used to determine the target interface skin matching the text to be synthesized according to the type of music and the speaker of the text to be synthesized.

12. The device according to claim 7, wherein: The target interface skin determination module includes: A navigation information acquisition unit, used to acquire the type of navigation information contained in the text to be synthesized when the context information of the text to be synthesized is navigation; A warning interface determination unit, used to determine that the target interface skin corresponding to the to-be-synthesized text is a warning interface when the type of the navigation information is a warning type; The navigation interface determination unit is used to determine that the target interface skin corresponding to the to-be-synthesized text is a map navigation interface when the type of the navigation information is a non-warning type.

13. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the interface skin updating method according to any one of claims 1 to 6.

14. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to enable the computer to execute the interface skin updating method according to any one of claims 1-6.

15. A computer program product, comprising a computer program / instruction, wherein the computer program / instruction, when executed by a processor, implements the interface skin updating method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Broadcast system using text to speech conversion

    CN102378050A

  • Multi-modal interactive processing method and system based on virtual person

    CN107894833A