A postcard generation method and device, a vehicle and a storage medium

Abstract

The application provides a postcard generation method and device, a vehicle and a storage medium, relates to the technical field of intelligent vehicles, and can generate a postcard related to a vehicle-mounted voice assistant according to the demand of a user, so as to improve the driving experience of the user. The method comprises the following steps: obtaining voice information of a vehicle user, and identifying a trigger word in the voice information; associatively expanding the identified trigger word to generate description information of a postcard; generating a picture of the postcard and text information matched with the picture according to the description information; generating the postcard according to the picture and the text information; and displaying the postcard on a vehicle-machine interface.

Description

Technical Field

[0001] This application relates to the field of intelligent vehicle technology, and more particularly to the field of in-vehicle voice assistant technology, specifically to a postcard generation method, device, vehicle, and storage medium. Background Technology

[0002] With the development and popularization of intelligent connectivity in the automotive field, in-vehicle voice assistants are gradually becoming a standard feature in every car. After a car is equipped with an in-vehicle voice assistant, users can directly interact with the assistant through voice commands to achieve functions such as playing music and navigation, greatly improving the user's driving experience and bringing convenience to the user.

[0003] Currently, with the development of in-vehicle voice assistants, the functions they can perform are becoming more and more comprehensive, such as intelligent conversation, nearby search, and automated command execution. It can be seen that the development of in-vehicle voice assistants focuses mainly on functionality and human-computer interaction. With the current situation that they can meet users' daily driving needs, the single and boring image of in-vehicle voice assistants is gradually failing to meet users' needs. Users are beginning to pursue a more diversified image of in-vehicle voice assistants to enrich their driving experience. Summary of the Invention

[0004] This application provides a method, apparatus, vehicle, and storage medium for generating postcards, to enrich the image of in-vehicle voice assistants and improve user experience. The technical solution of this application is as follows:

[0005] According to the first aspect of this application, a method for generating a postcard is provided, comprising: acquiring voice information of a vehicle user; recognizing trigger words in the voice information; performing associative expansion on the recognized trigger words to generate descriptive information for the postcard; generating an image of the postcard and text information matching the image based on the descriptive information; generating the postcard based on the image and text information; and displaying the postcard on the vehicle's infotainment system interface.

[0006] In one possible implementation, the method includes: generating image elements corresponding to the description information based on the description information; matching the description information with corresponding composition rules, and creating a composition for the image elements according to the composition rules to generate an uncolored image; determining a color scheme based on the description information, and color matching the uncolored image according to the color scheme to generate an image.

[0007] In one possible implementation, the method includes: extracting features from the image to obtain feature information of the image; and generating text information that matches the image based on the description information and the feature information.

[0008] In one possible implementation, the method includes: adding an image to a preset image position in a postcard template, and adding text information to a preset text position in a postcard template to obtain a postcard.

[0009] In one possible implementation, the method further includes: obtaining role setting information of the in-vehicle voice assistant; and determining trigger words based on the role setting information of the in-vehicle voice assistant.

[0010] According to a second aspect of this application, a postcard generation apparatus is provided, comprising: a recognition module for acquiring voice information of a vehicle user and recognizing trigger words in the voice information; a generation module for performing associative expansion on the recognized trigger words to generate descriptive information for the postcard; the generation module is further configured to generate an image of the postcard and text information matching the image based on the descriptive information; the generation module is further configured to generate the postcard based on the image and text information; and a display module for displaying the postcard on a vehicle infotainment interface.

[0011] In one possible implementation, the above-mentioned generation module is specifically used to: generate image elements corresponding to the description information based on the description information; match the corresponding composition rules based on the description information, and create a composition for the image elements according to the composition rules to generate an uncolored image.

[0012] In one possible implementation, the above-mentioned generation module is specifically used for: extracting features from the image to obtain the image's feature information; and generating text information that matches the image based on the description information and the feature information.

[0013] In one possible implementation, the above-mentioned generation module is specifically used to: add an image to a preset image position in the postcard template, and add text information to a preset text position in the postcard template to obtain a postcard.

[0014] In one possible implementation, the device further includes: a processing module for acquiring role setting information of the in-vehicle voice assistant; the processing module is also used to determine a trigger word based on the role setting information of the in-vehicle voice assistant.

[0015] According to a third aspect provided in this application, a vehicle is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute instructions to implement the method of the first aspect described above and any possible implementation thereof.

[0016] According to a fourth aspect provided in this application, a computer-readable storage medium is provided that, when the instructions in the computer-readable storage medium are executed by a processor of a vehicle, enables the vehicle to perform the methods described in the first aspect and any possible implementation thereof.

[0017] According to the fifth aspect provided in this application, a computer program product is provided, the computer program product including computer instructions that, when executed on a vehicle, cause the vehicle to perform the method described in the first aspect and any possible implementation thereof.

[0018] Therefore, the above-mentioned technical features of this application have the following beneficial effects:

[0019] (1) Based on the voice information of the vehicle user, the needs of the vehicle user can be identified, and then postcards including the in-vehicle voice assistant can be generated based on the voice information. This realizes the generation of different postcards according to the needs of the vehicle user, thereby improving the user experience.

[0020] (2) The images in the postcard can be generated based on the descriptive information extended from the user's voice information, which can make the image content of the postcard richer and make the postcard more in line with the user's needs.

[0021] (3) Generate text information that matches the image based on the user's voice information and image, so that the images and text on the postcard are more relevant, thereby improving the user's viewing experience.

[0022] (4) By adding the generated images and text information to the preset postcard template, postcards are generated, which improves the efficiency of postcard generation.

[0023] (5) Based on the role settings of different in-vehicle preset assistants, different trigger words are used, which increases the user's choice and thus improves the user experience.

[0024] It should be noted that the technical effects of any of the implementation methods in aspects two through five can be found in the technical effects of the corresponding implementation methods in aspect one, and will not be repeated here.

[0025] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0026] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application, and do not constitute an undue limitation of this application.

[0027] Figure 1 This is a flowchart illustrating a method for generating a postcard according to an exemplary embodiment;

[0028] Figure 2 This is a flowchart illustrating yet another method for generating a postcard, according to an exemplary embodiment.

[0029] Figure 3 This is a complete flowchart illustrating a method for generating a postcard according to an exemplary embodiment;

[0030] Figure 4 This is a schematic diagram of the structure of a postcard generating apparatus according to an exemplary embodiment;

[0031] Figure 5 This is a schematic diagram of the structure of a vehicle according to an exemplary embodiment. Detailed Implementation

[0032] To enable those skilled in the art to better understand the technical solutions of this application, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0033] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0034] For ease of understanding, the following detailed description of a postcard generation method provided in this application is provided in conjunction with the accompanying drawings.

[0035] Figure 1 This is a flowchart illustrating a method for generating a postcard according to an exemplary embodiment, such as... Figure 1 As shown, the method for generating this postcard includes the following steps:

[0036] S101. Obtain the voice information of the vehicle user and identify the trigger words in the voice information.

[0037] In some embodiments, the trigger word is determined by: obtaining the role setting information of the in-vehicle voice assistant; and determining the trigger word based on the role setting information of the in-vehicle voice assistant.

[0038] For example, the system has preset a variety of role settings for the in-vehicle voice assistant. The role settings can be set as the character of the in-vehicle voice assistant, such as liking outer space, liking travel, and liking painting. According to the corresponding role settings, the trigger words can be set as universe, city, and scenery.

[0039] S102. Expand the identified trigger words through association to generate postcard description information.

[0040] Understandably, trigger words contain relatively little information and cannot be used directly to generate postcards. Therefore, it is necessary to expand the trigger words through association to generate more descriptive information.

[0041] For example, the descriptive information can be the central idea or core element of the postcard.

[0042] In some embodiments, the identified trigger words are input into a description information generation model to obtain the postcard's description information. For example, if the identified trigger word is "painting," then "painting" is input into the description information generation model. After processes such as text analysis, text generalization, and inspiration association, the postcard's description information is obtained. The description information could be: a girl who likes to paint is sketching in the city with her easel.

[0043] S103. Generate a postcard image and matching text information based on the description information.

[0044] like Figure 2 As shown, in some embodiments, S103 may include the following steps:

[0045] S1031. Generate the image elements corresponding to the description information based on the description information.

[0046] One possible approach is to input the descriptive information into the element generation model to obtain the image element corresponding to the descriptive information.

[0047] For example, when the generated description includes "city", the generated image elements include "buildings", "roads", "vehicles", etc.; as another example, when the generated description includes "scenery", the generated image elements include "mountains", "rivers", "forests", etc.

[0048] S1032. Match the corresponding composition rules according to the description information, and create a composition for the image elements according to the composition rules to generate an uncolored image.

[0049] It should be noted that the composition rules are system presets used to create compositions based on the generated image elements, thereby generating uncolored images.

[0050] For example, composition rules include central composition, rule of thirds composition, golden ratio composition, and diagonal composition.

[0051] S1033. Based on the description information, determine the color scheme, and then match the colors of the uncolored images according to the color scheme to generate the images.

[0052] For example, the intelligent color matching model includes six basic hues: red, orange, yellow, green, blue, and purple. Different descriptive information and uncolored images correspond to different color matching styles. For instance, if the descriptive information and uncolored images include "landscape" or "forest," the corresponding color scheme will use green as the main color and other colors as secondary colors to match the uncolored images.

[0053] S1034. Input the uncolored image and description information into the intelligent color matching model to obtain a complete image.

[0054] S1035. The text content of the postcard is generated in the following way: feature extraction is performed on the image to obtain the image's feature information; based on the description information and feature information, text information matching the image is generated.

[0055] S104. Generate a postcard based on the image and text information.

[0056] In some embodiments, an image is added to a preset image position in a postcard template, and text information is added to a preset text position in a postcard template to obtain a postcard.

[0057] The postcard templates are system presets, and include preset image and text positions.

[0058] Understandably, after generating the image and text information, the postcard template can be directly called to generate the corresponding postcard.

[0059] S105. Display postcards on the vehicle's infotainment system interface.

[0060] In some embodiments, after generating a corresponding postcard based on the vehicle user's voice information, the vehicle is controlled to issue a notification to remind the vehicle user that a new postcard has been generated, and the postcard is displayed on the vehicle's infotainment screen at a fixed time frequency.

[0061] For example, once a postcard is generated, the vehicle emits a notification sound to inform the vehicle user that a new postcard has been generated, and displays the generated postcard on the vehicle's infotainment screen once every 10 minutes.

[0062] In this way, postcards can be customized based on the voice information of vehicle users, thus showcasing a rich variety of in-vehicle voice assistant images, enhancing the presence of the in-vehicle voice assistant, and improving the driving experience of vehicle users.

[0063] like Figure 3 As shown, embodiments of this application provide Figure 3 The diagram shows a complete flowchart of a method for generating postcards. The method includes the following steps:

[0064] S201. Obtain the voice information of the vehicle user and identify the trigger words in the voice information.

[0065] S202. Expand the identified trigger words through association to generate postcard description information.

[0066] S203. Generate the image elements corresponding to the description information based on the description information.

[0067] S204. Match the corresponding composition rules according to the information, and create a composition for the image elements according to the composition rules to generate an uncolored image.

[0068] S205. Based on the description information, determine the color scheme, and then match the colors of the uncolored images according to the color scheme to generate the images.

[0069] S206. Extract features from the image to obtain its feature information.

[0070] S207. Generate text information that matches the image based on the description information and feature information.

[0071] S208. Add the image to the preset image position in the postcard template and add the text information to the preset text position in the postcard template to obtain the postcard.

[0072] S209. Display postcards on the vehicle infotainment screen.

[0073] The above primarily describes the solutions provided by the embodiments of this application from a methodological perspective. To achieve the above functions, the postcard generating apparatus or electronic device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0074] This application embodiment can, based on the above method, exemplarily divide a postcard generating device or electronic device into functional modules. For example, the postcard generating device or electronic device may include functional modules corresponding to each functional division, or two or more functions may be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division; in actual implementation, there may be other division methods.

[0075] Figure 4 This is a schematic diagram illustrating the structure of a postcard generating apparatus according to an exemplary embodiment. (Refer to...) Figure 4 The postcard generating device 30 includes: an identification module 301, a generating module 302, and a display module 303.

[0076] The recognition module 301 is used to acquire the voice information of the vehicle user and to recognize the trigger words in the voice information.

[0077] The generation module 302 is used to expand the association of the identified trigger words and generate the description information of the postcard.

[0078] The generation module 302 is also used to generate a postcard image and text information matching the image based on the description information.

[0079] The generation module 302 is also used to generate postcards based on image and text information.

[0080] Display module 303 is used to display postcards on the vehicle infotainment interface.

[0081] In some embodiments, the generation module 302 is specifically used to generate image elements corresponding to the description information based on the description information; match the corresponding composition rules based on the description information; and create a composition for the image elements based on the composition rules to generate an uncolored image.

[0082] In some embodiments, the generation module 302 is specifically used to extract features from the image to obtain the image's feature information; and to generate text information matching the image based on the description information and the feature information.

[0083] In some embodiments, the generation module 302 is specifically used to add an image to a preset image position in the postcard template and to add text information to a preset text position in the postcard template to obtain a postcard.

[0084] In some embodiments, the above-described apparatus further includes: a processing module 304, configured to acquire role setting information of the in-vehicle voice assistant; the processing module 304 is further configured to determine a trigger word based on the role setting information of the in-vehicle voice assistant.

[0085] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0086] Figure 5 This is a schematic diagram illustrating the structure of a vehicle according to an exemplary embodiment. For example... Figure 5 As shown, vehicle 40 includes, but is not limited to, processor 401 and memory 402.

[0087] The memory 402 described above is used to store the executable instructions of the processor 401. It is understood that the processor 401 is configured to execute instructions to implement the postcard generation method in the above embodiment.

[0088] It should be noted that those skilled in the art will understand that Figure 5 The vehicle structure shown does not constitute a limitation on the vehicle; a vehicle may include, but is not limited to, other types of vehicles. Figure 5 This may indicate more or fewer components, or combinations of certain components, or different component arrangements.

[0089] The processor 401 is the control center of the vehicle, connecting various parts of the vehicle through various interfaces and lines. It performs various vehicle functions and processes data by running or executing software programs and / or modules stored in the memory 402, and by calling data stored in the memory 402, thereby providing overall vehicle monitoring. The processor 401 may include one or more processing units. Optionally, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may also not be integrated into the processor 401.

[0090] The memory 402 can be used to store software programs and various data. The memory 402 may primarily include a program storage area and a data storage area. The program storage area may store the operating system, application programs required by at least one functional module (such as a determination unit, processing unit, etc.), etc. Furthermore, the memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0091] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 402 including instructions, which can be executed by a processor 401 of a vehicle 40 to implement the postcard generation method in the above embodiments.

[0092] In actual implementation, Figure 4 The functions of the identification module 301, generation module 302, display module 303, and processing module 304 can all be derived from... Figure 5 The processor 401 calls the computer program stored in the memory 402 to implement the process. The specific execution process can be found in the description of the postcard generation method in the previous embodiment, and will not be repeated here.

[0093] Optionally, the computer-readable storage medium may be a non-transitory computer-readable storage medium, such as a read-only memory (ROM), random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device.

[0094] In an exemplary embodiment, this application also provides a computer program product including one or more instructions, which can be executed by a vehicle processor 401 to complete the postcard generation method in the above embodiments.

[0095] It should be noted that when one or more instructions in the computer-readable storage medium or computer program product are executed by the vehicle's processor, they implement the various processes of the above-described postcard generation method embodiment and achieve the same technical effect as the postcard generation method. To avoid repetition, these will not be elaborated here.

[0096] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0097] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0098] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the classified units can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0099] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0100] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, essentially, or the part that contributes to the prior art, or a complete or partial classification of the technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0101] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for generating a postcard, characterized in that, Applied to vehicle-mounted terminals, the method includes: Obtain the role setting information of the in-vehicle voice assistant, wherein the role setting information is used to characterize the role setting of the in-vehicle voice assistant; Based on the role settings information of the in-vehicle voice assistant, determine the trigger word; Acquire the voice information of the vehicle user, and identify the trigger words in the voice information; The identified trigger words are expanded through association to generate descriptive information for the postcard; Generate an image of the postcard and text information matching the image based on the description information; Generate a postcard based on the image and text information; The postcard is displayed on the vehicle's infotainment system.

2. The method according to claim 1, characterized in that, The image was generated in the following way: Based on the description information, generate the image element corresponding to the description information; Match the corresponding composition rules according to the description information, and create a composition for the image elements according to the composition rules to generate an uncolored image; Based on the described information, a color scheme is determined, and the uncolored image is color-matched according to the color scheme to generate the image.

3. The method according to claim 2, characterized in that, The text information is generated in the following way: Feature extraction is performed on the image to obtain its feature information; Based on the description information and the feature information, text information matching the image is generated.

4. The method according to claim 1, characterized in that, The step of generating a postcard based on the image and the text information includes: The postcard is obtained by adding the image to the preset image position in the postcard template and adding the text information to the preset text position in the postcard template.

5. A postcard generating apparatus, characterized in that, The device includes: The processing module is used to obtain the role setting information of the in-vehicle voice assistant, wherein the role setting information is used to characterize the role setting of the in-vehicle voice assistant; The processing module is also used to determine the trigger word based on the role setting information of the in-vehicle voice assistant; The recognition module is used to acquire the voice information of the vehicle user and to recognize the trigger words in the voice information; The generation module is used to perform associative expansion on the identified trigger words to generate postcard description information; The generation module is also used to generate an image of the postcard and text information matching the image based on the description information; The generation module is also used to generate a postcard based on the image and the text information; The display module is used to display the postcard on the vehicle's infotainment interface.

6. The apparatus according to claim 5, characterized in that, The generation module is specifically used for: Based on the description information, generate the image element corresponding to the description information; Match the corresponding composition rules according to the description information, and create a composition for the image elements according to the composition rules to generate an uncolored image; Based on the described information, a color scheme is determined, and the uncolored image is color-matched according to the color scheme to generate the image.

7. The apparatus according to claim 6, characterized in that, The generation module is specifically used for: Feature extraction is performed on the image to obtain its feature information; Based on the description information and the feature information, text information matching the image is generated.

8. The apparatus according to claim 5, characterized in that, The generation module is specifically used for: The postcard is obtained by adding the image to the preset image position in the postcard template and adding the text information to the preset text position in the postcard template.

9. A vehicle, characterized in that, include: processor; A memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the method as described in any one of claims 1 to 4.

10. A computer-readable storage medium, characterized in that, When the computer-executable instructions stored in the computer-readable storage medium are executed by the vehicle's processor, the vehicle is able to perform the method as described in any one of claims 1 to 4.

Images