Voice interaction method and device and related product

Abstract

The embodiment of the invention provides a voice interaction method and device and a related product, and relates to the technical field of vehicles, and the voice interaction method comprises the steps: obtaining a first hot word contained in a first voice triggering instruction in response to the first voice triggering instruction of a user; if it is determined that the control page of the vehicle contains a plurality of controls associated with the first hot word according to the first hot word, labeling the plurality of controls to generate a plurality of labeled controls; displaying the plurality of marked controls in the control page; and in response to a second voice trigger instruction sent by the user for a target control in the plurality of marked controls, triggering the target control, and executing an operation corresponding to the target control. Through the embodiment of the invention, the problem that the function execution result deviates from the user intention due to the fact that the vehicle randomly triggers or does not trigger the control based on the voice trigger instruction sent by the user under the condition that hot words of multiple controls are the same can be avoided, the accuracy of user interaction is improved, and the efficiency of user interaction is improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a voice interaction method, device, and related products. Background Art

[0002] Amid the rapid evolution of in-vehicle intelligent systems, voice interaction has become a core functional module of vehicle-mounted systems. The "See, Say" feature, a key voice control technology, allows users to directly trigger interface controls through natural language commands, enabling operations such as navigation settings, music playback, and air conditioning adjustment. This significantly improves the convenience and safety of driving interactions. However, current technologies still face significant practical challenges. When multiple semantically related actionable controls are present in the vehicle-mounted interface, the system can easily struggle with command recognition. For example, if the interface displays both a "front" and a "rear" air conditioning button, and the user issues the voice command "Turn on AC" with the intent to turn on the rear air conditioning, the system may not accurately recognize the intended command, potentially turning on the front air conditioning or both. This uncertainty not only leads to deviations from user expectations but also potentially distracts the driver, posing potential safety risks and severely impacting the user's interactive experience. Summary of the Invention

[0003] The purpose of the embodiments of the present application is to provide a voice interaction method, device and related products to solve the problem in related technologies that the intention of voice trigger instructions cannot be accurately identified, resulting in a deviation between the function execution results and the user's intention.

[0004] In order to solve the above technical problems, the embodiments of the present application are implemented as follows: In a first aspect, an embodiment of the present application provides a voice interaction method, comprising: In response to a first voice trigger instruction of a user, obtaining a first hot word included in the first voice trigger instruction; If it is determined based on the first hot word that the vehicle's control page includes multiple controls associated with the first hot word, annotating the multiple controls to generate multiple annotated controls; Displaying the marked multiple controls in the control page; In response to a second voice trigger instruction issued by the user for a target control among the marked multiple controls, the target control is triggered and an operation corresponding to the target control is performed.

[0005] Optionally, the determining, based on the first hot word, that a control page of the vehicle includes multiple controls associated with the first hot word includes: According to the hot word type of the first hot word, determining in the control interface a plurality of initial controls whose function types match the hot word type of the first hot word; According to the hot word content of the first hot word, it is determined that the multiple initial controls include multiple controls whose control names are semantically related to the hot word content.

[0006] Optionally, the performing annotation processing on the multiple controls to generate multiple annotated controls includes: Sorting the multiple controls according to historical trigger records of the multiple controls to generate a sorting result for the multiple controls; According to the sorting result, the multiple controls are annotated to generate the annotated multiple controls.

[0007] Optionally, the tagging the multiple controls according to the sorting result to generate the multiple tagged controls includes: Generating serial numbers corresponding to the plurality of controls according to the sorting result; For each of the multiple controls, a serial number labeling process is performed on the control according to the corresponding serial number to generate a serial number-labeled control.

[0008] Optionally, the tagging the multiple controls according to the sorting result to generate the multiple tagged controls includes: Determining, according to the sorting result, display styles corresponding to the plurality of controls for distinguishing display; For each of the multiple controls, display style annotation processing is performed on the control according to the corresponding display style to generate a control with display style annotation.

[0009] Optionally, the multiple controls are located on the same display interface of the control interface, and the marked multiple controls are multiple controls marked with serial numbers; and displaying the multiple controls marked with serial numbers on the control page includes: According to the result of the serial number marking, rearrange the plurality of controls marked with the serial numbers on the display interface in the order of the serial numbers; The rearranged plurality of controls marked with the serial numbers are displayed on the display interface.

[0010] Optionally, the multiple controls are located on different display interfaces of a control interface, and the marked multiple controls are multiple controls marked with serial numbers; and displaying the multiple controls marked with serial numbers on the control page includes: According to the result of the serial number marking, the multiple controls marked with the serial numbers are rearranged in the order of the serial numbers on the same display interface; The rearranged plurality of controls marked with the serial numbers are displayed on the same display interface.

[0011] Optionally, the method further includes: For each marked control, determining at least one second hot word for triggering the marked control; The at least one second hot word corresponding to each marked control is saved.

[0012] In a second aspect, an embodiment of the present application provides a voice interaction device, comprising: An acquisition module, configured to acquire a first hot word contained in a first voice trigger instruction in response to a user's first voice trigger instruction; a marking module configured to, if it is determined based on the first hot word that a control page of the vehicle contains multiple controls associated with the first hot word, mark the multiple controls to generate multiple marked controls; A display module, configured to display the marked multiple controls in the control page; An execution module is used to trigger the target control in response to a second voice trigger instruction issued by the user to the target control among the marked multiple controls, and execute an operation corresponding to the target control.

[0013] In a third aspect, an embodiment of the present application provides a voice interaction device comprising a memory and a processor; the memory stores executable program code, and when the executable program code is executed by the processor, the voice interaction method steps described in the first aspect above are implemented.

[0014] In a fourth aspect, an embodiment of the present application provides a vehicle comprising the voice interaction device as described in the third aspect above.

[0015] In a fifth aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the voice interaction method described in the first aspect above are implemented.

[0016] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the voice interaction method described in the first aspect above are implemented.

[0017] In the seventh aspect, an embodiment of the present application provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer performs the steps of the voice interaction method described in the first aspect above.

[0018] From the technical solutions provided by the above embodiments of the present application, it can be seen that in the embodiments of the present application, first, in response to the user's first voice trigger command, a first hot word contained in the first voice trigger command is obtained. Then, if it is determined based on the first hot word that the vehicle's control page contains multiple controls associated with the first hot word, the multiple controls are annotated to generate multiple annotated controls. Then, the multiple annotated controls are displayed in the control page. Finally, in response to the second voice trigger command issued by the user for the target control in the annotated multiple controls, the target control is triggered and the operation corresponding to the target control is executed. It can be seen that through the embodiments of the present application, in a scenario where multiple controls have the same hot word, multiple controls can be annotated to generate multiple annotated controls, and the multiple annotated controls can be displayed to the user in the control page, so that the user can accurately locate the target control according to the annotated result, and then a second voice trigger command corresponding to the annotated result is issued to the target control, so that the vehicle computer can accurately identify the intention of the voice trigger command, avoiding the problem that the function execution result deviates from the user's intention due to the vehicle randomly triggering or not triggering the control when multiple controls have the same hot word, thereby improving the efficiency of user interaction and the accuracy of control triggering. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in this application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0020] Figure 1 A flowchart of a voice interaction method provided in an embodiment of the present application; Figure 2 A schematic diagram of a control page provided in an embodiment of the present application; Figure 3 A schematic diagram of the serial number marking process provided in the embodiment of the present application; Figure 4 A display diagram of multiple controls marked with serial numbers provided in an embodiment of the present application; Figure 5 A schematic diagram of the process of the voice interaction method provided in an embodiment of the present application; Figure 6A schematic diagram of the module composition of a voice interaction device provided in an embodiment of the present application; Figure 7 A schematic diagram of the structure of a voice interaction device provided in an embodiment of the present application; Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] The embodiments of the present application provide a voice interaction method, device and related products.

[0022] In order to enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0023] Before introducing the voice interaction method, device and related products provided by the embodiments of the present application, the application scenarios provided by the embodiments of the present application are first described. The voice interaction method provided by the embodiments of the present application can be applied to scenarios where there are multiple controls with the same hot words in the interface of a vehicle terminal device. In a specific application scenario, when the vehicle is in the startup state, the user expects to trigger the rear air-conditioning controls on the interface of the vehicle-mounted terminal device through the voice trigger command "turn on the air conditioner" to turn on the rear air-conditioning inside the vehicle. However, in the related art, the air-conditioning controls on the interface of the vehicle-mounted terminal device include rear air-conditioning controls in addition to the front air-conditioning controls. When the user issues a voice trigger command of "turn on the air conditioner", the vehicle computer cannot accurately identify whether the voice trigger command intends to turn on the front air-conditioning or the rear air-conditioning. In this case, the vehicle computer randomly triggers the front air-conditioning controls and turns on the front air-conditioning, resulting in a deviation between the function execution result and the user's intention.

[0024] In order to solve the above problems, the embodiments of the present application provide a voice interaction method, device and related products, which can avoid the problem that when multiple controls have the same hot words, the vehicle randomly triggers or does not trigger controls based on the voice trigger instructions issued by the user, resulting in the function execution results deviating from the user's intentions. This enables the vehicle to accurately identify the intention of the voice trigger instruction, improve the accuracy of the control trigger, and improve the efficiency of user interaction.

[0025] The following is a clear and complete description of the voice interaction method, device and related products provided in the embodiments of the present application in combination with specific application scenarios and the drawings in the embodiments of the present application.

[0026] Figure 1 This is a flow chart of a voice interaction method provided in an embodiment of the present application, which can be executed by a vehicle-mounted terminal device. Figure 1 As shown, the voice interaction method may specifically include the following steps: Step S102: In response to a first voice trigger instruction from a user, a first hot word included in the first voice trigger instruction is obtained.

[0027] The vehicle-mounted terminal device can detect the user's first voice trigger instruction, and in response to the first voice trigger instruction, obtain the first hot word contained in the first voice trigger instruction. The voice trigger instruction can be in the form of natural language, and the voice trigger instruction can be exemplified by "turn on the air conditioner", "turn on the navigation", "increase the volume", etc. Hot words refer to specific words or phrases used to trigger the operation of specific controls. For example, in the voice trigger instruction "turn on the navigation", the word "turn on the navigation" is the hot word for the corresponding navigation control. For another example, in the voice trigger instruction "turn on the air conditioner", the word "turn on the air conditioner" is the hot word for the corresponding air conditioner control.

[0028] Step S104: If it is determined based on the first hot word that the vehicle's control page contains multiple controls associated with the first hot word, the multiple controls are annotated to generate multiple annotated controls.

[0029] Controls are operable objects in the interface of the vehicle terminal device. Users interact with the controls through operations such as clicking and voice interaction to trigger corresponding functions. Examples of controls include air conditioning controls, volume controls, navigation controls, etc. The vehicle's control page is a page in the vehicle terminal device interface that contains various controls. There can be multiple control pages, and one control page can contain or display multiple controls. The multiple controls associated with the first hot word can be located in the same control page or in different control pages. The control page is explained below by way of diagrams. Figure 2 A schematic diagram of the control page provided in the embodiment of this application, such as Figure 2 As shown, the control page is one of the control pages in the vehicle terminal device interface, and the navigation control, air conditioning control, music control and telephone control are displayed on the control page.

[0030] In one embodiment, based on the first hot word, determining that a control page of the vehicle includes multiple controls associated with the first hot word includes: According to the hot word type of the first hot word, determining a plurality of initial controls on the control page including a function type matching the hot word type of the first hot word; According to the hot word content of the first hot word, a plurality of controls whose control names are semantically related to the hot word content are determined from the plurality of initial controls.

[0031] In this embodiment, based on the first hot word, determining that the vehicle's control page contains multiple controls associated with the first hot word can be done by first determining, based on the hot word type of the first hot word, that the control page contains multiple initial controls whose function types match the hot word type of the first hot word. The hot word type is used to represent the application scenario or function positioning of the hot word, and the hot word type can be exemplified by switch control type, adjustment type, selection type, etc. The function type of the control matches the hot word type of the hot word, and the operation method of the control can be consistent with the action described by the hot word. For example, a volume adjustment control, whose control function is to adjust the volume, matches the adjustment type hot word. For another example, a network switch control, whose control function is to turn on or off the network connection, matches the switch control type hot word.

[0032] Then, based on the hot word content of the first hot word, determine that the multiple initial controls include multiple controls whose control names are semantically related to the hot word content. The hot word content of the hot word can be exemplified by "turn on the air conditioner", "adjust the volume", "turn on navigation", etc. The semantic relevance of the control name and the hot word content can be that the name of the control is the same as the hot word content. For example, the hot word content is "turn on navigation" and the control name is the navigation control. It can also be that the hot word content is different from the control name, but the semantic expression is the same. For example, the control name is the brightness adjustment control, and the hot word content is "adjust the screen brightness", where "adjust" is synonymous with "adjust", "brightness" is the core functional word, and the control name and the hot word express the same semantics with different vocabulary.

[0033] In one example, the first hot word is "turn on the air conditioner." The hot word type of the first hot word is switch control. The multiple initial controls whose function types match the switch control hot word type can be front air conditioner controls, rear air conditioner controls, navigation controls, multimedia controls, internal circulation controls, external circulation controls, etc. The hot word content of the first hot word is "turn on the air conditioner." Among the multiple initial controls, the controls whose control names are semantically related to the hot word content of "turn on the air conditioner" are the front air conditioner controls and the rear air conditioner controls. Based on this, it can be determined that the multiple controls associated with the first hot word "turn on the air conditioner" in the control page are the front air conditioner controls and the rear air conditioner controls.

[0034] It can be seen that through this embodiment, the multiple initial controls whose function types matched the hot word type of the first hot word included in the control interface are first determined according to the hot word type of the first hot word. According to the hot word type of the first hot word, the scope of determining the multiple controls in the control interface can be narrowed down. Then, according to the hot word content of the first hot word, the multiple controls whose control names are semantically related to the hot word content are determined among the multiple initial controls as the multiple controls associated with the first hot word. The multiple controls that have an association relationship with the first hot word can be determined from multiple dimensions, thereby making the determination result of the multiple controls more accurate.

[0035] After determining that the vehicle control page includes multiple controls associated with the first hot word, the multiple controls are annotated to generate multiple annotated controls.

[0036] In one embodiment, the annotation process is performed on multiple controls to generate multiple annotated controls, including: Sorting multiple controls according to their historical trigger records to generate sorting results. According to the sorting result, multiple controls are annotated to generate multiple annotated controls.

[0037] In this embodiment, when marking multiple controls, the multiple controls determined above can be sorted based on the historical trigger records of the multiple controls to generate a sorting result of the multiple controls, that is, the arrangement order of the multiple controls. The historical trigger records of the multiple controls can be the historical trigger counts of the multiple controls, and the historical trigger counts can reflect the degree of user demand for the functions corresponding to the controls. When sorting the multiple controls based on the historical trigger records, the multiple controls can be sorted in descending order of the historical trigger counts, with controls with high historical trigger counts placed in front and controls with low historical trigger counts placed in the back. For example, the historical trigger count of the front air-conditioning control is 50 times, and the historical trigger count of the rear air-conditioning control is 20 times. When sorting the front air-conditioning controls and the rear air-conditioning controls, the front air-conditioning controls can be placed in front and the rear air-conditioning controls can be placed in the back.

[0038] In addition to sorting multiple controls based on their historical trigger records, multiple controls can also be sorted based on other control information. Other control information includes at least one of the following: control location information, control style information, control unique identification information, etc. Among them, the control location information can be the location of the control in the control page of the vehicle terminal device interface. For example, the control is a route selection control, and the control location information of the route selection control is the upper right corner of the navigation page. Control style information refers to the visual presentation characteristics of the control, such as the shape, size, color, font size, etc. of the control. The unique identification information of the control is used to uniquely identify and manage the control. The type of the unique identification information can be a string ID (Identity Document), a digital ID, etc. For example, the type of the unique identification information is a digital ID, the ID of the front air-conditioning control is ID_1001, and the ID of the rear air-conditioning control is ID_1002.

[0039] Then, according to the sorting results of the multiple controls, the multiple controls are annotated to generate the annotated multiple controls. The purpose of annotating the multiple controls is to enable the user to clearly distinguish the multiple controls, so as to issue a voice trigger command based on the annotated results to trigger the corresponding controls.

[0040] In one example, when sorting multiple controls based on historical trigger records, the multiple controls can be sorted based on the number of historical trigger times of the multiple controls. For example, the first hot word is "open the window," and the multiple controls associated with the first hot word are the front window control and the rear window control. The front window control has been triggered 50 times, and the rear window control has been triggered 20 times. The front window control and the rear window control are sorted in descending order of the number of historical trigger times, and the sorting result is that the front window control is ranked first and the rear window control is ranked second. Accordingly, according to the above sorting result, the front window control and the rear window control are marked accordingly.

[0041] In another example, taking the control information as the control position information as an example for illustration, a plurality of controls are sorted according to the control position information. For example, the first hot word is to open the window, and the plurality of controls associated with the first hot word are the main driver window control and the co-driver window control. For example, the main driver window control is located at the lower left of the main interface of the vehicle terminal device interface, and the co-driver window control is located at the lower right of the main interface of the vehicle terminal device interface. Sorting is performed from left to right, and the sorting result is that the main driver window control is in the first place and the co-driver window control is in the second place. Accordingly, according to the sorting result, the main driver window control and the co-driver window control are marked accordingly.

[0042] In another example, when sorting multiple controls according to control style information, the controls may be sorted according to their colors, from light to dark, or according to their font sizes, from small to large.

[0043] Alternatively, if multiple controls have the same style information, for example, the same color, size, or font size, the controls can be sorted based on the first letter of their names. For example, if the front and rear air conditioning controls have the same style, and the first letter of the front control is Q and the first letter of the rear control is H, the controls can be sorted based on the order of Q and H in the alphabet.

[0044] When sorting multiple controls based on their unique identification information, they can be sorted in ascending order based on their control IDs.

[0045] It can be seen that through this embodiment, multiple controls are sorted according to their historical trigger records, so that the multiple controls can be arranged in a certain order and have sequentiality. Then, according to the sorting results, corresponding annotation processing is performed for the multiple controls, making the annotation process of multiple controls more efficient and the annotation results more accurate.

[0046] The labeling process for multiple controls may be to label multiple controls with serial numbers, for example, labeling the front air-conditioning controls with a high number of historical triggering times with serial number 1, and labeling the rear air-conditioning controls with a low number of historical triggering times with serial number 2.

[0047] In one embodiment, based on the sorting results, multiple controls are annotated to generate multiple annotated controls, including: Generate serial numbers corresponding to multiple controls based on the sorting results; For each control in the plurality of controls, a serial number labeling process is performed on the control according to the corresponding serial number, and a serial number-labeled control is generated.

[0048] In this embodiment, when multiple controls are labeled according to the sorting results, a serial number corresponding to each control in the multiple controls can be generated according to the sorting results of the multiple controls. The serial number can be in the form of a number, for example, the number 1, the number 2, etc. It can also be a letter or a symbol, for example, the letter A, the letter B, the symbol can be exemplified by a text symbol, such as Jia, Yi, etc. The symbol can also be exemplified by a special symbol such as a "star" symbol, a "triangle" symbol, etc. It can also be a combination of numbers and letters or numbers and symbols, etc. Taking the serial number as a number as an example, a corresponding number can be generated for each control according to the sorting results of the multiple controls, starting from the number 1. The serial number corresponding to the control at the front can be, for example, 1, the serial number corresponding to the control in the second place can be, for example, 2, and so on.

[0049] Then, for each of the multiple controls, the control is labeled according to its corresponding serial number to generate a serial number-labeled control. This serial number labeling process can include redrawing the control and adding the corresponding serial number to the control. The serial number can be located at a corner or in the center of the control, whichever is best to avoid affecting the user's ability to identify the control.

[0050] In one example, the multiple controls associated with the first hot word are, for example, a front window control and a rear window control. The front window control and the rear window control are arranged in the order of the front window control in front and the rear window control in the back. Based on this arrangement order, the sequence number generated for the front window control is, for example, A, and the sequence number generated for the rear window control is, for example, B. Then, the letter A is marked in the upper right corner of the front window control, and the letter B is marked in the upper right corner of the rear window control, resulting in a front window control marked with the letter A and a rear window control marked with the letter B.

[0051] In another example, the plurality of controls associated with the first hot word are front row air conditioning controls and rear row air conditioning controls. Figure 3 The serial number marking process diagram provided in the embodiment of this application is as follows: Figure 3 As shown, Figure 3 The image above shows the front and rear air conditioning controls before the sequence numbering process. According to the sorting results, the front controls are in front and the rear controls are in the back. The sequence number generated for the front controls is 1, and the sequence number generated for the rear controls is 2. Figure 3 The picture below shows the front and rear air-conditioning controls after serial number marking. The number 1 is displayed in the upper right corner of the front air-conditioning controls after serial number marking, and the number 2 is displayed in the upper right corner of the rear air-conditioning controls after serial number marking.

[0052] It should be noted that the above examples of sorting and serial number marking are for illustration only and are not intended to be limiting. In actual applications, multiple controls can be sorted and serial numbered according to actual user needs and actual data.

[0053] It can be seen that through this embodiment, corresponding serial numbers can be generated for multiple controls based on the sorting results of multiple controls, and the controls can be labeled according to the serial numbers corresponding to the controls to generate labeled controls, so that users can quickly locate the target controls according to the serial numbers, thereby improving the efficiency of user interaction. It can also enable users to issue voice trigger instructions based on the serial numbers to trigger the corresponding controls, thereby improving the accuracy of control triggering.

[0054] Multiple controls can be labeled or their display styles can be labeled. For example, the front air-conditioning controls with a high historical trigger count can be labeled red, and the rear air-conditioning controls with a low historical trigger count can be labeled yellow.

[0055] In one embodiment, based on the sorting results, multiple controls are annotated to generate multiple annotated controls, including: Determine the display styles corresponding to the multiple controls according to the sorting results; For each of the multiple controls, display style annotation processing is performed on the control according to its corresponding display style to generate a control with display style annotation.

[0056] In this embodiment, when labeling multiple controls based on the sorting results, the display style for the differentiated display corresponding to each control can be determined based on the sorting results. The display style for the differentiated display of a control is the display style that distinguishes the control from other controls, and the display style can be, for example, color, shape, display brightness, etc. The differentiated display can be that the multiple controls are different in color, or that the multiple controls are different in shape, or that the multiple controls are different in display brightness, etc. Then, for each of the multiple controls, the control is labeled with its display style based on its corresponding display style to generate a control labeled with the display style. Labeling the control with the display style can be redrawing the control, redrawing the original display style of the control to the display style for the differentiated display. For example, if the display style for the differentiated display is that the multiple controls are different in color, then the original color of the control is redrawn to the color for the differentiated display.

[0057] In one example, the multiple controls associated with the first hot word are, for example, front window controls and rear window controls, and the arrangement order of the front window controls and the rear window controls is front window controls in front and rear window controls in the back. The original display color of the front window controls is the same as the original display color of the rear window controls, both of which are gray. Taking the example of multiple controls with different colors, according to the arrangement order, the color of the different display generated for the front window controls is red, and the color of the different display generated for the rear window controls is blue. Then, the color of the front window controls is redrawn to red, and the color of the rear window controls is redrawn to blue, resulting in red front window controls and blue rear window controls.

[0058] In one example, the process of redrawing a control may be that the vehicle terminal device saves multiple controls associated with the first hot word in a root control and notifies the root control to redraw. The root control is the top-level container in the user interface control hierarchy. When the root control redraws the control, it first determines whether the redraw range of the control is a global redraw or a local redraw, and then notifies the child control to redraw the control. Local redrawing is to redraw part of the area of the control. For example, marking a number in the upper right corner of the control is a local redraw. Global redrawing is to redraw the entire control. For example, redrawing the display style of the control is a global redraw.

[0059] It can be seen that through this embodiment, the display style corresponding to each control can be determined separately according to the sorting results of multiple controls, and the display style of the control can be annotated according to the display style corresponding to the control to generate annotated controls, so that users can quickly locate the target control according to the display style, thereby improving the efficiency of user interaction, and also enabling users to issue voice trigger commands based on the display style to trigger the corresponding control, thereby improving the accuracy of control triggering.

[0060] Step S106: Display the marked multiple controls in the control page.

[0061] After generating multiple controls with serial number annotations, the multiple controls with annotations can be displayed to the user in the control page. The multiple controls associated with the first hot word can be located on the same display interface in the control page, or on different display interfaces in the control page. Accordingly, the multiple controls with annotations can be located on the same display interface in the control page, or on different display interfaces in the control page. When displaying multiple controls with annotations in the control page, in order to improve the efficiency of user interaction, the multiple controls with annotations can be displayed on the same display interface in the order of serial number arrangement.

[0062] In one embodiment, multiple controls are located on the same display interface of the control interface, and the marked multiple controls are multiple controls marked with serial numbers; displaying the marked multiple controls on the control page includes: According to the results of the serial number marking, multiple controls marked with the serial numbers are rearranged in the order of the serial numbers on the display interface; A plurality of controls marked with rearranged sequence numbers are displayed on a display interface.

[0063] In an embodiment of the present application, when multiple controls are located on the same display interface of the control interface, and the multiple controls marked are multiple controls marked with serial numbers, the multiple controls marked with serial numbers can be displayed on the control page by first following the serial number marking results of the multiple controls marked with serial numbers, rearranging the multiple controls marked with serial numbers in serial order on the display interface, and then displaying the rearranged multiple controls marked with serial numbers on the display interface. For example, when the serial number is a number, the multiple controls marked with serial numbers can be rearranged in order from small to large. For another example, when the serial number is a letter, the multiple controls marked with serial numbers can be rearranged in order from front to back of the letter. For another example, when the serial number is a special symbol, the multiple controls marked with serial numbers can be rearranged according to the conspicuousness of the symbol.

[0064] In one example, the front and rear air conditioning controls are used as the example. Assuming the front air conditioning control is labeled as 2 and the rear air conditioning control is labeled as 1, the front and rear air conditioning controls can be rearranged on the air conditioning control page in the order of 1 on the left and 2 on the right based on the labeled sequence numbers. Figure 4 A display diagram of multiple controls marked with serial numbers provided in the embodiment of the present application, such as Figure 4 As shown, Figure 4 The display interface shown in the upper figure shows the rear air-conditioning controls marked with the number 1 and the front air-conditioning controls marked with the number 2 before rearrangement. The front air-conditioning controls are displayed on the left side of the air-conditioning controls page, and the rear air-conditioning controls are displayed on the right side of the air-conditioning controls page. Figure 4 The display interface shown in the figure below shows the rear air-conditioning controls marked with the number 1 and the front air-conditioning controls marked with the number 2 after rearrangement. After rearrangement, the rear air-conditioning controls marked with the number 1 are on the left, and the front air-conditioning controls marked with the number 2 are on the right. The two controls are close to each other, making it easy for users to clearly obtain the control serial numbers.

[0065] It can be seen that through this embodiment, when multiple controls are located on the same display interface of the control interface, and the multiple marked controls are multiple controls marked with serial numbers, the multiple controls marked with serial numbers are rearranged in serial number order on the display interface according to the serial number marking results, and the multiple controls marked with serial numbers after rearrangement are displayed on the display interface. The multiple controls located on the same display interface can be clearly displayed on the same display interface in serial number order, so that the user can clearly and quickly obtain the control serial number, and then issue corresponding voice trigger instructions according to the control serial number, thereby improving the accuracy and efficiency of user interaction.

[0066] In one embodiment, multiple controls are located on different display interfaces of the control interface, and the marked multiple controls are multiple controls marked with serial numbers; the multiple controls marked with serial numbers are displayed on the control page, including: According to the results of the serial number marking, multiple controls marked with serial numbers are rearranged in the order of the serial numbers on the same display interface; Display multiple controls with rearranged serial number labels on the same display interface.

[0067] In this embodiment, when multiple controls are located on different display interfaces of the control interface, and the multiple controls marked are multiple controls marked with serial numbers, displaying the multiple controls marked with serial numbers in the control page can be firstly based on the serial number marking results of the multiple controls marked with serial numbers, and the multiple controls marked with serial numbers that are not on the same display interface are rearranged in serial number order to the same display interface, and then the rearranged multiple controls marked with serial numbers are displayed on the same display interface.

[0068] In one example, the first hotword is "turn on ambient lighting." The multiple controls associated with the first hotword are the full vehicle ambient lighting control, the front row ambient lighting control, and the rear row ambient lighting control. The full vehicle ambient lighting control is located on the main interface of the in-vehicle terminal device, while the front row ambient lighting control and the rear row ambient lighting control are located on the lighting settings page. The sequence numbers for these full vehicle ambient lighting control, the front row ambient lighting control, and the rear row ambient lighting control are labeled as follows: 1 for the full vehicle ambient lighting control, 2 for the front row ambient lighting control, and 3 for the rear row ambient lighting control. Because the full vehicle ambient lighting control, the front row ambient lighting control, and the rear row ambient lighting control are located on different display interfaces, when displaying the multiple controls labeled with sequence numbers, the three controls need to be rearranged onto the same display interface according to the control sequence number. This same display interface can be a newly generated display interface on the in-vehicle terminal device interface, the main interface where the full vehicle ambient lighting control is located, or the lighting settings page where the front row ambient lighting control and the rear row ambient lighting control are located. The rearranged controls for the full vehicle ambient lighting, front row ambient lighting, and rear row ambient lighting are displayed on the same display screen in the order 1 -> 2 -> 3. The controls are placed close together, making it easier for users to clearly identify the control sequence.

[0069] It can be seen that through this embodiment, when multiple controls are located on different display interfaces of the control interface, and the multiple marked controls are multiple controls marked with serial numbers, according to the serial number marking results, the multiple controls marked with serial numbers are rearranged in serial number order on the same display interface, and the rearranged multiple controls marked with serial numbers are displayed on the same display interface. The multiple controls originally located on different display interfaces can be clearly displayed on the same display interface in serial number order, so that the user can clearly and quickly obtain the control serial number, and then issue corresponding voice trigger instructions according to the control serial number, thereby improving the accuracy and efficiency of user interaction.

[0070] In one embodiment, before displaying the marked multiple controls in the control page, the method further includes: For each annotated control, determining at least one second hot word for triggering the annotated control; At least one second hot word corresponding to each marked control is saved.

[0071] In this embodiment, before displaying multiple annotated controls on a control page, at least one second hotword for triggering each annotated control is determined, and then the at least one second hotword corresponding to each annotated control is saved. Saving the at least one second hotword corresponding to each annotated control may include uploading the at least one second hotword corresponding to each annotated control to a voice engine, and then allowing the user to trigger the corresponding control using a voice trigger command containing the corresponding hotword.

[0072] In one example, the multiple labeled controls are a front air conditioning control labeled with the number 1 and a rear air conditioning control labeled with the number 2. For the front air conditioning control labeled with the number 1, the second hot word used to trigger the front air conditioning control labeled with the number 1 is determined to be, for example, "Turn on air conditioning 1" or "Turn on front air conditioning 1." For the rear air conditioning control labeled with the number 2, the second hot word used to trigger the rear air conditioning control labeled with the number 2 is determined to be, for example, "Turn on air conditioning 2" or "Turn on rear air conditioning 2." After determining the hot words corresponding to the front air conditioning control labeled with the number 1 and the hot words corresponding to the rear air conditioning control labeled with the number 2, the hot words "Turn on air conditioning 1" or "Turn on front air conditioning 1" corresponding to the front air conditioning control labeled with the number 1, and the hot words "Turn on air conditioning 2" or "Turn on rear air conditioning 2" corresponding to the rear air conditioning control labeled with the number 2 can be uploaded to the voice engine, and the user uses a voice trigger instruction containing any of the above hot words to trigger the corresponding control.

[0073] It can be seen that through this embodiment, before displaying multiple marked controls on the control page, at least one second hot word used to trigger the marked control is determined for each marked control, and at least one second hot word corresponding to each marked control is saved. After the user issues a voice trigger command, the target control can be quickly located based on the hot words contained in the voice trigger command and the hot words corresponding to the target control, so that the vehicle-mounted terminal device can trigger the target control more accurately and quickly, thereby improving the accuracy and efficiency of user interaction.

[0074] Step S108: In response to a second voice trigger instruction issued by the user to a target control among the marked multiple controls, the target control is triggered and an operation corresponding to the target control is executed.

[0075] After displaying multiple marked controls on the control page, the vehicle-mounted terminal device can respond to the second voice trigger instruction issued by the user for the target control among the multiple marked controls, trigger the target control associated with the user's second voice trigger instruction, and perform the operation corresponding to the target control.

[0076] In one example, the labeled multiple controls are the front air conditioning control labeled with the number 1 and the rear air conditioning control labeled with the number 2. The user's second voice trigger command is "Turn on front air conditioning 1." In response to the user's voice trigger command "Turn on front air conditioning 1," the in-vehicle terminal device recognizes the hotword contained therein as "Turn on front air conditioning 1," determines that the target control corresponding to the hotword is the front air conditioning control, and then triggers the front air conditioning control to turn on the front air conditioning.

[0077] In one embodiment, after the target control is triggered and the operation corresponding to the target control is performed in response to a second voice trigger instruction issued by the user for the target control among the marked multiple controls, the marking result and the hot words corresponding to the marked multiple controls can be stored. When the user issues a voice trigger instruction containing the hot words corresponding to the marked control again after a period of time, the vehicle-mounted terminal device does not need to re-determine the multiple controls associated with the hot words and re-sort and mark the multiple controls. It can directly respond to the user's voice trigger instruction based on the saved marking results and the hot words corresponding to the marked multiple controls, trigger the corresponding controls, and perform the operations corresponding to the controls.

[0078] Figure 5 This is a process diagram of the voice interaction method provided in an embodiment of the present application. The voice interaction method is applied to a scenario where there are multiple controls with the same hot words in the interface of a vehicle terminal device, such as Figure 5 As shown, the voice interaction method specifically includes the following steps: S501: The user wakes up the voice assistant of the vehicle-mounted terminal device.

[0079] S502: The vehicle-mounted terminal device traverses all controls in the control page, collects hot words associated with each control, and uploads them to the voice engine.

[0080] S503: The vehicle-mounted terminal device responds to the user's first voice trigger instruction and obtains the first hot word included in the first voice trigger instruction.

[0081] Examples of voice-triggered commands include "Turn on the air conditioner," "Turn on navigation," and "Increase the volume." Hot words are specific words or phrases used to trigger specific control operations. For example, in the voice-triggered command "Turn on navigation," the word "Turn on navigation" is the hot word for the corresponding navigation control.

[0082] S504: If the vehicle-mounted terminal device determines, based on the first hot word, that the vehicle's control interface includes multiple controls associated with the first hot word, the multiple controls are annotated to generate multiple annotated controls.

[0083] If the vehicle-mounted terminal device determines, based on the hot word type of the first hot word, that the control page contains multiple initial controls whose function types match the hot word type of the first hot word, and determines, based on the hot word content of the first hot word, that the above multiple initial controls contain multiple controls whose control names are semantically related to the hot word content, then the vehicle-mounted terminal device needs to annotate the multiple controls, generate multiple annotated controls, so that the user can clearly distinguish the multiple controls, and issue corresponding voice trigger instructions based on the annotation results.

[0084] S505: The vehicle-mounted terminal device sorts the multiple controls according to the historical triggering records of the controls and generates sorting results for the multiple controls.

[0085] The historical trigger record of the control may be the historical trigger count of the control, and the multiple controls may be sorted in descending order of the historical trigger counts of the controls.

[0086] S506: The vehicle-mounted terminal device performs labeling processing on the multiple controls according to the sorting result to generate multiple labeled controls.

[0087] After sorting multiple controls, the vehicle-mounted terminal device can perform serial number labeling on the multiple controls according to the sorting results to generate multiple controls labeled with serial numbers, or perform display style labeling on the multiple controls to distinguish the displays to generate multiple controls labeled with display styles.

[0088] S507: The vehicle-mounted terminal device displays the marked multiple controls on the control page.

[0089] After generating the labeled multiple controls, the vehicle-mounted terminal device may display the labeled multiple controls to the user on the control page.

[0090] S508: In response to a second voice trigger instruction issued by the user to a target control among the marked multiple controls, trigger the target control and perform an operation corresponding to the target control.

[0091] The vehicle-mounted terminal device can respond to the second voice trigger instruction issued by the user to the target control among the marked multiple controls, identify the hot words contained in the second voice trigger instruction, determine the target control corresponding to the hot words, and then trigger the target control to execute the operation corresponding to the target control.

[0092] Through this embodiment, in a scenario where there are multiple controls with the same hot words in the interface of a vehicle terminal device, multiple controls can be labeled to generate multiple labeled controls, and the multiple labeled controls can be displayed to the user on the control page, so that the user can accurately locate the target control according to the labeling results, and then issue a second voice trigger instruction corresponding to the labeling result to the target control, so that the vehicle computer can accurately identify the intention of the voice trigger instruction, avoiding the problem of deviation between the function execution result and the user intention caused by the vehicle randomly triggering or not triggering the control when multiple controls have the same hot words, thereby improving the efficiency of user interaction and the accuracy of control triggering.

[0093] Corresponding to the voice interaction method provided in the above embodiment, based on the same technical concept, the embodiment of the present application also provides a voice interaction device, Figure 6 A schematic diagram of the module composition of a voice interaction device provided in an embodiment of the present application, wherein the voice interaction device is used to perform Figure 1 The voice interaction method described, such as Figure 6 As shown, the voice interaction device 600 includes: An acquisition module 601 is configured to acquire a first hot word contained in a first voice trigger instruction in response to a first voice trigger instruction of a user; a marking module 602 for, if it is determined based on the first hot word that the vehicle's control page contains multiple controls associated with the first hot word, marking the multiple controls to generate multiple marked controls; A display module 603 is configured to display the marked multiple controls in the control page; The execution module 604 is used to trigger the target control in the marked multiple controls in response to the second voice trigger instruction issued by the user, and execute the operation corresponding to the target control.

[0094] In a possible implementation, the marking module 602 is specifically configured to determine, based on the hot word type of the first hot word, a plurality of initial controls in the control interface whose function types match the hot word type of the first hot word; According to the hot word content of the first hot word, it is determined that the multiple initial controls include multiple controls whose control names are semantically related to the hot word content.

[0095] In a possible implementation, the marking module 602 is further configured to sort the multiple controls according to the historical trigger records of the multiple controls, and generate a sorting result for the multiple controls; According to the sorting result, the multiple controls are annotated to generate the annotated multiple controls.

[0096] In a possible implementation, the marking module 602 is further configured to generate serial numbers corresponding to the plurality of controls according to the sorting result; For each of the multiple controls, a serial number labeling process is performed on the control according to the corresponding serial number to generate a serial number-labeled control.

[0097] In a possible implementation, the marking module 602 is further configured to determine, based on the sorting result, display styles corresponding to the plurality of controls for different displays; For each of the multiple controls, display style annotation processing is performed on the control according to the corresponding display style to generate a control with display style annotation.

[0098] In a possible implementation, the multiple controls are located on the same display interface of the control interface, and the multiple controls labeled are multiple controls labeled with serial numbers; the display module 602 is specifically configured to rearrange the multiple controls labeled with serial numbers on the display interface in order of serial numbers according to the serial number labeling result; The rearranged plurality of controls marked with the serial numbers are displayed on the display interface.

[0099] In one possible implementation, the multiple controls are located on different display interfaces of the control interface, and the multiple labeled controls are multiple controls labeled with serial numbers; the display module 602 is further specifically configured to rearrange the multiple controls labeled with serial numbers in the same display interface in the order of the serial numbers according to the serial number labeling result; The rearranged plurality of controls marked with the serial numbers are displayed on the same display interface.

[0100] In a possible implementation, the apparatus further includes: a determination module, the determination module being specifically configured to determine, for each annotated control, at least one second hot word for triggering the annotated control; The at least one second hot word corresponding to each marked control is saved.

[0101] From the technical solutions provided by the above embodiments of the present application, it can be seen that in the embodiments of the present application, first, in response to the user's first voice trigger command, a first hot word contained in the first voice trigger command is obtained. Then, if it is determined based on the first hot word that the vehicle's control page contains multiple controls associated with the first hot word, the multiple controls are annotated to generate multiple annotated controls. Then, the multiple annotated controls are displayed in the control page. Finally, in response to the second voice trigger command issued by the user for the target control in the annotated multiple controls, the target control is triggered and the operation corresponding to the target control is executed. It can be seen that through the embodiments of the present application, in a scenario where multiple controls have the same hot word, multiple controls can be annotated to generate multiple annotated controls, and the multiple annotated controls can be displayed to the user in the control page, so that the user can accurately locate the target control according to the annotated result, and then a second voice trigger command corresponding to the annotated result is issued to the target control, so that the vehicle computer can accurately identify the intention of the voice trigger command, avoiding the problem that the function execution result deviates from the user's intention due to the vehicle randomly triggering or not triggering the control when multiple controls have the same hot word, thereby improving the efficiency of user interaction and the accuracy of control triggering.

[0102] It should be noted that the voice interaction device provided in the embodiment of the present application and the voice interaction method provided in the embodiment of the present application are based on the same inventive concept. Therefore, the specific implementation of this embodiment can refer to the implementation of the aforementioned voice interaction method, and the repeated parts will not be repeated.

[0103] Corresponding to the voice interaction method provided in the above embodiment, based on the same technical concept, the embodiment of the present application also provides a voice interaction device, Figure 7 A schematic diagram of the structure of a voice interaction device provided in an embodiment of the present application is shown as follows. Figure 7 As shown, the voice interaction device includes: a memory 701 and a processor 702, wherein the memory 701 stores an executable program code 7011, and the processor 702 is used to call and execute the executable program code 7011 to perform the voice interaction method.

[0104] Corresponding to the voice interaction method provided in the above embodiment, based on the same technical concept, the embodiment of the present application also provides a vehicle, the vehicle provided in this embodiment includes the above Figure 7 The voice interaction device shown.

[0105] This embodiment can divide the vehicle into functional modules based on the above-described method example. For example, each functional module can be mapped to a specific function, or two or more functions can be integrated into a single processing module. The integrated module can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and represents only one logical functional division. In actual implementation, other division methods may be used.

[0106] In the case of dividing the functional modules into corresponding modules, the vehicle may include: an acquisition module, a labeling module, a display module, an execution module, etc. It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0107] The vehicle provided in this embodiment is used to execute the above-mentioned vehicle voice interaction method, and thus can achieve the same effect as the above-mentioned implementation method.

[0108] In the case of an integrated unit, the vehicle may include a processing module and a storage module. The processing module may be used to control and manage the vehicle's movements, while the storage module may be used to support the vehicle's execution of program codes and data.

[0109] The processing module may be a processor or controller that implements or executes the various exemplary logic blocks, modules, and circuits disclosed herein. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processing (DSP) and a microprocessor, and the storage module may be a memory.

[0110] Corresponding to the voice interaction method provided in the above embodiment, based on the same technical concept, the embodiment of the present application also provides an electronic device, which is used to execute the above voice interaction method. Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 8 As shown, electronic devices can vary significantly due to different configurations or performance. They may include one or more processors 801 and memory 802. Memory 802 may store one or more applications or data. Memory 802 may be either transient or persistent storage. Applications stored in memory 802 may include one or more modules (not shown), each of which may include a series of computer-executable instructions for the electronic device. Furthermore, processor 801 may be configured to communicate with memory 802 to execute the series of computer-executable instructions in memory 802 on the electronic device. The electronic device may also include one or more power supplies 803, one or more wired or wireless network interfaces 804, one or more input / output interfaces 805, and one or more keyboards 806.

[0111] Specifically in this embodiment, the electronic device includes a processor, a communication interface, a memory and a communication bus; wherein the processor, the communication interface and the memory communicate with each other through the bus; the memory is used to store computer programs; the processor is used to execute the programs stored in the memory to implement the steps of the above-mentioned voice interaction method.

[0112] The electronic device in the embodiment of the present disclosure can implement the various processes of the above-mentioned voice interaction method embodiment and achieve the same effects and functions, which will not be repeated here.

[0113] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps of the above-mentioned voice interaction method are implemented.

[0114] The computer-readable storage medium in the embodiment of the present disclosure can implement the various processes of the above-mentioned voice interaction method embodiment and achieve the same effects and functions, which will not be repeated here.

[0115] An embodiment of the present application also provides a computer program product, which implements the steps of the above-mentioned voice interaction method when the computer program is executed by a processor.

[0116] The computer program product in the embodiment of the present disclosure can implement the various processes of the above-mentioned voice interaction method embodiment and achieve the same effects and functions, which will not be repeated here.

[0117] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, apparatuses, or computer program products. Therefore, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0118] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0119] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0120] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0121] In a typical configuration, an electronic device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0122] Memory may include non-permanent storage in a computer-readable medium, in the form of random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0123] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can be implemented using any method or technology to store information. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change RAM (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media such as modulated data signals and carrier waves.

[0124] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0125] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, apparatuses, or computer program products. Therefore, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0126] The foregoing is merely an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should all be included within the scope of the claims of the present application.

Claims

1. A voice interaction method, characterized in that: include: In response to a first voice trigger instruction of a user, obtaining a first hot word included in the first voice trigger instruction; If it is determined based on the first hot word that the vehicle's control page includes multiple controls associated with the first hot word, annotating the multiple controls to generate multiple annotated controls; Displaying the marked multiple controls in the control page; In response to a second voice trigger instruction issued by the user for a target control among the marked multiple controls, the target control is triggered and an operation corresponding to the target control is performed.

2. The method according to claim 1, characterized in that The determining, based on the first hot word, that a control page of the vehicle includes a plurality of controls associated with the first hot word includes: According to the hot word type of the first hot word, determining in the control interface a plurality of initial controls whose function types match the hot word type of the first hot word; According to the hot word content of the first hot word, it is determined that the multiple initial controls include multiple controls whose control names are semantically related to the hot word content.

3. The method according to claim 1, characterized in that The step of performing annotation processing on the plurality of controls to generate a plurality of annotated controls includes: Sorting the multiple controls according to historical trigger records of the multiple controls to generate a sorting result for the multiple controls; According to the sorting result, the multiple controls are annotated to generate the annotated multiple controls.

4. The method according to claim 3, characterized in that The step of performing annotation processing on the plurality of controls according to the sorting result to generate the plurality of annotated controls includes: Generating serial numbers corresponding to the plurality of controls according to the sorting result; For each of the multiple controls, a serial number labeling process is performed on the control according to the corresponding serial number to generate a serial number-labeled control.

5. The method according to claim 3, characterized in that The step of performing annotation processing on the plurality of controls according to the sorting result to generate the plurality of annotated controls includes: Determining, according to the sorting result, display styles corresponding to the plurality of controls for distinguishing display; For each of the multiple controls, a display style annotation process is performed on the control according to the corresponding display style to generate a control with the display style annotation.

6. The method according to claim 1, characterized in that The multiple controls are located on the same display interface of the control interface, the multiple controls marked are multiple controls marked with serial numbers; and displaying the multiple controls marked on the control page includes: According to the result of the serial number marking, rearrange the multiple controls marked with the serial numbers on the display interface in the order of the serial numbers; The rearranged plurality of controls marked with the serial numbers are displayed on the display interface.

7. The method according to claim 1, characterized in that The multiple controls are located on different display interfaces of the control interface, the multiple controls marked are multiple controls marked with serial numbers; and displaying the multiple controls marked on the control page includes: According to the result of the serial number marking, the multiple controls marked with the serial numbers are rearranged in the order of the serial numbers on the same display interface; The rearranged plurality of controls marked with the serial numbers are displayed on the same display interface.

8. The method according to claim 1, characterized in that Also includes: For each marked control, determining at least one second hot word for triggering the marked control; The at least one second hot word corresponding to each marked control is saved.

9. A voice interaction device, characterized in that: include: An acquisition module, configured to acquire a first hot word contained in a first voice trigger instruction in response to a user's first voice trigger instruction; a marking module configured to, if it is determined based on the first hot word that a control page of the vehicle contains multiple controls associated with the first hot word, mark the multiple controls to generate multiple marked controls; A display module, configured to display the marked multiple controls in the control page; An execution module is used to trigger the target control in response to a second voice trigger instruction issued by the user to the target control among the marked multiple controls, and execute an operation corresponding to the target control.

10. A voice interaction device, characterized in that: It includes a memory and a processor; the memory stores executable program code, and when the executable program code is executed by the processor, the voice interaction method steps as described in claims 1-8 are implemented.

11. A vehicle, characterized in that: Including the voice interaction device as described in claim 10.

Images