A voice control method

Abstract

The application discloses a voice control method, and relates to the technical field of vehicles. The specific implementation mode of the method comprises the following steps: in response to receiving a voice instruction, matching voice content included in the voice instruction with text content included in each control displayed on a display screen; according to a matching result, determining a target control matched with the voice instruction; in the case where the number of target controls is multiple, adding a superscript to each of the multiple target controls; in response to receiving a voice instruction for a target superscript, executing a trigger operation on a target control indicated by the target superscript. The implementation mode makes the operation of triggering a control through voice simple and fast, improves the efficiency of voice triggering, and improves user experience; meanwhile, the value of the superscript is set according to a line-of-sight landing point and / or a user position, so that the control superscript is more in line with user demand and digital use habits, and user experience is improved.

Description

Technical Field

[0001] This invention relates to the field of vehicle technology, and more particularly to a voice control method. Background Technology

[0002] Currently, some vehicles support the "see and speak" function. However, this function has a problem: a single voice command input may hit multiple controls on the page, and the text content of these controls is highly similar. For the multiple controls initially hit, the user needs to input a voice command again that closely matches the text content of the control they wish to trigger, in order to activate that control. This voice triggering method is difficult and inefficient, resulting in a poor user experience. Summary of the Invention

[0003] In view of this, embodiments of the present invention provide a voice control method, comprising: responding to receiving a voice command, matching the voice content included in the voice command with the text content included in various controls displayed on a screen; determining a target control that matches the voice command based on the matching result; when there are multiple target controls, adding a badge to each of the multiple target controls according to the user's gaze point on the screen and / or the user's position in the vehicle; and responding to receiving a voice command for a target badge, performing a triggering operation on the target control indicated by the target badge. Thus, by adding badges to multiple controls initially matched, the user can trigger the corresponding control simply by indicating a badge value with voice, making voice-triggered control operation simple and quick, improving the efficiency of voice triggering, and enhancing the user experience; simultaneously, setting badge values ​​according to the gaze point and / or the user's position makes the control badges more in line with user needs and digital usage habits, further enhancing the user experience.

[0004] To achieve the above objectives, according to one aspect of the present invention, a voice control method is provided.

[0005] An embodiment of the present invention provides a voice control method, comprising: in response to receiving a voice command, matching the voice content included in the voice command with the text content included in various controls displayed on the screen;

[0006] Based on the matching results, the target control that matches the voice command is determined;

[0007] When there are multiple target controls, add badges to each of the multiple target controls according to the user's gaze point on the display screen and / or the user's position in the vehicle;

[0008] In response to receiving a voice command for a target marker, a trigger operation is performed on the target control indicated by the target marker.

[0009] Optionally, based on the user's gaze point on the display screen when inputting the voice command, badges are added to the multiple target controls, including:

[0010] Detect the point of the user's gaze on the display screen when inputting the voice command;

[0011] Calculate the distances between each of the target controls and the point of view;

[0012] In accordance with the order of distance from near to far, the subscript values ​​of the multiple target controls are set from small to large.

[0013] Optionally, the method further includes: sorting the plurality of index values ​​in order of distance from nearest to farthest;

[0014] According to the preset position indicated by the preset subscript display strategy, the subscript value in the preset position is highlighted.

[0015] Optionally, based on the user's position inside the vehicle, badges are added to each of the target controls, including:

[0016] Detect the seat occupied by the user who input the voice command;

[0017] When the user is seated in the driver's seat and the target controls are displayed on the driver's side display screen and the passenger side display screen, the subscript values ​​of the multiple target controls are set from smallest to largest in order from the driver's side display screen to the passenger side display screen.

[0018] Optionally, based on the user's position inside the vehicle, badges are added to each of the target controls, including:

[0019] When the user is sitting in the front passenger seat and the target controls are displayed on the driver's side display screen and the front passenger side display screen, the subscript values ​​of the multiple target controls are set from small to large in the order from the front passenger side display screen to the driver's side display screen.

[0020] Optionally, based on the user's position inside the vehicle, badges are added to each of the target controls, including:

[0021] When the user is sitting in a rear seat, the subscript values ​​of the multiple target controls are set from small to large in order from top to bottom and / or from left to right.

[0022] Optionally, based on the user's gaze point on the display screen and the user's position inside the vehicle, badges are added to the multiple target controls, including:

[0023] Based on the distance between each target control and the user's line of sight, a first order for setting the subscript values ​​for the multiple target controls is determined;

[0024] Based on the distance between each target control and the seat the user is sitting in, a second order for setting the subscript values ​​for the multiple target controls is determined;

[0025] According to the first order and the second order, set the subscript values ​​for the multiple target controls.

[0026] Optionally, setting index values ​​for the plurality of target controls according to the first order and the second order includes:

[0027] Determine whether the first order is consistent with the second order;

[0028] If the first order and the second order are consistent, set the subscript value for the multiple target controls according to the first order or the second order;

[0029] If the first order and the second order are inconsistent, the user's line of sight and the user's position inside the vehicle are determined to be of higher priority; the priority is preset for the user's line of sight and the user's position inside the vehicle, respectively; and according to the first or second order corresponding to the higher priority, a subscript value is assigned to multiple target controls.

[0030] Optionally, determining the target control matching the voice command based on the matching result includes:

[0031] For each control,

[0032] If the number of characters in the text content included in the control is less than or equal to a first threshold, the matching degree between the text content and the speech content is calculated.

[0033] If the matching degree between the text content and the voice content is higher than a preset matching degree threshold, the control is determined to be the target control.

[0034] Optionally, determining the target control matching the voice command based on the matching result further includes:

[0035] If the number of characters in the text content included in the control is greater than the first threshold, determine whether the text content and the voice content meet the condition that there is a second threshold number of consecutive characters that are successfully matched.

[0036] If it is determined that the text content and the voice content satisfy the condition that there are two consecutive characters that successfully match the second threshold, then the control is determined to be the target control.

[0037] To achieve the above objectives, according to another aspect of the present invention, an electronic device for voice control is provided.

[0038] An electronic device for voice control according to an embodiment of the present invention includes: one or more processors; and a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement a voice control method according to an embodiment of the present invention.

[0039] To achieve the above objectives, according to another aspect of the present invention, a computer-readable storage medium is provided.

[0040] An embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a voice control method according to an embodiment of the present invention.

[0041] To achieve the above objectives, according to another aspect of the present invention, a computer program product is provided.

[0042] A computer program product according to an embodiment of the present invention includes a computer program, characterized in that the program, when executed by a processor, implements a voice control method according to an embodiment of the present invention.

[0043] One embodiment of the above invention has the following advantages or beneficial effects: In response to receiving a voice command, the voice content included in the voice command is matched with the text content included in each control displayed on the screen; based on the matching result, a target control matching the voice command is determined; when there are multiple target controls, a badge is added to each of the multiple target controls according to the user's gaze point on the screen and / or the user's position in the vehicle; in response to receiving a voice command for a target badge, a triggering operation is performed on the target control indicated by the target badge. Thus, by adding badges to multiple controls initially matched, the user can trigger the corresponding control simply by indicating a badge value with voice, making voice-triggered control operation simple and quick, improving the efficiency of voice triggering, and enhancing the user experience; at the same time, setting badge values ​​according to the gaze point and / or the user's position makes the control badges more in line with user needs and digital usage habits, further enhancing the user experience.

[0044] The further effects of the aforementioned unconventional alternative methods will be explained below in conjunction with specific implementation methods. Attached Figure Description

[0045] The accompanying drawings are provided to better understand the invention and are not intended to unduly limit the scope of the invention. Wherein:

[0046] Figure 1 This is a flowchart illustrating a voice control method according to an embodiment of the present invention;

[0047] Figure 2 This is a schematic diagram of multiple target controls according to an embodiment of the present invention;

[0048] Figure 3 This is a schematic diagram illustrating the addition of subscripts to multiple target controls based on the line of sight according to an embodiment of the present invention;

[0049] Figure 4 This is a schematic diagram of an embodiment of the present invention showing the first superscript value in an enlarged manner;

[0050] Figure 5 This is a schematic diagram of an embodiment of the present invention after adding a badge to the target control based on the location of the user who issued the voice command;

[0051] Figure 6 This is a schematic diagram illustrating the addition of a badge to the target control based on the location of the user issuing the voice command, according to another embodiment of the present invention;

[0052] Figure 7 This is a schematic diagram of the addition of superscripts according to the top-to-bottom order in an embodiment of the present invention;

[0053] Figure 8 This is an exemplary system architecture diagram in which embodiments of the present invention can be applied;

[0054] Figure 9 This is a schematic diagram of the structure of a computer system suitable for implementing terminal devices or servers of the present invention. Detailed Implementation

[0055] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of the present invention, including various details to aid understanding. These details should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the invention. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0056] It should be noted that, unless otherwise specified, the embodiments of the present invention and the technical features thereof can be combined with each other.

[0057] Figure 1This is a schematic diagram of the main steps of the voice control method according to an embodiment of the present invention.

[0058] like Figure 1 As shown, the voice control method of this embodiment mainly includes steps S101-S104:

[0059] Step S101: In response to receiving a voice command, the voice content included in the voice command is matched with the text content included in each control displayed on the screen. The voice control method of this embodiment is applicable to vehicle infotainment systems that support the "see and speak" function. The screen can be a driver's side screen and / or a passenger side screen and / or a rear-seat screen. Multiple controls can be multiple controls in a list, wherein the multiple controls can be multiple controls in the same level list or multiple controls in different level lists.

[0060] Step S102: Based on the matching results, determine the target controls that match the voice command. The user inputs a voice command (e.g., "Zhang XX") based on the text content of the control they wish to trigger (e.g., Zhang XX's song "XXXX"). The system then matches the extracted voice content "Zhang XX" with the text content of each control on the display screen. Based on the matching results, the system selects multiple controls, such as Zhang XX's song "XXXX", Zhang XX's variety show "YYYY", and Zhang XX's TV series "ZZZZ". Figure 2 The diagram shows multiple target controls. Since multiple controls are currently selected, the user needs to continue inputting commands until a unique control is identified and triggered.

[0061] Regarding how to determine the target control through matching voice content and text content, in an optional embodiment of the present invention, determining the target control matching the voice command based on the matching result includes: for each control, if the number of characters in the text content included in the control is less than or equal to a first threshold, calculating the matching degree between the text content and the voice content; if the matching degree between the text content and the voice content is higher than a preset matching degree threshold, determining the control as the target control. The first threshold can be set to 2. In the process of matching the text content and voice content of each control, firstly, it is determined whether the number of characters in the text content of the control is less than or equal to 2. If the number of characters in the text content is less than or equal to 2, then the matching degree between the text content and the voice content is calculated. If the text content and voice content are completely identical, such as both being "OK" or "Cancel," then the match rate is determined to be 100%. If the text content and voice content are not completely identical, and the voice content is a synonym or near-synonym of the text content, such as the text content being "OK" and the voice content being "Good" or "OK," then the match rate is determined to be slightly lower than 100%, for example, 95%. If the semantics of the voice content differ significantly from the semantics of the text content, the match rate will be even lower. Controls corresponding to text content with a match rate higher than a preset value (e.g., 90%) are identified as the target controls hit by the voice command. It is understood that the specific values ​​corresponding to the preset values ​​and preset thresholds mentioned above are merely examples and are not intended to limit their use.

[0062] Furthermore, for situations where the text content of the control contains a large number of characters, in an optional embodiment of the present invention, determining the target control matching the voice command based on the matching result further includes: if the number of characters in the text content of the control is greater than the first threshold, determining whether the text content and the voice content satisfy the condition that there is a second threshold number of consecutive characters successfully matched; if it is determined that the text content and the voice content satisfy the condition that there is a second threshold number of consecutive characters successfully matched, determining the control as the target control. The second threshold can be 3. For example, if the text content of the control contains a large number of characters, such as "2024 Zhang XX song 'XXXX'", and the user's voice content includes three consecutive characters that are completely identical to the three consecutive characters in "2024 Zhang XX song 'XXXX'", then the voice command is determined to match the control, i.e., the control is determined as the target control. For example, if the voice content includes "Zhang XX", which is completely identical to "Zhang XX" in "2024 Zhang XX song 'XXXX'", then the control is determined as the target control.

[0063] In the above embodiments, a single voice command from a user may hit multiple target controls. In this case, if the user continues to select the desired control from multiple target controls by matching the voice command with the control text content, the voice content that the user needs to input will be longer than the first input. For example, if the first input is "Zhang XX", the second input would need to be "Zhang XX song", "Zhang XX song 《XXXX》", or "2024 Zhang XX song 《XXXX》". In other words, the longer the input voice content, the more accurate it is and the higher the probability of hitting the expected control, but the longer the input content, the more prone it is to errors. To solve this problem, badges can be added to the multiple target controls that are hit initially. This way, the user only needs to input the corresponding badge value via voice to trigger the corresponding control.

[0064] Step S103: When there are multiple target controls, add markers to each of the target controls based on the user's gaze point on the display screen and / or the user's position inside the vehicle. First, let's describe how to set marker values ​​for multiple target controls based on the user's gaze point. In an optional embodiment of the invention, adding markers to multiple target controls based on the user's gaze point on the display screen includes: detecting the user's gaze point on the display screen; calculating the distance between each target control and the gaze point; and setting marker values ​​for the multiple target controls from smallest to largest according to the distance from closest to farthest. Generally, people tend to prefer or are more likely to use smaller numbers compared to larger ones. Based on these user characteristics, this embodiment tracks the user's gaze to determine their focus point on the display screen, calculates the distance between multiple target controls and that focus point, and assigns smaller marker values ​​to target controls closer to the focus point and larger marker values ​​to target controls farther from the focus point. For example, if there are three target controls, and the user's attention is focused on one of them (the distance between this target control and the attention point is 0 cm), then the index value of this target control is set to 1. If the distance between the second target control and the attention point is 2 cm, then the index value of the second target control is set to 2. If the distance between the third target control and the attention point is 4 cm, then the index value of the third target control is set to 3. Figure 3 The diagram illustrates the addition of labels to multiple target controls based on the user's gaze. Users can trigger the corresponding target control by voice inputting any one of the numbers 1, 2, or 3. This embodiment makes voice-triggered operation simple, fast, and highly efficient.

[0065] Given that the user's gaze may be closer to the target control they wish to trigger, the corresponding index value is highlighted to make it easier for the user to see the index value of the target control closer to their gaze. In an optional embodiment of the invention, multiple index values ​​are sorted according to their distance from near to far; the index value in the preset position is highlighted according to a preset index display strategy. Specifically, highlighting index values ​​can include using a larger font size, using a specific font (e.g., bold), or using a specific color (e.g., a color that contrasts sharply with the control's background color). The preset position can be flexibly set according to the number of target controls. When there are three target controls, the preset position can be set to 1, meaning the index value of the first target control is highlighted, allowing the user to see the index value more clearly and trigger the corresponding target control by voice input, thus improving the efficiency of voice triggering. Figure 4 The image shows a diagram where the subscript value of the first target control is enlarged for display.

[0066] In addition to setting subscript values ​​for multiple target controls based on the distance between the target control and the line of sight as described in the above embodiments, subscript values ​​can also be set based on the location of the user issuing the voice command, so that smaller subscript values ​​are closer to the user. The following describes how to set subscript values ​​for multiple target controls based on the user's location. In an optional embodiment of the present invention, subscript values ​​are added to multiple target controls according to the user's location in the vehicle, including: detecting the seat in which the user inputting the voice command is sitting; and, if the user is sitting in the driver's seat and the target controls are displayed on both the driver's and passenger's displays, setting subscript values ​​for multiple target controls from smallest to largest in order from the driver's display to the passenger's display. The voice control method in this embodiment is based on the vehicle's "see-and-speak" function; therefore, the user issues voice commands based on the text content of the controls on the display screen. Therefore, when the user is sitting in the driver's seat, the likelihood of the user controlling the controls on the driver's display screen via voice is greater than that of the passenger's display screen. Similarly, when the user is sitting in the passenger's seat, the likelihood of the user controlling the controls on the passenger's display screen via voice is greater than that of the driver's display screen. This embodiment detects the user's location, such as whether they are sitting in the driver's seat, the front passenger seat, or the rear seat. Based on the user's location and the multiple target controls displayed on the screens (driver's and front passenger's displays), it assigns index values ​​to each target control. The specific principle for setting the index values ​​is: the closer the target control is to the user issuing the voice command, the smaller its index value. Specifically, when the user issuing the voice command is sitting in the driver's seat, the index values ​​of the target controls on the driver's display are first set, and the index values ​​are numbered sequentially from smallest to largest, such as 1, 2, 3, etc. Figure 5 As shown. When the number of target controls included on each display screen is not unique, the subscript values ​​are set in ascending order from top to bottom and / or from left to right.

[0067] In an optional embodiment of the present invention, according to the user's position in the vehicle, subscripts are added to multiple target controls, including: when the user is sitting in the passenger seat and the target controls are displayed on both the driver's and passenger's side displays, subscript values ​​are assigned to the multiple target controls in ascending order from the passenger's side display to the driver's side display. When the user issuing the voice command is sitting in the passenger seat, the target controls on the passenger's side display are closer to the user; therefore, subscript values ​​are assigned to the target controls on the passenger's side display first, and the subscript values ​​are numbered sequentially from smallest to largest, such as 1, 2, 3, etc. Figure 6 As shown. When the number of target controls included on each display screen is not unique, the subscript values ​​are set in ascending order from top to bottom and / or from left to right.

[0068] In an optional embodiment of the present invention, according to the user's position in the vehicle, subscripts are added to the multiple target controls, including: when the user is sitting in a rear seat, subscript values ​​are set to the multiple target controls in ascending order from top to bottom and / or from left to right. However, when a user sitting in a rear seat issues a voice command, and there is only one display screen, subscript values ​​are set to the target controls on the display screen in ascending order from left to right and / or from top to bottom. Figure 7 The diagram illustrates setting the index values ​​in a top-to-bottom order. Additionally, when there are two displays, such as a driver's display and a passenger's display, first set the index values ​​for the target controls on the left-hand driver's display, then set the index values ​​for the target controls on the right-hand passenger's display. For each display, set the index values ​​in a top-to-bottom and / or left-to-right order. See reference [link / reference]. Figure 5 .

[0069] Besides setting subscript values ​​for multiple target controls based on the user's line of sight or their position in the vehicle, subscript values ​​can also be set simultaneously based on both the user's line of sight and their position in the vehicle. This means considering both line of sight and position factors when setting subscript values ​​for target controls, making the set subscript values ​​more closely aligned with user needs and people's habits of using numbers, thus making it easier for users to control controls via voice. In an optional embodiment of the invention, subscript values ​​are added to multiple target controls based on the user's line of sight on the display screen and the user's position in the vehicle. This includes: determining a first order for setting subscript values ​​for multiple target controls based on the distance between each target control and the user's line of sight; determining a second order for setting subscript values ​​for multiple target controls based on the distance between each target control and the user's seat; and setting subscript values ​​for multiple target controls based on the first and second orders. For example, in the case where two target controls are distributed on the driver's side screen and one target control is distributed on the passenger's side screen, such as... Figure 6 As shown, the user issuing the voice command's gaze falls on the target control on the passenger-side screen. Based on this, the first order for setting the index values ​​of the three target controls can be the passenger-side screen first, then the driver-side screen. For multiple target controls on the driver-side screen, the index values ​​can be set in a top-to-bottom and / or left-to-right order. Specifically, for... Figure 6The three target controls, determined by the user's gaze on the passenger-side screen, are ordered as follows: Zhang XX's variety show "YYYY", Zhang XX's song "XXXX", and Zhang XX's TV series "ZZZZ". Furthermore, with the user seated in the passenger seat, the passenger-side display is closer to the user, while the driver-side display is farther away. Therefore, the second order is passenger-side screen first, then driver-side screen. For multiple target controls on each screen, subscript values ​​can be set in a top-to-bottom and / or left-to-right order. Therefore, for... Figure 6 The three target controls, determined by the user sitting in the front passenger seat, are in the following second order: Zhang XX's variety show "YYYY", Zhang XX's song "XXXX", and Zhang XX's TV series "ZZZZ".

[0070] In addition, regarding Figure 6 The distribution of target controls shown also presents another possibility: the user's gaze is focused on the passenger-side screen, but the user is seated in the driver's seat. In this case, the first order determined by the gaze focus would be: Zhang XX's variety show "YYYY", Zhang XX's song "XXXX", and Zhang XX's TV series "ZZZZ". The second order determined by the user's location would be: Zhang XX's song "XXXX", Zhang XX's TV series "ZZZZ", and Zhang XX's variety show "YYYY".

[0071] Based on a first order and a second order, determine how to set the index values ​​for multiple target controls. In an optional embodiment of the present invention, setting the index values ​​for multiple target controls based on the first order and the second order includes: determining whether the first order and the second order are consistent; if the first order and the second order are consistent, setting the index values ​​for multiple target controls based on the first order or the second order; if the first order and the second order are inconsistent, determining the higher priority between the user's line of sight and the user's position in the vehicle; the priority is preset for the user's line of sight and the user's position in the vehicle respectively; and setting the index values ​​for multiple target controls based on the first order or the second order corresponding to the higher priority. When the user's line of sight is on the passenger-side screen and the user is sitting in the passenger-side seat, the first order and the second order are completely consistent, and in this case, the index values ​​for three target controls can be set based on either one. A schematic diagram showing the completed index value setting is provided. Figure 6 When the user's gaze is focused on the passenger-side screen and the user is seated in the driver's seat, a conflict arises between the first and second priority settings. This can be resolved by pre-setting priorities to determine whether the first or second priority is used, and by assigning index values ​​to multiple target controls. For example, if the pre-set priority of the gaze focus is higher than the user's position, then the first priority will apply. Figure 6The three target controls are assigned index values. In this embodiment, as in the previous embodiment, the index values ​​of multiple target controls are assigned in ascending order according to the first order. That is, the index value of the target control that is closer to the user's expectation is represented by a smaller number, which makes it easier for the user to trigger the expected target control by voice.

[0072] Step S104: In response to receiving a voice command for a target marker, execute a trigger operation on the target control indicated by the target marker. Specifically, multiple target controls, such as Zhang XX's song "XXXX", Zhang XX's variety show "YYYY", and Zhang XX's TV series "ZZZZ", have marker values ​​of 1, 2, and 3 respectively. When the user issues a voice command, such as "1", the system executes the voice command and triggers the target control "Zhang XX's song "XXXX"" corresponding to marker value 1. This avoids the inconvenience of having to input the voice command "Zhang XX's song "XXXX"" to trigger the target control in the prior art. The voice control method of this embodiment only requires inputting simple numbers to trigger the target control, making voice control simple, fast, and efficient.

[0073] The voice control method of this invention, in response to receiving a voice command, matches the voice content of the voice command with the text content of various controls displayed on the screen; based on the matching result, determines the target control that matches the voice command; if there are multiple target controls, adds a badge to each of the multiple target controls; and in response to receiving a voice command for a target badge, executes a trigger operation on the target control indicated by the target badge. Thus, by adding badges to multiple controls initially matched, users can trigger the corresponding control simply by indicating a badge value with their voice, making voice-triggered control operations simple and quick, improving the efficiency of voice triggering, and enhancing the user experience; simultaneously, setting badge values ​​based on the gaze point and / or the user's position makes the control badges more in line with user needs and digital usage habits, further enhancing the user experience.

[0074] Figure 8 An exemplary system architecture 800 to which the voice control method of embodiments of the present invention can be applied is shown.

[0075] like Figure 8 As shown, system architecture 800 may include a display device 801, a network 802, and a processor 803. Network 802 serves as a medium for providing a communication link between display device 801 and processor 803. Network 802 may include various connection types, such as wired or wireless communication links, or fiber optic cables, etc.

[0076] Users can use display device 801 to interact with processor 803 via network 802 to receive or send data, etc. Display device 801 can be a portable display device, or a device with a display screen and web browsing capabilities that supports voice control, has various communication client applications installed, and includes, but is not limited to, smartphones, tablets, laptops, and desktop computers. Processor 803 can be a processor that provides various vehicle services.

[0077] It should be noted that the voice control method provided in this embodiment of the invention can be executed by the processor 803, and correspondingly, the voice control device can be set in the processor 803.

[0078] It should be understood that Figure 8 The number of display devices, networks, and processors shown is merely illustrative. Depending on implementation needs, any number of display devices, networks, and processors can be included.

[0079] The following is for reference. Figure 9 It shows a schematic diagram of the structure of a computer system 900 suitable for implementing an electronic device according to embodiments of the present invention. Figure 9 The display device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments of the present invention.

[0080] like Figure 9 As shown, the computer system 900 includes a central processing unit (CPU) 901, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 902 or programs loaded from storage section 908 into random access memory (RAM) 903. The RAM 903 also stores various programs and data required for the operation of the computer system 900. The CPU 901, ROM 902, and RAM 903 are interconnected via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0081] The following components are connected to I / O interface 905: an input section 906 including a keyboard, mouse, etc.; an output section 907 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 908 including a hard disk, etc.; and a communication section 909 including a network interface card such as a LAN card, modem, etc. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to I / O interface 905 as needed. A removable medium 911, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on drive 910 as needed so that computer programs read from it can be installed into storage section 908 as needed.

[0082] In particular, according to the embodiments disclosed in this invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 909, and / or installed from removable medium 911. When the computer program is executed by central processing unit (CPU) 901, it performs the functions defined above in the system of this invention.

[0083] It should be noted that the computer-readable medium shown in this invention can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this invention, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0084] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0085] The modules described in the embodiments of the present invention can be implemented in software or hardware. The described modules can also be housed in a processor; for example, a processor may be described as including a speech recognition module and a control module. The names of these modules do not necessarily limit the module itself; for example, the control module may also be described as "a module that performs triggering operations on the target control indicated by the target marker."

[0086] In another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiments; or it may exist independently and not assembled into the device. The computer-readable medium carries one or more programs, which, when executed by the device, cause the device to: in response to receiving a voice command, match the voice content included in the voice command with the text content included in various controls displayed on the screen; determine a target control matching the voice command based on the matching result; if there are multiple target controls, add a badge to each of the multiple target controls; and in response to receiving a voice command for a target badge, perform a triggering operation on the target control indicated by the target badge.

[0087] According to the technical solution of this embodiment of the invention, in response to receiving a voice command, the voice content included in the voice command is matched with the text content included in each control displayed on the screen; based on the matching result, a target control matching the voice command is determined; if there are multiple target controls, a badge is added to each of the multiple target controls; in response to receiving a voice command for a target badge, a triggering operation is performed on the target control indicated by the target badge. Thus, by adding badges to multiple controls initially matched, the user can trigger the corresponding control simply by indicating a badge value with voice, making voice-triggered control operation simple and quick, improving the efficiency of voice triggering, and enhancing the user experience; at the same time, setting badge values ​​based on the gaze point and / or the user's position makes the control badges more in line with user needs and digital usage habits, further enhancing the user experience.

[0088] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can occur depending on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A voice control method, characterized in that, include: In response to receiving a voice command, the voice content included in the voice command is matched with the text content included in each control displayed on the screen; Based on the matching results, the target control that matches the voice command is determined; When there are multiple target controls, add badges to each of the multiple target controls according to the user's gaze point on the display screen and / or the user's position in the vehicle; In response to receiving a voice command for a target marker, a trigger operation is performed on the target control indicated by the target marker.

2. The method according to claim 1, characterized in that, Based on the user's gaze point on the display screen when inputting the voice command, badges are added to the multiple target controls, including: Detect the point of the user's gaze on the display screen when inputting the voice command; Calculate the distances between each of the target controls and the point of view; In accordance with the order of distance from near to far, the subscript values ​​of the multiple target controls are set from small to large.

3. The method according to claim 2, characterized in that, Also includes: Sort the multiple index values ​​in order of distance from nearest to farthest; According to the preset position indicated by the preset subscript display strategy, the subscript value in the preset position is highlighted.

4. The method according to claim 1, characterized in that, Based on the user's location inside the vehicle, badges are added to each of the target controls, including: When the user is seated in the driver's seat and the target controls are displayed on the driver's side display screen and the passenger side display screen, the subscript values ​​of the multiple target controls are set from smallest to largest in order from the driver's side display screen to the passenger side display screen.

5. The method according to claim 1, characterized in that, Based on the user's location inside the vehicle, badges are added to each of the target controls, including: When the user is sitting in the front passenger seat and the target controls are displayed on the driver's side display screen and the front passenger side display screen, the subscript values ​​of the multiple target controls are set from small to large in the order from the front passenger side display screen to the driver's side display screen.

6. The method according to claim 1, characterized in that, Based on the user's location inside the vehicle, badges are added to each of the target controls, including: When the user is sitting in a rear seat, the subscript values ​​of the multiple target controls are set from small to large in order from top to bottom and / or from left to right.

7. The method according to claim 1, characterized in that, Based on the user's gaze point on the display screen and the user's position inside the vehicle, badges are added to multiple target controls, including: Based on the distance between each target control and the user's line of sight, a first order for setting the subscript values ​​for the multiple target controls is determined; Based on the distance between each target control and the seat the user is sitting in, a second order for setting the subscript values ​​for the multiple target controls is determined; According to the first order and the second order, set the subscript values ​​for the multiple target controls.

8. The method according to claim 7, characterized in that, The step of setting index values ​​for multiple target controls according to the first order and the second order includes: Determine whether the first order is consistent with the second order; If the first order and the second order are consistent, set the subscript value for the multiple target controls according to the first order or the second order; If the first order and the second order are inconsistent, the user's line of sight and the user's position in the vehicle are determined to be of higher priority; the priority is preset for the user's line of sight and the user's position in the vehicle respectively; and according to the first order or the second order corresponding to the higher priority, the subscript values ​​of the multiple target controls are set.

9. The method according to claim 1, characterized in that, The step of determining the target control that matches the voice command based on the matching result includes: For each control, If the number of characters in the text content included in the control is less than or equal to a first threshold, the matching degree between the text content and the speech content is calculated. If the matching degree between the text content and the voice content is higher than a preset matching degree threshold, the control is determined to be the target control.

10. The method according to claim 9, characterized in that, The step of determining the target control that matches the voice command based on the matching result further includes: If the number of characters in the text content included in the control is greater than the first threshold, determine whether the text content and the voice content meet the condition that there is a second threshold number of consecutive characters that are successfully matched. If it is determined that the text content and the voice content satisfy the condition that there are two consecutive characters that successfully match the second threshold, then the control is determined to be the target control.

11. An electronic device for voice control, characterized in that, include: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1-10.

12. A computer-readable medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-10.

13. A computer program product, comprising a computer program, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-10.

Images