Control method, device, vehicle-mounted terminal, vehicle and storage medium

Abstract

The present application discloses a control method, device, vehicle-mounted terminal, vehicle and storage medium. The control method includes: receiving a first voice control instruction input from a client; determining the first sound source position that issues the first voice control instruction according to the first voice control instruction; when it is determined that the first voice control instruction is a follow-up instruction of the second voice control instruction, and the first sound source position is different from the second sound source position, controlling the first control object at the first sound source position according to the first voice control instruction, the first control object is an object of the same type as the second control object in the second voice control instruction; wherein the second sound source position is the position of the sound source that issues the second voice control instruction. The control method provided by the present application can improve the intelligence, simplicity and efficiency of the secondary operation of the driver and passengers on the same type of control object that has been operated before.

Description

Technical Field

[0001] The present application relates to the field of automatic control, and in particular to a control method, device, vehicle-mounted terminal, vehicle and storage medium. Background Art

[0002] With the development of intelligent cars, drivers and other people in the car can control the equipment in the car (such as seats, air conditioners, windows, reading lights and zone audio, etc.) through accurate voice commands. With the increase of various devices in the car, the voice commands for controlling various devices are becoming more and more complicated, and drivers and passengers must master complete operating instructions to effectively control the equipment.

[0003] Each time the driver or passenger operates a device in the car, they need to input a semantically complete voice command. The complete command must include the controlled object and the action that the controlled object needs to perform to control the devices in the car. For example, by inputting the voice command "open the window of the main driver's seat", the window of the main driver's seat can be opened. If the driver or passenger in the front passenger seat also wants to open the window of the front passenger seat, the driver or passenger in the front passenger seat needs to input a complete voice command, such as "open the window of the front passenger seat". This results in the driver or passenger's secondary operation of the same type of control object that has been operated before being not smart, simple and efficient enough. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a control method, device, vehicle-mounted terminal, vehicle and storage medium to improve the intelligence, simplicity and efficiency of secondary operations of drivers and passengers on control objects of the same type that have been operated before.

[0005] The technical solution of this application is as follows:

[0006] In a first aspect, a control method is provided, the method comprising:

[0007] Receiving a first voice control instruction input from a client;

[0008] Determining, according to the first voice control instruction, a first sound source position that issues the first voice control instruction;

[0009] When it is determined that the first voice control instruction is a follow-up instruction of the second voice control instruction, and the first sound source position is different from the second sound source position, controlling a first control object at the first sound source position according to the first voice control instruction, the first control object being an object of the same type as the second control object in the second voice control instruction;

[0010] The second sound source position is the position of the sound source that issues the second voice control instruction.

[0011] In a second aspect, a control device is provided, the device comprising:

[0012] A receiving module, used for receiving a first voice control instruction input from a client;

[0013] A first determining module, used to determine the first sound source position that issues the first voice control instruction according to the first voice control instruction;

[0014] A control module, for controlling a first control object at the first sound source position according to the first voice control instruction when it is determined that the first voice control instruction is a follow-up instruction of a second voice control instruction and the first sound source position is different from the second sound source position, wherein the first control object is an object of the same type as the second control object in the second voice control instruction; wherein the second sound source position is the position of the sound source that issues the second voice control instruction.

[0015] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the control method described in any one of the embodiments of the present application.

[0016] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the control method described in any one of the embodiments of the present application are implemented.

[0017] The technical solution provided by the embodiments of the present application brings at least the following beneficial effects:

[0018] The control method provided in the embodiment of the present application determines the position of the first sound source that issues the first voice control instruction according to the first voice control instruction input from the client. When it is determined that the first voice control instruction is a follow-up instruction of the second voice control instruction, and the first sound source position is different from the second sound source position where the sound source that issues the second voice control instruction is located, the first control object at the first sound source position can be controlled according to the first voice control instruction, because the first control object is an object of the same type as the second control object in the second voice control instruction. In this way, if a voice control instruction has controlled the second control object before the first voice control instruction, the object of the same type as the second control object can be directly controlled by the follow-up instruction of the second voice control instruction, without the need to input a complete semantic voice control instruction to control the object of the same type as the second control object, thus realizing the intelligence, simplicity and efficiency of the secondary operation of the driver and passengers on the same type of control object that has been operated before.

[0019] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application, and do not constitute an improper limitation on the present application.

[0021] Figure 1 It is one of the schematic diagrams of a control method provided by an exemplary embodiment of the present application;

[0022] Figure 2 This is a second schematic diagram of a control method provided by an exemplary embodiment of the present application;

[0023] Figure 3 is a structural schematic diagram of a control device provided by an exemplary embodiment of the present application;

[0024] Figure 4 is a structural schematic diagram of a vehicle-mounted terminal provided by an exemplary embodiment of the present application;

[0025] Figure 5 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to make those of ordinary skill in the art better understand the technical scheme of the present application, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here can be implemented in an order other than those illustrated or described here. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are only examples consistent with some aspects of the present application as detailed in the attached claims.

[0028] As described in the background technology, there is a problem in the prior art that the secondary operation of the driver and passengers on the same type of control object that has been operated before is not intelligent, simple and efficient enough. In order to solve the above problem, an embodiment of the present application provides a control method, by determining the first sound source position that issues the first voice control instruction according to the first voice control instruction input from the client, when it is determined that the first voice control instruction is a follow-up instruction of the second voice control instruction, and the first sound source position is different from the second sound source position where the sound source that issues the second voice control instruction is located, the first control object at the first sound source position can be controlled according to the first voice control instruction. Since the first control object is the same type of object as the second control object in the second voice control instruction, it can be achieved that if a voice control instruction has controlled the second control object before the first voice control instruction, the object of the same type as the second control object can be directly controlled by the follow-up instruction of the second voice control instruction, without the need to input a complete semantic voice control instruction to control the object of the same type as the second control object, thereby achieving the intelligence, simplicity and efficiency of the secondary operation of the driver and passengers on the same type of control object that has been operated before.

[0029] The control method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0030] Figure 1 is a flow chart of a control method provided in an embodiment of the present application, such as Figure 1 As shown, the control method provided in the embodiment of the present application may include steps 110 to 130.

[0031] Step 110: Receive a first voice control instruction input from a client.

[0032] Step 120: Determine the position of a first sound source that issues the first voice control instruction according to the first voice control instruction.

[0033] Step 130: When it is determined that the first voice control instruction is a follow-up instruction of the second voice control instruction and the first sound source position is different from the second sound source position, control the first control object at the first sound source position according to the first voice control instruction.

[0034] The first control object may be an object of the same type as the second control object in the second voice control instruction.

[0035] The second sound source position may be the position of the sound source that issues the second voice control instruction.

[0036] In an embodiment of the present application, by determining the first sound source position that issues the first voice control instruction based on the first voice control instruction input from the client, when it is determined that the first voice control instruction is a follow-up instruction of the second voice control instruction, and the first sound source position is different from the second sound source position where the sound source that issues the second voice control instruction is located, the first control object at the first sound source position can be controlled according to the first voice control instruction. Since the first control object is an object of the same type as the second control object in the second voice control instruction, it can be achieved that if a voice control instruction has controlled the second control object before the first voice control instruction, the object of the same type as the second control object can be directly controlled by the follow-up instruction of the second voice control instruction, without the need to input a complete semantic voice control instruction to control the object of the same type as the second control object, thereby achieving the intelligence, simplicity and efficiency of the secondary operation of the driver and passengers on the same type of control object that has been operated before.

[0037] The control method provided in the embodiments of the present application will be described in detail below.

[0038] First, step 110 is introduced, receiving a first voice control instruction input from a client.

[0039] Among them, the first voice control instruction can be a voice control instruction input from the client. The first voice control instruction can specifically be an instruction for controlling a control object, and can specifically be an instruction for controlling a device in the car. The device in the car can be but is not limited to windows, seats, air conditioners, reading lights, ambient lights, and audio, etc.

[0040] In some embodiments of the present application, the user may input the first voice control instruction from the client, and specifically may input the first voice control instruction from a microphone of the client.

[0041] Then, step 120 is introduced, in which the position of the first sound source issuing the first voice control instruction is determined according to the first voice control instruction.

[0042] The first sound source position may be the position of the sound source that issues the first voice control instruction.

[0043] In some embodiments of the present application, according to the first voice control instruction, a sound source determination algorithm or other algorithms that can detect the sound source position can be used to determine the first sound source position that issues the first voice control instruction.

[0044] In some embodiments of the present application, how to determine the position of the first sound source that issues the first voice control instruction based on the first voice control instruction can be determined by an algorithm selected according to user needs, and is not limited here. Any implementation method that can determine the position of the first sound source that issues the first voice control instruction based on the first voice control instruction falls within the protection scope of the embodiments of the present application.

[0045] In one example, a passenger in the co-pilot seat of a vehicle issues a first voice control command from a client, and according to a sound source determination algorithm, it can be determined that the sound source issuing the first voice control command is in the co-pilot seat of the vehicle (ie, the first sound source position).

[0046] Finally, step 130 is introduced. When it is determined that the first voice control instruction is a follow-up instruction of the second voice control instruction and the first sound source position is different from the second sound source position, the first control object at the first sound source position is controlled according to the first voice control instruction.

[0047] The second voice control instruction may be an instruction followed by the first voice control instruction, and the second voice control instruction may also be input from the client.

[0048] The follow instruction may be an instruction to follow a certain object, and the follow instruction may be, for example but not limited to, instructions such as “me too”, “I want some too”, and “I want some too”.

[0049] In one example, the driver in the main driving seat of the vehicle sends a second voice control command from the client, such as "open the main driving window". If the driver in the front passenger seat sends a follow-up command of the second voice control command "Me too" (that is, the first voice control command) from the client, the first voice control command is determined to be a follow-up command of the second voice control command.

[0050] The second sound source position may be the position of the sound source that issues the second voice control instruction.

[0051] In some embodiments of the present application, the position of the second sound source that issues the second voice control instruction is determined specifically according to the second voice control instruction. The implementation method of determining the position of the first sound source that issues the first voice control instruction according to the first voice control instruction can be referred to, and will not be repeated here.

[0052] In one example, a driver in a main driving position of a vehicle issues a second voice control command from a client, and according to a sound source determination algorithm, it can be determined that the sound source issuing the second voice control command is in the main driving position of the vehicle (ie, the second sound source position).

[0053] The first control object may be a control object in the vehicle corresponding to the first voice control instruction, and specifically may be an object of the same type as the second control object in the second voice control instruction.

[0054] In one example, the driver in the main driving position of the vehicle issues a second voice control command from the client, such as "open the main driving window", then the "main driving window" is the second control object, and the main driving window can be opened. If the driver in the co-pilot position issues a follow-up command "me too" (i.e., the first voice control command) of the second voice control command from the client, the co-pilot window can be opened, then the "co-pilot window" is the first control object, and the first control object is the same type of object as the second control object, i.e., both are windows. In this way, the intelligence, simplicity, and efficiency of the secondary operation of the driver on the same type of control object that has been operated before are realized, without the need for the driver in the co-pilot position to input a semantically complete voice control command.

[0055] In some embodiments of the present application, in order to further realize the intelligence, simplicity and efficiency of the secondary operation of the driver and passenger on the same type of control object that has been operated before, after step 110, the control method involved above may further include:

[0056] According to the first voice control instruction, the semantics of the first voice control instruction is determined.

[0057] In some embodiments of the present application, after receiving the first voice control instruction, the first voice control instruction can be detected based on a voice recognition algorithm or a voice detection algorithm to obtain the semantics of the first voice control instruction.

[0058] In some embodiments of the present application, how to determine the semantics of the first voice control instruction based on the first voice control instruction can be selected according to user needs, and is not limited here. Any implementation method that can determine the semantics of the first voice control instruction based on the first voice control instruction falls within the protection scope of the embodiments of the present application.

[0059] In one example, the driver and passenger in the main driving seat of the vehicle sends a second voice control command from the client, for example, "open the main driver's window". If the driver and passenger in the front passenger seat sends a follow-up command "me too" (i.e., the first voice control command) to the second voice control command from the client, voice detection is performed on the first voice control command "me too" to determine its semantics as "the driver and passenger in the front passenger seat also wants to follow the main driver to open the front passenger seat window."

[0060] Correspondingly, determining the first voice control instruction as a follow-up instruction of the second voice control instruction in step 130 may specifically include:

[0061] When the semantics is determined to be the follow-up semantics of the second voice control instruction, the first voice control instruction is determined to be the follow-up instruction of the second voice control instruction.

[0062] In some embodiments of the present application, when it is determined that the semantics of the first voice control instruction is the follow-up semantics of the second voice control instruction, the first voice control instruction may be determined to be the follow-up instruction of the second voice control instruction.

[0063] In one example, the driver and passenger in the main driving position of the vehicle sends a second voice control command from the client, for example, it may be "open the main driver's window". If the driver and passenger in the co-pilot position sends a follow-up command "me too" (i.e., the first voice control command) of the second voice control command from the client, then the first voice control command "me too" is voice detected to determine that its semantics is "the driver and passenger in the co-pilot position also wants to follow the main driver to open the co-pilot window". This semantics follows the semantics of the second voice control command "the driver and passenger in the main driving position wants to open the main driver's window". That is, the semantics of the first voice control command are the follow-up semantics of the second voice control command. Then, it can be determined that the first voice control "me too" is a follow-up command of the second voice control command "open the main driver's window".

[0064] In an embodiment of the present application, by analyzing the received first voice control instruction, its corresponding semantics are obtained, and by analyzing its semantics, when it is determined that its semantics are the follow-up semantics of the second voice control instruction, it can be determined that the first voice control instruction is the follow-up instruction of the second voice control instruction. In this way, it can be accurately determined whether the first voice control instruction is the follow-up instruction of the second voice control instruction. Further, when it is determined that the first voice control instruction is the follow-up instruction of the second voice control instruction, based on the follow-up instruction, the object of the same type as the second control object can be directly controlled through the follow-up instruction of the second voice control instruction, without inputting a voice control instruction with complete semantics to control the object of the same type as the second control object, thereby further realizing the intelligence, simplicity and efficiency of the secondary operation of the driver and passengers on the same type of control objects that have been operated before.

[0065] In some embodiments of the present application, in order to further improve the user experience, after step 120, the control method involved above may further include:

[0066] A target user who issues a first voice control instruction is determined.

[0067] The target user may be a user who issues the first voice control instruction.

[0068] In some embodiments of the present application, determining the target user who issues the first voice control instruction may be specifically determined in the following manner:

[0069] (1) Determining audio feature information corresponding to the first voice control instruction based on the first voice control instruction; and determining a target user who issues the first voice control instruction based on the audio feature information.

[0070] The audio feature information may be audio information of the first voice control instruction, and may specifically include but is not limited to at least one of the following: timbre information and voiceprint information.

[0071] In one example, if the driver or passenger in the co-pilot seat issues a first voice control command "Me too" from the client, the audio feature information of the driver or passenger in the co-pilot seat who issued the first voice control command can be obtained, and the user corresponding to the audio feature information of the driver or passenger in the co-pilot seat can be searched for in the pre-stored correspondence between audio feature information and users. For example, if it is determined that the user corresponding to the audio feature information of the driver or passenger in the co-pilot seat is Zhang San, then Zhang San is the target user.

[0072] (2) According to the first sound source position, image information of an object at the first sound source position is obtained; and according to the image information, a target user who issues the first voice control instruction is determined.

[0073] The image information may be a photo of an object at the first sound source position.

[0074] In some embodiments of the present application, image information of the object at the first sound source position may be acquired by a shooting device with a shooting function, such as a camera or a webcam.

[0075] In one example, after determining that the first sound source position is the co-pilot position according to the first voice control instruction, the camera can be used to obtain image information of the driver and passenger in the co-pilot position, and the image information can be identified to determine the target user who issued the first voice control instruction.

[0076] It should be noted that the above examples of determining the target user who issues the first voice control command are only two examples provided in the embodiments of the present application. Those skilled in the art should know that there may be other ways to determine the target user who issues the first voice control command. For example, the target user who issues the first voice control command may be determined by obtaining the fingerprint information of the object at the position of the first sound source. Any method that can determine the target user who issues the first voice control command is protected by the present application.

[0077] After determining the target user who issues the first voice control instruction, correspondingly, controlling the first control object at the first sound source position according to the first voice control instruction may specifically include:

[0078] According to the target user and the historical control degree information of the target user on the first control object, the control degree information of the first control object at the first sound source position is determined.

[0079] The historical control degree information on the first control object may be information on the degree to which the target user previously controlled the first control object.

[0080] In one example, taking the first control object as an air conditioner, if the target user previously adjusted the air conditioner to 20 degrees, then the historical control degree information of the first control object is that the air conditioner was adjusted to 20 degrees.

[0081] The control degree information of the first control object may be the control degree of the first control object. For example, if the first control object is a car window, the control degree of the first control object may be the height of the car window opening; if the first control object is a reading light, the control degree of the first control object may be the brightness of the reading light, etc.

[0082] In one example, the driver and passenger in the main driving seat of the vehicle issues a second voice control command from the client, for example, it may be "turn on the air conditioner in the main driving seat". If the driver and passenger in the co-pilot seat issues a follow-up command "Me too" (i.e., the first voice control command) of the second voice control command from the client, the audio feature information of the driver and passenger in the co-pilot seat who issued the first voice control command can be obtained, and the user corresponding to the audio feature information of the driver and passenger in the co-pilot seat can be searched in the pre-stored correspondence between audio feature information and users to determine who the driver and passenger in the co-pilot seat is. For example, if it is Zhang San, then based on the historical control degree information of the temperature when the air conditioner was turned on by Zhang San before (for example, Zhang San turned on the air conditioner before and set it to 20 degrees), the air conditioner in the co-pilot seat will be turned on and adjusted to 20 degrees.

[0083] In an embodiment of the present application, by determining the target user who issues the first voice control command, and then determining the control degree information of the first control object at the first sound source position based on the target user and the historical control degree information of the target user on the first control object, not only can the secondary operation of the same type of control object that has been operated before be performed intelligently and efficiently, but also the control degree of the first control object can be determined based on the historical control degree information of the target user who issues the first voice control command on the first control object, which greatly meets the needs of users and improves the user experience.

[0084] In some embodiments of the present application, before receiving a first voice control instruction and controlling a first control object at a first sound source position according to the first voice control instruction, a second voice control instruction needs to be received first, so that a first control object of the same type as the second control object at the first sound source position can be controlled according to the first voice control instruction.

[0085] In some embodiments of the present application, before step 110, the control method mentioned above may further include:

[0086] receiving a second voice control instruction input from the client;

[0087] Determining, according to the second voice control instruction, a second sound source position that issues the second voice control instruction;

[0088] In the case where it is determined that the second voice control instruction is a control instruction for the second control object, controlling the second control object according to the second voice control instruction;

[0089] The second voice control instruction and the second control object are stored.

[0090] In some embodiments of the present application, determining that the second voice control instruction is a control instruction for the second control object can be done by analyzing the second voice control instruction to obtain the semantics of the second voice control instruction, analyzing the semantics, and determining whether the second voice control instruction is a control instruction for the second control object based on the semantics.

[0091] In one example, the driver in the main driving position of the vehicle sends a second voice control command from the client, for example, it may be "open the main driving window". The second voice control command is analyzed and its semantics may be "the driver in the main driving position wants to open the main driving window". Analysis of the semantics shows that it is a control command for the main driving window (i.e., the second control object), that is, the second voice control command is a control command for the second control object.

[0092] In some embodiments of the present application, after controlling the second control object according to the second voice control instruction, the second voice control instruction and the second control object may be stored, specifically in a storage space of the vehicle.

[0093] In an embodiment of the present application, before receiving a first voice control instruction input from a client, a second voice control instruction input from the client is received, and based on the second voice control instruction, a second sound source position that issues the second voice control instruction is determined, and when it is determined that the second voice control instruction is a control instruction for a second control object, the second control object is controlled based on the second voice control instruction, and the second voice control instruction and the second control object are stored, so that when a follow-up instruction of the second voice control instruction is subsequently received, the control object of the same type as the second control object can be directly controlled based on the follow-up instruction of the second voice control instruction, without the need to input a complete semantic voice control instruction to control the object of the same type as the second control object, thereby further realizing the intelligence, simplicity and efficiency of the secondary operation of the driver and passengers on the same type of control object that has been operated before.

[0094] In some embodiments of the present application, in order to ensure the storage capacity of the storage space in the vehicle, after storing the second voice control instruction and the second control object, the control method involved above may further include:

[0095] When the storage time of the second voice control instruction and the second control object reaches a preset storage time, the second voice control instruction and the second control object are cleared.

[0096] The storage duration of the second voice control instruction and the second control object may be the storage duration of the second voice control instruction and the second control object in the storage space.

[0097] The preset storage duration may be a preset threshold for the storage duration of the second voice control instruction and the second control object.

[0098] In some embodiments of the present application, a storage duration can be pre-set, for example, it can be 5 minutes. After the storage duration of the second voice control instruction and the second control object reaches the preset storage duration, the second voice control instruction and the second control object can be cleared.

[0099] In an embodiment of the present application, the second voice control instruction and the second control object are cleared when the storage time of the second voice control instruction and the second control object reaches a preset storage time. This ensures the storage capacity of the vehicle's storage space and avoids the problem of too many voice control instructions and control objects being stored in the vehicle, resulting in the inability to store subsequent voice control instructions and control objects.

[0100] In some embodiments of the present application, in order to further ensure that the first control object at the first sound source position can be directly controlled according to the first voice control instruction, before controlling the first control object at the first sound source position according to the first voice control instruction, the control method involved above may also include:

[0101] It is determined that the second voice control instruction and the second control object are not cleared.

[0102] In an embodiment of the present application, when it is determined that the first voice control instruction is a follow-up instruction of the second voice control instruction, and the first sound source position is different from the second sound source position, it is also necessary to determine that the second voice control instruction and the second control object have not been cleared. Only in this way can the first control object at the first sound source position, which is the same type of object as the second control object, be controlled according to the first voice control instruction. This ensures that the first control object can be accurately controlled according to the first voice control instruction, and avoids the situation where, after the second voice control instruction and the second control object are cleared, it is impossible to know which object is the same type as the second control object, so that the first control object cannot be controlled according to the first voice control instruction.

[0103] In some embodiments of the present application, multiple sets of correspondences between voice control instructions and control objects may be stored in the storage space. If a follow-up instruction "Me too" is input at this time, when a first control object of the same type as a second control object is controlled based on the follow-up instruction, a set of instructions closest to the follow-up instruction is selected from the storage space.

[0104] In one example, if there are currently three groups of correspondences between voice control instructions and control objects stored in the storage space, for example, the first group of correspondences is stored at the beginning: open the window of the main driving position (voice control instruction) and the window of the main driving position (control object), then the second group of correspondences is stored: open the air conditioner of the main driving position (voice control instruction) and the air conditioner of the main driving position (control object), and finally the third group of correspondences is stored: turn on the reading light of the driving position behind the main driving position (voice control instruction) and the reading light of the driving position behind the main driving position (control object). If the driver and passenger in the co-pilot position inputs the first voice control instruction "Me too", then the first voice control instruction is followed by the last instruction stored in the storage space, that is, it is followed by "turn on the reading light of the driving position behind the main driving position", then according to the first voice control instruction, the reading light of the co-pilot position is turned on.

[0105] In an embodiment of the present application, when multiple sets of correspondences between voice control instructions and controlled objects are stored, the controlled objects in a set of correspondences closest to the following instructions in the storage space are controlled based on the following instructions. This can achieve the effect of accurately controlling the controlled objects and avoid confusion when multiple control objects are stored.

[0106] In some embodiments of the present application, in order to improve user experience, for any target control object of the first control object or the second control object, after controlling the target control object according to the target voice control instruction, the control method involved above may further include:

[0107] Feedback the execution results of the target control object to the client.

[0108] The target control object may be the first control object or the second control object.

[0109] The target voice control instruction may be a voice control instruction corresponding to the target control object. Specifically, when the target control object is the first control object, the target voice control instruction may be the first voice control instruction; when the target control object is the second control object, the target voice control instruction may be the second voice control instruction.

[0110] In one example, taking the target control object as the second control object and the target voice control instruction as the second voice control instruction, the driver in the main driving position of the vehicle sends a second voice control instruction from the client, for example, it may be "open the main driving window", and the window of the main driving position is opened according to the second voice control instruction, and the execution result can be fed back to the client.

[0111] In one example, continuing to refer to the above example, the client may present the execution result in the following manner, but is not limited to:

[0112] (1) The following content is displayed in the client: "The window of the main driver's seat is open";

[0113] (2) The client plays a voice message saying “The driver’s window is open”;

[0114] (3) The window of the main driver's seat is opened in the vehicle image displayed in the client.

[0115] In some embodiments of the present application, how the specific client presents the execution results can be set according to user needs and is not limited here.

[0116] It should be noted that after controlling the first control object according to the first voice control instruction, the execution result can also be fed back to the client. The way in which the client presents the execution result can refer to the above-mentioned way of presenting the execution result of the second control object, which will not be repeated here.

[0117] In an embodiment of the present application, for any target control object among the first control object or the second control object, after controlling the target control object according to the target voice control instruction, the execution result of the target control object can be fed back to the client, so that the user can view the execution result very intuitively, thereby improving the user experience.

[0118] In order to better understand the control method provided in the embodiment of the present application, Figure 2 As shown, the embodiment of the present application provides another implementation of the control method, such as Figure 2 As shown, the control method provided in the embodiment of the present application may include the following steps 201 to 212:

[0119] Step 201: Receive a second voice control instruction.

[0120] Step 202: determine the position of a second sound source that issues a second voice control instruction, and recognize the second voice control instruction.

[0121] Step 203 , determining whether the second voice control instruction is a control instruction for the second control object, and if so, executing step 240 .

[0122] Step 204: Based on the second sound source position and according to the second voice control instruction, control the second control object and feed back the execution result.

[0123] Step 205: store the second voice control instruction and the second control object, and preset a storage time.

[0124] Step 206: Receive a first voice control instruction.

[0125] Step 207: determine the position of the first sound source that issues the first voice control instruction, and recognize the first voice control instruction.

[0126] Step 208 , determining whether the first voice control instruction is a follow-up instruction of the second voice control instruction, if so, executing step 209 .

[0127] Step 209: determine whether the storage space is empty. If not, execute step 210.

[0128] Step 210: determine whether the first sound source position is the same as the second sound source position; if they are different, execute step 211.

[0129] Step 211: Based on the first sound source position and according to the first voice control instruction, the first control object is controlled and the execution result is fed back.

[0130] Step 212: store the first voice control instruction and the first control object, and preset a storage time.

[0131] It should be noted that when determining the first sound source position based on the first voice control instruction, the target user who issues the first voice control instruction can also be determined, and then the control degree information of the first control object at the first sound source position can be determined based on the target user and the target user's historical control degree information of the first control object.

[0132] After the first voice control instruction and the first control object are stored and the storage time is preset, the next first voice control instruction may continue to be received, that is, steps 206 to 212 are repeatedly executed.

[0133] It should be noted that the control method provided in the embodiment of the present application can be executed by a control device or a control module in the control device for executing the control method. In the embodiment of the present application, the control device provided in the embodiment of the present application is described by taking the control device executing the control method as an example.

[0134] Based on the same inventive concept as the above control method, the present application also provides a control device. Figure 3 The control device provided in the embodiment of the present application is described in detail.

[0135] Figure 3 It is a schematic structural diagram of a control device according to an exemplary embodiment.

[0136] like Figure 3 As shown, the control device 300 may include:

[0137] The receiving module 310 is used to receive a first voice control instruction input from a client;

[0138] A first determining module 320, configured to determine a first sound source position that issues the first voice control instruction according to the first voice control instruction;

[0139] The control module 330 is used to control the first control object at the first sound source position according to the first voice control instruction when it is determined that the first voice control instruction is a follow-up instruction of the second voice control instruction and the first sound source position is different from the second sound source position, wherein the first control object is an object of the same type as the second control object in the second voice control instruction; wherein the second sound source position is the position of the sound source that issues the second voice control instruction.

[0140] In some embodiments of the present application, in order to further realize the intelligence, simplicity and efficiency of the secondary operation of the driver and passenger on the same type of control object that has been operated before, the control device involved above may also include:

[0141] A second determining module, configured to determine the semantics of the first voice control instruction according to the first voice control instruction;

[0142] The control module 330 may include:

[0143] The first determining unit is used to determine that the first voice control instruction is a follow-up instruction of the second voice control instruction when the semantics is determined to be a follow-up semantics of the second voice control instruction.

[0144] In some embodiments of the present application, in order to further improve user experience, the first determining module 320 may also be used to:

[0145] Determining a target user who issues the first voice control instruction;

[0146] Correspondingly, the control module 330 may also be used to determine the control degree information of the first control object at the first sound source position according to the target user and the historical control degree information of the target user on the first control object.

[0147] In some embodiments of the present application, in order to further realize the intelligence, simplicity and efficiency of the secondary operation of the driver and passenger on the same type of control object that has been operated before, the receiving module 310 can also be used to: receive the second voice control instruction input from the client;

[0148] The first determination module 320 may also be used to determine the position of a second sound source that issues the second voice control instruction according to the second voice control instruction;

[0149] The control module 330 may also be configured to control the second control object according to the second voice control instruction when determining that the second voice control instruction is a control instruction for the second control object;

[0150] The control device mentioned above may further include: a storage module, used to store the second voice control instruction and the second control object.

[0151] In some embodiments of the present application, in order to ensure the storage capacity of the storage space in the vehicle, the control device involved above may further include:

[0152] The clearing module is used to clear the second voice control instruction and the second control object when the storage time of the second voice control instruction and the second control object reaches a preset storage time.

[0153] In some embodiments of the present application, in order to further ensure that the first control object at the first sound source position can be directly controlled according to the first voice control instruction, the control module 330 may further include:

[0154] The second determining unit is used to determine that the second voice control instruction and the second control object are not cleared.

[0155] In some embodiments of the present application, in order to improve user experience, the control device involved above may further include:

[0156] A feedback module is used to feed back the execution result of the target control object to the client after controlling the target control object according to a target voice control instruction for any target control object among the first control object and the second control object; wherein, when the target control object is the first control object, the target voice control instruction is the first voice control instruction; when the target control object is the second control object, the target voice control instruction is the second voice control instruction.

[0157] The control device provided in the embodiment of the present application can be used to execute the control methods provided in the above-mentioned method embodiments. The implementation principles and technical effects are similar and will not be described here for the sake of simplicity.

[0158] Based on the same inventive concept, an embodiment of the present application also provides a vehicle-mounted terminal.

[0159] like Figure 4 The vehicle-mounted terminal 400 provided in an embodiment of the present application is shown. The vehicle-mounted terminal 400 may include a processor 410, and the processor may be used to implement the control method provided in the above embodiment.

[0160] In some embodiments of the present application, in order to improve user experience, the vehicle terminal 400 may further include: a display for displaying the execution result of the first control object or the second control object.

[0161] The vehicle-mounted terminal provided in the embodiment of the present application can be used to execute the control methods provided in the above-mentioned method embodiments. The implementation principles and technical effects are similar and will not be described here for the sake of simplicity.

[0162] Based on the same inventive concept, an embodiment of the present application also provides a vehicle, which may include a vehicle-mounted terminal as in the above embodiment.

[0163] Based on the same inventive concept, an embodiment of the present application also provides an electronic device.

[0164] Figure 5 Schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 5 As shown, the electronic device may include a processor 501 and a memory 502 storing computer programs or instructions.

[0165] Specifically, the processor 501 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiment of the present invention.

[0166] The memory 502 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 502 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 502 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 502 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 502 is a non-volatile solid-state memory. In a specific embodiment, the memory 502 includes a read-only memory (ROM). In appropriate cases, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM) or a flash memory or a combination of two or more of these.

[0167] The processor 501 implements any one of the control methods in the above embodiments by reading and executing computer program instructions stored in the memory 502 .

[0168] In one example, the electronic device may further include a communication interface 503 and a bus 510. Figure 5 As shown, the processor 501, the memory 502, and the communication interface 503 are connected via a bus 510 and communicate with each other.

[0169] The communication interface 503 is mainly used to implement the communication between the modules, devices, units and / or devices in the embodiment of the present invention.

[0170] Bus 510 includes hardware, software or both, and the parts of electronic equipment are coupled to each other. For example, but not limitation, bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 510 may include one or more buses. Although the embodiment of the present invention describes and shows a specific bus, the present invention considers any suitable bus or interconnection.

[0171] The electronic device can execute the control method in the embodiment of the present invention, thereby achieving Figure 1-Figure 2 Any control method described.

[0172] In addition, in combination with the control method in the above embodiment, the embodiment of the present invention can provide a readable storage medium for implementation. The readable storage medium stores program instructions; when the program instructions are executed by a processor, any one of the control methods in the above embodiment is implemented.

[0173] It should be clear that the present invention is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present invention.

[0174] The functional blocks shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present invention are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0175] It should also be noted that the exemplary embodiments mentioned in the present invention describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiments, or in a different order from the embodiments, or several steps can be performed simultaneously.

[0176] The above is only a specific implementation of the present invention. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the system, module and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. It should be understood that the protection scope of the present invention is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be covered within the protection scope of the present invention.

Claims

1. A control method, characterized in that: The method comprises: Receiving a first voice control instruction input from a client; Determining, according to the first voice control instruction, a first sound source position that issues the first voice control instruction; When it is determined that the first voice control instruction is a follow-up instruction of the second voice control instruction, and the first sound source position is different from the second sound source position, controlling a first control object at the first sound source position according to the first voice control instruction, the first control object being an object of the same type as the second control object in the second voice control instruction; Wherein, the second sound source position is the position of the sound source that issues the second voice control instruction; After receiving the first voice control instruction input from the client, the method further includes: Determining the semantics of the first voice control instruction according to the first voice control instruction; The determining that the first voice control instruction is a follow-up instruction of the second voice control instruction includes: In the case where it is determined that the semantics is the follow-up semantics of the second voice control instruction, determining the first voice control instruction as a follow-up instruction of the second voice control instruction; Wherein, after determining the first sound source position that issues the first voice control instruction according to the first voice control instruction, the method further includes: Determining a target user who issues the first voice control instruction; The controlling the first control object at the first sound source position according to the first voice control instruction includes: Determining control degree information of the first control object at the first sound source position according to the target user and historical control degree information of the target user on the first control object; Before receiving the first voice control instruction input from the client, the method further includes: receiving the second voice control instruction input from the client; Determining, according to the second voice control instruction, a position of a second sound source issuing the second voice control instruction; In a case where it is determined that the second voice control instruction is a control instruction for the second controlled object, controlling the second controlled object according to the second voice control instruction; The second voice control instruction and the second control object are stored.

2. The method according to claim 1, characterized in that After storing the second voice control instruction and the second control object, the method further includes: When the storage time of the second voice control instruction and the second control object reaches a preset storage time, the second voice control instruction and the second control object are cleared.

3. The method according to claim 2, characterized in that Before controlling the first control object at the first sound source position according to the first voice control instruction, the method further includes: It is determined that the second voice control instruction and the second control object are not cleared.

4. The method according to claim 3, characterized in that For any target control object of the first control object or the second control object, after controlling the target control object according to the target voice control instruction, the method further includes: Feedback the execution result of the target control object to the client; Among them, when the target control object is the first control object, the target voice control instruction is the first voice control instruction; when the target control object is the second control object, the target voice control instruction is the second voice control instruction.

5. A control device, characterized in that: The device comprises: A receiving module, used for receiving a first voice control instruction input from a client; A first determining module, used to determine the first sound source position that issues the first voice control instruction according to the first voice control instruction; A control module, configured to control a first control object at the first sound source position according to the first voice control instruction, when it is determined that the first voice control instruction is a follow-up instruction of a second voice control instruction and the first sound source position is different from the second sound source position; the first control object is an object of the same type as the second control object in the second voice control instruction; wherein the second sound source position is a position where a sound source that issues the second voice control instruction is located; A second determining module, configured to determine the semantics of the first voice control instruction according to the first voice control instruction; The control module includes a first determining unit, which is used to determine that the first voice control instruction is a follow-up instruction of the second voice control instruction when the semantics is determined to be a follow-up semantics of the second voice control instruction; The first determining module is further used to determine a target user who issues the first voice control instruction; The control module is further used to determine the control degree information of the first control object at the first sound source position according to the target user and the historical control degree information of the target user on the first control object; The receiving module is further used to receive the second voice control instruction input from the client; The first determining module is further used to determine the position of a second sound source that issues the second voice control instruction according to the second voice control instruction; The control module is further configured to control the second controlled object according to the second voice control instruction when it is determined that the second voice control instruction is a control instruction for the second controlled object; A storage module is used to store the second voice control instruction and the second control object.

6. A vehicle-mounted terminal, characterized in that: The vehicle-mounted terminal includes a processor, and the processor is used to implement the steps of the control method as described in any one of claims 1-4.

7. The vehicle-mounted terminal according to claim 6, characterized in that: The vehicle-mounted terminal further includes: a display; The display is used to display the execution result of the first control object or the second control object.

8. A vehicle, characterized in that: The vehicle comprises the vehicle-mounted terminal as described in any one of claims 6-7.

9. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the control method according to any one of claims 1 to 4 are implemented.

Images