Vehicle control method and device and vehicle

Abstract

The invention provides a vehicle control method and device and a vehicle, and the method comprises the steps: determining a target part in the vehicle corresponding to a voice control instruction if the voice control instruction of a target user is detected; if the voice control instruction does not indicate the target position of the target component, state information of a target user in the vehicle cabin is obtained; determining a target sound area of the vehicle cabin based on the target component and the state information; and controlling a target component in the target sound area to execute the voice control instruction. According to the method, the voice area corresponding to the voice control instruction of the user can be accurately recognized, and correct operation is executed.

Description

Technical Field

[0001] The present application relates to the field of vehicles, and more specifically, to a vehicle control method, device and vehicle in the field of vehicles. Background Art

[0002] In the prior art, microphones are installed in different areas of the vehicle to identify voice control commands when the user is in different areas of the vehicle, and the microphones collecting sound are associated with the seat areas in the vehicle.

[0003] However, since the position of the microphone in the vehicle is fixed, while the position and posture of the user in the vehicle may change; therefore, it may lead to misunderstanding of the user's voice control commands, resulting in incorrect operation of the vehicle; therefore, how to accurately identify the sound zone corresponding to the user's voice control commands and perform the correct operation is a technical problem that needs to be solved at present. Summary of the invention

[0004] The present application provides a vehicle control method, device and vehicle. The method determines the target sound zone in the vehicle cabin according to the status information of the target component and the target user corresponding to the voice control command, and controls the target component in the target sound zone to execute the voice control command, thereby ensuring that the sound zone corresponding to the user's voice control command can be accurately identified and the correct operation can be performed.

[0005] In a first aspect, a vehicle control method is provided, the method comprising:

[0006] If a voice control command of the target user is detected, determining that the voice control command corresponds to a target component in the vehicle;

[0007] If the voice control command does not indicate the target position of the target component, obtaining the state information of the target user in the cabin; wherein the state information includes the position of the target user in the cabin and the posture of the target user;

[0008] Determine the target sound zone of the cabin based on the target components and status information;

[0009] The target component in the target sound zone is controlled to execute the voice control instruction.

[0010] In an embodiment of the present application, if a voice control instruction of a target user is detected, a target component in the vehicle corresponding to the voice control instruction is obtained; if the voice control instruction does not indicate a target position of the target component, the state information of the target user is obtained; that is, when the voice control instruction does not specify the position of the target component, the state information of the target user is obtained; since the voice control instruction does not indicate the target position of the target component, the vehicle cannot directly determine the position of the target component that executes the voice control instruction in the vehicle; if there are multiple target components in the vehicle (for example, when the target component is a window), it may cause an error in the execution of the voice control instruction; therefore, it is necessary to determine the target sound zone in the cabin based on the state information of the target component and the target user, and determine the target component that executes the voice control instruction according to the target sound zone; since different positions or different postures of the target user will result in different target sound zones corresponding to the voice control instruction; therefore, the target sound zone of the cabin is determined according to the target component and the state information (including the position and posture of the user), to ensure that the sound zone corresponding to the user's voice control instruction can be accurately identified; thereby ensuring that the target component in the target sound zone can accurately execute the voice control instruction.

[0011] In conjunction with the first aspect, in some implementations of the first aspect, determining a target sound zone of a vehicle cabin based on the target component and the state information includes:

[0012] Determine the target part of the target user corresponding to the target component;

[0013] Based on multiple sound zones and status information in the vehicle cabin, a first sound zone where a target part is located is determined; based on the first sound zone, a target sound zone is determined.

[0014] In an embodiment of the present application, a target part of a target user corresponding to a target component is determined; that is, a body part of the target user corresponding to the target component is determined; a first sound zone where the target part is located is determined based on multiple sound zones in the cabin and status information of the target user; and a target sound zone is determined based on the first sound zone; since different target components act on different body parts of the user; therefore, in order to ensure that the target component in the target sound zone can act on the body part corresponding to the target user; the target sound zone is determined based on the first sound zone where the target component is located; ensuring that the target component in the target sound zone can accurately execute the voice control instructions of the target user.

[0015] In combination with the first aspect and the above implementations, in some implementations of the first aspect, the following further includes:

[0016] determining whether a target component exists in the first sound zone;

[0017] Based on the first pitch range, determine the target pitch range, including:

[0018] If the target component exists in the first sound zone, determining the first sound zone as the target sound zone;

[0019] If the target component does not exist in the first sound zone, a sound zone adjacent to the first sound zone is determined as the target sound zone.

[0020] In an embodiment of the present application, it is determined whether there is a target component in the first sound zone; that is, it is determined whether there is a target component in the sound zone where the target part of the target user is located; if there is a target component in the first sound zone, it means that there is a target component in the first sound zone that can act on the target part of the user; therefore, the first sound zone is determined as the target sound zone; if there is no target component in the first sound zone, the sound zone adjacent to the first sound zone is determined as the target sound zone; ensuring that when there is no target component in the first sound zone, the user's voice control command can be responded to to the greatest extent.

[0021] In combination with the first aspect and the foregoing implementations, in some implementations of the first aspect, determining the target vocal range based on the first vocal range includes:

[0022] If the first sound zone is at least two sound zones, and there are target components in at least two sound zones, the at least two sound zones are determined as target sound zones; or,

[0023] If the first sound zone is at least two sound zones, and there are target parts in at least two sound zones, determine the target distances between the target parts and the target parts in at least two sound zones; and determine the sound zone with the smallest target distance among the at least two sound zones as the target sound zone.

[0024] In an embodiment of the present application, if the first sound zone is at least two sound zones, and there are target parts in at least two sound zones, at least two sound zones can be used as target sound zones; or the sound zone in which the target part is closer to the target part in at least two sound zones can be determined as the target sound zone; ensuring that when the target part of the target user corresponds to two sound zones, the corresponding target sound zone can be determined.

[0025] In combination with the first aspect and the above implementations, in some implementations of the first aspect, the following further includes:

[0026] Get the position of each seat in the cabin;

[0027] The area inside the cabin is divided into multiple sound zones based on the position of each seat.

[0028] In an embodiment of the present application, the position of each seat in the vehicle cabin is obtained, and the area in the vehicle cabin is divided into a plurality of sound zones according to the position of each seat, thereby ensuring that the sound zone division of the vehicle cabin can be realized.

[0029] In combination with the first aspect and the above implementations, in some implementations of the first aspect, determining a target part of a target user corresponding to a target component includes:

[0030] If the target component is a window or an air conditioner of a vehicle, determining that the target part corresponding to the target component is the head of the target user;

[0031] If the target component is a seat of a vehicle, the target part corresponding to the target component is determined to be the waist or buttocks of the target user.

[0032] In the embodiments of the present application, since the window or air conditioner of a vehicle usually acts on the user's head, if the target component is the window or air conditioner of a vehicle, the target part corresponding to the target component is determined to be the head of the target user; and the seat of a vehicle usually acts on the user's waist or buttocks, if the target component is the seat of a vehicle, the target part is determined to be the waist or buttocks of the target user.

[0033] In combination with the first aspect and the above implementations, in some implementations of the first aspect, the following further includes:

[0034] If a change in the state information is detected, determining an updated target sound zone of the vehicle based on the changed state information and the target component;

[0035] The target component of the target sound zone is controlled to be turned off, and the target component of the updated target sound zone is controlled to be turned on to execute the voice control instruction.

[0036] In an embodiment of the present application, the position and posture of the user in the vehicle may change. If it is detected that the status information of the target user has changed, the target sound zone is updated based on the status information of the changed user and the target component; to ensure that the target sound zone is updated in time when the status information of the target user changes; control the target component of the target sound zone to be closed, and update the target component of the target sound zone to be opened; avoid the target component of the original target sound zone being in the open state, thereby reducing vehicle energy consumption.

[0037] In combination with the first aspect and the above implementations, in some implementations of the first aspect, controlling the target component in the target sound zone to execute the voice control instruction includes:

[0038] Based on the identity information of the target user, determine whether the target user has control authority over the target component;

[0039] If the target user has control authority over the target component, the target component in the target audio zone is controlled to execute the voice control instruction.

[0040] In an embodiment of the present application, based on the identity information of the target user, it is determined whether the target user has control authority over the target component; if the target user has control authority, the target component in the target sound zone is controlled to execute voice control instructions; the vehicle is prevented from responding to voice control instructions from users without control authority, thereby ensuring the safety of the vehicle.

[0041] In a second aspect, a vehicle control device is provided, the device comprising:

[0042] A first determination module is used to determine, if a voice control command of a target user is detected, a target component in the vehicle corresponding to the voice control command;

[0043] an acquisition module, configured to acquire state information of a target user in the vehicle cabin if the voice control instruction does not indicate a target position of the target component; wherein the state information includes a position of the target user in the vehicle cabin and a posture of the target user;

[0044] A second determination module is used to determine a target sound zone of the vehicle cabin based on the target component and the state information;

[0045] The control module is used to control the target component in the target sound zone to execute the voice control instruction.

[0046] In a third aspect, a vehicle is provided, comprising a memory and a processor, wherein the memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, so that the vehicle executes the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0047] In a fourth aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute the method in the first aspect or any possible implementation of the first aspect.

[0048] In a fifth aspect, a computer-readable storage medium is provided, which stores instructions. When the instructions are executed on a vehicle, the vehicle executes the method in the above-mentioned first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 This is a schematic diagram of a scenario provided by an embodiment of the present application;

[0050] Figure 2 This is another scenario schematic diagram provided by an embodiment of the present application;

[0051] Figure 3 is a schematic flow chart of a vehicle control method provided in an embodiment of the present application;

[0052] Figure 4 is a schematic flow chart of another vehicle control method provided in an embodiment of the present application;

[0053] Figure 5 is a structural schematic diagram of a vehicle control device provided in an embodiment of the present application;

[0054] Figure 6 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The technical solution in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0056] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.

[0057] In the prior art, microphones are installed in different areas of the vehicle to identify voice control commands when the user is in different areas of the vehicle, and the microphones collecting sound are associated with the seat areas in the vehicle.

[0058] However, since the position of the microphone in the vehicle is fixed, while the position and posture of the user in the vehicle may change, and the position of the seats in the cabin in the prior art can also be changed (for example, zero-gravity seats and seats using ultra-long-distance slide rail technology), the spatial layout in the cabin and the user's status are more flexible; therefore, if the sound zone for executing the voice control command is determined only based on the position of the microphone that receives the voice control command, it may lead to misunderstanding of the user's voice control command, thereby causing incorrect operation of the vehicle; therefore, how to accurately identify the sound zone corresponding to the user's voice control command and perform the correct operation is a technical problem that needs to be solved at present.

[0059] In view of this, the present application provides a vehicle control method, device and vehicle. Through the embodiments of the present application, the target sound zone in the vehicle cabin is determined according to the status information of the target component and the target user corresponding to the voice control command, and the target component in the target sound zone is controlled to execute the voice control command, ensuring that the sound zone corresponding to the user's voice control command can be accurately identified and the correct operation can be performed.

[0060] Figure 1 It is a schematic diagram of a scenario provided in an embodiment of the present application.

[0061] For example, Figure 1As shown in scene 100 in the figure, the sound zones in the vehicle cabin are divided according to the positions of the seats in the vehicle; different seats correspond to different sound zones; and different sound zones do not overlap.

[0062] As shown in (a) of the figure, there are four seats in the vehicle, namely, a driver's seat 101, a passenger seat 102, a rear left seat 103 and a rear right seat 104; according to the seats, the sound zones in the vehicle are divided into sound zones 111, 112, 113 and 114. Figure 1 As shown in (b) in the figure, wherein the sound zone 111 is the sound zone of the main driver's seat of the vehicle; the sound zone 112 is the sound zone of the co-driver's seat of the vehicle; the sound zone 113 is the sound zone of the left side of the rear row; and the sound zone 114 is the sound zone of the right side of the rear row.

[0063] For example, Figure 1 As shown, each sound zone in the cabin is equipped with a voice collection device (e.g., a microphone) for collecting the user's voice control instructions so that the vehicle can obtain and respond to the user's voice control instructions.

[0064] Exemplarily, when a user issues a voice control command, the voice collection device determines the sound zone where the user is located, and controls the components in the sound zone to execute the voice control command; for example, when the user issues a voice control command "open the vehicle's windows", the voice collection device determines the source position of the audio signal based on the audio signal of the voice control command, and controls the opening of the windows in the sound zone where the position is located; that is, the voice control command comes from the main driver's seat of the vehicle, and controls the opening of the main driver's seat window; the voice control command comes from the left rear area of ​​the vehicle, and controls the opening of the windows in the left rear area of ​​the vehicle.

[0065] It should be noted that the above division of the sound zones is for illustrative purposes only, and the present application does not limit the number of divided sound zones and the positions of the sound zones.

[0066] Figure 2 This is another scenario schematic diagram provided in an embodiment of the present application.

[0067] For example, Figure 2 The scene 200 shown is used to represent a scene when the status of the user in the vehicle changes.

[0068] For example, Figure 2 (a) The user is located in the passenger seat 102 of the vehicle, and the seat back of the passenger seat is in a reclining state; specifically, when the seat is not in a reclining state, such as Figure 2 As shown in (b) in FIG. 1 ; when the seat is in the reclining position, as shown in FIG. Figure 2 As shown in (c) in .

[0069] For example, Figure 2As shown in (b), the user is located in the front passenger seat 102. When the vehicle seat 102 is not in the reclining state, the user triggers a voice control command, such as "turn on the seat ventilation function". The distance d1 between the user and the microphone in the front passenger sound zone is less than the distance d2 between the user and the microphone in the rear right sound zone, that is, the user is closer to the front passenger sound zone; therefore, it is recognized that the user is in the front passenger sound zone 112, and the seat 102 in the front passenger sound zone is controlled to turn on the ventilation function.

[0070] For example, Figure 2 As shown in (c), the user is in the front passenger seat 102. When the front passenger seat 102 of the vehicle is in a reclining state, the user triggers a voice control command, such as "turn on the seat ventilation function". The user's real intention is to control the front passenger seat 102 located in the sound zone 112 to turn on the ventilation function; but since the distance d2 between the user and the microphone in the rear right sound zone 114 is less than the distance d1 between the user and the microphone in the rear right sound zone; that is, the user is closer to the rear right sound zone; if the user's posture is not recognized, but directly judged based on the distance between the user and the microphone, the seat 104 in the rear right area 114 will be controlled to turn on the ventilation function, resulting in a misjudgment of the intention of the user's voice control command, that is, the control operation does not meet the user's real intention.

[0071] Therefore, this solution obtains the user's status information; that is, obtains the user's position and status, and determines the target area of ​​the target component that executes the voice control instruction based on the target component corresponding to the voice control instruction and the user's status information; thereby ensuring that the user's voice control instruction can be accurately recognized and correctly executed.

[0072] Below Figure 3 and Figure 4 The vehicle control method provided in the embodiment of the present application is described in detail.

[0073] Figure 3 It is a schematic flow chart of a vehicle control method provided in an embodiment of the present application.

[0074] For example, Figure 3 The method 300 shown may be performed by a vehicle; or may be performed by a processor or chip in a vehicle.

[0075] like Figure 3 As shown, the vehicle control method 300 includes S310 to S340, and S310 to S340 are described in detail below.

[0076] S310: If a voice control command of a target user is detected, determine that the voice control command corresponds to a target component in the vehicle.

[0077] Among them, the target components in the vehicle refer to the equipment in the vehicle, and the target components can be controlled by voice control commands; the target components include but are not limited to seats, air conditioners, windows, display screens, etc. in the vehicle.

[0078] Exemplarily, the target component in the vehicle corresponding to the voice control command is used to represent the target component controlled by the voice control command; for example, if the voice control command is "turn on the vehicle seat ventilation", then the target component corresponding to the voice control command is the vehicle's seat; if a voice control command of the target user is detected; if the voice control command is "turn on the air conditioner", then the target component corresponding to the voice control command is the vehicle's air conditioner; if the voice control command is "close the windows", then the target component corresponding to the voice control command is the vehicle's windows.

[0079] It should be noted that the above is an example description of voice control instructions and target components in a vehicle, and this application does not impose any limitation on this.

[0080] For example, when the microphone in the vehicle collects the original voice signal of the voice control command, the vehicle performs pre-processing such as noise reduction, echo cancellation and sound enhancement on the collected original voice signal, thereby improving the voice quality and ensuring the accuracy of subsequent processing.

[0081] S320: If the voice control instruction does not indicate the target position of the target component, obtain the status information of the target user in the vehicle cabin.

[0082] The state information of the target user includes the position of the target user in the vehicle cabin and the posture of the target user.

[0083] Exemplarily, the position and posture of the target user in the vehicle can be obtained through a camera in the vehicle; or the position and posture of the target user can be obtained through an infrared thermal imaging device in the vehicle; wherein, infrared thermal imaging detects infrared specific band signals of thermal radiation of an object, converts the signals into visually distinguishable images and graphics, and can further calculate the temperature value of the object surface.

[0084] Optionally, the position, posture and number of users in the vehicle cabin can be identified through the vehicle's in-vehicle sensing system. The in-vehicle sensing system includes a driver monitoring system (DMS), an occupancy monitoring system (OMS) and three-dimensional depth sensing technology, such as time of flight (TOF) technology; the in-vehicle sensing system ensures that the position and status information of users in the vehicle cabin can be accurately monitored and identified.

[0085] For example, if the voice control instruction does not indicate the target position of the target component, the vehicle cannot determine the position of the target component in the vehicle that executes the voice control instruction; if there are multiple target components in the vehicle (for example, when the target component is a seat), the voice control instruction may be executed incorrectly; therefore, it is necessary to determine the target sound zone in the cabin based on the target component and the user's status information. For example, the voice control instruction is "turn on seat ventilation", because there are multiple seats in the vehicle; therefore, it is impossible to directly determine the seat to be controlled based on the voice control instruction; therefore, it is necessary to determine the specific position of the seat to be controlled based on the user's status information and the voice control instruction.

[0086] Optionally, if the voice control instruction indicates a target position of a target component, the target component at the target position is controlled to execute the voice control instruction. For example, if the voice control instruction is "control the ventilation function of the left rear seat to be turned on", the seat to be controlled can be directly determined according to the voice control instruction; therefore, the ventilation function of the left rear seat is controlled to be turned on.

[0087] S330, determining a target sound zone of the vehicle cabin based on the target component and the status information.

[0088] Exemplarily, before determining the target sound zone of the vehicle cabin, the position of each seat in the vehicle cabin is first obtained; based on the position of each seat, the area in the vehicle cabin is divided into multiple sound zones.

[0089] For example, each seat corresponds to a sound zone, and each sound zone does not overlap. Figure 1 As shown, when there are four seats in the vehicle, the area inside the vehicle is divided into four sound zones according to the positions of the seats; namely, a sound zone 111 for the driver's seat, a sound zone 112 for the co-driver's seat, a sound zone 113 for the left side of the rear row, and a sound zone 114 for the right side of the rear row.

[0090] It should be noted that when determining the target sound zone of the vehicle, the target sound zone is determined from the multiple divided sound zones.

[0091] The method for determining the target sound zone in the vehicle cabin is described in detail below.

[0092] In one implementation, determining the target sound zone of the vehicle cabin based on the target component and the state information includes:

[0093] Determine a target part of a target user corresponding to a target component; determine a first sound zone where the target part is located based on multiple sound zones and status information in the vehicle cabin; and determine a target sound zone based on the first sound zone.

[0094] For example, if the state information of the target user is different, the sound range corresponding to the body part of the target user is different; for example, if the state information of the target user is Figure 2As shown in (b) in FIG. 1 , the sound zones corresponding to the body parts of the target user are all the passenger seat sound zones 112; if the state information of the target user is as follows Figure 2 As shown in (c) in the figure, the sound zone corresponding to the target user's head and the target user's back is the rear right sound zone 114, and the sound zone corresponding to the target user's waist and the target user's buttocks is the front passenger seat sound zone 112.

[0095] For example, the target parts corresponding to the voice control instructions are different, and the determined body parts are different, that is, the target parts are different, and the sound ranges corresponding to different target parts are also different; for example, the user's status information is as follows: Figure 2 As shown in (c) in the figure, if the target component corresponding to the voice control command is the air conditioner, the corresponding target sound zone is the sound zone where the user's head is located, that is, the target sound zone is the sound zone 114 on the right side of the rear row; if the target component corresponding to the voice control command is the seat, the corresponding sound zone is the sound zone where the waist or buttocks of the target user are located, that is, the target sound zone is the sound zone 112 of the passenger seat.

[0096] In an embodiment of the present application, a target part of a target user corresponding to a target component is determined; that is, a body part of the target user corresponding to the target component is determined; a first sound zone where the target part is located is determined based on multiple sound zones in the cabin and status information of the target user; and a target sound zone is determined based on the first sound zone; since different target components act on different body parts of the user; therefore, in order to ensure that the target component in the target sound zone can act on the body part corresponding to the target user; the target sound zone is determined based on the first sound zone where the target component is located; ensuring that the target component in the target sound zone can accurately execute the voice control instructions of the target user.

[0097] In one implementation, if the target component is a vehicle window or air conditioner, the target part corresponding to the target component is determined to be the head of the target user; if the target component is a vehicle seat, the target part corresponding to the target component is determined to be the waist or buttocks of the target user.

[0098] Exemplarily, the target part corresponding to the target component is determined based on the part of the user's body that the target component acts on; since the window or air conditioner of a vehicle usually acts on the user's head, therefore, if the target component is the window or air conditioner of a vehicle, the target part corresponding to the target component is determined to be the head of the target user; and the seat of a vehicle usually acts on the user's waist or buttocks, therefore, if the target component is the seat of a vehicle, the target part is determined to be the waist or buttocks of the target user.

[0099] Exemplarily, the above is an explanation of determining a target part and a first sound zone corresponding to the target part. The following is a detailed explanation of an embodiment of determining a target sound zone of a vehicle based on the first sound zone.

[0100] In one implementation, determining whether a target component exists in a first sound zone;

[0101] The above-mentioned determining the target pitch range based on the first pitch range includes:

[0102] If the target component exists in the first sound zone, the first sound zone is determined as the target sound zone; if the target component does not exist in the first sound zone, a sound zone adjacent to the first sound zone is determined as the target sound zone.

[0103] Exemplarily, determine whether there is a target component in the first sound zone; that is, determine whether there is a target component in the sound zone where the target part of the target user is located; if there is a target component in the first sound zone, it means that there is a target component in the first sound zone that can act on the target part of the user, and therefore, the first sound zone is determined as the target sound zone; if there is no target component in the first sound zone, the sound zone adjacent to the first sound zone is determined as the target sound zone.

[0104] For example, when the voice control command is "turn on the air conditioner", the corresponding target component of the vehicle is the air conditioner of the vehicle; if the first sound zone where the target user's head is located is determined to be the sound zone 114 on the right side of the back row based on the target user's status information; if there is an air conditioner in the sound zone 114, the target sound zone is determined to be the sound zone 114; if there is no air conditioner in the sound zone 114, the adjacent sound zone of the sound zone 114 is determined as the target sound zone; for example, the adjacent sound zone 113 of the sound zone 114 is used as the target sound zone.

[0105] It should be noted that when there is no target component in the first zone and the adjacent zone of the first zone is determined as the target zone, it is necessary to ensure that the target component exists in the adjacent zone of the first zone; that is, when the first zone has multiple adjacent zones, the adjacent zone in which the target component exists among the multiple adjacent zones is determined as the target zone. For example, if the target component is an air conditioner, the first zone is zone 114, and there is no air conditioner in zone 114; Figure 1 As shown, the adjacent sound zones of the sound zone 114 include the front-to-back adjacent sound zone 112 and the left-to-right adjacent sound zone 113; if there is no air conditioner in the sound zone 112 and there is an air conditioner in the sound zone 113, 113 is determined as the target sound zone.

[0106] It should be noted that the above is an example description of the target component and the first sound zone, and the present application does not make any specific limitation on this.

[0107] In one implementation, the step of determining the target vocal range based on the first vocal range includes:

[0108] If the first sound zone is at least two sound zones, and there are target components in at least two sound zones, the at least two sound zones are determined as target sound zones; or,

[0109] If the first sound zone is at least two sound zones, and there are target parts in at least two sound zones, determine the target distances between the target parts and the target parts in at least two sound zones; and determine the sound zone with the smallest target distance among the at least two sound zones as the target sound zone.

[0110] For example, if the target user moves the seat, the target part of the target user is located at the boundary of the two sound zones, and there are target parts in both sound zones, and the target part of the user is located at the dotted line (such as Figure 1 As shown), both sound zones can be used as target sound zones; or the sound zone in which the target part and the target part are closer in the two sound zones can be used as the target sound zone.

[0111] For example, the voice control command is "open the car window", and the corresponding target part of the target user is the head; and the head of the target user is located at the dividing line between the sound zone 112 and the sound zone 114; then the sound zone 112 and the sound zone 114 can both be used as target sound zones; the target distance between the sound zone 112 and the head of the target user, and the target distance between the sound zone 114 and the head of the target user are determined respectively; and the sound zone with a closer distance is determined as the target sound zone.

[0112] Optionally, if the target user lies horizontally on the rear seat of the vehicle, and the target part of the user is located in two sound zones in the rear seat of the vehicle, both of the two sound zones in the rear seat of the vehicle are used as target sound zones.

[0113] It should be noted that the above is an example of voice control instructions and sound zones, and this application does not limit this.

[0114] In an embodiment of the present application, if the first sound zone corresponds to at least two sound zones, and there are target parts in at least two sound zones, at least two sound zones can be used as target sound zones; or the sound zone in which the target part is closer to the target part in at least two sound zones can be determined as the target sound zone; ensuring that when the target part of the target user corresponds to two sound zones, the corresponding target sound zone can be determined.

[0115] S340, controlling the target component in the target sound zone to execute the voice control instruction.

[0116] In one implementation, the above-mentioned controlling the target component in the target sound zone to execute the voice control instruction includes:

[0117] Based on the identity information of the target user, determine whether the target user has control authority over the target component;

[0118] If the target user has control authority over the target component, the target component in the target audio zone is controlled to execute the voice control instruction.

[0119] Exemplarily, facial information of users with control authority is pre-stored in the vehicle; when a voice control command of a target user is detected, the facial information of the target user is compared with the pre-stored facial information of the target user with control authority based on the collected image information; thereby determining whether the target user has control authority over the target component.

[0120] Optionally, if the identity information of the target user indicates that the target user who triggers the voice control instruction is a child, it is determined that the target user does not have control authority over the target component.

[0121] In an embodiment of the present application, based on the identity information of the target user, it is determined whether the target user has control authority over the target component; if the target user has control authority, the target component in the target sound zone is controlled to execute voice control instructions; the vehicle is prevented from responding to voice control instructions from users without control authority, thereby ensuring the safety of the vehicle.

[0122] In one implementation, the method further includes: if a change in the state information is detected, determining an updated target sound zone of the vehicle based on the changed state information and the target component;

[0123] The target component of the target sound zone is controlled to be turned off, and the target component of the updated target sound zone is controlled to be turned on to execute the voice control instruction.

[0124] Exemplarily, if it is detected that the state information of the target user has changed, the updated target sound zone of the vehicle is determined according to the changed state information and the target component; Figure 2 For example, the target user's status information is as follows Figure 2 As shown in (c) in FIG. 1 , when the voice control command controls the air conditioner to turn on, the air conditioner in the control audio zone 114 is turned on; when the state information of the target user is detected to have changed, the changed voice control command is as shown in FIG. Figure 2 As shown in (a) in FIG. 1 , the air conditioner in the sound zone 112 is controlled to be turned on, and the air conditioner in the sound zone 114 is controlled to be turned off.

[0125] It should be noted that the above is an example of voice control instructions and target sound ranges, and this application does not limit this.

[0126] In an embodiment of the present application, the position and posture of the user in the vehicle may change. If it is detected that the status information of the target user has changed, the target sound zone is updated based on the status information of the changed user and the target component; to ensure that the target sound zone is updated in time when the status information of the target user changes; control the target component of the target sound zone to be closed, and update the target component of the target sound zone to be turned on; avoid the target component of the original target sound zone being in the on state continuously, thereby reducing vehicle energy consumption.

[0127] In the above embodiment, if a voice control instruction of a target user is detected, a target component in the vehicle corresponding to the voice control instruction is obtained; if the voice control instruction does not indicate a target position of the target component, the state information of the target user is obtained; that is, when the voice control instruction does not specify the position of the target component, the state information of the target user is obtained; since the voice control instruction does not indicate the target position of the target component, the vehicle cannot directly determine the position of the target component that executes the voice control instruction in the vehicle; if there are multiple target components in the vehicle (for example, when the target component is a window), it may cause an error in the execution of the voice control instruction; therefore, it is necessary to determine the target sound zone in the cabin based on the state information of the target component and the target user, and determine the target component that executes the voice control instruction according to the target sound zone; since different positions or different postures of the target user will result in different target sound zones corresponding to the voice control instruction; therefore, the target sound zone of the cabin is determined according to the target component and the state information (including the position and posture of the user), to ensure that the sound zone corresponding to the user's voice control instruction can be accurately identified; thereby ensuring that the target component in the target sound zone can accurately execute the voice control instruction.

[0128] Figure 4 It is a schematic flow chart of another vehicle control method provided in an embodiment of the present application.

[0129] For example, Figure 4 The illustrated method 400 may be performed by a vehicle; or may be performed by a processor or chip in a vehicle.

[0130] like Figure 4 As shown, the vehicle control method 400 includes S401 to S412, and S401 to S412 are described in detail below.

[0131] S401: If a voice control instruction of a target user is detected, the voice control instruction is recognized.

[0132] Optionally, the implementation of S401 can refer to Figure 3 The relevant description of S310 is not repeated here.

[0133] S402, determining that the voice control command corresponds to a target component in the vehicle.

[0134] Exemplarily, by recognizing the voice control command, it is determined that the voice control command corresponds to a target component in the vehicle.

[0135] For example, when the microphone in the vehicle collects the original voice signal of the voice control command, the vehicle performs pre-processing such as noise reduction, echo cancellation and sound enhancement on the collected original voice signal; the pre-processed voice data will be transmitted to the voice recognition engine. This engine usually converts the voice signal into text based on a deep learning model; the command converted into text also needs to undergo a natural language processing (NLP) stage for semantic analysis to determine the intention of the voice control command and the corresponding target component.

[0136] S403, determining whether the voice control instruction indicates a target position of a target component; if not, executing S404.

[0137] Exemplarily, it is determined whether the voice control instruction indicates the target position of the target component; if the voice control instruction does not indicate the target position of the target component, the status information of the target user in the vehicle cabin is obtained.

[0138] Optionally, if the voice control instruction indicates a target position of a target component, the target component at the target position is controlled to execute the voice control instruction.

[0139] For example, if the voice control command is "open the vehicle's window", the voice control command does not indicate the position of the window to be opened; therefore, it is necessary to determine the target sound zone based on the position and posture of the target user, and control the window in the target sound zone to open; if the voice control command is "open the left rear window", the voice control command has indicated the target position of the target component; therefore, the target component at the target position is controlled to execute the voice control command, that is, to control the window in the left rear sound zone of the vehicle to open.

[0140] It should be noted that the above is an example of voice control instructions, and this application does not limit this.

[0141] S404, obtaining status information of the target user in the vehicle cabin.

[0142] Exemplarily, the status information of the target user in the vehicle cabin includes the position of the target user and the posture of the target user.

[0143] Exemplarily, the position and posture of the target user in the vehicle can be obtained through a camera in the vehicle; or the position and posture of the target user can be obtained through an infrared thermal imaging device in the vehicle; this application is not limited to this.

[0144] S405: Determine the target part of the target user corresponding to the target component.

[0145] Exemplarily, the target part of the target user corresponding to the target component is determined; that is, the body part of the user on which the target component acts is determined, and based on the body part of the user on which the target component acts, the target part corresponding to the target component is determined.

[0146] For example, a vehicle's window or air conditioner usually acts on the user's head; therefore, if the target component is a vehicle's window or air conditioner, the target part corresponding to the target component is determined to be the target user's head; and a vehicle's seat usually acts on the user's waist or buttocks, therefore, if the target component is a vehicle's seat, the target part is determined to be the target user's waist or buttocks.

[0147] S406, determining the first sound zone where the target part is located.

[0148] Exemplarily, a first sound zone where the target part is located is determined according to the state information of the target user and a plurality of sound zones in the vehicle cabin.

[0149] Among them, the multiple sound zones in the cabin are divided according to the positions of seats in the cabin; and each of the multiple sound zones is provided with a microphone, which is biased towards collecting voice control commands of users in different sound zones.

[0150] S407, determine whether there is a target component in the first sound zone; if so, execute S408; if not, execute S409.

[0151] Exemplarily, it is determined whether there is a target component in the first sound zone; if there is a target component in the first sound zone, the first sound zone is determined as the target sound zone; if there is no target component in the first sound zone, a sound zone adjacent to the first sound zone is determined as the target sound zone.

[0152] S408: Determine the first tone range as the target tone range.

[0153] Exemplarily, if there is a target component in the first sound zone, it means that the target component in the first sound zone can act on a target part of the user; therefore, the first sound zone is determined as the target sound zone.

[0154] S409: determine a sound zone adjacent to the first sound zone as a target sound zone.

[0155] Exemplarily, if there is no target component in the first sound zone, the component in the first sound zone cannot respond to and execute the voice control instruction; therefore, the adjacent sound zone of the first sound zone is determined as the target sound zone.

[0156] S410: If the target user has control authority, the target component of the target audio zone is controlled to execute the voice control instruction.

[0157] Exemplarily, after determining the target audio zone, if it is detected that the target user has control authority, the target component of the target audio zone is controlled to execute the voice control instruction; wherein the control authority is the control authority over the target component.

[0158] S411: If a change in the state information is detected, an updated target sound zone of the vehicle is determined.

[0159] Exemplarily, an image acquisition device (eg, a camera) in a vehicle acquires status information of a target user in real time; if a change in the status information of the target user is detected, an updated target sound zone of the vehicle is determined based on the changed status information.

[0160] S412, controlling the target component of the target sound zone to be turned off, and controlling the target component of the target sound zone to be updated to execute the voice control instruction.

[0161] Exemplarily, the target component of the target sound zone before the state information is changed is controlled to be turned off, and the target component of the updated target sound zone after the state is changed is controlled to execute the voice control instruction.

[0162] Optionally, the implementation of S411 and S412 can refer to Figure 3 The relevant description of S340 is not repeated here.

[0163] In an embodiment of the present application, if a voice control instruction of a target user is detected, the voice control instruction is identified and the target component corresponding to the voice control instruction is determined; when the voice control instruction does not indicate the target position of the target component, the target sound zone is determined according to the state information of the target user and the target component; because the voice control instruction does not indicate the target position of the target component, the vehicle cannot determine the position of the target component that executes the voice control instruction in the vehicle; if there are multiple target components in the vehicle, it may cause an error in the execution of the voice control instruction; therefore, according to the state information of the target component and the target user, the target sound zone where the target component is located is determined; and the target component in the target sound zone is controlled to execute the voice control instruction; it is ensured that the sound zone corresponding to the user's voice control instruction can be accurately identified; thereby ensuring that the target component in the target sound zone can accurately execute the voice control instruction. In addition, when it is detected that the state information of the target user has changed, the control strategy of the target component is adjusted in time according to the changed state information, thereby improving the user experience.

[0164] Combination of the above Figures 1 to 4 The vehicle control method provided by the embodiment of the present application is described in detail; Figure 5 and Figure 6 The device embodiments of the present application are described in detail. It should be understood that the device in the embodiments of the present application can execute the various methods of the aforementioned embodiments of the present application, that is, the specific working processes of the following various products can refer to the corresponding processes in the aforementioned method embodiments.

[0165] Figure 5 It is a structural schematic diagram of a vehicle control device provided in an embodiment of the present application.

[0166] For example, Figure 5 As shown, the vehicle control device 500 includes:

[0167] A first determination module 510 is used to determine, if a voice control command of a target user is detected, a target component in the vehicle corresponding to the voice control command;

[0168] The acquisition module 520 is used to acquire the state information of the target user in the vehicle cabin if the voice control instruction does not indicate the target position of the target component; wherein the state information includes the position of the target user in the vehicle cabin and the posture of the target user;

[0169] A second determination module 530 is used to determine a target sound zone of the vehicle cabin based on the target component and the state information;

[0170] The control module 540 is used to control the target component in the target sound zone to execute the voice control instruction.

[0171] Optionally, as an embodiment, the second determination module 530 is specifically used to: determine the target part of the target user corresponding to the target component; determine the first sound zone where the target part is located based on multiple sound zones and status information in the cabin; and determine the target sound zone based on the first sound zone.

[0172] Optionally, as an embodiment, the second determination module 530 is specifically used to: determine whether there is a target component in the first sound zone; if there is a target component in the first sound zone, determine the first sound zone as the target sound zone; if there is no target component in the first sound zone, determine a sound zone adjacent to the first sound zone as the target sound zone.

[0173] Optionally, as an embodiment, the second determining module 530 is specifically configured to: if the first sound zone corresponds to at least two sound zones, and there are target components in at least two sound zones, determine the at least two sound zones as target sound zones; or,

[0174] If the first sound zone is at least two sound zones, and there are target parts in at least two sound zones, determine the target distances between the target parts and the target parts in at least two sound zones; and determine the sound zone with the smallest target distance among the at least two sound zones as the target sound zone.

[0175] Optionally, as an embodiment, the acquisition module 520 is further used to: acquire the position of each seat in the vehicle cabin; and divide the area in the vehicle cabin into a plurality of sound zones based on the position of each seat.

[0176] Optionally, as an embodiment, the second determination module 530 is specifically used to: if the target component is a window or air conditioner of a vehicle, determine that the target part corresponding to the target component is the head of the target user; if the target component is a seat of a vehicle, determine that the target part corresponding to the target component is the waist or buttocks of the target user.

[0177] Optionally, as an embodiment, the second determination module 530 is further configured to: if a change in the state information is detected, determine an updated target sound zone of the vehicle based on the changed state information and the target component;

[0178] The control module 540 is further used to control the target component of the target sound zone to be turned off, and control the target component of the updated target sound zone to be turned on, so as to execute the voice control instruction.

[0179] Optionally, as an embodiment, the control module 540 is specifically used to: determine whether the target user has control authority over the target component based on the identity information of the target user; if the target user has control authority over the target component, control the target component to execute the voice control instruction.

[0180] It should be noted that the control device of the vehicle is embodied in the form of a functional unit. The term "module" here can be implemented in the form of software and / or hardware, and is not specifically limited to this.

[0181] For example, a "module" may be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor, etc.) and a memory for executing one or more software or firmware programs, a combined logic circuit, and / or other suitable components that support the described functions.

[0182] Therefore, the units of each example described in the embodiments of the present application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0183] Figure 6 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application.

[0184] Exemplarily, vehicle 600 includes: a processor 610 , a memory 620 , and executable program code 630 .

[0185] Exemplarily, the vehicle 600 includes one or more processors 610, which can support the vehicle 600 to implement the vehicle control method in the method embodiment. The processor 610 can be a general-purpose processor or a special-purpose processor. For example, the processor 610 can be a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, such as discrete gates, transistor logic devices, or discrete hardware components.

[0186] Exemplarily, the processor 610 may be used to control the vehicle 600, execute software programs, and process data of the software programs. The vehicle 600 may also include a communication unit to implement input (reception) and output (transmission) of signals.

[0187] Exemplarily, the vehicle 600 may include one or more memories 620 on which executable program code 630 is stored. The executable program code 630 can be executed by the processor 610 to generate instructions so that the processor 610 executes the vehicle control method described in the above method embodiment according to the instructions.

[0188] Optionally, data may be stored in the memory 620. Optionally, the processor 610 may read data stored in the memory 620, which may be stored at the same storage address as the executable program code 630, or may be stored at a different storage address from the executable program code 630.

[0189] Exemplarily, the processor 610 and the memory 620 may be provided separately or integrated together, for example, integrated on a system on chip (SOC) of the terminal device.

[0190] Exemplarily, the memory 620 can be used to store relevant programs of the vehicle control method provided in the embodiment of the present application, and the processor 620 can be used to call the executable program code 630 stored in the memory 620 when controlling the vehicle to execute the vehicle control method of the embodiment of the present application; for example, if a voice control command of the target user is detected, determine that the voice control command corresponds to a target component in the vehicle; if the voice control command does not indicate the target position of the target component, obtain the status information of the target user in the cabin; wherein the status information includes the position of the target user in the cabin and the posture of the target user; based on the target component and the status information, determine the target sound zone of the cabin; control the target component in the target sound zone to execute the voice control command.

[0191] The present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the vehicle control method of any of the aforementioned embodiments.

[0192] Among them, computer-readable storage media may include but are not limited to any type of disk, including floppy disks, optical disks, digital versatile disks (Digital Video Disc, DVD), compact disc read-only memory (Compact Disc Read-Only Memory, CD-ROM), microdrives and magneto-optical disks, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory, EPROM), electrically erasable programmable read only memory (Electrically Erasable Programmable read only memory, EEPROM), dynamic random access memory (Dynamic Random Access Memory, DRAM), video random access memory (Video Random Access Memory, VRAM), flash memory devices, magnetic cards or optical cards, nanosystems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and / or data.

[0193] The present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement a vehicle control method in the above-mentioned embodiment.

[0194] In addition, the electronic device provided in the embodiments of the present application may specifically be a chip, a component or a module, and the electronic device may include a connected processor and a memory; wherein the memory is used to store instructions, and when the electronic device is running, the processor may call and execute instructions so that the chip executes a vehicle control method in the above-mentioned embodiments.

[0195] Among them, the electronic device, computer-readable storage medium, computer program product or chip provided in this application are all used to execute the corresponding vehicle control method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding vehicle control method provided above, and will not be repeated here.

[0196] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0197] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0198] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A vehicle control method, characterized in that: The method comprises: If a voice control command of the target user is detected, determining that the voice control command corresponds to a target component in the vehicle; If the voice control instruction does not indicate the target position of the target component, obtaining the state information of the target user in the vehicle cabin; wherein the state information includes the position of the target user in the vehicle cabin and the posture of the target user; determining a target sound zone of the vehicle cabin based on the target component and the status information; The target component in the target sound zone is controlled to execute the voice control instruction.

2. The method according to claim 1, characterized in that The determining a target sound zone of the vehicle cabin based on the target component and the state information includes: Determine the target part of the target user corresponding to the target component; Determining a first sound zone where the target part is located based on the multiple sound zones in the vehicle cabin and the state information; Based on the first sound range, the target sound range is determined.

3. The method according to claim 2, characterized in that Also includes: Determining whether the target component exists in the first sound zone; The determining the target sound range based on the first sound range includes: If the target component exists in the first sound zone, determining the first sound zone as the target sound zone; If the target component does not exist in the first sound zone, a sound zone adjacent to the first sound zone is determined as the target sound zone.

4. The method according to claim 2, characterized in that: The determining the target sound range based on the first sound range includes: If the first sound zone is at least two sound zones, and the target component exists in at least two of the sound zones, the at least two sound zones are determined as the target sound zones; or, If the first sound zone is at least two sound zones, and the target component exists in at least two of the sound zones, determine the target distance between the target component and the target part in at least two of the sound zones; and determine the sound zone with the smallest target distance among the at least two sound zones as the target sound zone.

5. The method according to claim 1, characterized in that Also includes: Obtaining the position of each seat in the vehicle cabin; Based on the positions of the seats, the area within the vehicle cabin is divided into a plurality of sound zones.

6. The method according to claim 2, characterized in that The determining the target part of the target user corresponding to the target component includes: If the target component is a window or an air conditioner of the vehicle, determining that the target part corresponding to the target component is the head of the target user; If the target component is a seat of the vehicle, the target part corresponding to the target component is determined to be the waist or buttocks of the target user.

7. The method according to any one of claims 1 to 6, characterized in that Also includes: If a change in the state information is detected, determining an updated target sound zone of the vehicle based on the changed state information and the target component; The target component of the target sound zone is controlled to be turned off, and the target component of the updated target sound zone is controlled to be turned on, so as to execute the voice control instruction.

8. The method according to any one of claims 1 to 6, characterized in that The controlling the target component in the target sound zone to execute the voice control instruction comprises: Based on the identity information of the target user, determining whether the target user has control authority over the target component; If the target user has control authority over the target component, the target component in the target sound zone is controlled to execute the voice control instruction.

9. A vehicle control device, characterized in that: The device comprises: A first determination module is used to determine, if a voice control command of a target user is detected, that the voice control command corresponds to a target component in the vehicle; an acquisition module, configured to acquire status information of the target user in the vehicle cabin if the voice control instruction does not indicate the target position of the target component; wherein the status information includes the position of the target user in the vehicle cabin and the posture of the target user; A second determination module, configured to determine a target sound zone of the vehicle cabin based on the target component and the state information; A control module is used to control the target component in the target sound zone to execute the voice control instruction.

10. A vehicle, characterized in that: The vehicle comprises: A memory for storing executable program codes; A processor is used to call and run the executable program code from the memory so that the vehicle executes the method as claimed in any one of claims 1 to 8.

Images