Vehicle control method and device, vehicle and storage medium

Abstract

The invention provides a vehicle control method and device, a vehicle and a storage medium, the method is applied to the field of vehicles, and the method comprises the steps that the adjusting angle of a seat in the vehicle is detected; if the adjustment angle is greater than a preset angle threshold value, determining to turn off a recognition function of a first pickup device in an initial voice recognition system of the vehicle, and performing signal enhancement processing on an audio signal collected by a second pickup device to obtain a target voice recognition system; if the first voice instruction is detected, obtaining a target voice area of the first voice instruction based on the first voice instruction and a target voice recognition system; and controlling a target component in the target sound area to execute the control instruction. According to the method, the voice control service can be accurately provided for the user by accurately positioning the position when the user sends the voice instruction, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of vehicles, and more specifically, to a vehicle control method, device, vehicle and storage medium in the field of vehicle control technology. Background Art

[0002] With the rapid development of vehicle control technology, voice technology is being used more and more widely in vehicles. Many models are equipped with multi-zone voice recognition systems, which usually cover all seating areas in the vehicle, allowing passengers to control various functions of the vehicle through voice commands.

[0003] However, in some cases, existing voice recognition systems may misidentify the user's location, resulting in incorrect operations being performed, affecting the user experience.

[0004] Therefore, when a user's voice command is detected in a vehicle, how to accurately provide voice control services to the user and improve the user experience is a problem that needs to be solved at present. Summary of the invention

[0005] The present application provides a vehicle control method, device, vehicle and storage medium. The method can accurately provide voice control services to users by accurately locating the position of the user when issuing voice commands, thereby improving user experience.

[0006] In a first aspect, a vehicle control method is provided, the method comprising:

[0007] Detecting the adjustment angle of a seat in a vehicle; if the adjustment angle is greater than a preset angle threshold, determining to turn off the recognition function of the first sound pickup device in the initial voice recognition system of the vehicle, and performing signal enhancement processing on the audio signal collected by the second sound pickup device to obtain a target voice recognition system; wherein the first sound pickup device is a sound pickup device in an area adjacent to an area where the seat is located in an adjustment direction corresponding to the adjustment angle; the second sound pickup device is a sound pickup device in an area where the seat is located; if a first voice instruction is detected, obtaining a target sound zone of the first voice instruction based on the first voice instruction and the target voice recognition system; wherein the first voice instruction is used to represent a control instruction of a target component in the vehicle; controlling the target component in the target sound zone to execute the control instruction.

[0008] In an embodiment of the present application, by detecting the adjustment angle of a seat in a vehicle, if it is detected that the adjustment angle of the seat is greater than a preset angle threshold, the recognition function of the sound pickup device adjacent to the sound pickup device in the sound zone where the target seat is located in the direction of the seat adjustment angle is turned off, and the signal enhancement processing is performed on the sound pickup device in the sound zone where the seat is located to obtain an adjusted voice recognition system; based on the adjusted voice recognition system, the user's voice command is detected, and the sound zone where the user issues the voice command is determined through positioning recognition; based on the determined sound zone, the components in the vehicle are controlled to perform operations; in the above scheme, when the adjustment angle of the seat is greater than the preset angle threshold, since the sound pickup device in the direction of the adjustment angle and the sound zone where the seat is located are turned off The recognition function of the pickup device adjacent to the pickup device in the sound zone can avoid the problem of mistakenly locating the voice command to the sound zone of the adjacent seat behind the seat when the seat reclines at a large angle; since the signal enhancement processing is performed on the pickup device in the sound zone where the seat is located, the interference caused by the audio signal components in other directions is weakened, and at the same time, the problem of the signal strength of the voice command being attenuated due to the large reclining angle of the seat and the distance between the sound source and the pickup device in the sound zone where the seat is located, so that the pickup device in the sound zone where the seat is located cannot detect the audio signal of the voice command is avoided; therefore, the accuracy of voice command positioning can be improved, thereby providing users with accurate voice control services and improving user experience.

[0009] In combination with the first aspect, in some possible implementations, the present invention further includes:

[0010] Detect whether there is a user on the seat; if the adjustment angle is greater than a preset angle threshold, determine to turn off the recognition function of the first sound pickup device in the initial voice recognition system of the vehicle, and perform signal enhancement processing on the audio signal collected by the second sound pickup device, including: if it is detected that there is a user on the seat and the adjustment angle is greater than a preset angle threshold, determine to turn off the recognition function of the first sound pickup device, and perform signal enhancement processing on the audio signal collected by the second sound pickup device.

[0011] In an embodiment of the present application, when it is detected that there is a user on the seat and the adjustment angle of the seat is greater than a preset angle threshold, the voice recognition system is adjusted to obtain an adjusted voice recognition system. Since the adjustment process turns off the recognition function of the sound pickup device adjacent to the sound pickup device in the sound zone where the seat is located in the direction of the seat adjustment angle, and performs signal enhancement processing on the sound pickup device in the sound zone where the seat is located, the problem of misrecognition of voice commands can be avoided. For example, when the user sits on the seat and adjusts the reclining angle of the seat to a larger value, the voice recognition system mistakenly locates the user's position to the seat behind the seat where the user is sitting when recognizing the voice command issued by the user. Through the above scheme, the accuracy of voice command positioning can be improved, thereby providing users with accurate voice control services and improving user experience.

[0012] In combination with the first aspect and the above implementations, in some possible implementations, detecting whether there is a user on the seat includes:

[0013] Obtain the value of the pressure sensor of each seat in the vehicle; determine whether there is a user in the seat based on the value of the pressure sensor; or obtain the cabin image of the vehicle; determine whether there is a user in the seat based on the cabin image.

[0014] In an embodiment of the present application, in one implementation, by acquiring the values ​​of the pressure sensors in each seat, when the pressure sensors detect the pressure distribution or change in the seat, it is possible to determine which seats have users based on these values, thereby determining the way to adjust the voice recognition system, and achieving accurate recognition and positioning of voice commands. In another implementation, by acquiring the cabin image in the vehicle, it is determined based on the image recognition algorithm which seats have users, thereby determining the way to adjust the voice recognition system, and achieving accurate recognition and positioning of voice commands.

[0015] In combination with the first aspect and the above implementation manner, in some possible implementation manners, performing signal enhancement processing on the audio signal collected by the second sound pickup device includes:

[0016] Signal enhancement processing is performed on the audio signal component from the target direction in the audio signal collected by the second sound pickup device; wherein the target direction is obtained based on the time information and phase information of the collected audio signal.

[0017] In an embodiment of the present application, the direction from which the user issues the voice command is determined by collecting time information and phase information of the audio signal, and signal enhancement processing is performed on the audio signal component at that direction of the audio signal collected by the second sound pickup device. Due to the signal enhancement, the interference generated by the audio signal components in other directions is weakened, and more accurate identification and positioning can be achieved, thus avoiding the problem that the user who issues the voice command is far away from the sound pickup device in the sound zone where his seat is located, resulting in unrecognizable audio.

[0018] In combination with the first aspect and the above implementations, in some possible implementations, detecting the adjustment angle of a seat in a vehicle includes:

[0019] Acquire a seat image of the vehicle; and determine an adjustment angle of the seat based on the seat image.

[0020] In an embodiment of the present application, by acquiring image information in the cockpit and determining the adjustment angle of the seat based on the image information, the voice recognition system can be adjusted to avoid the situation where the seat adjustment angle is too large and the user's position is mistakenly identified as an incorrect seat position, thereby improving the accuracy of voice command positioning.

[0021] In combination with the first aspect and the above implementations, in some possible implementations, the present invention further includes:

[0022] If the adjustment angle is less than or equal to the preset angle threshold, when the second voice command is detected, the target sound zone of the second voice command is determined based on the second voice command and the initial voice recognition system.

[0023] In the embodiment of the present application, if the seat adjustment angle is less than or equal to the preset angle threshold, the voice command is recognized based on the initial voice recognition system, that is, the audio signals collected by all the sound pickup devices in the cockpit are obtained, and the target sound zone is determined based on the audio signals collected by all the sound pickup devices. Therefore, it is ensured that when the user's seat adjustment angle is restored to less than the preset angle threshold, the voice recognition system can accurately identify and locate the voice command.

[0024] In combination with the first aspect and the above implementations, in some possible implementations, the present invention further includes:

[0025] Obtaining an area within the vehicle and / or a size of a seat within the vehicle; and determining a preset angle threshold based on the area within the vehicle and / or a size of a seat within the vehicle.

[0026] In the embodiment of the present application, the area of ​​the vehicle and / or the size of the seats in the vehicle are obtained, wherein the preset angle threshold is positively correlated with the area of ​​the cabin; that is, the larger the area of ​​the vehicle, the larger the preset angle. Therefore, it is possible to optimize the configuration for different vehicle types and cabin layouts, ensuring that voice recognition can be performed in a suitable manner in various in-vehicle environments.

[0027] In a second aspect, a vehicle control device is provided, comprising:

[0028] An acquisition module, for detecting an adjustment angle of a seat in a vehicle;

[0029] A processing module is used to determine to turn off the recognition function of the first sound pickup device in the initial voice recognition system of the vehicle if the adjustment angle is greater than a preset angle threshold, and to perform signal enhancement processing on the audio signal collected by the second sound pickup device to obtain a target voice recognition system; wherein the first sound pickup device is a sound pickup device corresponding to an adjacent area to the area where the seat is located in the adjustment direction corresponding to the adjustment angle; the second sound pickup device is a sound pickup device in the area where the seat is located; if a first voice instruction is detected, a target sound zone of the first voice instruction is obtained based on the first voice instruction and the target voice recognition system; wherein the first voice instruction is used to represent a control instruction of a target component in the vehicle; and the target component in the target sound zone is controlled to execute the control instruction.

[0030] It should be understood that the expansion, limitation, explanation and description of the relevant contents in the above-mentioned first aspect also apply to the same contents in the second aspect.

[0031] In a third aspect, a vehicle is provided, comprising:

[0032] A memory for storing executable program codes;

[0033] A processor is used to call and run executable program code from a memory, so that the computer executes the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0034] In a fourth aspect, a computer-readable storage medium is provided, which stores a computer program code. When the computer program code runs on a computer, the computer executes the method in the above-mentioned first aspect or any possible implementation manner of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 is a schematic diagram of a four-tone zone vehicle provided in an embodiment of the present application;

[0036] Figure 2 is a schematic diagram of a scene of a vehicle seat at different tilt angles provided by an embodiment of the present application;

[0037] Figure 3 is a schematic diagram of a six-tone zone vehicle provided in an embodiment of the present application;

[0038] Figure 4 is a schematic flow chart of a vehicle control method provided in an embodiment of the present application;

[0039] Figure 5 is a schematic diagram of a four-tone zone vehicle control method provided in an embodiment of the present application;

[0040] Figure 6 is a schematic diagram of a six-tone zone vehicle control method provided in an embodiment of the present application;

[0041] Figure 7 is a schematic flow chart of another vehicle control method provided in an embodiment of the present application;

[0042] Figure 8 is a schematic flow chart of another vehicle control method provided in an embodiment of the present application;

[0043] Fig. 9 is a structural schematic diagram of a vehicle control device provided in an embodiment of the present application;

[0044] Fig.10 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION

[0045] The technical solution in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0046] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.

[0047] Combine the following Figures 1 to 3 The schematic diagram of the application scenario of this solution is described with examples.

[0048] Figure 1 It is a schematic diagram of a four-tone zone vehicle provided in an embodiment of the present application.

[0049] For example, Figure 1 The vehicle 100 includes seats 101, 102, 103 and 104; wherein seat 101 is the main driving seat, seat 102 is the co-pilot seat, seat 103 is the second row left seat, and seat 104 is the second row right seat; the sound zones in the vehicle can be divided according to the areas where the seats are located; for example, the preset range where each seat is located can correspond to a sound zone respectively; for example, Figure 1 As shown in (b), seat 101 corresponds to sound zone 105, seat 102 corresponds to sound zone 106, seat 103 corresponds to sound zone 107, and seat 104 corresponds to sound zone 108; among them, sound zone 105 is the left front sound zone, sound zone 106 is the right front sound zone, sound zone 107 is the left rear sound zone, and sound zone 108 is the right rear sound zone.

[0050] Each sound zone is provided with a sound pickup device; seats 101 and 102 are front seats of the four-sound zone vehicle 100, and the angles of their backrests can usually be adjusted.

[0051] It should be noted that, in the embodiments of the present application, the adjustment angle of the seat refers to the reclining angle of the seat back.

[0052] Figure 2 It is a schematic diagram of scenes of a vehicle seat at different tilt angles provided in an embodiment of the present application.

[0053] For example, Figure 2The scene 200 in FIG. 1 includes a seat 102 and a seat 104. A user sits on the seat 102. The adjustment angle of the seat 102 is small. Figure 2 As shown in (a) of FIG. 1 , the user's head is relatively close to the sound pickup device in the sound zone 106. At this time, the scene in the cockpit is as follows: Figure 1 As shown in (a) in FIG. 1 , when a user issues a voice command that only includes the control of a target component but does not include a clear position, the position where the voice command is issued is located in the sound zone 106 through voice recognition, and the components in the sound zone 106 are controlled; for example, when a user issues a voice command of "turn on seat heating", the position where the voice command is issued is located in the sound zone 106 through voice recognition, and the seat 102 in the sound zone 106 is controlled to perform the seat heating function; the user sits on the seat 102, and the adjustment angle of the seat 102 is large, as shown in FIG. Figure 2 As shown in (b) in FIG. 1 , the user's head is closer to the sound pickup device in the sound zone 108 than to the sound pickup device in the sound zone 106. At this time, the seat scene in the cockpit is as follows: Figure 2 As shown in (c) in the figure, in this case, the user actually wants to control the current seat 102 to perform some functions. When issuing a voice command, the existing voice recognition technology does not take into account that the user's position when issuing the voice command is affected by the user's riding posture. It will recognize the user's position when issuing the voice command as in the sound zone 108, and mistakenly judge that the user is on the seat 104, thereby performing an erroneous operation.

[0054] It should be understood that the above combination Figure 1 and Figure 2 Taking a vehicle with four sound zones as an example, the solution of the present application can also be applied to a vehicle with six sound zones, such as Figure 3 shown.

[0055] Figure 3 It is a schematic diagram of a six-tone zone vehicle provided in an embodiment of the present application.

[0056] For example, Figure 3 The vehicle 300 in the middle six-sound zone includes seat 301, seat 302, seat 303, seat 304, seat 305 and seat 306; wherein seat 301 is the main driving seat, seat 302 is the co-pilot seat, seat 303 is the left seat of the second row, seat 304 is the right seat of the second row, seat 305 is the left seat of the third row, and seat 306 is the right seat of the second row; the sound zones in the vehicle can be divided according to the areas where the seats are located; for example, the preset range where each seat is located can correspond to a sound zone respectively; for example, Figure 3As shown in (b), seat 301 corresponds to sound zone 307, seat 302 corresponds to sound zone 308, seat 303 corresponds to sound zone 309, seat 304 corresponds to sound zone 310, seat 305 corresponds to sound zone 311, and seat 306 corresponds to sound zone 312; among them, sound zone 307 is the left front sound zone, sound zone 308 is the right front sound zone, sound zone 309 is the left middle sound zone, sound zone 310 is the right middle sound zone, 311 is the left rear sound zone, and 312 is the right rear sound zone.

[0057] Among them, a sound pickup device is configured in each sound zone; seat 301, seat 302, seat 303 and seat 304 are the front and middle row seats of the six-zone vehicle 300, and users can usually adjust their backrest angles.

[0058] For example, in a six-tone zone vehicle, when a user sits in seat 304, the backrest angle can be adjusted. In this case, when the seat backrest is adjusted at a larger angle, the above-mentioned Figure 2 In the case of (b), the seat scene in the cockpit is as follows Figure 2 As shown in (d) in the figure, when the user issues a voice command, the prior art will mistakenly identify the user's current seat 304 as seat 306, resulting in erroneous execution of operations on seat 306, affecting the user's riding experience.

[0059] In view of this, an embodiment of the present application provides a vehicle control method. Through the embodiment of the present application, by detecting the adjustment angle of the seat in the vehicle, if it is detected that the adjustment angle of the seat is greater than a preset angle threshold, the recognition function of the sound pickup device adjacent to the sound pickup device in the sound zone where the target seat is located in the direction of the seat adjustment angle is turned off, and the audio signal collected by the sound pickup device in the sound zone where the seat is located is subjected to signal enhancement processing to obtain an adjusted voice recognition system; based on the adjusted voice recognition system, the user's voice command is detected, and the sound zone where the user issues the voice command is determined through positioning recognition; based on the determined sound zone, the components in the vehicle are controlled to perform operations; in the above scheme, when the adjustment angle of the seat is greater than the preset angle threshold, the adjustment angle is turned off due to the closure of the sound pickup device. The recognition function of the sound pickup device adjacent to the sound pickup device in the sound zone where the seat is located in the direction can avoid the problem of mistakenly locating the voice command to the sound zone where the adjacent seat behind the seat is located when the seat reclines at a large angle; since the audio signal collected by the sound pickup device in the sound zone where the seat is located is enhanced, the interference caused by the audio signal components in other directions is weakened, and at the same time, the problem of the signal strength of the voice command being attenuated due to the large reclining angle of the seat and the distance between the sound source and the sound pickup device in the sound zone where the seat is located, so that the sound pickup device in the sound zone where the seat is located cannot detect the audio signal of the voice command is avoided; therefore, the accuracy of voice command positioning can be improved, thereby providing users with accurate voice control services and improving user experience.

[0060] Combine the following Figures 4 to 7 A vehicle control method provided in an embodiment of the present application is described in detail.

[0061] Figure 4 is a schematic flow chart of a vehicle control method provided in an embodiment of the present application. Figure 4 As shown, the method 400 includes S410 to S440, and S410 to S440 are described in detail below.

[0062] For example, Figure 4 The vehicle control 400 shown may be executed by the vehicle; or, executed by a processor in the vehicle; or, executed by a chip mounted in the processor of the vehicle.

[0063] S410: Detecting an adjustment angle of a seat in the vehicle.

[0064] In one implementation, the method includes:

[0065] Acquire a seat image of the vehicle; and determine an adjustment angle of the seat based on the seat image.

[0066] The image information refers to images of various seat positions in the cockpit. If there are drivers and passengers in the cockpit, the image information includes the drivers and passengers.

[0067] In one possible implementation, the vehicle is equipped with an occupant monitoring system (OMS), and image information in the cockpit is obtained through an image acquisition device in the cockpit. The image acquisition device may be the vehicle's OMS camera, so that the purpose of acquiring images inside the vehicle can be achieved without adding other hardware to the vehicle. In the absence of an OMS, the image acquisition device may also be other cameras in the vehicle. For example, the image acquisition device is a camera disposed above the central control screen, or a camera disposed at another location, which is not limited in the embodiments of the present application. The number of the image acquisition devices is one or more, as long as it can cover multiple seats in the cockpit.

[0068] It should be noted that the collection of image information requires the user's permission and authorization. Only after the user's permission and authorization can the image information in the cockpit be obtained.

[0069] Exemplarily, OMS is used to acquire image information in the cockpit, and a deep learning algorithm is used to identify the adjustment angle of the seat. First, the acquired image information is preprocessed, and the preprocessed image information is input into a pre-trained deep learning model. The model calculates the adjustment angle of the seat by identifying features such as the contour and edges of the seat. In an embodiment of the present application, the adjustment angle of the seat refers to the angle at which the seat back is adjusted backward.

[0070] Optionally, if there is a user sitting in the seat, the image of the seat area is captured by the camera in the cabin, and the key points and contours of the human body are analyzed using a deep learning algorithm based on the user's head, shoulders, torso and other features to identify the posture of the person in the car and determine the seat adjustment angle based on the overlapping area between the key points of the human body and the seat position.

[0071] Optionally, if a passenger moves or adjusts his or her posture in the vehicle, the passenger's position and posture are updated through continuous image analysis to allow for more accurate voice command recognition and execution.

[0072] In the above scheme, by acquiring image information in the cockpit and determining the seat adjustment angle based on the image information, the voice recognition system can be adjusted to avoid the situation where the seat adjustment angle is too large and the user's position is mistakenly identified as an incorrect seat position, thereby improving the accuracy of voice command positioning.

[0073] In one implementation, the method further includes:

[0074] Obtaining an area within the vehicle and / or a size of a seat within the vehicle; and determining a preset angle threshold based on the area within the vehicle and / or a size of a seat within the vehicle.

[0075] Among them, the preset angle threshold is related to the maximum adjustable angle of the seat, for example, the preset angle threshold is set to 70% of the maximum adjustable angle of the seat; wherein the maximum adjustable angle of the seat is related to the area of ​​the cabin and / or the size of the seat in the cabin; for example, the maximum adjustable angle of the seat is positively correlated with the area of ​​the cabin, that is, the larger the area of ​​the cabin, the larger the maximum adjustable angle of the seat; wherein the area of ​​the cabin includes the space between the front row and the rear row and the height from the roof to the floor, etc.; wherein the size of the seat in the cabin refers to the specific size of the seat in the cabin, including the length, width, depth of the seat, and the height of the backrest, etc.

[0076] Exemplarily, a preset angle threshold is set in the vehicle according to the area of ​​the cabin and / or the size of the seats in the cabin; and the user can personalize the preset angle threshold.

[0077] Therefore, according to the area of ​​the cabin and / or the size of the seats in the cabin, the preset angle threshold is determined so that the vehicle can adapt to different vehicle configurations and ensure that the setting of the seat adjustment angle is reasonable and effective. Users can adjust the threshold according to their personal preferences to obtain a riding experience that is more in line with their own habits, which improves the accuracy of the system and avoids misjudgment and misoperation.

[0078] In the above solution, the area of ​​the vehicle and / or the size of the seats in the vehicle are obtained, wherein the preset angle threshold is positively correlated with the area of ​​the cabin; that is, the larger the area of ​​the vehicle, the larger the preset angle. Therefore, it is possible to optimize the configuration for different vehicle types and cabin layouts, ensuring that voice recognition can be performed in a suitable manner in various in-vehicle environments.

[0079] S420: If the adjustment angle is greater than a preset angle threshold, determine to turn off the recognition function of the first sound pickup device in the initial voice recognition system of the vehicle, and perform signal enhancement processing on the audio signal collected by the second sound pickup device to obtain a target voice recognition system.

[0080] Among them, the first sound pickup device is a sound pickup device in an area adjacent to the area where the seat is located in the adjustment direction corresponding to the adjustment angle; the second sound pickup device is a sound pickup device in the area where the seat is located.

[0081] In an embodiment of the present application, if it is detected that the adjustment angle of the seat is greater than a preset angle threshold, the recognition and positioning function of the sound pickup device in the area adjacent to the area where the seat is located in the adjustment direction corresponding to the seat adjustment angle is turned off, and the audio signal collected by the sound pickup device in the area where the seat is located is enhanced to obtain an adjusted target speech recognition system.

[0082] For example, for Figure 5 The four-tone zone vehicle 100 shown in the figure detects that the adjustment angles of all seats in the vehicle do not exceed the preset angle threshold. At this time, the voice recognition system is an initial voice recognition system, such as Figure 5 As shown in (c) in the figure, the sound pickup device in each sound zone performs the voice recognition positioning function normally; if it is detected that the adjustment angle of the seat 102 in the vehicle exceeds the preset angle threshold, the sound pickup device corresponding to the sound zone behind the seat 102 is turned off, and the signal of the sound pickup device in the area where the seat 102 is located is enhanced. At this time, the voice recognition system is the target voice recognition system, such as Figure 5 As shown in (d) in .

[0083] Similarly, for Figure 6 The six-tone zone vehicle 300 shown in the figure detects that the adjustment angles of all seats in the vehicle do not exceed the preset angle threshold. At this time, the voice recognition system is an initial voice recognition system, such as Figure 6 As shown in (c) in the figure, the sound pickup device in each sound zone performs the voice recognition positioning function normally; if it is detected that the adjustment angle of the seat 304 in the vehicle exceeds the preset angle threshold, the sound pickup device corresponding to the sound zone behind the seat 304 is turned off, and the signal of the sound pickup device in the area where the seat 304 is located is enhanced. At this time, the voice recognition system is the target voice recognition system, such as Figure 6 As shown in (d) in .

[0084] In one implementation, the method further includes:

[0085] Detect whether there is a user on the seat; if the adjustment angle is greater than a preset angle threshold, determine to turn off the recognition function of the first sound pickup device in the initial voice recognition system of the vehicle, and perform signal enhancement processing on the audio signal collected by the second sound pickup device, including: if it is detected that there is a user on the seat and the adjustment angle is greater than a preset angle threshold, determine to turn off the recognition function of the first sound pickup device, and perform signal enhancement processing on the audio signal collected by the second sound pickup device.

[0086] In an embodiment of the present application, it is detected whether there is a user on a seat in a vehicle. If it is detected that a user is on the seat and the adjustment angle of the seat is greater than a preset angle threshold, the recognition and positioning function of the sound pickup device in the area adjacent to the area where the seat is located in the adjustment direction corresponding to the seat adjustment angle is turned off, and audio enhancement processing is performed on the audio signal collected by the sound pickup device in the area where the seat is located to obtain an adjusted target speech recognition system.

[0087] It should be understood that when the adjustment angle of the seat is greater than the preset angle threshold, if the user is on the seat, the user's posture is close to lying flat, and the head is closer to the sound pickup device adjacent to the sound pickup device in the target area in the direction of the seat's adjustment angle. Since the user's head is closer to the sound pickup device adjacent to the sound pickup device in the area where the seat is located in the direction of the full angle, a voice command is issued at this time. Since the sound emission position is far from the sound pickup device in the seat area, the amplitude of the audio signal of the user's voice command obtained by the sound pickup device is low, resulting in the voice recognition system locating the sound source in the right rear sound area when the user issues a voice command on the seat, and then performing an erroneous operation. Therefore, in order to avoid the above-mentioned problem in this solution, by judging whether the adjustment angle is greater than the preset angle threshold and adjusting the voice recognition system, the user's position when the voice command is issued can be accurately located, thereby accurately providing the user with voice control services and improving the user experience.

[0088] In one implementation, the method includes:

[0089] Obtain the value of the pressure sensor of each seat in the vehicle; determine whether there is a user in the seat based on the value of the pressure sensor; or obtain the cabin image of the vehicle; determine whether there is a user in the seat based on the cabin image.

[0090] Implementation method 1:

[0091] In an embodiment of the present application, the values ​​of the pressure sensors configured in each seat in the vehicle are obtained, and whether there is a user on the seat is determined based on the size and distribution of the values.

[0092] Exemplarily, the pressure value is detected by the distributed pressure sensor arranged at the seat cushion, and the presence of a user is determined by comparing the sensor data of each seat; for example, Figure 1 The four-zone vehicle 100 shown obtains the values ​​of the various pressure sensors arranged at the seat cushions and backrests in seat 101, seat 102, seat 103 and seat 104; for example, the value of the pressure sensors arranged at the seat cushions in seat 101, seat 103 and seat 104 is 0, and the value of the pressure sensor arranged at the seat cushion in seat 102 is 50N, then it can be determined that there is a user on seat 102.

[0093] In the above scheme, by obtaining the values ​​of the pressure sensors in each seat, when the pressure sensors detect the pressure distribution or changes in the seats, it is possible to determine which seats have users based on these values, thereby determining how to adjust the voice recognition system and achieving accurate recognition and positioning of voice commands.

[0094] Implementation method 2:

[0095] In an embodiment of the present application, a cockpit image of a vehicle is acquired, and by acquiring the cockpit image of the vehicle, it is determined whether there is a user in the seat based on an image recognition algorithm.

[0096] Exemplarily, by acquiring images captured by a camera in the cockpit, a deep learning algorithm is used to analyze key points and contours of the human body based on features such as the user's head, shoulders, and torso to identify whether there is a user in the seat.

[0097] In the above scheme, by acquiring the cockpit image in the vehicle and determining which seats have users based on the image recognition algorithm, the method for adjusting the voice recognition system is determined to achieve accurate recognition and positioning of voice commands.

[0098] In one implementation, the method further includes:

[0099] Signal enhancement processing is performed on the audio signal component from the target direction in the audio signal collected by the second sound pickup device; wherein the target direction is obtained based on the time information and phase information of the collected audio signal.

[0100] Among them, the second sound pickup device is a sound pickup device in the area where the seat is located with an adjustment angle greater than a preset angle threshold; the target direction includes sound source positioning (Direction of Arrival, DOA) information, which is used to indicate the direction from which the user issues a voice command; wherein the time information of the audio signal refers to the time when the audio signal arrives at the target sound pickup device; the phase information refers to the phase of the audio signal when it arrives at the sound pickup device.

[0101] Exemplarily, a fixed beamforming algorithm is used to perform weighted summation on the collected audio signals to form a beam from the target direction, thereby achieving the effect of enhancing the amplitude of the original audio signal; or an adaptive beamforming algorithm is used to adapt to the changing sound source position and noise environment, and enhance the audio signal based on the changing sound source position and noise environment.

[0102] In the above scheme, the direction from which the user issues the voice command is determined by using the time information and phase information of the collected audio signal, and the audio signal component of the audio signal collected by the second sound pickup device at that direction is subjected to signal enhancement processing. Due to the signal enhancement, the interference generated by the audio signal components in other directions is weakened, and more accurate identification and positioning can be achieved, thus avoiding the problem that the user who issues the voice command is far away from the sound pickup device in the sound zone where his seat is located, resulting in the user being unable to be identified.

[0103] S430: If a first voice instruction is detected, a target sound range of the first voice instruction is obtained based on the first voice instruction and a target voice recognition system.

[0104] Among them, the first voice command is a voice command issued by the user, which is used to control the target component in the vehicle; for example, the first voice command can be used to control the seats in the vehicle; such as seat heating, seat ventilation and seat massage, etc., and can also be used to control the windows, air conditioning, etc. in the vehicle; for example, adjust the opening degree of the windows, the wind speed of the air conditioner and the wind direction of the air conditioner, etc.

[0105] Exemplarily, when the adjustment angle of the seat in the vehicle is less than a preset angle threshold, for the initial speech recognition system, when performing speech recognition positioning, the initial target direction is determined by detecting the signal amplitude of the voice command issued by the user, the time of arrival at each sound pickup device, and the phase difference. Based on the preliminary target direction information, the initial speech recognition system calculates the confidence for each sound zone. The calculation of the confidence is affected by factors such as signal amplitude, signal arrival time, and noise. For example, the larger the signal amplitude, the closer the sound source is to the sound pickup device in the sound zone, and the higher the confidence. The initial speech recognition system calculates based on the confidence of each sound zone to determine the sound zone. For the target speech recognition system, when performing speech recognition positioning, the preliminary target direction is determined by detecting the signal amplitude of the voice command issued by the user, the time when it arrives at each sound pickup device, and the phase difference. The target speech recognition system enhances the audio signal components from the target direction collected by the sound pickup device in the sound zone where the seat with a large adjustment angle is located, calculates the confidence based on the enhanced signal, and thus determines the sound zone; wherein the enhancement processing includes using beamforming technology to enhance the amplitude of the signal components in the target direction, while filtering out interference in other directions.

[0106] Optionally, the target speech recognition system may determine the sound zone corresponding to the sound pickup device having the largest signal strength of the audio signal collected as the target sound zone by comparing the signal strengths of the audio signals collected by the sound pickup devices in each sound zone.

[0107] In another implementation, the method further includes:

[0108] If the adjustment angle is less than or equal to the preset angle threshold, when the second voice command is detected, the target sound zone of the second voice command is determined based on the second voice command and the initial voice recognition system.

[0109] Among them, the second voice command is a voice command issued by the user, which is used to control the target component in the vehicle; for example, the second voice command can be used to control the seats in the vehicle; such as seat heating, seat ventilation and seat massage, etc., and can also be used to control the windows, air conditioning, etc. in the vehicle; for example, adjust the opening degree of the windows, the wind speed of the air conditioner and the wind direction of the air conditioner, etc.

[0110] For example, Figure 1 As shown in (b) of FIG. 1 , in a four-zone vehicle 100, the sound zones in the cabin are divided into: zone 105, zone 106, zone 107, and zone 108. If it is detected that the user adjusts the seat 102 to an angle less than or equal to a preset angle threshold, such as Figure 2 As shown in (a), when the voice command is recognized and located, the audio signals collected by the sound pickup devices in all sound zones in the cockpit, i.e., sound zones 105, 106, 107 and 108, are processed.

[0111] It should be understood that when voice recognition is performed using the audio signals collected by the sound pickup devices in each sound zone, since the adjustment angle of the seat 102 is less than or equal to the preset angle threshold, it means that the user is in a relatively upright or normal sitting position. At this time, the sound source position of the user's voice command is closest to the sound pickup device in the sound zone 106. The signal strength of the audio signal collected by the sound pickup device in the sound zone 106 is stronger than the signal strength collected by other sound pickup devices and will not be mistakenly identified and located in other sound zones. Therefore, when the seat adjustment angle is less than or equal to the preset angle threshold, the audio signals collected by all the sound pickup devices in the cockpit are collected to effectively integrate the information of the audio source and enhance clarity and accuracy.

[0112] S440: Control the target component in the target sound zone based on the voice command.

[0113] The target components refer to the main driver's seat, the co-driver's seat, the seats in the second row left and second row right areas, the windows and the air conditioner, etc.; wherein the voice command can control the seat heating, seat ventilation, seat massage, air conditioning volume adjustment, air conditioning opening and closing, and window opening and closing, etc. in the corresponding sound zone. Exemplarily, the voice command issued by the user is collected, and noise filtering, signal enhancement and other processing are performed to improve the audio quality, and the feature value of the processed audio signal is extracted to extract the key parameters that can represent the voice characteristics; for example, Mel frequency cepstral coefficients, etc.; these feature values ​​are input into the pre-trained model for model training, and different voice patterns can be learned and recognized. Finally, through pattern matching, the voice features of the input user's voice command are matched with the known patterns in the model, and finally the voice recognition results are output, and the target components in the target sound zone are controlled according to the voice recognition results.

[0114] In one embodiment of the present application, the voice command is converted into text using Automatic Speech Recognition (ASR) technology, including preprocessing the voice command and inputting the processed audio features into the acoustic model and the language model, which are decoded and post-processed and output in the form of a text stream; specifically, the preprocessing includes: sampling and quantization, the audio signal is sampled and quantized into a digital signal after being collected by a pickup device; noise elimination, reducing environmental noise through noise suppression technology; and feature extraction, extracting features from the audio signal, such as Mel-frequency cepstral coefficients, filter group energy, spectrogram, etc.

[0115] In one implementation, the voice command issued by the user may be a voice command that includes the type and location of the target component; for example, the voice command is "Please heat the front passenger seat." In this case, there is no need to use voice recognition to locate the sound zone where the user issued the voice command to control the heating component in the front passenger seat for heating.

[0116] Through the above scheme, by detecting the adjustment angle of the seat in the vehicle, if it is detected that the adjustment angle of the seat is greater than the preset angle threshold, the recognition function of the sound pickup device adjacent to the sound pickup device in the sound zone where the target seat is located in the direction of the seat adjustment angle is turned off, and the audio signal collected by the sound pickup device in the sound zone where the seat is located is subjected to signal enhancement processing to obtain an adjusted voice recognition system; based on the adjusted voice recognition system, the user's voice command is detected, and the sound zone where the user issues the voice command is determined through positioning recognition; based on the determined sound zone, the components in the vehicle are controlled to perform operations; in the above scheme, when the adjustment angle of the seat is greater than the preset angle threshold, since the sound pickup device in the direction of the adjustment angle and the sound zone where the seat is located are turned off The recognition function of the adjacent sound pickup device of the sound pickup device can avoid the problem of mistakenly locating the voice command to the sound zone of the adjacent seat behind the seat when the seat reclines at a large angle; since the audio signal collected by the sound pickup device in the sound zone where the seat is located is enhanced, the interference caused by the audio signal components in other directions is weakened. At the same time, it avoids the problem that the signal strength of the voice command is attenuated due to the large reclining angle of the seat and the distance between the sound source and the sound pickup device in the sound zone where the seat is located, so that the sound pickup device in the sound zone where the seat is located cannot detect the audio signal of the voice command; therefore, the accuracy of voice command positioning can be improved, thereby providing users with accurate voice control services and improving user experience.

[0117] Combine the following Figure 7 Another vehicle control method provided in an embodiment of the present application is illustrated by way of example.

[0118] Figure 7 FIG. 1 is a schematic flow chart of a specific application of a vehicle control method provided in an embodiment of the present application. Figure 7 As shown, the method 700 includes S710 to S780, and S710 to S780 are described in detail below.

[0119] S710: Detect the adjustment angle of the seat in the vehicle.

[0120] Optionally, the implementation of S710 can refer to Figure 4 The relevant description in S410 is not repeated here.

[0121] S720: Obtain the area of ​​the cabin and the size of the seats in the cabin, and determine a preset angle threshold according to the area of ​​the cabin and the size of the seats in the cabin.

[0122] Exemplarily, the configuration data of the vehicle, such as the area of ​​the cabin and the size of each seat, are read, and based on this information, a preset angle threshold for determining the adjustment range of the seat is calculated.

[0123] Optionally, the implementation of S720 can refer to Figure 4The relevant description in S410 is not repeated here.

[0124] S730, determine whether the seat adjustment angle is greater than a preset angle threshold; if so, execute S740 to S760; if not, execute S770.

[0125] In an embodiment of the present application, if the adjustment angle of the seat is greater than the preset angle threshold, it means that the user's posture is close to lying flat, and the head is closer to the sound pickup device adjacent to the sound pickup device in the area where the seat is located in the direction of the seat adjustment angle. At this time, it is easy to be disturbed by it. Therefore, S740 is executed; that is, the recognition function of the first sound pickup device in the initial voice recognition system is turned off; if the adjustment angle of the seat is less than or equal to the preset angle threshold, it means that the user is in a relatively upright or normal sitting posture. When issuing a voice command, it is usually not misrecognized and mistriggered by the sound pickup device adjacent to the sound pickup device in the area where the seat is located in the direction of the seat adjustment angle. At this time, by collecting the audio signals collected by all the sound pickup devices in the cockpit, S770 is executed, that is, the voice command is recognized and located based on the initial voice recognition system.

[0126] S740: Turn off the recognition function of the first sound pickup device in the initial voice system.

[0127] The first sound pickup device refers to a sound pickup device that is adjacent to the sound pickup device in the area where the seat is located in the direction of the adjustment angle of the seat.

[0128] Optionally, the implementation of S740 can refer to Figure 4 The relevant description of the implementation method in S420 is not repeated here.

[0129] S750: Perform signal enhancement processing on the audio signal collected by the second sound pickup device.

[0130] The second sound pickup device refers to the sound pickup device in the area where the seat is located.

[0131] Optionally, the implementation of S750 can refer to Figure 4 The relevant description of the implementation method in S420 is not repeated here.

[0132] S760: Based on the adjusted target speech recognition system, the speech instruction is recognized and located to obtain a target sound area.

[0133] The adjusted target speech recognition system refers to a speech recognition system after the first sound pickup device in the initial speech recognition system is turned off and the audio signal collected by the second sound pickup device is subjected to signal enhancement processing.

[0134] Optionally, the implementation of S760 can refer to Figure 4The relevant description of the implementation method in S430 is omitted here.

[0135] S770: Based on the initial speech recognition system, the speech instruction is recognized and located to obtain a target sound area.

[0136] Optionally, the implementation of S770 can refer to Figure 4 The relevant description of the implementation method in S430 is omitted here.

[0137] S780: Control the target component in the target sound zone based on the voice command.

[0138] Among them, the target components refer to the main driver's seat, the co-pilot seat, the seats in the left and right areas of the second row, the windows, the air conditioners and other components; among them, the voice commands can control the seat heating, seat ventilation, seat massage, air conditioning volume adjustment, air conditioning opening and closing, and window opening and closing in the corresponding sound zones.

[0139] Optionally, the implementation of S780 can refer to Figure 4 The relevant description of the implementation method in S440 is omitted here.

[0140] In an embodiment of the present application, by detecting the adjustment angle of a seat in a vehicle, if it is detected that the adjustment angle of the seat is greater than a preset angle threshold, the recognition function of the sound pickup device adjacent to the sound pickup device in the sound zone where the target seat is located in the direction of the seat adjustment angle is turned off, and the signal enhancement processing is performed on the sound pickup device in the sound zone where the seat is located to obtain an adjusted voice recognition system; based on the adjusted voice recognition system, the user's voice command is detected, and the sound zone where the user issues the voice command is determined through positioning recognition; based on the determined sound zone, the components in the vehicle are controlled to perform operations; in the above scheme, when the adjustment angle of the seat is greater than the preset angle threshold, since the sound pickup device in the direction of the adjustment angle and the sound zone where the seat is located are turned off The recognition function of the adjacent sound pickup devices in the sound zone can avoid the problem of erroneously locating the voice command to the sound zone of the adjacent seat behind the seat when the seat reclines at a large angle; since the signal enhancement processing is performed on the sound pickup device in the sound zone where the seat is located, the interference caused by the audio signal components in other directions is weakened. At the same time, it avoids the problem that the signal strength of the voice command is attenuated due to the large reclining angle of the seat and the distance between the sound source and the sound pickup device in the sound zone where the seat is located, so that the sound pickup device in the sound zone where the seat is located cannot detect the audio signal of the voice command; therefore, the accuracy of voice command positioning can be improved, thereby providing users with accurate voice control services and improving user experience. The following is combined with Figure 8 The vehicle control method provided in the embodiment of the present application is illustrated by taking the case where the user is located in the front passenger seat of a four-tone zone vehicle and the voice command is a control command for seat heating.

[0141] Figure 8 FIG. 1 is a schematic flow chart of another vehicle control method provided in an embodiment of the present application. Figure 8 As shown, method 800 includes S801 to S807, and S801 to S807 are described in detail below.

[0142] S801: Detect that the vehicle is powered on.

[0143] Exemplarily, when a user presses the vehicle's start button or turns the key to start the engine, the vehicle's power system is turned on, and the vehicle detects this change in power-on state, thereby triggering subsequent initialization and the start of related functions.

[0144] S802: Detect that there is a user in the front passenger seat.

[0145] Optionally, the implementation of S802 can refer to Figure 4 The relevant description in S420 is not repeated here.

[0146] S803, determine whether the passenger seat adjustment angle is greater than a preset angle threshold; if so, execute S804; if not, re-execute S803 after a preset time interval.

[0147] In an embodiment of the present application, it is determined whether the adjustment angle of the front passenger seat is greater than a preset angle threshold. If so, S804 is executed; that is, the initial speech recognition system is adjusted to obtain a target speech recognition system; if it is less than or equal to the preset angle threshold, S803 is re-executed after a preset time, that is, the adjustment angle of the seat is re-detected after a preset time.

[0148] S804, turning off the voice recognition function of the sound pickup device corresponding to the area behind the co-pilot seat in the initial voice recognition system, and performing enhancement processing on the audio signal collected by the sound pickup device corresponding to the area behind the co-pilot seat to obtain an adjusted target voice recognition system.

[0149] Optionally, the implementation of S804 can refer to Figure 4 The relevant description in S420 is not repeated here.

[0150] S805: Determine a target sound zone based on the target speech recognition system and the detected voice command.

[0151] Optionally, the implementation of S805 can refer to Figure 4 The relevant description in S430 is omitted here.

[0152] S806: Recognize the voice command and determine that the target component is the front passenger seat and the control information is to turn on the seat heating function.

[0153] Exemplarily, voice commands issued by the user are collected, converted into digital signals, and feature vectors are extracted. The feature vectors are input into a pre-trained ASR model, and the target component is determined to be a seat, and the control information is seat heating. Combined with the target sound area being the right front sound area where the co-pilot is located, the target component is determined to be the co-pilot seat.

[0154] S807. Control the front passenger seat to turn on the seat heating function.

[0155] Exemplarily, the vehicle's seats are equipped with heating elements, which are embedded in the seat cushions and seat backs and are heated by resistance wires or heating pads. After determining that the target component is the front passenger seat and the control information is to turn on the seat heating function, the seat heating instruction is sent to the electronic unit used to control the seat through the vehicle's controller area network bus (CAN), and after receiving the instruction, the electronic unit turns on the heating element of the front passenger seat.

[0156] Optionally, the above scheme is illustrated by the example of detecting that there is someone in the front passenger seat, and the present application can detect each seat in the vehicle without limitation; the above scheme is illustrated by the example of seat heating as a voice command, and the voice commands of the present application can also be seat massage, air conditioning air volume adjustment, air conditioning opening and closing, and window opening and closing, etc.

[0157] In the embodiment of the present application, the seat adjustment angle and the voice recognition system in the vehicle are combined to achieve accurate response to the user's voice commands. When it is detected that the seat adjustment angle is large, the initial voice recognition system is adjusted, the voice recognition function of the sound pickup device corresponding to the rear area of ​​the co-pilot seat in the initial voice recognition system is turned off, and the audio signal collected by the sound pickup device corresponding to the co-pilot seat area is enhanced to obtain an adjusted target voice recognition system. Based on the adjusted target voice recognition system, the voice commands issued by the user are recognized, so as to more accurately determine the target sound area and execute the corresponding control commands to turn on the seat heating function. This method reduces the possibility of misoperation, improves the accuracy of voice recognition, and improves user experience.

[0158] Combination of the above Figures 1 to 8 A vehicle control method provided by an embodiment of the present application is described in detail; Fig. 9 and Fig.10 The device embodiments of the present application are described in detail. It should be understood that the device in the embodiments of the present application can execute the various methods of the aforementioned embodiments of the present application, that is, the specific working processes of the following various products can refer to the corresponding processes in the aforementioned method embodiments.

[0159] Fig. 99 is a schematic diagram of the structure of a vehicle control device provided in an embodiment of the present application. The device 900 includes a detection module 910 and a processing module 920 .

[0160] Among them, the detection module 910 is used to detect the adjustment angle of the seat in the vehicle; the processing module 920 is used to determine to turn off the recognition function of the first sound pickup device in the initial voice recognition system of the vehicle if the adjustment angle is greater than a preset angle threshold, and to perform signal enhancement processing on the audio signal collected by the second sound pickup device to obtain a target voice recognition system; wherein the first sound pickup device is a sound pickup device in an area adjacent to the area where the seat is located in the adjustment direction corresponding to the adjustment angle; the second sound pickup device is a sound pickup device in the area where the seat is located; if a first voice instruction is detected, based on the first voice instruction and the target voice recognition system, a target sound zone of the first voice instruction is obtained; wherein the first voice instruction is used to represent a control instruction of a target component in the vehicle; and the target component in the target sound zone is controlled to execute the control instruction.

[0161] Optionally, as an embodiment, the processing module 920 is specifically configured to:

[0162] Detect whether there is a user on the seat; if the adjustment angle is greater than a preset angle threshold, determine to turn off the recognition function of the first sound pickup device in the initial voice recognition system of the vehicle, and perform signal enhancement processing on the audio signal collected by the second sound pickup device, including: if it is detected that there is a user on the seat and the adjustment angle is greater than a preset angle threshold, determine to turn off the recognition function of the first sound pickup device, and perform signal enhancement processing on the audio signal collected by the second sound pickup device.

[0163] Optionally, as an embodiment, the processing module 920 is further configured to:

[0164] Obtain the value of the pressure sensor of each seat in the vehicle; determine whether there is a user in the seat based on the value of the pressure sensor; or obtain the cabin image of the vehicle; determine whether there is a user in the seat based on the cabin image.

[0165] Optionally, as an embodiment, the processing module 920 is specifically configured to:

[0166] Signal enhancement processing is performed on the audio signal component from the target direction in the audio signal collected by the second sound pickup device; wherein the target direction is obtained based on the time information and phase information of the collected audio signal.

[0167] Optionally, as an embodiment, the processing module 920 is specifically configured to:

[0168] Acquire a seat image of the vehicle; and determine an adjustment angle of the seat based on the seat image.

[0169] Optionally, as an embodiment, the processing module 920 is further configured to:

[0170] If the adjustment angle is less than or equal to the preset angle threshold, when the second voice command is detected, the target sound zone of the second voice command is determined based on the second voice command and the initial voice recognition system.

[0171] Optionally, as an embodiment, the processing module 920 is further configured to:

[0172] Obtaining an area within the vehicle and / or a size of a seat within the vehicle; and determining a preset angle threshold based on the area within the vehicle and / or a size of a seat within the vehicle.

[0173] It should be noted that the vehicle control device 900 is implemented in the form of a functional unit. The term "module" here can be implemented in the form of software and / or hardware, and is not specifically limited to this.

[0174] For example, a "module" may be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application-specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor, etc.) and a memory for executing one or more software or firmware programs, a combined logic circuit, and / or other suitable components that support the described functions.

[0175] Therefore, the units of each example described in the embodiments of the present application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0176] Fig.10 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application.

[0177] Exemplarily, vehicle 1000 includes: a processor 1010 , a memory 1020 , and an executable program code 1030 .

[0178] Exemplarily, the vehicle 1000 includes one or more processors 1010, which can support the vehicle 1000 to implement the vehicle generation method in the method embodiment. The processor 1010 can be a general-purpose processor or a special-purpose processor. For example, the processor 1010 can be a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit, a field programmable gate array (FPGA), or other programmable logic devices, such as discrete gates, transistor logic devices, or discrete hardware components.

[0179] Exemplarily, the processor 1010 may be used to control the vehicle 1000, execute software programs, and process data of the software programs. The vehicle 1000 may also include a communication unit to implement input (reception) and output (transmission) of signals.

[0180] Exemplarily, the vehicle 1000 may include one or more memories 1020 on which executable program code 1030 is stored. The executable program code 1030 can be executed by the processor 1010 to generate instructions, so that the processor 1010 executes the generation method described in the above method embodiment according to the instructions.

[0181] Optionally, data may be stored in the memory 1020. Optionally, the processor 1010 may read data stored in the memory 1020, which may be stored at the same storage address as the executable program code 1030, or may be stored at a different storage address from the executable program code 1030.

[0182] Exemplarily, the processor 1010 and the memory 1020 may be provided separately or integrated together, for example, integrated on a system on chip (System On Chip, SOC) of the terminal device.

[0183] Exemplarily, the memory 1020 can be used to store relevant programs of the vehicle generation method provided in the embodiment of the present application, and the processor 1020 can be used to call the executable program code 1030 stored in the memory 1020 when controlling the vehicle to execute the vehicle control method of the embodiment of the present application.

[0184] The present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the vehicle control method of any of the aforementioned embodiments.

[0185] Among them, computer-readable storage media may include but are not limited to any type of disk, including floppy disks, optical disks, digital versatile disks (Digital Video Disc, DVD), compact disc read-only memory (Compact Disc Read-Only Memory, CD-ROM), microdrives and magneto-optical disks, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory, EPROM), electrically erasable programmable read only memory (Electrically Erasable Programmable read only memory, EEPROM), dynamic random access memory (Dynamic Random Access Memory, DRAM), video random access memory (Video Random Access Memory, VRAM), flash memory devices, magnetic cards or optical cards, nanosystems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and / or data.

[0186] The present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement a vehicle control method in the above-mentioned embodiment.

[0187] In addition, the electronic device provided in the embodiments of the present application may specifically be a chip, a component or a module, and the electronic device may include a connected processor and a memory; wherein the memory is used to store instructions, and when the electronic device is running, the processor may call and execute instructions so that the chip executes a vehicle control method in the above-mentioned embodiments.

[0188] Among them, the vehicle, computer-readable storage medium, computer program product or chip provided in this application are all used to execute the corresponding vehicle control method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding vehicle control method provided above, and will not be repeated here.

[0189] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0190] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0191] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A vehicle control method, characterized in that: The method comprises: Detecting the adjustment angle of seats in vehicles; If the adjustment angle is greater than a preset angle threshold, it is determined to turn off the recognition function of the first sound pickup device in the initial voice recognition system of the vehicle, and to perform signal enhancement processing on the audio signal collected by the second sound pickup device to obtain a target voice recognition system; wherein the first sound pickup device is a sound pickup device in an area adjacent to the area where the seat is located in the adjustment direction corresponding to the adjustment angle; and the second sound pickup device is a sound pickup device in the area where the seat is located; If a first voice command is detected, a target sound zone of the first voice command is obtained based on the first voice command and the target voice recognition system; wherein the first voice command is used to represent a control command of a target component in the vehicle; The target component in the target sound zone is controlled to execute the control instruction.

2. The method according to claim 1, characterized in that Also includes: Detecting whether there is a user on the seat; If the adjustment angle is greater than a preset angle threshold, determining to turn off the recognition function of the first sound pickup device in the initial voice recognition system of the vehicle, and performing signal enhancement processing on the audio signal collected by the second sound pickup device, includes: If it is detected that the user exists on the seat and the adjustment angle is greater than the preset angle threshold, it is determined to turn off the recognition function of the first sound pickup device, and to perform the signal enhancement processing on the audio signal collected by the second sound pickup device.

3. The method according to claim 2, characterized in that The detecting whether there is a user on the seat comprises: Acquire the value of the pressure sensor of each seat in the vehicle; and determine whether the user is on the seat based on the value of the pressure sensor; Alternatively, a cockpit image of the vehicle is acquired; and based on the cockpit image, it is determined whether the user is on the seat.

4. The method according to claim 1, characterized in that: The signal enhancement processing of the audio signal collected by the second sound pickup device includes: The signal enhancement process is performed on the audio signal component from the target direction in the audio signal collected by the second sound pickup device; wherein the target direction is obtained based on the time information and phase information of the collected audio signal.

5. The method according to claim 1, characterized in that The method of detecting the adjustment angle of a seat in a vehicle comprises: Acquiring a seat image of the vehicle; Based on the seat image, an adjustment angle of the seat is determined.

6. The method according to any one of claims 1 to 5, characterized in that Also includes: If the adjustment angle is less than or equal to the preset angle threshold, when a second voice instruction is detected, a target sound zone of the second voice instruction is determined based on the second voice instruction and the initial voice recognition system.

7. The method according to any one of claims 1 to 5, characterized in that Also includes: Acquire the area inside the vehicle and / or the size of the seats inside the vehicle; The preset angle threshold is determined based on an area within the vehicle and / or a size of a seat within the vehicle.

8. A vehicle control device, characterized in that: The device comprises: A detection module, used for detecting an adjustment angle of a seat in a vehicle; A processing module, used for determining to turn off the recognition function of the first sound pickup device in the initial voice recognition system of the vehicle if the adjustment angle is greater than a preset angle threshold, and performing signal enhancement processing on the audio signal collected by the second sound pickup device to obtain a target voice recognition system; wherein the first sound pickup device is a sound pickup device corresponding to an adjacent area of ​​the seat in the adjustment direction corresponding to the adjustment angle; the second sound pickup device is a sound pickup device in the area where the seat is located; if a first voice instruction is detected, based on the first voice instruction and the target voice recognition system, a target sound zone of the first voice instruction is obtained; wherein the first voice instruction is used to represent a control instruction of a target component in the vehicle; and the target component in the target sound zone is controlled to execute the control instruction.

9. A vehicle, characterized in that: The vehicle comprises: A memory for storing executable program codes; A processor is used to call and run the executable program code from the memory so that the vehicle executes the method as claimed in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed, the method according to any one of claims 1 to 7 is implemented.

Images