Vehicle control method and device, electronic equipment and storage medium

Abstract

The invention discloses a vehicle control method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining behavior data of an interaction object, determining a target interaction mode of a vehicle according to the behavior data and an interaction mode determination mode corresponding to the behavior data, and controlling the vehicle to enter the target interaction mode, the behavior data comprises at least one of the action data and the voice data of the interaction object, so that the interaction object does not need to select the target interaction mode through a trigger button of a specific interface, but can select the target interaction mode according to the action or the voice of the interaction object; the convenience, interestingness and participation sense of target interaction mode selection of the user are improved; besides, two interaction mode determination modes are preset on the vehicle, so that the user can select the target interaction mode no matter executing related actions or making related voices, the selection modes of the target interaction mode are enriched, and the modes of selecting the target interaction mode by the user are more diversified.

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and in particular to a vehicle control method, device, electronic device and storage medium. Background Art

[0002] With the development of automobile intelligence, the human-computer interaction modes of automobiles are becoming more and more abundant. In order to meet the diverse interaction needs of users, multiple human-computer interaction modes can usually be set on the car, and users can choose the human-computer interaction mode according to their needs. When users make a selection, they usually need to select the corresponding human-computer interaction mode through the trigger button of a specific interface on the vehicle terminal, which is not convenient for users to operate. Summary of the invention

[0003] Based on this, a vehicle control method, device, electronic device and storage medium are provided to solve the above technical problems.

[0004] In a first aspect, a vehicle control method is provided, comprising:

[0005] Acquire behavior data of the interactive object; the behavior data includes at least one of action data and voice data of the interactive object;

[0006] Determine a target interaction mode of the vehicle according to the behavior data and an interaction mode determination method corresponding to the behavior data; the vehicle is preset with a first interaction mode determination method corresponding to the action data and a second interaction mode determination method corresponding to the voice data;

[0007] The vehicle is controlled to enter the target interaction mode.

[0008] In one embodiment, when the behavior data includes the motion data and the voice data, determining the target interaction mode of the vehicle according to the behavior data and the interaction mode determination method corresponding to the behavior data includes:

[0009] Determine a first candidate interaction mode according to the action data and the first interaction mode determination method; and determine a second candidate interaction mode according to the voice data and the second interaction mode determination method;

[0010] Determine one of the first candidate interaction mode and the second candidate interaction mode as the target interaction mode.

[0011] In one embodiment, determining one of the first candidate interaction mode and the second candidate interaction mode as the target interaction mode includes:

[0012] Calculating a first confidence of the first candidate interaction mode and a second confidence of the second candidate interaction mode; determining the candidate interaction mode corresponding to the larger value of the first confidence and the second confidence as the target interaction mode;

[0013] or,

[0014] Calculating a first confidence of the first candidate interaction mode, and when it is determined that the first confidence is greater than or equal to a preset first target threshold, determining that the first candidate interaction mode is the target interaction mode; otherwise, calculating a second confidence of the second candidate interaction mode, and when it is determined that the second confidence is greater than or equal to a preset second target threshold, determining that the second candidate interaction mode is the target interaction mode;

[0015] or,

[0016] Calculate the second confidence of the second candidate interaction mode, and when it is determined that the second confidence is greater than or equal to a preset second target threshold, determine that the second candidate interaction mode is the target interaction mode; otherwise, calculate the first confidence of the first candidate interaction mode, and when it is determined that the first confidence is greater than or equal to a preset first target threshold, determine that the first candidate interaction mode is the target interaction mode.

[0017] In one embodiment, the action data is obtained based on image acquisition of the action of the interactive object; before determining that the first confidence is greater than or equal to a preset first target threshold, the method includes:

[0018] Acquire a first influence degree of the current environment of the interactive object on image acquisition;

[0019] According to the corresponding relationship between the preset first influence degree and the preset first threshold, the first target threshold corresponding to the first influence degree is determined.

[0020] In one embodiment, the voice data is obtained based on audio collection of the voice of the interactive object; before determining that the second confidence is greater than or equal to a preset second target threshold, the method includes:

[0021] Obtaining a second degree of influence of the current environment of the interactive object on audio collection;

[0022] According to the corresponding relationship between the preset second influence degree and the preset second threshold, the second target threshold corresponding to the second influence degree is determined.

[0023] In one embodiment, the motion data includes a speed of motion change of the interactive object; and determining the first candidate interaction mode according to the motion data and the first interaction mode determination method includes:

[0024] According to the correspondence between the preset action change speed and the preset candidate interaction mode, the preset candidate interaction mode corresponding to the action change speed of the interaction object is determined as the first candidate interaction mode.

[0025] In one embodiment, after controlling the vehicle to enter the target interaction mode, the method further includes:

[0026] Acquire target data corresponding to the target interaction mode;

[0027] A target vehicle component corresponding to the target interaction mode is controlled according to the target data.

[0028] In one embodiment, when the target interaction mode is a rhythmic interaction mode, acquiring target data corresponding to the target interaction mode includes:

[0029] Acquiring melody data through an audio acquisition device and determining that the melody data is the target data; or receiving a music playing instruction and determining that the melody data corresponding to the music played by the music playing instruction is the target data;

[0030] The controlling the target vehicle component corresponding to the target interaction mode according to the target data includes:

[0031] Determining an audio feature of the target data; the audio feature comprises at least one of a rhythm feature, a frequency feature, and an intensity feature of the melody data;

[0032] The first target vehicle component is controlled according to the rhythm feature; and / or, the second target vehicle component is controlled according to the frequency feature; and / or, the third target vehicle component is controlled according to the intensity feature.

[0033] In one embodiment, the first target vehicle component includes a light emitting device of the vehicle, and the controlling the first target vehicle component according to the rhythm feature includes:

[0034] Determine the light flashing frequency of the light emitting device according to the rhythm characteristics, and control the light emitting device to flash according to the light flashing frequency;

[0035] and / or,

[0036] The second target vehicle component includes a first movable device of the vehicle, and the controlling the second target vehicle component according to the frequency characteristic includes:

[0037] determining a moving speed of the first movable device according to the frequency characteristic, and controlling the movement of the first movable device according to the moving speed;

[0038] and / or,

[0039] The third target vehicle component includes a second movable device of the vehicle, and the controlling the third target vehicle component according to the strength characteristic includes:

[0040] The movement amplitude of the second movable device is determined according to the strength feature, and the movement of the second movable device is controlled according to the movement amplitude.

[0041] In a second aspect, the present application provides a vehicle control device, comprising:

[0042] An acquisition module, used to acquire behavior data of an interactive object; the behavior data includes at least one of action data and voice data of the interactive object;

[0043] a determination module, configured to determine a target interaction mode of the vehicle according to the behavior data and an interaction mode determination method corresponding to the behavior data; the vehicle is preset with a first interaction mode determination method corresponding to the action data and a second interaction mode determination method corresponding to the voice data;

[0044] A control module is used to control the vehicle to enter the target interaction mode.

[0045] In a third aspect, the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores a computer program, and the processor executes the computer program to implement the vehicle control method of the first aspect.

[0046] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the vehicle control method of the first aspect.

[0047] The vehicle control method, device, electronic device and storage medium provided in the present application obtain the behavior data of the interactive object, determine the target interaction mode of the vehicle according to the behavior data and the interaction mode determination method corresponding to the behavior data, and control the vehicle to enter the target interaction mode, wherein the behavior data includes at least one of the action data and voice data of the interactive object. Therefore, the interactive object does not need to select the target interaction mode through the trigger button of a specific interface, but can select the target interaction mode according to its own action or voice, thereby improving the convenience, fun and sense of participation of the user in selecting the target interaction mode; in addition, since two interaction mode determination methods are pre-set on the vehicle, the user can select the target interaction mode regardless of performing related actions or making related voices, thereby enriching the selection methods of the target interaction mode and making the user's selection of the target interaction mode more diversified.

[0048] Other features and advantages of the present application will be described in the subsequent description, and partly become apparent from the description, or be understood by practicing the present application. The purposes and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. It should be understood that the above general description and the detailed description below are only exemplary and explanatory and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0050] Figure 1 A schematic flow chart of a vehicle control method in one embodiment;

[0051] Figure 2 A schematic diagram of a process for determining a target interaction mode in one embodiment;

[0052] Figure 3 A schematic diagram of a process for controlling a target vehicle component in one embodiment;

[0053] Figure 4 is a flowchart of processing melody data in one embodiment;

[0054] Figure 5 is a schematic structural diagram of a vehicle control device in one embodiment;

[0055] Figure 6 FIG. 1 is a schematic diagram of the structure of an electronic device in an embodiment. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0057] Embodiment 1:

[0058] This application embodiment provides a vehicle control method, see Figure 1 As shown, including:

[0059] S11: Acquire behavior data of the interaction object; the behavior data includes at least one of action data and voice data of the interaction object.

[0060] S12: Determine the target interaction mode of the vehicle based on the behavior data and the interaction mode determination method corresponding to the behavior data; the vehicle is preset with a first interaction mode determination method corresponding to the action data and a second interaction mode determination method corresponding to the voice data.

[0061] S13: Control the vehicle to enter a target interaction mode.

[0062] The following is a detailed introduction to the above steps.

[0063] For step S11, the behavior data of the interactive object can be obtained when it is determined that the target function is in the on state. The target function refers to a function for controlling the target vehicle component according to the interaction data of the interactive object. The on state of the target function indicates that the interactive object has an interaction requirement. At this time, the behavior data of the interactive object is obtained to determine the target interaction mode, so as to avoid wasting computing resources by determining the target interaction mode when there is no interaction requirement.

[0064] In one embodiment, an image acquisition device is used to acquire an image of the interactive object to obtain a target image containing the interactive object, and an action of the interactive object in the target image is analyzed to obtain action data. An audio acquisition device is used to acquire voice data of the interactive object.

[0065] When the interactive object is located outside the vehicle, the image acquisition device can be a driving recorder or an external camera, and the audio acquisition device can be a wireless microphone of the vehicle or a mobile terminal that can communicate with the vehicle. After the voice data of the interactive object is collected by the mobile terminal, the voice data is sent to the vehicle. When the interactive object is located inside the vehicle, the image acquisition device can be an in-vehicle camera, and the audio acquisition device can be an in-vehicle microphone.

[0066] It should be noted that the interaction mode in the embodiment of the present application refers to the mode in which the interaction object interacts with the vehicle. The interaction mode in the embodiment of the present application includes but is not limited to at least one of a rhythm interaction mode, a gesture interaction mode, a dance interaction mode and a voice interaction mode.

[0067] The first interaction mode determination method in step S12 refers to a method of determining the interaction mode based on the action data of the interaction object, and the second interaction mode determination method refers to a method of determining the interaction mode based on the voice data of the interaction object.

[0068] In the embodiment of the present application, corresponding interaction mode determination methods are set for different types of behavior data, so that the vehicle can identify and analyze different types of behavior data, making the user's selection of target interaction modes more diversified.

[0069] In one embodiment, if the behavior data only includes one of action data and voice data, then the interaction mode determination method corresponding to the behavior data is directly called to determine the corresponding interaction mode, and the interaction mode is used as the target interaction mode.

[0070] In the first example, when the behavior data is action data, the interaction action of the interaction object is determined according to the action data, and according to the correspondence between the preset interaction action and the preset interaction mode, the preset interaction mode corresponding to the interaction action of the interaction object is used as the target interaction mode.

[0071] In the second example, when the behavior data is action data, and the action data includes the action change speed of the interactive object, according to the correspondence between the preset action change speed and the preset interaction mode, the preset interaction mode corresponding to the action change speed of the interactive object is used as the target interaction mode.

[0072] It should be noted that the action change speed in the embodiment of the present application reflects the speed of change of the action of the interactive object, which can be the change speed of the gesture action of the interactive object or the change speed of the body action of the interactive object.

[0073] Exemplarily, the human body key points of the hands and / or other limbs of the interactive object can be tracked by an image acquisition device, and the acceleration of the human body key points can be used as the motion change speed. When there are multiple human body key points, the acceleration of each human body key point can be multiplied by the preset weight of the human body key point, and the sum of the products of the acceleration of each human body key point and the preset weight is used as the motion change speed of the interactive object.

[0074] It can be understood that, in this example, a correspondence between a preset action change speed and a preset interaction mode needs to be established in advance, and the preset action change speed here can be a preset action change speed range.

[0075] Taking the measurement of the speed of motion change by acceleration as an example, the corresponding relationship can be shown in Table 1 below:

[0076] Table 1

[0077] Preset acceleration Preset Interaction Mode [0，a1] Gesture interaction mode (a1, a2] Dancing interactive mode

[0078] If the acceleration of the key points of the human body of the interaction object is determined to be within the range of [0, a1], then according to the above correspondence, the gesture interaction mode is used as the target interaction mode. If the acceleration of the key points of the human body of the interaction object is determined to be within the range of (a1, a2], then according to the above correspondence, the dancing interaction mode is used as the target interaction mode.

[0079] Exemplarily, the motion change speed can also be measured by parameters of multiple different dimensions, such as the speed, acceleration and motion duration of key points of the human body. In this case, a preset motion change speed range includes a preset speed range, a preset acceleration range and a corresponding preset motion duration range. The corresponding relationship between the preset motion change speed and the preset interaction mode can be shown in Table 2 below:

[0080] Table 2

[0081]

[0082] If it is determined that the velocity of the key points of the human body of the interaction object is within the range of (v1, v2], and the acceleration is within the range of (a1, a2], and the continuous motion duration that meets the above conditions is within (t2, t3], then according to the above Table 2, the dancing interaction mode is used as the target interaction mode.

[0083] For example, if the speed of the key points of the human body is detected to be more than 1.2m / s and the acceleration is more than 2.5m / s 2 , and the speed exceeds 1.2m / s and the acceleration exceeds 2.5m / s 2 If the duration T_active exceeds 2 seconds, it is determined that the interactive object's motion changes quickly, indicating that the interactive object is in a high-intensity motion state. At this time, the dancing interaction mode is used as the target interaction mode.

[0084] In the third example, when the behavior data is voice data, keywords in the voice data can be extracted, and according to the correspondence between preset keywords and preset interaction modes, the preset interaction mode corresponding to the keywords in the voice data is used as the target interaction mode.

[0085] In actual applications, the interactive object may make a voice when performing related actions. Therefore, in one embodiment, see Figure 2 As shown, the behavior data includes action data and voice data, and step S12 includes the following sub-steps:

[0086] S121: Determine a first candidate interaction mode according to the action data and the first interaction mode determination method; and determine a second candidate interaction mode according to the voice data and the second interaction mode determination method.

[0087] S122: Determine one of the first candidate interaction mode and the second candidate interaction mode as the target interaction mode.

[0088] It should be noted that when the action data includes the action change speed of the interactive object, the preset interaction mode corresponding to the action change speed of the interactive object can be determined as the first candidate interaction mode according to the correspondence between the preset action change speed and the preset interaction mode.

[0089] A more specific method for determining the first candidate interaction mode and the second candidate interaction mode in sub-step S121 can refer to the method of determining the corresponding interaction mode based on action data and the method of determining the corresponding interaction mode based on voice data introduced in the above content, which will not be repeated here.

[0090] It is understandable that in order to improve the accuracy of the target interaction mode finally established and avoid false triggering of the interaction mode, the more credible mode between the first candidate interaction mode and the second candidate interaction mode may be used as the target interaction mode.

[0091] Therefore, in sub-step S122, the target interaction mode may be determined in the following manner:

[0092] Method 1: Calculate a first confidence level of a first candidate interaction mode and a second confidence level of a second candidate interaction mode; and determine that the candidate interaction mode corresponding to the larger value of the first confidence level and the second confidence level is the target interaction mode.

[0093] The first confidence level refers to the credibility of the first candidate interaction mode determined based on the action data, and the second confidence level refers to the credibility of the second candidate interaction mode determined based on the voice data. Through this embodiment, when the interactive object performs an action and makes a voice at the same time due to an erroneous operation, the vehicle can determine the corresponding candidate interaction modes based on the action data and the voice data respectively, and then use the candidate interaction mode with a higher degree of credibility as the target interaction mode, thereby improving the accuracy of the target interaction mode confirmation and making the confirmed target interaction mode meet the needs of the interactive object.

[0094] Method 2: Calculate the first confidence of the first candidate interaction mode, and when it is determined that the first confidence is greater than or equal to the preset first target threshold, determine the first candidate interaction mode as the target interaction mode; otherwise, calculate the second confidence of the second candidate interaction mode, and when it is determined that the second confidence is greater than or equal to the preset second target threshold, determine the second candidate interaction mode as the target interaction mode.

[0095] Method three: Calculate the second confidence of the second candidate interaction mode, and when it is determined that the second confidence is greater than or equal to the preset second target threshold, determine the second candidate interaction mode as the target interaction mode; otherwise, calculate the first confidence of the first candidate interaction mode, and when the first confidence is greater than or equal to the preset first target threshold, determine the first candidate interaction mode as the target interaction mode.

[0096] Different external environments have different degrees of influence on image acquisition and audio acquisition. When the environmental noise is high, the impact on audio acquisition is greater. Therefore, when voice data and motion data are acquired, the first candidate interaction mode can be determined based on the motion data. Correspondingly, the first confidence of the first candidate interaction mode is calculated preferentially. If the first confidence meets the requirements, it indicates that the credibility of the first candidate interaction mode determined based on the motion data is relatively high. At this time, the first candidate interaction mode is directly used as the target interaction mode. When the first confidence does not meet the requirements, the second confidence is judged.

[0097] Therefore, in one embodiment, when it is determined that the ambient noise of the environment in which the interactive object is located is greater than or equal to the preset ambient noise threshold, the above-mentioned method 2 can be used to determine the target interaction mode. If it is determined that the ambient noise of the environment in which the interactive object is located is less than the preset ambient noise threshold, it means that the external environment has little impact on audio collection. Considering that the probability of voice false triggering is less than the probability of action false triggering in actual applications, the above-mentioned method 3 can be used to determine the target interaction mode.

[0098] When the ambient light is poor or the weather is bad, such as when it is rainy, the impact on image acquisition is greater. Therefore, when voice data and motion data are acquired, the second candidate interaction mode can be determined based on the voice data. Correspondingly, the second confidence level of the second candidate interaction mode is calculated first. If the second confidence level meets the requirements, it indicates that the second candidate interaction mode determined based on the voice data is more credible. In this case, the second candidate interaction mode is directly used as the target interaction mode. When the second confidence level does not meet the requirements, the first confidence level is judged again.

[0099] Therefore, in one embodiment, when it is determined that the ambient brightness of the environment in which the interactive object is located is greater than or equal to the preset brightness threshold, the above-mentioned method 3 can be used to determine the target interaction mode. If it is determined that the ambient brightness of the environment in which the interactive object is located is less than the preset ambient brightness threshold, it means that the external environment has a greater impact on image acquisition, and the above-mentioned method 2 can be used to determine the target interaction mode.

[0100] It can be understood that the first target threshold and / or the second target threshold used for making the judgment may be fixed or may change with the environmental conditions of the environment in which the interactive object is located.

[0101] In one embodiment, before determining whether the first confidence level is greater than or equal to a preset first target threshold, the first target threshold used for the current determination may be determined. Specifically, the first target threshold may be determined in the following manner:

[0102] Obtaining a first degree of influence of the current environment of the interactive object on image acquisition;

[0103] According to the corresponding relationship between the preset first influence degree and the preset first threshold, a first target threshold corresponding to the first influence degree is determined.

[0104] In this embodiment, the influence of the environment on image acquisition can be measured by the ambient brightness, that is, the ambient brightness can be used as the first influence degree.

[0105] It can be understood that the preset first impact degree can be a preset impact degree value range. In this embodiment, the impact degree value range to which the first impact degree belongs can be determined, and the preset first threshold corresponding to the impact degree value range is used as the first target threshold.

[0106] Similarly, in one embodiment, before determining whether the second confidence level is greater than or equal to the preset second target threshold, the second target threshold used for the current determination may be determined first. Specifically, the second target threshold may be determined in the following manner:

[0107] Obtaining a second degree of influence of the current environment of the interactive object on audio collection;

[0108] According to the corresponding relationship between the preset second influence degree and the preset second threshold, a second target threshold corresponding to the second influence degree is determined.

[0109] In this embodiment, the influence of the environment on the audio collection can be measured by the environmental noise, that is, the environmental noise can be used as the second influence level.

[0110] It can be understood that the preset second impact degree can also be a preset impact degree value range. In this embodiment, the impact degree value range to which the second impact degree belongs can be determined, and the preset second threshold corresponding to the impact degree value range can be used as the second target threshold.

[0111] The greater the impact of the environment on the collection of behavioral data, the lower the credibility of the collected data. In order to ensure the accuracy of the candidate interaction mode determined based on the data, it is necessary to increase the target threshold used for judgment.

[0112] That is, in the correspondence between the above-mentioned preset first influence degree and the preset first threshold, the preset first threshold corresponding to the preset first influence degree with a larger value is greater than the preset first threshold corresponding to the preset first influence degree with a smaller value. Similarly, in the correspondence between the above-mentioned preset second influence degree and the preset second threshold, the preset second threshold corresponding to the preset second influence degree with a larger value is greater than the preset second threshold corresponding to the preset second influence degree with a smaller value. Exemplarily, the correspondence between the preset second influence degree and the preset second threshold is shown in Table 3 below:

[0113] Table 3

[0114] Preset ambient noise range Preset second threshold The first preset ambient noise range: [d1, d2] X1 The second preset environmental noise range: (d2, d3] X2

[0115] The value in the second preset environmental noise range is greater than the value in the first preset environmental noise range, and X2>X1.

[0116] When the vehicle enters the corresponding target interaction mode, it indicates that the interaction method corresponding to the target interaction mode can be used to achieve interaction. Figure 3 As shown, after step S13, the following steps may be included:

[0117] S31: Acquire target data corresponding to the target interaction mode.

[0118] S32: Controlling the target vehicle component corresponding to the target interaction mode according to the target data.

[0119] In the embodiment of the present application, the interaction modes pre-set on the vehicle include but are not limited to at least one of a rhythmic interaction mode, a gesture interaction mode, a dancing interaction mode and a voice interaction mode.

[0120] Through the above method, one of the rhythm interaction mode, gesture interaction mode, dance interaction mode and voice interaction mode can be used as the target interaction mode.

[0121] It is understandable that different interaction modes may correspond to different methods of determining target data, and may correspond to different target vehicle components.

[0122] The following is a detailed introduction to the interaction methods in different interaction modes.

[0123] When the target interaction mode is the rhythmic interaction mode, the above step S31 includes:

[0124] Acquire melody data through an audio acquisition device and determine that the melody data is target data; or receive a music playing instruction and determine that the melody data corresponding to the music played by the music playing instruction is target data.

[0125] Then step S32 includes:

[0126] Determine an audio feature of the melody data; the audio feature includes at least one of a rhythm feature, a frequency feature, and an intensity feature of the melody data;

[0127] The first target vehicle component is controlled according to the rhythm characteristic; and / or, the second target vehicle component is controlled according to the frequency characteristic; and / or, the third target vehicle component is controlled according to the intensity characteristic.

[0128] When the interactive object is outside the vehicle, a wireless microphone or a mobile terminal that can communicate with the vehicle can be used as the audio collection device, and when the interactive object is inside the vehicle, the microphone inside the vehicle can be used as the audio collection device. The sending method of the music playing instruction includes but is not limited to voice, action, input, etc.

[0129] In one embodiment, the first target vehicle component includes a light-emitting device of the vehicle, which can be any light-emitting device on the vehicle, including but not limited to at least one of ambient lights, headlights, brake lights, turn signals and welcome lights. At this time, the light flashing frequency of the light-emitting device can be determined according to the rhythm characteristics, and the light-emitting device can be controlled to flash according to the light flashing frequency.

[0130] In one embodiment, the second target vehicle component includes a first movable device of the vehicle. In this case, the moving speed of the first movable device can be determined according to the frequency characteristics, and the movement of the first movable device can be controlled according to the moving speed.

[0131] In one embodiment, the third target vehicle component includes a second movable device of the vehicle. In this case, the movement amplitude of the second movable device can be determined according to the strength characteristics, and the movement of the second movable device can be controlled according to the movement amplitude.

[0132] The first movable device and the second movable device are movable devices on the vehicle, including but not limited to windows, side mirrors, suspensions, trunk doors, etc. The first movable device and the second movable device may be the same device or different. For example, the first movable device is a window and / or a suspension, in which case the lifting speed of the window and / or the up and down movement speed of the suspension can be controlled, and the second movable device is a side mirror, in which case the movement range of the side mirror can be controlled.

[0133] See also Figure 4 As shown, in one embodiment, in order to improve the accuracy of melody analysis, after obtaining melody data through an audio acquisition device, after determining the presence of background noise, the background noise, such as wind noise, engine noise, road noise, etc., can be eliminated through noise suppression, and then it is determined whether the signal strength after removing the background noise is within a preset strength range, for example, it is determined whether the RMS (Root Mean Square) of the signal is less than a first threshold value, if so, the signal is amplified, and it is determined whether the RMS is greater than a second threshold value, if so, the signal is attenuated, so as to ensure that the signal strength is within a preset strength range. If an emergency occurs and the sound suddenly reaches a high pitch, a limiter can be used to adjust it, and finally voice enhancement is performed. If it is determined that the melody data is the singing data of the interactive object, a voice enhancement algorithm can be used to highlight the vocal part, and then the processed melody data is feature analyzed to obtain the audio features of the melody data.

[0134] In the embodiment of the present application, the rhythm characteristics of the melody data can be determined by a rhythm analysis algorithm. Specifically, the time-frequency characteristics of the melody data can be analyzed by a CQT (Constant-Q Transform) algorithm, and the short-time energy and zero-crossing rate can be calculated. The rhythm interval can be determined in combination with the peak detection method, and the number of beats per unit time can be calculated. The flashing frequency of the light of the light-emitting device can be determined according to the number of beats per unit time, so as to achieve the visual synchronization effect of fast-tempo fast flash and slow-tempo slow flash.

[0135] In another embodiment, the first target vehicle component may further include a door, and the frequency of opening and closing the door is controlled according to the rhythm characteristics.

[0136] In this embodiment, the target vehicle component is linked to the melody through the melody characteristics, creating a resonance between music and vision, thereby enhancing the user's auditory and visual experience.

[0137] When the target interaction mode is the gesture interaction mode, the gesture action of the interaction object may be acquired as the target data, and the target vehicle component may be controlled based on the gesture action.

[0138] When the interactive object makes preset gestures such as raising hands, waving hands, crossing hands, and clenching fists, the vehicle triggers the corresponding control logic based on the recognition results.

[0139] After the target vehicle component is controlled to perform the corresponding action, the user can be prompted through the vehicle feedback component, specifically, through light-emitting devices, voice devices, windows, etc. For example, double flashing lights to confirm the interaction, voice prompts to guide user operations, automatic lifting of windows, etc., to ensure the intuitiveness and predictability of the interaction.

[0140] The preset gesture actions in the embodiment of the present application can be set by the developer before the vehicle leaves the factory, and can also support user customization.

[0141] For users with special needs, custom gestures and script functions are supported to make the vehicle control process more flexible. For example, users can record specific gestures, such as "five fingers open and rotate" corresponding to the opening of the panoramic sunroof. It also supports users to compose complete interactive scripts, such as "Welcome Home Mode": the user raises his hand and waves, the lights flash and play a welcome voice; the user swings his hands down, the window slowly lowers, and the seat automatically adjusts to the comfort mode; the user nods to confirm, the door unlocks, and the ambient light lights up. This personalized setting allows users to adjust the interaction logic according to different scenarios, meet personalized needs, and improve user satisfaction with the interactive experience.

[0142] When the target interaction mode is the dancing interaction mode, the dancing movements of the interactive object can be obtained as target data, and the target vehicle components can be controlled according to the dancing movements. Exemplarily, the motion trajectory of the key points of the human body of the interactive object can be obtained, and the dancing movements of the interactive object can be determined according to the motion trajectory, thereby generating a control signal for controlling the target vehicle components.

[0143] The dancing interaction mode realizes vehicle control based on the dynamic changes of key points of the human body. Key points of the human body include but are not limited to at least one of the key points of the head, the torso, and the limbs. For example, if the interactive object raises both hands and swings them left and right, the front and rear lights of the vehicle may flash synchronously; if the interactive object rotates sideways, the interior ambient light may change color; if the user extends the left / right arm horizontally, the left / right windows and doors of the vehicle will open and close accordingly.

[0144] The dance interaction mode supports official presets and user customization. In the official preset mode, dance interaction scripts are provided, such as "Light and Shadow Dance", "Free Rhythm", "Welcome Dance", etc. The interactive object only needs to dance according to the preset movements, and the vehicle automatically matches the changes of the vehicle components such as lights, music, and windows according to the preset movements. For example, in the "Light and Shadow Dance" mode, the interactive object waves or jumps with the music, and the vehicle headlights, atmosphere lights, and fog lights present dynamic light effects, which keep in sync with the dance rhythm of the interactive object, creating an immersive stage effect.

[0145] In the user-defined mode, a custom action recording function is provided, and users can freely set the mapping relationship between specific dance actions and vehicle functions. For example, users can record a "touch and rotate" action and set the corresponding vehicle response, such as the door slowly opening, the seat adjusting to the welcome mode, playing specific background music, etc. This makes the dance interaction mode not only used for daily interactions, but also for specific scenarios, such as personalized welcome ceremonies, private parties, etc.

[0146] When the target interaction mode is the voice interaction mode, the voice command of the interaction object may be acquired as the target data, and the target vehicle component may be controlled according to the voice command.

[0147] Similarly, this mode supports official presets and user customization. The voice interaction mode allows the interactive object to interact with the vehicle through voice commands to achieve the control of the functions of multiple target vehicle components such as doors, windows, tailgates, lighting equipment, etc., such as turning on the lights, opening the doors, folding the rearview mirrors, etc.

[0148] The interactive object can achieve a scenario where multiple target vehicle components are operating simultaneously through specific instructions. For example, if the interactive object shouts "Spread your wings", the four doors and tailgate of the vehicle will be triggered to open together, simulating the effect of "spreading wings", with the lights flashing and the suspension high in front and low in the back, creating a feeling that the vehicle is ready to take off. If the interactive object shouts "Spread your wings and fly high", the four doors will start to swing synchronously after half of them are opened, simulating the feeling of flying. In addition, a variety of predefined scenes such as "sunny" and "bright lights" can be preset. In the embodiment of the present application, the target vehicle components are controlled by voice commands, which expands the intelligence and convenience of vehicle control.

[0149] It should be understood that, although the various steps in the above-mentioned flow chart are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the above-mentioned flow chart may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0150] Embodiment 2:

[0151] Based on the same inventive concept, see Figure 5 As shown, an embodiment of the present application provides a vehicle control device, including:

[0152] An acquisition module 501 is used to acquire behavior data of an interactive object; the behavior data includes at least one of action data and voice data of the interactive object;

[0153] A determination module 502 is used to determine a target interaction mode of the vehicle according to the behavior data and an interaction mode determination method corresponding to the behavior data; the vehicle is preset with a first interaction mode determination method corresponding to the action data and a second interaction mode determination method corresponding to the voice data;

[0154] The control module 503 is used to control the vehicle to enter the target interaction mode.

[0155] Further, when the behavior data includes the action data and the voice data, the determination module 502 is used to determine the first candidate interaction mode based on the action data and the first interaction mode determination method; and determine the second candidate interaction mode based on the voice data and the second interaction mode determination method; and determine one of the first candidate interaction mode and the second candidate interaction mode as the target interaction mode.

[0156] Further, the determination module 502 is used to calculate a first confidence of the first candidate interaction mode and a second confidence of the second candidate interaction mode; determine that the candidate interaction mode corresponding to the larger value of the first confidence and the second confidence is the target interaction mode; or, calculate the first confidence of the first candidate interaction mode, and when it is determined that the first confidence is greater than or equal to a preset first target threshold, determine that the first candidate interaction mode is the target interaction mode, otherwise, calculate the second confidence of the second candidate interaction mode, and when it is determined that the second confidence is greater than or equal to a preset second target threshold, determine that the second candidate interaction mode is the target interaction mode; or, calculate the second confidence of the second candidate interaction mode, and when it is determined that the second confidence is greater than or equal to the preset second target threshold, determine that the second candidate interaction mode is the target interaction mode, otherwise, calculate the first confidence of the first candidate interaction mode, and when it is determined that the first confidence is greater than or equal to the preset first target threshold, determine that the first candidate interaction mode is the target interaction mode.

[0157] Further, the determination module 502 is used to obtain a first influence degree of the environment in which the interactive object is currently located on the image acquisition before determining that the first confidence level is greater than or equal to a preset first target threshold; determine the first target threshold corresponding to the first influence degree according to the corresponding relationship between the preset first influence degree and the preset first threshold.

[0158] Furthermore, the determination module 502 is used to obtain a second degree of influence of the current environment of the interactive object on the audio collection before determining that the second confidence level is greater than or equal to a preset second target threshold; and determine the second target threshold corresponding to the second degree of influence based on the correspondence between the preset second degree of influence and the preset second threshold.

[0159] Further, the determination module 502 is used to determine, according to a correspondence between a preset action change speed and a preset interaction mode, the preset interaction mode corresponding to the action change speed of the interaction object as the first candidate interaction mode.

[0160] Furthermore, the control module 503 is used to obtain target data corresponding to the target interaction mode after controlling the vehicle to enter the target interaction mode; and control the target vehicle components corresponding to the target interaction mode according to the target data.

[0161] Further, when the target interaction mode is the rhythmic interaction mode, the control module 503 is used to control the audio acquisition device to obtain melody data and determine that the melody data is the target data; or, receive a music playing instruction and determine that the melody data corresponding to the music played by the music playing instruction is the target data; determine the audio features of the melody data; the audio features include at least one of the rhythm features, frequency features and intensity features of the melody data; control the first target vehicle component according to the rhythm features; and / or, control the second target vehicle component according to the frequency features; and / or, control the third target vehicle component according to the intensity features.

[0162] Further, the first target vehicle component includes a light-emitting device of the vehicle, and the control module 503 is used to determine a flashing frequency of a light of the light-emitting device according to the rhythm characteristics, and control the flashing of the light-emitting device according to the flashing frequency; and / or, the second target vehicle component includes a first movable device of the vehicle, and the control module 503 is used to determine a moving speed of the first movable device according to the frequency characteristics, and control the movement of the first movable device according to the moving speed; and / or, the third target vehicle component includes a second movable device of the vehicle, and the control module 503 is used to determine a moving amplitude of the second movable device according to the intensity characteristics, and control the movement of the second movable device according to the moving amplitude.

[0163] It should be understood that for the sake of brevity, the contents described in some embodiments will not be repeated in this embodiment.

[0164] Embodiment three:

[0165] See also Figure 6 As shown, an embodiment of the present application provides an electronic device, including a processor 601 and a memory 602, wherein the memory 602 stores a computer program, and the processor 601 executes the computer program. The processor executes the computer program to implement the steps of the method introduced above, which will not be repeated here.

[0166] The processor 601 may be an integrated circuit chip with signal processing capability. The processor 601 may be a general-purpose processor, including a CPU (Central Processing Unit), a NP (Network Processor), etc.; it may also be a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. It may implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0167] The memory 602 may include, but is not limited to, RAM (Random Access Memory), ROM (Read Only Memory), PROM (Programmable Read Only Memory), EPROM (Erasable Programmable Read-Only Memory), and EEPROM (Electrically Erasable Programmable Read Only Memory).

[0168] Those skilled in the art will understand that Figure 6 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the application of the scheme of the present application. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0169] Based on the same inventive concept, the embodiments of the present application also provide a computer-readable storage medium, such as a floppy disk, a CD, a hard disk, a flash memory, a USB flash disk, an SD (Secure Digital) card, an MMC (Multi-Media Card) card, etc., in which one or more programs for implementing the above steps are stored. These one or more programs can be executed by one or more processors to implement the steps of the methods in the above embodiments, which will not be repeated here.

[0170] Based on the same inventive concept, an embodiment of the present application further provides a computer program product, including a computer program, which implements any of the above methods when executed by a processor.

[0171] Among them, the program code for executing the computer program product of the present application can be written in any combination of one or more programming languages, and the program code can be executed completely on the user device, partially on the user device, as an independent software package, partially on the user device and partially on a remote device, or completely on the remote device.

[0172] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) that contain computer-usable program code.

[0173] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer-readable storage media according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0174] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0175] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of user-operated steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0176] It should be noted that the diagram provided in the present embodiment only illustrates the basic concept of the present application in a schematic manner, so the diagram only shows the components related to the present application rather than drawing according to the number, shape and size of the components during actual implementation. The type, quantity and ratio of each component during actual implementation can be a random change, and its component layout type may also be more complicated. The structure, ratio, size, etc. illustrated by the accompanying diagram of this specification are only used to match the content disclosed in the specification, so that people familiar with this technology can understand and read, and are not used to limit the restrictive conditions that can be implemented in this application, so they have no technical substantive significance. Any modification of the structure, change of the proportional relationship or adjustment of the size, without affecting the effect that can be produced by this application and the purpose that can be achieved, should still fall within the scope that the technical content disclosed in this application can cover. At the same time, the terms such as "upper", "lower", "left", "right", "middle" and "one" quoted in this specification are also only for the convenience of narration, rather than for limiting the scope that can be implemented in this application. The change or adjustment of its relative relationship, without substantial change of technical content, should also be regarded as the scope that can be implemented in this application.

[0177] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various places in the text does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0178] As shown in this document, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural, unless the context clearly indicates an exception. Generally speaking, the terms "include" and "comprise" only indicate that the steps and elements that have been clearly identified are included, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0179] The definitions of inclusion in this document, such as the terms "having", "may have", "include" or "may include" used herein, indicate the existence of the corresponding functions, operations, elements, etc. herein, and do not limit the existence of one or more other functions, operations, elements, etc. In addition, it should be understood that the terms "including" or "having" used herein indicate the existence of the features, numbers, steps, operations, elements, components, or a combination thereof described in the specification, without excluding the existence or addition of one or more other features, numbers, steps, operations, elements, components, or a combination thereof.

[0180] In the embodiments of the present application, prefixes such as "first" and "second" are used only to distinguish different description objects, and have no limiting effect on the position, order, priority, quantity or content of the described objects. The use of prefixes such as ordinal numbers to distinguish description objects in the embodiments of the present application does not constitute a limitation on the described objects. For the statement of the described + object, please refer to the description in the context of the claims or embodiments, and no unnecessary limitation should be constituted due to the use of such prefixes. In addition, in the description of the present embodiment, unless otherwise specified, the meaning of "multiple" is two or more.

[0181] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0182] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A vehicle control method, characterized in that: include: Acquire behavior data of the interactive object; the behavior data includes at least one of action data and voice data of the interactive object; Determine a target interaction mode of the vehicle according to the behavior data and an interaction mode determination method corresponding to the behavior data; the vehicle is preset with a first interaction mode determination method corresponding to the action data and a second interaction mode determination method corresponding to the voice data; The vehicle is controlled to enter the target interaction mode.

2. The vehicle control method according to claim 1, characterized in that: When the behavior data includes the motion data and the voice data, determining the target interaction mode of the vehicle according to the behavior data and the interaction mode determination method corresponding to the behavior data includes: Determine a first candidate interaction mode according to the action data and the first interaction mode determination method; and determine a second candidate interaction mode according to the voice data and the second interaction mode determination method; Determine one of the first candidate interaction mode and the second candidate interaction mode as the target interaction mode.

3. The vehicle control method according to claim 2, characterized in that: The determining one of the first candidate interaction mode and the second candidate interaction mode as the target interaction mode includes: Calculating a first confidence of the first candidate interaction mode and a second confidence of the second candidate interaction mode; determining the candidate interaction mode corresponding to the larger value of the first confidence and the second confidence as the target interaction mode; or, Calculating a first confidence of the first candidate interaction mode, and when it is determined that the first confidence is greater than or equal to a preset first target threshold, determining that the first candidate interaction mode is the target interaction mode; otherwise, calculating a second confidence of the second candidate interaction mode, and when it is determined that the second confidence is greater than or equal to a preset second target threshold, determining that the second candidate interaction mode is the target interaction mode; or, Calculate the second confidence of the second candidate interaction mode, and when it is determined that the second confidence is greater than or equal to a preset second target threshold, determine that the second candidate interaction mode is the target interaction mode; otherwise, calculate the first confidence of the first candidate interaction mode, and when it is determined that the first confidence is greater than or equal to a preset first target threshold, determine that the first candidate interaction mode is the target interaction mode.

4. The vehicle control method according to claim 3, characterized in that: The action data is obtained based on image acquisition of the action of the interactive object; Before determining that the first confidence level is greater than or equal to a preset first target threshold, the method includes: Acquire a first influence degree of the current environment of the interactive object on image acquisition; According to the corresponding relationship between the preset first influence degree and the preset first threshold, the first target threshold corresponding to the first influence degree is determined.

5. The vehicle control method according to claim 3, characterized in that: The voice data is obtained based on audio collection of the voice of the interactive object; Before determining that the second confidence level is greater than or equal to a preset second target threshold, the method includes: Obtaining a second degree of influence of the current environment of the interactive object on audio collection; According to the corresponding relationship between the preset second influence degree and the preset second threshold, the second target threshold corresponding to the second influence degree is determined.

6. The vehicle control method according to claim 2, characterized in that: The action data includes a speed of change of the action of the interactive object; and determining the first candidate interaction mode according to the action data and the first interaction mode determination method includes: According to the correspondence between the preset action change speed and the preset interaction mode, the preset interaction mode corresponding to the action change speed of the interaction object is determined as the first candidate interaction mode.

7. The vehicle control method according to any one of claims 1 to 6, characterized in that: After controlling the vehicle to enter the target interaction mode, the method further includes: Acquire target data corresponding to the target interaction mode; A target vehicle component corresponding to the target interaction mode is controlled according to the target data.

8. The vehicle control method according to claim 7, characterized in that: When the target interaction mode is a rhythmic interaction mode, the acquiring target data corresponding to the target interaction mode includes: Acquiring melody data through an audio acquisition device and determining that the melody data is the target data; or receiving a music playing instruction and determining that the melody data corresponding to the music played by the music playing instruction is the target data; The controlling the target vehicle component corresponding to the target interaction mode according to the target data includes: Determining an audio feature of the melody data; the audio feature comprises at least one of a rhythm feature, a frequency feature, and an intensity feature of the melody data; The first target vehicle component is controlled according to the rhythm feature; and / or, the second target vehicle component is controlled according to the frequency feature; and / or, the third target vehicle component is controlled according to the intensity feature.

9. The vehicle control method according to claim 8, characterized in that: The first target vehicle component includes a light-emitting device of the vehicle, and the controlling the first target vehicle component according to the rhythm feature includes: Determine the light flashing frequency of the light emitting device according to the rhythm characteristics, and control the light emitting device to flash according to the light flashing frequency; and / or, The second target vehicle component includes a first movable device of the vehicle, and the controlling the second target vehicle component according to the frequency characteristic includes: determining a moving speed of the first movable device according to the frequency characteristic, and controlling the movement of the first movable device according to the moving speed; and / or, The third target vehicle component includes a second movable device of the vehicle, and the controlling the third target vehicle component according to the strength characteristic includes: The movement amplitude of the second movable device is determined according to the intensity feature, and the movement of the second movable device is controlled according to the movement amplitude.

10. A vehicle control device, characterized in that: include: An acquisition module, used to acquire behavior data of an interactive object; the behavior data includes at least one of action data and voice data of the interactive object; a determination module, configured to determine a target interaction mode of the vehicle according to the behavior data and an interaction mode determination method corresponding to the behavior data; the vehicle is preset with a first interaction mode determination method corresponding to the action data and a second interaction mode determination method corresponding to the voice data; A control module is used to control the vehicle to enter the target interaction mode.

11. An electronic device, characterized in that: The method comprises a processor and a memory, wherein a computer program is stored in the memory, and the processor executes the computer program to implement the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by at least one processor, the method according to any one of claims 1 to 9 is implemented.

Images