Vehicle door control method and device and vehicle

Abstract

The invention discloses a vehicle door control method and device and a vehicle, and the method comprises the steps: obtaining target music data in the vehicle in response to a vehicle door opening instruction; obtaining the volume and frequency of the target music data; door opening parameters of the vehicle are determined according to the volume and / or the frequency; the wing-shaped vehicle door of the vehicle is controlled to be opened according to the door opening parameters, so that the music rhythm collected in real time is converted into the vehicle door control signal, synchronous rhythm of the wing-shaped vehicle door and the music rhythm is achieved, and the science and technology feeling of wing-shaped vehicle door control is improved.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and more specifically, to a door control method, device and vehicle. Background Art

[0002] With the development of science and technology, cars are becoming more and more intelligent, and people are paying more and more attention to the entertainment system inside the car. Wing-shaped doors, also known as gull-wing doors or butterfly doors, are an innovative design of modern cars. Their characteristics are that the door hinges are located on the roof, and the doors will spread upward and outward when opened, similar to wings, which not only enhances the appearance of the vehicle but also increases its practicality. However, the existing wing-shaped door control system is only used for door opening, and there is a problem of low sense of technology. Summary of the invention

[0003] In view of this, the embodiments of the present application propose a door control method, device and vehicle to improve the above-mentioned problems.

[0004] In a first aspect, an embodiment of the present application provides a door control method, the method comprising: obtaining target music data in a vehicle in response to a door opening command; obtaining the volume and frequency of the target music data; determining the door opening parameters of the vehicle according to the volume and / or the frequency; and controlling the wing door of the vehicle to open with the door opening parameters.

[0005] In a second aspect, an embodiment of the present application provides a door control device, the device comprising: a music data acquisition module, a music feature acquisition module, a door opening parameter determination module and a wing door control module. The music data acquisition module is used to acquire target music data in the vehicle in response to a door opening instruction; the music feature acquisition module is used to acquire the volume and frequency of the target music data; the door opening parameter determination module is used to determine the door opening parameters of the vehicle according to the volume and / or the frequency; and the wing door control module is used to control the wing door of the vehicle to open with the door opening parameters.

[0006] In a third aspect, an embodiment of the present application provides a vehicle, comprising a wing door, a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes the above method.

[0007] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.

[0008] In the scheme of the present application, by responding to the door opening command, the target music data in the vehicle is obtained, and the volume and frequency of the target music data are obtained, and the door opening parameters of the vehicle are determined according to the volume and / or frequency, and the wing-shaped doors of the vehicle are controlled to open with the door opening parameters, so as to collect and analyze the music in the vehicle in real time to obtain the volume and frequency of the music, and control the opening and closing action of the wing-shaped doors according to the volume and frequency of the music, so as to realize the real-time rhythm of the wing-shaped doors with the music, thereby improving the technological sense of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0010] Figure 1 A schematic diagram of a process flow of a door control method provided by an embodiment of the present application is shown;

[0011] Figure 2 A schematic diagram of a process flow of a door control method provided by an embodiment of the present application is shown;

[0012] Figure 3 A structural block diagram of a wing-shaped door control system provided by an embodiment of the present application is shown;

[0013] Figure 4 A schematic diagram of a process flow of a door control method provided by an embodiment of the present application is shown;

[0014] Figure 5 A schematic diagram of a process flow of a door control method provided by an embodiment of the present application is shown;

[0015] Figure 6 A schematic diagram of a process flow of a door control method provided by an embodiment of the present application is shown;

[0016] Figure 7 A module block diagram of a door control device provided by an embodiment of the present application is shown;

[0017] Figure 8 A block diagram of a vehicle for executing a door control method according to an embodiment of the present application is shown;

[0018] Fig. 9 A storage unit for storing or carrying a program code for implementing a vehicle door control method according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0019] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0020] At present, the application of wing-shaped doors is becoming more and more widespread. The existing wing-shaped door control system is only used for door opening, and its function is single, the degree of intelligence is low, and the sense of science fiction is insufficient. Therefore, in the related technology, the control of wing-shaped doors has the problem of low sense of science and technology.

[0021] In view of the above problems, the inventor has found through long-term research that a door control method, device and vehicle provided in the embodiments of the present application are proposed, which obtain the volume and frequency of the music by real-time acquisition and analysis of the music in the car, and control the opening and closing of the wing-shaped door according to the volume and frequency of the music, so that the wing-shaped door can move in real time with the music, thereby improving the sense of technology of the wing-shaped door control. The specific door control method is described in detail in the subsequent embodiments.

[0022] See also Figure 1 , Figure 1 FIG. 1 is a flow chart of a vehicle door control method provided by an embodiment of the present application. In a specific embodiment, the vehicle door control method can be applied to Figure 7 The door control device 200 and the vehicle 100 equipped with the door control device 200 are shown. Figure 8 ). The following will take a vehicle as an example to illustrate the specific process of this embodiment. Of course, it can be understood that the vehicle used in this embodiment may include a vehicle-mounted terminal, a wing-shaped door and other equipment, which is not limited here. Figure 1 The process shown is described in detail, and the door control method may specifically include the following steps:

[0023] Step S110: In response to the door opening instruction, acquiring target music data in the vehicle.

[0024] In some embodiments, the vehicle may receive a door opening command input by a user, and accordingly, the vehicle may respond to the door opening command to obtain target music data in the vehicle. The door opening command may be used to instruct the vehicle to control the wing-shaped door to move in real time with the music, or may be used to instruct the vehicle to control the wing-shaped door to move in real time with the music while controlling the wing-shaped door to open.

[0025] The door opening command may be input by the user pressing a physical button included in the vehicle, or by the user touching a touch screen included in the vehicle, or by the vehicle analyzing audio data collected by a sound pickup device included in the vehicle, or by the vehicle obtaining the command from an associated electronic device or the cloud through wireless communication technology (such as Bluetooth, WiFi, Zigbee, and other wireless communication technologies). In this embodiment, the manner in which the vehicle obtains the door opening command is not limited herein.

[0026] Among them, a microphone array can be set in the vehicle; based on this, the vehicle can collect the music signal played in the car through the microphone array, and can convert the audio analog music signal into a digital signal through an analog-to-digital converter.

[0027] In some embodiments, the vehicle can collect audio signals in the vehicle through a microphone array, and can analyze and identify the audio signals, distinguish mixed sound sources, remove noise, and filter the collected audio signals to obtain target music data. Among them, the electronic device can perform feature recognition on the audio signal, filter out the ambient noise in the vehicle, the voice communication noise of the passengers, etc., and can analyze the intensity and frequency characteristics of the real-time music. At the same time, through filtering, the connection of the audio signal can be smoothed to improve the validity of the target audio data.

[0028] Optionally, the vehicle can distinguish mixed sound sources of audio signals by analyzing the time difference between the audio signals collected by the microphone array; the vehicle can also separate the sound sources of audio signals collected inside the vehicle through the microphone array through deep learning; optionally, the vehicle can also separate the sound sources of audio signals collected inside the vehicle through sound source localization combined with the microphone array.

[0029] Optionally, the vehicle can remove noise and filter the collected audio signals in the vehicle through a linear filter; it can also remove noise through deep learning; it can also remove noise and filter the collected audio signals in the vehicle through a real-time noise reduction algorithm based on a statistical model (such as WebRTC's noise reduction algorithm, spectral subtraction algorithm, Wiener filter algorithm, Fourier transform algorithm, etc.). The noise of the audio signal in the vehicle may include environmental noise, voice communication noise of passengers, etc.

[0030] The sound source of the target music data in the vehicle may be a playback device of the vehicle or a playback device of an electronic device in the vehicle, which is not limited here.

[0031] Step S120: Acquire the volume and frequency of the target music data.

[0032] In some embodiments, after the vehicle obtains the target music data, it can perform feature extraction and time series analysis on the target music data to obtain the volume and frequency of the target music data. The vehicle can perform feature recognition and time series analysis on the target music data by deep learning to obtain the volume and frequency of the target music data. The vehicle can also perform feature recognition and time series analysis on the target music data by a preset algorithm to obtain the volume and frequency of the target music data. The preset algorithm may include a Fourier transform algorithm, a pitch detection algorithm, a short-time Fourier transform, and the like.

[0033] Step S130: Determine the door opening parameters of the vehicle according to the volume and / or the frequency.

[0034] In some embodiments, after obtaining the volume and frequency of the target music data, the vehicle can determine the door opening parameters of the vehicle according to the volume and / or the frequency. The door opening parameters of the vehicle may include the door opening amplitude, door opening speed, door opening duration, etc.

[0035] As an implementable method, the vehicle may be pre-set with a mapping relationship between multiple volumes and multiple opening amplitudes; wherein the corresponding relationship between multiple volumes and multiple opening amplitudes may be a one-to-one corresponding relationship or a many-to-one corresponding relationship; wherein multiple volumes and multiple opening amplitudes may be positively correlated or negatively correlated, which is not limited here. Optionally, the vehicle may also be pre-set with a mapping relationship between multiple volumes and multiple opening speeds; wherein the corresponding relationship between multiple volumes and multiple opening speeds may be a one-to-one corresponding relationship or a many-to-one corresponding relationship. Optionally, the vehicle may also be pre-set with a mapping relationship between multiple frequencies and multiple opening amplitudes; wherein the corresponding relationship between multiple frequencies and multiple opening amplitudes may be a one-to-one corresponding relationship or a many-to-one corresponding relationship; wherein multiple frequencies and multiple opening speeds may be positively correlated or negatively correlated, which is not limited here. Optionally, the vehicle may also be pre-set with a mapping relationship between multiple frequencies and multiple opening speeds; wherein the corresponding relationship between multiple frequencies and multiple opening speeds may be a one-to-one corresponding relationship or a many-to-one corresponding relationship.

[0036] Exemplarily, a mapping relationship between multiple volume levels and multiple opening amplitudes may be pre-set in the vehicle. The mapping relationship between multiple volume levels and multiple opening amplitudes may be set by the user independently or obtained through third-party experimental data; the multiple volume levels and multiple opening amplitudes with a mapping relationship may be set by the user independently or obtained through third-party experimental data, so that the volume of the music is matched with the amplitude of the door opening and closing according to the mapping relationship, so that the wing-shaped door can move dynamically with the music. In the mapping relationship, the maximum volume value among the multiple volume levels may correspond to the maximum value of the opening amplitude of the multiple doors, and the minimum volume value among the multiple volume levels may correspond to the minimum value of the opening amplitude of the multiple doors. The multiple volume levels in the mapping relationship correspond one-to-one to the opening amplitudes of the multiple doors and are positively correlated.

[0037] Exemplarily, a mapping relationship between multiple frequencies and multiple opening speeds may be pre-set in the vehicle. The mapping relationship between multiple frequencies and multiple opening speeds may be set by the user independently or obtained through third-party experimental data; the multiple frequencies with a mapping relationship and multiple opening speeds may be set by the user independently or obtained through third-party experimental data, so as to match the frequency of the music with the speed of the door opening and closing according to the mapping relationship, and realize the dynamic rhythm of the wing-shaped door with the music. In the mapping relationship, the maximum frequency value among the multiple frequencies may correspond to the maximum opening speed of the multiple doors, and the minimum frequency value among the multiple frequencies may correspond to the minimum opening speed of the multiple doors. The multiple frequencies in the mapping relationship correspond to the multiple opening speeds one by one and are positively correlated.

[0038] As an implementable manner, a mapping relationship between multiple volume levels or multiple frequencies and multiple turn-on time lengths may be pre-set in the vehicle; wherein the correspondence between multiple volume levels or multiple frequencies and multiple turn-on time lengths may be a one-to-one correspondence or a many-to-one correspondence; wherein the multiple volume levels or multiple frequencies and the multiple turn-on time lengths may be positively correlated or negatively correlated, which is not limited here.

[0039] Among them, after the vehicle obtains the volume and frequency corresponding to the target music data, the vehicle's door opening parameters can be determined according to the volume and / or the frequency.

[0040] Step S140: Controlling the wing door of the vehicle to open with the door opening parameters.

[0041] In some embodiments, after the vehicle determines the door opening parameters of the vehicle according to the target music data, the wing door of the vehicle can be controlled to open with the door opening parameters. The vehicle can generate a corresponding control signal according to the door opening parameters, and send the control signal to the door logic execution module of the wing door of the vehicle through the vehicle bus; accordingly, the door logic execution module can execute the control signal to control the hinge of the wing door, so as to achieve the real-time rhythm of the wing door with the music. Exemplarily, the door opening parameters include opening amplitude and opening speed; the vehicle determines the opening amplitude of the wing door based on the volume of the target music data, and the vehicle determines the opening speed of the wing door based on the frequency of the target music data, thereby generating a first control signal corresponding to the opening amplitude for controlling the opening amplitude of the wing door, and generating a second control signal corresponding to the opening speed for controlling the opening speed of the wing door; accordingly, the vehicle can control the opening of the wing door of the vehicle based on the first control signal and the second control signal.

[0042] A door control method provided in an embodiment of the present application obtains target music data in a vehicle and obtains the volume and frequency of the target music data in response to a door opening command, determines the door opening parameters of the vehicle according to the volume and / or frequency, and controls the wing-shaped doors of the vehicle to open with the door opening parameters, thereby collecting and analyzing the music in the vehicle in real time to obtain the volume and frequency of the music, and controlling the opening and closing of the wing-shaped doors according to the volume and frequency of the music, so as to realize the real-time rhythm of the wing-shaped doors with the music, thereby improving the sense of technology of the vehicle with the wing-shaped doors, and also improving the user's entertainment experience of the vehicle with the wing-shaped doors.

[0043] See also Figure 2 , Figure 2 The flow chart of the door control method provided by an embodiment of the present application is shown in FIG. Figure 2 The process shown is described in detail, and the door control method may specifically include the following steps:

[0044] Step S201: generating the door opening instruction in response to a touch operation on a target button of the vehicle.

[0045] In some embodiments, a target button may be provided in the vehicle, and the target button may be a physical button. The number of the target buttons may be one or more; the target button may be provided in the T-shaped area of ​​the vehicle's steering wheel, in the middle of the vehicle's center console, or above the center console next to the driver's seat in the vehicle. In this embodiment, the location of the target button is not limited.

[0046] As an implementable manner, there are multiple target buttons, each of which can correspond to a different wing-shaped door of the vehicle, wherein the positions of the multiple target buttons in the vehicle can correspond to the positions of the wing-shaped doors corresponding to the target buttons. Accordingly, the vehicle can obtain the touch operation acting on each target button, and based on the touch operation, control the wing-shaped door corresponding to each target button to move in real time with the music.

[0047] As another practicable manner, the number of the target button is one. Accordingly, the vehicle can obtain the touch operation acting on the target button, and control each wing door of the vehicle to move in real time with the music based on the touch operation.

[0048] Among them, the user can control the wing-shaped door to move in real time with the music by touching the target button, which improves the user's interactive experience with the vehicle. Among them, the vehicle can respond to the touch operation of the target button of the vehicle and generate a door opening instruction. Among them, the vehicle can obtain the pressure of the target button through the pressure sensor. If the pressure is greater than the pressure threshold, it can be determined that the touch operation of the target button of the vehicle is detected, and the door opening instruction can be generated.

[0049] Step S202: In response to a door opening instruction, obtaining audio data in the vehicle.

[0050] In some embodiments, after the vehicle receives the door opening instruction, it can respond to the door opening instruction and obtain audio data in the vehicle. A microphone array can be provided in the vehicle; accordingly, the vehicle can respond to the door opening instruction and collect the sound signal in the vehicle in real time through the microphone array, and can convert the sound signal into a digital signal through an analog-to-digital converter.

[0051] Step S203: Filtering first music data from the audio data, wherein the sound source of the first music data is a playback device in the vehicle.

[0052] In some implementations, after the vehicle obtains the audio data, the first music data may be filtered out from the audio data; wherein the sound source of the first music data may be a playback device in the vehicle.

[0053] In some embodiments, a first model may be pre-set in the vehicle, and the first model may be used to identify the sound source of the sound signal in the audio data (e.g., a playback device in the vehicle, a person in the vehicle, etc.), and filter the first music data whose sound source is the playback device in the vehicle from the audio data. The first model may be a combination of a convolutional neural network and a recurrent neural network. Accordingly, after the vehicle obtains the audio data, the audio data may be input into the first model to obtain the first music data output by the first model.

[0054] Step S204: Perform noise filtering on the first music data to obtain second music data.

[0055] In some embodiments, after the vehicle obtains the first music data, it may perform noise filtering on the first music data to obtain the second music data, wherein the noise filtering may include removing human voices, vehicle interior noise, etc.

[0056] In some embodiments, a second model may be pre-set in the vehicle, and the second model may be used to filter out noise other than music in the audio data. The second model may be a combination of a convolutional neural network and a recurrent neural network; the second model may be the same model as the first model, or may be a different model, which is not limited here. Accordingly, after the vehicle obtains the first music data, the first music data may be input into the second model, and the first music data may be subjected to noise filtering processing by the second model to obtain the second music data output by the second model.

[0057] Step S205: Filter the second music data to obtain the target music data.

[0058] In some embodiments, after the vehicle obtains the second music data, it can filter the second music data to obtain the target music data. The filtering of the second music data by the vehicle can be understood as smoothing the connection of the digital signal, thereby improving the accuracy of the obtained music data.

[0059] In some embodiments, a third model may be pre-set in the vehicle, and the third model may be used to filter the audio data. The third model may be a combination of a convolutional neural network and a recurrent neural network; the third model may be the same model as the first model, or may be a different model, which is not limited here. Accordingly, after the vehicle obtains the second music data, the second music data may be input into the third model, and the second music data may be filtered by the third model to obtain the target music data output by the third model.

[0060] Step S206: Input the target music data into a preset model.

[0061] In some embodiments, a preset model may be pre-set in the vehicle, and the preset model may be used to perform feature recognition, time series analysis, and other processing on the audio data. The preset model may be a combination of a convolutional neural network and a recurrent neural network; the target model may be the same model as the first model, or may be a different model, which is not limited here. After the vehicle obtains the target music data, the target audio data may be input into the preset model.

[0062] Step S207: performing feature extraction and timing analysis on the target music data through the preset model to obtain the volume and frequency of the target music data output by the preset model.

[0063] In some embodiments, after the vehicle inputs the target music data into a preset model, the preset model can be used to perform feature extraction and timing analysis on the target music data to obtain the volume and frequency of the target music data output by the preset model.

[0064] Exemplarily, the preset model and the first model are the same model, which is a combination of a convolutional neural network and a recurrent neural network; wherein, after the vehicle obtains audio data in the vehicle, the audio data can be input into the preset model, and the preset model can be used to filter out first music data whose sound source is a playback device in the vehicle from the audio data, and the preset model can be used to perform noise filtering on the first music data to obtain second music data, and the preset model can be used to filter the second music data to obtain target music data, and the preset model can be used to perform feature extraction and timing analysis on the target music data to obtain the volume and frequency of the target music data output by the preset model. Among them, considering that the Fourier transform algorithm is very sensitive to noise and its ability to separate signals and noise is relatively general, the Fourier transform algorithm has limited frequency resolution for music and is not sensitive enough to tracking beat detection in real-time music. It may not be able to accurately capture rapid changes in music signals, and it is also unable to provide accurate time information for sudden changes in sound signals. Based on this, in this embodiment, the vehicle uses a deep learning algorithm to parse real-time music in the car and extract music features. By adopting a deep learning technology that is a combination of convolutional neural networks and recurrent neural networks, feature extraction and timing analysis are performed on the collected music signals, so as to effectively identify the music and noise signals played in real time in the car, and perform filtering processing to improve the accuracy of volume and frequency recognition of music rhythm.

[0065] In some embodiments, the vehicle may be pre-set with a deep learning model to be trained, and the deep learning model to be trained may be used to identify and analyze music features and output the volume and frequency of the music; wherein the deep learning network structure of the deep learning model to be trained may be a combination of a convolutional neural network and a recurrent neural network. Accordingly, the vehicle may obtain an audio data set in the vehicle from an associated cloud or electronic device; wherein the audio data set may include multiple audio data and each of the multiple audio data has a corresponding feature annotation. The audio data may include human voices, in-car noise, in-car music, etc. The feature annotation may include a sound source annotation, a volume annotation, and a frequency annotation. The sound source annotation may be used to characterize the sound source corresponding to the audio data, such as a playback device in the vehicle, a passenger in the vehicle, etc.; the volume annotation may be used to characterize the volume corresponding to the audio data, and the frequency annotation may characterize the frequency corresponding to the audio data.

[0066] The vehicle can train the deep learning model to be trained based on the audio data set to obtain a preset model. The vehicle can input the audio data in the audio data set into the deep learning model to be trained to obtain the output of the deep learning model to be trained, and can obtain the loss of the deep learning model to be trained based on the feature annotation corresponding to the audio data and the output, and can adjust the parameters of the deep learning model to be trained based on the loss until the deep learning model to be trained converges to obtain the preset model, so that the vehicle can perform audio signal analysis and recognition on the audio data based on the preset model, and perform mixed sound source distinction, noise processing and filtering, as well as feature extraction and timing analysis, and separate the volume and frequency of the in-car music in the audio data, so as to use the deep learning analysis method to extract the features of the real-time music in the car, and improve the accuracy of the volume and frequency recognition of the music.

[0067] Step S208: determining the opening amplitude according to the volume, and / or determining the opening amplitude according to the frequency, wherein the opening amplitude is positively correlated with the volume, and the opening amplitude is positively correlated with the frequency.

[0068] As an implementable manner, after the vehicle obtains the volume of the target music data in the vehicle, the opening amplitude of the wing-shaped door of the vehicle can be determined according to the volume. Among them, the opening amplitude of the wing-shaped door can be positively correlated with the volume. Exemplarily, the maximum value of the music volume played by the playback device of the vehicle corresponds to the first amplitude of the wing-shaped door opening, and the minimum value of the music volume played corresponds to the second amplitude of the wing-shaped door opening; wherein the first amplitude is greater than the second amplitude. Among them, the first amplitude and the second amplitude can be pre-set in the vehicle, can be set by the user independently, or can be obtained from third-party experimental data. Optionally, the volume in the range from the minimum value of the music volume played to the maximum value of the music volume played can be in direct proportion to the opening amplitude between the second amplitude of the wing-shaped door opening and the first amplitude of the wing-shaped door opening, or can be a positively correlated functional relationship, which is not limited here.

[0069] As another feasible method, after the vehicle obtains the frequency of the target music data in the vehicle, the opening amplitude of the wing-shaped door of the vehicle can be determined according to the frequency. Among them, the opening amplitude of the wing-shaped door can be positively correlated with the frequency. Exemplarily, the frequency of the music is greater than the third amplitude of the opening of the wing-shaped door corresponding to the first threshold, and the frequency of the music is less than the fourth amplitude of the opening of the wing-shaped door corresponding to the second threshold; wherein the third amplitude is greater than the fourth amplitude. Among them, the third amplitude and the fourth amplitude can be pre-set in the vehicle, can be set by the user independently, or can be obtained from third-party experimental data. Optionally, the frequency of the music in the interval from the second threshold to the first threshold can be in direct proportion to the opening amplitude between the fourth amplitude of the opening of the wing-shaped door and the third amplitude of the opening of the wing-shaped door, or can be a positively correlated functional relationship, which is not limited here.

[0070] As another practicable manner, after the vehicle obtains the volume of the target music data in the vehicle, the fifth amplitude of the wing-shaped door opening can be determined according to the volume, and after the vehicle obtains the frequency of the target music data in the vehicle, the sixth amplitude of the wing-shaped door opening can be determined according to the frequency. Accordingly, the vehicle can determine the opening amplitude of the wing-shaped door based on the fifth amplitude and the sixth amplitude, for example, determining the minimum value, maximum value, average value, etc. of the fifth amplitude and the sixth amplitude as the opening amplitude of the wing-shaped door.

[0071] Step S209: determining the opening speed according to the volume, and / or determining the opening speed according to the frequency, wherein the opening speed is positively correlated with the volume, and the opening speed is positively correlated with the frequency.

[0072] As an implementable manner, after the vehicle obtains the volume of the target music data in the vehicle, the opening speed of the wing-shaped door of the vehicle can be determined according to the volume. Among them, the opening speed of the wing-shaped door can be positively correlated with the volume. Exemplarily, the maximum value of the music volume played by the playback device of the vehicle corresponds to the first speed of the wing-shaped door opening, and the minimum value of the music volume played corresponds to the second speed of the wing-shaped door opening; wherein the first speed is greater than the second speed. Among them, the first speed and the second speed can be pre-set in the vehicle, can be set by the user independently, or can be obtained from third-party experimental data. Optionally, the volume in the range from the minimum value of the music volume played to the maximum value of the music volume played can be directly proportional to the opening speed between the second speed of the wing-shaped door opening and the first speed of the wing-shaped door opening, or can be a positively correlated functional relationship, which is not limited here.

[0073] As another feasible method, after the vehicle obtains the frequency of the target music data in the vehicle, the opening speed of the wing-shaped door of the vehicle can be determined according to the frequency. Among them, the opening speed of the wing-shaped door can be positively correlated with the frequency. Exemplarily, the frequency of the music is greater than the third threshold corresponding to the third speed of the wing-shaped door opening, and the frequency of the music is less than the fourth threshold corresponding to the fourth speed of the wing-shaped door opening; wherein the third speed is greater than the fourth speed. Among them, the third speed and the fourth speed can be pre-set in the vehicle, can be set by the user independently, or can be obtained from third-party experimental data. Optionally, the frequency of the music in the interval from the fourth threshold to the third threshold can be in direct proportion to the opening speed between the fourth speed of the wing-shaped door opening and the third speed of the wing-shaped door opening, or can be a positively correlated functional relationship, which is not limited here.

[0074] As another practicable manner, after the vehicle obtains the volume of the target music data in the vehicle, the fifth speed of opening the wing-shaped door can be determined according to the volume, and after the vehicle obtains the frequency of the target music data in the vehicle, the sixth speed of opening the wing-shaped door can be determined according to the frequency. Accordingly, the vehicle can determine the opening speed of the wing-shaped door based on the fifth speed and the sixth speed, such as determining the minimum value, maximum value, average value, etc. of the fifth speed and the sixth speed as the opening speed of the wing-shaped door.

[0075] Step S210: Controlling the wing door of the vehicle to open with the door opening parameters, wherein the door opening parameters include an opening amplitude and an opening speed.

[0076] In some embodiments, the door opening parameters determined by the vehicle according to the frequency and / or volume of the music in the vehicle include the opening amplitude and opening speed of the wing-shaped doors. Accordingly, the vehicle can control the wing-shaped doors of the vehicle to open with the door opening parameters, so that the vehicle can respond to the rhythm of the music in real time and synchronize the door opening and closing actions with the rhythm of the music, thereby enhancing the entertainment and interactivity of the vehicle.

[0077] For example, please refer to Figure 3 and Figure 4 , Figure 3 A structural block diagram of a wing-type door control system provided in one embodiment of the present application is shown. Figure 4 A flow chart of a door control method provided by an embodiment of the present application is shown. Among them, the wing-type door control system may include a music acquisition module, a deep learning recognition module, a door logic control module and a door logic execution module. Among them, the music acquisition module may include a microphone array, which can be used to collect audio data in the vehicle in real time, and can convert the audio signal into a digital signal. Among them, the deep learning recognition module can be used to perform feature recognition on the audio data, and can perform noise reduction and filtering on the audio data to obtain the volume and frequency of the music data in the vehicle. Among them, the deep learning recognition module can filter the ambient noise in the car, the voice communication noise of the passengers, etc. included in the audio data, and can also smooth the connection of the digital signal through filtering.

[0078] Among them, the door logic control module may be pre-set with a first mapping relationship between volume and the door opening amplitude, and a second mapping relationship between frequency and door opening speed. Accordingly, the door logic control module may obtain an opening amplitude matching the volume based on the first mapping relationship and the volume of the audio data; and may obtain an opening speed matching the frequency based on the second mapping relationship and the frequency of the audio data. Accordingly, after the door logic control module determines the opening amplitude and the opening speed, it may generate a control signal corresponding to the opening amplitude and the opening speed, and may send the control signal to the door logic execution module through the vehicle bus. Accordingly, the door logic execution module may execute the control signal to control the wing-shaped door of the vehicle to open based on the opening amplitude and the opening speed, thereby realizing the real-time rhythm of the wing-shaped door with the music.

[0079] In some embodiments, when the vehicle is controlling the wing-shaped door of the vehicle to open with the door opening parameter, if it is detected that the music in the vehicle stops playing, the wing-shaped door can be controlled to stop rhythmically. Optionally, the vehicle can control the wing-shaped door to maintain the current door open state to stop the rhythm; the vehicle can also control the wing-shaped door to be in the door closed state to stop the rhythm.

[0080] As an implementable method, when the vehicle is controlling the vehicle's wing-shaped doors to open with door opening parameters, if a touch operation acting on a target button of the vehicle is detected, a door rhythmic closing command can be generated, and the wing-shaped doors can be controlled to stop rhythmically in response to the door rhythmic closing command.

[0081] Compared with the vehicle door control method provided by an embodiment of the present application, Figure 1The door control method shown in the embodiment can also generate a door opening instruction in response to the touch operation on the target button of the vehicle, so as to control the door in response to the touch operation on the target button, and improve the accuracy of controlling the wing-shaped door to follow the rhythm of the music. In addition, the embodiment can also obtain the audio data in the vehicle in response to the door opening instruction, filter the first music data from the audio data, wherein the sound source of the first music data is the playback device in the vehicle, perform noise filtering on the first music data to obtain the second music data, perform filtering on the second music data to obtain the target music data, thereby performing sound source distinction, noise reduction and filtering on the audio data in the vehicle to obtain the music data in the vehicle in real time, and improve the accuracy of obtaining the music data in the vehicle. At the same time, the embodiment can also input the target music data into the preset model, perform feature extraction and time series analysis on the target music data through the preset model, and obtain the volume and frequency of the target music data output by the preset model, so as to use the deep learning model to parse the real-time music, separate the volume and frequency of the music, and improve the accuracy and efficiency of obtaining the volume and frequency of the music. At the same time, in this embodiment, the door opening parameters may include opening amplitude and opening speed. In this embodiment, the opening amplitude can also be determined according to the volume, and / or the opening amplitude can be determined according to the frequency, wherein the opening amplitude is positively correlated with the volume, and the opening amplitude is positively correlated with the frequency, the opening speed can be determined according to the volume, and / or the opening speed can be determined according to the frequency, wherein the opening speed is positively correlated with the volume, and the opening speed is positively correlated with the frequency, thereby determining the opening parameters of the wing-shaped door according to the analysis results of the music rhythm, thereby realizing the real-time rhythm of the wing-shaped door with the music, thereby improving the sense of technology and entertainment experience of the entire vehicle.

[0082] See also Figure 5 , Figure 5 The flow chart of the door control method provided by an embodiment of the present application is shown in FIG. Figure 5 The process shown is described in detail, and the door control method may specifically include the following steps:

[0083] Step S310: In response to the door opening instruction, the speed of the vehicle is obtained.

[0084] In some embodiments, the vehicle may obtain the vehicle speed in response to the door opening command. Alternatively, the vehicle may obtain the vehicle speed through a vehicle speed sensor, a navigation system, an inertial vehicle unit, or a radar detector.

[0085] Step S310: If the vehicle speed is zero, the target music data is obtained.

[0086] In some embodiments, after obtaining the vehicle speed, the vehicle can determine whether the vehicle speed is zero. If it is determined that the vehicle speed is zero, the target music data in the vehicle can be obtained, so that when the vehicle speed is zero, the vehicle's wing doors are controlled based on the rhythm of the music in the vehicle, thereby improving the safety of the vehicle.

[0087] Step S330: Acquire the volume and frequency of the target music data.

[0088] Step S340: Determine the door opening parameters of the vehicle according to the volume and / or the frequency.

[0089] Step S350: Controlling the wing door of the vehicle to open with the door opening parameters.

[0090] For the detailed description of step S330 to step S350, please refer to the above description of step S120 to step S140, which will not be repeated here.

[0091] Compared with the vehicle door control method provided by an embodiment of the present application, Figure 1 The door control method shown in this embodiment can also respond to the door opening command to obtain the vehicle speed. If the vehicle speed is zero, the target music data is obtained, so that when the vehicle speed is zero, the vehicle's wing-shaped doors are controlled based on the rhythm of the music in the car, thereby improving the safety of the vehicle.

[0092] See also Figure 6 , Figure 6 The flow chart of the door control method provided by an embodiment of the present application is shown in FIG. Figure 6 The process shown is described in detail, and the door control method may specifically include the following steps:

[0093] Step S410: In response to the door opening instruction, obtaining the gear information of the vehicle.

[0094] In some embodiments, the vehicle may obtain the gear information of the vehicle in response to the door opening command. Alternatively, the vehicle may detect the position of the vehicle's gear lever to determine the gear information of the vehicle, or the vehicle may determine the gear information of the vehicle by detecting the mark on the gear lever, for example, if the letter "P" is displayed on the gear lever, it is determined that the current gear of the vehicle is the parking gear.

[0095] Step S410: If the gear information is the parking gear, the target music data is obtained.

[0096] In some embodiments, after the vehicle obtains the gear information, it determines whether the gear information is the parking gear. If it is determined that the gear information is the parking gear, the target music data in the vehicle can be obtained, so that when the vehicle is in the parking gear, the wing-shaped doors of the vehicle are controlled based on the rhythm of the music in the vehicle, thereby improving the safety of the vehicle.

[0097] Step S430: Acquire the volume and frequency of the target music data.

[0098] Step S440: Determine the door opening parameters of the vehicle according to the volume and / or the frequency.

[0099] Step S450: Controlling the wing door of the vehicle to open with the door opening parameters.

[0100] For the detailed description of step S430 to step S450, please refer to the above description of step S120 to step S140, which will not be repeated here.

[0101] Compared with the vehicle door control method provided by an embodiment of the present application, Figure 1 The door control method shown in this embodiment can also respond to the door opening command to obtain the gear information of the vehicle. If the gear information is the parking gear, the target music data is obtained, so that when the vehicle is in the parking gear, the wing-shaped door of the vehicle is controlled based on the rhythm of the music in the car, thereby improving the safety of the vehicle.

[0102] See also Figure 7 , Figure 7 The module block diagram of the vehicle door control device provided by an embodiment of the present application is shown. The vehicle door control device 200 is applied to the above-mentioned vehicle. Figure 7 The process shown in the figure is described in detail, the door control device 200 includes: a music data acquisition module 210, a music feature acquisition module 220, a door opening parameter determination module 230 and a wing door control module 240, wherein:

[0103] The music data acquisition module 210 is used to acquire target music data in the vehicle in response to a door opening instruction.

[0104] The music feature acquisition module 220 is used to acquire the volume and frequency of the target music data.

[0105] The door opening parameter determination module 230 is used to determine the door opening parameters of the vehicle according to the volume and / or the frequency.

[0106] The wing door control module 240 is used to control the wing door of the vehicle to open with the door opening parameters.

[0107] Further, the door opening parameters include an opening amplitude and an opening speed, and the door opening parameter determination module 230 may include: a door opening parameter determination first unit and a door opening parameter determination second unit, wherein:

[0108] The first door opening parameter determination unit is used to determine the opening amplitude according to the volume and / or determine the opening amplitude according to the frequency, wherein the opening amplitude is positively correlated with the volume and the opening amplitude is positively correlated with the frequency.

[0109] The door opening parameter determines the second unit, which is used to determine the opening speed according to the volume and / or determine the opening speed according to the frequency, wherein the opening speed is positively correlated with the volume and the opening speed is positively correlated with the frequency.

[0110] Furthermore, the music data acquisition module 210 may include: an audio data acquisition unit, a sound source distinguishing unit, a noise filtering unit and a filtering unit, wherein:

[0111] The audio data acquisition unit is used to acquire audio data in the vehicle.

[0112] The sound source distinguishing unit is used to filter the first music data from the audio data, wherein the sound source of the first music data is the playback device in the vehicle.

[0113] The noise filtering unit is used to perform noise filtering on the first music data to obtain second music data.

[0114] The filtering unit is used to filter the second music data to obtain the target music data.

[0115] Furthermore, the music data acquisition module 210 may also include: a vehicle speed acquisition unit and a first music data acquisition unit, wherein:

[0116] The vehicle speed acquisition unit is used to acquire the vehicle speed of the vehicle in response to the door opening instruction.

[0117] The first music data acquisition unit is used to acquire the target music data if the vehicle speed is zero.

[0118] Furthermore, the music data acquisition module 210 may also include: a gear information acquisition unit and a second music data acquisition unit, wherein:

[0119] The gear information acquisition unit is used to acquire the gear information of the vehicle in response to the door opening instruction.

[0120] The second music data acquisition unit is used to acquire the target music data if the gear information is the parking gear.

[0121] Furthermore, before acquiring the target music data in the vehicle in response to the door opening instruction, the door control device 200 may further include: a touch response unit, wherein:

[0122] A touch response unit is used to respond to a touch operation on a target button of the vehicle and generate the door opening instruction.

[0123] Furthermore, the music feature acquisition module 220 may include: an input model unit and a music feature acquisition sub-unit, wherein:

[0124] The input model unit is used to input the target music data into a preset model.

[0125] The music feature acquisition subunit is used to perform feature extraction and timing analysis on the target music data through the preset model to obtain the volume and frequency of the target music data output by the preset model.

[0126] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0127] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0128] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0129] See also Figure 8 , which shows a structural block diagram of a vehicle 100 provided in an embodiment of the present application. The vehicle 100 may be an electric vehicle, a gasoline vehicle, a tricycle, or other vehicle with processing capabilities. The vehicle 100 in the present application may include one or more of the following components: a wing door 101, a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more programs are configured to execute the method described in the aforementioned method embodiment.

[0130] Among them, the wing-shaped door 101 is also called a gull-wing door or a butterfly door. Its characteristic is that the door hinge is located on the roof. When the door is opened, the wing-shaped door 101 will expand upward and outward, and its shape is similar to a wing.

[0131] Among them, the processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire vehicle 100, and executes various functions and processes data of the vehicle 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 110 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0132] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data created by the vehicle 100 during use (such as a phone book, audio and video data, chat record data), etc.

[0133] See also Fig. 9 , which shows a structural block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable medium 300 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0134] The computer readable storage medium 300 can be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable storage medium 300 includes a non-transitory computer-readable storage medium. The computer readable storage medium 300 has storage space for program code 310 that performs any method steps in the above method. These program codes can be read from or written to one or more computer program products. The program code 310 can be compressed, for example, in an appropriate form.

[0135] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A door control method, characterized in that: The method comprises: Responding to a door opening instruction, acquiring target music data in the vehicle; Acquire the volume and frequency of the target music data; determining a door opening parameter of the vehicle according to the volume and / or the frequency; The wing door of the vehicle is controlled to open with the door opening parameter.

2. The method according to claim 1, characterized in that The door opening parameters include an opening amplitude and an opening speed, and determining the door opening parameters of the vehicle according to the volume and / or the frequency includes: Determine the opening amplitude according to the volume, and / or determine the opening amplitude according to the frequency, wherein the opening amplitude is positively correlated with the volume, and the opening amplitude is positively correlated with the frequency; The opening speed is determined according to the volume, and / or the opening speed is determined according to the frequency, wherein the opening speed is positively correlated with the volume, and the opening speed is positively correlated with the frequency.

3. The method according to claim 1, characterized in that: The step of obtaining target music data in the vehicle includes: Acquiring audio data in the vehicle; Filtering first music data from the audio data, wherein the sound source of the first music data is a playback device in the vehicle; Performing noise filtering on the first music data to obtain second music data; The second music data is filtered to obtain the target music data.

4. The method according to any one of claims 1 to 3, characterized in that: The step of obtaining target music data in the vehicle in response to the door opening instruction includes: In response to the door opening instruction, obtaining the speed of the vehicle; If the vehicle speed is zero, the target music data is obtained.

5. The method according to any one of claims 1 to 3, characterized in that: The step of obtaining target music data in the vehicle in response to the door opening instruction includes: In response to the door opening instruction, acquiring gear information of the vehicle; If the gear information is the parking gear, the target music data is obtained.

6. The method according to any one of claims 1 to 3, characterized in that: Before acquiring the target music data in the vehicle in response to the door opening instruction, the method further includes: In response to a touch operation on a target button of the vehicle, the door opening instruction is generated.

7. The method according to any one of claims 1 to 3, characterized in that: The obtaining the volume and frequency of the target music data includes: Inputting the target music data into a preset model; The preset model is used to perform feature extraction and timing analysis on the target music data to obtain the volume and frequency of the target music data output by the preset model.

8. A door control device, characterized in that: The device comprises: A music data acquisition module, for acquiring target music data in the vehicle in response to a door opening instruction; A music feature acquisition module, used to acquire the volume and frequency of the target music data; a door opening parameter determination module, configured to determine a door opening parameter of the vehicle according to the volume and / or the frequency; The wing-shaped door control module is used to control the wing-shaped door of the vehicle to open with the door opening parameters.

9. A vehicle, characterized in that: include: Wing doors; one or more processors; Memory; One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the method according to any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, which can be called by a processor to execute the method according to any one of claims 1 to 7.

Images