An in-vehicle ambient sound synthesis method and device, electronic equipment and storage medium

Abstract

The embodiment of the application provides a kind of vehicle ambient sound synthesis method, device, electronic equipment and storage medium, by collecting ambient sound around vehicle, to obtain the sound frequency of all the sound signals, according to preset basic audio filtering rule and the actual needs of user, determine the corresponding sound frequency of the sound signal with louder sound or the longest duration as ambient base audio;Again according to preset and sound filtering rule, determine the odd harmonic of basic audio as ambient and sound frequency, and preset ambient tempo speed, according to preset ambient tempo speed, ambient and sound frequency and ambient base audio, generate vehicle ambient sound.The embodiment of the application generates vehicle ambient sound by collecting ambient sound, without external source and communication network.At the same time, ambient noise is used as a part of ambient sound, to achieve noise reduction without making users feel bad mood, diversified and sound generation mode also meets the personalized needs of users.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of vehicles, in particular to a vehicle-mounted ambient sound synthesis method and device, electronic equipment and storage medium. BACKGROUND

[0002] In recent years, with the further upgrading of the vehicle cabin, the cabin has become an important living space for users. More and more software applications have entered the vehicle terminal, and the vehicle cabin application software also meets the needs of users. As the third space of the vehicle user, the user spends more time relaxing in the vehicle, and the demand for ambient sound in the vehicle has become an important selling point for vehicle applications.

[0003] At present, ambient sound in the vehicle is realized by accessing external music ambient sound sources. However, this approach has some drawbacks, such as high access cost of the source, dependence of ambient sound generation on the source side, and the need for network updates. In addition, the vehicle air conditioner, engine noise, and external environmental sound will reduce the effect of the ambient sound itself and affect the user's experience. SUMMARY

[0004] The present application provides a vehicle-mounted ambient sound synthesis method, device, electronic equipment and storage medium, which generates ambient sound by collecting and frequency screening the ambient sound during vehicle driving, without accessing external sources and realizing noise reduction during driving.

[0005] In a first aspect, the present application provides a vehicle-mounted ambient sound synthesis method, comprising the following steps:

[0006] Collecting the ambient sound around the vehicle, the ambient sound containing sound signals of different frequencies;

[0007] Obtaining the sound frequencies of all the sound signals, and determining the ambient base audio according to a preset base audio screening rule;

[0008] Determining the ambient and sound frequency according to a preset and sound screening rule;

[0009] Presetting the ambient tempo speed, and generating the vehicle-mounted ambient sound according to the preset ambient tempo speed, the ambient and sound frequency, and the ambient base audio.

[0010] Further, determining the ambient base audio specifically comprises the following steps:

[0011] Obtaining a first sound signal, the first sound signal being the sound signal with the largest loudness among all the sound signals;

[0012] If the difference between the loudness of the first sound signal and the loudness of the sound signal of the next level is greater than a preset threshold, the sound frequency of the first sound signal is determined as the base audio.

[0013] Further, the method for determining the atmosphere and sound frequency further comprises the following steps:

[0014] If the difference between the loudness of the first sound signal and the loudness of the sound signal of the next level is not greater than a preset threshold, a second sound signal is obtained, the second sound signal being the sound signal with the longest duration among all the sound signals;

[0015] The sound frequency of the second sound signal is determined as the base frequency.

[0016] Further, the method for determining the atmosphere and sound frequency further comprises the following steps:

[0017] The atmosphere base frequency is obtained, and an odd harmonic is generated according to the sound frequency of the atmosphere frequency;

[0018] The odd harmonic is determined as the atmosphere and sound frequency.

[0019] Further, the method for determining the atmosphere and sound frequency further comprises the following steps:

[0020] The atmosphere and sound frequency comprises a bright and sound mode and a dim and sound mode;

[0021] In response to an active selection operation of a user, a bright mode or a dim and sound mode is generated, wherein the audio ratio of each sound signal in the bright and sound mode is a:(a+1):(a+2), and the audio ratio of each sound signal in the dim and sound mode is a:(a+2):(a+5+x), wherein a and x are both preset parameters.

[0022] In a second aspect, the present application provides a vehicle-mounted atmosphere sound synthesizing device, comprising:

[0023] A sound collecting module is configured to collect ambient sound around a vehicle, the ambient sound comprising sound signals of different frequencies;

[0024] A base frequency generating module is configured to obtain the sound frequencies of all the sound signals, and determine an atmosphere base frequency according to a preset base frequency screening rule;

[0025] A harmony generating module is configured to determine an atmosphere and sound frequency according to a preset harmony screening rule;

[0026] An atmosphere sound generating module is configured to preset an atmosphere beat speed, and generate the vehicle-mounted atmosphere sound according to the preset atmosphere beat speed, the atmosphere and sound frequency, and the atmosphere base frequency.

[0027] Further, the base frequency generating module further comprises:

[0028] The first sound signal acquisition unit is configured to acquire a first sound signal, the first sound signal being a sound signal with the largest loudness among all the sound signals.

[0029] The first basic audio determination unit is configured to determine a sound frequency of the first sound signal as the basic audio if a difference between the loudness of the first sound signal and the loudness of a sound signal with the second largest loudness exceeds a preset threshold.

[0030] Further, the basic audio generation module further comprises:

[0031] The second sound signal acquisition unit is configured to acquire a second sound signal if the difference between the loudness of the first sound signal and the loudness of the sound signal with the second largest loudness does not exceed the preset threshold, the second sound signal being a sound signal with the longest duration among all the sound signals.

[0032] The second basic audio determination unit is configured to determine the sound frequency of the second sound signal as the basic audio.

[0033] In a third aspect, the present application provides an electronic device, comprising:

[0034] at least one memory and at least one processor;

[0035] The memory is configured to store one or more programs.

[0036] When the one or more programs are executed by the at least one processor, the at least one processor implements the steps of the vehicle ambient sound synthesis method according to the first aspect.

[0037] In a fourth aspect, the present application provides a computer readable storage medium, the computer readable storage medium storing a computer program, the computer program being executed by a processor to implement the steps of the vehicle ambient sound synthesis method according to the first aspect.

[0038] The present application acquires sound frequencies of all the sound signals by collecting ambient sound of a vehicle, determines a corresponding sound frequency of a sound signal with a larger loudness or a sound signal with the longest duration as an ambient basic audio according to a preset ambient basic audio screening rule and actual needs of a user, determines an odd harmonic of the ambient basic audio as an ambient overtone sound frequency according to a preset overtone screening rule, and generates a vehicle ambient sound according to a preset ambient beat speed, the ambient overtone sound frequency and the ambient basic audio. The present application generates a vehicle ambient sound by collecting ambient sound, without an external source and a communication network. Meanwhile, ambient noise is used as a part of the ambient sound, so that noise reduction is achieved without causing a user to have an unpleasant emotion, and diversified overtone generation modes meet personalized needs of the user.

[0039] In order to more clearly illustrate the technical solutions of the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, the accompanying drawings in the following description only only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings. BRIEF DESCRIPTION OF DRAWINGS

[0040] Figure 1 A step flow chart of a vehicle ambient sound synthesis method provided in an exemplary embodiment;

[0041] Figure 2 A module schematic diagram of a vehicle ambient sound synthesis device provided in an exemplary embodiment;

[0042] Figure 3 A schematic diagram of an electronic device provided in an exemplary embodiment. DETAILED DESCRIPTION

[0043] In order to make the purposes, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0044] It should be clear that the described embodiments are only some of the embodiments of the present application, not all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0045] The terms used in the present application are only for the purpose of describing the specific embodiments, and are not intended to limit the present application. The singular forms "a", "an" and "the" used in the present application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein means and includes any or all possible combinations of one or more associated listed items.

[0046] The following description refers to the accompanying drawings. Unless otherwise noted, same or similar components in different drawings have same or similar reference numerals. The implementations described in the following exemplary embodiments are not meant to represent all implementations consistent with the present disclosure. Rather, they are simply examples of apparatuses and methods consistent with some aspects of the present disclosure as detailed in the appended claims. In the description of the present disclosure, it should be understood that the terms "first", "second", "third", etc. are used to distinguish like objects from one another, but are not necessarily used to describe a particular sequential or chronological order, nor are they necessarily used to indicate or imply relative importance. The specific meaning of the above terms in the present disclosure can be understood according to the specific circumstances by those of ordinary skill in the art.

[0047] In addition, in the description of the present disclosure, "a plurality of" means two or more, unless otherwise specified. The association relationship of the associated objects is described by "and / or", which means that there can be three relationships, for example, A and / or B can represent the following three cases: A exists alone, A and B exist together, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after it.

[0048] In the existing noise reduction technology, anti-phase noise reduction is a commonly used technical means. Anti-phase noise reduction is based on the principle of destructive interference of sound waves. When the frequency, amplitude, phase and other parameters of two sound waves are the same, but the directions are opposite, they will have destructive interference, that is, the energy of the two sound waves will cancel each other out, thereby achieving the effect of noise reduction. Specifically, anti-phase noise reduction places a sound source opposite to the noise near the noise source, so that the sound waves emitted by the two sound sources meet and destructively interfere, thereby achieving the effect of noise reduction.

[0049] However, this noise reduction technology will have an impact on driving safety to some extent for vehicles in motion, because some noise is helpful for the driver to make real-time judgments on the road conditions during driving. Once these noises are reduced to a level that the driver cannot perceive through anti-phase noise reduction, it will threaten the driving safety of the vehicle.

[0050] Based on the above concept and background technology, as shown in Figure 1 The embodiment of the present application provides a vehicle-mounted ambient sound synthesis method, which specifically includes the following method steps:

[0051] S201: Collecting ambient sound around the vehicle, the ambient sound containing sound signals of different frequencies.

[0052] In the embodiments of the present application, the sound collecting device is used to collect the ambient sound around the vehicle. Since the sound sources in the external environment are complex, the sound signals constituting the ambient sound include but are not limited to the internal noise during the vehicle driving, the sound of the horn and other noises caused by urban life. The sound collecting device is connected with the terminal device, and the terminal device analyzes and processes the received ambient sound. In some other examples, the terminal device can be a terminal device in the vehicle, or a PC, a smart phone, a tablet computer, a portable computer or other electronic terminal device with the functions of data receiving, data processing and data sending. The sound collecting device is generally an electronic device with the function of sound collecting, such as a recording and video recording device, and can also include a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module and the like.

[0053] S202: Acquire the sound frequency of all the sound signals, and determine the atmosphere base audio according to a preset base audio screening rule.

[0054] The frequency of the ambient audio is high, and the rhythm is chaotic. The synthesis of the atmosphere audio needs a base audio, and in order to achieve the purpose of noise reduction, the sound frequency of the sound signal in the environment needs to be screened according to specific rules.

[0055] In a preferred embodiment, if there is a sound signal with a loudness obviously greater than other sound signals in the ambient sound, the sound frequency of the sound signal with the maximum loudness is selected as the base audio. The first sound signal is acquired, which is the sound signal with the maximum loudness among all the sound signals. If the difference between the loudness of the first sound signal and the loudness of the sound signal with the second largest loudness exceeds a preset threshold, the sound frequency of the first sound signal is determined as the base audio.

[0056] In a preferred embodiment, if there is no sound signal with a large loudness in the ambient sound, the sound signal with the highest occurrence frequency, i.e. the longest duration, is selected as the base audio. Specifically, if the difference between the loudness of the first sound signal and the loudness of the sound signal with the second largest loudness does not exceed a preset threshold, the second sound signal is acquired, which is the sound signal with the longest duration among all the sound signals. The sound frequency of the second sound signal is determined as the base audio.

[0057] In some other examples, the ambient sound of a specific frequency can also be screened as the base audio according to actual needs.

[0058] S203: A preset atmosphere rhythm speed is generated according to the preset atmosphere rhythm speed, the atmosphere, the sound frequency and the atmosphere base audio.

[0059] The synthesis of the ambient sound includes base audio, harmony and beat. Among them, the beat can be adjusted by the user as needed, or can be pre-set, for example, when the user needs to relax, a slower beat speed can be selected; and when the user needs to be excited, a faster beat speed can be selected.

[0060] The generation of the harmony can rely on the determined ambient base audio, or can be set by a specific frequency for screening.

[0061] In a preferred embodiment, determining the ambient and sound frequency specifically includes the following method steps: obtaining the ambient base audio, and generating odd harmonics according to the sound frequency of the ambient audio; confirming that the odd harmonics are the ambient and sound frequency.

[0062] In a preferred embodiment, the ambient and sound frequency includes a bright harmony mode and a dim harmony mode; in response to the user's active selection operation, the bright mode or the dim harmony mode is generated, wherein the audio ratio of each sound signal in the bright harmony mode is a:(a+1):(a+2), and the audio ratio of each sound signal in the dim harmony mode is a:(a+2):(a+5+x), wherein a and x are both preset parameters and are integers not equal to 0.

[0063] Specifically, according to the principle of harmony, the sound frequency which is in odd ratio with the frequency of the base audio can form a chord with the base audio, thereby enhancing the feeling of harmony. By adding two different frequencies which are in a certain integer ratio with the base audio, different feelings can be produced. At the same time, according to the principle of harmony, when the proportion of low, medium and high frequencies in the audio is adjacent, a bright feeling (major chord) will be produced; on the contrary, if the proportion of low, medium and high frequencies in the audio is different, for example, between 10:12 and 12:15, such non-continuous frequency ratio will produce a soft or dim feeling.

[0064] In a specific application scenario, the 220Hz sound is collected and screened from the environment sound as the base sound. Then, based on 220Hz, the odd harmonic 660Hz of it can be matched. When the odd harmonic is matched, the direct matching of the two sounds is harmonious. In some other examples, the 5th harmonic 1100Hz can be matched. Preferably, multiple harmonious sounds can be matched together to form a chord to give people a comfortable listening feeling.

[0065] In another example, the dim harmony mode can also set the high, medium and low frequency ratio to a:(a+x):(a+x+(x-y)), wherein a, x and y are all preset parameters and are integers not equal to 0.

[0066] The embodiment of the present application acquires the sound frequencies of all the sound signals by collecting the ambient sound around the vehicle, determines the corresponding sound frequencies of the sound signal with the largest loudness or the longest duration as the atmosphere base audio according to a preset base audio screening rule and actual needs of a user, determines the odd harmonic of the base audio as the atmosphere and sound frequency according to a preset and sound screening rule, and generates the vehicle-mounted atmosphere sound according to the preset atmosphere beat speed, the atmosphere and sound frequency, and the atmosphere base audio. The embodiment of the present application generates the vehicle-mounted atmosphere sound by collecting the ambient sound, and does not need external sources and communication networks. Meanwhile, the ambient noise is taken as a part of the atmosphere sound, so that noise reduction is achieved without causing a user to have an unpleasant mood, and diversified generation modes of the and sound meet the personalized needs of the user.

[0067] The embodiment of the present application also provides a synthesis device 300 of a vehicle-mounted atmosphere sound, as shown in the figure, comprising: Figure 2

[0068] A sound collecting module 301 is used to collect the ambient sound around the vehicle, and the ambient sound contains sound signals with different frequencies.

[0069] A base audio generating module 302 is used to acquire the sound frequencies of all the sound signals, and determine the atmosphere base audio according to a preset base audio screening rule.

[0070] A and sound generating module 303 is used to determine the atmosphere and sound frequency according to a preset and sound screening rule.

[0071] An atmosphere sound generating module 304 is used to preset an atmosphere beat speed, and generate the vehicle-mounted atmosphere sound according to the preset atmosphere beat speed, the atmosphere and sound frequency, and the atmosphere base audio.

[0072] In an exemplary example, the base audio generating module 302 further comprises:

[0073] A first sound signal acquiring unit is used to acquire a first sound signal, and the first sound signal is the sound signal with the largest loudness in all the sound signals.

[0074] A first base audio determining unit is used to determine the sound frequency of the first sound signal as the base audio if the difference between the loudness of the first sound signal and the loudness of the sound signal with the second largest loudness exceeds a preset threshold.

[0075] In an exemplary example, the base audio generating module 302 further comprises:

[0076] ​The second sound signal acquisition unit is used to acquire a second sound signal if the difference between the loudness of the first sound signal and the loudness of the next loudest sound signal does not exceed a preset threshold. The second sound signal is the sound signal with the longest duration among all the sound signals.

[0077] The second basic audio determination unit is used to determine the sound frequency of the second sound signal as the basic audio.

[0078] It should be noted that the in-vehicle ambient sound synthesis device and the in-vehicle ambient sound synthesis method provided in the above embodiments belong to the same concept. For details of their specific implementation process, please refer to the method embodiments, which will not be repeated here.

[0079] like Figure 3 As shown, Figure 3 This is a structural block diagram of an electronic device according to an exemplary embodiment of this application.

[0080] The electronic device includes a processor 910 and a memory 920. The main control chip may contain one or more processors 910. Figure 3 Taking a processor 910 as an example, the main control chip can contain one or more memory modules 920. Figure 3 Take a memory chip 920 as an example.

[0081] The memory 920, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as the program for synthesizing in-vehicle ambient sound as described in any embodiment of this application, and the program instructions / modules corresponding to the method for synthesizing in-vehicle ambient sound as described in any embodiment of this application. The memory 920 may mainly include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a function; the data storage area may store data created based on the use of the device, etc. Furthermore, the memory 920 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 920 may further include memory remotely located relative to the processor 910, and these remote memories can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0082] The processor 910 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 920, thereby implementing a method for synthesizing in-vehicle ambient sound as described in any of the above embodiments.

[0083] The embodiment of the present application further provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the vehicle-mounted atmosphere sound synthesis method of any one of the above embodiments.

[0084] The application can take the form of a computer program product implemented on one or more storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) including a program code that can be executed by a computer. The computer readable storage medium includes permanent and non-permanent, removable and non-removable media, and can be implemented by any method or technology to store information. The information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device, or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

[0085] It should be understood that the embodiments of the present application are not limited to the precise construction that has been described above and illustrated in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the embodiments of the present application is only limited by the appended claims.

[0086] The above-described embodiments only express several implementation manners of the embodiments of the present application, which are described in detail and specifically, but should not be understood as limitations to the scope of the patent. It should be pointed out that, for ordinary skilled in the art, several modifications and improvements can be made without departing from the concept of the embodiments of the present application, and these all belong to the protection scope of the embodiments of the present application.

Claims

1. A method of synthesizing in-vehicle ambient sound, characterized by, The method comprises the following steps: Collecting the ambient sound around the vehicle, wherein the ambient sound comprises sound signals of different frequencies; Obtaining the sound frequencies of all the sound signals, determining the ambient base audio according to a preset base audio screening rule; Determining the ambient and sound frequency according to a preset and sound screening rule; Presetting the ambient beat speed, and generating the vehicle ambient sound according to the preset ambient beat speed, the ambient and sound frequency, and the ambient base audio; The determination of the ambient base audio specifically comprises the following steps: Obtaining a first sound signal, wherein the first sound signal is the sound signal with the maximum loudness among all the sound signals; If the difference between the loudness of the first sound signal and the loudness of the sound signal of the next level is greater than a preset threshold, the sound frequency of the first sound signal is determined as the base audio; The determination of the ambient base audio further comprises the following method steps: If the difference between the loudness of the first sound signal and the loudness of the sound signal of the next level is not greater than a preset threshold, a second sound signal is obtained, wherein the second sound signal is the sound signal with the longest duration among all the sound signals; The sound frequency of the second sound signal is determined as the base audio; The determination of the ambient and sound frequency specifically comprises the following method steps: Obtaining the ambient base audio, and generating an odd harmonic wave according to the sound frequency of the ambient audio; Confirming that the odd harmonic wave is the ambient and sound frequency.

2. The method of claim 1, wherein the method further comprises: The determination of the ambient and sound frequency specifically comprises the following method steps: The ambient and sound frequency comprises a bright and sound mode and a dim and sound mode; In response to an active selection operation of a user, a bright mode or a dim and sound mode is generated, wherein the audio ratio of each sound signal in the bright and sound mode is a: (a+1): (a+2), and the audio ratio of each sound signal in the dim and sound mode is a: (a+2): (a+5+x), wherein a and x are both preset parameters.

3. An apparatus for synthesizing an in-vehicle ambient sound, characterized by comprising: A method for synthesizing a vehicle ambient sound, comprising: A sound collecting module for collecting the ambient sound around the vehicle, wherein the ambient sound comprises sound signals of different frequencies; A base audio generating module for obtaining the sound frequencies of all the sound signals, and determining the ambient base audio according to a preset base audio screening rule; A and sound generating module for determining the ambient and sound frequency according to a preset and sound screening rule; An ambient sound generating module for presetting the ambient beat speed, and generating the vehicle ambient sound according to the preset ambient beat speed, the ambient and sound frequency, and the ambient base audio; The base audio generating module further comprises: A first sound signal obtaining unit for obtaining a first sound signal, wherein the first sound signal is the sound signal with the maximum loudness among all the sound signals; A first base audio determining unit for determining the sound frequency of the first sound signal as the base audio if the difference between the loudness of the first sound signal and the loudness of the sound signal of the next level is greater than a preset threshold; The base audio generating module further comprises: a second sound signal obtaining unit, configured to obtain a second sound signal if a difference between a loudness of the first sound signal and a loudness of the sound signal of the second order loudness of the first sound signal does not exceed a preset threshold, the second sound signal being the sound signal with the longest duration among all the sound signals; a second fundamental frequency determining unit, configured to determine the sound frequency of the second sound signal as the fundamental frequency.

4. An electronic device, comprising: comprising: at least one memory and at least one processor; the memory, configured to store one or more programs; when the one or more programs are executed by the at least one processor, the at least one processor implements the steps of the vehicle ambient sound synthesis method according to any one of claims 1 to 2.

5. A computer-readable storage medium storing a computer program, the computer program comprising instructions that, when executed by a computer, cause the computer to perform the method of any one of claims 1 to 4. the computer program is executed by the processor to implement the steps of the vehicle ambient sound synthesis method according to any one of claims 1 to 2.

Images